• Visit Website
  • CONTACT
    Los Angeles, CA
    (310) 584-7454

Testing Special Forces

4.7
11 reviews

Testing Special Forces: that’s our motto and we stand by it.

We take pride in making sure our clients are delivering the best  and the most secure software to their customers.

Testing software is our specialty and we are constantly looking for new ways to challenge the status quo. We secure our clients’ QA from start to finish. We also integrate into our partners’ internal QA teams to supplement their needs or to help them improve their internal processes. During the entire testing process, we stay in touch with our clients’ developers which allows us to test fixes in real-time and make suggestions that can benefit the entire project.

We are especially proud of our Security Department, which employs experienced veterans of ethical hacking and social engineering who constantly strives to make the Internet a safer place.

Our certified testers work with our partners in 5 different time zones. This means that we work when you’re working, no matter where you’re located. We are dedicated to our client’s projects from the start and we stay dedicated to projects even after they hit the market.

What separates us from the competition?

Take a look at the numbers:

• Over 50 in-house testers who are 100% ISTQB Certified

• Over 7,000 testers in over 50 countries who are always ready for action

• We have over 7 years of experience and have delivered over 500 successful projects to our clients

• We’re ready for it all: Security, Functional, Performance, Crowdtesting and UX

READ MORE...
 
$1,000+
 
$25 - $49 / hr
 
50 - 249
 Founded
2010
Show all +
Los Angeles, CA
headquarters
other locations

Portfolio

Key clients: 
  • Samsung
  • Philips
  • Credit Agricole
  • T-Mobile
  • Naspers
  • CineWorld
  • Finder by TomTom
  • Credit Suisse
  • ExplainEverything
  • Nomtek
  • Tui
  • RWE
  • Empik
  • Orgintag
  • EyeEm
  • Apator
  • Clearvision
  • Autodesk
  • TomTom
  • Trans.eu
  • Greenwood Campbell
  • Électricité de France

Reviews

4.7
11 reviews
Sort by

Application Testing for a Yacht Rental Platform

"They’ll tell you if something is wrong and won’t hide anything from you." 

See More

5.0

Quality: 
5.0
Schedule: 
4.5
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
Oct. 2018 - Ongoing
Project summary: 

TestArmy provides diverse testing services for mobile apps about to go into production. They’re responsible for regression, UX, and edge-case testing. They also identify discrepancies in use between iOS and Android platforms.

The Reviewer
 
11-50 Employees
 
Fort Lauderdale, Florida
Sam Lepak
Head of Digital Marketing, YachtLife
 
Verified
The Review
Feedback summary: 

No major bugs have slipped through TestArmy’s program into production. Their comprehensive bug tracking via Pivotal and their constant communication have empowered them to investigate all possible technical issues with both iOS and Android apps. Their transparency sets them apart in the industry.

BACKGROUND

Introduce your business and what you do there.

I’m the head of digital marketing at YachtLife, an Airbnb for luxury yachts. We’re no different than a yacht broker, but we’ve become the first mobile app to allow users to charter a luxury yacht for a day, half day, or multiple days on the water.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with TestArmy?

We needed quality assurance, bug reporting, and user acceptance (UA) testing for our mobile apps and our website. We’d create a build and prepare to send it out, but we’d do the testing ourselves and only later find a bug that affected tons of users. We didn’t want that problem. We wanted to ensure a great experience every time we rolled out a new feature or a new app update.

SOLUTION

What was the scope of their involvement?

Initially, we did a two-week discovery sprint so they could learn about the app. That was at a flat rate, which was less than their hourly rate. They comprehended the job quickly, and we decided to do it full-time. They informed us they were going to pair us with a new tester, but that didn’t make sense to me as they had someone learning our whole platform for two weeks. They went back and agreed to keep the original tester on our project.

We build out features in a staging environment, whether it be with our app or our website, and before uploading it to production, we have TestArmy do regression testing, user experience testing, edge-case testing and identify discrepancies across platforms. Basically, they’d try to break it. They test on multiple devices, and they’ve been willing to buy devices if they don’t have a particular one. They’ll also make suggestions based on discrepancies in how it functions on Android vs. iOS. Afterward, they’ll deliver a report to us. When they find a bug, they report it in Pivotal Tracker and let us know in our Slack channel. They don’t do any of the bug fixing. We’re also looking at implementing security testing with them as well because they've spotted a few security issues.

What is the team composition?

We have a project manager, along with a part-time resource.

How did you come to work with TestArmy?

I looked at Capterra reviews and reached out to TestArmy and other QA agencies. I narrowed it down to four or five, and we had calls with them. We went through rounds of interviews. It seemed like a lot of them possessed the same capabilities, but offered them for different prices. We asked TestArmy for two current customer reviews to get their feedback. I was able to ask them questions to see what it was like. That was super helpful, and it solidified our choosing them.

How much have you invested with them?

We spend $2,000/month. They work on a month to month basis, which is awesome. They’ve been extremely flexible with contracts.

What is the status of this engagement?

We’ve been working together since October 2018.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

It’s more of a reactive success metric. After we deploy something, do we have any bugs? After deploying all of our major updates since bringing TestArmy on, we haven’t had any major bugs. There’s been 1–2 edge cases out of everything, but those are outliers. We’re extremely satisfied with the product development side.

How did TestArmy perform from a project management standpoint?

We communicate via Slack, and they’re very responsive. Their tester and product manager are in Slack with us, so they’re like a part of the team. We get a daily summary of everything they work on through Slack too. They report all of their bugs in Pivotal Tracker, and they were willing to accommodate whatever tracking system we wanted. I have a weekly call with them. They’re super transparent, and they confirm all their hours before billing us.

What did you find most impressive about them?

They’re very focused, and the price was well below average for the quality they deliver. Their communication is great. They leave no stone unturned. They’ll tell you if something is wrong and won’t hide anything from you.

Are there any areas they could improve?

Early on, they documented some bugs that were more subjective than objective. We talked to them about it and told them to focus on the objective bugs we could fix. The issue was resolved after that.

Do you have any advice for potential customers?

It helps if they know exactly what you want. In our case, we didn’t know what we wanted, but they helped us figure it out, which was great. If you’re unsure about using them, try out their two-week discovery period and see how it goes. They’re straightforward and transparent and will help you determine what you need, but if you go in knowing what you need, it’ll be easier to determine if they’re right for you.

5.0
Overall Score It’s been near perfect. I’m very surprised by how smoothly things have gone.
  • 4.5 Scheduling
    ON TIME / DEADLINES
    They’re a little out of our time zone, but we’ve set up a different time to talk with them. Everything else has been above satisfactory.
  • 5.0 Cost
    Value / within estimates
    We’ve been very happy with the quality for the price we’re paying.
  • 5.0 Quality
    Service & deliverables
    Everything they’ve delivered has been spot-on. We’ve had zero issues. It’s been great.
  • 5.0 NPS
    Willing to refer
    I’ve recommended them to other friends, colleagues, and app marketers. We’ve had a great relationship and I want that for other people as well.

Software Testing for Consumer Complaints Company

“They’ll independently make suggestions on how we can change our approach and get better results.”

See More

4.5

Quality: 
4.5
Schedule: 
4.0
Cost: 
4.0
Willing to refer: 
5.0
The Project
 
Confidential
 
Oct. 2017 - Ongoing
Project summary: 

TestArmy provides an in-house team with automated QA testing for one of their products. They create and implement all tests and flag issues for further development prior to deployment.

The Reviewer
 
11-50 Employees
 
London, United Kingdom
Hattie Burt
Head of Projects, Resolver
 
Verified
The Review
Feedback summary: 

Their developer is fully integrated with the in-house development team, making it easy to coordinate work and stay on schedule. Thanks to their work, there haven’t been any major issues with the live product thus far.

BACKGROUND

Introduce your business and what you do there.

I’m the head of projects at Resolver. We assist consumers in raising complaints against a company they’ve had an issue with by providing them information about their rights and guiding them through the complaint process. The service is free to consumers, but we also offer a set of enterprise products for companies and regulators that want to resolve consumer complaints.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with TestArmy?

 

They’ve been helping us with a collaborative decision-making product aimed at regulators, courts, and ombudsmen. We brought TestArmy onboard to save time and ensure that deployments go smoothly.

SOLUTION

What was the scope of their involvement?

They provide us with automated testing resources. Their developer participates in regular stand-ups with our team. We deploy new code each week, so while our team is working on development, they’re writing the automated tests for it. Once everything’s ready, they run the tests overnight and flag any issues for our team to review.

What is the team composition?

We currently have one developer who works full-time with us, but we’re looking to expand our use of their services.

How did you come to work with TestArmy?

Our CTO received a referral from a colleague, so we looked into their services and found that they were a good fit for our needs.

What is the status of this engagement?

We started working with them in October 2017 and we’re still working together.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

They’ve integrated really well with our development team and they’re good at proactively solving problems. They’ll independently make suggestions on how we can change our approach and get better results. We hired them to give us confidence that our product would be reliable when we launched it in March 2018 and, due to their QA work, we haven’t had any major issues in the six months since then.

How did TestArmy perform from a project management standpoint?

We manage their individual tester who works with our team, but their administrative team is always helpful when we need to get in touch with them about contracts and scheduling.

What did you find most impressive about them?

 

Integrating testers and developers can be a bit tricky, but the tester we have is a core member of our team. He takes initiative and communicates with the rest of the team to solve problems.

Are there any areas they could improve?

We’ve realized that we need to have more discussion upfront about the strategic approach before they begin writing the tests. We initially went for expediency, but it’s become clear on both sides that we’re better off having those planning conversations at the start.

Do you have any advice for potential customers?

Know what you hope to get out of the engagement and fully integrate their developer into your team if you can. They’re very willing to engage with you as a partner as long as you communicate effectively.

4.5
Overall Score
  • 4.0 Scheduling
    ON TIME / DEADLINES
    The testing gets done on time, but timeliness on the contract side of things could be better.
  • 4.0 Cost
    Value / within estimates
    The value for the junior testers is excellent, but using senior testers is a bit expensive.
  • 4.5 Quality
    Service & deliverables
    They’ve been really consistent and we haven’t had any major issues in the live environment.
  • 5.0 NPS
    Willing to refer
    I’ve recommended them before.

Testing for Financial Services Aggregation API

"The personal touch made the difference."

See More

4.0

Quality: 
4.0
Schedule: 
5.0
Cost: 
4.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
June 2017 - Ongoing
Project summary: 

TestArmy coordinates crowd-testing efforts that require testers to have several unique bank and credit card accounts. They provide end-to-end functionality testing for a financial API. 

The Reviewer
 
11-50 Employees
 
Hamburg, Germany
Project Manager, Financial Services API
 
Verified
The Review
Feedback summary: 

TestArmy has streamlined the testing process, decreasing the time it takes to test and fix an issue from one month of one week. Their communication and reporting are proactive, and the team has helped to lower the cost of testing while providing high quality work. 

BACKGROUND

Introduce your business and what you do there.

I am leading the European expansion of our core company product, a banking-as-a-service platform. We have built an API which helps other businesses—small fintechs and large companies—as well as single developers to easily aggregate different financial services. We currently support more than 3,000 financial services in Germany and Austria; the goal is to expand to 34 other countries, and this is the context within which we’re collaborating with TestArmy.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with TestArmy?

We need to make sure that we can provide direct access to our technology and APIs, but the bigger challenge was testing the integrations we’re building with several teams across Europe. In order to validate that the new financial institution or service we’re aggregating is working well, we need to perform tests with someone who has a real account with a bank or a credit card provider. Getting access to such a testing network was a big challenge for us, but a company like TestArmy could provide this out of the box, along with full management of the test cycles.

SOLUTION

What was the scope of their involvement?

TestArmy provides end-to-end functional testing. They support us with the recruitment of testers and the management of the test cycles, via a frontend we make available to them.

It’s an ongoing collaboration, so I suppose that there will be many other interesting things we’ll discover with TestArmy, but, for now, we’re focused on that.

What is the team dynamic?

We have been involved with at least 4 people from their side, but I’m not sure what the full size of the team is.

How did you come to work with TestArmy?

The process was organic—we went to Google and started searching for “crowd testing”. This was the keyword we used because I knew we actually wanted to have local testing groups. We looked at a couple of other crowd-testing agencies, as well as ones offering similar services, including ones in Berlin. We went with TestArmy because of their high engagement with the project. It was a non-typical set of requirements, namely testers who owned specific bank accounts, for example. TestArmy also had flexibility, and were loose in terms of offering a proof-of-concept project, as well as on how we would organize the cycle and how they would report results. TestArmy also put us in contact with testers directly.

How much have you invested with them?

The total cost has been below $10,000.

What is the status of this engagement?

We started working with TestArmy in June 2017.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

One thing we are measuring is the maintenance cost for each financial system being aggregated via API. Compared to costs per financial source in Germany (where we have an expensive setup in terms of getting tests done), they’ve definitely helped us decrease the number.

Before using TestArmy, we required a month of work for fixing an issue and going back to test it again. Because of how they’ve helped us streamline feedback from testers, we’ve reduced this process to 7 work days. It’s a huge improvement on our side.

How did TestArmy perform from a project management standpoint?

The reports are very detailed, including videos and valuable technical information. The engagement involved a big plan on our site, and the responsiveness of the project manager on their side has been perfect. They kept us up-to-date on the recruitment process of different testing groups, and it was really easy to get in touch and setup meetings. The whole project management flow makes it easy to actually plan test cycles. One of the biggest blockers for us was being able to plan for cycles in the future, and to get that part streamlined between tester feedback, fixing issues and testing them again.

What did you find most impressive about them?

The personal touch made the difference. Our use case is treated in-depth and with care, compared with other companies, where we were given generic options. The personalization is key.

Are there any areas they could improve?

So far, we haven’t had any problems with TestArmy.

4.0
Overall Score The way in which services are provided is perfect, but TestArmy could put some work into professionalizing the systems and improving the way in which customers access the information.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    They’ve met all deadlines, and scheduling meetings has been a no-brainer. They’ve been reactive and flexible to scheduling things from one day to another.
  • 4.0 Cost
    Value / within estimates
    It was good, especially compared to other agencies.
  • 4.0 Quality
    Service & deliverables
    The way in which they report, the timeliness and the quality of the reports are very good, but TestArmy should implement a customer platform where we could look at the feedback ourselves.
  • 5.0 NPS
    Willing to refer
    The fact that TestArmy is so open to use cases, even problematic ones, says a lot about them.

Security Testing for Online Whiteboard Tool

"After TestArmy, we never had any issues with security or vulnerability."

See More

5.0

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
Aug. 2015 - Ongoing
Project summary: 

TestArmy tests code for an interactive whiteboard portal to identify data security risks. The team points out initial vulnerabilities and then performs a retest after making the internal team aware.

The Reviewer
 
51-200 Employees
 
Wroclaw, Poland
Piotr Sliwinski
CTO, Explain Everything
 
Verified
The Review
Feedback summary: 

After each test, a full report of the platform's vulnerabilities and strengths is given. TestArmy excels at setting clear dates for testing and retesting and is great at communicating their results. The team is knowledgeable and thoughtful, delivering the best possible service. 

BACKGROUND

Introduce your business and what you do there.

I’m the CTO of Explain Everything. We provide a free form creation tool that works like an interactive whiteboard. It’s usually mostly in education. We are making inroads in the enterprise market as well. Our tool can create explanatory movies or online lectures, and is best suited for presentations, lectures, student projects, and things like that.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with TestArmy?

We have a portal that stores presentations and projects created using our app. We wanted TestArmy to test the security and vulnerability of our portal. If you’re doing something with an internal team, it’s better to have an external team testing this, especially when it comes to data security. Nowadays there are many problems with websites not being secure. While we were following all best practices while setting up our portal, we wanted to have somebody test that externally.

SOLUTION

What was the scope of their involvement?

We test for security every time we do a major upgrade to our portal.  We give TestArmy the URL and the description of the app.  They’re trying to break it and hack into it using their tools. Then they give us a report for what they’ve been able to accomplish and why so that we can fix whatever it is. When we fix the issues, they retest it, and then we are safe. We’ve only been using them for security and vulnerability testing of our website on a yearly basis. 

How did you come to work with TestArmy?

They are from the same city as us. The companies within the region usually know each other and know who is doing what. We knew that they do testing and security testing. We contacted them. We did some research of other companies, but TestArmy looked the best to us and had the most experience.

How much have you invested with them?

We’ve spent between $5,000-$10,000.

What is the status of this engagement?

We started working together in August 2015 and will be entering into a third engagement in August or September of this year. They tested the portal in the summers of both 2015 and 2016, and we’ll do additional retests again this summer.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

They provide a full report of what tools were used for testing. For example, for part of the website, we are using the service that has a list of the newest vulnerabilities and they went through that list. We have a full report of what has been tested and whether vulnerabilities were found or not. For other things, they’re also providing how many security holes were present. We always have to fix them all. The KPI here would be the number of vulnerabilities found versus the number of vulnerabilities fixed. Then the retest shows whether they were fixed. After TestArmy, we never had any issues with security or vulnerability. We are really happy with the results. They are a good service.

How did TestArmy perform from a project management standpoint?

They performed very well. They have a clear start date and end date. The deliverables were always clear to us, as well as the retest dates. Both in terms of meeting deadlines and general time spent on the project, they are excellent. We communicated over phone and Skype. We also used our own tool, Explain Everything, because it can be used for communication. 

What did you find most impressive about them?

During personal meetings with them, I had a good impression that they were very thoughtful and really knew what they’re doing. I’m a long time tech entrepreneur and I can sense whether someone is knowledgeable or just talking nonsense. They really deliver.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    Everything happens in a very timely manner.
  • 5.0 Cost
    Value / within estimates
    Compared to the quality of the service, the service is really inexpensive.
  • 5.0 Quality
    Service & deliverables
    They have very good looking reports with explanations on how to fix problems.
  • 5.0 NPS
    Willing to refer

Functionality Testing for BIM System

"TestArmy’s team is competent, and they produce quality work."

See More

4.0

Quality: 
4.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
4.0
The Project
 
Confidential
 
Nov. 2016 - Ongoing
Project summary: 

TestArmy conducts software evaluation across multiple Android and iOS devices by detecting regression bugs and providing manual testing based on detailed scripts.

The Reviewer
 
11-50 Employees
 
Oslo, Norway
Lars Moastuen
Senior Software Developer, Rendra
 
Verified
The Review
Feedback summary: 

Through TestArmy’s attentive assessments, the number of critical bugs has dropped among all tested products. Their consistent communication and ability to catch issues quickly continue to encourage efficiency.

BACKGROUND

Introduce your business and what you do there.

I’m a senior software developer for Rendra, a company in the building industry. We provide entrepreneurs with 3D CAD [computer-aided design] models for their sites for office buildings, hospitals, and so on.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with TestArmy?

We reached out to them because we needed to test our software on a large number of different Android and iOS devices. Instead of attempting to buy all these devices and perform tests ourselves, we wanted to use a company which already had most of them available to offload our task. 

SOLUTION

What was the scope of their involvement? 

The purpose of the test, at least in the beginning, was to discover device-specific issues which we had no way of detecting. Gradually, we have been offloading more and more general testing to TestArmy, as well. They provide manual testing based on detailed test scripts that we provide. TestArmy also undergoes general testing and has gotten to know our software. They detect changes and find regression bugs we may introduce while implementing new features. We don’t undergo any automated testing.

How did you come to work with TestArmy?

I was not in the loop initially. Another employee got in contact with TestArmy, but I’m not sure about the selection process.

How much have you invested with TestArmy?

This information is confidential. 

What is the status of this engagement?

We started working with TestArmy in November of 2016. The collaboration is ongoing.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We keep track of the number of critical bugs being discovered and how these numbers evolved since starting to work with TestArmy. I wouldn’t say that we have fewer bugs, but we’re discovering them at earlier stages than before. We do have fewer major bugs than before. The severity has decreased.

How did TestArmy perform from a project management standpoint?

We allocate time with TestArmy’s testers every week and communicate directly with them. Whenever we’ve had contact with their project managers, the meetings have been quick and efficient. I think that the communication has been straightforward. TestArmy’s team is competent, and they produce quality work.

What did you find most impressive about TestArmy?

We appreciate that they provide good testers who are competent in working with complex software. They have a technical background and can provide our developers with useful information on how to solve issues.

Are there any areas TestArmy could improve?

In general, I’m very satisfied with the quality of work provided by TestArmy, but the list of available mobile and tablet devices could be even more extensible and up to date. Having new devices ready when they reach the market would be a great plus for us.

4.0
Overall Score We’ve been happy with TestArmy in general.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    They’ve always been available and flexible during our meetings.
  • 5.0 Cost
    Value / within estimates
    We have a good agreement with TestArmy.
  • 4.0 Quality
    Service & deliverables
    The reports could always be better and more efficient, but TestArmy’s team is self-sufficient. The testing involves little effort on our part.
  • 4.0 NPS
    Willing to refer
    I’m very happy with TestArmy and wouldn’t hesitate to use them if I needed testing at a later stage.

Website Testing for Musician

"They are a dedicated team with open communication and completed everything within the allotted timeframe."

See More

5.0

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
June 2016 - July 2016
Project summary: 

TestArmy provided testing services on two websites to ensure they were fully functional and error free. They worked closely with the developers to suggest changes in order to provide user-friendly sites.

The Reviewer
 
1-10 Employees
 
Leeds, UK
Kate Chruscicka
Professional Musician
 
Verified
The Review
Feedback summary: 

Testing was completed on time and the value of their services was worth the money spent. Clients and partners are impressed with both websites, and TestArmy was open to questions and suggestions throughout the process, and were quick to answer all requests.

BACKGROUND

Please describe your organization.

I am a world-renowned, award-winning musician that performs at private, corporate events and festivals.

OPPORTUNITY / CHALLENGE

What business challenge were you trying to address with TestArmy? 

I reached out to TestArmy to be sure that my two websites were fully functional and error free. I was looking for a company to verify my website was error free and user-friendly to help me better connect with potential clients and fans.

SOLUTION

Please describe the scope of the work and TestArmy's involvement in greater detail. 

TestArmy was very proactive in helping me to test my websites. They were present from start to finish. TestArmy started testing as soon as we developed both websites and they also conducted acceptance tests at the end of our development. Plus, once everything was finished, TestArmy conducted retests to let me rest assured that everything was functioning properly.

How did you come to work with TestArmy?

After doing some research, I really liked the fact that TestArmy stressed their commitment to building a relationship with me rather than just seeing me as a paying client. I was also impressed by the kinds of clients they have previously partnered with.

Could you provide a sense of the size of this initiative in financial terms?

I spent around $5,000.

What is the status of this engagement? 

TestArmy completed their engagement with my developers. The whole process took just under 2 months, one month during the development and then a couple of weeks for acceptance tests and retests.

RESULTS & FEEDBACK

What are the results of the project, and are there any statistics or metrics you can share?

The project was just completed so I do not have any immediate metrics to share. However, the testers from TestArmy were in constant communication with my developers and made suggestions on what things could be changed to create a more user-friendly experience. I believe that the open communication between my developers and TestArmy helped deliver the best websites possible.

My clients and partners are impressed with both websites and I have not yet heard any problem on either site.

How did TestArmy perform from a project management standpoint?

TestArmy dedicated a team to my project that consisted of 4 full-time testers plus another 20 testers to replicate my potential clients. They stayed in constant communication with my developers and me and were always ready when we had questions or concerns about a specific feature.

What distinguishes TestArmy from other providers?

I really appreciated the fact that TestArmy was not only efficient, but also open throughout the entire process. The questions my developers had were always quickly answered and their test reports enabled my developers to work in a more efficient manner. I think the fact that they were so involved with my project really proves that they treat each project as if it was their own, and that isn’t normal with other companies.

Is there anything TestArmy could have improved or done differently?

I can't think of anything.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    Everything was completed on time.
  • 5.0 Cost
    Value / within estimates
    They were not cheap, but they were worth every penny.
  • 5.0 Quality
    Service & deliverables
    Their service was unbelievable. They are a dedicated team with open communication and completed everything within the allotted timeframe.
  • 5.0 NPS
    Willing to refer

Website and Email Testing for Digital Agency

"TestArmy reacts quickly to any issues and comes up with solutions."

See More

4.0

Quality: 
4.0
Schedule: 
5.0
Cost: 
4.0
Willing to refer: 
5.0
The Project
 
$50,000 to $199,999
 
Apr. 2016 - Ongoing
Project summary: 

TestArmy has provided testing services across 30 websites, the majority of which are focused on layout testing. The team also provides browser compatibility checks, as well as HTML and CSS validations. 

The Reviewer
 
51-200 Employees
 
Kielce, Poland
Marcin Wojdyła
Head Solutions Architect, Digital Agency
 
Verified
The Review
Feedback summary: 

Website users are happy and report few issues. Although there were some initial issues in the engagement, TestArmy has adapted and gained experience quickly. They now have senior resources who are experienced and are working to provide training. TestArmy is an extension of the internal team. 

BACKGROUND

Introduce your business and what you do there.

Ware are a global digital agency that deals mostly with pharmaceutical clients. We provide services related to digital marketing, website and mobile app development, and so on. Our headquarters are in London, and we have offices in Poland, Italy, and New York. Our headcount is over 100 employees, and we work with various external suppliers. I am the head solutions architect of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with TestArmy?

We had a high volume of websites to be tested against designs and requirements. We needed someone to do this for us.

SOLUTION

What was the scope of their involvement?

We have worked with TestArmy on 30–40 websites so far. Our most common task is layout testing. This involves making comparisons against the design files we provide—for instance, if the built website is identical to the initial design. TestArmy also runs browser compatibility checks, looking at a number of browsers and devices which should be compatible with a particular website. They use physical devices to check for any layout issues or bugs. They also run some standard HTML and CSS validations using our internal tools in order to verify that the work is compliant with W3C standards. TestArmy checks follow-up emails for us, testing our templates in Outlook and the iOS email client. TestArmy also looks at our Veeva CRM [customer relationship management] presentations to see if the content follows our designs. These are environments through which medical representatives can show presentations.

Initially, our collaboration was on-demand. We sent TestArmy tasks for which they provided resources. Since November 2016, we changed the model and have a dedicated team of four QA engineers from TestArmy. We make sure that they have enough work and schedule their tasks. TestArmy is integrated into our team in several ways. Aside from using our Slack channels, they also use our internal JIRA instance for raising bugs and defining tasks. TestArmy is still a remote resource for us, so we work out of different offices.

How did you come to work with TestArmy?

I found TestArmy through the recommendation of a colleague. She had worked with TestArmy for a previous company. The relationship worked well so we didn't consider any other candidates.

How much have you invested with TestArmy?

The cost of TestArmy's work has been around $8,000 per month. In total, we’ve paid $80,000 for their services.

What is the status of this engagement?

We started working with TestArmy around April 2016. We still work with them.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We have generally looked at our clients' satisfaction level and the number of issues reaching our clients. TestArmy's performance is good, and everyone has been happy so far. There were some issues initially, but they were mostly due to a lack of experience with our environment and project types. Most of those have been sorted out by now. Our general perception is that TestArmy is an extension of our internal team.

How did TestArmy perform from a project management standpoint?

We communicate with TestArmy's team in English. There is usually a project manager on our side who works directly with their team members and sets deadlines. TestArmy will usually hit those deadlines, notifying us about any potential problems that may hold them back. TestArmy has senior team leaders who coordinate the work, so, if there are any issues, there will be someone whom we can go to and ask for help.

What did you find most impressive about TestArmy?

TestArmy reacts quickly to any issues and comes up with solutions. They also have senior resources who are experienced with general processes around digital. We've used TestArmy's expertise to improve our internal processes. The team which works for us can operate in different time zones, which has helped us handle global relations with foreign clients in the US, Europe, and Asia.

Are there any areas TestArmy could improve?

The technical understanding of underlying technologies around our websites and applications could be better. It would help TestArmy's team understand what our bugs are, as well as the reasons and implications around them. I know that TestArmy will be providing training for the team.

4.0
Overall Score The work is good, but not perfect.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    The work is delivered on time. I don't have any major issues in this respect.
  • 4.0 Cost
    Value / within estimates
    We have had additional costs compared to doing the work internally. Relative to global prices, TestArmy has good value for money.
  • 4.0 Quality
    Service & deliverables
    TestArmy has good strengths, but there are still technology-related improvements to be made.
  • 5.0 NPS
    Willing to refer
    TestArmy can help a lot.

Security Testing for Smart Packaging Company

"I appreciated the communication between our teams, as well as TestArmy's fast work."

See More

5.0

Quality: 
5.0
Schedule: 
5.0
Cost: 
4.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
Sep. 2015 - Jan. 2017
Project summary: 

TestArmy provided security testing services for a mobile app and web panel. Specifically, they focused on NFC tags and check the communication between smart devices and the cloud.

The Reviewer
 
11-50 Employees
 
Poland
Alan Pilarz
Origintag
 
Verified
The Review
Feedback summary: 

TestArmy provided a full summary of action steps for the app and web panel, and then re-tested both upon completion of those action steps. After completion, both systems were in good order. The team’s communication was up to scratch, and they provided deliverables with project timelines. 

BACKGROUND

Please describe your organization.

We provide smart-packaging solutions using the RFID and NFC capabilities in smartphones, in order to provide communication between the customer and the product.

OPPORTUNITY / CHALLENGE

What business challenge were you trying to address with TestArmy?

We needed to test our system for security issues at the request of one of our clients.

SOLUTION

Please describe the scope of their involvement in greater detail.

TestArmy provided testing for our app, Talkin' Things, as well as for our web panel, talkinthings.com. Specifically, they tried to copy our NFC tags and looked at the communication between the smart devices and our cloud. It was quite a difficult project.

How did you come to work with TestArmy?

I found TestArmy online while looking for testing companies. I compared three offers and chose TestArmy because they had the best portfolio, and provided the best communication.

Could you provide a sense of the size of this initiative in financial terms?

The cost of TestArmy's work was around €5,000. [$5,200]

What is the status of this engagement?

We had our first conversations with TestArmy in September 2016, and the testing process started in December. The project took 1-2 months to complete.

RESULTS & FEEDBACK

Could you share any statistics or metrics from this engagement?

The communication between our company and theirs was good, and TestArmy delivered the project in the right time. As a deliverable, they gave us a full summary of what we should do to improve our system. TestArmy then did another series of tests after we implemented those changes. Our system is in good order at the moment, so the project was successful.

How did TestArmy perform from a project management standpoint?

TestArmy assigned a project manager from their side. We had a number of calls and emails during the project, as well as one meeting. The communication was sufficient, and everything was delivered according to our timeline.

What distinguishes TestArmy from other providers?

I appreciated the communication between our teams, as well as TestArmy's fast work.

Is there anything TestArmy could have improved or done differently?

Everything was okay.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 4.0 Cost
    Value / within estimates
    The cost was significant for our company, but, based on our other offers, TestArmy had mid-range pricing.
  • 5.0 Quality
    Service & deliverables
    The quality of our tests was good.
  • 5.0 NPS
    Willing to refer
    We were very happy to collaborate with TestArmy, so we wouldn't hesitate to refer them to colleagues.

Security and Functionality Testing for Events Coordination Company

"I've appreciated the direct contact with Testarmy's specialists."

See More

5.0

Quality: 
5.0
Schedule: 
5.0
Cost: 
4.0
Willing to refer: 
5.0
The Project
 
Confidential
 
Mar. 2014 - May 2014
Project summary: 

Testarmy performed security and functionality testing for a website that manages 2,000-3,000 simultaneous users. The testing process went through three iterations.

The Reviewer
 
1-10 Employees
 
Wroclaw, Poland
Ewa Mroz
CEO, Bieg Firmowy
 
Verified
The Review
Feedback summary: 

Testarmy achieved a functional result and fixed platform bugs. They maintained constant communication through JIRA, Skype, and other tools so that no deadlines were missed.

BACKGROUND

Introduce your business and what you do there.

Respondent 1: We are a charity organization focused on yearly corporate running events which take place in Poland. We have around 5,000 participants in Wrocław and 2,000 in Warsaw. I am the founder and chief executive officer of the organization. I am in charge of organizing the events.

Respondent 2: I am the IT director and events manager of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with Testarmy?

Respondent 2: We needed security and functionality testing for our website. The website is used for registering competition participants, so it has many forms and functionalities which needed to be secure and operational.

SOLUTION

What was the scope of their involvement?

Respondent 2: Testarmy provided security as well as functional and load (or performance) testing. They ensure that the site could handle 2,000–3,000 concurrent users. Testarmy's specialist maintained contact with us online. We've had three iterations for each type of test. Testarmy also fixed any bugs that were identified.

How did you come to work with Testarmy?

Respondent 2: I found three options when I googled security and functional testing companies. Testarmy offered the best price and a collaboration model.

How much have you invested with Testarmy?

Respondent 2: This information is confidential.

What is the status of this engagement?

Respondent 1: We started working with Testarmy in March 2014.

Respondent 2: The work was finished in May. We are planning a new project with Testarmy in 2017 after we've updated our website.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

Respondent 1: We are satisfied with Testarmy.

Respondent 2: Testarmy tested our platform and fixed any bugs, achieving a functional result.

How did Testarmy perform from a project management standpoint?

Respondent 2: We maintained communication through JIRA, Skype, Slack, email, and phone. We've had a long period for performing all our tests, so there were no missed deadlines.

What did you find most impressive about Testarmy?

Respondent 2: I've appreciated the direct contact with Testarmy's specialists.

Are there any areas Testarmy could improve?

Respondent 1: No, everything was good.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    Respondent 2: Testarmy didn't miss any deadlines.
  • 4.0 Cost
    Value / within estimates
    Respondent 2: Testarmy's service isn't cheap.
  • 5.0 Quality
    Service & deliverables
    Respondent 2: Everything was okay.
  • 5.0 NPS
    Willing to refer

Application Testing for Web and App Development Company

"To be successful with Testarmy, you just need to let them work."

See More

5.0

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Confidential
 
July 2015 - Ongoing
Project summary: 

Testarmy performs manual testing for several websites and applications, including both iOS and Android. They are also in the process of building a system for automatic testing where applicable. 

The Reviewer
 
51-200 Employees
 
Warsaw, Poland
Head of Project Management, Development Company
 
Verified
The Review
Feedback summary: 

Testarmy’s team is knowledgeable and knows exactly what to do. They are flexible in systems and procedures, and they keep to deadlines. When extra testers are needed, they are able to jump into a project easily.

BACKGROUND

Introduce your business and what you do there.

I’m currently the head of project management at a software development and design house. I’m responsible for all of the client interactions regarding project timelines and project satisfaction at the end of each product development. 

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with Testarmy?

We hired Testarmy to find as many bugs as they could within various websites and applications for iOS and Android. 

SOLUTION

What was the scope of their involvement?

We’ve used Testarmy for several projects. I think we’re using them in almost all of our projects right now. We use them because they’re certified and they have several tools that they can test with. Right now, we work with Testarmy for manual testing on several devices. They are starting to build a system for automatic testing and they want to shift to that. However, automatic testing will not work for all of our applications. They will continue manual testing where needed.  

How did you come to work with Testarmy?

They’ve reached out to us and after a couple of times when we had a need for a QA team, and we have negotiated a deal.

How much have you invested with Testarmy?

I don't know.

What is the status of this engagement?

We started working with them in July 2015, and we are still working together.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

Their testers are very knowledgeable and well prepared. I think our cooperation is successful right now. They are flexible and can work on-site, which is helpful. We have several core projects where we need them to be in our clients’ offices, and Testarmy’s resources are able to travel as required.

How did Testarmy perform from a project management standpoint?

They are able to use our systems and procedures. They also do a good job of hitting deadlines. If we keep our deadlines, they keep theirs. I mostly work with their CEO, but from my point of view, they have good project management. If we need extra testers, they always have someone in the background that can jump onto our project.

What did you find most impressive about Testarmy?

The most important thing is that they have people who can usually jump into a project well-prepared. I think we have a good collaboration.

Are there any areas Testarmy could improve?

They could expand the list of devices they have, but I know that’s hard. 

What tips or recommendations could you share that might increase the likelihood of success with Testarmy?

To be successful with Testarmy, you just need to let them work. They know exactly what to do.

5.0
Overall Score They teach us how to build better software and I can always communicate with them about problems. If we have an issue, they help.
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
    They are on a fine line between it making sense to contract testing out vs building our own testing team internally.
  • 5.0 Quality
    Service & deliverables
    They always work well with our team.
  • 5.0 NPS
    Willing to refer