TestFort QA Lab

BACKGROUND

Introduce your business and what you do there.

I’m the VP of product, and we're a company that builds mobile applications as well as advertising attribution solutions.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with TestFort QA Lab?

We were experiencing pervasive quality issues in our mobile app. Since we lacked an internal QA team, we were looking to onboard a QA team as fast as possible, the app was already on the market.

SOLUTION

What was the scope of their involvement?

Serving as an extension of our own team, they define regression tests for our mobile app and provide us with very detailed reports. While we haven’t formally engaged them for other projects, we’re talking to them about work for other apps, as well.

What is the team composition?

Two of their test engineers are embedded in our internal team. There’s an account manager who oversees the work on occasion, but the test engineers have truly become part of our team.

How did you come to work with TestFort QA Lab?

I found them on Clutch. We shortlisted them, along with two other companies, and gave them test projects. The quality of TestFort’s work blew the others out of the water, so we immediately committed to working with them.

How much have you invested with them?

We’ve spent somewhere between $50,000–$75,000.

What is the status of this engagement?

The engagement began in December 2018 and is still ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement? 

The quality of our app—and our software releases—has improved significantly since we started working together. Their work has also led to a 75–80% bug reduction, which is phenomenal.

How did TestFort QA Lab perform from a project management standpoint?

We’ve had no problems. While we oversee most of the project management, they sufficiently manage their own workload. They’re flexible to work with, and they communicate really well. The difference in time zone can be a challenge, but we’ve been able to work around it.

We utilize Slack and Google Hangouts to communicate. We also used JIRA to track software bugs.

What did you find most impressive about them?

I was impressed by their attention to detail, and their use of visual aids to support written communication. They especially do an excellent job at the latter, which has been very helpful since they’re a remote team. They’re skilled at eliminating and overcoming cultural and linguistic barriers.

Are there any areas they could improve?

I can’t really think of anything. They may want to consider having some team members available during our core hours—that would be very helpful for us, but it isn't that important. 

Do you have any advice for potential customers?

Engage them on a small task that can be completed in a single sprint. That gives you two weeks to become familiar with them and their working style. It’ll also give you a sense of their output.

BACKGROUND

Please describe your company and position.

I am the Principal Consultant of The Blueprint Consult, LLC

Describe what your company does in a single sentence.

Specialize in bridging the gap between business and technology across industries including media, telecommunications, professional services and consulting.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestFort QA Lab to accomplish?

• To begin introducing non customer facing AI-driven features into our consulting workflows.
• To understand how reliable these AI outputs actually are in real scenarios.
• To obtain a clearer picture of where the system performs well and where it becomes inconsistent

SOLUTION

How did you find TestFort QA Lab?

• Online Search
• Referral
• Clutch Site

Why did you select TestFort QA Lab over others?

• Pricing fit our budget
• Great culture fit
• Good value for cost
• Company values aligned

How many teammates from TestFort QA Lab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

TestFort focused on validating AI-generated outputs used in our internal consulting processes: things like summaries, recommendations, and structured insights based on input data. They tested different variations of inputs to see how stable the outputs were and how sensitive the system was to small changes. 
A useful part of their approach was documenting patterns, not just individual bugs, but cases where the AI would behave inconsistently under similar conditions. Deliverables included detailed observations, structured feedback on AI behavior, and suggestions on how to make the system more predictable.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The main result was better predictability. Before the project, we often saw variations in AI outputs that were hard to explain. After the testing phase, we had a much clearer understanding of where those inconsistencies come from. In practical terms, the number of cases where outputs required manual correction dropped by around 30%. We also reduced the time spent reviewing AI-generated content, since the system became more stable in typical use cases.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

The process was steady and without unnecessary complexity. They shared findings regularly, and we didn’t have to chase updates. When we adjusted the scope, they adapted without pushing back or slowing things down.

What was your primary form of communication with TestFort QA Lab?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

They were comfortable working with uncertainty. Instead of trying to force clear “pass/fail” results where they don’t really apply, they focused on understanding patterns and behavior. That was exactly what we needed.

Are there any areas for improvement or something TestFort QA Lab could have done differently?

At times, we would have benefited from slightly more structured summaries of findings, especially for internal stakeholders who were not involved in the process day to day. Overall though, the collaboration felt thoughtful and grounded.

BACKGROUND

Please describe your company and position.

 I am the CTO of a Spending Management Company

Describe what your company does in a single sentence.

Spending management solution

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestFort QA Lab to accomplish?

• TestFort QA Lab was tasked with testing our invoice management feature. Our goal was to confirm that the platform worked as intended, with no critical bugs. The folk behind TestFort did an excellent job. They helped validate the platform’s functionality by covering a wide range of payment scenarios using test automation tools, which gave us confidence in our system and accelerated the product launch.

SOLUTION

How did you find TestFort QA Lab?

Referral

Why did you select TestFort QA Lab over others?

• Great culture fit
• Referred to me
• Company values aligned

How many teammates from TestFort QA Lab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Before we started, we had a series of meetings with our product and technical teams to understand the ins and outs of the feature and set clear testing objectives. Next, we made a detailed plan, including various test scenarios, test cases, test approach, and an established test environment. For testing, the team used tools such as Java, Maven, TestNG, Selendine, and Allure, and engaged three roles — team lead, senior and middle testers. 
Over the next three weeks, we ran tests and worked on all issues found along the way. As a result of the collaboration, we’ve not only validated our invoice management feature but also improved it from a UX point of view.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

In addition to established metrics, we regularly measured test coverage and received demos and reports.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

We’ve never had any problem with the team, as they were always proactive in addressing any concerns or changes we brought up and worked ahead of schedule. It helped a lot that we could actually talk to each other through virtual meetings.

What was your primary form of communication with TestFort QA Lab?

Virtual Meeting

What did you find most impressive or unique about this company?

Their proactive approach has actually stunned us. Most of the issues were solved even before we recognized them as potential problems. They really know what they’re doing and are committed to delivering great service.

Are there any areas for improvement or something TestFort QA Lab could have done differently?

We can’t think of anything. Perhaps, we’d like the price to be cheaper, but then, quality can’t be cheap, and quality is what matters when it comes to testing.