QA Wolf

BACKGROUND

Please describe your company and position.

I am the Software Engineer of Gumroad

Describe what your company does in a single sentence.

Makes software that helps people sell digital goods online.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• QA

SOLUTION

How did you find QA Wolf?

Other

Why did you select QA Wolf over others?

Other

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf writes tests for our software and provides a portal that informs us when something breaks the tests.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Reduced our QA spend and improved our QA since every time they write a test for us, it runs on every deployment. When we had manual QA, the same thing would only get tested once.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They are very quick at responding and addressing issues.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

No matter what time of day, they always respond almost instantly on Slack.

Are there any areas for improvement or something QA Wolf could have done differently?

We occasionally get false positives, but otherwise no issues!

BACKGROUND

Please describe your company and position.

 I am the VP Product & Engineering of an agriculture company 

Describe what your company does in a single sentence.

Provide environmental controls and automation to farms.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automated QA Testing

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf provided us with automated frontend end-to-end testing. Their team is extremely responsive and helpful - all you have to do is provide a loom of your application changes and they update the tests for you.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Reduction in time our staff has to spend writing QA tests to 1-2 hours a month.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf is very responsive and provides reliable service on a daily basis for our team.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

They completely take the manual parts of QA testing (writing tests, updating scripts, watching your test suite) off of your team's plate.

Are there any areas for improvement or something QA Wolf could have done differently?

Some tests can be flaky after several updates to our web application. This just means we need to be more diligent in staying in sync with the QA wolf team to update tests accordingly.

BACKGROUND

Please describe your company and position.

I am the Product Manager of ecomedes

Describe what your company does in a single sentence.

We house the world’s largest, most intelligent, and freshest catalog of sustainable building products and certifications.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• QA Testing

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Primary purpose is to detect bugs and flaws in site configuration and to monitor unexpected changes in data and certifications published. Deliverables include: 

• Overview of Testing Activities: Brief description of the types and phases of testing conducted 
• Testing Environment and Tools Used: Information about the testing environment, including hardware, operating systems, and software tools utilized during the testing process. 
• Test Coverage: Overview of the extent to which the software was tested. 
• Discovered Defects: Summary of the defects found during testing, often categorized by severity (e.g., critical, major, minor) or type (e.g., functional errors, performance issues, usability problems).

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Several key measurable outcomes include: 

• Test Coverage: The percentage of the product's features or code that has been tested. 
• Defect Detection and Resolution Rate: The number of defects found and resolved within a specific time frame.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf and the team has done as great job managing the project and workload for us. They are very responsive and comprehensive on their follow up to help us resolve the issues found from start to finish.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their team is very buttoned up and professional, responsive and communicative.

Are there any areas for improvement or something QA Wolf could have done differently?

QA Wolf is currently covering the majority of our testing needs at the moment. At the moment, we are happy with the service and can think of nothing to add, that would increase engagement.

BACKGROUND

Please describe your company and position.

I am the Engineering Director of Stacklet, Inc.

Describe what your company does in a single sentence.

Stacklet provides a cloud-governance-as-code platform that helps companies manage their security, asset visibility, operations, and cost optimization policies in the cloud.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Build and maintain automated test suite for core Stacklet products

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• Pricing fit our budget
• Great culture fit
• Good value for cost

Describe the scope of work in detail. Please include a summary of key deliverables.

We hired QA Wolf to build and maintain an automated test suite for our web app. Key deliverables:

1. Review app and develop test plan 
2. Implement tests in Playwright 
3. Execute test suite on a regular schedule or on demand, report results 
4. Achieve at least 80% coverage within 3 months 
5. Proactively review failing tests, fix flakes, file tickets for real bugs 
6. Implement tests for new features as our product evolves

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

QA Wolf developed a test suite for our product and achieved 99% coverage in 3-4 months. They provide ongoing maintenance, proactively investigating every test failure, fixing flakes, and filing bugs for real failures. They provide a nice dashboard that reports test results, and webhooks for integrating with our CI/CD pipelines. The tests are written in Playwright and the source is visible, so we can see exactly what the tests are doing.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They are well organized and extremely responsive, and have consistently delivered on what they promised. I've never been disappointed - they consistently meet or exceed my expectations.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Using QA Wolf is like having a team of experienced QA automation engineers on my own engineering staff, but at a fraction of the cost, and without any hiring or training overhead. They are also work quickly and save us a lot of time. 

They took us from 0% to 99% test coverage in a few months, and they handle all ongoing test maintenance and development with very little time investment from us. Finally, the team at QA Wolf are great people - knowledgeable, friendly, responsive, and fun to work with.

Are there any areas for improvement or something QA Wolf could have done differently?

I've been pleased with QA Wolf from the beginning, and they're getting better all the time, continually improving their service, and open to feedback and suggestions.

BACKGROUND

Please describe your company and position.

I am a manager at Xima Software

Describe what your company does in a single sentence.

Every customer interaction is crucial to building relationships and improving their experience. Xima’s Cloud Contact Center is a user-friendly solution for small-to-medium-sized businesses that enables employees to delight customers while providing deep, insightful data to improve your company.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Define a series of automated tests to ensure system stability

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• High ratings
• Close to my geographic location
• Pricing fit our budget
• Great culture fit
• Good value for cost

Describe the scope of work in detail. Please include a summary of key deliverables.

The setup and maintenance of automated tests that cover our software and ensure system stability as we release new features,

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Test stability, test creation progress reports, bug reports, communication

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf has been wonderful to work with. They've provided clear timelines, delivered stable tests that ensure system stability, and have been highly communicative.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

How communicative they've been. Regardless of the issue or challenge, we know about it and have been able to troubleshoot and resolve the issue quickly.

Are there any areas for improvement or something QA Wolf could have done differently?

Not that I can think of at the moment.

BACKGROUND

Please describe your company and position.

I am a Product Quality Specialist of Fleet Device Management

Describe what your company does in a single sentence.

Cross-platform device management and endpoint security.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Supplement our manual testing efforts with automation.

SOLUTION

How did you find QA Wolf?

• Online Search

Why did you select QA Wolf over others?

• Pricing fit our budget
• Great culture fit
• Good value for cost
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

Out internal QA team is small and focused entirely on hands-on, manual testing. QA Wolf provides a suite of automated tests on our web application to supplement our work. This allows us to routinely check every aspect of our product's UI/UX, while internal QA is able to keep our scope narrowed to current feature work and bug fixes.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Internal QA able to be more focused. Customer-facing/reported bugs reduced. Increased product confidence.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf team is always timely with filing bug reports, communicating on issues, verifying fixes.The team is always available to discuss additions or changes to our testing needs, and proactive about suggesting ways they can bring additional value.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

They are always quick to respond, communicative, and a pleasure to work with. They bring a very human touch to automation,

Are there any areas for improvement or something QA Wolf could have done differently?

I have no critical feedback for them, we are very satisfied.

BACKGROUND

Please describe your company and position.

I am the Senior Prject Manager of Viking Sasquatch

Describe what your company does in a single sentence.

Fiercely developing the elusive software solutions your company needs!

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• To QA our tickets for our projects of creating and improve custom title software for a system that is over 20 years old
• Run regression testing
• Inform us when things are not working properly

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• Pricing fit our budget
• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Our client needed a faster, more capable implementation of their existing Windows desktop based application. The database was completely rebuilt, incorporated new UI/UX designs for the modern day, and improved existing systems within the application. Most of the features within this system can be defined as form entry, calculations and form filled emails.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Client satisfaction has been our best indicator.They let us know what they have been happy with as far as system improvements and time saving processes that have been added to the application.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf let us know anything wasn't working before our clients who were doing UAT would. Sometimes during deploys within minutes QA wolf would send us a video link with an issue they encountered letting us know that the new code needed to be adjusted and fixed. QA wolf would report bugs in a timely manner for us to fix for not only emergencies but also backlog items. They worked very closely with our head of QA asking questions and information about test cases when we would have new updates.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

QA wolf has a very friendly culture of attending to client needs immediately. If my dedicated rep isn't around to help me someone will step in instantly. Their responsive time is insanely fast.

Are there any areas for improvement or something QA Wolf could have done differently?

I personally see no ways QA wolf could improve. They are quite professional and do high quality work with care.

BACKGROUND

Please describe your company and position.

I am the QA Engineer of WorkRamp

Describe what your company does in a single sentence.

All in one Learning Management Software built for every use case of any company

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automation
• Reduce cost of manual testing
• Efficient bug reports
• Availability of the testers
• Cost / benefit

SOLUTION

How did you find QA Wolf?

• Online Search
• Referral

Why did you select QA Wolf over others?

• High ratings
• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

Not possible to know, they rotate and there's always someone available.

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf created our automation suite with a coverage of almost 100% of our use cases, automated the bug report in our Jira board, and connected their Slack bot to ours, so we have a constant report of the real-time status of the automation suite on our end. 

Their dashboard includes everything I need to know about the regression testing that is run at different times per day, it also includes all the analytics and valuable information on the current status of the bugs, deprecated tests and the ones in maintenance.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Reduce of the cost of our manual testing by 50%, increase of the coverage of the execution of the daily test after the code was completed, from 30 (manual) to 500+ (automated), increase the bug reports before they were sent to production by 25% on average per year.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

All deliveries are accomplished on time, by a customer-focused team. Everything is presented as requested, in a format easy to understand, and with zero follow-ups on our end.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

It was impressive how rapidly they created the automation suite, how well they handle the everyday communication with us (customers) and the great customer-oriented persons they have.

Are there any areas for improvement or something QA Wolf could have done differently?

Nothing, one year after and we are incredibly happy with the results.

BACKGROUND

Please describe your company and position.

I am the Senior QA Engineer of AdCellerant

Describe what your company does in a single sentence.

Advertising and marketing solutions

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Getting coverage quick
• Coverage in Playwright

SOLUTION

How did you find QA Wolf?

• Online Search

Why did you select QA Wolf over others?

• Pricing fit our budget
• Good value for cost
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

We were originally on the verge of launching a new OMS system so were in need to get coverage prior to our launch date. QA Wolf successfully got the coverage we needed. As the year progressed we were able to give QA Wolf more complicated work flows to help de-burden our manual team. We gave them a goal of completion for this of 2 months and are on track to have this completed

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

For us it was usable complete test cases in the time we agreed too. So for an example we had them cover our messaging platform and having them complete it within the time period we allotted plus our weekly checkins with progress updates helped us feel confident that the work we needed to be completed is completed

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Project management has turned to being a super great thing. Cohen is amazing with his touch ins and ensuring we are on track. Additionally Gray had been perfect as our lead to ensure we are getting the completion we need. Both have been wonderful in responding via slack. Our weekly meetings they are great about updating the status of the project and allowing us to discuss any test cases

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

A few things!

1. we could off load test cases and replace with others at any time.
2. They code in playwright which is what we write in
3. Having all test cases hosted by them and ran through their server to de-burden our load

Are there any areas for improvement or something QA Wolf could have done differently?

It took till the second half of the year for us to get into a better communication rythm with QA Wolf. So in general with new clients I would harp on the side of more communication compared to less. Additionally ensuring and auditing the test cases to confirm they are valid and dont need adjustments!

BACKGROUND

Please describe your company and position.

I am the Senior Director of Engineering of an automotive retailing software company.

Describe what your company does in a single sentence.

Digital retailing software for the automotive industry.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Reduce time to release.
• Bring up automated regression coverage.
• Give time back to our QA team.
• Increase confidence in the quality of our releases.

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Great culture fit
• Good value for cost
• Referred to me

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QAWolf built a suite of regression tests that runs daily, before every release, and on demand. They also maintain the existing tests regularly as the application evolves. They work closely with our Engineering and QA teams to understand the scope of changes and new features, how they ought to be tested, what our expectations are and what priorities we have for our automated tests.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The main measurable outcome was the massive reduction in our time to release: from a week due to manual regression testing of every release, down to an hour thanks to the automatic suite running multiple tests concurrently and reporting all findings in an easy to consume format to decide what is a blocker, what is known, and what is of minor importance.

Without the burden of manual testing, our QA team is now free to build and maintain our test cases, ensure that new features are built to spec, find inconsistencies in implementation; in short, they now have time to go about their other responsibilities.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QAWolf delivered the 80% coverage in the promised timeline, and that is despite our shortcomings in terms of environment stability, and the quality and thoroughness of our test cases. They took charge of their task and helped guide us to provide them with the most important requirements they needed from us.

As a side effect, we now have a much better idea of internal issues we have to resolve in our testing environments. As for the response to our needs, the QAWolf team is always around and they make sure to communicate to each other whenever we send a request or have a question. We always get an answer within the day. The relationship is friendly, casual, unobstructed by procedures and delays, and extremely effective.

What was your primary form of communication with QA Wolf?

Virtual Meeting

What did you find most impressive or unique about this company?

Besides the fact that they did indeed deliver the 80% coverage in the time they promised, I am always impressed by their responsiveness; their thoroughness in triaging findings from test runs; their eye for details; their willingness to hear about rough edges in the platform and ability to sand them down quickly; their openness about their roadmap and plans and how they could benefit us; their autonomy in finding the answers they need to unblock their work.

Are there any areas for improvement or something QA Wolf could have done differently?

Nothing that I can think of. As I mentioned before, whenever I have found an inconvenience with the platform, the tooling or the process, it has been very easy to just talk about it with QA Wolf and find a solution.