QA Wolf

BACKGROUND

Introduce your business and what you do there.

I’m the director of product at Clade, a fintech platform offering productivity tools for investors and fundraisers. We streamline diligence, data sharing, and marketing to democratize and enhance efficiency in global investment management.

OPPORTUNITY / CHALLENGE

What challenges or issues did you encounter with QA Wolf?

Our only challenge was that the overnight suite could be slow, but that was partially our fault.

SOLUTION

What was the scope of their involvement?

QA Wolf has offloaded the majority of our manual and regression QA validation. The team has done over 400 coverage tests for a very large app, focusing on all functionality and acting as constant user testing.

How did you come to work with QA Wolf?

I joined the company, and we were already using QA Wolf.

What is the status of this engagement?

We’re still loyal customers.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

QA Wolf’s work has had a very high impact on our team’s efficiency and productivity. We’ve covered over 400 tests, and the number of bugs validated and fixed has been in the hundreds.

How did QA Wolf perform from a project management standpoint?

QA Wolf’s project management is good. The team delivers on time and responds well to our needs. There was an occasional delay in release, but it saves us from releasing countless bugs. We communicated via Slack.

What did you find most impressive about them?

QA Wolf’s ability to understand a separate application and its features with minimal context is impressive.

Are there any areas they could improve?

No, there aren’t any.

UPDATED REVIEW

This review was published on September 25, 2024.

Senior Software Engineer, FinTech Platform
Information technology

New York City, New York

1-10

Aug 2022 - Ongoing

$1,000,000 to $9,999,999

Verified

Project summary
QA Wolf provides ongoing test automation services for a fintech platform. The team is responsible for most of the QA for the client's project, including bug reports, nightly test runs, and weekly test reports.

Feedback summary
QA Wolf's work has led to increased developer velocity with less time spent on tests and QA. The team has full frontend test coverage, with 400 tests running. Overall, the service provider is very responsive and quick to make adjustments and provides excellent support to the client's satisfaction.

BACKGROUND

Please describe your company and position.

I am the Senior Software Engineer of an information technology company 

Describe what your company does in a single sentence.

Fintech platform for private equity

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Front end test automation

SOLUTION

How did you find QA Wolf?

• Online Search
• Other

Why did you select QA Wolf over others?

Good value for cost

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf provides us with test automation services including bug reports, nightly test runs, and weekly test reports on an ongoing basis. They take the responsibility for most of the QA for our project

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Led to increased developer velocity with less time spent on tests and QA.
• Full frontend test coverage with nightly runs and bug reports with 400 test running

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Very responsive and quick to make adjustments, as well as ad hoc re-running of tests as needed when bugs are fixed.

What was your primary form of communication with QA Wolf?

Email or Messaging App

What did you find most impressive or unique about this company?

Excellent support from a high performing team, as well as full slack integration with live chats and updates with the actual QA Engineers

Are there any areas for improvement or something QA Wolf could have done differently?

Nothing I can think of

STAR RATINGS:
Overall rating: 5
Quality: 5
Cost: 5 
Schedule: 5
Willing to refer: 5

BACKGROUND

Please describe your company and position.

 I am the QA Manager of a gambling company 

Describe what your company does in a single sentence.

Interactive technology webapps

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automate Regression test pass

SOLUTION

How did you find QA Wolf?

Other

Why did you select QA Wolf over others?

• Great culture fit
• Good value for cost
• Personalized approach

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Scope of work is to automate our regression test pass allowing us to deploy to prodoction more frequently and with less repetitive manual tests from the QA team.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Ammount of test cases no longer needed to do manually and increased frequency of deployments.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They were very responsive to our feedback about improving certain test cases, and they are very on top of meeting golas and letting you know whats possible and what's not within the timeframes

What was your primary form of communication with QA Wolf?

Virtual Meeting

What did you find most impressive or unique about this company?

The individualized approach and their efforts to truly understand what we needed.

Are there any areas for improvement or something QA Wolf could have done differently?

Bug reporting can improve a bit more to fit with our own processes, but in general their reports are ok.

BACKGROUND

Please describe your company and position.

I am the Sr. Product Manager of BlueOcean AI

Describe what your company does in a single sentence.

Provide marketing data analytics to marketers

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Software QA
• Automated Testing

SOLUTION

How did you find QA Wolf?

Word of mouth

Why did you select QA Wolf over others?

• Referred to me
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

• Scope of work included: 
  • General QA testing
  • Automated Testing
  • Testing reports

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Number of identified issues

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf has consistently delivered tests in a responsive manner, always on time to our expectations and delivered thorough results.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their consistent reliability and responsiveness over Slack is impressive. We always get our questions answered in a very timely manner.

Are there any areas for improvement or something QA Wolf could have done differently?

Perhaps more flexible pricing plans, especially for smaller companies

BACKGROUND

Please describe your company and position.

I am the Engineering Manager of a marketing company 

Describe what your company does in a single sentence.

Send performance drive direct mail.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Manage and Automate E2E Software Testing

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

Good Product

Describe the scope of work in detail. Please include a summary of key deliverables.

Within the first month, QA Wolf has already shown value in building out signfigant coverage, intergrating with our systems, and integrating with our team.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Number of tests completed so far and the coverage of those tests. 

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They;ve been great in both responding to our needs and actually ahead of schedule. 

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The combination of technology and the human element of software testing. They have a great platform and the people to back it up.

Are there any areas for improvement or something QA Wolf could have done differently?

Some integrations aren't the end all be all, but they make up for it with their APIs and the progress they're making on them. 

BACKGROUND

Please describe your company and position.

I am a Software Engineer at Magic Labs

Describe what your company does in a single sentence.

A powerful set of web3 capabilities

• Seamless onboarding
• High conversion.
• From concept to collection
• Operate with confidence

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Run a QA suite of tests after every deploy

SOLUTION

How did you find QA Wolf?

• Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

• Weekly meetings to ensure QA tests are correct
• Set up a suite of QA tests that automatically run after every deploy
• Create a dashboard to view every single test

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Higher confidence with deploys, less bugs

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Very organized with timelines, delivery, etc. They're very responsive on Slack (within 30 min - 24 hours)

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Communication, quality, and offerings!

Are there any areas for improvement or something QA Wolf could have done differently?

Improve dashboard, but has already improved a lot since we started! Have tests run after every preview deploy

BACKGROUND

Please describe your company and position.

I am the Staff Program Manager - Quality and Testing of Salesloft

Describe what your company does in a single sentence.

Salesloft is the first AI-powered revenue orchestration platform.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automate Regression Tests

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• Pricing fit our budget
• Great culture fit
• Referred to me
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Automating our Regression Test Suite. We are focusing first on all of our Priority 0 and Priority 1UI regression tests.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Continuous addition of our tests being automated - 50/month, then 100/month. Running the test suite multiple times a day in less than 30 minutes.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf has been a pleasure to work with. They deliver on time and meet our needs along the way in timely and courteous manner. When we wanted faster runtimes, they delivered. When we asked for certain tests to be automated sooner, they delivered.

What was your primary form of communication with QA Wolf?

Virtual Meeting

What did you find most impressive or unique about this company?

Their willingness to always "find a way". Even with some interesting use cases we have and integrations with 3rd parties, they always find a way to make it work, and work well.

Are there any areas for improvement or something QA Wolf could have done differently?

Can't wait for the new multi-environment feature to go live!

BACKGROUND

Please describe your company and position.

I am the Software Engineer of Gumroad

Describe what your company does in a single sentence.

Makes software that helps people sell digital goods online.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• QA

SOLUTION

How did you find QA Wolf?

Other

Why did you select QA Wolf over others?

Other

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf writes tests for our software and provides a portal that informs us when something breaks the tests.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Reduced our QA spend and improved our QA since every time they write a test for us, it runs on every deployment. When we had manual QA, the same thing would only get tested once.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They are very quick at responding and addressing issues.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

No matter what time of day, they always respond almost instantly on Slack.

Are there any areas for improvement or something QA Wolf could have done differently?

We occasionally get false positives, but otherwise no issues!

BACKGROUND

Please describe your company and position.

 I am the VP Product & Engineering of an agriculture company 

Describe what your company does in a single sentence.

Provide environmental controls and automation to farms.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automated QA Testing

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf provided us with automated frontend end-to-end testing. Their team is extremely responsive and helpful - all you have to do is provide a loom of your application changes and they update the tests for you.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Reduction in time our staff has to spend writing QA tests to 1-2 hours a month.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf is very responsive and provides reliable service on a daily basis for our team.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

They completely take the manual parts of QA testing (writing tests, updating scripts, watching your test suite) off of your team's plate.

Are there any areas for improvement or something QA Wolf could have done differently?

Some tests can be flaky after several updates to our web application. This just means we need to be more diligent in staying in sync with the QA wolf team to update tests accordingly.

BACKGROUND

Please describe your company and position.

I am the Product Manager of ecomedes

Describe what your company does in a single sentence.

We house the world’s largest, most intelligent, and freshest catalog of sustainable building products and certifications.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• QA Testing

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Primary purpose is to detect bugs and flaws in site configuration and to monitor unexpected changes in data and certifications published. Deliverables include: 

• Overview of Testing Activities: Brief description of the types and phases of testing conducted 
• Testing Environment and Tools Used: Information about the testing environment, including hardware, operating systems, and software tools utilized during the testing process. 
• Test Coverage: Overview of the extent to which the software was tested. 
• Discovered Defects: Summary of the defects found during testing, often categorized by severity (e.g., critical, major, minor) or type (e.g., functional errors, performance issues, usability problems).

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Several key measurable outcomes include: 

• Test Coverage: The percentage of the product's features or code that has been tested. 
• Defect Detection and Resolution Rate: The number of defects found and resolved within a specific time frame.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf and the team has done as great job managing the project and workload for us. They are very responsive and comprehensive on their follow up to help us resolve the issues found from start to finish.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their team is very buttoned up and professional, responsive and communicative.

Are there any areas for improvement or something QA Wolf could have done differently?

QA Wolf is currently covering the majority of our testing needs at the moment. At the moment, we are happy with the service and can think of nothing to add, that would increase engagement.

BACKGROUND

Please describe your company and position.

I am the Engineering Director of Stacklet, Inc.

Describe what your company does in a single sentence.

Stacklet provides a cloud-governance-as-code platform that helps companies manage their security, asset visibility, operations, and cost optimization policies in the cloud.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Build and maintain automated test suite for core Stacklet products

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• Pricing fit our budget
• Great culture fit
• Good value for cost

Describe the scope of work in detail. Please include a summary of key deliverables.

We hired QA Wolf to build and maintain an automated test suite for our web app. Key deliverables:

1. Review app and develop test plan 
2. Implement tests in Playwright 
3. Execute test suite on a regular schedule or on demand, report results 
4. Achieve at least 80% coverage within 3 months 
5. Proactively review failing tests, fix flakes, file tickets for real bugs 
6. Implement tests for new features as our product evolves

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

QA Wolf developed a test suite for our product and achieved 99% coverage in 3-4 months. They provide ongoing maintenance, proactively investigating every test failure, fixing flakes, and filing bugs for real failures. They provide a nice dashboard that reports test results, and webhooks for integrating with our CI/CD pipelines. The tests are written in Playwright and the source is visible, so we can see exactly what the tests are doing.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They are well organized and extremely responsive, and have consistently delivered on what they promised. I've never been disappointed - they consistently meet or exceed my expectations.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Using QA Wolf is like having a team of experienced QA automation engineers on my own engineering staff, but at a fraction of the cost, and without any hiring or training overhead. They are also work quickly and save us a lot of time. 

They took us from 0% to 99% test coverage in a few months, and they handle all ongoing test maintenance and development with very little time investment from us. Finally, the team at QA Wolf are great people - knowledgeable, friendly, responsive, and fun to work with.

Are there any areas for improvement or something QA Wolf could have done differently?

I've been pleased with QA Wolf from the beginning, and they're getting better all the time, continually improving their service, and open to feedback and suggestions.