QA Wolf

BACKGROUND

Please describe your company and position.

I am the Staff Engineer of Factoryfix

Describe what your company does in a single sentence.

FactoryFix connects manufacturing companies to vetted skilled workers for on-demand labor needs.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automated E2E Testing

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

• Initial Assessment: Understanding the specific needs, challenges, and objectives of our software to tailor the QA process. 
• Test Strategy Development: Creating a detailed plan that outlines the types of tests to be performed, tools to be used, and the overall testing timeline. 
• Automated Test Suite Creation: Developing a suite of automated tests tailored to our application, ensuring coverage of all new features and critical functionalities. 
• Comprehensive Test Reports: Detailed reports outlining the outcomes of all tests performed, including identified bugs, their severity, and recommendations for fixes. 
• Fixed Amount of Tests: Delivery of a predetermined number of tests within the agreed timeframe, ensuring a broad and deep coverage of the software’s features and functionalities. 
• Early Bug Detection: Rapid identification of any potential issues in the development cycle, allowing for timely corrections that prevent costly fixes post-release. 
• Quality Assurance Dashboard: Access to a real-time, interactive dashboard provided by QA Wolf, offering insights into the testing process, progress, and results.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Fixed amount of tests agreed upon contract within a timeline

Describe their project management. Did they deliver items on time? How did they respond to your needs?

The deliver on time and have dedicated engineers available through different timezones effectively providing 24/7 support

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Commitment to quality and ease of integration

Are there any areas for improvement or something QA Wolf could have done differently?

Hard to tell any but a more seamlessly CI/CD integration into Github would have been great

BACKGROUND

Please describe your company and position.

I am the Integrated Product Quality Specialist of Vividly

Describe what your company does in a single sentence.

We help CPG companies increase trade promotion ROI by more effectively planning trade promotions, forecasting sales and revenue, and improving trade deduction management.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Support in building automated QA (vs. adding more HC)
• Minimize/prevent regressions around releases

SOLUTION

How did you find QA Wolf?

• Referral
• Other

Why did you select QA Wolf over others?

• High ratings
• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

I was involved later on so I'm not sure what the original scope was ; as our priorities changed, so have our needs with QA Wolf ; during my involvement we've worked on building automated tests to support new feature releases, and other tests to prevent regressions

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Smooth launch (minimal bugs) ; time it takes to build tests

Describe their project management. Did they deliver items on time? How did they respond to your needs?

For the most part, the team was able to deliver most items we requested ; always felt supported

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Impressed with the team's ability to ramp quickly to understand the complexities behind our platform and build tests around it. We've had a few instances where we've been able to revert due to the bugs caught by QA Wolf; we were able to respond before our clients were impacted!

Are there any areas for improvement or something QA Wolf could have done differently?

I think there's a good amount of effort that goes into the material needed for the team to build tests for us (this created additional work vs. enlisting someone internal to do this) - if there is a way to make that more efficient, I think it would be helpful. Currently, it feels like we could have a role solely dedicated to managing our QA Wolf suite. I think if that's our biggest limitation at the moment, we just don't have the bandwidth to get the most out of this service and application.

BACKGROUND

Please describe your company and position.

I am the Engineering Manager of Praetorian

Describe what your company does in a single sentence.

We help our customers minimize the likelihood of compromise by using an adversarial perspective to uncover material risks the same way attackers do.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• End to end testing of our Chariot platform

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Provide end to end testing with at least 80% coverage of our application

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

App code coverage report with regularly scheduled end to end tests in our environments to catch regressions introduced.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

There are some communication gaps with the delivery of new coverage requests, it's hard to track when new tests get completed. Once the tests are completed, they are integrated well and we are alerted responsibly when the tests fail. We have very few false-positive alerts.

What was your primary form of communication with QA Wolf?

Email or Messaging App

What did you find most impressive or unique about this company?

They are very white glove and respond to all requests quickly. The tests are designed well, and the signal-to-noise ratio with false positive bug reports is good.

Are there any areas for improvement or something QA Wolf could have done differently?

It is difficult to track specifically which parts of our application have tests and which do not have tests. It would be good to have some kind of overlay telling me this information. Mentally tracking workflow names and test names to our own UI is difficult.

BACKGROUND

Please describe your company and position.

I am the Tech Lead of 86 Repairs

Describe what your company does in a single sentence.

86 Repairs is the repair and maintenance management platform built for the restaurant industry, including on-demand repair management and preventative maintenance.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• UI Test Suite Building/Maintenance
• Automated Testing Practices

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Great culture fit
• Good value for cost
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

We had many employees available to work with us at any time.

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf has been an invaluable partner in the development and maintenance of our internal web application. Their team not only assisted in testing the application but also played a crucial role in maintaining the tests as our main development team introduced new features. They were instrumental in constructing automated test runs and mapping out strategic plans for future Continuous Integration/Continuous Deployment (CI/CD) integrations with our deployment processes.

Additionally, QA Wolf provided expert advice on prioritizing tests to align with our budget and contractual agreements. Their expertise extended to conducting API endpoint testing, facilitating UI-based integration testing wherever applicable, ensuring a comprehensive testing framework that supported our development goals effectively.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

QA Wolf has provided significant benefits to our engineering processes, particularly in terms of developer-hour savings from test maintenance. This efficiency gain translated into thousands of developer hours being reallocated to focus more intensively on feature development within the main engineering team.

Additionally, we observed a dramatic reduction in the number of bugs reported in our JIRA backlog from production finds, with over a 90% decrease in issues for all features tested by QA Wolf. Furthermore, our contract with QA Wolf has proven to be exceptionally cost-effective for our company.

By leveraging their suite of developers and maintainers, we were able to replace the manpower equivalent to half-a-dozen full-time QA engineers. This strategic decision has resulted in saving our engineering budget hundreds of thousands of dollars annually, underscoring the value and efficiency QA Wolf brings to our operations.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf has consistently met our expectations by delivering items and milestones on time. They played a crucial role in planning the quarterly phases of test suite development, ensuring alignment and comfort with our main engineering team. The initial integration and setup process, facilitated by their onboarding team and the Director of Engineering, instilled confidence in their work ethic and consistency, affirming the effectiveness of our partnership.

Regular bi-weekly check-ins between QA Wolf's Customer Service representative and our assigned lead developer ensured continuous alignment in our collaborative efforts. Additionally, the implementation of interactive Slack integration between our teams greatly enhanced our communication, making it easier and more efficient to address high-priority issues promptly.

This comprehensive approach to partnership and project management has not only streamlined our processes but also reinforced our confidence in QA Wolf's capabilities and dedication to success.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

QA Wolf has consistently impressed us with their unwavering commitment to maintaining high-quality testing services over the past year. Their ability to sustain this level of excellence has been pivotal in bolstering our confidence throughout our feature development process, a critical need for us as a fast-paced startup.

Their communication has been exemplary, keeping us well-informed about their activities, roadmaps, and milestones, which has greatly contributed to the smooth collaboration between our teams. Furthermore, in light of our company's budget constraints in the past financial year, QA Wolf has been incredibly understanding and flexible.

They have valued our partnership, working closely with us to find innovative solutions that enable us to continue our engagement with them, despite our tightened budget. This collaborative spirit and their dedication to accommodating our financial situation have deepened our appreciation for QA Wolf's exceptional service and partnership.

Are there any areas for improvement or something QA Wolf could have done differently?

At present, there appear to be no significant concerns or red flags associated with QA Wolf, indicating a satisfactory business relationship thus far. Looking ahead, should QA Wolf maintain its current level of performance and service quality into the next financial year, we would be exceedingly pleased to continue our partnership with them. This stability and reliability in their operations reinforce our confidence in their capabilities as a business partner.

BACKGROUND

Please describe your company and position.

I am the Product Manager of Padlet

Describe what your company does in a single sentence.

We create an online collaborative platform used by a lot of teachers and students.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Create automated testing procedures for our product

SOLUTION

How did you find QA Wolf?

• Online Search
• Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Great culture fit
• Good value for cost
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

We work with them to create our automated testing processes and whenever any of the workflows are broken, they inform us so that our engineering team can go in and fix it. They also maintain all of these workflows so that whenever there are any feature changes, they adapt the workflow so they continue to behave correctly.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The length of time it takes for us to identify and fix a broken workflow. The number of broken workflows that are unidentified

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They are very timely, but do take a while to create new workflows when we have new features. They have been extremely responsive whenever we request additional information to fix broken workflows. I estimate a response time of under 5 minutes for any given message or request.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their responsiveness to any of our requests has been impressive, as well as their friendliness with any of their responses.

Are there any areas for improvement or something QA Wolf could have done differently?

Nothing that comes to mind - the only thing might be length of time it takes for them to create the workflows as well as cost of service. But I think the quality of the service makes it worthwhile

BACKGROUND

Please describe your company and position.

I am the SVP of Engineering of the company

Describe what your company does in a single sentence.

We provide a user-friendly solution for small-to-medium-sized businesses that enables employees to delight customers while providing deep, insightful data to improve their company.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Prevent software regressions
• Manage an end-to-end test suite

SOLUTION

How did you find QA Wolf?

Email outreach

Why did you select QA Wolf over others?

• Great culture fit
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf takes the headache out of maintaining brittle end to end automated tests. We can have our devs focus on building features, instead of figuring out how to build reliable end to end tests. The greatest benefit to QA Wolf isn't that they just write tests for us, it's the added value of them maintaining the tests for us over time as our application continues to change.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

We were able to repurpose a full-time developer who exclusively updated brittle tests. We were also able to reduce the amount of manual tests we do between releases, eliminating the need for a manual QA team.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They have done a good job setting expectations for what they can deliver and how long it will take. We have an ongoing work relationship with them. As we release features each month, they add some tests to cover the new features. They are good and communicating and making sure our needs are met.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The staff we have worked with at QA Wolf are high-quality. Everyone I've interacted with would make a great addition to my own team. They hire the best people and we enjoy working with them.

Are there any areas for improvement or something QA Wolf could have done differently?

One thing QA Wolf could improve is making it more cost effective to work in different environments. Currently, their solution is to duplicate tests for different environments. We'd much prefer a single suite of tests that can be run across different environments/versions that they wouldn't have to maintain separately. I know they have something in the works to make this better, but it is a limitation of their current offering.

BACKGROUND

Introduce your business and what you do there.

I’m the CTO and co-founder of a four-year-old startup. We’re a mission-driven finance company for the underbanked.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Wolf?

We needed to manage the quality of our product. This is normally done in-house, but we didn’t have the team nor the capacity to cover it, so we hired QA Wolf.

SOLUTION

What was the scope of their involvement?

QA Wolf acts as our quality assurance solutions provider. Their team develops, runs, and maintains validation tests for our product, which is a web app. They have a unique toolset which they use to build out our test environment for us. 

We do continuous integration builds and this generates a bundle that will get deployed. QA Wolf’s system triggers off of that, running a series of tests and permutations of those against our staging environment. They also help us define and build out our matrixes using their toolset. This entire process ensures that the app conforms to specifications, is responsive, and performs all of the services with very little oversight from us.

If anything breaks or fails, they immediately contact us and try to resolve the issue. They identify whether there is a regression or a change in behavior that we have to test for, and they work with us to build out new tests that could cover new sections of the app or a new user flow.

What is the team composition?

We work with 3–4 people: an architect, a solutions expert, an account manager, and the CEO of QA Wolf. The account manager is our primary touchpoint. She engages us in case there are any issues and she gives us weekly reports and updates. 

How did you come to work with QA Wolf?

I discovered them through various networks. I’ve seen many companies provide the same set of services and repackage it only to achieve the same mediocre results. However, what made QA Wolf stand out from other providers was their tooling and novel way of approaching quality as a service. I vetted their technology and was impressed by it, so I decided to give them a try.

How much have you invested with them?

Thus far, we’ve invested around $50,000–$60,000.

What is the status of this engagement?

Our relationship with QA Wolf is ongoing, and it started around June 2021.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We measure the success of QA Wolf’s work through hard data. We get reports of regressions and major user path coverage on a per-release or per-build status. 

How did QA Wolf perform from a project management standpoint?

QA Wolf is very responsive. Once I realized that they knew what they were doing, I’ve been more hands-off and reliant on their team. They spend their time wisely and proactively tell me what I need to do or what I need to know, and this allows me to focus more on other things. 

What did you find most impressive about them?

I have a huge load of confidence from knowing that every hour they spend, they spend efficiently. I can see that the time they put in meaningfully improves the quality of the product for the majority of our users. I appreciate that they don’t waste their time fixing obscure things, but instead direct their attention towards making sure that primary paths, core use cases, and things that drive our revenue are always up and serviceable.

Are there any areas they could improve?

No, I can’t really think of anything for them to improve on. They’ve done nothing but add value to our company. 

Do you have any advice for potential customers?

Give QA Wolf as much information as you can about what you want them to deliver, but don’t try to micromanage them. They’re efficient and very self-sufficient, and it would only be a waste of time to try to micromanage a team like that. 

BACKGROUND

Please describe your company and position.

I am a Department Lead at CallRevu

Describe what your company does in a single sentence.

Company built software to aid the automotive industry (and auto-adjacent) in their customer's experiences.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automate Regression
• Speed up regression

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• Good value for cost
• Company values aligned
• Great team to work with

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

regression testing across both lower environments and production

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Contributed to improving the speed of regression testing across both lower environments and production
• Allows manual QA to focus on new features/updates while their teams can focus on regression

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf has delivered on the dates promised. As things changed, they were able to pivot with little to no impact.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

How quickly they can update test cases that have changed.

Are there any areas for improvement or something QA Wolf could have done differently?

The integration with our ticketing system could have been better so that we didn't have to manage tickets in multiple locations.

BACKGROUND

Please describe your company and position.

I am the Product Manager of a financial services company.

Describe what your company does in a single sentence.

Founded by leading capital markets lawyers, the company is the first and only platform of its kind—offering end-to-end capital raising solutions for any business at any stage. Founders have raised over $2B and counting through our technology, both from their own communities and through strategically marketed campaigns.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Helping with the QA process

SOLUTION

How did you find QA Wolf?

• Online Search
• Other

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Great culture fit
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

We engaged QA Wolf for the following services:  Automation testing General QA of our product to trag and find any bugs Pre-deployment testing 

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

I'm not super familiar, i've just been helping out from the product side of things. 

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Yes they have, they are extremely efficient and responsive

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their responsiveness is phenomenal. They are very thorough with their work. 

Are there any areas for improvement or something QA Wolf could have done differently?

None

BACKGROUND

Please describe your company and position.

I am the QA Analyst of WordWatch.io

Describe what your company does in a single sentence.

We develop a compliance platform called WordWatch. 

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automate Regression Testing
• Reduce Production bugs
• Shortern time to market

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• Great culture fit
• Good value for cost
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Automate regression testing of our project.  Understand the nature of the application Convert manual test cases to automation Execute automated regression suite on a regular schedule Maintain automated test cases Investigate failures in test runs Report bugs  

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Regular automated test runs
• Detection of bugs 
• Reduce release testing time

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They provide da clean line of communcation both at project management and day-to-day execution level. The delivered on time. They were always highly responsive to any requests from out side and followed up on any promises they made. 

What was your primary form of communication with QA Wolf?

Virtual Meeting

What did you find most impressive or unique about this company?

• Execellent communication
• Well-organised project struture
• Their pragmatic approach to demanding situations impressed us.
• Agility in responding to changing priorities 

Are there any areas for improvement or something QA Wolf could have done differently?

They have served the needs of our project very well already.