QA Wolf

BACKGROUND

Please describe your company and position.

I am the QA Automation Engineer of a software company 

Describe what your company does in a single sentence.

The operating system for sports organizations around the world

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Create and manage web automation tests

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• Great culture fit
• Referred to me

How many teammates from QA Wolf were assigned to this project?

15-20

Describe the scope of work in detail. Please include a summary of key deliverables.

Our goal for QA Wolf was for them to build out a web automation testing suite that mirrors what we previously had. The key deliverables were to verify we would have parity across both platforms and that QA Wolf would be self sufficient in test creation

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Making sure that QA Wolf is able to catch the same issues that we would find in our previous automation suite. Additionally during the pilot phase they had to hit a certain number of tests created by a certain date, which they succeeded at.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Yes, everything is delivered on time and even sometimes earlier than I expected. Throughout my time working with QA Wolf they have been incredibly responsive and are always on top of every task we ask of them. They take what we give them and run with it, making it very seamless for me

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The people, everyone that I've interacted with at QA Wolf has been incredibly kind, responsive, professional, and helpful. It makes it really easy to work with them as it truly feels like a team.

Are there any areas for improvement or something QA Wolf could have done differently?

No I think that my experience has been amazing, they've been incredibly helpful and I wouldn't change a thing about the last few months. Everything has been so seamless and truly stress free

BACKGROUND

Please describe your company and position.

 I am the Chief of Staff of a procurement platform.

Describe what your company does in a single sentence.

Our company is a single platform for procurement, purchase, and management of electronic components that works seamlessly with integrated logistics to assure that the physical management of electronics parts is always responsible and efficient.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Identifying regressions as soon as possible

SOLUTION

How did you find QA Wolf?

• Online Search
• Referral

Why did you select QA Wolf over others?

• High ratings
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf worked closely with our team to develop a comprehensive suite of tests across key user workflows, to detect any regressions as soon as possible. Any time an issue came up, the QA Wolf team would reach out to our team immediately. Issues could easily be turned into tickets for the Engineering team to work on.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

QA Wolf made it easy to create an audit of all existing tests, so that our team could look through the product (both old and new) and understand where to create additional test coverage. QA Wolf now catches the vast majority of regressions first.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

One of QA Wolf's greatest strengths is its customer success. We were assigned our own point of contact, with whom we were able to meet on a recurring basis to discuss goals and progress, as well as ask any questions. QA Wolf held a lunch & learn for the Engineering team to walk through the QA Wolf platform and ensure that everyone understood the self-serve functionality. 

Additionally, any time our team asked a question in our shared Slack channel, someone from the QA Wolf team would almost always respond within seconds. Folks were always willing to work together to figure out the right way to implement tests to ensure goals were being met.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

QA Wolf's responsiveness is excellent! We ran into a few regressions all at once and realized we need to audit and increase test coverage. Multiple folks on the QA Wolf team made themselves free to walk through these new product areas, so we could be sure to implement the tests most effectively.

Are there any areas for improvement or something QA Wolf could have done differently?

We would love it if the QA Wolf team proactively looked for redundancies across tests, so that we could use our test quota more optimally across our product. Currently, our product uses the same frontend components throughout the product, and each "uses up" a test. We'd love to identify opportunities to save on tests and costs.

BACKGROUND

Please describe your company and position.

I am the Director of Engineering, Content of Napster

Describe what your company does in a single sentence.

Napster, historically known for its role in peer-to-peer file sharing for music, has evolved into a legal streaming service offering access to a vast library of music and audio content.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Augment our QA team by having them handle e2e testing of our web apps
• identify any bugs that come up
• fully test newly released features

SOLUTION

How did you find QA Wolf?

word of mouth

Why did you select QA Wolf over others?

• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

• Integration and Setup: Implemented a straightforward integration of QA Wolf with our development pipeline for automated testing and configured automated test environments for the web application, internal tools, and APIs. 
• Automated Testing Suite Development: Developed comprehensive automated tests, including functional, regression, and performance tests. 
• Continuous Testing Framework: Established a framework for continuous, automated testing throughout the development lifecycle. 

Key Deliverables: 

• Automated Testing Suite: A set of automated tests tailored to our software's needs. 
• Integration Framework: A configured and operational framework for continuous testing. 
• Testing Reports: Regular, detailed reports on test outcomes, bugs, and performance metrics. 
• Continuous Improvement Plan: A strategy for ongoing test suite enhancement and optimization.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

1. Reduction in Manual Testing Hours: A significant decrease in the hours required for manual testing. 
2. Increased Test Coverage: An increase in the percentage of test coverage across the web application, internal tools, and APIs, ensuring more comprehensive quality assurance. At first this manifested in more bugs because they were identifying issues we had not caught, but overtime we saw more stability. 
3. Decrease in Bug Detection Time: A reduction in the average time it takes to detect and resolve bugs, indicating improved efficiency and responsiveness in the development process. Their bug reports are top notch. 
4. Team Productivity Went Way Up: Our devs can focus on developing and solving issues rather then hunting them down and monitoring test suites.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf nailed their project management. They always delivered on time, were super responsive to what we needed and they made communication a breeze, especially on Slack. We hardly ever had to reach out first because they were always one step ahead, keeping us in the loop and tackling things before we even thought to mention them. It felt like they were part of our team, always on the ball and making everything run smoothly.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

I'm impressed with the way they communicate, respond quickly and how modern and easy the whole process feels.

Are there any areas for improvement or something QA Wolf could have done differently?

not really

BACKGROUND

Please describe your company and position.

I am the Staff Engineer of Factoryfix

Describe what your company does in a single sentence.

FactoryFix connects manufacturing companies to vetted skilled workers for on-demand labor needs.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automated E2E Testing

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

• Initial Assessment: Understanding the specific needs, challenges, and objectives of our software to tailor the QA process. 
• Test Strategy Development: Creating a detailed plan that outlines the types of tests to be performed, tools to be used, and the overall testing timeline. 
• Automated Test Suite Creation: Developing a suite of automated tests tailored to our application, ensuring coverage of all new features and critical functionalities. 
• Comprehensive Test Reports: Detailed reports outlining the outcomes of all tests performed, including identified bugs, their severity, and recommendations for fixes. 
• Fixed Amount of Tests: Delivery of a predetermined number of tests within the agreed timeframe, ensuring a broad and deep coverage of the software’s features and functionalities. 
• Early Bug Detection: Rapid identification of any potential issues in the development cycle, allowing for timely corrections that prevent costly fixes post-release. 
• Quality Assurance Dashboard: Access to a real-time, interactive dashboard provided by QA Wolf, offering insights into the testing process, progress, and results.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Fixed amount of tests agreed upon contract within a timeline

Describe their project management. Did they deliver items on time? How did they respond to your needs?

The deliver on time and have dedicated engineers available through different timezones effectively providing 24/7 support

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Commitment to quality and ease of integration

Are there any areas for improvement or something QA Wolf could have done differently?

Hard to tell any but a more seamlessly CI/CD integration into Github would have been great

BACKGROUND

Please describe your company and position.

I am the Integrated Product Quality Specialist of Vividly

Describe what your company does in a single sentence.

We help CPG companies increase trade promotion ROI by more effectively planning trade promotions, forecasting sales and revenue, and improving trade deduction management.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Support in building automated QA (vs. adding more HC)
• Minimize/prevent regressions around releases

SOLUTION

How did you find QA Wolf?

• Referral
• Other

Why did you select QA Wolf over others?

• High ratings
• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

I was involved later on so I'm not sure what the original scope was ; as our priorities changed, so have our needs with QA Wolf ; during my involvement we've worked on building automated tests to support new feature releases, and other tests to prevent regressions

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Smooth launch (minimal bugs) ; time it takes to build tests

Describe their project management. Did they deliver items on time? How did they respond to your needs?

For the most part, the team was able to deliver most items we requested ; always felt supported

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Impressed with the team's ability to ramp quickly to understand the complexities behind our platform and build tests around it. We've had a few instances where we've been able to revert due to the bugs caught by QA Wolf; we were able to respond before our clients were impacted!

Are there any areas for improvement or something QA Wolf could have done differently?

I think there's a good amount of effort that goes into the material needed for the team to build tests for us (this created additional work vs. enlisting someone internal to do this) - if there is a way to make that more efficient, I think it would be helpful. Currently, it feels like we could have a role solely dedicated to managing our QA Wolf suite. I think if that's our biggest limitation at the moment, we just don't have the bandwidth to get the most out of this service and application.

BACKGROUND

Please describe your company and position.

I am the Engineering Manager of Praetorian

Describe what your company does in a single sentence.

We help our customers minimize the likelihood of compromise by using an adversarial perspective to uncover material risks the same way attackers do.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• End to end testing of our Chariot platform

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Provide end to end testing with at least 80% coverage of our application

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

App code coverage report with regularly scheduled end to end tests in our environments to catch regressions introduced.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

There are some communication gaps with the delivery of new coverage requests, it's hard to track when new tests get completed. Once the tests are completed, they are integrated well and we are alerted responsibly when the tests fail. We have very few false-positive alerts.

What was your primary form of communication with QA Wolf?

Email or Messaging App

What did you find most impressive or unique about this company?

They are very white glove and respond to all requests quickly. The tests are designed well, and the signal-to-noise ratio with false positive bug reports is good.

Are there any areas for improvement or something QA Wolf could have done differently?

It is difficult to track specifically which parts of our application have tests and which do not have tests. It would be good to have some kind of overlay telling me this information. Mentally tracking workflow names and test names to our own UI is difficult.

BACKGROUND

Please describe your company and position.

I am the Tech Lead of 86 Repairs

Describe what your company does in a single sentence.

86 Repairs is the repair and maintenance management platform built for the restaurant industry, including on-demand repair management and preventative maintenance.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• UI Test Suite Building/Maintenance
• Automated Testing Practices

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Great culture fit
• Good value for cost
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

We had many employees available to work with us at any time.

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf has been an invaluable partner in the development and maintenance of our internal web application. Their team not only assisted in testing the application but also played a crucial role in maintaining the tests as our main development team introduced new features. They were instrumental in constructing automated test runs and mapping out strategic plans for future Continuous Integration/Continuous Deployment (CI/CD) integrations with our deployment processes.

Additionally, QA Wolf provided expert advice on prioritizing tests to align with our budget and contractual agreements. Their expertise extended to conducting API endpoint testing, facilitating UI-based integration testing wherever applicable, ensuring a comprehensive testing framework that supported our development goals effectively.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

QA Wolf has provided significant benefits to our engineering processes, particularly in terms of developer-hour savings from test maintenance. This efficiency gain translated into thousands of developer hours being reallocated to focus more intensively on feature development within the main engineering team.

Additionally, we observed a dramatic reduction in the number of bugs reported in our JIRA backlog from production finds, with over a 90% decrease in issues for all features tested by QA Wolf. Furthermore, our contract with QA Wolf has proven to be exceptionally cost-effective for our company.

By leveraging their suite of developers and maintainers, we were able to replace the manpower equivalent to half-a-dozen full-time QA engineers. This strategic decision has resulted in saving our engineering budget hundreds of thousands of dollars annually, underscoring the value and efficiency QA Wolf brings to our operations.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf has consistently met our expectations by delivering items and milestones on time. They played a crucial role in planning the quarterly phases of test suite development, ensuring alignment and comfort with our main engineering team. The initial integration and setup process, facilitated by their onboarding team and the Director of Engineering, instilled confidence in their work ethic and consistency, affirming the effectiveness of our partnership.

Regular bi-weekly check-ins between QA Wolf's Customer Service representative and our assigned lead developer ensured continuous alignment in our collaborative efforts. Additionally, the implementation of interactive Slack integration between our teams greatly enhanced our communication, making it easier and more efficient to address high-priority issues promptly.

This comprehensive approach to partnership and project management has not only streamlined our processes but also reinforced our confidence in QA Wolf's capabilities and dedication to success.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

QA Wolf has consistently impressed us with their unwavering commitment to maintaining high-quality testing services over the past year. Their ability to sustain this level of excellence has been pivotal in bolstering our confidence throughout our feature development process, a critical need for us as a fast-paced startup.

Their communication has been exemplary, keeping us well-informed about their activities, roadmaps, and milestones, which has greatly contributed to the smooth collaboration between our teams. Furthermore, in light of our company's budget constraints in the past financial year, QA Wolf has been incredibly understanding and flexible.

They have valued our partnership, working closely with us to find innovative solutions that enable us to continue our engagement with them, despite our tightened budget. This collaborative spirit and their dedication to accommodating our financial situation have deepened our appreciation for QA Wolf's exceptional service and partnership.

Are there any areas for improvement or something QA Wolf could have done differently?

At present, there appear to be no significant concerns or red flags associated with QA Wolf, indicating a satisfactory business relationship thus far. Looking ahead, should QA Wolf maintain its current level of performance and service quality into the next financial year, we would be exceedingly pleased to continue our partnership with them. This stability and reliability in their operations reinforce our confidence in their capabilities as a business partner.

BACKGROUND

Please describe your company and position.

I am the Product Manager of Padlet

Describe what your company does in a single sentence.

We create an online collaborative platform used by a lot of teachers and students.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Create automated testing procedures for our product

SOLUTION

How did you find QA Wolf?

• Online Search
• Referral

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Great culture fit
• Good value for cost
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

We work with them to create our automated testing processes and whenever any of the workflows are broken, they inform us so that our engineering team can go in and fix it. They also maintain all of these workflows so that whenever there are any feature changes, they adapt the workflow so they continue to behave correctly.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The length of time it takes for us to identify and fix a broken workflow. The number of broken workflows that are unidentified

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They are very timely, but do take a while to create new workflows when we have new features. They have been extremely responsive whenever we request additional information to fix broken workflows. I estimate a response time of under 5 minutes for any given message or request.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their responsiveness to any of our requests has been impressive, as well as their friendliness with any of their responses.

Are there any areas for improvement or something QA Wolf could have done differently?

Nothing that comes to mind - the only thing might be length of time it takes for them to create the workflows as well as cost of service. But I think the quality of the service makes it worthwhile

BACKGROUND

Please describe your company and position.

I am the SVP of Engineering of the company

Describe what your company does in a single sentence.

We provide a user-friendly solution for small-to-medium-sized businesses that enables employees to delight customers while providing deep, insightful data to improve their company.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Prevent software regressions
• Manage an end-to-end test suite

SOLUTION

How did you find QA Wolf?

Email outreach

Why did you select QA Wolf over others?

• Great culture fit
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf takes the headache out of maintaining brittle end to end automated tests. We can have our devs focus on building features, instead of figuring out how to build reliable end to end tests. The greatest benefit to QA Wolf isn't that they just write tests for us, it's the added value of them maintaining the tests for us over time as our application continues to change.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

We were able to repurpose a full-time developer who exclusively updated brittle tests. We were also able to reduce the amount of manual tests we do between releases, eliminating the need for a manual QA team.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They have done a good job setting expectations for what they can deliver and how long it will take. We have an ongoing work relationship with them. As we release features each month, they add some tests to cover the new features. They are good and communicating and making sure our needs are met.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The staff we have worked with at QA Wolf are high-quality. Everyone I've interacted with would make a great addition to my own team. They hire the best people and we enjoy working with them.

Are there any areas for improvement or something QA Wolf could have done differently?

One thing QA Wolf could improve is making it more cost effective to work in different environments. Currently, their solution is to duplicate tests for different environments. We'd much prefer a single suite of tests that can be run across different environments/versions that they wouldn't have to maintain separately. I know they have something in the works to make this better, but it is a limitation of their current offering.