QA Wolf

BACKGROUND

Please describe your company and position.

I am the CEO of Red Hook Agency

Describe what your company does in a single sentence.

We are a software development consulting firm.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

To deliver and maintain a suite of E2E tests for a client

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• High ratings
• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf delivered a suite of End-To-End (E2E) tests based on our specifications. Once the tests are delivered, QA Wolf actively monitors for failures, filters out false positives or updates the tests if needed, and then alerts us if a bug has been found through automated or manual methods. 

Additionally, QA Wolf's team has a platform that connects directly to our Jira to automatically create issues. 

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Our client's application started with zero automated testing and a lot of risk for every change.  We have now built a test suite that the client can depend on without taking the time to hire an additional team or train the existing team before business value could be realized from automated testing.  

In that time, we have been able to begin training the team to build their own automated testing and continue to leverage QA Wolf for tests that are difficult for the internal team to maintain in a cost efficient way. 

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They've always set great expectations when it comes to timelines and delivered on those processes. They are extremely quick to respond to any need. 

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their ability to gain business context from an existing application/product with just a few questions is very impressive. 

Are there any areas for improvement or something QA Wolf could have done differently?

I enjoy working with QA Wolf and do not have any critical feedback so far. 

BACKGROUND

Please describe your company and position.

I am the Senior QA Engineer of Vendoo

Describe what your company does in a single sentence.

Vendoo is a leading platform empowering resellers to expand their businesses by providing tools and features that streamline online reselling processes.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Implement automated testing for existing functionalities to ensure consistent and thorough regression testing, thereby reducing manual effort and improving efficiency
• Free up QA resources from repetitive regression testing tasks, allowing them to dedicate more time and attention to testing new features and implementing enhancements.
• Establish a robust testing framework and strategy to achieve comprehensive test coverage, instilling confidence in the quality and reliability of Vendoo's software platform.

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• Great culture fit
• Good value for cost
• Tech Stack

How many teammates from QA Wolf were assigned to this project?

6-10 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

The scope of work undertaken by QA Wolf encompassed several key areas to meet Vendoo's objectives:

1. Automate Regression Tests: QA Wolf implemented a comprehensive automated testing framework to cover regression testing for existing functionalities within Vendoo's platform. This involved identifying critical test scenarios, developing automated test scripts, and integrating them into the continuous integration (CI) pipeline for regular execution.
2. Free Up QA Time for New Functionalities: By taking over the responsibility of automated regression testing, QA Wolf enabled Vendoo's QA team to redirect their focus towards testing new features and implementing enhancements. This allowed for faster iteration and development cycles, leading to quicker feature releases and overall improvements to the platform.
3. Ensure Confidence in Test Coverage: QA Wolf worked closely with Vendoo to establish a robust testing strategy aimed at achieving comprehensive test coverage. Through thorough testing practices, QA Wolf instilled confidence in the quality and reliability of Vendoo's software.
4. Best Practices Implementation: QA Wolf provided guidance and expertise on best practices in software testing, including timely bug reporting, structured testing processes, and accountability for test maintenance. Vendoo's team benefited from learning and adopting industry-standard practices, enhancing their overall testing efficiency and effectiveness.

Key Deliverables:

• Automated regression test suite covering critical functionalities of the Vendoo platform.
• Documentation of test plans, test cases, and testing processes.
• Integration of automated tests into the CI pipeline for continuous execution.
• Training sessions and knowledge transfer on testing best practices and process improvements.
• Regular reporting on test results, including identified bugs, test coverage metrics, and recommendations for further enhancements.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

1. Test Coverage: Vendoo's test coverage has improved significantly, with the QA Wolf Dashboard indicating that the coverage requests have been fulfilled. Ensuring that automated tests adequately cover critical functionalities.
2. Active Tests and Parallel Runs: The Qa Wolf Dashboard shows the number of active tests and conducts parallel runs, indicating high testing activity and efficiency. This suggests that QA Wolf's automation efforts have enabled Vendoo to scale its testing efforts effectively while minimizing testing time.
3. Bug Management: The Dashboard provides visibility into identified bugs, with total bugs reported. They are constantly sharing any unexpected behavior in our platform, and they can use your reporting tool, in our case Jira, to create the bugs found.
4. Dev Time Saved: The Wolf pack activity section highlights the total of hours saved of developer time, indicating increased efficiency in identifying and resolving issues through automated testing. 
5. Test Suite Overview: The Dashboard provides an overview of Vendoo's test suite, including the number of tests in different categories such as inventory, settings, analytics, and more. This breakdown allows Vendoo to assess test coverage across various areas of the platform and prioritize testing efforts accordingly.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf exhibited excellent project management throughout our partnership, consistently delivering items on time and exceeding expectations in their responsiveness to our needs. They demonstrated a proactive approach, always asking the right questions to understand our requirements thoroughly and ensuring alignment with our objectives. 
Moreover, QA Wolf went above and beyond by proactively reaching out when they identified new functionalities in our platform, suggesting ways to incorporate them into our testing strategy. Overall, QA Wolf's project management was exemplary, characterized by professionalism, responsiveness, and a commitment to delivering high-quality results.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

What impressed us most about QA Wolf was the exceptional quality of their work and the caliber of each engineer on their team. Their dedication to delivering high-quality testing solutions is evident in every aspect of their work, from the meticulous attention to detail in their test scripts to the thoroughness of their bug reports. Each engineer demonstrated a deep understanding of software testing principles and best practices, coupled with a proactive mindset and a commitment to excellence. 

Are there any areas for improvement or something QA Wolf could have done differently?

None

BACKGROUND

Please describe your company and position.

I am the Founder & CTO of Arketa

Describe what your company does in a single sentence.

Booking and marketing automation software for fitness professionals

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Automate UI Tests for Web apps

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• High ratings
• Pricing fit our budget
• Great culture fit

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

The scope of work with QA Wolf involves setting up the testing environment in Playwright, creating automated end-to-end tests for web applications through a no-code/low-code approach, and integrating these tests into our development pipeline. Key deliverables include a suite of reliable automated tests, detailed test reports for tracking bugs and performance issues, ensuring high-quality web application delivery.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Successfully delivered 125 automated tests in under 90 days, demonstrating enhanced testing efficiency and significantly accelerated development cycles for the web application project.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They were effective and responsive, maintaining on-time delivery of tasks. Communication was primarily through Slack, where they notified us about any test failures and provided weekly updates to showcase progress.

What was your primary form of communication with QA Wolf?

Email or Messaging App

What did you find most impressive or unique about this company?

The most impressive part was their speed in spinning up tests, quickly creating comprehensive test suites with efficiency and precision.

Are there any areas for improvement or something QA Wolf could have done differently?

They could have been a part of our manual testing process ensuring that features are built properly before shipping

BACKGROUND

Please describe your company and position.

I am the Head of Engineering of Compt

Describe what your company does in a single sentence.

My company offers a perk management online platform.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Decrease the number of defects and bugs
• Ensure we continuously deliver high quality software

SOLUTION

How did you find QA Wolf?

Cold out reach from QA Wolf

Why did you select QA Wolf over others?

• Close to my geographic location
• Great culture fit
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

The project's scope with QA Wolf was to have at least 80% automated test coverage of the most critical features of our product implemented in the QA Wolf platform. QA Wolf implemented and delivered all the agreed-upon tests fully and on time, paired with walk-through and onboarding to ensure our team was properly trained to navigate and understand their platform effectively.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The high test coverage and the fact that QA Wolf has caught multiple bugs before they made it into production are just two examples demonstrating the continuous process and great success of QA Wolf.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf delivered the coverage we agreed on on time. They are always very prompt to answer our inquiries and to create new coverage when we need it. We could not ask for better support in this regard!

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

QA Wolf's way of providing QA as a partner is like nothing I've seen before. Getting test coverage and seeing its results and impact on their platform is easy so we have no hesitation to connect with them when needed. Also, the way the coverage is swiftly added behind the scenes and delivered to us feels like magic!

Are there any areas for improvement or something QA Wolf could have done differently?

In terms of their product and service, and how their team operates, I can't think of anything they could improve. QA Wolf is truly a great partner to work with.

BACKGROUND

Please describe your company and position.

I am the Senior Engineering Manager of a sports software company.

Describe what your company does in a single sentence.

We build software that empowers sports teams to focus on maximising their athletes's performance.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Increase release cadence and confidence
• Allow the internal dev team to focus on delivering value

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

• High ratings
• Great culture fit
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

10+

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf came in to help us build out our E2E suite and maintain the tests so the team could focus on building business logic without the distraction of dealing with flaky tests and false flags. We started with a pilot, where QA Wolf were extremely helpful in identifying areas where tests could be applied, and were able to hit their advertised "80% test coverage in 4 months" target. 

We immediately saw the value in having the wolf pack as part of our SDLC and expanded our test suite and continue to grow it to this day.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

The first metric of success was that the 80% in 4 months goal was hit on time. As part of the initial suite of tests we were able to automate the vast majority of what was a manual test suite, which allowed our internal team to dedicate that time back to supporting customers and providing value. The QA Wolf test suite has caught a good number of bugs before they hit production, and the team's confidence in releases has increased significantly since we brought them on board.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

The team had during the pilot phase the team had a well oiled, battle tested scope of work and the stuck to the schedule religiously. The followed up where necessary and made sure that we were always kept abreast of where the team were at. Since we've passed out of the pilot phase the team have remained extremely proactive, ensuring that any new coverage requests are quickly actioned and any test failures are triaged as soon as possible.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The thing I've been most impressed by with QA Wolf is their attitude and proactivity. Any company can and should hit their promised targets, but the way QA Wolf goes above and beyond to do it in a positive way is amazing. Their team sit in a shared slack channel and their response times are always within a few minutes. 

They are always happy to help, and in places where they may not understand the platform, they are keen to learn and share their learnings among the team. There have been many companies I've worked with with good customer service, but QA Wolf are a rare case of being truly great.

Are there any areas for improvement or something QA Wolf could have done differently?

There's not much I would change about QA Wolf, they are a joy to work with. I would love to see them expand their capabilities to cover even more testing areas (eg. mobile testing).

BACKGROUND

Please describe your company and position.

 I am the Engineering Manager of a software company 

Describe what your company does in a single sentence.

Automate security & compliance

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Add E2E tests

SOLUTION

How did you find QA Wolf?

Online Search

Why did you select QA Wolf over others?

High ratings

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

We initially conducted a POC with QA Wolf to determine if this was the right product for us. We implemented roughly 100 tests with QA Wolf, and the tests did help prevent many regressions. We've since been working with QA Wolf to roll out tests for the entire product.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Number of regressions / bugs prevented 
• Number of tests, and number of developer hours saved from writing the tests

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf has very strong project management chops. Items are always delivered on time, and they communicate their implementation plans with target dates very clearly. The QA Wolf team has always been extremely fast to respond, and they are a delight to work with.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their responsiveness! They usually always respond to Slack messages within 5 minutes (usually 2 or 3), and they are very quick to identify and triage bugs, rerun tests, and are diligent in writing and verifying tests also. They were a great company to partner with; their product and processes were easy to use and incorporate.

Are there any areas for improvement or something QA Wolf could have done differently?

I do wish the QA Wolf app had more functionality around managing and tracking bugs, but they are taking feedback and are working to improve the app.

BACKGROUND

Please describe your company and position.

I am the Head of Engineering of Surfside

Describe what your company does in a single sentence.

Surfside is a comprehensive marketing technology that consolidates your first-party data from all customer interactions. It enables advertisers to gain insights, target effectively, and measure strategies to impact both current and potential customers.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Test Coverage on out client facing platforms

SOLUTION

How did you find QA Wolf?

Other

Why did you select QA Wolf over others?

• Good value for cost
• Company values aligned

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Our collaboration with QA Wolf focuses on creating a targeted testing strategy, primarily for end-to-end testing of our feature-rich platform, which is frequently updated. The scope covers: 

• End-to-End Testing 
• Regression Testing 
• Feature Testing 
• Sanity Checks 

Deliverables include: 

• Detailed Test Reports 
• UI Testing Results 
• Bug Statistics 
• Integration with Jira for ticketing 
• Test replays 
• looms etc.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Using QA Wolf has significantly improved our testing coverage, especially with end-to-end tests, accounting for about 80% of our testing needs. it created a streamlined process for identifying and fixing bugs especially regressions. This allowed our team to focus more on developing new features and maintaining a steady release schedule.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf's project management has been quite effective. They consistently meet our deadlines, showing they really grasp our timing needs. They're quick to answer whenever we reach out with questions or need support, helping everything run smoothly. They guide us on how to better integrate and utilize their services, though there's room to dive deeper into their offerings. Overall, their assistance greatly simplifies managing the testing aspects of our projects.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The most impressive aspect of QA Wolf is their quick response time and expertise across various testing areas, which has significantly eased our testing process.

Are there any areas for improvement or something QA Wolf could have done differently?

QA Wolf has been very effective in responsiveness and testing expertise, making a significant contribution to our projects. To add even more value, providing detailed guidance on integrating their services throughout the project lifecycle could help us fully utilize their potential and further streamline our dev process.

BACKGROUND

Please describe your company and position.

I am the QA Automation Engineer of a software company 

Describe what your company does in a single sentence.

The operating system for sports organizations around the world

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Create and manage web automation tests

SOLUTION

How did you find QA Wolf?

Referral

Why did you select QA Wolf over others?

• Great culture fit
• Referred to me

How many teammates from QA Wolf were assigned to this project?

15-20

Describe the scope of work in detail. Please include a summary of key deliverables.

Our goal for QA Wolf was for them to build out a web automation testing suite that mirrors what we previously had. The key deliverables were to verify we would have parity across both platforms and that QA Wolf would be self sufficient in test creation

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Making sure that QA Wolf is able to catch the same issues that we would find in our previous automation suite. Additionally during the pilot phase they had to hit a certain number of tests created by a certain date, which they succeeded at.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Yes, everything is delivered on time and even sometimes earlier than I expected. Throughout my time working with QA Wolf they have been incredibly responsive and are always on top of every task we ask of them. They take what we give them and run with it, making it very seamless for me

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The people, everyone that I've interacted with at QA Wolf has been incredibly kind, responsive, professional, and helpful. It makes it really easy to work with them as it truly feels like a team.

Are there any areas for improvement or something QA Wolf could have done differently?

No I think that my experience has been amazing, they've been incredibly helpful and I wouldn't change a thing about the last few months. Everything has been so seamless and truly stress free

BACKGROUND

Please describe your company and position.

 I am the Chief of Staff of a procurement platform.

Describe what your company does in a single sentence.

Our company is a single platform for procurement, purchase, and management of electronic components that works seamlessly with integrated logistics to assure that the physical management of electronics parts is always responsible and efficient.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Identifying regressions as soon as possible

SOLUTION

How did you find QA Wolf?

• Online Search
• Referral

Why did you select QA Wolf over others?

• High ratings
• Good value for cost

How many teammates from QA Wolf were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

QA Wolf worked closely with our team to develop a comprehensive suite of tests across key user workflows, to detect any regressions as soon as possible. Any time an issue came up, the QA Wolf team would reach out to our team immediately. Issues could easily be turned into tickets for the Engineering team to work on.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

QA Wolf made it easy to create an audit of all existing tests, so that our team could look through the product (both old and new) and understand where to create additional test coverage. QA Wolf now catches the vast majority of regressions first.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

One of QA Wolf's greatest strengths is its customer success. We were assigned our own point of contact, with whom we were able to meet on a recurring basis to discuss goals and progress, as well as ask any questions. QA Wolf held a lunch & learn for the Engineering team to walk through the QA Wolf platform and ensure that everyone understood the self-serve functionality. 

Additionally, any time our team asked a question in our shared Slack channel, someone from the QA Wolf team would almost always respond within seconds. Folks were always willing to work together to figure out the right way to implement tests to ensure goals were being met.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

QA Wolf's responsiveness is excellent! We ran into a few regressions all at once and realized we need to audit and increase test coverage. Multiple folks on the QA Wolf team made themselves free to walk through these new product areas, so we could be sure to implement the tests most effectively.

Are there any areas for improvement or something QA Wolf could have done differently?

We would love it if the QA Wolf team proactively looked for redundancies across tests, so that we could use our test quota more optimally across our product. Currently, our product uses the same frontend components throughout the product, and each "uses up" a test. We'd love to identify opportunities to save on tests and costs.

BACKGROUND

Please describe your company and position.

I am the Director of Engineering, Content of Napster

Describe what your company does in a single sentence.

Napster, historically known for its role in peer-to-peer file sharing for music, has evolved into a legal streaming service offering access to a vast library of music and audio content.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Wolf to accomplish?

• Augment our QA team by having them handle e2e testing of our web apps
• identify any bugs that come up
• fully test newly released features

SOLUTION

How did you find QA Wolf?

word of mouth

Why did you select QA Wolf over others?

• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

Describe the scope of work in detail. Please include a summary of key deliverables.

• Integration and Setup: Implemented a straightforward integration of QA Wolf with our development pipeline for automated testing and configured automated test environments for the web application, internal tools, and APIs. 
• Automated Testing Suite Development: Developed comprehensive automated tests, including functional, regression, and performance tests. 
• Continuous Testing Framework: Established a framework for continuous, automated testing throughout the development lifecycle. 

Key Deliverables: 

• Automated Testing Suite: A set of automated tests tailored to our software's needs. 
• Integration Framework: A configured and operational framework for continuous testing. 
• Testing Reports: Regular, detailed reports on test outcomes, bugs, and performance metrics. 
• Continuous Improvement Plan: A strategy for ongoing test suite enhancement and optimization.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

1. Reduction in Manual Testing Hours: A significant decrease in the hours required for manual testing. 
2. Increased Test Coverage: An increase in the percentage of test coverage across the web application, internal tools, and APIs, ensuring more comprehensive quality assurance. At first this manifested in more bugs because they were identifying issues we had not caught, but overtime we saw more stability. 
3. Decrease in Bug Detection Time: A reduction in the average time it takes to detect and resolve bugs, indicating improved efficiency and responsiveness in the development process. Their bug reports are top notch. 
4. Team Productivity Went Way Up: Our devs can focus on developing and solving issues rather then hunting them down and monitoring test suites.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

QA Wolf nailed their project management. They always delivered on time, were super responsive to what we needed and they made communication a breeze, especially on Slack. We hardly ever had to reach out first because they were always one step ahead, keeping us in the loop and tackling things before we even thought to mention them. It felt like they were part of our team, always on the ball and making everything run smoothly.

What was your primary form of communication with QA Wolf?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

I'm impressed with the way they communicate, respond quickly and how modern and easy the whole process feels.

Are there any areas for improvement or something QA Wolf could have done differently?

not really