App Regression Testing & Reporting for Tax Mgmt Software Co
Featured Review- Application Testing
- Confidential
- Jan. 2017 - Jan. 2035
- Quality
- 5.0
- Schedule
- 5.0
- Cost
- 5.0
- Willing to Refer
- 5.0
"Overall, the comapny does do a great job for what my company needs."
- Engineering
- South Jordan, Utah
- 51-200 Employees
- Online Review
- Verified
Outsourced provides regression testing services for a tax management software company's app. The team executes regression test cases, assists the local QA team, and provides documentation and testing reports.
Thanks to Outsourced's work, the client has seen a 30% reduction in non-customer bugs, increased regression coverage by 40%, and reduced test execution time by 35%. The team has met deadlines, communicated efficiently, and proven responsive. Their fast turnaround and discipline stand out.
The client submitted this review online.
BACKGROUND
Please describe your company and position.
I am the Director of Quality Assurance and Technical Support of Canopy Tax
Describe what your company does in a single sentence.
Canopy Tax provides cloud-based tax and practice management software designed to help accounting professionals streamline workflows, manage client relationships, and automate compliance processes.
OPPORTUNITY / CHALLENGE
What specific goals or objectives did you hire Outsourced to accomplish?
- Regression Testing of the Canopy App
- Assisting Local (Utah) QA's with assigned work
SOLUTION
How did you find Outsourced?
This decision was made before I started 7 years ago. I am not sure.
Why did you select Outsourced over others?
- Pricing fit our budget
- Great culture fit
- Good value for cost
- Company values aligned
How many teammates from Outsourced were assigned to this project?
6-10 Employees
Describe the scope of work in detail. Please include a summary of key deliverables.
Scope of Work for Outsourced Regression Employees
The Outsourced Regression Team hired for manual regression testing of the Canopy app is responsible for ensuring the stability, functionality, and performance of the application across various releases. Their primary role is to execute regression test cases, assist the local QA team, and provide detailed feedback on system behavior to identify defects before deployment.
Key Responsibilities & Scope of Work
Manual Regression Testing
Execute predefined manual test cases across core modules of the Canopy application.
Identify, document, and report bugs, inconsistencies, and UI/UX issues.
Perform sanity checks after each deployment to ensure core functionalities remain intact.
Assist Local QA with Test Execution & Verification
Support Manual QA Engineers by testing newly developed or modified features.
Verify bug fixes submitted by developers to ensure they are properly resolved.
Work closely with local QA.
Test Case Documentation & Maintenance
Maintain detailed documentation of test execution results, steps to reproduce issues, and expected outcomes.
Update and improve existing test case repositories as needed.
Cross-Browser Testing
Validate application behavior across different browsers, operating systems to ensure a consistent user experience.
Collaboration & Communication
Work with local QA teams to provide feedback and insights from regression test cycles.
Maintain clear documentation of test coverage and defects in Jira.
Key Deliverables
Executed Regression Test Reports (detailing test results, pass/fail status, and issues found).
Bug Reports in Jira (including steps to reproduce, severity, expected vs. actual results).
Validation of Fixes & Retesting Reports (confirming resolution of previously reported defects).
Updated Test Case Documentation (to reflect the latest application changes).
Ad-hoc Testing Reports (as needed for priority issues reported by customers or engineering).
The Outsourced Regression Team plays a critical role in reducing production defects, ensuring system reliability, and supporting the QA team in maintaining quality standards across Canopy’s releases.
RESULTS & FEEDBACK
What were the measurable outcomes from the project that demonstrate progress or success?
Measurable Outcomes Demonstrating Progress & Success
The Outsourced Regression Team has contributed to the overall quality, efficiency, and stability of Canopy’s application releases. Below are key measurable outcomes that highlight the team's impact:
1. Improved Bug Detection & Resolution Rate
✅ 30% Reduction in Non-Customer Bugs – By proactively identifying and reporting defects during regression cycles, the number of internally found bugs (before reaching customers) decreased significantly.
✅ 88% Monthly Customer Bug Resolution Rate in Engineering – Timely regression testing helped ensure critical customer-reported bugs were fixed within engineering’s SLA.
✅ 50% Faster Customer Bug Resolution Time – Engineering’s resolution time for customer-reported issues improved due to clearer bug reports and structured regression feedback.
2. Increased Testing Efficiency & Coverage
✅ Regression Coverage Increased by 40% – More test cases were executed per cycle, covering a broader range of functionalities, including cross-browser and device compatibility.
✅ Test Execution Time Reduced by 35% – Outsourced testers took over repetitive manual regression tasks, allowing local QA to focus on higher-value testing activities.
✅ 99% Test Execution Completion Rate – Ensured all high-priority regression test cases were executed before each release.
3. Enhanced QA & Engineering Collaboration
✅ Improved Test Documentation & Jira Reporting – The team provided detailed bug reports with replication steps, leading to faster triage and resolution.
✅ 50% Reduction in Defect Reopen Rate – More accurate defect reports reduced the need for back-and-forth clarifications between QA and engineering.
✅ Reduced UAT Issues by 25% – Fewer last-minute defects surfaced during User Acceptance Testing, improving overall release confidence.
4. Increased Capacity for Local QA Team
✅ Freed Up 30% of Local QA’s Bandwidth – Local QA Engineers were able to shift focus to exploratory testing, test automation, and strategic quality initiatives.
✅ Faster Feature Verification Cycles – Assisted local QA with new feature testing, reducing turnaround time for development sign-off.
Overall Impact
The outsourced regression team played a crucial role in accelerating test execution, improving bug detection, and enhancing QA-Engineering collaboration. Their contributions directly reduced production defects, shortened customer bug resolution times, and increased test efficiency, leading to more stable releases and improved customer experience with Canopy.
Describe their project management. Did they deliver items on time? How did they respond to your needs?
Project Management & Delivery Performance of the Outsourced Regression Team
The outsourced regression team operated within a structured project management framework designed to ensure timely, accurate, and effective regression testing while aligning with the needs of local QA and engineering.
1. Timeliness & Deliverables
✅ Consistently Met Regression Deadlines – The team successfully executed full regression test cycles within the designated test windows, ensuring releases were not delayed.
✅ High Test Execution Completion Rate – 99% of planned regression test cases were executed per cycle, ensuring comprehensive coverage.
✅ Proactive Bug Reporting – Bugs were reported within the first half of the testing window, allowing development teams to address critical issues earlier in the cycle.
2. Responsiveness & Adaptability
✅ Quick Adjustments to Priorities – The team adapted seamlessly to shifting priorities, such as urgent hotfix validations or last-minute feature testing.
✅ Fast Turnaround on Retesting & Verifications – Critical defects were retested within 24 hours of the fix being deployed, allowing faster resolution.
✅ Efficient Communication in Jira & Slack – The team promptly responded to bug inquiries and test clarifications, reducing bottlenecks for developers and QA leads.
3. Collaboration & Issue Resolution
✅ Proactive Engagement with Local QA – Regular touchpoints with local QA ensured alignment on test coverage, expectations, and issue escalations.
✅ Minimal Rework Due to Clear Documentation – Well-documented bug reports in Jira reduced engineering back-and-forth, improving issue resolution speed.
✅ Handled Time Zone Differences Well – Despite working in a different time zone, the team effectively coordinated with local QA, ensuring a smooth workflow.
Overall Evaluation
The outsourced regression team consistently delivered on time, demonstrated high responsiveness to changing priorities, and provided clear, actionable defect reports that improved testing efficiency. Their structured approach to test execution, documentation, and collaboration directly contributed to the overall success of regression cycles at Canopy.
What was your primary form of communication with Outsourced?
Email or Messaging App
What did you find most impressive or unique about this company?
Most Impressive & Unique Aspects of Outsourced Regression Team
The outsourced regression team stood out due to their efficiency, adaptability, and structured approach to regression testing, which significantly enhanced Canopy’s QA processes and release quality. The most impressive and unique aspects of their contribution include:
✅ High Level of Test Execution Discipline – The team maintained a 99% test execution completion rate, ensuring comprehensive regression coverage for every release.
✅ Exceptional Responsiveness & Fast Turnaround – They adapted quickly to changing priorities, such as urgent hotfix testing and unplanned verifications, often retesting fixes within 24 hours.
✅ Strong Communication & Documentation Practices – Their well-documented Jira reports and clear defect replication steps minimized rework and improved developer efficiency.
✅ Ability to Scale Testing Capacity Without Slowing Down Releases – By handling the bulk of manual regression testing, they freed up 30% of local QA's bandwidth, allowing internal teams to focus on higher-value exploratory and automation testing.
✅ Effective Collaboration Across Time Zones – Despite being remote and offshore, the team aligned well with local QA and engineering, proving that a distributed QA model can work seamlessly.
Overall Impression
The outsourced regression team demonstrated a high level of professionalism, reliability, and efficiency, making them a valuable extension of Canopy’s QA operations. Their ability to execute large-scale regression testing with speed and precision directly contributed to faster bug resolution, fewer production issues, and more stable releases—a critical factor in improving Canopy’s overall software quality.
Are there any areas for improvement or something Outsourced could have done differently?
Overall, the comapny does do a great job for what my company needs. The team is professional and easy to work with. The company is open to feedback and works hard to make sure their employees are professional. Continue to have good communication and great employees is the only feedback I have.
RATINGS
-
Quality
5.0Service & Deliverables
-
Schedule
5.0On time / deadlines
-
Cost
5.0Value / within estimates
-
Willing to Refer
5.0NPS
