OnPath Testing

BACKGROUND

Please describe your company and position.

I am the CEO of an advertising & marketing company 

Describe what your company does in a single sentence.

Full service with digital marketing with AI solutions.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire OnPath Testing to accomplish?

• review our testing methodologies
• provide guidance on structure and processes
• expand our in-house testing capabilities

SOLUTION

How did you find OnPath Testing?

Referral

Why did you select OnPath Testing over others?

• Referred to me
• Company values aligned

How many teammates from OnPath Testing were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

We requested that OnPath review our testing methodologies and processes in order to help us improve our internal capabilities and scale. We also engaged with OnPath to explore a deeper engagement where we would scale them into our agency to help handle larger workloads with their on-demand and dedicated QA testers.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Not only did OnPath fail to provide any updates or explanations for their delays until deadlines were significantly missed, but their overall approach was marked by a lack of professionalism. When they did show up for consulting work, they were unprepared and had not reviewed our materials, systems, or processes. Instead of fostering a collaborative and solution-oriented environment, their workplace culture seemed to be driven by negativity, making it even more difficult to get productive results. We had to repeatedly reach out just to get basic updates, further highlighting their disregard for effective communication and accountability.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They failed to give us any updates or explanations for their delays until deadlines were greatly missed. They showed up to do consulting work unprepared and hadn't reviewed our materials, systems, or processes. We had to reach out to get updates. We had to do the project management for them. It was a surprising and disappointing failure.

What was your primary form of communication with OnPath Testing?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

OnPath sounded like a great match for us, we had a very similar cultural outlook and approach to business but sadly the results just didn't delivery. 

Are there any areas for improvement or something OnPath Testing could have done differently?

OnPath has undoubtedly talent amongst their ranks or they would not be where they are today, however that talent is currently overshadowed by what appears to be a lack of leadership, misaligned priorities and a prevalence of cultural-toxicity that leads to antagonizing relationships and failed outcomes.

Company Responses

The service provider responded on March 10, 2025.
We engaged this person's company for marketing purposes in 2024. They over-promised and under-delivered both in quality and timeliness of their deliverables, and my marketing manager was so upset she left a poor review. In exchange for this review, they've fabricated their own "revenge review" against our company OnPath Testing, for a fictional project. This is truly unfortunate, and indicates the complete lack of integrity, both professionally and personally, that this fellow believes is acceptable. I wish them all the best, but would advise against engaging with them or their team.

BACKGROUND

Please describe your company and position.

I am the Head of Product of Goodparty.org

Describe what your company does in a single sentence.

Helping independent political candidates run for office and win

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire OnPath Testing to accomplish?

• We hired OnPath Testing to ensure the quality and robustness of our software application through comprehensive testing. Specifically, we were looking to identify and address any software bugs, performance issues, and security vulnerabilities before the public release. Their involvement was crucial in achieving a successful launch, and we found their services to be exceptionally thorough and effective.

SOLUTION

How did you find OnPath Testing?

Online Search

Why did you select OnPath Testing over others?

Good value for cost

How many teammates from OnPath Testing were assigned to this project?

1 Employee

Describe the scope of work in detail. Please include a summary of key deliverables.

• Test Plan: A document outlining the test strategy, resources, and timeline 
• Test Cases: A comprehensive list of functional and non-functional test cases 
• Bug Reports: Weekly bug reports along with severity and priority ratings 
• Performance Metrics: Detailed logs of performance tests, including response times under various load conditions 
• Final QA Report: A consolidated document containing the outcomes of all testing phases, recommendations, and any further steps required for ongoing maintenance

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Bug Reduction: Pre-engagement, our internal testing had identified approximately 50 bugs. OnPath Testing discovered an additional 30 critical and minor bugs, all of which were resolved before launch. This significantly improved the software's stability. 
• Performance Improvement: Post-engagement, we saw a 25% improvement in system response times under high load conditions, meeting our performance benchmarks. 
• User Experience: User acceptance testing showed a 95% satisfaction rate, a 10% increase compared to the preliminary tests before OnPath’s involvement. 
• Time-to-Market: Thanks to OnPath’s efficient testing procedures, we were able to stick to our project timeline and launch the software on the scheduled date, without any delays. 
• Cost Efficiency: With OnPath's thorough and efficient testing methodologies, we avoided the potentially significant costs of post-launch patches and damage to brand reputation, estimating a cost-saving of around 20%. 
• Knowledge Transfer: Though explicit knowledge transfer was deemed unnecessary due to the thoroughness of OnPath's documentation, their final report served as an excellent resource for our internal teams for ongoing maintenance, thereby adding long-term value.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

• Timely Deliveries: All key milestones, from the initial test plan to the final QA report, were delivered on or ahead of schedule. Their punctuality had a positive ripple effect on our overall project timeline. 
• Responsiveness: OnPath was incredibly responsive to our needs and inquiries. Whenever we had questions or required adjustments to the scope, they were quick to accommodate us. Their agile methodology proved beneficial, allowing for flexibility while maintaining the highest standards. 
• Regular Updates: We received daily updates, which included progress reports, bug lists, and performance metrics. This consistent communication kept us in the loop and allowed us to make informed decisions. 
• Issue Resolution: When issues were identified, OnPath took immediate steps to resolve them, often proposing multiple solutions for us to consider. Their proactive approach minimized delays and helped us maintain our project’s momentum. 
• Professionalism: The team maintained a high level of professionalism throughout the project. Meetings were efficient, well-documented, and action-oriented, which greatly aided the decision-making process.

What was your primary form of communication with OnPath Testing?

Virtual Meeting

What did you find most impressive or unique about this company?

What stood out to us the most about OnPath Testing was their ability to seamlessly integrate with our internal team and adapt to our project needs rapidly. Their agile approach was not just a methodology but a practice that enabled real-time adjustments, thereby maximizing efficiency and results.

Are there any areas for improvement or something OnPath Testing could have done differently?

N/A

BACKGROUND

Introduce your business and what you do there.

I'm a manager at an NFT marketplace.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with OnPath Testing?

We needed help with platform testing but didn't have the internal resources.

SOLUTION

What was the scope of their involvement?

OnPath Testing has been doing staff augmentation for us to test our platforms.

What is the team composition?

We work with three members of OnPath's team, including two testers and an account manager.

How much have you invested with them?

So far, we've spent about $70,000 with them.

What is the status of this engagement?

The project started in March 2022, and it's still ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

They've found bugs diligently and documented them well, so we're impressed with their work.

How did OnPath Testing perform from a project management standpoint?

Project management is great, and we have no complaints; OnPath Testing's team communicates well and delivers everything on time. Regarding tools, we use Slack and Google Meet.

What did you find most impressive about them?

OnPath is very responsive to feedback and questions.

Are there areas they could improve?

I feel that their approach is very corporate, and it could be better to look at it more from a startup perspective that is less caring about minor bugs and more caring about usability.

Any advice for potential customers?

Provide them with all the information needed for the project, and trust them to deliver the best.

BACKGROUND

Please describe your company and your position there.

CodeLogic is building the worlds first comprehensive system of record for tracking and storing relationships and dependencies between Applications, Data Stores, Infrastructure and Platforms. This includes discovering, in fine-grained detail, application structure, dynamic relationships and other complex systemic elements, and surfacing them in easy to understand ways that deliver value and drive action within development and IT organizations. As CTO, I'm responsible for the technical strategy, development and delivery of the product. As such, comprehensive, continuous test, as part of our DevOps pipeline, is exceptionally important.

OPPORTUNITY / CHALLENGE

For what projects/services did your company hire OnPath Testing?

As CodeLogic is a significantly complex technical undertaking, it was important for our development organization to have a well defined, structured approach to Quality Assurance and Testing. OnPath, on an ongoing basis, provides our core managed test team, including the development of automated test processes, test definitions and project management for these activities.

SOLUTION

How did you select this vendor and what were the deciding factors?

Having worked successfully with OnPath in the past, and knowing the depth of their expertise, both in technical testing and in managing test infrastructure development, OnPath was an obvious choice for us, given our complex demands.

Describe the project in detail and walk through the stages of the project.

The project, defined across multiple phases, extends current unit and integration testing, with automated functional test harness development across our core product and agent frameworks. In latter phases we are extending comprehensive API based testing, to address simulated user acceptance testing. Additionally, this is being done in conjunction with DevOps CI/CB/CT/CD (CT being continuous test) integration. This includes eventual continuous comprehensive test automation across feature branches, in conjunction with in-line unit and automation tests that are already in place.

How many resources from the vendor's team worked with you, and what were their positions?

We have worked with 2 test development engineers, 2 test engineers and 1 team project manager.

RESULTS & FEEDBACK

Can you share any outcomes from the project that demonstrate progress or success?

In conjunction with unit and integration testing, the automated continuous functional test platform, implemented by OnPath, has provided critical insight and significant QA improvements. This is exceptionally important as CodeLogic delivers releases every two weeks, using a disciplined Continuous Delivery model. OnPath is one of the few Test Development, Automation and Outsourcing providers I'd trust to work in such a demanding environment.

How effective was the workflow between your team and theirs?

Given our tight, continuous delivery pattern, hard deadlines and highly technical product, OnPath has provided excellent, tightly coupled workflow and execution with our development engineering teams.

What did you find most impressive or unique about this company?

The quality of the resources, sourced from both North America and Asia, has been consistently impressive. Additionally, with team/project management located in North America, OnPath has managed to effectively bridge issues with the (usually) very challenging time-zone issues exhibited by other service providers. Finally, OnPath (in both my experiences working with them) requires remarkably little corrective oversight. Provided structured touchpoints and lines of communications are established, they get the job done with a minimum of fuss.

Are there any areas for improvement or something they could have done differently?

My only recommendation would be to broaden their offerings into core DevOps process development, specifically with an eye toward earlier integration of comprehensive testing as part of Continuous Integration and Build. That said, this isn't a current deficiency, but a recommendation due to the evolving nature of development processes.

BACKGROUND

Please describe your company and your position there.

I'm the CTO of RAIR Technologies INC - an NFT infrastructure and streaming encryption platform.

OPPORTUNITY / CHALLENGE

For what projects/services did your company hire OnPath Testing, and what were your goals?

To review our codebases and ensure our security focused offerings were able to pass a rigorous QA process and integrate into a CI/CD pipeline.

SOLUTION

How did you select this vendor and what were the deciding factors?

Brian is an expert in the QA field, very personable, and able to source us great QA talent.

Describe the scope of work in detail, including the project steps, key deliverables, and technologies used.

Full QA pipeline for our company. Sourcing qualified QA engineers. On our dailies frequently to stay on top of our project developments. Advice and expertise on CI/CD workflows, security auditing, and other aspects of the QA process we need help with.

How many people from the vendor's team worked with you, and what were their positions?

3 total. An original QA engineer, our current QA engineer, and a senoir security auditor.

RESULTS & FEEDBACK

Can you share any measurable outcomes of the project or general feedback about the deliverables?

Stood up the QA department to ensure our product is successful. Implemented testing plan, manual QA, QA automation, Atlassian structure for QA/QC of all developer tickets. Jenkins pipeline for testable deployment.

Describe their project management style, including communication tools and timeliness.

They're responsive, helpful, and proactive.

What did you find most impressive or unique about this company?

Getting to interface with the CEO Brian directly - he's taken a keen interest in blockchain and smart contracting which is really awesome as we can work together on a deeper level given a shared passion for the space.

Are there any areas for improvement or something they could have done differently?

Original QA engineer needed to be replaced which could have transitioned a little faster and smoother but also this was on our end being so early in the development cycle when we brought QA on.

BACKGROUND

Please describe your company and your position there.

I'm the director of technology at Emerge. Emerge is a digital product agency in Portland, OR. We specialize in strategy, UX and interface design, mobile and web app development.

OPPORTUNITY / CHALLENGE

For what projects/services did your company hire OnPath Testing, and what were your goals?

We brought in OnPath to lead QA for a custom software development project with a tight timeline and complex technical ecosystem.

SOLUTION

How did you select this vendor and what were the deciding factors?

OnPath was our choice due to their reputation for exceptional work, excellent collaboration, and adaptability.

Describe the scope of work in detail, including the project steps, key deliverables, and technologies used.

OnPath created a customized testing plan suitable for the project budget, software type, and complexities of the technical ecosystem. OnPath also created test cases appropriate based of user stories and features, and executed quality assurance practices. They provided detailed feedback on bugs or other found issues, drastically improving the final software product.

How many people from the vendor's team worked with you, and what were their positions?

There were three people on the core team, including the owner, the senior QA manager / solutions architect, and a QA analyst.

RESULTS & FEEDBACK

Can you share any measurable outcomes of the project or general feedback about the deliverables?

OnPath was able to provide excellent QA on budget and on time. The quality of QA feedback was exceptional.

Describe their project management style, including communication tools and timeliness.

OnPath's project management was great. They felt like fully integrated members of our product team, which was key for this project as it featured many shifting variables. Communication was primarily done via video calls, chat tools, Jira, and email. Communication was always timely and clear.

What did you find most impressive or unique about this company?

OnPath Testing's adaptability and collaboration skills were truly impressive. The project we worked on together featured a very tight timeline, shifting requirements, and a complicated technical ecosystem. OnPath was able to bring critical thinking and focus on intent and outcome over output, yet still provide exceptional quality assurance while following best practice.

Are there any areas for improvement or something they could have done differently?

Nope, they were great.

BACKGROUND

Please describe your company and your position there.

I'm the CTO of a technology company that provides a nationwide platform for vehicle customization.

OPPORTUNITY / CHALLENGE

For what projects/services did your company hire OnPath Testing?

We hired OnPath to close an immediate gap in quality assurance testing for our online product which was (at that point) 1-2 months out from launch.

SOLUTION

How did you select this vendor and what were the deciding factors?

I had a personal working relationship with the CEO, Brian Borg, dating back to 1999, when he was a quality assurance engineer and I was a software engineer. Fast forward to today, both being leaders in our respective domains, it was the right time & place to reach back out to him to see what new accomplishments we could achieve together.

Describe the project in detail and walk through the stages of the project.

OnPath helped focus in on the biggest, most immediate needs, in order to bring value to our in-house development team as quickly as possible. That meant providing ad hoc testing against a codebase in development, as well as the initial stages of laying a foundation for automated testing in the months to come.

How many resources from the vendor's team worked with you, and what were their positions?

OnPath provided two resources, a QA engineer, and a QA manager to help coordinate & align the deliverables.

RESULTS & FEEDBACK

Can you share any outcomes from the project that demonstrate progress or success?

The ad hoc testing provided an immediate gap closure. They put a fresh set of external eyes on our product, providing valuable feedback to identify and eliminate edge conditions we would have missed otherwise. Additionally, the framework for automated testing immediately provided the developers with scripts they could work with and expand upon to improve the quality of their own software.

How effective was the workflow between your team and theirs?

The workflow was extremely flexible; we initially had OnPath's QA engineer integrated directly into the team, participating in stand-ups, processing items ready for testing as they flowed through our JIRA board, adapting as necessary.

What did you find most impressive or unique about this company?

The most impressive part of OnPath is their ability to quickly assess the situation and culture, and consider for both when adapting their solutions. Ours was very informal and conversational, and they read that quickly, and became flexible to meet those same expectations.

Are there any areas for improvement or something they could have done differently?

Nothing that I can think of the moment!

BACKGROUND

Introduce your business and what you do there.

I am the director of product management at ClearCaptions, a transcription service for people that are hard of hearing.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with OnPath Testing?

We needed OnPath Testing to test our software applications and hardware to confirm that our phones were meeting the product requirements, both from feature presentation and from a nonfunctional perspective as well. At the time, we were a part of another company called Purple Communications. We were in a transition period and developing our own solution.

SOLUTION

What was the scope of their involvement?

It has really been a test, fix, and recast process where everything is done in a ticketing system where we document various cases and acceptance criteria.  Every week we typically have a build that is coming from our development team and then heads to the test team. They validate it based on the issues and acceptance criteria that are included in that sprint.

Depending on where we are in the development cycle, if it’s a released candidate, for instance, then we will go through regression testing and they will document everything within that same Jira ticket and then the process repeats. We have modified this process overtime from trying to communicate across externals versus using an internal resource, which has been very different.

What is the team composition?

I have worked a lot with Brian (President & Chief QA Engineer, OnPath Testing) and 3–4 testers. Over the last few years, we have had anywhere from 2–8 testers. 

How did you come to work with OnPath Testing?

I originally found them online. We reached out to various companies and did interviews to understand their process, how we integrate cost quotes, and sent out an RFE (Request for Evidence). Ultimately, OnPath Testing was the one that we gelled with most and in terms of both understanding the scope as well as culturally. This process took a few months.

How much have you invested with them?

We spend roughly $500,000–$1,000,000 annually. So, we have spent $1 million–$2 million in total. 

What is the status of this engagement?

We have been working together since January 2017 and the relationship is currently ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement? 

They’ve enabled us to get the product out the door and to catch issues and make assessments on whether we want to fix something now or later. We are also able to pinpoint, address, and resolve issues that we are seeing in the field very quickly.

How did OnPath Testing perform from a project management standpoint

They are able to focus on this particular product, which is really good. There are never distractions in terms of deprioritizing us based on other responsibilities they may have. They immediately take care of what we need and get it turned around. They’ve exceeded my expectations in regard to timing; they are always on time. With testers that are overseas, we communicate via Jira issue tracking, Confluence, or email. We had a little bit of a rocky start because we got a new project manager, but the relationship has integrated.

What did you find most impressive about them?

Their flexibility has been really beneficial. Brian and I have sat down and gone through product requirements, how various features and functionalities work and finding the acceptance criteria around those, and then how we will test them. It has been really great to reach out and talk through things. It’s a lot more interaction and collaboration. My impression with other companies was they wanted everything predefined, so we really appreciated the collaboration with OnPath Testing and being integrated with our teams.

Are there any areas they could improve?

There are some individuals in the team that haven’t kept up with the changes from our product requirements, so there’s some work that needs to be done there. There’s been some turnover here and there, but it’s been managed fairly well. 

Do you have any advice for potential customers?

Spending a lot of time working on the frontend, defining the process such as test cases, and understanding what test suite you’re going to use is important. Communicate the metrics you capture in order to understand how those cadences are going to work. Examine the frontend in the beginning so that you can just tweak the relationship as it continues.

BACKGROUND

Please describe your organization.

We are a Scrum Team working on developing software products for online registration of athletic events. This can include, for example, the New York City Marathon. Registration for the event is typically done online currently. We provide the necessary software for it. We also provide scoring systems for these races.

What is your position?

I am the product owner.

OPPORTUNITY / CHALLENGE

What business challenge were you trying to address with OnPath Testing?

The business goal was making sure that we had sufficient regression testing for the code we had developed. We initially used Selenium for the process, trying to automate the testing for our registration and scoring systems.

SOLUTION

Please describe the scope of their involvement.

OnPath Testing wrote test scripts in Selenium and Capybara for us. We moved to the latter because we needed Ruby code support. They became familiar enough with our systems to be able to write tests scripts themselves, without the need of doing step-by-step scenarios.

OnPath built our entire test suite for Selenium in 2013, over the span of three to six months. They continued to write automated tests as we developed new features, in order to make sure that everything was covered. In late 2014, our automated test suite became too cumbersome, so we decided to switch from Selenium to Cucumber. This involved rewriting all of our application tests. OnPath were the ones who undertook the task in its entirety.

They had to learn the new technology, as they didn't have past Cucumber experience. They not only did this, but they also learned to write for Capybara, the Ruby code that runs Cucumber. It was a long project, but they stuck to it. The total time was about six months for complete code coverage. They continued to write new parts as we released new features.

OnPath was willing to learn new technologies, which we seriously appreciated. We had a remote relationship. The dev team we worked with is based in India.

How did you come to work with OnPath Testing?

They were referred to us by a collaborator who had worked with them in the past.

Could you provide a sense of the size of this initiative in financial terms?

The total expense for our collaboration was around $50,000.

What is the status of this engagement?

The collaboration ended in December 2015. Our company is moving to a different direction, and the Scrum developers are now responsible for writing tests. Ending our relationship had nothing to do with OnPath Testing’s performance.

We only gave them two weeks’ notice of the termination, and OnPath Testing continued the work up until the last day. It was impressive to see this attitude.

RESULTS & FEEDBACK

Could you share any statistics or metrics from this engagement?

We consider the relationship with OnPath to have been a very good investment. 

How did OnPath Testing perform from a project management standpoint?

We found them very reliable and great collaborators. They don’t need to be micromanaged and they’ve always been able to deliver the specs requested of them.

What distinguishes OnPath Testing from other providers?

We appreciate their desire to learn new technologies and their ability to put in long hours. OnPath Testing worked harder than most of our employees, which was impressive.

Is there anything OnPath Testing could have improved or done differently?

They were very willing to learn new technologies, but it took them a while to obtain the domain knowledge necessary to actually write out the test scenarios themselves. I had to take care of this for longer than I would have wanted.