On-Demand QA. Ongoing ROI.

For over 30 years, QualityLogic has worked with organizations to improve the quality of web and mobile applications, smart energy solutions and imaging systems (3D print systems, printers, fax devices and Fax over IP). The company’s software quality assurance and testing teams provide cost-competitive, U.S. onshore expertise to support the efforts of its clients’ agile development programs.

QualityLogic’s test tools are the de facto and official standards for verifying interoperability and conformance and formal certification testing in many industries. 

Whether you’re deploying a mission-critical web application, a consumer-oriented website, or a mobile application, QualityLogic can provide a quick, efficient, cost-effective Quality Assurance and Testing solution.

 
$5,000+
 
$25 - $49 / hr
 
50 - 249
 Founded
1986
Show all +
Boise, ID
headquarters
  • QualityLogic
    6148 N. Discovery Way, Suite 175
    Boise, ID 83713
    United States
    +1.208.424.1905
other locations
  • QualityLogic
    2245 First Street, Suite 103
    Simi Valley, CA 93065
    United States
    +1.208.424.1905
  • QualityLogic
    4045 NW 64th Street, Suite 120
    Oklahoma City, OK 73116
    United States
    +1.208.424.1905

Portfolio

Key clients: 

Fortune 100 Media Company

Fortune 500 Biotech Pharmaceuticals Company

Leading Social Relationship Company

 

Reviews

Sort by

QA Testing for Global IT Development Company

"They went above and beyond our expectations."

Quality: 
4.0
Schedule: 
5.0
Cost: 
4.0
Willing to refer: 
5.0
The Project
 
$50,000 to $199,999
 
May 2016 - Ongoing
Project summary: 

To ensure their machines and file formats were compliant with new specifications, a large IT company looked to QualityLogic to develop tools that automate the testing process.

The Reviewer
 
10,000+ Employees
 
Barcelona, Spain
SWQA Engineer, IT Services Company
 
Verified
The Review
Feedback summary: 

The tools developed by QualityLogic have already detected several issues with the machine code and even found issues with the new specifications themselves. Their team is committed to the business objective and will work hard to ensure their partners' goals are achieved.

BACKGROUND

Introduce your business and what you do there.

We are a large associate development company, with locations all around the world. I work in software quality.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QualityLogic?

We needed to support a new file format in our machines. There were some new specifications that were being developed at the same time we were developing our machines. We needed QualityLogic to help develop a suite of files that covered the specifications. We also needed help developing the tools to test the files with our machines.

SOLUTION

What was the scope of their involvement?

We had two main goals. We handed QualityLogic the specifications that were in development for the new file format. First goal: QualityLogic needed to develop a set of files, a plot suite, that covered all of the specifications, including the possible variants, the positive and negative clauses, and everything that the specification says. The specifications were very complex with a core module and several extensions. In the end, there were 300 different plots that covered all the specifications. Our proposal was to make sure that our machines were compliant with the specifications. If a machine is going to consume this kind of file format and be considered "compliant with the spec," it needs to accept certain kinds of files and reject other kinds of files. If all the positive cases pass and all the negatives cases fail, we could be sure that we were compliant with the specification.

The second goal was to develop a set of tools so that our team didn’t need to test our machines manually. Every week, there are 300 untested files. QualityLogic developed a set of tools that were automatically able to connect with our machines, send the files, and report the results. The evaluation needed to be formed according to both our quality standards and those of our development team. Every time our development team made a change to the code, they had to make sure that it was compliant with the specifications.

What is the team dynamic?

I had one person that I interfaced with, and I also spoke to a senior engineer. We discussed requirements and technical matters and also budget, scope, etc. I know they had a team of developers and testers behind them, but I only interacted with these two people.

How did you come to work with QualityLogic?

They had worked with my company 15 years ago for another project. We recalled that their work was very good, so we decided to contact them. It was an internal recommendation from a colleague.

How much have you invested with them?

Our initial budget was around $200,000. We expanded the budget a couple of times because we wanted to perfect some tools and add more capabilities with them, to a final of $250,000.

What is the status of this engagement?

We started working with QualityLogic in the spring of 2016; the first project is finished and the second project is ongoing. The first set of standards was completed in seven or eight months.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

The most valuable metric is that we ended up with 300 valid test cases developed by QualityLogic. We also encountered 20-25 issues in our code that we found thanks to this plot suite.

We didn’t intend to qualify the specifications, but QualityLogic found several issues in the specifications themselves. They were in contact with the authors so they could correct them. There was a lot of success in the requirements. That was very valuable because if we had built the code based on wrong specifications, it would have cost us a lot of effort to re-build later on. That was not expected, but QualityLogic reviewed all the specification and asked questions and proposed improvements which was very helpful.

How did QualityLogic perform from a project management standpoint?

We had a meeting every week with a call. In every call, they told us the progress in the development and the new plots. We discussed requirements and priorities. If they needed to choose between different options for a tool, for example, we discussed the best approach. They would inform us on the budget and the cost of doing a certain functionality. They were very transparent. We didn’t have any problem with priorities or time estimations. If they said they were going to do something in a certain time, they made sure they did. We used GoToMeeting for our communication.

What did you find most impressive about them?

Their commitment is impressive. They were very involved in the project. They cared about the success. They understood our problem and wanted to know how we were going to use the product in order to adequate their job. They went above and beyond our expectations. They were good at avoiding failures and giving suggestions. In the beginning, I was the only interface with my company, but in the end, we saw that it was better if they spoke directly to our engineers. Now there’s very frequent communication between their team and ours. Their work is going well, so there will be other opportunities working with us.

Are there any areas they could improve?

No. If I had any suggestions of improvement for them, I told them and they fixed it right away.

5.0
Overall Score Because of their experience, their commitment and their results.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    We had some delays. The specifications are new, so it wasn’t anything they could have done on their side. It was just normal delays when there are unknowns.
  • 4.0 Cost
    Value / within estimates
    The cost was reasonable.
  • 4.0 Quality
    Service & deliverables
    Sometimes the tools came with defects, but that was fine because if we needed to choose between having a perfect delivery every week or having a working tool in less time, I chose the working tool.
  • 5.0 NPS
    Willing to refer
    The project has been great, and the results are really fine. We achieved our purpose. I have already recommended them to my colleagues.

QA Web Testing for Cancer Research Nonprofit

“They’re a good third party sanity check for us.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Confidential
 
Aug. 2014 - Ongoing
Project summary: 

Hired to ascertain proper functioning of all public-facing forms, QualityLogic ran transactional, cross browser and device testing, ensuring a glitch-free user experience.

The Reviewer
 
11-50 Employees
 
Los Angeles, California
Robyn Bucknam
Vice President, Stand Up to Cancer
 
Verified
The Review
Feedback summary: 

At least 20 significant bugs were found for each engagement. On a recent project, zero user complaints were received regarding issues on the forms. This team has earned their five-star review with accuracy and thoroughness of their work, proactive communication, and flexible scheduling.

BACKGROUND

Introduce your business and what you do there.

Stand Up To Cancer is a division of the Entertainment Industry Foundation, a 501(c)(3) charitable organization that raises funds to support collaborative cancer research.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QualityLogic?

We had a very large-scale event that usually sees a very high level of transactional traffic. We needed QualityLogic to help make sure that all of our forms were functioning correctly and that there were no surprise issues that would be encountered by any of our users.

SOLUTION

What was the scope of their involvement?

We engaged QualityLogic to run transactional testing as well as cross browser and device testing. We began by outlining what we were concerned about, and then QualityLogic looked over the plans, suggested what we should test, and then ran a full suite of functional and cross browser tests for us to make sure pages displayed correctly and that there were no bugs or submission issues.

We've worked with QualityLogic for three years and the team that we work with has always stayed consistent. It's made it very easy to engage with them. They're pretty familiar with our forms so it's easy to go back to them time and time again. We worked heavily with Don Walker, Paul Morris, Don Burke, and several other people on the team, and they've always been really great.

How did you come to work with QualityLogic?

Someone we had worked with knew of them and said that they might be worth considering. When we first engaged with them, we looked at several different testing companies, and we just liked the style of QualityLogic. They were very technical, but easy to work with. It was our first engagement with a firm to handle this kind of work as a neutral third party.

What is the status of this engagement?

We started working with them August 2014 and have done several projects together since that time.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

For each engagement, they’ve found at least 20 reasonably significant bugs that could be addressed. On a recent project, we ended up with zero user complaints of any issues on the forms.

How did QualityLogic perform from a project management standpoint?

They’re very proactive about communicating what they’re working on and their schedule estimation is always very accurate. They are very flexible in timelines and the testing, and they really understand digital work cycles. When we had delays or things that came up, the team was really professional and easy to work with. Our correspondence has been mostly over the phone and email, and then also working with tracking through shared documents.

What did you find most impressive about QualityLogic?

What’s always impressed me is the accuracy and thoroughness of their work and their flexibility. They are usually able to help us make sure that we can walk into any page launch feeling confident that there aren’t any issues that we don’t know about. They’re a good third party sanity check for us.

Are there any areas QualityLogic could improve? ​​​​​​

Not that I can think of.

5.0
Overall Score They have contributed to several projects where we can sleep better at night because of their work.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    They have always delivered exactly when they said they would and had the right resources available for us when we needed it.
  • 5.0 Cost
    Value / within estimates
    They deliver a significant amount for the prices that they charge.
  • 5.0 Quality
    Service & deliverables
    Their work is always accurate and very detail oriented.
  • 5.0 NPS
    Willing to refer
    We’ve been extremely happy across the board with their services and offerings.

QA Testing for Large Broadcast Media Organization

"They are quick learners and are very flexible."

Quality: 
4.5
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Confidential
 
Apr. 2010 - Ongoing
Project summary: 

QualityLogic augments internal teams in several web and app testing projects. They quickly learned comprehensive internal methods beyond black-box testing and dedicate up to 50 people for QA needs.

The Reviewer
 
51-200 Employees
 
Burbank, California
QA Engineer, Broadcast Media Organization
 
Verified
The Review
Feedback summary: 

QualityLogic is a trustworthy team with a reliable work ethic. Even in wide-scope, high-profile projects, no major bugs have been found. Over time and after onboarding, QualityLogic’s efforts ran more and more smoothly, and they’ve been quick learners who are able to tackle any challenge.

BACKGROUND

Introduce your business and what you do there.

I am the QA manager of an app development group working on behalf of a large media company. We focus on multiple platforms, including mobile over-the-top content on iOS, tvOS, Android mobile and TV, Amazon Fire TV, and a few others, including the web.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QualityLogic?

We were growing fast, and needed testing help. QualityLogic was one of a few vendors who were available to us.

SOLUTION

What was the scope of their involvement?

We assigned QualityLogic some projects and discussed how we wanted the testing to be done. They were open to suggestions and new testing methods. They learned the process from us and took ownership of the testing for a wide array of our apps. This has included all-manual testing, not just black-box (having users interact with the apps), but also with a more complex approach. Based on a user’s location, they will receive different streams for live viewing. For instance, if someone wanted to see a particular New York station, the app would recognize that they are in that location, and give them the right feed. This is challenging to do with black-box testing because we can’t manipulate locations, and need to go into a gray-box area, looking at the APIs and manually manipulating responses so that we receive the desired results.

Another example: our app can handle five shows on a page; we wanted to see what would happen if there was a sixth show. Rather than us programming a test for each use case, QualityLogic has looked at our API and its responses, manually added shows, and assessed the reactions.

The composition of the team has changed recently. We have recently expanded to 50 people, but my interactions are with the project manager and the leads. We have also decreased the team size when there were fewer projects in a fiscal year.

We have worked with other testing vendors, but not at the scale of QualityLogic. They hold around 75-80% of all our projects.

How did you come to work with QualityLogic?

We used to have two different teams in-house: a web team and a mobile player team, which I was a part of. QualityLogic was contacted by someone on the web part. The teams have since merged, and I took over the QA department. I contacted QualityLogic and started giving them business minimally, at first. After they were onboarded around processes and functionalities, we started giving them more projects.

What is the status of this engagement?

We started working with QualityLogic 2 ½ or 3 years ago for my department. They may have started working for the company a little earlier.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

Over the last year, we haven’t had any major issues in production after the testing performed by QualityLogic. Software will always have bugs, but we haven’t had any major ones that would make us stop everything and rerelease the code. QualityLogic has full coverage of test cases, and the work is done to a level that makes us confident in whatever they provide signoff on.

How did QualityLogic perform from a project management standpoint?

I deal directly with Joe Walker, their program management director, who is extremely flexible and able to present a plan for any challenges I present. I’ve also talked with one of their QA managers.

What did you find most impressive about QualityLogic?

The type of testing we do is not standard, not something which could be done by low-cost resources in India, for example. With QualityLogic, we have access to testers working at engineer levels. They’re willing to adapt, and they’re quick learners. We can teach something to one person, who will then relay it to the whole team.

Are there any areas QualityLogic could improve?

There were things to fix in the beginning, and we provided QualityLogic with ideas on how to change things around, but we haven’t had any production issues in the last six months to a year. When we first started, if there was anything missed on their side, they owned the mistake, which was a positive for us. We still provide feedback to them, but we haven’t had any recent issues.

4.5
Overall Score We had some initial hurdles, but I would rate them a 5 for their current performance.
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 4.5 Quality
    Service & deliverables
    They are quick learners and are very flexible. We have reached the point of leaving all the testing to QualityLogic. There is always room for improvement, though.
  • 5.0 NPS
    Willing to refer
    I have recommended QualityLogic to a few other departments, who have started a collaboration.

Testing Services for Critical Communication Application

"We have a great relationship, and they do excellent work for us."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$50,000 to $199,999
 
June 2014 - Ongoing
Project summary: 

QualityLogic conducts manual, ad hoc, and exploratory testing for mobile and web apps, supporting feature additions via new assessments and flagging issues through a defect-tracking system and usage library.

The Reviewer
 
11-50 Employees
 
Boise, Idaho
CTO, Critical Communication Company
 
Verified
The Review
Feedback summary: 

Time-sensitive initiatives proceeded quickly and launched smoothly to enterprise customers worldwide through QualityLogic’s scalable workflow. The team’s responsiveness, conscientious approach, and willingness to take ownership of product reliability continue to boost output.

BACKGROUND

Introduce your business and what you do there.

I’m the CTO and VP of engineering for a company that makes mobile and SaaS [software-as-a-service] solutions for emergency and clerical communication management. 

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QualityLogic?

We needed testing for our mobile apps and web app in a way that could be repeated without staffing our own team. We also needed enough physical devices to test everything properly. We’ve worked with other quality companies that focus on test automation. Despite all the automated tests as we build and execute, we still need manual, ad hoc, and exploratory testing. 

SOLUTION

What was the scope of their involvement?

The relationship was already in place when I joined the company. Now, they provide testing services for our applications. As we add more features, they incorporate new tests and have built up a library of those to determine functionality. If new issues are found, they integrate with our defect-tracking system directly. They’re able to enter what type of issue they find, how to reproduce them, and which accounts and users they’re acting on behalf of when they found it. We have other communication channels between them, the development teams, and the support teams in order to refine and triage items and determine what actions we should be taking.

We had a single main point of contact. At the beginning of the year, he started joining us twice a week in our daily standup meetings. He comes to the office and sits in our scrum. That’s working really well. A few other people are involved too.

How did you come to work with QualityLogic?

They’re a local company, and I think a manager of ours at the time ran into them somewhere. I’m not exactly sure how they got connected because that predated me.

How much have you invested with QualityLogic?

We have spent between $150,000 and $250,000 so far.

What is the status of this engagement?

We started working with them in June 2014 and the work is ongoing. 

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or impact of the engagement?

We have a great relationship, and they do excellent work for us. We have urgent timing on some of the releases that we make to enterprise customers. These tasks have time-sensitive events where we’re releasing things for use around the world. On some occasions, QualityLogic has been asked to help us test things really quickly or over the weekend. They’ve always been responsive and worked with us on those urgent requests.

How did QualityLogic perform from a project management standpoint?

We use JIRA for tracking all of the R&D work. They interface directly with JIRA and our Atlassian accounts. We use HipChat for communication about testing and qualification. We also use email and phone to communicate, and our project manager attends our meetings twice a week.

What did you find most impressive about QualityLogic?

They’ve developed a keen understanding of our applications. They know how they work as well as we do, maybe even better than some people on our team because of their broad usage. They take ownership of what they do and are quite proactive.

Are there any areas QualityLogic could improve?

I can’t think of anything. They offer good service. They don’t get into test automation, but that’s not a downside really.  

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
    We don’t have to hire more staff or purchase all the equipment. It’s a great value.
  • 5.0 Quality
    Service & deliverables
    They’ve been responsive and have taken ownership for what they provide. They go above and beyond when we ask. They’re very conscientious partners.
  • 5.0 NPS
    Willing to refer