Independent software testing company

QA Madness is an independent software testing company that was created by skilled pros who were (by the way, still are) totally crazy about their work and wanted to improve the quality not only of the software they test but the quality of the testing services in general.

We’re experts in website, eCommerce, mobile application and game testing. We use the best tools and processes that help to ensure the quality of any software product.

While working with our company, you will get services of highly qualified professionals working according to well-established processes. We have several offices located in Lithuania, Poland, and Ukraine.

 
Undisclosed
 
< $25 / hr
 
50 - 249
 Founded
2008
Show all +
Vilnius, Lithuania
headquarters
  • QA Madness
    Konstitucijos pr. 12
    Vilnius 09309
    Lithuania
other locations
  • QA Madness
    Ukraine

Portfolio

Key clients: 

Giftdirect.com & TheIrishStore.com, Above The Fray Design, Inc., Envision Group, DevPocket, Inc., Elgentos. 

Reviews

Sort by

QA Testing for Multiple E-Commerce Platforms

“We’ve been more than happy with their delivery.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
July 2017 - Ongoing
Project summary: 

QA Madness engineers integrated into the development team. They helped upgrade a Magento platform and assisted with a sizeable set of bug fixes. They also test browsers for desktop and mobile devices.

The Reviewer
 
11-50 Employees
 
Dublin, Ireland
Max Pronko
CTO, Giftdirect.com & TheIrishStore.com
 
Verified
The Review
Feedback summary: 

The team’s work resulted in increases in user session times and conversion rate. They have proven themselves with fast, high-quality work delivery, flexibility, and clear communications, causing their engagement to become a dedicated, ongoing relationship. QA Madness offers a strong ROI.

BACKGROUND

Introduce your business and what you do there.

I am the CTO of a merchant company running two websites: Giftdirect.com and TheIrishStore.com. The latter is focused on U.S.-based customers who account for 80%­90% of our orders. Giftdirect.com covers the U.K. and European markets. They are two distinct platforms running Magento 1 and Magento 2. I am responsible for all technical aspects of the company including projects related to our two stores as well as internal work.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

Our development and business analysis team fixes existing functionalities and build new ones. We lacked in-house testing resources and had a lot of work that required a dedicated force. We needed help delivering high-quality releases for both e-commerce platforms.

SOLUTION

What was the scope of their involvement?

Our first engagement with QA Madness was upgrading the TheIrishStore.com platform from Magento 1 to Magento 2 along with a large set of bug fixes for Giftdirect.com. They gave us an overview of their processes for issue documentation before they started the work. The team performed testing across different browsers for both desktop and mobile devices. The scope included testing during and after development. The first part required the full attention of QA Madness’ engineers, while the second was a matter of ongoing bug fixes and verification.

What is the team composition?

Our first interaction was with their head of sales who negotiated the details required for the start of our collaboration. We had a few calls with her, the team lead, and their CTO on how to approach the two projects. After we agreed on a scope and estimate, the work began. We were assigned a dedicated team of QA engineers who were integrated into our development team.

How did you come to work with QA Madness?

I was looking for a testing provider at the Mage Titans conference in Milan in June 2017. We met their team and had a discussion with their CEO and CTO. They were friendly and shared examples of their past projects to give us an idea of their work quality. We went through a trial round of testing activities to see their approach to the project.

How much have you invested with them?

The cost of their work so far has been $12,000.

What is the status of this engagement?

We started working with QA Madness in July 2017. After the successful delivery of a couple of releases, we decided to continue the collaboration.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

Over 2 1/2-months, their team identified 164 bugs across two websites. After finishing the scope of issues, user session times increased by an average of 24 seconds based on Google Analytics. Our conversion rate also increased by a couple of percentage points for both websites.

How did QA Madness perform from a project management standpoint?

The delivery process was smooth and transparent to our stakeholders. We use Jira for task tracking and comments. They know how to use the tool well and usually reply within minutes. We use Slack for instant communication. They are available during work hours.

What did you find most impressive about them?

I’ve appreciated the friendly communication from their team. They are strict and direct, but they have been flexible when we needed to change or adjust our process. They provided clarification for the reported bugs in the form of screenshots and videos upon request.

Are there any areas they could improve?

No, we’ve been more than happy with their delivery.

Do you have any advice for future clients of theirs?

I recommend giving QA Madness a trial run to see how well they could work for you.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    I enjoyed working with them. QA Madness met deadlines from day one.
  • 5.0 Cost
    Value / within estimates
    I would rate them even higher if I could.
  • 5.0 Quality
    Service & deliverables
    They are integrated into our team. They are responsive and provide estimations and deliveries quickly.
  • 5.0 NPS
    Willing to refer

QA Testing for E-commerce Development Company

"They have a mature and sophisticated process that reflects their considerable experience."

Quality: 
5.0
Schedule: 
4.5
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
July 2017 - Ongoing
Project summary: 

QA Madness provides end-to-end testing and documentation to streamline QA processes for web and mobile apps. Each project comprises at least two rounds of checks and recommendations.

The Reviewer
 
11-50 Employees
 
Sydney, Australia
Director, Development Shop
 
Verified
The Review
Feedback summary: 

Convenient services have increased QA turnaround by over 50%. Competent project management balances simultaneous projects in a professional manner. However, more a more proactive approach to feedback is desired.

BACKGROUND

Introduce your business and what you do there.

I’m director at a company that builds e-commerce stores on Magento and Shopify. We help our clients maintain and manage them.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We wanted to streamline and enhance our QA process with an outside vendor, as opposed to building one in-house. The outside agency needed to uphold industry best practices that we could then leverage to improve our service offerings.

SOLUTION

What was the scope of their involvement?

Our developers QA website conversions and upgrades on a monthly basis for clients. They then pass those to QA Madness for more robust testing across various browsers and devices. Their team provides a report, which we use to process any modifications.

Currently, we’re working on a new website. They’ll do end-to-end testing for it, creating use cases for each page’s functions. The team will document issues and offer recommendations; these steps are included in the homepage testing process. We’ll send our fixes back to them. Their sign off on those corrections will complete the process.

What is the team composition?

We have two main points of contact, one of whom was our primary tester.

How did you come to work with QA Madness?

We spent a few months searching for the right partner by testing different firms. Their attention to detail and the level of protection and documentation impressed us. We knew that the amount of information they provided would make engagement easy for our in-house developers.

How much have you invested with them?

We’ve spent $5,000.

What is the status of this engagement?

Work started July 2017 and is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We’ve increased our QA speed by over 50%. Their availability and intangible improvements to our process make turnarounds more efficient.

How did QA Madness perform from a project management standpoint?

We use JIRA. They’re very competent at managing current and upcoming tasks.

What did you find most impressive about them?

They have a mature and sophisticated process that reflects their considerable experience.

Are there any areas they could improve?

We’d like to see more initiative with project management. They could provide us with more constructive feedback.

Do you have any advice for potential customers?

Make sure they’re familiar with the resources involved in the project scope.

4.5
Overall Score
  • 4.5 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

QA Testing for Design & Development Shop

“The very first site we launched delighted and impressed our client in terms of QA.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
July 2017 - Ongoing
Project summary: 

QA Madness provided quality assurance services for a development shop, working on a variety of different projects. They tested specific modules on different devices and the entire website at the project’s end.

The Reviewer
 
1-10 Employees
 
Portland, Oregon
Noah Oken-Berg
Co-Founder, Above The Fray Design, Inc.
 
Verified
The Review
Feedback summary: 

The QA projects they worked on were very successful and the team caught almost all of the issues with the websites. They were dedicated, thorough, and lived up to the high recommendations they came with. They communicated extremely effectively and were attentive to all deadlines and estimates. 

BACKGROUND

Introduce your business and what you do there.

Above the Fray Design, Inc. is a full-service e-commerce design and development shop specializing in Magento and other platforms. I am a co-founder and the business developer of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

In the past, I’ve been a part of numerous software and e-commerce development teams that have tried to do QA [quality assurance] in-house, or had developers, project managers, and even business development people handle the task. It can become a mess and it’s one of the worst things I’ve seen happen. After all the hard work, the project can go south at the very end because of this. We were looking to solve that problem but also didn’t want to bring in a full QA team, as it would be overkill for our needs. We went to QA Madness for assistance.

SOLUTION

What was the scope of their involvement?

Their involvement started at the very beginning of the project. They helped look ahead in order to see which areas they would want to run QA on.

Particularly if we’ve finished a module or specific section, they do the QA, conducting a full test on a variety of different devices, platforms, browsers, and screen sizes. Towards the end—especially when we’re going into pre-launch phases and prior to user-acceptance testing—they will go through, comparing the entire website to the scope of work, and interviewing us to make sure everything is correct.

No matter what, everyone is going to miss something, but this approach knocks out 95% of the issues that the client would point out to us otherwise.

What is the team composition? 

I worked with one of their sales managers.

How did you come to work with QA Madness?

They are known in the e-commerce world, for Magento specifically. Some of my most esteemed colleagues had worked with them and they also ran a pretty good email campaign that brought them to my attention. I asked a colleague from another company about the team, and he said also said they were the best.

How much have you invested with them?

Over the course of three projects, we’ve spent $15,000–$20,000 on their services.

What is the status of this engagement?

We started working with them in July or August 2017. We’ve worked with them on three projects so far and plan to maintain an ongoing relationship.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We’re a new company, but our members have been working in the industry for years. My business partner and I have assembled what I consider to be an all-star team, but this was our first time working together in this formula. We wanted to break all misconceptions around poor development, broken timelines, and angry clients.

The very first site we launched delighted and impressed our client in terms of QA. The number of follow-up tickets they had with us was minimal, and the ones that did exist weren’t as much related to QA items as they were to design pieces that the client wanted to adjust. 

Every client we’ve used QA Madness with has been absolutely delighted with the work.

How did QA Madness perform from a project management standpoint?

They’ve been amazing in terms of communication; with no delays or lags, even during holidays. They give us advanced notice of any scheduling conflicts, and even then, they’ve made themselves available at times when they said they probably wouldn’t be. They’re extremely attentive to client concerns and deadlines, and extremely professional when it came to sticking to estimates, scopes, and quotes. I have no complaints; they are an extremely valuable part of our extended team and I couldn’t ask for more from a project management standpoint.

We have people across the nation and across the globe, so Skype is used by our team across various locations. We also have VoIP phone calls and use email. I am connected with the managers from their team via Facebook as well.

What did you find most impressive about them?

It comes back to the difference they’ve made in terms of client satisfaction with end-results. They also have good communication cadence and don’t over-engineer QA, which helps maintain timelines. After all the hard work of our designers, engineers, developers, project managers, and system analysts, having their team make sure that there is a bow on the final delivery, and the client is happy, is invaluable.

Are there any areas they could improve?

I always like to give constructive feedback and am usually good at it. If there was something to point out, I would have done it, but they’re thorough and professional. I appreciate them immensely and have no improvements to mention.  

Do you have any advice for future clients of theirs?

A general rule is being proactive and not afraid to engage. Provide as much information as possible, so they can do their job. Engage early, speaking with them prior to even the project. We didn’t wait until the last minute, which worked out great, but if we hadn’t given them time to prepare ahead of time then they’d have had to scramble.

5.0
Overall Score I enjoy every moment of it and I’m appreciative of everything they did for us.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    If we missed a deadline, it was our fault, not theirs. They were proactive in helping us stuck to deadlines.
  • 5.0 Cost
    Value / within estimates
    They’re extremely competitive. The hourly amount makes a difference in itself, but there’s also the value they put into every hour of work.
  • 5.0 Quality
    Service & deliverables
    It all boils down to end-results. We have a 100% satisfaction rate from both clients and our internal team.
  • 5.0 NPS
    Willing to refer
    I’ve already recommended them to several people.

Manual Testing for Business Services Tech Firm

"Their team is very organized, especially when it comes to using complicated applications like ours."

Quality: 
4.0
Schedule: 
4.5
Cost: 
4.5
Willing to refer: 
4.0
The Project
 
$50,000 to $199,999
 
June 2016 - Ongoing
Project summary: 

QA Madness provides manual testing for a co-browsing chat solution. Project engineers identify bugs offer valuable second opinions related to different browsers and devices. 

The Reviewer
 
1-10 Employees
 
Groningen, Netherlands
Project Manager
 
Verified
The Review
Feedback summary: 

Switching from automated testing to manual testing has improved the quality of final products. They are skilled enough to handle a complicated solution with multiple user types, and they are thorough and creative when it comes to testing methods. 

BACKGROUND

Introduce your business and what you do there.

We offer a more proactive chat solution to customers visiting websites, through something called browsing. It’s a useful tool for people visiting online stores or other websites, and need help finalizing purchases. They can chat with the agents, but also share their screens, in order to receive guidance on how to fill out a form, which buttons to click, and so on. The solution is applicable in all kinds of contexts, but it can be especially helpful for government organizations and large companies which that have less user-friendly websites. We are located in The Netherlands, with a part of our dev team being based in Spain. I am a member of the coding team and handle a mixture of backend and frontend development, as well as platform operations.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We were changing the way in which we were working, and tried to speed up our development process. At the time, we realized that we had a number of tools for automating almost everything related to development, code-sharing, testing, and deployment. The missing part in all of this was having some kind of human testing. Unit testing is nice for identifying bugs, and so if functional testing, for determining if all parts in the system are working correctly with each other, but we also wanted human testing, so the manager of our company brought QA Madness in.

SOLUTION

What was the scope of their involvement?

QA Madness provided testing not only for discovering bugs, but also as a means of having a different view on the new features we were building. Whenever we decide to design and build something, one of the steps will be to have a different set of eyes look at that feature, and give us feedback. QA Madness can provide recommendations on how we can improve features, make screens more intuitive for customers, and have simpler approaches to development.

If I’m not mistaken, QA Madness is doing testing through an online platform which covers all desktop browsers, Internet Explorer, Firefox, Chrome, Opera, and Safari. They are also testing for mobile devices, namely the native browsers on Android and iOS.

How did you come to work with QA Madness?

I believe that the leader of our company was looking for a testing team online, and found QA Madness. I was not involved in the selection process, but I inherited this relationship.

How much have you invested with QA Madness?

I don’t have this information.

What is the status of this engagement?

We started working with QA Madness almost two years ago.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We have moved away from an automated workflow. Whenever we made a new change in the code, it would be pushed automatically to our repositories, after which it would have unit testing performed, and be deployed. We experienced some issues with this workflow, so we are working together with QA Madness in order to test everything for errors and stability. We have implemented a new rollback tool which can undo any new features or bug fixes. We perform manual testing before each new release, and also test the rollback tool, ensuring that everything is okay in terms of previous and current versions.

The stability and security of our releases has increased a lot in the past two months, and we haven’t had any issues with new releases. We have one new release every week, which means that we are moving fast in terms of development, fixing bugs and releasing new features.

How did QA Madness perform from a project management standpoint?

We are working closely with the testing team itself through our Slack instance, which is a Skype-like application for communication. We have daily chats around the features to be tested, any reported bugs, and changes to the testing environment. For meetings, we use Zoom, which is similar to Google Hangouts. It allows us to share screens and have daily standups, and interview QA Madness’ resources.

As far as I know, our managers had conversations with members of QA Madness and assigned one person to work with us. After that, we had a couple of meetings with their manager and tester, and went through interviews and evaluations. The initial tester left the company, but a new resource was introduced to us before that happened, making the transition smooth. I don’t know if we were able to interview all the members of our testing team.

I haven’t looked at QA Madness’ reports. I believe that they are received by the company leader or someone else on our side.

What did you find most impressive about QA Madness?

This is the first company of its kind I’ve worked with, so I cannot compare QA Madness to anyone else. Their team is very organized, especially when it comes to using complicated applications like ours, with different accounts, users, and passwords. We didn’t have any issues with lost passwords on their side, which is a common occurrence for us.

QA Madness is also very detailed in terms of work. They perform different kinds of crazy things during testing, in order to break the software and get errors, like turning off the internet connection while performing a task. Over the past couple of years, QA Madness has helped us detect a number of strange user behaviors. In the end, we won’t know how good the software is until it’s released publicly, and users start doing crazy things with it. We appreciate QA Madness’ work, since this is the way to really test software. At some point, we will be introducing a new type of automatic and functional testing. We like to have this between different stages like testing, staging, production, private clouds, and so on. Our private cloud is similar to the production environment, but with more restrictions around security and data protection. Some of our customers need this kind of extra protection. We plan to introduce a new kind of automatic integration between these different stages, and already have a person from QA Madness’ side working with us, and learning the new technology, not only in order to test that everything is working fine, but to also convert the tests into real code that we can use. They will help us build the piece of software for performing this automatic integration and functional testing.

Are there any areas QA Madness could improve?

Since they are a growing company, improving knowledge around the software and technologies we’re using, specifically around HTML and security. We want to offer the best and most secure features to customers, so this is always a good offer. QA Madness could make suggestions related to security issues they identified in the latest version of Chrome, which could affect our platform, for example. It would be the perfect improvement to them.

4.5
Overall Score We are really happy with them, but there is always some space to improve. Security knowledge would be one example.
  • 4.5 Scheduling
    ON TIME / DEADLINES
    QA Madness is always willing to help us, especially around deadlines, even outside of working hours. There is some space to improve, but I’m very happy for now.
  • 4.5 Cost
    Value / within estimates
    Everyone’s happy with them, and the work QA Madness is doing for us. They have always helped us find and fix bugs, and have suggested ways in which to test and improve features before they go out to customers.
  • 4.0 Quality
    Service & deliverables
  • 4.0 NPS
    Willing to refer

Ongoing Solution Testing for Digital Agency

"They're quite flexible and fast ... turnaround time is usually only 2-days."

Quality: 
3.0
Schedule: 
4.0
Cost: 
4.5
Willing to refer: 
4.0
The Project
 
Less than $10,000
 
Feb. 2014 - Ongoing
Project summary: 

QA Madness is consistently subcontracted to test separately developed solutions. Most projects involve testing complex mobile apps before supplying a detailed report contained all discovered bugs. 

The Reviewer
 
11-50 Employees
 
Salzburg, Austria
Lead Project Manager
 
Verified
The Review
Feedback summary: 

QA Madness is quick and flexible, acting on very short notice. Deliverables are always clear and accurate, and the price is highly competitive. 

BACKGROUND

Introduce your business and what you do there.

We are a digital agency based in Salzburg, Austria doing all kinds of digital marketing for international clients. We do website development, web shops, mobile applications, video/photo production, and media management. It’s basically everything a client needs today in digital marketing. I’m the lead project manager. From the beginning of a project to the launch of the project, my responsibility is to lead projects, be the first point of contact for my clients, organize resources, and plan projects and internal resources.

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We produce a lot of things (websites, web shops, mobile apps), but we do not have a quality assurance department. We do internal testing, but not in a super professional way—we don’t have dedicated people assigned to quality assurance and testing. That’s why QA Madness was and is a good call on our part.

SOLUTION

What was the scope of their involvement?

We outsource to them for certain projects. Mostly, it’s the size and importance of the project as well as the client’s budget that determines whether or not we go to QA Madness for testing. I’ll give QA Madness a project that has a high budget, or one that’s super important or involved a lot of time for developing a website or the mobile app. They have not been involved in testing many solutions, to be honest. It’s around five projects per year.

These solutions, mainly mobile apps, are relatively complex. There are so many mobile devices—different iPhones and Android versions of smartphones. On all these devices, it’s a lot of effort to test the mobile app’s quality.

My projects are more about functionality and finding bugs: Does every link work? Does the navigation work fine? Is there anything a user could be blocked from? Is there an error message? I think they do usability testing and infrastructure testing, but I’ve never done it personally with QA Madness.

From my understanding, it’s manual testing. I don’t know how big the team is there. In their testing reports, there’s usually one person mentioned responsible for the tests. I’m not sure if this person is the project manager or the person who is doing all the testing. I have only one point of contact there who has been the same person all this time.

How did you come to work with QA Madness?

I came to the agency, and QA Madness was already a part of it. I took over the main communication with them. Whenever someone at the agency has a relevant project, they approach me and I get to my contact at QA Madness.

How much have you invested with QA Madness?

Around €2,000 [$2,254] yearly.

What is the status of this engagement?

It’s been ongoing for about three years, but I’ve only been with the agency for two years.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

First of all, they are quite fast and flexible. Whenever there’s a project, they can deliver fast even when there’s little time. The testing is very carefully done; there’s nothing missing. They’re always very accurate, so it’s very helpful for us. Otherwise, we wouldn’t use them. They have a good, fair price. It works well from that perspective.

How did QA Madness perform from a project management standpoint?

Communication is happening via email. Once we have aligned on a project’s costs, they send a checklist of what they need for testing. This checklist is always the same: we send them download links, our expectations, and a quick introduction and description of the project. Once they have received that, they start with the testing.

Depending on how big the whole project is, they’ll send us the report of functional testing after a couple of days also via email. It’s a PDF document with detailed descriptions of bugs and functionalities that aren’t working 100%. We then take the document and give it to our development team, who’ll go through the document, fixing bugs and improving things. We don’t have calls where QA Madness present their results. If we have questions, of course, we can ask, but it’s usually very clear.

What did you find most impressive about QA Madness?

I don’t have too much experience with other partners. Their price is surprisingly good because they are based in Lithuania, so the price level there is different than in central Europe. For us, it’s super efficient and cost-effective to outsource testing. They are quite flexible and fast, so that’s also something that I would highlight. The turnaround time is usually only 2-days. 

Are there any areas QA Madness could improve?

It would be helpful for QA Madness to present their results in a nicer way. For example, a 30-minute call with them where they give us some thoughts that are not written in the document. After a successful testing round, we could have a discussion about it together rather than via reports. I think that’s related to their price. They do a really good price, so we would not expect that. At some point, it would be a next step or an improvement.

4.5
Overall Score
  • 4.0 Scheduling
    ON TIME / DEADLINES
  • 4.5 Cost
    Value / within estimates
  • 3.0 Quality
    Service & deliverables
    The cost-quality relationship is very good. For the cost that we have, the quality is totally fine.
  • 4.0 NPS
    Willing to refer

Platform Testing for Consumer Products Business

"QA Madness has done a great job of testing our site on all platforms."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
Sept. 2015 - Ongoing
Project summary: 

QA Madness first engaged through manual testing of features for a popular online forum. The team's performance led to further testing of a related Magento site, which is now the primary focus of their work.

The Reviewer
 
1-10 Employees
 
Amsterdam, Netherlands
COO
 
Verified
The Review
Feedback summary: 

QA Madness’ project team completed multi-platform QA assignments rapidly and supplied thorough yet easy-to-understand documentation of many unexpected bugs.

BACKGROUND

Introduce your business and what you do there.

I’m the COO of a popular, online consumer products store. We list hundreds of different items that users can buy directly through our site. 

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We needed to find a company we could trust, which moved quickly, and which was not so expensive, while still providing good services. We operate in a competitive market and need to be on top of everything. We weren’t mobile friendly, so we hired a development team for this task. At the same time, we needed to have everything tested by a professional company. Although we know the site best ourselves, we didn’t have the time in our daily schedule for all the testing we wanted to do.

SOLUTION

What was the scope of their involvement?

Our development team is a third party, and QA Madness tested everything developed by them. We had a new design for the site and were also making it mobile responsive. The Magento backend is quite challenging, featuring many customizations. It was a difficult task for the testers, but if we’re going to go to war, we have to be prepared, which was exactly what we did by hiring QA Madness. Everything was thoroughly tested even though we didn’t anticipate the volume of work on this end.

It was also important to have everyone involved deal directly with each other. I didn’t want to be in-between because things always get lost in translation. QA Madness is very good at communicating with other companies, and I had no trouble at all. I simply followed up from time to time and was always surprised by the number of bugs discovered and their beautiful style of documentation. This is probably standard for this type of company, but I could see that QA Madness put a lot of effort in it.

We’ve used them for testing the payment functionality of the webshop as well, where they performed just as fast.

We also run a popular online forum in the world related to the different products we sell. It was updated and made mobile-responsive under a new platform. It was a large job, and we used QA Madness’ testing services there for the first time. There aren’t many web forums which require testing, and it’s a different type of task. This showed us QA Madness’ flexibility in handling different types of situations. We had a good experience and decided to use them for our webshop as well.

How did you come to work with QA Madness?

We received a lead from the group which is developing our new Magento shop. We didn’t look at any other shops because we knew the referrer very well, and find them to be a professional company. They wouldn’t have hired a testing firm without fully checking them out. QA Madness also has a competitive price.

What is the status of this engagement?

We started working with QA Madness in September 2015.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness has done a great job of testing our site on all platforms. They moved quickly and delivered documentation, which was of great value to our development team and was easily understood by leadership. We plan to use QA Madness for our new shop.

How did QA Madness perform from a project management standpoint?

We mostly communicate via email. We had a few Skype calls with QA Madness’ team as well. They talked directly to our development team, although I was often in between. QA Madness has great independence, and we haven’t had to sit behind them in order to ensure that the work gets done.

In the beginning, we used Google Docs for the forum, but the work done on the web shop has been through JIRA, which our development team had access to.

QA Madness’ managers only changed on a few occasions, but the quality remained the same.

What did you find most impressive about QA Madness?

I haven’t worked with many other testing companies, but I appreciated QA Madness’ overall response time. With other groups, I sometimes had to remind them of requests, but this never happened with QA Madness.

Are there any areas QA Madness could improve?

I would have told them if there was anything I thought they could improve.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    I wish other companies were like QA Madness.
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
    They’re one of the best companies we’ve seen.
  • 5.0 NPS
    Willing to refer
    I have recommended them already.

Manual QA Testing For Digital Agency

"QA Madness has gone well above and beyond what we've asked of them."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Confidential
 
Oct. 2015 - Ongoing
Project summary: 

QA Madness provided manual testing resources for an app and website developer. The team, which included testers and a project manager, thoroughly tested the software and troubleshot features.

The Reviewer
 
11-50 Employees
 
Los Angeles Metro Area
Project Manager
 
Verified
The Review
Feedback summary: 

QA Madness provided comprehensive testing that identified all potential issues, prioritized user needs, and provided an excellent revision guide for developers. The team provides additional testing to ensure that the entire product is up to standards. Communication is also consistently excellent. 

BACKGROUND

Please describe your organization.

I work for a development agency with a focus on mobile apps and websites. We also handle virtual reality development.

What is your position?

I am a project manager in the company.

OPPORTUNITY / CHALLENGE

What business challenge were you trying to address with QA Madness?

As we develop solutions for our clients, we want to be able to test the quality of our apps and websites before launch. 

SOLUTION

Please describe the scope of their involvement.

We use QA Madness exclusively for testing. We have a few different scenarios. If we're developing a brand-new app, we will have QA Madness go through extensive testing on the entirety of the software from front to back. In other situations, we may be troubleshooting a particular feature, giving QA Madness a specific focus. For the most part, we've used QA Madness for manual testing. We may also assign some automated load testing to them in the future.

We are using around six testers from QA Madness. I interact directly with three of them. There are project managers in our company who interact with the others.

How did you come to work with QA Madness?

We were using QA Madness prior to my coming onboard with the company. I'm not sure what the genesis was in terms of finding them.

Could you provide a sense of the size of this initiative in financial terms?

I don't have this information. I came on after we started working with QA Madness, and I've only seen a portion of their work.

What is the status of this engagement?

We have been working with QA Madness for close to a year. We have an ongoing relationship.

RESULTS & FEEDBACK

Could you share any statistics or metrics from this engagement?

Generally speaking, QA Madness has been very thorough. They understand how a product can be figured out intuitively. We will offer QA Madness as much direction as possible, but they tend to figure out software on their own. The results that we've gotten back from QA Madness are very easy for developers to follow. The quality we've seen from QA Madness is high.

How did QA Madness perform from a project management standpoint?

We have been using Pivotal Tracker as one of our main tools, as well as Trello for smaller projects. We do have a few projects tracked through JIRA as well.

What distinguishes QA Madness from other providers?

QA Madness has gone well above and beyond what we've asked of them. Often, if we give QA Madness a particular area of focus, they've also come back with a complete battery of tests, offering QA [quality assurance] for the entire product, which was more than what we asked for.

Is there anything QA Madness could have improved or done differently?

Nothing comes to mind. QA Madness's communication has been great, too. I was able to get a hold of QA Madness's managers and engineers quickly. Even though there's a time difference between us and them, their engineers made themselves available whenever they were needed. On the whole, we're very satisfied with QA Madness.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

Testing Script For Boutique IT Firm

"I had a good experience with QA Madness. I would go to them again in a heartbeat."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
Jul. 2016 - Ongoing
Project summary: 

QA Madness ran tests scripts to determine the concurrent checkout threshhold of an independently developed e-commerce project. The project involved scripting and quality assurance.

The Reviewer
 
1-10 Employees
 
Los Angeles Metro Area
Paul Ashcraft
President, Envision Group
 
Verified
The Review
Feedback summary: 

QA Madness produced fluid, strong code that fulfilled the initial project expectations. The team handled every stage of the process, from running the scripts to documenting results and producing a thorough report. Communication and workflow were seamless throughout the project.

BACKGROUND

Introduce your business and what you do there.

We're website developers. Our specialty is creating open-source platforms which sit on top of enterprise systems. An example would be using a Drupal presentation layer as a CMS [content management system], which will tie in on the backend to Salesforce, or using Magento as an e-commerce platform, and integrating it with a SAP system.

I am the president of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We were working on a Magento commerce project for a client in the healthcare industry, and needed to run a test script which would show us what the concurrent checkout threshold was. We were busy in the development cycle and had a tight development window.

SOLUTION

What was the scope of their involvement?

Rather than creating test scripts ourselves, we were able to outsource the work to QA Madness. We have only engaged QA Madness on one project. QA Madness assigned around 2-3 people to our project. We only interacted through a project lead.

I gave the specifics in terms of scripts to our director of technology. QA Madness had access to our development environment in order for them to write the scripts. Our client has very tight security requirements, so we weren't able to provide access to live environments. We ran test scripts on quality assurance servers in the client's environment.

How did you come to work with QA Madness?

I found QA Madness on Google, had an initial contact, and decided to use them.

What is the status of this engagement?

We started working with QA Madness a couple of months ago. We had a week's time to write the scripts, which is what QA Madness committed to. They met their deadlines, and everything worked as smoothly as possible.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness' code was not brittle at all, and we didn't have a need to rewrite anything. We made a few little tweaks in terms of threshold testing, after which everything was ready to go.

The test script made by QA Madness worked to our exact specifications, showing us how many concurrent transactions we could handle. We could then determine if that number was sufficient, or whether we needed to resize the servers. It was valuable information, and the delivery was on time and within budget. All in all, I had a good experience with QA Madness. I would go to them again in a heartbeat.

How did QA Madness perform from a project management standpoint?

Everything worked as it should, and our communication was fantastic. I imagined that there would be some delays because of our time zone differences, but someone at QA Madness was burning the midnight oil. I was able to email them in the morning on West Coast time and receive responses in real time.

There was no need to use project management software. We use GitHub internally, but not with QA Madness. They had access to our development server, ran the scripts, got the results, and turned the work over to us.

What did you find most impressive about QA Madness?

I was impressed with QA Madness' communication. I have done offshore work in the past with Indian, Russian, and Ukrainian companies. Their command of the English language was very good, as well as their communication skills and timeliness. Oftentimes, we ran into issues along those lines, but not with this project.

Are there any areas QA Madness could improve?

No.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    Nothing was even an hour late.
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer
    I specifically asked to be used as a reference in the future for QA Madness.

Manual QA Testing for Consumer App Startup

"QA Madness was great, always on time, had good rapport, and were thorough."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
Project summary: 

Using Assemblia and Redmine, QA Madness provided quality assurance and testing services for a mobile app developer. A team member tested all versions of the app and documented bugs with video.

The Reviewer
 
11-50 Employees
 
Los Angeles, California
Director of Operations, Consumer App Startup
 
Verified
The Review
Feedback summary: 

Since hiring QA Madness, apps have greatly improved in quality and efficiency. By providing helpful, timely reports and describing potential issues in detail, the team resolved issues and moved the app to market quickly. The team's dependable, friendly approach simplifies complex projects. 

BACKGROUND

Introduce your business and what you do there.

We are a startup mobile app company. We have developed an encrypted messaging app for iOS and Android.

I am the Director of Operations for the company. I've been in charge of our work with QA Madness for the last 6 months.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We needed assistance with testing our app.

SOLUTION

What was the scope of their involvement?

QA Madness provided functional testing for our app. Because they're based overseas, QA Madness worked on testing while we were sleeping, which came as perfect timing, allowing us to work on the detected bugs the next day.

QA Madness received builds through HockeyApp and logged bugs using Assembla, initially. We've moved to Redmine since then. We sent iterations to QA Madness both before and after launching a new version. QA Madness provided one resource at any given time. We mostly interacted with that person through our lead QA manager.

Our QA tester was changed at one point, but QA Madness gave us a week-and-a-half notice for this, giving us enough time to prepare the new person.

How did you come to work with QA Madness?

I wasn't involved in the initial selection. I know that our company purposely looked for a partner on a different time schedule, so that the work could be done within the night, allowing us to review everything when we started our day.

How much have you invested with QA Madness?

The total cost of QA Madness' services has been around $15,000.

What is the status of this engagement?

We've been working with QA Madness for 9 months.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We have a small QA team, so we wouldn't have been able to identify all the issues in our app without the help of QA Madness. They saved us a lot of time. QA Madness was thorough with bug reports and consistent in terms of findings. We don't have a tight focus on the general bug count, but we have noticed an improvement since working with QA Madness.

How did QA Madness perform from a project management standpoint?

QA Madness delivered their reports on time, without any issues. We collaborated exclusively through email and Assembla.

What did you find most impressive about QA Madness?

QA Madness is a very thorough and timely company. They always included videos of the issues detected, which helped us locate them.

Are there any areas QA Madness could improve?

No. QA Madness was great, always on time, had good rapport, and were thorough. It was a breeze working with them.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

Manual QA Testing For Technology Provider

"I appreciated the fact that QA Madness was always responsive and worked quickly."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
May 2014 - Ongoing
Project summary: 

QA Madness provides manual quality assurance, compatibility testing, and regression testing for product designs and requirements. The team files bugs, creates test cases, and documents any issues.

The Reviewer
 
11-50 Employees
 
New York City Metro Area
Michael Bogorad
Founder & CEO, DevPocket, Inc.
 
Verified
The Review
Feedback summary: 

QA Madness impressed with their ability to provide clear, concise directions to reproduce a performance issue. The team rarely misses crucial details and always provides an accurate timetable. Their dependability, rapid delivery, and thorough recordkeeping have streamlined many projects.

BACKGROUND

Introduce your business and what you do there.

We are a mobile software development company engaging in work for hire with clients in the US, Europe, Russia, Israel, and Canada. I am the Chief Executive Officer of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We had some QA resources, but realized that we weren't 100% happy with their performance and also didn't have a full workload all of the time. There were times when they were literally doing nothing, so we thought that we could work with a company, utilizing resources as-needed.

SOLUTION

What was the scope of their involvement?

QA Madness typically reviews our product requirements and designs, performing manual testing. In some instances, they also engage in derived test cases. We use QA Madness for regression and compatibility testing. They create test cases as formal descriptions.

Usually, we interact with a project lead from QA Madness. When there is a need for making a test, I will create a task in our tracker and explain what I need QA Madness to do. They start the process, file bugs, and close the task when it's complete. In most cases, a screenshot or video is attached to the report, explaining how to reproduce the issue. QA Madness doesn't provide suggestions for bug fixes. They don't have access to the source code and don't have the capabilities for fixes.

How did you come to work with QA Madness?

I reached a few companies, looking for one that could offer good quality at a reasonable price, ultimately finding QA Madness. I think that I received a marketing email from them initially. When the time came to find a QA company, I opened QA Madness' email and contacted them.

How much have you invested with QA Madness?

The total cost of QA Madness' services has been up to $50,000. We work on a time-and-materials basis.

What is the status of this engagement?

We have been working with QA Madness for two and a half years. We have used them for tests on more than 10 applications.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness has good skills for writing scenarios on the basis of which an issue can be reproduced. Usually, QA Madness will not miss anything critical, which is what we want from a QA team: to be reliable, quick, and have the ability to explain issues. The documentation they provide is also terrific. 

How did QA Madness perform from a project management standpoint?

There are no surprises in QA Madness' work, usually. We can estimate how long a project will take, based on previous experience. I'm very happy with QA Madness and continue to work with them.

QA Madness always kept us informed about any busy or unavailable periods, allowing our company to create a plan that will work for both parties.

What did you find most impressive about QA Madness?

I appreciated the fact that QA Madness was always responsive and worked quickly. Whenever we post a task, testing will begin the next day and be completed within a few days. It can take longer for bigger projects.

Are there any areas QA Madness could improve?

Nothing comes to mind.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
    QA Madness provided great services for a small cost.
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer
    I have recommended QA Madness to friends and colleagues.