Independent software testing company

QA Madness is an independent software testing company that was created by skilled pros who were (by the way, still are) totally crazy about their work and wanted to improve the quality not only of the software they test but the quality of the testing services in general.

We’re experts in website, eCommerce, mobile application and game testing. We use the best tools and processes that help to ensure the quality of any software product.

While working with our company, you will get services of highly qualified professionals working according to well-established processes. We have several offices located in Lithuania, Poland, and Ukraine.

 
Undisclosed
 
< $25 / hr
 
50 - 249
 Founded
2008
Show all +
Vilnius, Lithuania
headquarters
  • QA Madness
    Konstitucijos pr. 12
    Vilnius 09309
    Lithuania
other locations
  • QA Madness
    Ukraine

Portfolio

Key clients: 

Giftdirect.com & TheIrishStore.com, Above The Fray Design, Inc., Envision Group, DevPocket, Inc., Elgentos. 

Reviews

Sort by

Functional Testing for Magento Maintenance Company

“QA Madness generated extensive feedback that developers normally can’t see.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
Mar. 2018 - June 2018
Project summary: 

QA Madness conducted QA and load testing on a Magento e-commerce site. They ran software scripts to assess functionality and find code errors on several browsers and devices, then sent reports on the results.

The Reviewer
 
11-50 Employees
 
Netherlands
Wouter Den Otter
CEO, SupportDesk
 
Verified
The Review
Feedback summary: 

QA Madness ran fastidious testing that yielded uniquely generative insight. They captured the relevant results within engaging multimedia reports complete with screenshots, notes, and video. Using a sophisticated array of technology, they organized the project flawlessly and rapidly delivered.

BACKGROUND

Introduce your business and what you do there.

I’m the founder and owner of SupportDesk. Our company specializes in delivering technical support and maintenance for Magento-based online shops.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

During our largest project to date, we noticed that despite our company’s development skill, we had room for improvement with QA and testing. We hired QA Madness to conduct our testing and provide the maximum amount of feedback and input possible.

SOLUTION

What was the scope of their involvement?

Before starting the project, we discussed which areas QA Madness would support. They helped us assess an e-commerce platform’s functionality and performance-related conflicts in the code. After a major release, they performed QA and load testing. The results showed that new bottlenecks tend to arise after this process. This useful discovery helped us fine-tune the performance.

QA Madness executed all of their work remotely. Since all our company’s work is online, our development team also has a few remote members. Working collaboratively, we prepared release sprints in time for QA Madness to perform a full round of testing.

What is the team composition? 

We had a central point of contact from QA Madness who handled a bit of everything. She initially served as our account manager and supported us throughout the planning stage. When the tests were complete, she delivered the reports and results to us.

How did you come to work with QA Madness?

A Dutch competitor we’ve worked with on occasion referred QA Madness, especially for larger projects. They’d been pleased with the quality of their tests and the results they received.

I also met an employee from QA Madness.  A company I was visiting had invited him over as a thank-you for the last project they’d done together.

How much have you invested with them?

The cost of their work totaled around €6,000 (approximately $7,000).

What is the status of this engagement?

We started working with QA Madness in March 2018. Although we finished the project in June 2018, we weren’t quite ready to launch at that time. We had to wait for an SAP connector to provide public data.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

QA Madness generated extensive feedback that developers normally can’t see. We could never have gained this insight without their thorough functionality testing services.

They sent us reports on the test scripts they’d run on different browsers and devices.  After identifying a number of issues, they efficiently delivered results. I appreciated how quickly they conducted testing despite the high volume of work it entails. 

How did QA Madness perform from a project management standpoint?

We usually use Zendesk and have a Kanban setup for primarily operational support. For this project, we also set up a Trello board where QA Madness posted reports and created new issues for every incident. Using this system allowed us to define new sprints and add them to the backlog. We used Slack for team communication and discussed the general approach with our primary contact over phone and email. Everything ran like clockwork. I have no complaints.

What did you find most impressive about them?

QA Madness conducts thorough testing on every relevant browser and device. Most of the issues included screenshots, detailed descriptions, and even video attachments. This level of documentation helped our developers determine precisely what was going on. It was a nice bonus they added to the entire process.

Are there any areas they could improve?

No, everything was good.

Do you have any advice for future clients of theirs?

Many developers handle testing themselves, so using QA Madness was a new approach for us. I encourage potential customers to just go for it; they’ll see the benefits afterward.  

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer
    I've already done so.

QA Testing for Fitness Products Company

“Their level of dedication and willingness to push through issues is impressive.”

Quality: 
4.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
Sept. 2017 - Ongoing
Project summary: 

QA Madness conducted a series of tests to determine if existing functionalities were working properly and the code was programmed correctly. They continue to test new features and maintain a detailed case file.

The Reviewer
 
11-50 Employees
 
Rotterdam, Netherlands
Marcel Dumont
CTO, FitForMe
 
Verified
The Review
Feedback summary: 

QA Madness significantly decreased the number of issues found in each functionality deployment, which pleased users. The team continues to show their interest in the project through active collaboration skills and a determined work ethic.

BACKGROUND

Introduce your business and what you do there.

I am the CTO of a fitness products company called FitForMe. We sell fitness supplements for people who have had a geriatric operation.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We wanted to increase the quality of our deliverables by improving our ability to release products quicker and more often.

SOLUTION

What was the scope of their involvement?

QA Madness started by establishing a sequence of standardized tests to ensure our main functions and features were properly working in various locations, countries, and scenarios. They helped us make sure our developer’s code was meeting our business requirements. The team also did some exploratory testing on our new functionalities. They tested the product by trying to break it, this allowed them to find all of our issues. Additionally, they improved our documentation efforts by writing out test cases and updating our interpretation if its functionality has been adapted. They continue to work with us to optimize our business.

What is the team composition?

We mainly work with an account manager and a full-time QA person. They will provide a second person if the need arises.

How did you come to work with QA Madness?

I met them at a conference. Having worked with multiple QA companies in the past, it was important to me that I didn’t work with an anonymous team of people behind a screen. I wanted to personally talk to the team. I chose QA madness after a trial because I was happy with their command of the English language, they were very smart, and they were willing to think through the project with us.

How much have you invested with them?

We spent €20,000–€25,000 (around $25,000 USD) so far.

What is the status of this engagement?

We started working together in September 2017 and partnership is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

Working with QA Madness has reduced the number of issues found after each live deployment by around 50%. Previously, our deployments were a little messy and elicited complaints from users. Now, our product works.

How did QA Madness perform from a project management standpoint?

QA Madness works as part of our internal team and we treat them as such. We use a scrum methodology and the QA Madness team participates in all of our meetings and processes. We use Slack and Jira for our daily communication.

What did you find most impressive about them?

Their level of dedication and willingness to push through issues is impressive.

Are there any areas they could improve?

QA Madness could improve their test process. They’re very much based on manual work, but an automated approach would allow them to take on bigger tasks and lower the running costs of software.

Any advice for potential customers?

I recommend clients treat them as part of their team and integrate them into the development cycle from the beginning.

4.5
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 4.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

QA Testing for Multiple E-Commerce Platforms

“We’ve been more than happy with their delivery.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
July 2017 - Ongoing
Project summary: 

QA Madness engineers integrated into the development team. They helped upgrade a Magento platform and assisted with a sizeable set of bug fixes. They also test browsers for desktop and mobile devices.

The Reviewer
 
11-50 Employees
 
Dublin, Ireland
Max Pronko
CTO, Giftdirect.com & TheIrishStore.com
 
Verified
The Review
Feedback summary: 

The team’s work resulted in increases in user session times and conversion rate. They have proven themselves with fast, high-quality work delivery, flexibility, and clear communications, causing their engagement to become a dedicated, ongoing relationship. QA Madness offers a strong ROI.

BACKGROUND

Introduce your business and what you do there.

I am the CTO of a merchant company running two websites: Giftdirect.com and TheIrishStore.com. The latter is focused on U.S.-based customers who account for 80%­90% of our orders. Giftdirect.com covers the U.K. and European markets. They are two distinct platforms running Magento 1 and Magento 2. I am responsible for all technical aspects of the company including projects related to our two stores as well as internal work.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

Our development and business analysis team fixes existing functionalities and build new ones. We lacked in-house testing resources and had a lot of work that required a dedicated force. We needed help delivering high-quality releases for both e-commerce platforms.

SOLUTION

What was the scope of their involvement?

Our first engagement with QA Madness was upgrading the TheIrishStore.com platform from Magento 1 to Magento 2 along with a large set of bug fixes for Giftdirect.com. They gave us an overview of their processes for issue documentation before they started the work. The team performed testing across different browsers for both desktop and mobile devices. The scope included testing during and after development. The first part required the full attention of QA Madness’ engineers, while the second was a matter of ongoing bug fixes and verification.

What is the team composition?

Our first interaction was with their head of sales who negotiated the details required for the start of our collaboration. We had a few calls with her, the team lead, and their CTO on how to approach the two projects. After we agreed on a scope and estimate, the work began. We were assigned a dedicated team of QA engineers who were integrated into our development team.

How did you come to work with QA Madness?

I was looking for a testing provider at the Mage Titans conference in Milan in June 2017. We met their team and had a discussion with their CEO and CTO. They were friendly and shared examples of their past projects to give us an idea of their work quality. We went through a trial round of testing activities to see their approach to the project.

How much have you invested with them?

The cost of their work so far has been $12,000.

What is the status of this engagement?

We started working with QA Madness in July 2017. After the successful delivery of a couple of releases, we decided to continue the collaboration.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

Over 2 1/2-months, their team identified 164 bugs across two websites. After finishing the scope of issues, user session times increased by an average of 24 seconds based on Google Analytics. Our conversion rate also increased by a couple of percentage points for both websites.

How did QA Madness perform from a project management standpoint?

The delivery process was smooth and transparent to our stakeholders. We use Jira for task tracking and comments. They know how to use the tool well and usually reply within minutes. We use Slack for instant communication. They are available during work hours.

What did you find most impressive about them?

I’ve appreciated the friendly communication from their team. They are strict and direct, but they have been flexible when we needed to change or adjust our process. They provided clarification for the reported bugs in the form of screenshots and videos upon request.

Are there any areas they could improve?

No, we’ve been more than happy with their delivery.

Do you have any advice for future clients of theirs?

I recommend giving QA Madness a trial run to see how well they could work for you.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    I enjoyed working with them. QA Madness met deadlines from day one.
  • 5.0 Cost
    Value / within estimates
    I would rate them even higher if I could.
  • 5.0 Quality
    Service & deliverables
    They are integrated into our team. They are responsive and provide estimations and deliveries quickly.
  • 5.0 NPS
    Willing to refer

QA Testing for E-commerce Development Company

"They have a mature and sophisticated process that reflects their considerable experience."

Quality: 
5.0
Schedule: 
4.5
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
July 2017 - Ongoing
Project summary: 

QA Madness provides end-to-end testing and documentation to streamline QA processes for web and mobile apps. Each project comprises at least two rounds of checks and recommendations.

The Reviewer
 
11-50 Employees
 
Sydney, Australia
Director, Development Shop
 
Verified
The Review
Feedback summary: 

Convenient services have increased QA turnaround by over 50%. Competent project management balances simultaneous projects in a professional manner. However, more a more proactive approach to feedback is desired.

BACKGROUND

Introduce your business and what you do there.

I’m director at a company that builds e-commerce stores on Magento and Shopify. We help our clients maintain and manage them.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We wanted to streamline and enhance our QA process with an outside vendor, as opposed to building one in-house. The outside agency needed to uphold industry best practices that we could then leverage to improve our service offerings.

SOLUTION

What was the scope of their involvement?

Our developers QA website conversions and upgrades on a monthly basis for clients. They then pass those to QA Madness for more robust testing across various browsers and devices. Their team provides a report, which we use to process any modifications.

Currently, we’re working on a new website. They’ll do end-to-end testing for it, creating use cases for each page’s functions. The team will document issues and offer recommendations; these steps are included in the homepage testing process. We’ll send our fixes back to them. Their sign off on those corrections will complete the process.

What is the team composition?

We have two main points of contact, one of whom was our primary tester.

How did you come to work with QA Madness?

We spent a few months searching for the right partner by testing different firms. Their attention to detail and the level of protection and documentation impressed us. We knew that the amount of information they provided would make engagement easy for our in-house developers.

How much have you invested with them?

We’ve spent $5,000.

What is the status of this engagement?

Work started July 2017 and is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We’ve increased our QA speed by over 50%. Their availability and intangible improvements to our process make turnarounds more efficient.

How did QA Madness perform from a project management standpoint?

We use JIRA. They’re very competent at managing current and upcoming tasks.

What did you find most impressive about them?

They have a mature and sophisticated process that reflects their considerable experience.

Are there any areas they could improve?

We’d like to see more initiative with project management. They could provide us with more constructive feedback.

Do you have any advice for potential customers?

Make sure they’re familiar with the resources involved in the project scope.

4.5
Overall Score
  • 4.5 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

QA Testing for Design & Development Shop

“The very first site we launched delighted and impressed our client in terms of QA.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
July 2017 - Ongoing
Project summary: 

QA Madness provided quality assurance services for a development shop, working on a variety of different projects. They tested specific modules on different devices and the entire website at the project’s end.

The Reviewer
 
1-10 Employees
 
Portland, Oregon
Noah Oken-Berg
Co-Founder, Above The Fray Design, Inc.
 
Verified
The Review
Feedback summary: 

The QA projects they worked on were very successful and the team caught almost all of the issues with the websites. They were dedicated, thorough, and lived up to the high recommendations they came with. They communicated extremely effectively and were attentive to all deadlines and estimates. 

BACKGROUND

Introduce your business and what you do there.

Above the Fray Design, Inc. is a full-service e-commerce design and development shop specializing in Magento and other platforms. I am a co-founder and the business developer of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

In the past, I’ve been a part of numerous software and e-commerce development teams that have tried to do QA [quality assurance] in-house, or had developers, project managers, and even business development people handle the task. It can become a mess and it’s one of the worst things I’ve seen happen. After all the hard work, the project can go south at the very end because of this. We were looking to solve that problem but also didn’t want to bring in a full QA team, as it would be overkill for our needs. We went to QA Madness for assistance.

SOLUTION

What was the scope of their involvement?

Their involvement started at the very beginning of the project. They helped look ahead in order to see which areas they would want to run QA on.

Particularly if we’ve finished a module or specific section, they do the QA, conducting a full test on a variety of different devices, platforms, browsers, and screen sizes. Towards the end—especially when we’re going into pre-launch phases and prior to user-acceptance testing—they will go through, comparing the entire website to the scope of work, and interviewing us to make sure everything is correct.

No matter what, everyone is going to miss something, but this approach knocks out 95% of the issues that the client would point out to us otherwise.

What is the team composition? 

I worked with one of their sales managers.

How did you come to work with QA Madness?

They are known in the e-commerce world, for Magento specifically. Some of my most esteemed colleagues had worked with them and they also ran a pretty good email campaign that brought them to my attention. I asked a colleague from another company about the team, and he said also said they were the best.

How much have you invested with them?

Over the course of three projects, we’ve spent $15,000–$20,000 on their services.

What is the status of this engagement?

We started working with them in July or August 2017. We’ve worked with them on three projects so far and plan to maintain an ongoing relationship.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We’re a new company, but our members have been working in the industry for years. My business partner and I have assembled what I consider to be an all-star team, but this was our first time working together in this formula. We wanted to break all misconceptions around poor development, broken timelines, and angry clients.

The very first site we launched delighted and impressed our client in terms of QA. The number of follow-up tickets they had with us was minimal, and the ones that did exist weren’t as much related to QA items as they were to design pieces that the client wanted to adjust. 

Every client we’ve used QA Madness with has been absolutely delighted with the work.

How did QA Madness perform from a project management standpoint?

They’ve been amazing in terms of communication; with no delays or lags, even during holidays. They give us advanced notice of any scheduling conflicts, and even then, they’ve made themselves available at times when they said they probably wouldn’t be. They’re extremely attentive to client concerns and deadlines, and extremely professional when it came to sticking to estimates, scopes, and quotes. I have no complaints; they are an extremely valuable part of our extended team and I couldn’t ask for more from a project management standpoint.

We have people across the nation and across the globe, so Skype is used by our team across various locations. We also have VoIP phone calls and use email. I am connected with the managers from their team via Facebook as well.

What did you find most impressive about them?

It comes back to the difference they’ve made in terms of client satisfaction with end-results. They also have good communication cadence and don’t over-engineer QA, which helps maintain timelines. After all the hard work of our designers, engineers, developers, project managers, and system analysts, having their team make sure that there is a bow on the final delivery, and the client is happy, is invaluable.

Are there any areas they could improve?

I always like to give constructive feedback and am usually good at it. If there was something to point out, I would have done it, but they’re thorough and professional. I appreciate them immensely and have no improvements to mention.  

Do you have any advice for future clients of theirs?

A general rule is being proactive and not afraid to engage. Provide as much information as possible, so they can do their job. Engage early, speaking with them prior to even the project. We didn’t wait until the last minute, which worked out great, but if we hadn’t given them time to prepare ahead of time then they’d have had to scramble.

5.0
Overall Score I enjoy every moment of it and I’m appreciative of everything they did for us.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    If we missed a deadline, it was our fault, not theirs. They were proactive in helping us stuck to deadlines.
  • 5.0 Cost
    Value / within estimates
    They’re extremely competitive. The hourly amount makes a difference in itself, but there’s also the value they put into every hour of work.
  • 5.0 Quality
    Service & deliverables
    It all boils down to end-results. We have a 100% satisfaction rate from both clients and our internal team.
  • 5.0 NPS
    Willing to refer
    I’ve already recommended them to several people.

Manual Testing for Business Services Tech Firm

"Their team is very organized, especially when it comes to using complicated applications like ours."

Quality: 
4.0
Schedule: 
4.5
Cost: 
4.5
Willing to refer: 
4.0
The Project
 
$50,000 to $199,999
 
June 2016 - Ongoing
Project summary: 

QA Madness provides manual testing for a co-browsing chat solution. Project engineers identify bugs offer valuable second opinions related to different browsers and devices. 

The Reviewer
 
1-10 Employees
 
Groningen, Netherlands
Project Manager
 
Verified
The Review
Feedback summary: 

Switching from automated testing to manual testing has improved the quality of final products. They are skilled enough to handle a complicated solution with multiple user types, and they are thorough and creative when it comes to testing methods. 

BACKGROUND

Introduce your business and what you do there.

We offer a more proactive chat solution to customers visiting websites, through something called browsing. It’s a useful tool for people visiting online stores or other websites, and need help finalizing purchases. They can chat with the agents, but also share their screens, in order to receive guidance on how to fill out a form, which buttons to click, and so on. The solution is applicable in all kinds of contexts, but it can be especially helpful for government organizations and large companies which that have less user-friendly websites. We are located in The Netherlands, with a part of our dev team being based in Spain. I am a member of the coding team and handle a mixture of backend and frontend development, as well as platform operations.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We were changing the way in which we were working, and tried to speed up our development process. At the time, we realized that we had a number of tools for automating almost everything related to development, code-sharing, testing, and deployment. The missing part in all of this was having some kind of human testing. Unit testing is nice for identifying bugs, and so if functional testing, for determining if all parts in the system are working correctly with each other, but we also wanted human testing, so the manager of our company brought QA Madness in.

SOLUTION

What was the scope of their involvement?

QA Madness provided testing not only for discovering bugs, but also as a means of having a different view on the new features we were building. Whenever we decide to design and build something, one of the steps will be to have a different set of eyes look at that feature, and give us feedback. QA Madness can provide recommendations on how we can improve features, make screens more intuitive for customers, and have simpler approaches to development.

If I’m not mistaken, QA Madness is doing testing through an online platform which covers all desktop browsers, Internet Explorer, Firefox, Chrome, Opera, and Safari. They are also testing for mobile devices, namely the native browsers on Android and iOS.

How did you come to work with QA Madness?

I believe that the leader of our company was looking for a testing team online, and found QA Madness. I was not involved in the selection process, but I inherited this relationship.

How much have you invested with QA Madness?

I don’t have this information.

What is the status of this engagement?

We started working with QA Madness almost two years ago.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We have moved away from an automated workflow. Whenever we made a new change in the code, it would be pushed automatically to our repositories, after which it would have unit testing performed, and be deployed. We experienced some issues with this workflow, so we are working together with QA Madness in order to test everything for errors and stability. We have implemented a new rollback tool which can undo any new features or bug fixes. We perform manual testing before each new release, and also test the rollback tool, ensuring that everything is okay in terms of previous and current versions.

The stability and security of our releases has increased a lot in the past two months, and we haven’t had any issues with new releases. We have one new release every week, which means that we are moving fast in terms of development, fixing bugs and releasing new features.

How did QA Madness perform from a project management standpoint?

We are working closely with the testing team itself through our Slack instance, which is a Skype-like application for communication. We have daily chats around the features to be tested, any reported bugs, and changes to the testing environment. For meetings, we use Zoom, which is similar to Google Hangouts. It allows us to share screens and have daily standups, and interview QA Madness’ resources.

As far as I know, our managers had conversations with members of QA Madness and assigned one person to work with us. After that, we had a couple of meetings with their manager and tester, and went through interviews and evaluations. The initial tester left the company, but a new resource was introduced to us before that happened, making the transition smooth. I don’t know if we were able to interview all the members of our testing team.

I haven’t looked at QA Madness’ reports. I believe that they are received by the company leader or someone else on our side.

What did you find most impressive about QA Madness?

This is the first company of its kind I’ve worked with, so I cannot compare QA Madness to anyone else. Their team is very organized, especially when it comes to using complicated applications like ours, with different accounts, users, and passwords. We didn’t have any issues with lost passwords on their side, which is a common occurrence for us.

QA Madness is also very detailed in terms of work. They perform different kinds of crazy things during testing, in order to break the software and get errors, like turning off the internet connection while performing a task. Over the past couple of years, QA Madness has helped us detect a number of strange user behaviors. In the end, we won’t know how good the software is until it’s released publicly, and users start doing crazy things with it. We appreciate QA Madness’ work, since this is the way to really test software. At some point, we will be introducing a new type of automatic and functional testing. We like to have this between different stages like testing, staging, production, private clouds, and so on. Our private cloud is similar to the production environment, but with more restrictions around security and data protection. Some of our customers need this kind of extra protection. We plan to introduce a new kind of automatic integration between these different stages, and already have a person from QA Madness’ side working with us, and learning the new technology, not only in order to test that everything is working fine, but to also convert the tests into real code that we can use. They will help us build the piece of software for performing this automatic integration and functional testing.

Are there any areas QA Madness could improve?

Since they are a growing company, improving knowledge around the software and technologies we’re using, specifically around HTML and security. We want to offer the best and most secure features to customers, so this is always a good offer. QA Madness could make suggestions related to security issues they identified in the latest version of Chrome, which could affect our platform, for example. It would be the perfect improvement to them.

4.5
Overall Score We are really happy with them, but there is always some space to improve. Security knowledge would be one example.
  • 4.5 Scheduling
    ON TIME / DEADLINES
    QA Madness is always willing to help us, especially around deadlines, even outside of working hours. There is some space to improve, but I’m very happy for now.
  • 4.5 Cost
    Value / within estimates
    Everyone’s happy with them, and the work QA Madness is doing for us. They have always helped us find and fix bugs, and have suggested ways in which to test and improve features before they go out to customers.
  • 4.0 Quality
    Service & deliverables
  • 4.0 NPS
    Willing to refer

Ongoing Solution Testing for Digital Agency

"They're quite flexible and fast ... turnaround time is usually only 2-days."

Quality: 
3.0
Schedule: 
4.0
Cost: 
4.5
Willing to refer: 
4.0
The Project
 
Less than $10,000
 
Feb. 2014 - Ongoing
Project summary: 

QA Madness is consistently subcontracted to test separately developed solutions. Most projects involve testing complex mobile apps before supplying a detailed report contained all discovered bugs. 

The Reviewer
 
11-50 Employees
 
Salzburg, Austria
Lead Project Manager
 
Verified
The Review
Feedback summary: 

QA Madness is quick and flexible, acting on very short notice. Deliverables are always clear and accurate, and the price is highly competitive. 

BACKGROUND

Introduce your business and what you do there.

We are a digital agency based in Salzburg, Austria doing all kinds of digital marketing for international clients. We do website development, web shops, mobile applications, video/photo production, and media management. It’s basically everything a client needs today in digital marketing. I’m the lead project manager. From the beginning of a project to the launch of the project, my responsibility is to lead projects, be the first point of contact for my clients, organize resources, and plan projects and internal resources.

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We produce a lot of things (websites, web shops, mobile apps), but we do not have a quality assurance department. We do internal testing, but not in a super professional way—we don’t have dedicated people assigned to quality assurance and testing. That’s why QA Madness was and is a good call on our part.

SOLUTION

What was the scope of their involvement?

We outsource to them for certain projects. Mostly, it’s the size and importance of the project as well as the client’s budget that determines whether or not we go to QA Madness for testing. I’ll give QA Madness a project that has a high budget, or one that’s super important or involved a lot of time for developing a website or the mobile app. They have not been involved in testing many solutions, to be honest. It’s around five projects per year.

These solutions, mainly mobile apps, are relatively complex. There are so many mobile devices—different iPhones and Android versions of smartphones. On all these devices, it’s a lot of effort to test the mobile app’s quality.

My projects are more about functionality and finding bugs: Does every link work? Does the navigation work fine? Is there anything a user could be blocked from? Is there an error message? I think they do usability testing and infrastructure testing, but I’ve never done it personally with QA Madness.

From my understanding, it’s manual testing. I don’t know how big the team is there. In their testing reports, there’s usually one person mentioned responsible for the tests. I’m not sure if this person is the project manager or the person who is doing all the testing. I have only one point of contact there who has been the same person all this time.

How did you come to work with QA Madness?

I came to the agency, and QA Madness was already a part of it. I took over the main communication with them. Whenever someone at the agency has a relevant project, they approach me and I get to my contact at QA Madness.

How much have you invested with QA Madness?

Around €2,000 [$2,254] yearly.

What is the status of this engagement?

It’s been ongoing for about three years, but I’ve only been with the agency for two years.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

First of all, they are quite fast and flexible. Whenever there’s a project, they can deliver fast even when there’s little time. The testing is very carefully done; there’s nothing missing. They’re always very accurate, so it’s very helpful for us. Otherwise, we wouldn’t use them. They have a good, fair price. It works well from that perspective.

How did QA Madness perform from a project management standpoint?

Communication is happening via email. Once we have aligned on a project’s costs, they send a checklist of what they need for testing. This checklist is always the same: we send them download links, our expectations, and a quick introduction and description of the project. Once they have received that, they start with the testing.

Depending on how big the whole project is, they’ll send us the report of functional testing after a couple of days also via email. It’s a PDF document with detailed descriptions of bugs and functionalities that aren’t working 100%. We then take the document and give it to our development team, who’ll go through the document, fixing bugs and improving things. We don’t have calls where QA Madness present their results. If we have questions, of course, we can ask, but it’s usually very clear.

What did you find most impressive about QA Madness?

I don’t have too much experience with other partners. Their price is surprisingly good because they are based in Lithuania, so the price level there is different than in central Europe. For us, it’s super efficient and cost-effective to outsource testing. They are quite flexible and fast, so that’s also something that I would highlight. The turnaround time is usually only 2-days. 

Are there any areas QA Madness could improve?

It would be helpful for QA Madness to present their results in a nicer way. For example, a 30-minute call with them where they give us some thoughts that are not written in the document. After a successful testing round, we could have a discussion about it together rather than via reports. I think that’s related to their price. They do a really good price, so we would not expect that. At some point, it would be a next step or an improvement.

4.5
Overall Score
  • 4.0 Scheduling
    ON TIME / DEADLINES
  • 4.5 Cost
    Value / within estimates
  • 3.0 Quality
    Service & deliverables
    The cost-quality relationship is very good. For the cost that we have, the quality is totally fine.
  • 4.0 NPS
    Willing to refer

Platform Testing for Consumer Products Business

"QA Madness has done a great job of testing our site on all platforms."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
Sept. 2015 - Ongoing
Project summary: 

QA Madness first engaged through manual testing of features for a popular online forum. The team's performance led to further testing of a related Magento site, which is now the primary focus of their work.

The Reviewer
 
1-10 Employees
 
Amsterdam, Netherlands
COO
 
Verified
The Review
Feedback summary: 

QA Madness’ project team completed multi-platform QA assignments rapidly and supplied thorough yet easy-to-understand documentation of many unexpected bugs.

BACKGROUND

Introduce your business and what you do there.

I’m the COO of a popular, online consumer products store. We list hundreds of different items that users can buy directly through our site. 

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We needed to find a company we could trust, which moved quickly, and which was not so expensive, while still providing good services. We operate in a competitive market and need to be on top of everything. We weren’t mobile friendly, so we hired a development team for this task. At the same time, we needed to have everything tested by a professional company. Although we know the site best ourselves, we didn’t have the time in our daily schedule for all the testing we wanted to do.

SOLUTION

What was the scope of their involvement?

Our development team is a third party, and QA Madness tested everything developed by them. We had a new design for the site and were also making it mobile responsive. The Magento backend is quite challenging, featuring many customizations. It was a difficult task for the testers, but if we’re going to go to war, we have to be prepared, which was exactly what we did by hiring QA Madness. Everything was thoroughly tested even though we didn’t anticipate the volume of work on this end.

It was also important to have everyone involved deal directly with each other. I didn’t want to be in-between because things always get lost in translation. QA Madness is very good at communicating with other companies, and I had no trouble at all. I simply followed up from time to time and was always surprised by the number of bugs discovered and their beautiful style of documentation. This is probably standard for this type of company, but I could see that QA Madness put a lot of effort in it.

We’ve used them for testing the payment functionality of the webshop as well, where they performed just as fast.

We also run a popular online forum in the world related to the different products we sell. It was updated and made mobile-responsive under a new platform. It was a large job, and we used QA Madness’ testing services there for the first time. There aren’t many web forums which require testing, and it’s a different type of task. This showed us QA Madness’ flexibility in handling different types of situations. We had a good experience and decided to use them for our webshop as well.

How did you come to work with QA Madness?

We received a lead from the group which is developing our new Magento shop. We didn’t look at any other shops because we knew the referrer very well, and find them to be a professional company. They wouldn’t have hired a testing firm without fully checking them out. QA Madness also has a competitive price.

What is the status of this engagement?

We started working with QA Madness in September 2015.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness has done a great job of testing our site on all platforms. They moved quickly and delivered documentation, which was of great value to our development team and was easily understood by leadership. We plan to use QA Madness for our new shop.

How did QA Madness perform from a project management standpoint?

We mostly communicate via email. We had a few Skype calls with QA Madness’ team as well. They talked directly to our development team, although I was often in between. QA Madness has great independence, and we haven’t had to sit behind them in order to ensure that the work gets done.

In the beginning, we used Google Docs for the forum, but the work done on the web shop has been through JIRA, which our development team had access to.

QA Madness’ managers only changed on a few occasions, but the quality remained the same.

What did you find most impressive about QA Madness?

I haven’t worked with many other testing companies, but I appreciated QA Madness’ overall response time. With other groups, I sometimes had to remind them of requests, but this never happened with QA Madness.

Are there any areas QA Madness could improve?

I would have told them if there was anything I thought they could improve.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    I wish other companies were like QA Madness.
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
    They’re one of the best companies we’ve seen.
  • 5.0 NPS
    Willing to refer
    I have recommended them already.

Manual QA Testing For Digital Agency

"QA Madness has gone well above and beyond what we've asked of them."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Confidential
 
Oct. 2015 - Ongoing
Project summary: 

QA Madness provided manual testing resources for an app and website developer. The team, which included testers and a project manager, thoroughly tested the software and troubleshot features.

The Reviewer
 
11-50 Employees
 
Los Angeles Metro Area
Project Manager
 
Verified
The Review
Feedback summary: 

QA Madness provided comprehensive testing that identified all potential issues, prioritized user needs, and provided an excellent revision guide for developers. The team provides additional testing to ensure that the entire product is up to standards. Communication is also consistently excellent. 

BACKGROUND

Please describe your organization.

I work for a development agency with a focus on mobile apps and websites. We also handle virtual reality development.

What is your position?

I am a project manager in the company.

OPPORTUNITY / CHALLENGE

What business challenge were you trying to address with QA Madness?

As we develop solutions for our clients, we want to be able to test the quality of our apps and websites before launch. 

SOLUTION

Please describe the scope of their involvement.

We use QA Madness exclusively for testing. We have a few different scenarios. If we're developing a brand-new app, we will have QA Madness go through extensive testing on the entirety of the software from front to back. In other situations, we may be troubleshooting a particular feature, giving QA Madness a specific focus. For the most part, we've used QA Madness for manual testing. We may also assign some automated load testing to them in the future.

We are using around six testers from QA Madness. I interact directly with three of them. There are project managers in our company who interact with the others.

How did you come to work with QA Madness?

We were using QA Madness prior to my coming onboard with the company. I'm not sure what the genesis was in terms of finding them.

Could you provide a sense of the size of this initiative in financial terms?

I don't have this information. I came on after we started working with QA Madness, and I've only seen a portion of their work.

What is the status of this engagement?

We have been working with QA Madness for close to a year. We have an ongoing relationship.

RESULTS & FEEDBACK

Could you share any statistics or metrics from this engagement?

Generally speaking, QA Madness has been very thorough. They understand how a product can be figured out intuitively. We will offer QA Madness as much direction as possible, but they tend to figure out software on their own. The results that we've gotten back from QA Madness are very easy for developers to follow. The quality we've seen from QA Madness is high.

How did QA Madness perform from a project management standpoint?

We have been using Pivotal Tracker as one of our main tools, as well as Trello for smaller projects. We do have a few projects tracked through JIRA as well.

What distinguishes QA Madness from other providers?

QA Madness has gone well above and beyond what we've asked of them. Often, if we give QA Madness a particular area of focus, they've also come back with a complete battery of tests, offering QA [quality assurance] for the entire product, which was more than what we asked for.

Is there anything QA Madness could have improved or done differently?

Nothing comes to mind. QA Madness's communication has been great, too. I was able to get a hold of QA Madness's managers and engineers quickly. Even though there's a time difference between us and them, their engineers made themselves available whenever they were needed. On the whole, we're very satisfied with QA Madness.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

Testing Script For Boutique IT Firm

"I had a good experience with QA Madness. I would go to them again in a heartbeat."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
Jul. 2016 - Ongoing
Project summary: 

QA Madness ran tests scripts to determine the concurrent checkout threshhold of an independently developed e-commerce project. The project involved scripting and quality assurance.

The Reviewer
 
1-10 Employees
 
Los Angeles Metro Area
Paul Ashcraft
President, Envision Group
 
Verified
The Review
Feedback summary: 

QA Madness produced fluid, strong code that fulfilled the initial project expectations. The team handled every stage of the process, from running the scripts to documenting results and producing a thorough report. Communication and workflow were seamless throughout the project.

BACKGROUND

Introduce your business and what you do there.

We're website developers. Our specialty is creating open-source platforms which sit on top of enterprise systems. An example would be using a Drupal presentation layer as a CMS [content management system], which will tie in on the backend to Salesforce, or using Magento as an e-commerce platform, and integrating it with a SAP system.

I am the president of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We were working on a Magento commerce project for a client in the healthcare industry, and needed to run a test script which would show us what the concurrent checkout threshold was. We were busy in the development cycle and had a tight development window.

SOLUTION

What was the scope of their involvement?

Rather than creating test scripts ourselves, we were able to outsource the work to QA Madness. We have only engaged QA Madness on one project. QA Madness assigned around 2-3 people to our project. We only interacted through a project lead.

I gave the specifics in terms of scripts to our director of technology. QA Madness had access to our development environment in order for them to write the scripts. Our client has very tight security requirements, so we weren't able to provide access to live environments. We ran test scripts on quality assurance servers in the client's environment.

How did you come to work with QA Madness?

I found QA Madness on Google, had an initial contact, and decided to use them.

What is the status of this engagement?

We started working with QA Madness a couple of months ago. We had a week's time to write the scripts, which is what QA Madness committed to. They met their deadlines, and everything worked as smoothly as possible.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness' code was not brittle at all, and we didn't have a need to rewrite anything. We made a few little tweaks in terms of threshold testing, after which everything was ready to go.

The test script made by QA Madness worked to our exact specifications, showing us how many concurrent transactions we could handle. We could then determine if that number was sufficient, or whether we needed to resize the servers. It was valuable information, and the delivery was on time and within budget. All in all, I had a good experience with QA Madness. I would go to them again in a heartbeat.

How did QA Madness perform from a project management standpoint?

Everything worked as it should, and our communication was fantastic. I imagined that there would be some delays because of our time zone differences, but someone at QA Madness was burning the midnight oil. I was able to email them in the morning on West Coast time and receive responses in real time.

There was no need to use project management software. We use GitHub internally, but not with QA Madness. They had access to our development server, ran the scripts, got the results, and turned the work over to us.

What did you find most impressive about QA Madness?

I was impressed with QA Madness' communication. I have done offshore work in the past with Indian, Russian, and Ukrainian companies. Their command of the English language was very good, as well as their communication skills and timeliness. Oftentimes, we ran into issues along those lines, but not with this project.

Are there any areas QA Madness could improve?

No.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    Nothing was even an hour late.
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer
    I specifically asked to be used as a reference in the future for QA Madness.