Independent software testing company

QA Madness is an independent software testing company that was created by skilled pros who were (by the way, still are) totally crazy about their work and wanted to improve the quality not only of the software they test but the quality of the testing services in general.

We’re experts in website, eCommerce, mobile application and game testing. We use the best tools and processes that help to ensure the quality of any software product.

While working with our company, you will get services of highly qualified professionals working according to well-established processes. We have several offices located in Lithuania, Poland, and Ukraine.

 
Undisclosed
 
< $25 / hr
 
50 - 249
 Founded
2008
Show all +
Vilnius, Lithuania
headquarters
other locations
  • Ukraine

Portfolio

Key clients: 

Giftdirect.com & TheIrishStore.com, Above The Fray Design, Inc., Envision Group, DevPocket, Inc., Elgentos. 

Reviews

Sort by

QA Testing for Magento Solution Specialist

"They are highly skilled and diligent at identifying issues."

Quality: 
4.5
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$50,000 to $199,999
 
Aug. 2014 - Ongoing
Project summary: 

QA Madness provides ongoing QA testing for an e-commerce development firm. They’ve integrated with an agile Scrum process, running UI comparison tests along with log tests on internal server capabilities.

The Reviewer
 
11-50 Employees
 
The Netherlands
Caspar Hardholt
CEO & Founder, MediaCT
 
Verified
The Review
Feedback summary: 

The team’s diligence and enthusiasm for fixing issues has improved the functionality of websites. They have adapted to in-house work processes in order to assist directly with project management. Positive feedback from customers has focused on the team’s expertise.

BACKGROUND

Introduce your business and what you do there.

I’m the CEO and founder of MediaCT, an e-commerce development firm. We develop and maintain e-commerce sites for retailers.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We wanted to outsource QA testing to improve deliverables for our clients.

SOLUTION

What was the scope of their involvement?

Their testers are integrated within our agile Scrum methodology. A QA Madness tester is part of each of our eight-member development teams. They test every feature we develop and run log tests on our server capabilities based on their own scripts, which simulate a high-traffic environment. Their functional testing includes UI comparisons to see if the interface matches our designs.

What is the team composition?

We regularly work with 4–5 people.

How did you come to work with QA Madness?

They approached us by either LinkedIn or email, and I appreciated their directness. I liked the idea of getting outside expertise because it’s more objective.

How much have you invested with them?

We have spent between €125,000—150,000 (approximately $142,000—$171,000 USD).

What is the status of this engagement?

We started working together in August 2014, and the work is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We have received positive feedback from clients due to the team’s eagerness to identify and fix issues. At one point, QA Madness found an obscure issue within a web browser that prevented the customer from adding a product to the basket.

How did QA Madness perform from a project management standpoint?

We contact the managers through Slack and Jira. We’ve already integrated the testers into our processes and include them in our standups and daily meetings.

What did you find most impressive about them?

They are highly skilled and diligent at identifying issues, which we’re not very good at. They’ve also adapted to our processes.

Are there any areas they could improve?

No, we’re highly satisfied.

Do you have any advice for potential customers?

Clients should approach the work as a collaboration and involve QA Madness as much as possible.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 4.5 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

Manual Testing for E-Commerce Solutions Company

"QA Madness has excellent communication. They have never missed a deadline or misunderstood our instructions."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Confidential
 
Sept. 2017 - Ongoing
Project summary: 

QA Madness performs manual testing for e-commerce platforms built in Magento. They ensure that the final product meets design specifications and lacks bugs.

The Reviewer
 
1-10 Employees
 
Amsterdam, Netherlands
Jordi Dekker
Co-Founder, Wezz E-Commerce
 
Verified
The Review
Feedback summary: 

Their efforts significantly reduce the number of bugs and issues in each final product. The team also had improved internal processes to streamline sprint productivity. They perform high-quality testing on time and effectively communicate throughout all projects they complete.

BACKGROUND

Introduce your business and what you do there.

I’m the co-founder of Wezz e-Commerce. We build e-commerce platforms and webshops in Magento.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We design e-commerce platforms for clients and then outsource the implementation to outside developers. We used to do testing in-house, but the process resulted in less than rigorous results, so we decided to outsource the work. We engaged QA Madness to ensure that every final product meets our design specifications and lacks any bugs or issues before launch.

SOLUTION

What was the scope of their involvement?

The first project was a testing pilot. We had a webshop that needed testing for bugs and issues. We gave QA Madness the requirements, and they performed manual testing. The team had experience working and testing in Magento, so they already had a list of features to check with critical path testing. Their results impressed us, so we decided to intensify our cooperation. QA Madness now performs work for us on a project-by-project basis. They are also working weekly to complete long-term internal projects, such as improving our testing processes.

What is the team composition?

We kept in touch with one person who manages the project and oversees their testers. Their testers update their progress using a shared Jira account.

How did you come to work with QA Madness?

After an online search and a few conversations, we narrowed down potential testing partners to three companies, including QA Madness. The QA Madness team demonstrated a high degree of flexibility; they were willing to accommodate our workflow without getting bogged down in their internal processes.

What is the status of this engagement?

We started working together in September 2017 and the partnership is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

While we lack exact figures, QA Madness has significantly reduced the number of bugs and issues in our final products. They’ve also improved our internal processes. For example, we’re completing a project in two weekly sprints for one client; QA Madness integrated testing into the sprints, which has helped us do better work with fewer bugs. Also, they take a hands-on approach and will pitch in without hesitation.

How did QA Madness perform from a project management standpoint?

They’re willing to use whatever system is most convenient to us. We use Jira to log their work and stay updated on their progress. We also use Slack for quick communication. 

What did you find most impressive about them?

QA Madness has excellent communication. They have never missed a deadline or misunderstood our instructions. They are highly responsive and flexible, which has made our collaboration seamless.

Are there any areas they could improve?

No, we’re highly satisfied with their work.

Any advice for potential customers?

QA Madness has in-depth knowledge and valuable expertise in the field of testing. Listen to their advice before telling their team what to do.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

Functional Testing for Magento Maintenance Company

“QA Madness generated extensive feedback that developers normally can’t see.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
Mar. 2018 - June 2018
Project summary: 

QA Madness conducted QA and load testing on a Magento e-commerce site. They ran software scripts to assess functionality and find code errors on several browsers and devices, then sent reports on the results.

The Reviewer
 
11-50 Employees
 
Netherlands
Wouter Den Otter
CEO, SupportDesk
 
Verified
The Review
Feedback summary: 

QA Madness ran fastidious testing that yielded uniquely generative insight. They captured the relevant results within engaging multimedia reports complete with screenshots, notes, and video. Using a sophisticated array of technology, they organized the project flawlessly and rapidly delivered.

BACKGROUND

Introduce your business and what you do there.

I’m the founder and owner of SupportDesk. Our company specializes in delivering technical support and maintenance for Magento-based online shops.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

During our largest project to date, we noticed that despite our company’s development skill, we had room for improvement with QA and testing. We hired QA Madness to conduct our testing and provide the maximum amount of feedback and input possible.

SOLUTION

What was the scope of their involvement?

Before starting the project, we discussed which areas QA Madness would support. They helped us assess an e-commerce platform’s functionality and performance-related conflicts in the code. After a major release, they performed QA and load testing. The results showed that new bottlenecks tend to arise after this process. This useful discovery helped us fine-tune the performance.

QA Madness executed all of their work remotely. Since all our company’s work is online, our development team also has a few remote members. Working collaboratively, we prepared release sprints in time for QA Madness to perform a full round of testing.

What is the team composition? 

We had a central point of contact from QA Madness who handled a bit of everything. She initially served as our account manager and supported us throughout the planning stage. When the tests were complete, she delivered the reports and results to us.

How did you come to work with QA Madness?

A Dutch competitor we’ve worked with on occasion referred QA Madness, especially for larger projects. They’d been pleased with the quality of their tests and the results they received.

I also met an employee from QA Madness.  A company I was visiting had invited him over as a thank-you for the last project they’d done together.

How much have you invested with them?

The cost of their work totaled around €6,000 (approximately $7,000).

What is the status of this engagement?

We started working with QA Madness in March 2018. Although we finished the project in June 2018, we weren’t quite ready to launch at that time. We had to wait for an SAP connector to provide public data.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

QA Madness generated extensive feedback that developers normally can’t see. We could never have gained this insight without their thorough functionality testing services.

They sent us reports on the test scripts they’d run on different browsers and devices.  After identifying a number of issues, they efficiently delivered results. I appreciated how quickly they conducted testing despite the high volume of work it entails. 

How did QA Madness perform from a project management standpoint?

We usually use Zendesk and have a Kanban setup for primarily operational support. For this project, we also set up a Trello board where QA Madness posted reports and created new issues for every incident. Using this system allowed us to define new sprints and add them to the backlog. We used Slack for team communication and discussed the general approach with our primary contact over phone and email. Everything ran like clockwork. I have no complaints.

What did you find most impressive about them?

QA Madness conducts thorough testing on every relevant browser and device. Most of the issues included screenshots, detailed descriptions, and even video attachments. This level of documentation helped our developers determine precisely what was going on. It was a nice bonus they added to the entire process.

Are there any areas they could improve?

No, everything was good.

Do you have any advice for future clients of theirs?

Many developers handle testing themselves, so using QA Madness was a new approach for us. I encourage potential customers to just go for it; they’ll see the benefits afterward.  

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer
    I've already done so.

QA Testing for Fitness Products Company

“Their level of dedication and willingness to push through issues is impressive.”

Quality: 
4.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
Sept. 2017 - Ongoing
Project summary: 

QA Madness conducted a series of tests to determine if existing functionalities were working properly and the code was programmed correctly. They continue to test new features and maintain a detailed case file.

The Reviewer
 
11-50 Employees
 
Rotterdam, Netherlands
Marcel Dumont
CTO, FitForMe
 
Verified
The Review
Feedback summary: 

QA Madness significantly decreased the number of issues found in each functionality deployment, which pleased users. The team continues to show their interest in the project through active collaboration skills and a determined work ethic.

BACKGROUND

Introduce your business and what you do there.

I am the CTO of a fitness products company called FitForMe. We sell fitness supplements for people who have had a geriatric operation.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We wanted to increase the quality of our deliverables by improving our ability to release products quicker and more often.

SOLUTION

What was the scope of their involvement?

QA Madness started by establishing a sequence of standardized tests to ensure our main functions and features were properly working in various locations, countries, and scenarios. They helped us make sure our developer’s code was meeting our business requirements. The team also did some exploratory testing on our new functionalities. They tested the product by trying to break it, this allowed them to find all of our issues. Additionally, they improved our documentation efforts by writing out test cases and updating our interpretation if its functionality has been adapted. They continue to work with us to optimize our business.

What is the team composition?

We mainly work with an account manager and a full-time QA person. They will provide a second person if the need arises.

How did you come to work with QA Madness?

I met them at a conference. Having worked with multiple QA companies in the past, it was important to me that I didn’t work with an anonymous team of people behind a screen. I wanted to personally talk to the team. I chose QA madness after a trial because I was happy with their command of the English language, they were very smart, and they were willing to think through the project with us.

How much have you invested with them?

We spent €20,000–€25,000 (around $25,000 USD) so far.

What is the status of this engagement?

We started working together in September 2017 and partnership is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

Working with QA Madness has reduced the number of issues found after each live deployment by around 50%. Previously, our deployments were a little messy and elicited complaints from users. Now, our product works.

How did QA Madness perform from a project management standpoint?

QA Madness works as part of our internal team and we treat them as such. We use a scrum methodology and the QA Madness team participates in all of our meetings and processes. We use Slack and Jira for our daily communication.

What did you find most impressive about them?

Their level of dedication and willingness to push through issues is impressive.

Are there any areas they could improve?

QA Madness could improve their test process. They’re very much based on manual work, but an automated approach would allow them to take on bigger tasks and lower the running costs of software.

Any advice for potential customers?

I recommend clients treat them as part of their team and integrate them into the development cycle from the beginning.

4.5
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 4.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

QA Testing for Multiple E-Commerce Platforms

“We’ve been more than happy with their delivery.”

Quality: 
3.0
Schedule: 
3.5
Cost: 
4.0
Willing to refer: 
3.5
The Project
 
$10,000 to $49,999
 
July 2017 - Ongoing
Project summary: 

QA Madness integrated more engineers into the internal development team. They helped upgrade a Magento platform, assisted with a sizeable set of bug fixes, and tested browsers for desktop and mobile devices.

The Reviewer
 
11-50 Employees
 
Dublin, Ireland
Max Pronko
CTO, Giftsdirect.com & TheIrishStore.com
 
Verified
The Review
Feedback summary: 

QA Madness initially combined fast delivery with a high-quality deliverable that increased user session times and conversion rates. Since changing the team to include more junior resources, they were unable to finish the project with the senior QA experts they had promised to allocate.

BACKGROUND

Introduce your business and what you do there.

I am the CTO of a merchant company running two websites: Giftsdirect.com and TheIrishStore.com. The latter is focused on U.S.-based customers who account for 80%­90% of our orders. Giftsdirect.com covers the U.K. and European markets. They are two distinct platforms running Magento 1 and Magento 2. I am responsible for all technical aspects of the company including projects related to our two stores as well as internal work.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

Our development and business analysis team fixes existing functionalities and build new ones. We lacked in-house testing resources and had a lot of work that required a dedicated force. We needed help delivering high-quality releases for both e-commerce platforms.

SOLUTION

What was the scope of their involvement?

Our first engagement with QA Madness was upgrading the TheIrishStore.com platform from Magento 1 to Magento 2 along with a large set of bug fixes for Giftsdirect.com. They gave us an overview of their processes for issue documentation before they started the work. The team performed testing across different browsers for both desktop and mobile devices. The scope included testing during and after development. The first part required the full attention of QA Madness’ engineers, while the second was a matter of ongoing bug fixes and verification.

What is the team composition?

Our first interaction was with their head of sales who negotiated the details required for the start of our collaboration. We had a few calls with her, the team lead, and their CTO on how to approach the two projects. After we agreed on a scope and estimate, the work began. We were assigned a dedicated team of QA engineers who were integrated into our development team.

How did you come to work with QA Madness?

I was looking for a testing provider at the Mage Titans conference in Milan in June 2017. We met their team and had a discussion with their CEO and CTO. They were friendly and shared examples of their past projects to give us an idea of their work quality. We went through a trial round of testing activities to see their approach to the project.

How much have you invested with them?

The cost of their work so far has been $12,000.

What is the status of this engagement?

We started working with QA Madness in July 2017. After the successful delivery of a couple of releases, we decided to continue the collaboration.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

Over 2 1/2-months, their team identified 164 bugs across two websites. After finishing the scope of issues, user session times increased by an average of 24 seconds based on Google Analytics. Our conversion rate also increased by a couple of percentage points for both websites.

How did QA Madness perform from a project management standpoint?

The delivery process was smooth and transparent to our stakeholders. We use Jira for task tracking and comments. They know how to use the tool well and usually reply within minutes. We use Slack for instant communication. They are available during work hours.

What did you find most impressive about them?

I’ve appreciated the friendly communication from their team. They are strict and direct, but they have been flexible when we needed to change or adjust our process. They provided clarification for the reported bugs in the form of screenshots and videos upon request.

Are there any areas they could improve?

No, we’ve been more than happy with their delivery.

Do you have any advice for future clients of theirs?

I recommend giving QA Madness a trial run to see how well they could work for you.

Updated Review

This review was updated by the client on December 21st, 2018. The original star ratings were: Overall - 5, Quality – 5, Schedule – 5, Cost – 5, NPS - 5. New content is below.

What was the scope of their involvement?

We continued to work with QA Madness after our initial review, but many things became increasingly worse. They changed our project manager twice. Due to the amount of work we had, we decided to hire a full-time dedicated resource. Communication dramatically decreased and they weren’t as transparent about their team’s availability. They didn’t notify us when employees were out of the office.

We made several development changes to both of our projects. We expected the changes to be tested properly, and in our initial agreement, it was agreed that they would allocate middle to senior QA resources to us, and that this resource would provide testing services to us in a timely fashion.

We were expecting to have a dedicated senior-level QA expert, but from time to time we felt they substituted a junior-level QA resource. Both our projects took on a lower quality of deliverables. The issues we experienced weren’t identified during progression testing or pre-production release testing, which impacted our conversion rates as a business.

We assigned QA Madness more work and went forward with the release, but experienced issues in the planning phase. As we were about to essentially take our company’s product of the year live, we had consistent miscommunications while trying to figure out their QA resources’ quality of service and abilities.

How much have you invested in them?

We spent less than $25,000.

What is the status of this engagement?

Last week, our new project manager sent us a letter stating that they didn’t have senior QA resources available and wanted to stop doing business with us in 14 days. We had extensively communicated the importance of their support to our company. During this critical time of the year, we needed the quality of deliverables to stay high. Since their senior QA resource was going on vacation, they replaced them with a junior employee to finish the next week’s work without consulting with us. They left our project without any QA support despite their initial agreement to finish the work according to our terms.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

The quality of services provided by QA Madness decreased since we left the first review. We had different project managers with lower-level skills which caused issues with our live environments. The change affected both of our websites when we did the release. We saw an increasing number of we hadn’t found during the pre-release stage which impacted our business’s conversions and KPIs.

How did QA Madness perform from a project management standpoint?

We used Slack to communicate with the QA resources and email to communicate with the project managers. Since the role of project manager changed hands, the new person much less than we first discussed and agreed to. We hel phone calls to try to find common ground and I used email to request any improvements or explanations.

What did you find most impressive about them?

Unfortunately, I don’t have any areas that I can say are positive at this point in time.

Are there any areas they could improve?

They should communicate clearly and work more closely and effectively with their clients when providing support. We defined the quality, skills, and experience level we wanted from the QA resources, and felt they should have delivered on our expectations. The deliverables should not change, nor should they substitute junior resources for more senior ones.

3.0
Overall Score
  • 3.5 Scheduling
    ON TIME / DEADLINES
  • 4.0 Cost
    Value / within estimates
    The price increased. 
  • 3.0 Quality
    Service & deliverables
  • 3.5 NPS
    Willing to refer

QA Testing for E-commerce Development Company

"They have a mature and sophisticated process that reflects their considerable experience."

Quality: 
5.0
Schedule: 
4.5
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
Less than $10,000
 
July 2017 - Ongoing
Project summary: 

QA Madness provides end-to-end testing and documentation to streamline QA processes for web and mobile apps. Each project comprises at least two rounds of checks and recommendations.

The Reviewer
 
11-50 Employees
 
Sydney, Australia
Director, Development Shop
 
Verified
The Review
Feedback summary: 

Convenient services have increased QA turnaround by over 50%. Competent project management balances simultaneous projects in a professional manner. However, more a more proactive approach to feedback is desired.

BACKGROUND

Introduce your business and what you do there.

I’m director at a company that builds e-commerce stores on Magento and Shopify. We help our clients maintain and manage them.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We wanted to streamline and enhance our QA process with an outside vendor, as opposed to building one in-house. The outside agency needed to uphold industry best practices that we could then leverage to improve our service offerings.

SOLUTION

What was the scope of their involvement?

Our developers QA website conversions and upgrades on a monthly basis for clients. They then pass those to QA Madness for more robust testing across various browsers and devices. Their team provides a report, which we use to process any modifications.

Currently, we’re working on a new website. They’ll do end-to-end testing for it, creating use cases for each page’s functions. The team will document issues and offer recommendations; these steps are included in the homepage testing process. We’ll send our fixes back to them. Their sign off on those corrections will complete the process.

What is the team composition?

We have two main points of contact, one of whom was our primary tester.

How did you come to work with QA Madness?

We spent a few months searching for the right partner by testing different firms. Their attention to detail and the level of protection and documentation impressed us. We knew that the amount of information they provided would make engagement easy for our in-house developers.

How much have you invested with them?

We’ve spent $5,000.

What is the status of this engagement?

Work started July 2017 and is ongoing.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We’ve increased our QA speed by over 50%. Their availability and intangible improvements to our process make turnarounds more efficient.

How did QA Madness perform from a project management standpoint?

We use JIRA. They’re very competent at managing current and upcoming tasks.

What did you find most impressive about them?

They have a mature and sophisticated process that reflects their considerable experience.

Are there any areas they could improve?

We’d like to see more initiative with project management. They could provide us with more constructive feedback.

Do you have any advice for potential customers?

Make sure they’re familiar with the resources involved in the project scope.

4.5
Overall Score
  • 4.5 Scheduling
    ON TIME / DEADLINES
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
  • 5.0 NPS
    Willing to refer

QA Testing for Design & Development Shop

“The very first site we launched delighted and impressed our client in terms of QA.”

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
July 2017 - Ongoing
Project summary: 

QA Madness provided quality assurance services for a development shop, working on a variety of different projects. They tested specific modules on different devices and the entire website at the project’s end.

The Reviewer
 
1-10 Employees
 
Portland, Oregon
Noah Oken-Berg
Co-Founder, Above The Fray Design, Inc.
 
Verified
The Review
Feedback summary: 

The QA projects they worked on were very successful and the team caught almost all of the issues with the websites. They were dedicated, thorough, and lived up to the high recommendations they came with. They communicated extremely effectively and were attentive to all deadlines and estimates. 

BACKGROUND

Introduce your business and what you do there.

Above the Fray Design, Inc. is a full-service e-commerce design and development shop specializing in Magento and other platforms. I am a co-founder and the business developer of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

In the past, I’ve been a part of numerous software and e-commerce development teams that have tried to do QA [quality assurance] in-house, or had developers, project managers, and even business development people handle the task. It can become a mess and it’s one of the worst things I’ve seen happen. After all the hard work, the project can go south at the very end because of this. We were looking to solve that problem but also didn’t want to bring in a full QA team, as it would be overkill for our needs. We went to QA Madness for assistance.

SOLUTION

What was the scope of their involvement?

Their involvement started at the very beginning of the project. They helped look ahead in order to see which areas they would want to run QA on.

Particularly if we’ve finished a module or specific section, they do the QA, conducting a full test on a variety of different devices, platforms, browsers, and screen sizes. Towards the end—especially when we’re going into pre-launch phases and prior to user-acceptance testing—they will go through, comparing the entire website to the scope of work, and interviewing us to make sure everything is correct.

No matter what, everyone is going to miss something, but this approach knocks out 95% of the issues that the client would point out to us otherwise.

What is the team composition? 

I worked with one of their sales managers.

How did you come to work with QA Madness?

They are known in the e-commerce world, for Magento specifically. Some of my most esteemed colleagues had worked with them and they also ran a pretty good email campaign that brought them to my attention. I asked a colleague from another company about the team, and he said also said they were the best.

How much have you invested with them?

Over the course of three projects, we’ve spent $15,000–$20,000 on their services.

What is the status of this engagement?

We started working with them in July or August 2017. We’ve worked with them on three projects so far and plan to maintain an ongoing relationship.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We’re a new company, but our members have been working in the industry for years. My business partner and I have assembled what I consider to be an all-star team, but this was our first time working together in this formula. We wanted to break all misconceptions around poor development, broken timelines, and angry clients.

The very first site we launched delighted and impressed our client in terms of QA. The number of follow-up tickets they had with us was minimal, and the ones that did exist weren’t as much related to QA items as they were to design pieces that the client wanted to adjust. 

Every client we’ve used QA Madness with has been absolutely delighted with the work.

How did QA Madness perform from a project management standpoint?

They’ve been amazing in terms of communication; with no delays or lags, even during holidays. They give us advanced notice of any scheduling conflicts, and even then, they’ve made themselves available at times when they said they probably wouldn’t be. They’re extremely attentive to client concerns and deadlines, and extremely professional when it came to sticking to estimates, scopes, and quotes. I have no complaints; they are an extremely valuable part of our extended team and I couldn’t ask for more from a project management standpoint.

We have people across the nation and across the globe, so Skype is used by our team across various locations. We also have VoIP phone calls and use email. I am connected with the managers from their team via Facebook as well.

What did you find most impressive about them?

It comes back to the difference they’ve made in terms of client satisfaction with end-results. They also have good communication cadence and don’t over-engineer QA, which helps maintain timelines. After all the hard work of our designers, engineers, developers, project managers, and system analysts, having their team make sure that there is a bow on the final delivery, and the client is happy, is invaluable.

Are there any areas they could improve?

I always like to give constructive feedback and am usually good at it. If there was something to point out, I would have done it, but they’re thorough and professional. I appreciate them immensely and have no improvements to mention.  

Do you have any advice for future clients of theirs?

A general rule is being proactive and not afraid to engage. Provide as much information as possible, so they can do their job. Engage early, speaking with them prior to even the project. We didn’t wait until the last minute, which worked out great, but if we hadn’t given them time to prepare ahead of time then they’d have had to scramble.

5.0
Overall Score I enjoy every moment of it and I’m appreciative of everything they did for us.
  • 5.0 Scheduling
    ON TIME / DEADLINES
    If we missed a deadline, it was our fault, not theirs. They were proactive in helping us stuck to deadlines.
  • 5.0 Cost
    Value / within estimates
    They’re extremely competitive. The hourly amount makes a difference in itself, but there’s also the value they put into every hour of work.
  • 5.0 Quality
    Service & deliverables
    It all boils down to end-results. We have a 100% satisfaction rate from both clients and our internal team.
  • 5.0 NPS
    Willing to refer
    I’ve already recommended them to several people.

Manual Testing for Business Services Tech Firm

"Their team is very organized, especially when it comes to using complicated applications like ours."

Quality: 
4.0
Schedule: 
4.5
Cost: 
4.5
Willing to refer: 
4.0
The Project
 
$50,000 to $199,999
 
June 2016 - Ongoing
Project summary: 

QA Madness provides manual testing for a co-browsing chat solution. Project engineers identify bugs offer valuable second opinions related to different browsers and devices. 

The Reviewer
 
1-10 Employees
 
Groningen, Netherlands
Project Manager
 
Verified
The Review
Feedback summary: 

Switching from automated testing to manual testing has improved the quality of final products. They are skilled enough to handle a complicated solution with multiple user types, and they are thorough and creative when it comes to testing methods. 

BACKGROUND

Introduce your business and what you do there.

We offer a more proactive chat solution to customers visiting websites, through something called browsing. It’s a useful tool for people visiting online stores or other websites, and need help finalizing purchases. They can chat with the agents, but also share their screens, in order to receive guidance on how to fill out a form, which buttons to click, and so on. The solution is applicable in all kinds of contexts, but it can be especially helpful for government organizations and large companies which that have less user-friendly websites. We are located in The Netherlands, with a part of our dev team being based in Spain. I am a member of the coding team and handle a mixture of backend and frontend development, as well as platform operations.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We were changing the way in which we were working, and tried to speed up our development process. At the time, we realized that we had a number of tools for automating almost everything related to development, code-sharing, testing, and deployment. The missing part in all of this was having some kind of human testing. Unit testing is nice for identifying bugs, and so if functional testing, for determining if all parts in the system are working correctly with each other, but we also wanted human testing, so the manager of our company brought QA Madness in.

SOLUTION

What was the scope of their involvement?

QA Madness provided testing not only for discovering bugs, but also as a means of having a different view on the new features we were building. Whenever we decide to design and build something, one of the steps will be to have a different set of eyes look at that feature, and give us feedback. QA Madness can provide recommendations on how we can improve features, make screens more intuitive for customers, and have simpler approaches to development.

If I’m not mistaken, QA Madness is doing testing through an online platform which covers all desktop browsers, Internet Explorer, Firefox, Chrome, Opera, and Safari. They are also testing for mobile devices, namely the native browsers on Android and iOS.

How did you come to work with QA Madness?

I believe that the leader of our company was looking for a testing team online, and found QA Madness. I was not involved in the selection process, but I inherited this relationship.

How much have you invested with QA Madness?

I don’t have this information.

What is the status of this engagement?

We started working with QA Madness almost two years ago.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We have moved away from an automated workflow. Whenever we made a new change in the code, it would be pushed automatically to our repositories, after which it would have unit testing performed, and be deployed. We experienced some issues with this workflow, so we are working together with QA Madness in order to test everything for errors and stability. We have implemented a new rollback tool which can undo any new features or bug fixes. We perform manual testing before each new release, and also test the rollback tool, ensuring that everything is okay in terms of previous and current versions.

The stability and security of our releases has increased a lot in the past two months, and we haven’t had any issues with new releases. We have one new release every week, which means that we are moving fast in terms of development, fixing bugs and releasing new features.

How did QA Madness perform from a project management standpoint?

We are working closely with the testing team itself through our Slack instance, which is a Skype-like application for communication. We have daily chats around the features to be tested, any reported bugs, and changes to the testing environment. For meetings, we use Zoom, which is similar to Google Hangouts. It allows us to share screens and have daily standups, and interview QA Madness’ resources.

As far as I know, our managers had conversations with members of QA Madness and assigned one person to work with us. After that, we had a couple of meetings with their manager and tester, and went through interviews and evaluations. The initial tester left the company, but a new resource was introduced to us before that happened, making the transition smooth. I don’t know if we were able to interview all the members of our testing team.

I haven’t looked at QA Madness’ reports. I believe that they are received by the company leader or someone else on our side.

What did you find most impressive about QA Madness?

This is the first company of its kind I’ve worked with, so I cannot compare QA Madness to anyone else. Their team is very organized, especially when it comes to using complicated applications like ours, with different accounts, users, and passwords. We didn’t have any issues with lost passwords on their side, which is a common occurrence for us.

QA Madness is also very detailed in terms of work. They perform different kinds of crazy things during testing, in order to break the software and get errors, like turning off the internet connection while performing a task. Over the past couple of years, QA Madness has helped us detect a number of strange user behaviors. In the end, we won’t know how good the software is until it’s released publicly, and users start doing crazy things with it. We appreciate QA Madness’ work, since this is the way to really test software. At some point, we will be introducing a new type of automatic and functional testing. We like to have this between different stages like testing, staging, production, private clouds, and so on. Our private cloud is similar to the production environment, but with more restrictions around security and data protection. Some of our customers need this kind of extra protection. We plan to introduce a new kind of automatic integration between these different stages, and already have a person from QA Madness’ side working with us, and learning the new technology, not only in order to test that everything is working fine, but to also convert the tests into real code that we can use. They will help us build the piece of software for performing this automatic integration and functional testing.

Are there any areas QA Madness could improve?

Since they are a growing company, improving knowledge around the software and technologies we’re using, specifically around HTML and security. We want to offer the best and most secure features to customers, so this is always a good offer. QA Madness could make suggestions related to security issues they identified in the latest version of Chrome, which could affect our platform, for example. It would be the perfect improvement to them.

4.5
Overall Score We are really happy with them, but there is always some space to improve. Security knowledge would be one example.
  • 4.5 Scheduling
    ON TIME / DEADLINES
    QA Madness is always willing to help us, especially around deadlines, even outside of working hours. There is some space to improve, but I’m very happy for now.
  • 4.5 Cost
    Value / within estimates
    Everyone’s happy with them, and the work QA Madness is doing for us. They have always helped us find and fix bugs, and have suggested ways in which to test and improve features before they go out to customers.
  • 4.0 Quality
    Service & deliverables
  • 4.0 NPS
    Willing to refer

Ongoing Solution Testing for Digital Agency

"They're quite flexible and fast ... turnaround time is usually only 2-days."

Quality: 
3.0
Schedule: 
4.0
Cost: 
4.5
Willing to refer: 
4.0
The Project
 
Less than $10,000
 
Feb. 2014 - Ongoing
Project summary: 

QA Madness is consistently subcontracted to test separately developed solutions. Most projects involve testing complex mobile apps before supplying a detailed report contained all discovered bugs. 

The Reviewer
 
11-50 Employees
 
Salzburg, Austria
Lead Project Manager
 
Verified
The Review
Feedback summary: 

QA Madness is quick and flexible, acting on very short notice. Deliverables are always clear and accurate, and the price is highly competitive. 

BACKGROUND

Introduce your business and what you do there.

We are a digital agency based in Salzburg, Austria doing all kinds of digital marketing for international clients. We do website development, web shops, mobile applications, video/photo production, and media management. It’s basically everything a client needs today in digital marketing. I’m the lead project manager. From the beginning of a project to the launch of the project, my responsibility is to lead projects, be the first point of contact for my clients, organize resources, and plan projects and internal resources.

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We produce a lot of things (websites, web shops, mobile apps), but we do not have a quality assurance department. We do internal testing, but not in a super professional way—we don’t have dedicated people assigned to quality assurance and testing. That’s why QA Madness was and is a good call on our part.

SOLUTION

What was the scope of their involvement?

We outsource to them for certain projects. Mostly, it’s the size and importance of the project as well as the client’s budget that determines whether or not we go to QA Madness for testing. I’ll give QA Madness a project that has a high budget, or one that’s super important or involved a lot of time for developing a website or the mobile app. They have not been involved in testing many solutions, to be honest. It’s around five projects per year.

These solutions, mainly mobile apps, are relatively complex. There are so many mobile devices—different iPhones and Android versions of smartphones. On all these devices, it’s a lot of effort to test the mobile app’s quality.

My projects are more about functionality and finding bugs: Does every link work? Does the navigation work fine? Is there anything a user could be blocked from? Is there an error message? I think they do usability testing and infrastructure testing, but I’ve never done it personally with QA Madness.

From my understanding, it’s manual testing. I don’t know how big the team is there. In their testing reports, there’s usually one person mentioned responsible for the tests. I’m not sure if this person is the project manager or the person who is doing all the testing. I have only one point of contact there who has been the same person all this time.

How did you come to work with QA Madness?

I came to the agency, and QA Madness was already a part of it. I took over the main communication with them. Whenever someone at the agency has a relevant project, they approach me and I get to my contact at QA Madness.

How much have you invested with QA Madness?

Around €2,000 [$2,254] yearly.

What is the status of this engagement?

It’s been ongoing for about three years, but I’ve only been with the agency for two years.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

First of all, they are quite fast and flexible. Whenever there’s a project, they can deliver fast even when there’s little time. The testing is very carefully done; there’s nothing missing. They’re always very accurate, so it’s very helpful for us. Otherwise, we wouldn’t use them. They have a good, fair price. It works well from that perspective.

How did QA Madness perform from a project management standpoint?

Communication is happening via email. Once we have aligned on a project’s costs, they send a checklist of what they need for testing. This checklist is always the same: we send them download links, our expectations, and a quick introduction and description of the project. Once they have received that, they start with the testing.

Depending on how big the whole project is, they’ll send us the report of functional testing after a couple of days also via email. It’s a PDF document with detailed descriptions of bugs and functionalities that aren’t working 100%. We then take the document and give it to our development team, who’ll go through the document, fixing bugs and improving things. We don’t have calls where QA Madness present their results. If we have questions, of course, we can ask, but it’s usually very clear.

What did you find most impressive about QA Madness?

I don’t have too much experience with other partners. Their price is surprisingly good because they are based in Lithuania, so the price level there is different than in central Europe. For us, it’s super efficient and cost-effective to outsource testing. They are quite flexible and fast, so that’s also something that I would highlight. The turnaround time is usually only 2-days. 

Are there any areas QA Madness could improve?

It would be helpful for QA Madness to present their results in a nicer way. For example, a 30-minute call with them where they give us some thoughts that are not written in the document. After a successful testing round, we could have a discussion about it together rather than via reports. I think that’s related to their price. They do a really good price, so we would not expect that. At some point, it would be a next step or an improvement.

4.5
Overall Score
  • 4.0 Scheduling
    ON TIME / DEADLINES
  • 4.5 Cost
    Value / within estimates
  • 3.0 Quality
    Service & deliverables
    The cost-quality relationship is very good. For the cost that we have, the quality is totally fine.
  • 4.0 NPS
    Willing to refer

Platform Testing for Consumer Products Business

"QA Madness has done a great job of testing our site on all platforms."

Quality: 
5.0
Schedule: 
5.0
Cost: 
5.0
Willing to refer: 
5.0
The Project
 
$10,000 to $49,999
 
Sept. 2015 - Ongoing
Project summary: 

QA Madness first engaged through manual testing of features for a popular online forum. The team's performance led to further testing of a related Magento site, which is now the primary focus of their work.

The Reviewer
 
1-10 Employees
 
Amsterdam, Netherlands
COO
 
Verified
The Review
Feedback summary: 

QA Madness’ project team completed multi-platform QA assignments rapidly and supplied thorough yet easy-to-understand documentation of many unexpected bugs.

BACKGROUND

Introduce your business and what you do there.

I’m the COO of a popular, online consumer products store. We list hundreds of different items that users can buy directly through our site. 

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We needed to find a company we could trust, which moved quickly, and which was not so expensive, while still providing good services. We operate in a competitive market and need to be on top of everything. We weren’t mobile friendly, so we hired a development team for this task. At the same time, we needed to have everything tested by a professional company. Although we know the site best ourselves, we didn’t have the time in our daily schedule for all the testing we wanted to do.

SOLUTION

What was the scope of their involvement?

Our development team is a third party, and QA Madness tested everything developed by them. We had a new design for the site and were also making it mobile responsive. The Magento backend is quite challenging, featuring many customizations. It was a difficult task for the testers, but if we’re going to go to war, we have to be prepared, which was exactly what we did by hiring QA Madness. Everything was thoroughly tested even though we didn’t anticipate the volume of work on this end.

It was also important to have everyone involved deal directly with each other. I didn’t want to be in-between because things always get lost in translation. QA Madness is very good at communicating with other companies, and I had no trouble at all. I simply followed up from time to time and was always surprised by the number of bugs discovered and their beautiful style of documentation. This is probably standard for this type of company, but I could see that QA Madness put a lot of effort in it.

We’ve used them for testing the payment functionality of the webshop as well, where they performed just as fast.

We also run a popular online forum in the world related to the different products we sell. It was updated and made mobile-responsive under a new platform. It was a large job, and we used QA Madness’ testing services there for the first time. There aren’t many web forums which require testing, and it’s a different type of task. This showed us QA Madness’ flexibility in handling different types of situations. We had a good experience and decided to use them for our webshop as well.

How did you come to work with QA Madness?

We received a lead from the group which is developing our new Magento shop. We didn’t look at any other shops because we knew the referrer very well, and find them to be a professional company. They wouldn’t have hired a testing firm without fully checking them out. QA Madness also has a competitive price.

What is the status of this engagement?

We started working with QA Madness in September 2015.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness has done a great job of testing our site on all platforms. They moved quickly and delivered documentation, which was of great value to our development team and was easily understood by leadership. We plan to use QA Madness for our new shop.

How did QA Madness perform from a project management standpoint?

We mostly communicate via email. We had a few Skype calls with QA Madness’ team as well. They talked directly to our development team, although I was often in between. QA Madness has great independence, and we haven’t had to sit behind them in order to ensure that the work gets done.

In the beginning, we used Google Docs for the forum, but the work done on the web shop has been through JIRA, which our development team had access to.

QA Madness’ managers only changed on a few occasions, but the quality remained the same.

What did you find most impressive about QA Madness?

I haven’t worked with many other testing companies, but I appreciated QA Madness’ overall response time. With other groups, I sometimes had to remind them of requests, but this never happened with QA Madness.

Are there any areas QA Madness could improve?

I would have told them if there was anything I thought they could improve.

5.0
Overall Score
  • 5.0 Scheduling
    ON TIME / DEADLINES
    I wish other companies were like QA Madness.
  • 5.0 Cost
    Value / within estimates
  • 5.0 Quality
    Service & deliverables
    They’re one of the best companies we’ve seen.
  • 5.0 NPS
    Willing to refer
    I have recommended them already.