QA Madness

BACKGROUND

Introduce your business and what you do there.

Above the Fray Design, Inc. is a full-service e-commerce design and development shop specializing in Magento and other platforms. I am a co-founder and the business developer of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

In the past, I’ve been a part of numerous software and e-commerce development teams that have tried to do QA [quality assurance] in-house, or had developers, project managers, and even business development people handle the task. It can become a mess and it’s one of the worst things I’ve seen happen. After all the hard work, the project can go south at the very end because of this. We were looking to solve that problem but also didn’t want to bring in a full QA team, as it would be overkill for our needs. We went to QA Madness for assistance.

SOLUTION

What was the scope of their involvement?

Their involvement started at the very beginning of the project. They helped look ahead in order to see which areas they would want to run QA on.

Particularly if we’ve finished a module or specific section, they do the QA, conducting a full test on a variety of different devices, platforms, browsers, and screen sizes. Towards the end—especially when we’re going into pre-launch phases and prior to user-acceptance testing—they will go through, comparing the entire website to the scope of work, and interviewing us to make sure everything is correct.

No matter what, everyone is going to miss something, but this approach knocks out 95% of the issues that the client would point out to us otherwise.

What is the team composition? 

I worked with one of their sales managers.

How did you come to work with QA Madness?

They are known in the e-commerce world, for Magento specifically. Some of my most esteemed colleagues had worked with them and they also ran a pretty good email campaign that brought them to my attention. I asked a colleague from another company about the team, and he said also said they were the best.

How much have you invested with them?

Over the course of three projects, we’ve spent $15,000–$20,000 on their services.

What is the status of this engagement?

We started working with them in July or August 2017. We’ve worked with them on three projects so far and plan to maintain an ongoing relationship.

RESULTS & FEEDBACK

What evidence can you share that demonstrates the impact of the engagement?

We’re a new company, but our members have been working in the industry for years. My business partner and I have assembled what I consider to be an all-star team, but this was our first time working together in this formula. We wanted to break all misconceptions around poor development, broken timelines, and angry clients.

The very first site we launched delighted and impressed our client in terms of QA. The number of follow-up tickets they had with us was minimal, and the ones that did exist weren’t as much related to QA items as they were to design pieces that the client wanted to adjust. 

Every client we’ve used QA Madness with has been absolutely delighted with the work.

How did QA Madness perform from a project management standpoint?

They’ve been amazing in terms of communication; with no delays or lags, even during holidays. They give us advanced notice of any scheduling conflicts, and even then, they’ve made themselves available at times when they said they probably wouldn’t be. They’re extremely attentive to client concerns and deadlines, and extremely professional when it came to sticking to estimates, scopes, and quotes. I have no complaints; they are an extremely valuable part of our extended team and I couldn’t ask for more from a project management standpoint.

We have people across the nation and across the globe, so Skype is used by our team across various locations. We also have VoIP phone calls and use email. I am connected with the managers from their team via Facebook as well.

What did you find most impressive about them?

It comes back to the difference they’ve made in terms of client satisfaction with end-results. They also have good communication cadence and don’t over-engineer QA, which helps maintain timelines. After all the hard work of our designers, engineers, developers, project managers, and system analysts, having their team make sure that there is a bow on the final delivery, and the client is happy, is invaluable.

Are there any areas they could improve?

I always like to give constructive feedback and am usually good at it. If there was something to point out, I would have done it, but they’re thorough and professional. I appreciate them immensely and have no improvements to mention.  

Do you have any advice for future clients of theirs?

A general rule is being proactive and not afraid to engage. Provide as much information as possible, so they can do their job. Engage early, speaking with them prior to even the project. We didn’t wait until the last minute, which worked out great, but if we hadn’t given them time to prepare ahead of time then they’d have had to scramble.

BACKGROUND

Please describe your company and your position there.

I’m the CTO of elgentos ecommerce solutions, a boutique Magento development agency in the Netherlands. We mainly serve webshop merchants with income ranging between €1–20 million per year.

OPPORTUNITY / CHALLENGE

For what projects/services did your company hire QA Madness?

We outsource the testing work to them. When we build a new feature for our clients, we pass the staging information on to QA Madness, where they conduct thorough functional testing as well as regression and smoke testing.

What were your goals for this project?

The main goal is to increase the quality of our deliverables.

SOLUTION

How did you select this vendor?

They came highly recommended by other companies in our industry.

Describe the project in detail.

We first gathered all issues in our project management software and assigned a QA [quality assurance] label to them. QA Madness then went through those issues to conduct testing and created new issues for any problems they found. Their reporting is extremely thorough and includes a step-by-step way to reproduce the issue, several screenshots, and almost always also a screen capture video. They also test in a wide range of devices and browsers, which we decided upon together beforehand.

What was the team composition?

We were assigned a project manager who then assigned testing agents based on their internal availability. We do have the same project manager for every project, which is very nice.

RESULTS & FEEDBACK

Can you share any outcomes from the project that demonstrate progress or success?

Their work has helped speed up our time-to-go-live for an average feature to a week or so, which usually was around a month including sprint, testing, and client approval.

How effective was the workflow between your team and theirs?

The workflow was very effective. We’ve communicated using our own issue management system— GitLab—which keeps things streamlined for us and our clients.

What did you find most impressive about this company?

I was amazed by the level of detail in the reporting and reproduction of the issues. They surprise me every time by finding bugs and issues that I would've never thought of testing. They're also usually available for testing within a few days, which is extremely nice in some situations although we try to plan in advance.

Are there any areas for improvement?

Not that I can think of.

BACKGROUND

Introduce your business and what you do there.

We offer a more proactive chat solution to customers visiting websites, through something called browsing. It’s a useful tool for people visiting online stores or other websites, and need help finalizing purchases. They can chat with the agents, but also share their screens, in order to receive guidance on how to fill out a form, which buttons to click, and so on. The solution is applicable in all kinds of contexts, but it can be especially helpful for government organizations and large companies which that have less user-friendly websites. We are located in The Netherlands, with a part of our dev team being based in Spain. I am a member of the coding team and handle a mixture of backend and frontend development, as well as platform operations.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We were changing the way in which we were working, and tried to speed up our development process. At the time, we realized that we had a number of tools for automating almost everything related to development, code-sharing, testing, and deployment. The missing part in all of this was having some kind of human testing. Unit testing is nice for identifying bugs, and so if functional testing, for determining if all parts in the system are working correctly with each other, but we also wanted human testing, so the manager of our company brought QA Madness in.

SOLUTION

What was the scope of their involvement?

QA Madness provided testing not only for discovering bugs, but also as a means of having a different view on the new features we were building. Whenever we decide to design and build something, one of the steps will be to have a different set of eyes look at that feature, and give us feedback. QA Madness can provide recommendations on how we can improve features, make screens more intuitive for customers, and have simpler approaches to development.

If I’m not mistaken, QA Madness is doing testing through an online platform which covers all desktop browsers, Internet Explorer, Firefox, Chrome, Opera, and Safari. They are also testing for mobile devices, namely the native browsers on Android and iOS.

How did you come to work with QA Madness?

I believe that the leader of our company was looking for a testing team online, and found QA Madness. I was not involved in the selection process, but I inherited this relationship.

How much have you invested with QA Madness?

I don’t have this information.

What is the status of this engagement?

We started working with QA Madness almost two years ago.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We have moved away from an automated workflow. Whenever we made a new change in the code, it would be pushed automatically to our repositories, after which it would have unit testing performed, and be deployed. We experienced some issues with this workflow, so we are working together with QA Madness in order to test everything for errors and stability. We have implemented a new rollback tool which can undo any new features or bug fixes. We perform manual testing before each new release, and also test the rollback tool, ensuring that everything is okay in terms of previous and current versions.

The stability and security of our releases has increased a lot in the past two months, and we haven’t had any issues with new releases. We have one new release every week, which means that we are moving fast in terms of development, fixing bugs and releasing new features.

How did QA Madness perform from a project management standpoint?

We are working closely with the testing team itself through our Slack instance, which is a Skype-like application for communication. We have daily chats around the features to be tested, any reported bugs, and changes to the testing environment. For meetings, we use Zoom, which is similar to Google Hangouts. It allows us to share screens and have daily standups, and interview QA Madness’ resources.

As far as I know, our managers had conversations with members of QA Madness and assigned one person to work with us. After that, we had a couple of meetings with their manager and tester, and went through interviews and evaluations. The initial tester left the company, but a new resource was introduced to us before that happened, making the transition smooth. I don’t know if we were able to interview all the members of our testing team.

I haven’t looked at QA Madness’ reports. I believe that they are received by the company leader or someone else on our side.

What did you find most impressive about QA Madness?

This is the first company of its kind I’ve worked with, so I cannot compare QA Madness to anyone else. Their team is very organized, especially when it comes to using complicated applications like ours, with different accounts, users, and passwords. We didn’t have any issues with lost passwords on their side, which is a common occurrence for us.

QA Madness is also very detailed in terms of work. They perform different kinds of crazy things during testing, in order to break the software and get errors, like turning off the internet connection while performing a task. Over the past couple of years, QA Madness has helped us detect a number of strange user behaviors. In the end, we won’t know how good the software is until it’s released publicly, and users start doing crazy things with it. We appreciate QA Madness’ work, since this is the way to really test software. At some point, we will be introducing a new type of automatic and functional testing. We like to have this between different stages like testing, staging, production, private clouds, and so on. Our private cloud is similar to the production environment, but with more restrictions around security and data protection. Some of our customers need this kind of extra protection. We plan to introduce a new kind of automatic integration between these different stages, and already have a person from QA Madness’ side working with us, and learning the new technology, not only in order to test that everything is working fine, but to also convert the tests into real code that we can use. They will help us build the piece of software for performing this automatic integration and functional testing.

Are there any areas QA Madness could improve?

Since they are a growing company, improving knowledge around the software and technologies we’re using, specifically around HTML and security. We want to offer the best and most secure features to customers, so this is always a good offer. QA Madness could make suggestions related to security issues they identified in the latest version of Chrome, which could affect our platform, for example. It would be the perfect improvement to them.

BACKGROUND

Introduce your business and what you do there.

We are a digital agency based in Salzburg, Austria doing all kinds of digital marketing for international clients. We do website development, web shops, mobile applications, video/photo production, and media management. It’s basically everything a client needs today in digital marketing. I’m the lead project manager. From the beginning of a project to the launch of the project, my responsibility is to lead projects, be the first point of contact for my clients, organize resources, and plan projects and internal resources.

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We produce a lot of things (websites, web shops, mobile apps), but we do not have a quality assurance department. We do internal testing, but not in a super professional way—we don’t have dedicated people assigned to quality assurance and testing. That’s why QA Madness was and is a good call on our part.

SOLUTION

What was the scope of their involvement?

We outsource to them for certain projects. Mostly, it’s the size and importance of the project as well as the client’s budget that determines whether or not we go to QA Madness for testing. I’ll give QA Madness a project that has a high budget, or one that’s super important or involved a lot of time for developing a website or the mobile app. They have not been involved in testing many solutions, to be honest. It’s around five projects per year.

These solutions, mainly mobile apps, are relatively complex. There are so many mobile devices—different iPhones and Android versions of smartphones. On all these devices, it’s a lot of effort to test the mobile app’s quality.

My projects are more about functionality and finding bugs: Does every link work? Does the navigation work fine? Is there anything a user could be blocked from? Is there an error message? I think they do usability testing and infrastructure testing, but I’ve never done it personally with QA Madness.

From my understanding, it’s manual testing. I don’t know how big the team is there. In their testing reports, there’s usually one person mentioned responsible for the tests. I’m not sure if this person is the project manager or the person who is doing all the testing. I have only one point of contact there who has been the same person all this time.

How did you come to work with QA Madness?

I came to the agency, and QA Madness was already a part of it. I took over the main communication with them. Whenever someone at the agency has a relevant project, they approach me and I get to my contact at QA Madness.

How much have you invested with QA Madness?

Around €2,000 [$2,254] yearly.

What is the status of this engagement?

It’s been ongoing for about three years, but I’ve only been with the agency for two years.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

First of all, they are quite fast and flexible. Whenever there’s a project, they can deliver fast even when there’s little time. The testing is very carefully done; there’s nothing missing. They’re always very accurate, so it’s very helpful for us. Otherwise, we wouldn’t use them. They have a good, fair price. It works well from that perspective.

How did QA Madness perform from a project management standpoint?

Communication is happening via email. Once we have aligned on a project’s costs, they send a checklist of what they need for testing. This checklist is always the same: we send them download links, our expectations, and a quick introduction and description of the project. Once they have received that, they start with the testing.

Depending on how big the whole project is, they’ll send us the report of functional testing after a couple of days also via email. It’s a PDF document with detailed descriptions of bugs and functionalities that aren’t working 100%. We then take the document and give it to our development team, who’ll go through the document, fixing bugs and improving things. We don’t have calls where QA Madness present their results. If we have questions, of course, we can ask, but it’s usually very clear.

What did you find most impressive about QA Madness?

I don’t have too much experience with other partners. Their price is surprisingly good because they are based in Lithuania, so the price level there is different than in central Europe. For us, it’s super efficient and cost-effective to outsource testing. They are quite flexible and fast, so that’s also something that I would highlight. The turnaround time is usually only 2-days. 

Are there any areas QA Madness could improve?

It would be helpful for QA Madness to present their results in a nicer way. For example, a 30-minute call with them where they give us some thoughts that are not written in the document. After a successful testing round, we could have a discussion about it together rather than via reports. I think that’s related to their price. They do a really good price, so we would not expect that. At some point, it would be a next step or an improvement.

BACKGROUND

Introduce your business and what you do there.

I’m the COO of a popular, online consumer products store. We list hundreds of different items that users can buy directly through our site. 

OPPORTUNITY / CHALLENGE

What challenges were you trying to address with QA Madness?

We needed to find a company we could trust, which moved quickly, and which was not so expensive, while still providing good services. We operate in a competitive market and need to be on top of everything. We weren’t mobile friendly, so we hired a development team for this task. At the same time, we needed to have everything tested by a professional company. Although we know the site best ourselves, we didn’t have the time in our daily schedule for all the testing we wanted to do.

SOLUTION

What was the scope of their involvement?

Our development team is a third party, and QA Madness tested everything developed by them. We had a new design for the site and were also making it mobile responsive. The Magento backend is quite challenging, featuring many customizations. It was a difficult task for the testers, but if we’re going to go to war, we have to be prepared, which was exactly what we did by hiring QA Madness. Everything was thoroughly tested even though we didn’t anticipate the volume of work on this end.

It was also important to have everyone involved deal directly with each other. I didn’t want to be in-between because things always get lost in translation. QA Madness is very good at communicating with other companies, and I had no trouble at all. I simply followed up from time to time and was always surprised by the number of bugs discovered and their beautiful style of documentation. This is probably standard for this type of company, but I could see that QA Madness put a lot of effort in it.

We’ve used them for testing the payment functionality of the webshop as well, where they performed just as fast.

We also run a popular online forum in the world related to the different products we sell. It was updated and made mobile-responsive under a new platform. It was a large job, and we used QA Madness’ testing services there for the first time. There aren’t many web forums which require testing, and it’s a different type of task. This showed us QA Madness’ flexibility in handling different types of situations. We had a good experience and decided to use them for our webshop as well.

How did you come to work with QA Madness?

We received a lead from the group which is developing our new Magento shop. We didn’t look at any other shops because we knew the referrer very well, and find them to be a professional company. They wouldn’t have hired a testing firm without fully checking them out. QA Madness also has a competitive price.

What is the status of this engagement?

We started working with QA Madness in September 2015.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness has done a great job of testing our site on all platforms. They moved quickly and delivered documentation, which was of great value to our development team and was easily understood by leadership. We plan to use QA Madness for our new shop.

How did QA Madness perform from a project management standpoint?

We mostly communicate via email. We had a few Skype calls with QA Madness’ team as well. They talked directly to our development team, although I was often in between. QA Madness has great independence, and we haven’t had to sit behind them in order to ensure that the work gets done.

In the beginning, we used Google Docs for the forum, but the work done on the web shop has been through JIRA, which our development team had access to.

QA Madness’ managers only changed on a few occasions, but the quality remained the same.

What did you find most impressive about QA Madness?

I haven’t worked with many other testing companies, but I appreciated QA Madness’ overall response time. With other groups, I sometimes had to remind them of requests, but this never happened with QA Madness.

Are there any areas QA Madness could improve?

I would have told them if there was anything I thought they could improve.

BACKGROUND

Please describe your organization.

I work for a development agency with a focus on mobile apps and websites. We also handle virtual reality development.

What is your position?

I am a project manager in the company.

OPPORTUNITY / CHALLENGE

What business challenge were you trying to address with QA Madness?

As we develop solutions for our clients, we want to be able to test the quality of our apps and websites before launch. 

SOLUTION

Please describe the scope of their involvement.

We use QA Madness exclusively for testing. We have a few different scenarios. If we're developing a brand-new app, we will have QA Madness go through extensive testing on the entirety of the software from front to back. In other situations, we may be troubleshooting a particular feature, giving QA Madness a specific focus. For the most part, we've used QA Madness for manual testing. We may also assign some automated load testing to them in the future.

We are using around six testers from QA Madness. I interact directly with three of them. There are project managers in our company who interact with the others.

How did you come to work with QA Madness?

We were using QA Madness prior to my coming onboard with the company. I'm not sure what the genesis was in terms of finding them.

Could you provide a sense of the size of this initiative in financial terms?

I don't have this information. I came on after we started working with QA Madness, and I've only seen a portion of their work.

What is the status of this engagement?

We have been working with QA Madness for close to a year. We have an ongoing relationship.

RESULTS & FEEDBACK

Could you share any statistics or metrics from this engagement?

Generally speaking, QA Madness has been very thorough. They understand how a product can be figured out intuitively. We will offer QA Madness as much direction as possible, but they tend to figure out software on their own. The results that we've gotten back from QA Madness are very easy for developers to follow. The quality we've seen from QA Madness is high.

How did QA Madness perform from a project management standpoint?

We have been using Pivotal Tracker as one of our main tools, as well as Trello for smaller projects. We do have a few projects tracked through JIRA as well.

What distinguishes QA Madness from other providers?

QA Madness has gone well above and beyond what we've asked of them. Often, if we give QA Madness a particular area of focus, they've also come back with a complete battery of tests, offering QA [quality assurance] for the entire product, which was more than what we asked for.

Is there anything QA Madness could have improved or done differently?

Nothing comes to mind. QA Madness's communication has been great, too. I was able to get a hold of QA Madness's managers and engineers quickly. Even though there's a time difference between us and them, their engineers made themselves available whenever they were needed. On the whole, we're very satisfied with QA Madness.

BACKGROUND

Introduce your business and what you do there.

We're website developers. Our specialty is creating open-source platforms which sit on top of enterprise systems. An example would be using a Drupal presentation layer as a CMS [content management system], which will tie in on the backend to Salesforce, or using Magento as an e-commerce platform, and integrating it with a SAP system.

I am the president of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We were working on a Magento commerce project for a client in the healthcare industry, and needed to run a test script which would show us what the concurrent checkout threshold was. We were busy in the development cycle and had a tight development window.

SOLUTION

What was the scope of their involvement?

Rather than creating test scripts ourselves, we were able to outsource the work to QA Madness. We have only engaged QA Madness on one project. QA Madness assigned around 2-3 people to our project. We only interacted through a project lead.

I gave the specifics in terms of scripts to our director of technology. QA Madness had access to our development environment in order for them to write the scripts. Our client has very tight security requirements, so we weren't able to provide access to live environments. We ran test scripts on quality assurance servers in the client's environment.

How did you come to work with QA Madness?

I found QA Madness on Google, had an initial contact, and decided to use them.

What is the status of this engagement?

We started working with QA Madness a couple of months ago. We had a week's time to write the scripts, which is what QA Madness committed to. They met their deadlines, and everything worked as smoothly as possible.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness' code was not brittle at all, and we didn't have a need to rewrite anything. We made a few little tweaks in terms of threshold testing, after which everything was ready to go.

The test script made by QA Madness worked to our exact specifications, showing us how many concurrent transactions we could handle. We could then determine if that number was sufficient, or whether we needed to resize the servers. It was valuable information, and the delivery was on time and within budget. All in all, I had a good experience with QA Madness. I would go to them again in a heartbeat.

How did QA Madness perform from a project management standpoint?

Everything worked as it should, and our communication was fantastic. I imagined that there would be some delays because of our time zone differences, but someone at QA Madness was burning the midnight oil. I was able to email them in the morning on West Coast time and receive responses in real time.

There was no need to use project management software. We use GitHub internally, but not with QA Madness. They had access to our development server, ran the scripts, got the results, and turned the work over to us.

What did you find most impressive about QA Madness?

I was impressed with QA Madness' communication. I have done offshore work in the past with Indian, Russian, and Ukrainian companies. Their command of the English language was very good, as well as their communication skills and timeliness. Oftentimes, we ran into issues along those lines, but not with this project.

Are there any areas QA Madness could improve?

No.

BACKGROUND

Introduce your business and what you do there.

We are a startup mobile app company. We have developed an encrypted messaging app for iOS and Android.

I am the Director of Operations for the company. I've been in charge of our work with QA Madness for the last 6 months.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We needed assistance with testing our app.

SOLUTION

What was the scope of their involvement?

QA Madness provided functional testing for our app. Because they're based overseas, QA Madness worked on testing while we were sleeping, which came as perfect timing, allowing us to work on the detected bugs the next day.

QA Madness received builds through HockeyApp and logged bugs using Assembla, initially. We've moved to Redmine since then. We sent iterations to QA Madness both before and after launching a new version. QA Madness provided one resource at any given time. We mostly interacted with that person through our lead QA manager.

Our QA tester was changed at one point, but QA Madness gave us a week-and-a-half notice for this, giving us enough time to prepare the new person.

How did you come to work with QA Madness?

I wasn't involved in the initial selection. I know that our company purposely looked for a partner on a different time schedule, so that the work could be done within the night, allowing us to review everything when we started our day.

How much have you invested with QA Madness?

The total cost of QA Madness' services has been around $15,000.

What is the status of this engagement?

We've been working with QA Madness for 9 months.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

We have a small QA team, so we wouldn't have been able to identify all the issues in our app without the help of QA Madness. They saved us a lot of time. QA Madness was thorough with bug reports and consistent in terms of findings. We don't have a tight focus on the general bug count, but we have noticed an improvement since working with QA Madness.

How did QA Madness perform from a project management standpoint?

QA Madness delivered their reports on time, without any issues. We collaborated exclusively through email and Assembla.

What did you find most impressive about QA Madness?

QA Madness is a very thorough and timely company. They always included videos of the issues detected, which helped us locate them.

Are there any areas QA Madness could improve?

No. QA Madness was great, always on time, had good rapport, and were thorough. It was a breeze working with them.

BACKGROUND

Introduce your business and what you do there.

We are a mobile software development company engaging in work for hire with clients in the US, Europe, Russia, Israel, and Canada. I am the Chief Executive Officer of the company.

OPPORTUNITY / CHALLENGE

What challenge were you trying to address with QA Madness?

We had some QA resources, but realized that we weren't 100% happy with their performance and also didn't have a full workload all of the time. There were times when they were literally doing nothing, so we thought that we could work with a company, utilizing resources as-needed.

SOLUTION

What was the scope of their involvement?

QA Madness typically reviews our product requirements and designs, performing manual testing. In some instances, they also engage in derived test cases. We use QA Madness for regression and compatibility testing. They create test cases as formal descriptions.

Usually, we interact with a project lead from QA Madness. When there is a need for making a test, I will create a task in our tracker and explain what I need QA Madness to do. They start the process, file bugs, and close the task when it's complete. In most cases, a screenshot or video is attached to the report, explaining how to reproduce the issue. QA Madness doesn't provide suggestions for bug fixes. They don't have access to the source code and don't have the capabilities for fixes.

How did you come to work with QA Madness?

I reached a few companies, looking for one that could offer good quality at a reasonable price, ultimately finding QA Madness. I think that I received a marketing email from them initially. When the time came to find a QA company, I opened QA Madness' email and contacted them.

How much have you invested with QA Madness?

The total cost of QA Madness' services has been up to $50,000. We work on a time-and-materials basis.

What is the status of this engagement?

We have been working with QA Madness for two and a half years. We have used them for tests on more than 10 applications.

RESULTS & FEEDBACK

Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?

QA Madness has good skills for writing scenarios on the basis of which an issue can be reproduced. Usually, QA Madness will not miss anything critical, which is what we want from a QA team: to be reliable, quick, and have the ability to explain issues. The documentation they provide is also terrific. 

How did QA Madness perform from a project management standpoint?

There are no surprises in QA Madness' work, usually. We can estimate how long a project will take, based on previous experience. I'm very happy with QA Madness and continue to work with them.

QA Madness always kept us informed about any busy or unavailable periods, allowing our company to create a plan that will work for both parties.

What did you find most impressive about QA Madness?

I appreciated the fact that QA Madness was always responsive and worked quickly. Whenever we post a task, testing will begin the next day and be completed within a few days. It can take longer for bigger projects.

Are there any areas QA Madness could improve?

Nothing comes to mind.

BACKGROUND

Please describe your company and position.

I am the Operation Specialist of SRACO ICT

Describe what your company does in a single sentence.

R&D unit and analysis hub with a focus on deep research and discovery practices.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire QA Madness to accomplish?
We hired QA Madness to perform comprehensive testing of our mobile application, which is available on both iOS and Android platforms.

SOLUTION

How did you find QA Madness?

Referral

Why did you select QA Madness over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from QA Madness were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

We hired QA Madness to perform comprehensive testing of our mobile application. The project involved functional, UI/UX, and compatibility testing across a wide range of devices, including smartphones and tablets.

A particular focus was placed on supporting a broad set of OS versions — from Android 12 up to the latest release, and from iOS 17 through to the newest iOS version — to ensure maximum coverage and smooth user experience across both older and modern devices.

The QA Madness team provided detailed defect reports, maintained regression test suites, and helped us identify and resolve critical issues before production releases.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

As a result of the testing process, the QA Madness team successfully executed hundreds of test cases, including edge cases that helped uncover critical and hidden bugs in our product. Their thorough approach allowed us to identify and resolve a number of issues that had previously gone unnoticed.

After addressing the high-priority issues, we saw a measurable improvement in performance and stability. Most notably, we experienced a 20% increase in conversion rates, with a significant impact observed among iOS users.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

The structured testing approach and transparent communication from QA Madness contributed greatly to the success of this project.

What was your primary form of communication with QA Madness?

• In-Person Meeting
• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Meeting deadlines, high expertise, and proactivity of specialists.

Are there any areas for improvement or something QA Madness could have done differently?

We were extremely satisfied with the processes and the fact that they improved during the collaboration.