TestDevLab

BACKGROUND

Please describe your company and position.

I am the Software Product Director of ViewSonic

Describe what your company does in a single sentence.

Selling computer monitors, projectors, interactive flat panels and commercial displays.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• AV streaming performance and quality checking
• Product benchmarking

SOLUTION

How did you find TestDevLab?

Online Search

Why did you select TestDevLab over others?

• High ratings
• Good value for cost

How many teammates from TestDevLab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Testing Objectives
The goal was to benchmark AirSync across key performance indicators that matter in education settings: ease of use, flexibility, classroom interactivity, video/audio quality, responsiveness, and collaboration support. Testing scenarios aimed to simulate classroom use—wireless screen sharing, bandwidth fluctuations, and simultaneous connections—to reflect how K-12 teachers and students would interact with the system daily. Tests were run on Viewsonic provided hardware. 

Test Scope and Methodology
TestDevLab conducted a series of cross-platform tests on Windows, macOS, Android, and iOS devices. Both static and dynamic video content were used under varying network conditions, including controlled bandwidth reductions (Unlimited → 1Mbps → 500Kbps) and simulated packet loss (1% → 5%).

Metrics evaluated included:

Audio: POLQA scores and delay measurements
Video: VMAF, FPS, latency, resolution stability
Performance: CPU, RAM, GPU usage during streaming
The testing process replicated classroom environments by capturing real-time user interactions, wireless network challenges, and multiple device connections. Objective tools like HDMI capture cards and Linux-based network shaping ensured results were both accurate and replicable.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Metrics evaluated included:

• Audio: POLQA scores and delay measurements
• Video: VMAF, FPS, latency, resolution stability
• Performance: CPU, RAM, GPU usage during streaming

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They delivered the test results on time. We created a shared team on Microsoft Teams, so we could have any realtime discussion. Also, we sent emails back and forth to deliver the test results on top of that.

What was your primary form of communication with TestDevLab?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

We were impressed by their expertise and experience in multimedia streaming field. Moreover, we learned a lot from their testing methodology.

Are there any areas for improvement or something TestDevLab could have done differently?

None.

BACKGROUND

Please describe your company and position.

I am the Senior Engineering Manager, Video & Infra of Gather Presence, Inc

Describe what your company does in a single sentence.

Gather builds remote work software that provides a virtual office presence and video conferencing.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• Gain an understanding of how our video conferencing (webrtc) features perform in a variety of situations.
• Gain an understanding of how our competitors' video conferencing (webrtc) features perform in a variety of situations.

SOLUTION

How did you find TestDevLab?

Online Search

Why did you select TestDevLab over others?

Examples of their work shared online

Describe the scope of work in detail. Please include a summary of key deliverables.

We hired TestDevLab to collect performance data about our video conferencing product in multi-user conversations. This included under bandwidth limited conditions, on both fast and slow hardware, and when screen-sharing at different resolutions. In addition, they also performed identical testing against two of our competitors, giving us an understanding of where we stand in a relative sense. They provided a 200+ page slide deck describing their findings, as well as graphs of various statistics over the course of each test.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

They found specific conditions in which our product underperformed the competition, and provided enough data that we were able to schedule engineering work to address it. This knowledge led us to reprioritize work throughout the first half of 2025.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

We engaged with them under a tight timeline, trying to have data ready before an upcoming board meeting. Due to technical considerations on our side, we delayed part of their work, and as a result missed the deadline we'd been targeting. They made extra effort to deliver a partial report in advance of our deadline, which was appreciated. Greater communication from their end about how the timeline of the project was tracking would have been useful, however. At times, work progressed for multiple weeks without an update.

What was your primary form of communication with TestDevLab?

Email or Messaging App

What did you find most impressive or unique about this company?

Their WebRTC-specific expertise was the primary reason we used and continue to use their services. They provide a great deal of technical analysis and insight, and make extra effort to ensure their testing is useful by providing things like packet captures.

Are there any areas for improvement or something TestDevLab could have done differently?

Weekly reports about the progress of their team and how they are trending against deadlines should be a default.

BACKGROUND

Please describe your company and position.

 I am the QA Team Lead of a financial services company 

Describe what your company does in a single sentence.

Financing and Circular retail

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• Test automation

SOLUTION

How did you find TestDevLab?

Referral

Why did you select TestDevLab over others?

• Close to my geographic location
• Referred to me

How many teammates from TestDevLab were assigned to this project?

1 Employee

Describe the scope of work in detail. Please include a summary of key deliverables.

Reengineered CI/CD test processes that ran efficiently, reliably, and integrated seamlessly with the development lifecycle.

A suite of maintainable, well-documented automated tests (unit, integration, functional, and UI) that significantly increased test coverage and reduced manual verification efforts.

Elevated internal QA and development team skill sets through training sessions, workshops, and mentorship, ensuring long-term sustainability of high-quality testing practices.

Conducted a thorough review of the existing testing frameworks, tools, and workflows to identify bottlenecks and inefficiencies.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Improved test coverage of our applications and minimized time spent on regression testing.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

They maintained clear and open lines of communication, quickly responding to inquiries, and providing frequent status updates. Whether it was clarifying a requirement, discussing a change in testing scope, or seeking feedback on a newly developed test suite, they remained receptive and adaptive. Their approach to addressing needs was attentive and solutions-driven, ensuring that stakeholders felt heard and supported. He consistently delivered key deliverables and completed assigned tasks within the agreed-upon timelines. When unexpected challenges arose, they communicated promptly, proactively sought resolutions, and adjusted their approach to maintain project momentum.

What was your primary form of communication with TestDevLab?

• In-Person Meeting
• Virtual Meeting

What did you find most impressive or unique about this company?

It makes us feel like they are not just a service provider, but a true partner in quality assurance.

Are there any areas for improvement or something TestDevLab could have done differently?

At the moment there is nothing, we are wery pleased.

BACKGROUND

Please describe your company and position.

I am the Test Manager of I-Hub

Describe what your company does in a single sentence.

We are specialized in the management of know your customer (KYC) processes and operate as an outsourcer for the financial, fund and insurance sector.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• Put in place testing activity for manual and automated testing

SOLUTION

How did you find TestDevLab?

Online Search

Why did you select TestDevLab over others?

• Pricing fit our budget
• Great culture fit
• Good value for cost
• Company values aligned

How many teammates from TestDevLab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Development of Testing Policy and Test Automation Project:
TestDevLab was in charge of the creation of a comprehensive testing policy as well as the development and execution of a test automation strategy tailored to our project needs.
Project Team Involvement:
The project team included the active participation of a Test Manager, Functional Testers, and Test Automation Engineers, ensuring a coordinated and expert approach to the testing process.
Parallel Testing of Multiple Systems:
Testing activities were carried out for several systems in parallel, ensuring that all necessary system functionalities were verified across different platforms simultaneously.
Types of Tests Conducted:
A wide range of tests was performed, including:
○      Performance tests,

○      Functional and non-functional tests,

○      API tests,

○      UX/UI tests,

○      Regression tests.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

Volume of non regression testing automated for our applications

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Responses to needs are in an agile and efficient mode, with exchanges based on the 3 amigos.
We are not using project management part. But any need is well raised and answered in time

What was your primary form of communication with TestDevLab?

Email or Messaging App

What did you find most impressive or unique about this company?

Their new technology monitoring and innovation are impressive.

Are there any areas for improvement or something TestDevLab could have done differently?

N/A

BACKGROUND

Please describe your company and position.

I am the Head of Growth and Strategy of Mitigate Ltd.

Describe what your company does in a single sentence.

Mitigate is a Latvian company that excels in providing custom development services, specializing in developing business-critical applications for large corporations across the Baltic region and Europe. Mitigate’s focus is on delivering tailored solutions to meet customer needs. 

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• To provide quality assurance services for mobile products (iOS / Android)
• To ensure that the application meets user needs and expectations, leading to higher user retention and positive reviews
• To identify and address potential security vulnerabilities, ensuring that user data is protected and the application complies with industry standards

SOLUTION

How did you find TestDevLab?

Referral

Why did you select TestDevLab over others?

• High ratings
• Close to my geographic location
• Great culture fit
• Good value for cost
• Referred to me

How many teammates from TestDevLab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

LMT Smart TV project. The goal was to create a smart TV app that is now available on both Google Play and the App Store.  

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

We worked closely on the project during the testing phase and brought in TestDevLab to help create a clear test strategy, detailed test planning, and successfully test the iOS and Android apps. TestDevLab also conducted compatibility testing across various devices to ensure everything functioned smoothly. In the end, Mitigate’s team delivered a high-quality product to the customer, fully managing the mobile app development for both platforms

Describe their project management. Did they deliver items on time? How did they respond to your needs?

TestDevLab seamlessly integrated into our agile software development process, making sure that testing was incorporated throughout the development stages. 

What was your primary form of communication with TestDevLab?

• In-Person Meeting
• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

Their expertise in quality assurance, the variety of software testing services offered, and access to thousands of real devices for testing.

Are there any areas for improvement or something TestDevLab could have done differently?

TestDevLab did an excellent job with their expertise and range of testing services. If there’s one area for potential improvement, it could be around speeding up communication during key stages of testing. A quicker feedback loop during time-sensitive phases would help further improve the efficiency of the process. Overall, we were very satisfied with their support.

BACKGROUND

Please describe your company and position.

I am the COO of a digital product agency

Describe what your company does in a single sentence.

We are an agency that helps businesses design, build, and launch groundbreaking (mobile) digital products.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• Support with quality services
• Generate full test plans and execute it

SOLUTION

How did you find TestDevLab?

Referral

Why did you select TestDevLab over others?

• High ratings
• Pricing fit our budget
• Great culture fit
• Good value for cost
• Referred to me
• Company values aligned

How many teammates from TestDevLab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

Providing a fully detailed test plan, managing the quality engineering team and providing full test reports for Android and iOS application that we developped.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Very high quality test plans.
• Test reports and bug reports quality delivered in a proper pace aligned with the development team.
• Synchronisation with all team members in the project avoided delays

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Working in a Scrum environment, teams are aligned (developmetn + quality) and deliverables were constantly on time, even with bigger scopes to cover during each sprint. 

What was your primary form of communication with TestDevLab?

• In-Person Meeting
• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

The flexibility to adjust to the development team, clarity in communication and willingness to create a quality product. TestDevLab covers any areas of quality you can expect, with very strong quality engineers. Be it for a team with no QA to a team scale up, TestDevLab will be adding value to the products they work with.

Are there any areas for improvement or something TestDevLab could have done differently?

No

BACKGROUND

Please describe your company and position.

I am the software developer of LINE Plus

Describe what your company does in a single sentence.

We have been developing and operating a video call service within the LINE messenger. I am leading the development and operation team.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• We have been developing and operating a video call service within the LINE messenger. To enhance the call quality of our service, we need to measure the call quality accurately. However, there is no standard for measuring video call quality, making it a challenging task.

SOLUTION

How did you find TestDevLab?

Online Search

Why did you select TestDevLab over others?

seem professional

Describe the scope of work in detail. Please include a summary of key deliverables.

TestDevLab offers professional video call quality measurements. They have their own various scenarios and network impairment frameworks.

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Price: We can discuss the quality scenarios, and the price depends on the number of test scenarios. It seems very reasonable and controllable.
• Report and Insights: After completing the tests, they provide us with a report and share their professional insights. This is very helpful to us.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

Initially, we discussed the project through Zoom, and then we primarily communicated via email. We asked many questions, and they answered every one of them.

What was your primary form of communication with TestDevLab?

Email or Messaging App

What did you find most impressive or unique about this company?

fill later

Are there any areas for improvement or something TestDevLab could have done differently?

They answered all our questions. Additionally, if they felt a re-test was necessary, they were willing to do it. This demonstrated their sense of responsibility to us.

BACKGROUND

Please describe your company and position.

 I am the Quality Management Team Lead of a smartphone manufacturing company 

Describe what your company does in a single sentence.

Dutch electronics manufacturer that designs and produces smartphones and headphones which aims to minimize the ethical and environmental impact.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• To perform manual and automated testing on our products to ensure the quality and performance our software releases before they are deployed to consumers.

SOLUTION

How did you find TestDevLab?

Online Search

Why did you select TestDevLab over others?

• High ratings
• Pricing fit our budget
• Good value for cost

How many teammates from TestDevLab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

1. Provide continuous manual and automated testing analysis as a service for the smartphone device category
2. Lab analysis per product and SW version is performed on devices with the latest HW build. 
3. Each SW release is tested and fixes are verified prior to public Software update rollout or product launch, and cross-checked with previous issues reported. Monthly releases full testing, weekly builds validation/check of specific issues. 
4. Test planning and scripting: design reusable scripts that are easily managed and can be used for various product models and use cases. 
5. Result analysis and reporting: Reports include summary, top issue prioritizing, categorization and pre-debugging for the issues found 
6. Summarized performance reports provided in PDF format: from each analyzed Software version in a user-friendly format. Detailed reports can be in other most adequate formats.
7. Reports on software builds are uploaded in Google Drive for access by both parties 
8. Responsible for creating and flagging issues found directly on internal issue management system.  
9. Access to the TestDevLab platform that collects and displays data for employees. Available defect data: video, device log, crashes, resets, resource monitor. Additional data can be provided on request. 
10. Support with labs testing on a need basis as agreed by the parties (such as audio, connectivity, video, camera, battery). 
11. Provide benchmarking and comparative analysis on a need basis as agreed by the parties.  

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

• Reports of each software build tests that describe the issues that need to be investigated, how they can be reproduced, and their priority. 
• Performance report from the automated testing focusing on KPIs and SW stability for each software release tested. 

Describe their project management. Did they deliver items on time? How did they respond to your needs?

• Manual testing - were always delivered on time. Took the lead properly with suggestions to make it better.
• Automation testing - The reporting part for automation took quite a while to get in shape but once done, it was delivered on time. There was a bit lacking lead here since more time was spent on the set-up when compared to manual testing.
• Provided very good support for any Ad-hoc requests.

What was your primary form of communication with TestDevLab?

• Virtual Meeting
• Email or Messaging App

What did you find most impressive or unique about this company?

• I liked how the manual testing was set up, how they took the initiative to revise test plans for better coverage, and how they correctly delivered all required data.
• They were open to take on new test requests out of their initial scope of work, which provided substantial support to specific investigations.

Are there any areas for improvement or something TestDevLab could have done differently?

• The automation framework could have been better structured and set up at a much initial stage with defined KPIs and testing methodology.
• Some small room for improvements on the manual testing to explore more on customer scenarios and benchmarking. 

BACKGROUND

Please describe your company and position.

I am the Product Manager of Kõu Mobility Group

Describe what your company does in a single sentence.

We empower people to choose emission-free transportation.

OPPORTUNITY / CHALLENGE

What specific goals or objectives did you hire TestDevLab to accomplish?

• Ensure that the Companion App for Äike e-scooters is of the highest quality.

SOLUTION

How did you find TestDevLab?

Referral

Why did you select TestDevLab over others?

• Great culture fit
• Good value for cost
• Referred to me

How many teammates from TestDevLab were assigned to this project?

2-5 Employees

Describe the scope of work in detail. Please include a summary of key deliverables.

TestDevLab was regularly testing our App releases for the Äike Companion App. We had defined a set of devices that were in the scope, and each new feature or update got thoroughly tested using a pre-defined testing framework. TestDevLab regularly reported any bugs they found. Key deliverables: 

• iOS test suite 
• Android test suite 
• fault list 
• transparency on testing methodologies and framework

RESULTS & FEEDBACK

What were the measurable outcomes from the project that demonstrate progress or success?

After started working with TestDevLab we significantly improved our Defect Detection Ratio and raised the overall quality of our app.

Describe their project management. Did they deliver items on time? How did they respond to your needs?

TestDevLab was extremely well organised and always delivered on time. We really appreciated their enthusiasm to help make our product better and always going the extra mile to understand the problems we are trying to solve.

What was your primary form of communication with TestDevLab?

Virtual Meeting

What did you find most impressive or unique about this company?

The people that were assigned to my project were very good communicators and very organised. It was a great pleasure to work with them.

Are there any areas for improvement or something TestDevLab could have done differently?

Can't think of any.