What evidence can you share that demonstrates the impact of the engagement?
We have a spreadsheet that we use to summarize all completed automated tests and how many tests are left, so that we know where we stand. I review that tracker every couple of weeks, and make sure progress is being made.
We have three different application levels: web, iOS, and Android. They automated the web application testing by almost 95% within three months.
How did XBOSoft perform from a project management standpoint?
We have an ongoing development process, with two-week sprints to deliver work to production. We’ve made a lot of progress in the last 10 months because they're really good. They understand the deadlines and put in all the required effort to make sure they find any critical issues.
What did you find most impressive about them?
They were able to identify the major issues and why those things weren’t working properly within a week. That gave me a lot of confidence very quickly. I was able to convince my senior management that this was going to be a good investment and we should move forward with it.
Are there any areas they could improve?
When working with remote teams, communication is key. I have a half-hour discussion with them every day, to answer their questions and ask my own. We’ve had these meetings every weekday since we started the collaboration.
Also, we work on a lot of features with them, where we come up with how we want to do the testing and other aspects. I’d like them to do a bit more analysis and ask me more questions. It would make it into more of a brainstorming discussion, allowing us to identify more and more user test scenarios.
Do you have any advice for future clients of theirs?
Set expectations correctly from the client side and provide all the documentation and information they need. I worked with a QA engineer from their side and created a spreadsheet with all the tests. We provided that list to the team so they’d be productive from day one.