Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?
We've been very happy with Menlo Technologies' work, given that we've engaged them for so many years. We don't have to spend a lot of time getting them up-to-speed on certain projects because many of the developers have been working with us for a long time.
Tracking performance metrics was a very subjective process when I first came onboard, so I spent a year putting together strict criteria for tracking how the work was being accomplished. Menlo Technologies has told us that we're by far their most advanced client in this regard, so much so that they've started implementing these methods with some of their other projects.
We specifically keep a close eye on how many items are assigned to particular engineers, how long it takes them to finish tasks, as well as what they're quality of code is, measured in bug counts. Every once in a while, we have had to dig in deeper during code reviews, but I've been generally happy and found that Menlo Technologies is almost as critical as us during this process.
How did Menlo Technologies perform from a project management standpoint?
We have a few methods in place to address working remotely with Menlo Technologies' team. We use a Slack channel and have a dedicated project manager on-site. Given the fact that we've worked through distinct sprint cycles, and Menlo Technologies' is given specific assignments and due dates, we tend to be okay.
What did you find most impressive about Menlo Technologies?
Since we've been working with Menlo Technologies for a long time, the inherent knowledge they have with our systems has helped a lot. If we ever need to add additional resources, Menlo Technologies can provide the training. Swapping resources at will without losing a serious amount of time is a unique advantage.
Are there any areas Menlo Technologies could improve?
Menlo Technologies tended to be a little less critical in terms of code quality than our team. Like many offshore service providers, Menlo Technologies has usually done what we specified, and nothing more, rarely questioning what is being done. I can understand this since Menlo Technologies wasn't involved in the design, but it would be nice to have pushback when something doesn't make sense. On a couple of occasions, something wasn't on-spec and wasn't caught, which was a little concerning. Tightening up those areas, and providing more resources able to think outside the box would be an improvement and aid for our team.
Another company I've used actually sent one person back-and-forth between sites, getting an idea of the culture and vibe at the client's location, and transferring that offshore. This helped tighten up the teams. When I brought this up to Menlo Technologies, they were willing to do it but wanted to triple the cost for that person. They did hire a senior person for this, but he only visits us about once a month.