Could you share any evidence that would demonstrate the productivity, quality of work, or the impact of the engagement?
At the beginning, there were items on which Appsbee had a different approach than our internal team. It only took one discussion for us to convey that we wanted things to get done a certain way. Appsbee went back and changed their work style.
I don't have any metrics, but I can assure you that they were very good. About 85-90% of the time, there was no reason to question anything that came back from Appsbee. In 5% of cases, we had a question about a certain deliverable, for which Appsbee usually had a good explanation. On another 5%, we needed to rethink things, because something wasn't taken into account.
We have an extremely complex system, tied to the nature of retaining the app's users. Quite often, a small change can affect an awful lot. This has been a problem even for our internal team, but Appsbee picked up on it quickly, making sure that the testing was rigorous. I got involved on a daily basis, testing what had been done and how, before making anything live. Appsbee was good in this regard.
How did Appsbee perform from a project management standpoint?
The schedule slipped a few times, which was due to a naiveté regarding the depth of our project. We told Appsbee how long it had taken us to get the iOS version together. We knew that Appsbee could effectively meet the deadlines that were set, but we were okay with this, given that we had more realistic expectations.
What did you find most impressive about Appsbee?
I appreciated the fact that we were able to treat Appsbee as an external element which was still a part of our own organization. Throughout the constant feedback and discussions that we had, I never felt that Appsbee was an external company.
Are there any areas Appsbee could improve?
Appsbee sometimes needed to document the activity in a bit more detail. When we swapped to using an Agile methodology, it was required that Appsbee record many of the results of the team's efforts. Out of the eagerness to get things done, we sometimes tested elements before there was any documentation as to what had been done. It was a case of catch-up, rather than anything else.