Def Method

Please describe your company and your position there.

I'm the Technology Team Lead at ArtsPool, a worker and member-owned cooperative that provides shared administrative services for New York arts nonprofits.

For what projects/services did your company hire Def Method, and what were your goals?

Our business relies on a high level of systemization and standardization so that we are completing processes in the same way for each of our members. Our engagement with Def Method allowed us to intake data related to grant applications and new hires in a standardized way and to automatically or manually apply a series of preset workflows to new and existing tasks in the system.

How did you select this vendor and what were the deciding factors?

I have a relationship with the founder Joe Leo going to back to the time when he was my TA in a study group at General Assembly. Joe and I share many values, and Joe is one of the smartest developers that I know, so I have absolute trust in the developers that he hires.

He and his developers have not only helped us grow our web application's functionality as our needs have grown, but have also served as important mentors for my own growth as a developer. This added value, and the ability of Def Method to really understand our business, played a big part in our decision to use them.

Describe the scope of work in detail, including the project steps, key deliverables, and technologies used.

Def Method built us several web forms to intake new hire and grant application data and a system for creating and applying standard workflows to tasks in our systems. The technologies used were Ruby on Rails with a little bit of Javascript mixed in.

How many people from the vendor's team worked with you, and what were their positions?

Three people worked on the project: a senior developer in NYC, a junior developer based in Ukraine, and a project manager based in NYC.

Can you share any measurable outcomes of the project or general feedback about the deliverables?

The web forms have been very transformative in streamlining how we intake tasks in a structured way. The majority of work is now coming in via web forms and routed to the correct person with minimal effort rather than coming in via email and having to be routed manually.

Describe their project management style, including communication tools and timeliness.

Def Method follows many standard agile development practices. We did an iteration planning meeting each week, a short stand up each day, and a weekly retrospective. We mostly worked remotely though they welcomed me to work on site at their office whenever I wanted. They were always very communicative and timely.

What did you find most impressive or unique about this company?

They really take the time to understand the business and the feature requirements. I also think that Def Method hires developers who have a high degree of empathy and are good humans, which results in both a better product design and a better client experience.

Are there any areas for improvement or something they could have done differently?

No. I love Def Method and will probably never use another company.

Introduce your business and what you do there.

I’m the VP of a small startup at Wal-Mart.

What challenge were you trying to address with Def Method?

We were looking to augment our staff.

What was the scope of their involvement?

Def Method has been helping us hire product managers to support our team, and they’re also responsible for writing requirements, organizing the work for engineers, among other things.

What is the team composition?

We’ve been working with just one product manager they provided.

How did you come to work with Def Method?

They were referred to us, and we decided on working with them. 

How much have you invested with them?

We’ve spent around $1.5 million–$2 million with them so far.

What is the status of this engagement?

We’ve been working together since January 2015, and the engagement is ongoing.

What evidence can you share that demonstrates the impact of the engagement?

I’ve been pleased with their work — they’ve been good partners. They listen to our feedback, so we’ve had a great relationship.

How did Def Method perform from a project management standpoint?

They’re great; we usually communicate via email and Zoom.

What did you find most impressive about them?

They listen to us and have a quality team — I’m genuinely happy with the people we’ve been working with. 

Are there any areas they could improve?

I don’t think there’s anything they can improve on — I’m proud of the work they’ve done for us. 

Any advice for potential customers?

Be clear on your requirements. 

Introduce your business and what you do there.

I’m an archivist at a broadcast media company.

What challenge were you trying to address with Def Method?

We run a SQL database in the archives, and we needed someone to help us host it on a new server because the people in the radio stations couldn’t run it anymore.

What was the scope of their involvement?

The project involves two aspects: migrating the old database we had in the Amazon cloud to a new server, which was the bulk of the job. The other part is assistance with the ongoing maintenance of the database they migrated for us.

What is the team composition?

We’ve been working mainly with Stephen (Senior Software Engineer) and Paul (CTO).

How did you come to work with Def Method?

The team that we used to take care of the database worked with them and suggested Def Method to help us with a new hosting service.

How much have you invested with them?

We’ve spent $60,000 with them so far.

What is the status of this engagement?

We started working together in March 2020, and the engagement is ongoing.

What evidence can you share that demonstrates the impact of the engagement?

We’ve been satisfied with their service. 

How did Def Method perform from a project management standpoint?

Recently, the response seems a little slower than before because Def Method assigned someone else to take care of our project, but generally, they’ve been good. 

Are there any areas they could improve?

We ask them for additional assistance with restoring some data that we lost. They ended up not being able to help us, but they charged us for their time — it felt that they should’ve expressed that at the beginning. They could provide an estimate at the beginning of the project to avoid misunderstandings. 

Introduce your business and what you do there.

I’m the executive director and COO of a group of investors called New York Angels.

What challenge were you trying to address with Def Method?

Our large group of 130 investors needed to collectively and efficiently indicate which deals they wanted to move forward with after the screening process, so we wanted to facilitate a method of voting. We also wanted to use this method to collect feedback for the companies that participated in the screening process. We brought in Def Method to help us out.

What was the scope of their involvement?

We had a web app that had been previously developed in a sandbox. It was doing what we wanted it to do albeit minimally. It became apparent that the tech we were working with was going to expire and that the version we were using would no longer be supported, so Def Method stepped in to upgrade our Ruby on Rails infrastructure. We sat down with the team to describe what needed to be done and what additional features we wanted for the app, and they followed through on those accordingly. 

Def Method currently does maintenance and upgrades in time for our yearly rounding up of investors. They also conduct some testing whenever they update our app.

What is the team composition?

There are usually 1–2 people working on our app: a project manager and a developer.

How did you come to work with Def Method?

The owner of Def Method bought the provider that we were previously using to update our app. I liked Def Method and decided to work with them.

How much have you invested with them?

We’ve invested a little over $10,000.

What is the status of this engagement?

We first got in touch with Def Method in October 2016. Our collaboration is ongoing.

What evidence can you share that demonstrates the impact of the engagement?

The app is easy to use and does exactly what we want it to do. It’s a very vital part of our process. Bringing opportunities to New York Angels and providing feedback to the companies that we pick is way easier for me now. 

Def Method makes sure that we have what we need and that the app performs well. They always know what’s up and coming when it comes to Ruby on Rails.

How did Def Method perform from a project management standpoint?

They’re great at communicating and their project management is effective. We mostly speak through email.

The entire discovery process was carried out effectively and they’ve managed to deliver specifically what we wanted. They also gave us a good idea of how they would achieve our needs, asking us questions along the way.

What did you find most impressive about them?

Def Method knows that they’re dealing with people who aren’t technically knowledgeable, so they always tell me what’s going to happen during updates. They even suggest what good features we could add to the app and which won’t be necessary.

They’re honest and transparent when it comes to what we need to do, which helps us deal with our budget effectively. I have no reason to question Def Method; I trust that they’re not going to add anything we don’t need.

Are there any areas they could improve?

There's nothing that I can think of. I think Def Method is great and very loyal to their customers. I love working with them.

Do you have any advice for potential customers?

Know exactly what it is that you want to accomplish and be prepared to articulate your goals. Be open-minded to Def Method’s suggestions because their team always knows a better way to create a better product. They are really dedicated to doing what’s best for their customers.

What challenge were you trying to address with Def Method?

We were building a piece of technology to help us collect data from large-scale events that we attend.

What was the scope of their involvement?

Def Method developed our web app, executing the project from design through development. They’re still supporting the platform too. We use the app at conferences to gather data. For example, we deployed the platform at a partner’s conferences. There, we presented our product’s URL and any attendees who accessed it could invest in the startups that had booths at the event. The product enabled the conference owner to get attendees to engage with the startups. We also got really good data from the participants.

What is the team composition?

The CEO was involved throughout the process but also assigned a project manager who was absolutely amazing.

How did you come to work with Def Method?

We met through a mutual colleague and Def Method was open to exploring a partnership. We had a need to execute this project and their team did so flawlessly.

How much have you invested with them?

We spent tens of thousands of dollars on the project.

What is the status of this engagement?

We started our partnership in 2018, and it’s ongoing.

What evidence can you share that demonstrates the impact of the engagement? 

We deployed this at large scale conferences with thousands of people and the system hasn’t failed. The app just works, so Def Method did a top-notch job. The solution helps us to gather data in markets where we weren’t able to do it. Their team helped us to establish credibility in the market.

How did Def Method perform from a project management standpoint?

We used a few project management tools and communicated via Slack. Their team was always accessible. Whenever there was an issue, they were available.

What did you find most impressive about them?

I liked every single person at their company. Their team’s so good that I would hire them for my organization. I really enjoyed working with them.

Are there any areas they could improve?

No, I think that they’re perfect.

Do you have any advice for potential customers?

Work with Merziyah (Senior Project Manager). She’s the best.

Introduce your business and what you do there.

When I worked with Def Method, I was with a company called Health Management Resources (HMR). I was the product manager of a new app product we were working on.

What challenge were you trying to address with Def Method?

Def Method provided development services.

What was the scope of their involvement?

Def Method developed a native iOS app for holistic wellness. The idea was that each week, users would be given seven health tasks to complete. Def Method created functionalities so that users could mark off the tasks, submit journal entries about how they did so, and see how they progressed throughout the week. They created another feature that paired active users with a partner so that they could see each other’s progress and compete or collaborate to complete all of the activities for that week together. Def Method also developed a web-based admin backend that is like a content management portal.

We actually began the collaboration while the concept was still a bit fuzzy, so they ran us through a design sprint. I also contracted with a design firm, and I managed them preparing all of the high-fidelity mockups. The design firm then collaborated with Def Method to implement them.

Def Method then did a technical discovery process and began to map out the architecture, database, and various elements of the app. We moved into a development period of about six months, during which we had 1–2 full-time developers building the app and releasing the initial versions. They’re currently on a maintenance contract to keep the app up and running. 

What is the team composition?

My day-to-day contact was Merziyah (Project Manager, Def Method). Over the six months of development, we worked with three different developers on the project. Paul (Principal Engineer, Def Method) was our architecture consultant, so he came in and out. Julia (COO, Def Method) was involved from a strategy standpoint and led the design sprint. She also came in at various points to run working sessions; she came to Boston once. She was always available if I needed her for strategy questions. 

How did you come to work with Def Method?

I was talking with a few product consultants about finding someone who could be really iterative, flexible, and helpful with an MVP of a brand-new concept, and one of them recommended Def Method. 

I reached out to Joe (Founder & CEO, Def Method) and really liked him based on our first conversation. He’s a fantastic guy and seemed to get where we were and what we would need in a partner, like lots of flexibility, transparency, and control over decisions. I mostly chose them because I had the impression that they would be really iterative and collaborative.

How much have you invested with them?

Last year, the company spent around $300,000.

What is the status of this engagement?

My former company began working with Def Method in March 2019, and their work together is ongoing. I joined a different company about a month ago.

What evidence can you share that demonstrates the impact of the engagement?

We had a really low crash report, and the app was super stable and not very buggy; it functioned very well from the beginning. It was an MVP in terms of limited functionality but not in terms of being difficult to use, which was great. I believe we acquired 3,000 users in December, so we had pretty good conversion and new user acquisition rates. Anecdotally, we heard from a few people who would send us feature suggestions and often end their email by thanking us for making a really good app.

I think it would have been a much different experience if I hadn't worked with them. They made it a total joy, and I could just focus on listening to users and figuring out what to do next because they were great about getting stuff done and implementing things.

How did Def Method perform from a project management standpoint?

They were awesome in this regard. Their dedicated product person was great about being a strategic collaborator and thought partner to me; as I was trying to make decisions about upcoming features, what to prioritize, or how to implement different things, they were always available to bat around ideas and bring their expertise to the table.

Their process was very transparent and slick. I always knew where things were; I never felt like I didn’t have a clear line of sight into how things were going. Their developers were wonderful, super smart, top-notch people. They all seemed to love to learn and dig into new challenges. I liked being around them and actually ended up going to their office a bunch of times. They did a great job of coming up with fresh solutions for the ways that things would function. How they pulled in content was really slick, and both their front- and backends were awesome. The user-pairing feature was a pretty difficult feature to implement, but Yisselda (Software Engineer & Consultant, Def Method) made it look easy. She was super sharp and came up with great solutions. 

In terms of project management tools, we used Jira. The way that we collaborated through Jira was really good. We communicated via Slack and then had Google or Zoom calls for most of our daily standups. We also had an initial planning meeting at the beginning of every week, and then sometimes a grooming meeting mid-week to review upcoming things. 

What did you find most impressive about them?

I was essentially doing a skunkworks project that people in my organization weren’t necessarily brought into. One of the things I appreciated most was that Def Method understood the product vision, bought into it, and became a great partner to me. Beginning with the discovery process, they had engineers who were great about jumping in and even doing some rough sketches from a developer’s perspective. They made decisions about the way they implemented solutions based on the product vision. Having that higher-level strategic view combined with the technical skills to get it done was very appreciated.

Before we worked together, I didn’t realize how well they’d understand the product vision or what strong collaborators they’d be. Each of the developers knew how to make decisions that reflected the user insights and supported the product vision throughout.

Are there any areas they could improve?

I don’t think their mobile app development bench is that deep. We had one developer for a month who was super fresh to it, and that didn’t go too well because it was his first mobile app project. I think that making sure that they have the right number of people with the correct range of skills for the projects that they’re getting is an area they could improve.

Any advice for potential customers?

I would definitely recommend them to anyone. In the beginning, it took a little bit to understand what my responsibilities were versus theirs, and where the collaboration intersected or overlapped, but I feel like that just depends on the relationship. They’re probably flexible enough to be able to fit into whatever process the client wants. However, I think it’s better if their clients are hands-on. We were doing all of our own testing and accepting every story, and I think you’d actually be missing out on value if you were too hands-off. I was happy that we worked side-by-side on everything.  

Introduce your business and what you do there.

I’m the founder and primary product manager at Mentorflo. We’re a startup that creates software to improve operational efficiency for law firms and corporations.

What challenge were you trying to address with Def Method?

We wanted to create an MVP version of our software that we could share with clients, allowing them to play with the system outside of our controlled demonstrations. Internally, we’d already developed wireframes, a working prototype, and an InVision deck, so we needed a vendor to build out the platform.

What was the scope of their involvement?

We started with a brainstorming session. We shared all of the design work we’d done internally with Def Method, then worked with them to confirm our UX/UI ideas, establish goals, and set priorities. We took their feedback and eventually settled on a final design, and then they built out the MVP. Once it was finished, we showed the platform to potential clients, and the Def Method team is working to incorporate their feedback. They’re currently revamping the architecture and building more layers to the software.

Def Method’s role goes beyond development assistance. Their team helped us launch the product on the market. They established, and continue to help us navigate, relationships with other vendors. They created content to support both our marketing and onboarding efforts, building a collection of style guides and tutorials. We look to the Def Method team for any of our development and branding needs. Basically, they act as a sounding board for all of our questions.

What is the team composition?

I’m in contact with a total of about seven people, including a project manager. I’m not sure how many team members work behind the scenes.

How did you come to work with Def Method?

We looked into several service providers in New York. I’d previously worked with a number of different vendors for specific stages of our business growth, so I considered a few of those in addition to other recommendations. I met with Def Method, and they were fantastic. They seemed perfectly suited for what we wanted to do.

How much have you invested with them?

So far, we’ve spent approximately $50,000.

What is the status of this engagement?

We started working together in February 2018, and it’s an ongoing project.

What evidence can you share that demonstrates the impact of the engagement?

We’ve just recently released the MVP, and there haven’t been any issues or bugs so far. Def Method’s work is very stable—it’s withstood both internal and user testing.

Having worked with several different agencies, Def Method stands out for the quality of their guidance and advice regarding important business decisions. They’re very aware of our budget restraints and propose cost-effective solutions that accomplish our goals. Often, their alternative ideas are much better than our original plans.

How did Def Method perform from a project management standpoint?

Their team is very responsive. I can expect prompt replies at any time of the day. We have weekly standups while were in the development phase of a project, but they routinely update me on their progress all the time.

Their team’s management is on top of every aspect of the project, and they’re very trustworthy. They really take the time to understand our goals and guide us in the right direction. Additionally, the managers make sure every team member prioritizes overarching project goals, rather than simply completing their specific tasks. Their assistance has not only been helpful from a development standpoint but also a business perspective.

What did you find most impressive about them?

Def Method has really taken the time to understand what we want to accomplish, so I trust their business guidance. They’re a much more valuable partner than some of the more engineering-focused or design-centric shops. Their team has a good level of technical skill, but they’re also capable of providing valuable business insight. I could tell the Def Method team was committed to helping me reach my goals.

Are there any areas they could improve?

No, I can’t think of anything.

Any advice for potential customers?

I recommend clients research and speak with a variety of development shops, then narrow their choice according to their specific needs. In my experience, Def Method helped me turn an idea that I’d been working on for years into something better than I could have imagined. Their empathy and business acumen are two of their key strengths.

Introduce your business and what you do there.

I’m the CEO and co-founder of a wearable medical device company.

What challenge were you trying to address with Def Method?

We hired Def Method to help us develop our mobile apps for both iOS and Android devices.

What was the scope of their involvement?

Our in-house team provided the designs for the mock-ups and screens to Def Method. They used their team of mobile developers to create two separate apps for iOS and Android, respectively. They submitted everything to us for testing and helped us launch to the App Store.

What is the team composition?

They provided a project manager, a project developer, and two iOS and two Android developers.

How did you come to work with Def Method?

We compiled several quotes from companies we found online. We used a specific mailing list of founders primarily based in New York and one member recommended Def Method for the project.

How much have you invested with them?

We’ve spent under $80,000 on the project.

What is the status of this engagement?

We worked together from January–April 2017 on the bulk of the project. They still provide service for small feature additions and updates when needed.

What evidence can you share that demonstrates the impact of the engagement?

The app has functioned perfectly for our users. Def Method developed it to match the expectations we set.

How did Def Method perform from a project management standpoint?

They were easy to work with. The project manager handled bi-weekly check-ins, but we also had regular communication with the developers. The lead kept the project on track and helped us adhere to timelines and requirements. Their team was included in our work Slack channels so they could ask for clarifications whenever.

What did you find most impressive about them?

The ease of communication and quality of work made Def Method especially valuable. They ran a well-oiled operation and we had no complaints. Though they weren’t the least expensive option, the final product was worth it.

Are there any areas they could improve?

Because we had our own in-house design team and communication channels, we can’t speak to how effective Def Method would be in other situations. However, for us, the process worked perfectly.

Introduce your business and what you do there.

I'm the founder and CEO of Agnes intelligence, which is an artificial intelligence company. 

What challenge were you trying to address with Def Method?

We hired Def Method to create the initial design and prototype for our product.

What was the scope of their involvement?

During the product discovery, they helped us figure out exactly what we were building. Once they formulated the MVP, they built out the actual prototype. I knew that I wanted to use a specific concept-clustering algorithm that works on text or spoken word. It takes a massive pile of unstructured data, whether that's emails or phone calls, and clusters the results by the concept. It enables users to perform sophisticated data operations and simplifies the process of document review for professionals like lawyers. 

Using the design thinking process, we met together in the same room for three days with Post-It notes. Def Method is very skilled at drawing out a founder's exact vision and packaging it in a way that can be built and demonstrated. I've worked with numerous vendors, and Def Method is far and away the best in this space. 

As a cloud-based web application, our product will include both a mobile and a desktop application version. The deliverable they produced during this engagement was a skinny prototype. At the moment we're still in the development stage. Once I have the funding, I'll hire them to complete much more of the process. 

What is the team composition? 

Back when we were building the prototype, we worked with three engineers from the team. We had one main point of contact, but regarding customer service, Joe (Founder, Def Method) is very hands on. As a customer, I always felt comfortable calling his cell phone and could get right in touch with the founder if I needed. I really appreciated this element, which not all companies offer. 

How did you come to work with Def Method?

One of my professional contacts referred me to Def Method. 

How much have you invested with them?

We have a hybrid cash-equity deal. The value of their services equals about $50,000–$75,000. 

What is the status of this engagement?

Our engagement began in January 2018. We’ve been working together for about three months so far. Once we get the necessary funding, we’ll continue working with Def Method. We have a whole Gantt chart of tasks we want them to handle, and I have every confidence in their team to deliver. 

What evidence can you share that demonstrates the impact of the engagement?

Our process made it very easy to assess their performance. During the multi-day product discovery process, Def Method got everyone on board with the exact product we were to build. They produced a Gantt chart and a cost estimate for the entire project. Ultimately, they delivered everything on time. To me, that's the ultimate metric of success.

Def Method has been much more than just a prototype builder or designer. They're a true partner in building a product that's not just an innovation, but a complete category changer. 

How did Def Method perform from a project management standpoint?

Concerning communication, using a third-party video chat was entirely sufficient. Holding daily standups via video calls ensured accountability.  Def Method's proactive approach distinguishes them from the competition. I never had to chase them down to make sure they were doing their job. Their team set up our meetings, and they showed up every morning to show us what they were doing. From a founder's perspective, that is exactly ideal. 

What did you find most impressive about them?

Two things stand out to me. I'm working on cutting-edge, patent-pending algorithms that have never been done before. My challenging project demands an extremely smart team, and Def Method’s extremely high-quality engineers are fully up to the task. They have the in-house expertise and capabilities to perform extremely high-end data science.

Secondly, they offer impressive and proactive customer service. They're transparent about what clients will receive from their work and when they will complete it. I always know where we stand. 

Are there any areas they could improve?

I don't have any complaints. 

Do you have any advice for potential customers?

I would advise future clients to come prepared to the first meeting. Def Method is a team of serious people. I would imagine that they expect their clients to be involved and buy into the program. Since that's what I want to do, I consider it a positive. 

Introduce your business and what you do there.

I’m the co-founder of The Scuttle, an emerging app company.

What challenge were you trying to address with Def Method?

We engaged Def Method to help develop an MVP of our app for iOS and the web.

What was the scope of their involvement?

We had already written user stories and a wireframe for the web app. Julia (Head of Strategy & Growth, Def Method) spent two days leading a focus group to narrow down our vision of the app. Once we had a scope, she recommended a team of offshore developers to develop code for our MVP. She then served as project manager of that development team. Def Method later helped with validating our app and testing it with users.

What is the team composition?

I worked primarily with Julia. I also met with Joe (President/Partnership Director, Def Method). If I ever had a question, I could call him and receive a response quickly.

How did you come to work with Def Method?

We were looking for a CTO at first, but the search was proving difficult. A friend referred Julia to me because she had founded her own app as well. I asked her for advice on finding CTOs, and she then offered Def Method’s services. I was hesitant about working with an agency—we had a bad experience with a previous—but Def Method made us feel safe and offered an open-ended contract.

What is the status of this engagement?

We worked together from July–October 2018.

What evidence can you share that demonstrates the impact of the engagement?

Def Method delivered a rough MVP that met our requirements. During development, we brought in an outside consultant to check over the developers’ code and make sure it met our standards for quality and documentation. He was particularly impressed with their code’s clarity and transparency. Unfortunately, due to external circumstances, we’ve pressed pause on our MVP to do more user testing and validation. Def Method still supports us as needed. When I needed help with a pitch deck to pitch to angel investors, they recommended another team to help me.

How did Def Method perform from a project management standpoint?

Julia kept the project organized and remained calm under pressure. She managed several projects at once in addition to ours, but she always remembered our project’s details. She also made working with an offshore development team as seamless as possible, accommodating time zone differences and languages barriers. The Def Method team was flexible in including our third-party consultant as external oversight. We had 15-minute check-ins every day and an hour-long meeting every Friday. We communicated in person and over the phone, and we kept track of progress through Pivotal Tracker.

What did you find most impressive about them?

Def Method seemed truly invested in our success and in delivering high-quality products and services. We appreciated their open-ended contract, their honesty and transparency, and their continued support after our partnership ended. The team also taught us terminology and the background knowledge we needed so we could understand how they built our product.

Are there any areas they could improve?

We would love if they had another person as competent and helpful as Julia to help her workload. However, Def Method is young and has time to build out their team.