At Speedinvest Network Effects, we invest in business models with network effects. Every year we search for 8–10 needles in the haystack — startups with the extra bit of potential vs. the countless other great companies we look at. Picking the winners can be a challenge with so many visionary founders out there. Many have promising business ideas and know how to pitch their start-up well. Hence, we often become excited about multiple investment opportunities in parallel. Yet, we have to ensure that our thinking is not only guided by subjective feelings but a disciplined, systematic approach. This is where our Startup Scorecard comes in handy. You can run through it in this Typeform or download it as an Excel File. The scorecard is an attempt to:
This article introduces our scorecard to
The scorecard consists of the 11 assessment dimensions displayed above: Value proposition, Defensibility, Network Effects, Market, Competition, Monetisation, Traction, Engagement, Unit Economics, Team, Investment Case. When we evaluate a shortlisted company with the scorecard, we attribute a certain number of points to each assessment dimension. The maximum number of points is 65 points.
Creating a comprehensive scorecard is a challenging, if not impossible, task because you have to make a trade-off between universal applicability and the level of depth of the tool. Moreover, the approach of applying objective and quantifiable assessment criteria has obvious limitations (e.g. when it comes to evaluating the product or the team). One last disclaimer: we have only recently developed the tool and so far, it has just been tested with a few dozen companies in our deal flow. What we know for certain is that it works best for typical marketplaces that already have some traction ( a typical stage for companies we invest in). For other businesses, (e.g., pre-seed stage companies, businesses with network effects but no marketplace), some evaluation criteria may not always be applicable.
After all, this will certainly not be the last iteration of the scorecard — in fact, we are very curious to get your feedback on how to tweak and improve it.
Remark: The terms “marketplace”, “platform” and “business with network effects” are used interchangeably in this text
These are, in our view, considered to be the “hygiene factors” of any marketplace or network effects-driven business. These are the “must-haves” in order to make it into our short list. Most importantly, a marketplace has to offer (1) great quality of supply. No customer will buy in a marketplace if the supply is questionable or if better products can be found elsewhere (all else equal). It is also an excellent way of breaking into a market through a niche early on. The same is the case if the website does not enable an (2) intuitive user journey. Today’s users expect instant gratification. If they cannot find what they want easily or if they have problems maneuvering the categories, they will abandon the product and likely churn persistently. Next, the marketplace has to (3) facilitate trust. Users need to feel it is safe to transact through the website. The combination of these three factors, sometimes also referred to as the three pillars of marketplace success, have to result in a (4) new or much better user experience vs. the status quo. As Bill Gurley explains in one of his blog posts: “Great marketplaces do not simply aggregate a market; they enhance it. They leverage the connective tissue to offer the consumer a user experience that simply was not possible before the arrival of this new intermediary”. At the same time, the marketplace should also provide an (5) economic advantage to its users: the service becomes much cheaper for the customer (demand side) and/or the sellers (supply side) earn more money. Finally, whilst a start-up can claim that their marketplace meets all these requirements, we look for some extra validation and check if we can get (6) positive supplier and customer references.
A marketplace startup looking for seed-funding should check all these 6 boxes. If that is the case we attribute one point in our scorecard — not more because meeting these criteria is simply a hygiene factor Now you might think: What about a start-up that is pre-seed and has not launched the business yet? Well, then obviously it cannot fulfill all the criteria. It will just get one point less in the scorecard because it still has to prove it can make it.
When we analyze a marketplace business, we look for a number of indicators for future defensibility of the business, each worth one point in our scorecard.
You might wonder why the list above excludes network effects. It is because they are an inherent feature of all marketplaces, with varying strength. Network effects are so important to our investment hypothesis, that we have covered them as a separate section of the scorecard.
How do you measure network effects? This is a question that can be debated at length. There is no obvious answer. However, we believe that by combining different type of network effects you can create even stronger network effects (for a more theoretical deep-dive on different types of network effects, we recommend reading this great article by Nfx). Moreover, there are some good indicators for the strength of network effects, like a high “buyer equals seller” ratio. We value each of the points listed below with one point in the scorecard.
Similar to any other VC investor, we love startups that tackle big problems in huge markets. Ideally, the companies we invest in have a total addressable market (TAM) of more than 50 billion euro (this will yield the max score of 5 points in our scorecard). However, many companies we see address a much smaller market. We cannot consider all of them, because, like most other VCs, we need to invest in startups which can, at a successful exit, at least return the entire fund. In our view, a TAM as low as 1–2 bn Euros can still yield a large enough financial outcome provided that a) the company’s take rate is high and b) it has the potential to capture significant market share. Yet, we would be very careful investing in a business with such a small TAM, since it will have a much harder time attracting follow-on funding from bigger funds with higher TAM requirements.
Some start-ups create businesses in markets that have not existed before or, they unlock shadow markets (like Uber and Airbnb did). In these cases, TAM might be well below 1bn dollars. We would consider an investment in startups addressing such markets if we are convinced that the market size can grow to multi-billion dollars within a reasonable timeframe (of 5 to 7 years). As the cases of Uber and Airbnb show, new or unlocked shadow markets can actually be extremely attractive. On the other hand, Google made a big bet that Google Glass would open up a new market, but we have yet to see this materialize. We allocate three points to startups opening up new, not yet existing markets with a significant potential market size (10bn plus to justify the additional risk).
Market growth is another important factor to determine the attractiveness of a market. Markets that grow faster than 5% annually get an extra point on our scorecard. Shrinking markets get a minus point.
Another aspect to consider is the fragmentation of a market on the supplier- as well as the buyer-side. The more fragmented a market is, the more value-add a marketplace can provide. In markets with too little fragmentation, individual market participants can gain too much power and dictate terms. Moreover, bypassing becomes a serious risk. It is hard to find a universal threshold when a market is enough fragmented. Generally, we hope to see several hundred or even thousands of suppliers and ten thousands of customers. At the same time, it is important to look at transactions at an individual level. In our view, if there are usually at least 10 potentially relevant transaction partners for both buyers and suppliers, no individual player has too much power and bypassing becomes quite cumbersome. Which buyer wants to write emails back and forth with 10 suppliers? If there are less than 10 relevant transaction partners, we give a minus point (and might not invest at all).
We prefer to back startups that have no competitors with a similar business model yet (3 points in our scorecard), at least not in Europe. As you might have noticed, we have already valued “first mover advantages” in the section on defensibility. We feel that overweighting this point is justified due to the large benefits associated with being a first mover.
We do, of course, evaluate startups that have to face competitors with similar business models and similar funding (we then give 2 points) or even better funding (1 point). The positive side of competition is that it is a good indicator that the market is attractive. Being late just makes it harder to be successful, although sometimes there also some late mover advantages, e.g. less product validation is required.
Marketplaces have entirely different revenue margins. Most marketplaces monetize mainly through a “commission model”. In his classic blog post, A Rake Too Far: Optimal Platform Pricing Strategy, Billy Gurley presents a handy table comparing the take rates of several successful marketplaces. Here you can see that a company like Open Table can thrive with a take rate as low as 2%, whilst image platforms like Shutterstock manage to take a 70% cut from each transaction. However, all things being equal, the higher the revenue margin of a platform, the better. That’s why in our scorecard we give 3 points to platforms with a revenue margin of more than 25% and fewer points for lower margins.
In general, it is also easier for a marketplace to become successful when the purchasing (or usage) frequency is high. Customers are more engaged and keep the product on top of their mind. We give one extra point for a marketplace with at least medium purchasing or usage frequency — which we have defined as a marketplace that is relevant for the customer at least once per month.
Another extra point is given when a marketplace has the potential to develop several different monetization options, e.g. commission, listing fee, add-on services, advertisement (more on this here). More monetization options mean greater pricing flexibility for a platform and a higher likelihood of extracting the maximum amount of value (i.e. take rate) in the long-term.
When we talk about traction, different metrics make sense for different types of businesses at different stages. Usually, we are interested in Gross Merchandise Volume (GMV) growth. However, there are certain businesses with network effects for which user growth matters much more than GMV in the early stages of the company life, e.g. social networks. In the scorecard, we always take into an account and evaluate the most meaningful metric.
We also differentiate regarding the evaluation period (i.e. timeframe). If a company has been on the market for more than a year, we look at GMV growth in the last 12 months. We give a top score of 5 points if GMV has grown by more than 5x. Anything above 3x yearly growth means the company is on track to follow the mantra of “Triple, triple, double, double, double” (T2T3), coined by Neeraj Agrawal from Battery Ventures. T2T3 should be the ambition level of every startup that wants to become a billion-dollar company.
As a seed investor, we get many pitch decks from companies, that have been on the market for less than 12 months. In these cases, we cannot calculate a year-on-year growth-multiple. Instead, we take the startups compound monthly growth rate of the last 4 months. Doing so only makes sense if in month one of the evaluation period GMV has crossed a minimum threshold of at least 10k EUR or USD. Otherwise, we look at a base figure so low that the calculated growth rate is artificially inflated and hence meaningless.
There is yet another situation where we would only consider the most recent months of growth even if a start-up has been on the market for one year or more. That situation is given when a startup has recently pivoted and is gaining traction rapidly due to the changes in strategy.
Often, user engagement is a superior indicator of success than financial traction for early stage marketplace companies. There are several ways to measure user engagement. Tracking purchasing frequency is one of them, but a KPI like the number of repeat purchases is just of limited value. What qualifies as a high or low number, is totally depended on the business model.
We have therefore decided to measure engagement by looking at the share of wallet. Let’s take a marketplace for catering services as an example. Here, we would look at how much of the catering order volume of the customer is funneled through the platform after the first transaction. We give a max score of 4 points if more than 80% of the customer’s order volume is captured by the platform after becoming a customer.
A great indicator of early product-market-fit is the emergence of power users. Power users can also help a startup to understand in which direction to develop their product and strategy. For the sake of the scorecard, we assume that a power user is someone who spends more money or time on the platform than he did before on this specific use case. A power user of a catering marketplace, for example, would be a company that orders catering more often than it did before using the services of the marketplace. The scorecard honors the emergence of power users with one extra point.
When analyzing the unit economics of a startup, it is important to differentiate whether the business is by nature a business with recurring revenues (e.g. a subscription business) or mostly non-recurring revenues (e.g. a platform for buying houses).
If it is a “natural retention business” we analyze the ratio of customer lifetime value (CLTV) vs. “fully loaded” customer acquisition costs (CAC). CLTV is calculated as follows:
Average revenue per transaction x gross margin x the average number of transactions per customer over its entire (average) lifetime.
Fully loaded CAC should include all costs to convert a (new) customer, including performance marketing, attributable sales costs, attributable customer success costs, and other marketing costs. When talking about unit economics with startups, we often hear very bold assumptions regarding customer retention, resulting in an inflated CLTV. To be on the safe side, we assume a customer lifetime cut-off point of 18 months for B2C-businesses and 36 months for B2B-business (reflecting the often longer-enduring business relationships in B2B-businesses).
If revenues of the business are not recurring on a regular basis, but only once or every other year, we instead analyze gross margin vs. costs per order (CPO). We hence assume that a customer has to be newly acquired for each purchase and it is absolutely essential that the business is first order profitable.
As a rule of thumb, we would like to see a CLTV vs. CAC ratio or, alternatively, a gross margin vs. CPO-ratio of at least 3 to 1. For a ratio above 4 to 1, we give a top score of 3. In the case that unit economics are not yet existent we work with estimations and make our own predictions to test whether a healthy ratio is achievable at all for the company in question.
Customer retention of businesses with recurring revenues is often hard to predict, especially at a very early stage of a company. Therefore, we look at another KPI that is usually easier to determine: the payback period. The payback period stands for the time it takes to recoup the customer acquisition costs. Customers with non-recurring revenue should always be first order profitable. B2C businesses with recurring revenues get an extra point if the payback time is less than 6 months, B2B businesses get an extra point if the payback is less than 12 months. Companies with recurring businesses who are first order profitable receive an additional extra point.
Lastly, we want to be confident that the customer and supplier acquisition strategy is scalable. In order to do that we need to look at the different acquisition channels and their dynamics. Optimally, the company has found at least one organic acquisition channel that can fuel growth in the long run. If paid marketing is the main customer acquisition strategy, we try to evaluate if CAC will remain at an attractive level whilst increasing marketing spend.
William A. Sahlman of Harvard Business School has well summarized a common mentality amongst investors: “When I receive a business plan, I always read the résumé section first. Not because the people part of the new venture is most important, but because without the right team, none of the other parts really matter”.
We could not agree more, so we overweighted the “Team” section in our scorecard. Teams are being assessed along 12 success factors of exceptional founder-teams. One point is given for every success factor that is met.
Even if our assessment makes us very bullish about a company and its team the investment round still has to make sense from an economic perspective. In our scorecard, we give a point each if the subsequent criteria are fulfilled:
That’s it. We have now gone through the entire scorecard. We hope this article helps to explain our thinking around marketplaces. We also hope the scorecard serves as a useful tool for marketplace founders to evaluate how “VC ready” their business is — in our experience, most interesting marketplace start-ups have a score of at least 30.
Again, please do not hesitate to reach out to let us hear your thoughts on this. Happy also to discuss during the marketplace conference that we organize on the 28th of November in Berlin — make sure to get some tickets before they are sold out.
Authored by Philip Specht, a member of the Speedinvest Network Effects team, with contributions from Mathias Ockenfels, Jeroen Arts and Krishan Allen. The team invests in SaaS-enabled platforms and marketplaces and other Network Effects-driven businesses where the value of a product increases with every new user. Enabled by new technologies in areas we cannot even imagine today, the team believes these are the businesses that will continue to revolutionize the world.
Sign-up to get the latest Speedinvest news, insights and resources right in your inbox.
If you’re especially interested in all things Network Effects, platforms and marketplaces, sign-up for the Marketplace Snippet.