Databricks: open-source research, turned into a data platform
When big data meant heavyweight clusters and open source meant giving the product away, a company built by Berkeley researchers around their own project looked like a hard way to build a business.
The Bet
Databricks was founded in 2013 by the researchers behind Apache Spark, an open-source engine for processing large amounts of data that started at UC Berkeley. At the time, enterprise data was dominated by heavyweight warehouses and the Hadoop ecosystem, and many investors doubted that a company built on freely available software could capture much value.
Moonshot’s bet was that the team that created the technology would understand it better than anyone, and that the move of company data to the cloud would reward a platform built for it from the start rather than adapted later.
Open source was supposed to be hard to make money from. We thought it was the fastest way to earn developers’ trust.
Moonshot’s View
We believed open source was a distribution advantage, not a giveaway. Developers who adopt a tool freely become the people who argue for it inside their companies.
We also believed data and machine learning would converge. The companies that stored their data well would be the ones able to build on it with AI, and a single platform for both could become very hard to replace.
Room for Disagreement
The skeptics had a point. Open-source businesses can struggle to charge for what users can run themselves, the incumbents in data warehousing were large and entrenched, and the big cloud providers could build competing services of their own.
We took those risks seriously. Our disagreement was with the idea that the creators of a widely used project could not build the best way to run it, and with how slowly companies were expected to move their data to the cloud.
Notable
Databricks, in brief.
- Sector
- Data + AI
- Founded
- 2013
- Founders
- Ali Ghodsi, Matei Zaharia, Ion Stoica and other creators of Apache Spark
- Moonshot backed
- Early
- The contrarian call
- Open-source research could become the enterprise data platform
- Money raised
- $25B to date
- Company value
- $190B
- Moonshot 25
- No. 3 of 25 overall
Source: money raised and company value from Caplight, as of Nov 17, 2026. View source
Pitch Moonshot
Building something the crowd doesn’t believe in yet?
Tell us in about two minutes. No warm intro needed, and every pitch is read by the team.