Everything / Data and databases / Data Engineering
Data Engineering Growing
On TutorHero's Everything Index, Data Engineering is growing on GitHub: 2.09 of every 10,000 new public repos over the last three months (2.0k a month), +290% vs a year ago. The 12-month forecast says rising (+54%). By the end of 2032, lines in the same state ended between 0.01x and 2.5x of where they started (median 0.54x).
Since 2019, and the range to 2032
New repos per 10,000 (3-month average, log scale)12-month forecastRange to 2032: middle half and 90% of past similar lines
The range is not a forecast of this line: it is what GitHub lines in the same state (more than doubled its share of new repos in a year) did 1 to 5 years later, 2019 to 2026, applied to today's level. Past 5 years it is stretched, not measured. Checked out of time (learned before 2022, scored after), 71% of outcomes landed inside the 90% range, so read it as wide. Open it in the Everything chart.
Week by week
Wikipedia views a day, last 8 weeks
New public repos with the data-engineering tag each week (Monday to Sunday, UTC). The outlined bars, last week included, are still filling in, as tags are often added days after a repo is created, so their height will grow a little. "Against the field" divides the change by what the typical tag did, so a wave that lifts every tag does not count. Hover for the numbers.
Built vs talked about
Each line is its own share (of all new GitHub repos, all Hacker News stories, all English Wikipedia views, all new stars on the repos we track), shown as a share of its own peak, so the timing and shape compare even though the units differ. Hover for the counts. Tap a name to hide or show a line.
What it means
- Worth learning now: Data Engineering is growing, +290% share of new GitHub repos vs a year ago.
- Start by reading semantica-agi/semantica (+2.1k stars in 3 months) and DataTalksClub/data-engineering-zoomcamp (+859 stars in 3 months).
- People to follow: DataTalksClub, Prefect, Airbyte.
- Getting crowded: new repos +290% but attention -13%, so each new project competes harder for stars.
- 1.00 new stars per new repo over 3 months, vs 8.50 for the typical trend: more supply than demand right now.
- The 12-month forecast for its share: +54% (Rising).
- Built more than talked about: Wikipedia -30% vs new repos +290% in a year, less talk per builder than the typical trend, so builders are ahead of the conversation.
- History: of past GitHub lines that more than doubled its share of new repos in a year, 61% had a smaller share 3 to 5 years later and 8% at least doubled.
- Attention: 0.48% of new stars on the repos we track, -13% in a year.
- Hacker News: 2 stories a month, -30% share in a year; Wikipedia 1.9k views a month, -30%.
- Not investment advice: this measures what people build on GitHub, not any company.
- Most-starred tools here lately: semantica-agi/semantica (organic stars), DataTalksClub/data-engineering-zoomcamp (organic stars).
- The field is growing, so expect new tools and fast changes; pin versions.
Repos carrying it now
People building it
DataTalksClubThe place to talk about dataInfluence 74
PrefectWorkflow orchestration and data pipeline frameworks in Python.Influence 43
AirbyteOpen source data replication platform and context layer for AI agents.Influence 28
jddevtimejddevtimeInfluence 18
Gyan Prakash@flipkart | Ex-@zomato | AI & Data Science | Quant Finance | NSITInfluence 37
KestraBuild reliable workflows, blazingly fast, deploy in just a few clicks.Influence 65
Tom OwersGilbert09Influence 36
Jingbo ChaiBuilds AI agents for research, gaming, and emergency preparedness.Influence 29More in Data and databases
Questions
Is Data Engineering growing on GitHub?
Yes. Its share of all new public GitHub repos is +290% vs a year ago and +19% over the last three months (Sep 2026). Phase: Growing.
How many new Data Engineering repos are created each month?
About 2.0k new public repos a month carry the data-engineering tag (three-month average to Sep 2026), or 2.09 of every 10,000 new repos.
What will Data Engineering look like in 2032?
Nobody knows, and we say how much. Of past GitHub lines that more than doubled its share of new repos in a year, the middle half had between 0.14x and 1.27x of their share 3 to 5 years later, and 61% ended smaller.
Is Data Engineering more talked about than built?
Built more than talked about. Over the year its share of Wikipedia views moved -30% while its share of new GitHub repos moved +290%. New repos grew faster than talk for most AI trends this year, so the label compares it with the typical trend: about 1/1.5 of the talk per builder of the median trend.
Not investment advice. Measurements of what people build and star on GitHub, a statistical forecast, base rates and a model's reading of them. Nothing here is about any company's revenue, valuation or stock.