Skip to content

r/dataengineering

Data Engineering

News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.

Members
482,777
Created
2015
Posts a day
3
Avg comments, top posts this week
18

r/dataengineering is a Reddit community with 482,777 members, created in 2015. It averaged about 3 new posts a day over the last month. This week's top posts had a median score of 12 and an average of 18 comments each. Data, sql and engineering are the words that show up most in recent titles. This month's top posts went up most often around 15:00 UTC, and most often on a Monday.

Only approved members can post in r/dataengineering.

Data checked October 18, 2026 · Open on Reddit

Top posts this week

  1. 342How it feels writing SQL by hand just to prove I still can instead of using the agent149 comments · October 16, 2026
  2. 177me watching someones agent approve my PR I didn't read6 comments · October 12, 2026
  3. 72How do you find data mismatches between two large tables?44 comments · October 16, 2026
  4. 44Should I move from a snowflake environment to a fabric environment to get back to a DE role?24 comments · October 17, 2026
  5. 33built a sql practice site around data engineering concepts9 comments · October 18, 2026
  6. 32Data Team feels a bit Siloed10 comments · October 13, 2026
  7. 23Looking for a self-service AWS sandbox account solution9 comments · October 15, 2026
  8. 16Might be switching roles and cloud platforms soon. What are the main differences between GCP and AWS?10 comments · October 16, 2026
  9. 15Introducing sqlleaf: column-level lineage for any SQL dialect3 comments · October 17, 2026
  10. 11Airflow OSS vs MWAA (re-evaluating given access to LLMs)15 comments · October 12, 2026

Top posts this month

  1. 1,166Is critical thinking dead? New hire spends $20k on tokens pushing PRs226 comments · September 25, 2026
  2. 1,046I'm tired boss36 comments · September 26, 2026
  3. 434Thoughts on AI in DE After Drinking the KoolAid For 10 months88 comments · September 28, 2026
  4. 378Medallion architecture: what the business sees vs. what we deal with14 comments · October 5, 2026
  5. 362Python Polars 2.0 release19 comments · October 6, 2026
  6. 350How it feels writing SQL by hand just to prove I still can instead of using the agent149 comments · October 16, 2026
  7. 338Why is my LinkedIn feed filled with knowledge posts from 20-26 year old Indian guys who are AI experts? How are they getting so accomplished at AI?88 comments · September 28, 2026
  8. 288Are you guys still writing SQL?272 comments · October 4, 2026
  9. 202We were struggling to find Data Engineers293 comments · September 30, 2026
  10. 198After 6 months, I've finally accepted an offer. Thank you everyone.21 comments · September 22, 2026

What people ask

  1. 288Are you guys still writing SQL?272 comments · October 4, 2026
  2. 1,166Is critical thinking dead? New hire spends $20k on tokens pushing PRs226 comments · September 25, 2026
  3. 100Is dbt the red-headed stepchild to data engineers?170 comments · September 26, 2026
  4. 345How it feels writing SQL by hand just to prove I still can instead of using the agent149 comments · October 16, 2026
  5. 130Does AI struggle at data modeling?94 comments · September 23, 2026
  6. 338Why is my LinkedIn feed filled with knowledge posts from 20-26 year old Indian guys who are AI experts? How are they getting so accomplished at AI?88 comments · September 28, 2026

Common words in titles

  • data 11
  • sql 7
  • engineering 4
  • agent 3
  • code 3
  • databricks 3
  • feels 3
  • snowflake 3
  • aws 2
  • between 2
  • built 2
  • career 2

Best time to post

  • 15:00 UTC · 5 top posts
  • 16:00 UTC · 3 top posts
  • 17:00 UTC · 3 top posts
  • Monday · 8 top posts
  • Friday · 6 top posts

These are counted from the timestamps of this month's 25 top posts. They show when popular posts went up and don't guarantee reach.

Rules

  1. Don't be a jerk
  2. Search the sub & wiki before asking a question
  3. Keep it related to data engineering
  4. Limit self-promotion posts/comments to once a month
  5. No shill/opaque marketing
  6. No recruiting, solicitation, or networking posts
  7. No resume/CV, interview, or exam preparation questions
  8. No technical error/bug questions
  9. No AI generated content/text
  10. No low effort content
  11. All links are reviewed

How to post in r/dataengineering without breaking its rules

Similar subreddits

Member growth

We started recording r/dataengineering member counts on October 18, 2026. Growth will show here once we have a few weeks of history.

Get this data from the API

Every number on this page comes from ChatterAPI's Reddit endpoints and is refreshed about once a week. You can pull the same data for any subreddit from your own code or AI agent.

curl "https://chatterapi.com/v1/reddit/subreddits/dataengineering" \
  -H "Authorization: Bearer $CHATTERAPI_KEY"
{
  "data": {
    "url": "https://www.reddit.com/r/dataengineering/",
    "name": "dataengineering",
    "nsfw": false,
    "title": "Data Engineering",
    "createdAt": "2015-02-06T18:37:28.000Z",
    "description": "News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.",
    "subscribers": 482777
  },
  "credits": {
    "charged": 2
  }
}

Recorded response, October 18, 2026, trimmed.

Free subreddit stats toolAPI referenceAll subreddits we track

Questions about r/dataengineering

How many members does r/dataengineering have?
r/dataengineering had 482,777 members when we last checked on October 18, 2026.
How active is r/dataengineering?
Based on its newest posts, it got about 3 new posts a day over the last month. This week's top posts averaged 18 comments each.
When is the best time to post in r/dataengineering?
This month's top posts in r/dataengineering went up most often around 15:00 UTC, and most often on a Monday. That's when popular posts were published, so use it as a starting point, not a rule.
Can I get r/dataengineering data through an API?
Yes. Call GET /v1/reddit/subreddits/dataengineering for members, rules and description, and GET /v1/reddit/subreddits/dataengineering/posts for its posts. Each call costs 2 credits, and new accounts get 100 free credits.

Pull r/dataengineering into your code or agent.

Sign up and get 100 free credits. No card required.