Skip to content

Reddit scraper in Python

You can scrape Reddit with Python in a few lines using requests. A single GET call returns posts as JSON, so you have no HTML to parse and no PRAW app to register.

Run the scraper in your browser firstThen copy the Python code below.
Reddit scraper python: a snake-shaped paper kite flying over a field of mailboxes, each opening to hand it a small card, bright day.

The job

Most Python Reddit scrapers are one of two things: a PRAW script that needs an approved app, or a requests plus BeautifulSoup script that breaks whenever the page changes. This route avoids both. You call an endpoint and read the fields.

Page through results with the cursor each response returns. Save the id of the newest post you saw, and a scheduled run will only read posts newer than that. For background on the options, see how to scrape Reddit.

How it works

  1. Install requests

    pip install requests. Nothing else needs installing.

  2. Call the endpoint

    Send a GET to /v1/reddit/scrape with the subreddit in the query and your key in the Authorization header. The exact code is in the Python tab below.

  3. Page and save

    Keep looping while the response has a nextCursor, then write the rows to CSV with pandas or the standard csv module.

Endpoints that do it

EndpointWhat it's forCredits
Get a postGET /v1/reddit/posts/{id}Posts from a subreddit, for bulk collection.2 credits
Search postsGET /v1/reddit/searchPosts by keyword.2 credits
Get a thread with commentsGET /v1/reddit/threads/{id}A post with its comments.3 credits

Free tools for the same job

Try the job in a browser first. These tools call the same endpoints, and you don't need a key or any code.

The Python call and its response

The code is in the Python tab. The response below was recorded from a real call.

curl "https://api.chatterapi.com/v1/reddit/posts/1wdihhj" \
  -H "Authorization: Bearer $CHATTERAPI_KEY"
response, first 2 rows
{
  "data": {
    "id": "1wdihhj",
    "fullname": "t3_1wdihhj",
    "title": "What CRM should a small business use?",
    "body": "We’re a small B2B business with 6 people and sales is still pretty founder led, but revenue has grown enough that keeping leads, follow ups and customer conversations spread across spreadsheets and inboxes is starting to…",
    "author": "NotedWhisky",
    "subreddit": "CRM",
    "permalink": "/r/CRM/comments/1wdihhj/what_crm_should_a_small_business_use/",
    "url": "https://www.reddit.com/r/CRM/comments/1wdihhj/what_crm_should_a_small_business_use/",
    "externalUrl": null,
    "score": 52,
    "numComments": 186,
    "upvoteRatio": 0.96,
    "createdAt": "2026-09-11T14:52:16.000Z",
    "nsfw": false,
    "locked": false,
    "media": null
  }
}

Recorded from a live call on . Long text is shortened and the cursor is cut. A live key is charged 2 credits for this call. A test key returns this same sample for 0 credits.

What it won't do

  • Only public posts and comments come back.
  • Your plan's requests per second cap how fast a large crawl can run.
  • Follow Reddit's content rules and your own data policy.

Questions

Do I still need PRAW?
No. You don't need a Reddit app or PRAW. Plain requests works.
How do I get more than one page?
Pass the nextCursor from each response into the next call, and stop when it comes back empty.
Can I run it on a schedule?
Yes. Save the id of the last post you saw and skip anything older. See the rate limit guide.

Other languages

Build it with one API key

Try it free for 7 days with 1,000 credits.