Reddit scraper in Python
You can scrape Reddit with Python in a few lines using requests. A single GET call returns posts as JSON, so you have no HTML to parse and no PRAW app to register.

The job
Most Python Reddit scrapers are one of two things: a PRAW script that needs an approved app, or a requests plus BeautifulSoup script that breaks whenever the page changes. This route avoids both. You call an endpoint and read the fields.
Page through results with the cursor each response returns. Save the id of the newest post you saw, and a scheduled run will only read posts newer than that. For background on the options, see how to scrape Reddit.
How it works
Install requests
pip install requests. Nothing else needs installing.Call the endpoint
Send a GET to
/v1/reddit/scrapewith the subreddit in the query and your key in theAuthorizationheader. The exact code is in the Python tab below.Page and save
Keep looping while the response has a
nextCursor, then write the rows to CSV with pandas or the standardcsvmodule.
Endpoints that do it
| Endpoint | What it's for | Credits |
|---|---|---|
| Get a postGET /v1/reddit/posts/{id} | Posts from a subreddit, for bulk collection. | 2 credits |
| Search postsGET /v1/reddit/search | Posts by keyword. | 2 credits |
| Get a thread with commentsGET /v1/reddit/threads/{id} | A post with its comments. | 3 credits |
Free tools for the same job
Try the job in a browser first. These tools call the same endpoints, and you don't need a key or any code.
The Python call and its response
The code is in the Python tab. The response below was recorded from a real call.
curl "https://api.chatterapi.com/v1/reddit/posts/1wdihhj" \
-H "Authorization: Bearer $CHATTERAPI_KEY"{
"data": {
"id": "1wdihhj",
"fullname": "t3_1wdihhj",
"title": "What CRM should a small business use?",
"body": "We’re a small B2B business with 6 people and sales is still pretty founder led, but revenue has grown enough that keeping leads, follow ups and customer conversations spread across spreadsheets and inboxes is starting to…",
"author": "NotedWhisky",
"subreddit": "CRM",
"permalink": "/r/CRM/comments/1wdihhj/what_crm_should_a_small_business_use/",
"url": "https://www.reddit.com/r/CRM/comments/1wdihhj/what_crm_should_a_small_business_use/",
"externalUrl": null,
"score": 52,
"numComments": 186,
"upvoteRatio": 0.96,
"createdAt": "2026-09-11T14:52:16.000Z",
"nsfw": false,
"locked": false,
"media": null
}
}Recorded from a live call on . Long text is shortened and the cursor is cut. A live key is charged 2 credits for this call. A test key returns this same sample for 0 credits.
What it won't do
- Only public posts and comments come back.
- Your plan's requests per second cap how fast a large crawl can run.
- Follow Reddit's content rules and your own data policy.
Questions
Do I still need PRAW?
requests works.How do I get more than one page?
nextCursor from each response into the next call, and stop when it comes back empty.