Subreddit comments/submissions 2005-06 to 2023-12
Watchful1

folder reddit (79895 files)
filesubreddits23/Against_the_Storm_submissions.zst 1.71MB
filesubreddits23/Against_the_Storm_comments.zst 7.53MB
filesubreddits23/AgainstHinduphobia_submissions.zst 3.97MB
filesubreddits23/AgainstHinduphobia_comments.zst 1.46MB
filesubreddits23/AgainstHateSubreddits_submissions.zst 11.15MB
filesubreddits23/AgainstHateSubreddits_comments.zst 61.97MB
filesubreddits23/AgainstGamerGate_submissions.zst 1.96MB
filesubreddits23/AgainstGamerGate_comments.zst 81.68MB
filesubreddits23/AgainstDegenerateSubs_submissions.zst 2.72MB
filesubreddits23/AgainstDegenerateSubs_comments.zst 11.45MB
filesubreddits23/AgMarketplace_submissions.zst 5.73MB
filesubreddits23/AgMarketplace_comments.zst 17.66MB
filesubreddits23/AftershockFestival_submissions.zst 1.03MB
filesubreddits23/AftershockFestival_comments.zst 3.67MB
filesubreddits23/Afterpay_submissions.zst 643.89kB
filesubreddits23/Afterpay_comments.zst 2.22MB
filesubreddits23/Aftermath1231_submissions.zst 811.13kB
filesubreddits23/Aftermath1231_comments.zst 3.04MB
filesubreddits23/AfterVanced_submissions.zst 461.70kB
filesubreddits23/AfterVanced_comments.zst 2.10MB
filesubreddits23/AfterTheLoop_submissions.zst 364.19kB
filesubreddits23/AfterTheLoop_comments.zst 2.55MB
filesubreddits23/AfterTheEndFanFork_submissions.zst 6.27MB
filesubreddits23/AfterTheEndFanFork_comments.zst 13.32MB
filesubreddits23/AfterTheDance_submissions.zst 4.32MB
filesubreddits23/AfterTheDance_comments.zst 29.19MB
filesubreddits23/AfterPrisonShow_submissions.zst 7.36MB
filesubreddits23/AfterPrisonShow_comments.zst 19.13MB
filesubreddits23/AfterEffects_submissions.zst 54.46MB
filesubreddits23/AfterEffects_comments.zst 80.10MB
filesubreddits23/Afrodisiac_submissions.zst 23.44MB
filesubreddits23/Afrodisiac_comments.zst 11.52MB
filesubreddits23/Afrobull_submissions.zst 2.14MB
filesubreddits23/Afrobull_comments.zst 1.61MB
filesubreddits23/AfroQueens_submissions.zst 4.32MB
filesubreddits23/AfroQueens_comments.zst 1.14MB
filesubreddits23/AfroDeviant_submissions.zst 11.34MB
filesubreddits23/AfroDeviant_comments.zst 2.19MB
filesubreddits23/AfricanViolets_submissions.zst 4.56MB
filesubreddits23/AfricanViolets_comments.zst 6.04MB
filesubreddits23/AfricanGrey_submissions.zst 1.70MB
filesubreddits23/AfricanGrey_comments.zst 4.06MB
filesubreddits23/AfricanGoneWild_submissions.zst 8.61MB
filesubreddits23/AfricanGoneWild_comments.zst 3.11MB
filesubreddits23/AfricanDwarfFrog_submissions.zst 1.74MB
filesubreddits23/AfricanDwarfFrog_comments.zst 2.19MB
filesubreddits23/Africa_submissions.zst 19.67MB
filesubreddits23/Africa_comments.zst 25.31MB
filesubreddits23/Afghan_submissions.zst 4.35MB
Too many files! Click here to view them all.
Type: Dataset
Tags: reddit

Bibtex:
@article{,
title= {Subreddit comments/submissions 2005-06 to 2023-12},
journal= {},
author= {Watchful1},
year= {},
url= {https://www.reddit.com/r/pushshift/comments/1akrhg3/separate_dump_files_for_the_top_40k_subreddits/},
abstract= {This is the top 40,000 subreddits from reddit's history in separate files. You can use your torrent client to only download the subreddit's you're interested in.

These are from the pushshift dumps from 2005-06 to 2023-12 which can be found here https://academictorrents.com/details/7c0645c94321311bb05bd879ddee4d0eba08aaee

These are zstandard compressed ndjson files. Example python scripts for parsing the data can be found here https://github.com/Watchful1/PushshiftDumps

If you have questions, please reply to this reddit post or DM u/Watchful on reddit or respond to this post https://www.reddit.com/r/pushshift/comments/1akrhg3/separate_dump_files_for_the_top_40k_subreddits/},
keywords= {reddit},
terms= {},
license= {},
superseded= {}
}


Send Feedback