HuggingFaceFW/fineweb
Viewer
β’
Updated
β’
25B
β’
313k
β’
2.03k
π LLM pretraining datasets
A collection of datasets for LLM pretraining
-
HuggingFaceFW/fineweb-2
Viewer β’ Updated β’ 12.5B β’ 75.9k β’ 446Note π· Web datasets
-
HuggingFaceFW/fineweb-edu
Viewer β’ Updated β’ 3.3B β’ 516k β’ 649
mlfoundations/dclm-baseline-1.0
Preview β’ Updated β’ 355k β’ 209Note π Highly curated web datasets filtered using classifiers
HuggingFaceTB/finemath
Viewer β’ Updated β’ 48.3M β’ 10.6k β’ 292Note π Highly curated math pages from CommonCrawl
-
bigcode/the-stack
Viewer β’ Updated β’ 546M β’ 10.1k β’ 779
bigcode/the-stack-v2
Viewer β’ Updated β’ 5.45B β’ 4.57k β’ 341Note π» Github code dataset
HuggingFaceTB/cosmopedia
Viewer β’ Updated β’ 31.1M β’ 26.8k β’ 592Note Synthetic textbooks
HuggingFaceTB/smollm-corpus
Viewer β’ Updated β’ 237M β’ 12.4k β’ 311Note Contains Cosmopedia v2 (synthetic textbooks) and Python-Edu (educational Python code)