A Map for Studying Pre-training in LLMs
- Data Collection
- General Text Data
- Specialized Data
- Data Preprocessing
- Quality Filtering
- Deduplication
TRISHA SHARMA us107
🎯
ritwikraha
/ Pretraining-LLM.md
Last active
December 13, 2025 21:43
Pretraining of Large Language Models