The Pile Diverse English-language training corpus combining multiple text sources, with replication code and documentation supporting language modeling research and dataset analysis.
Visit productCosigns Received
Be the first Cosign
Put your name behind The Pile.
Add it to your Products I use list and share why you use it.