Scaling Laws for Autoregressive Generative Modeling
- Source
- doi.org
- Published
- Oct 28, 2020
We identify empirical scaling laws for the cross-entropy loss in four domains: generative image modeling, video modeling, multimodal image$\leftrightarrow$text models, and mathematical problem solving. In all cases autoregressive Transformers smoothly impro...
Info
- Published
- Oct 28, 2020
- Uploaded
- Jul 10, 2026
- Uploaded by
- Trevor McFedries
- Queried
- 0 times
Appears in
More
Use with your agent
Have your agent query this content directly
Download package
Unlocks the raw transcripts and files to use as you please
Discover playbooks
Create a repeatable workflow using this source