Design supports variable-length documents in packed layouts
The design supports variable-length documents directly in packed layouts without repacking through document-local scaling and workload-aware scheduling.
Training stability and quality preservation were validated on pretraining Llama-style models.
Sources behind this report
- Hugging Face
Research · abstract · CC0 1.0
Source published
Read by the newsroom
Report history
No earlier revision dates are retained here. This does not establish that the report has never changed; read any dated updates and corrections.
This brief was made by AI and checked against its cited public sources. How the newsroom works