6
RegMix
π
Generate regression predictions from CSV data
𧬠RegMix: Data Mixture as Regression
Automatic data mixture method for large language model pre-training
-
-
RegMix: Data Mixture as Regression for Language Model Pre-training
Paper β’ 2407.01492 β’ Published β’ 37 -
sail/data-mixture-human-1b
Text Generation β’ Updated β’ 16 β’ 3 -
sail/data-mixture-pile-cc-1b
Text Generation β’ Updated β’ 16 β’ 3 -
sail/data-mixture-regmix-1b
Text Generation β’ Updated β’ 13 β’ 2 -
sail/data-mixture-doremi-1b
Text Generation β’ Updated β’ 14 β’ 2 -
sail/data-mixture-random-1b
Text Generation β’ Updated β’ 11 β’ 4 -
sail/regmix-data-sample
Viewer β’ Updated β’ 698k β’ 313 β’ 2 -
sail/regmix-data
Viewer β’ Updated β’ 13.7M β’ 4.5k β’ 4