Draft models
Collection
Tiny draft model for speculative sampling created using 'transplant-vocab'
•
6 items
•
Updated
A 0.5B parameter draft model for speculative sampling for use with deepseek-ai/DeepSeek-R1 created from alamios/DeepSeek-R1-DRAFT-Qwen2.5-0.5B using transplant-vocab.
NOTE: This is a draft model for the full-sized DeepSeek-R1
model and not the smaller "distilled" models!
See jukofyork/DeepSeek-R1-DRAFT-0.5B-GGUF for a F16
GGUF ready for use with llama.cpp
.