PrunaAI/HuggingFaceTB-SmolLM2-1.7B-Instruct-GGUF-smashed
Updated
•
501
Pruna AI
Enterprise
company
AI & ML interests
Efficient machine learning for any model and hardware: pruning, quantization, compilation, and more.
Recent Activity
View all activity
PrunaAI's activity
sharpenb
updated
2
models
about 10 hours ago
sharpenb
updated
a
model
2 days ago
sharpenb
published
a
model
7 days ago
Upload folder using huggingface_hub
2
#1 opened 7 days ago
by
sharpenb
sharpenb
published
a
model
7 days ago
Upload folder using huggingface_hub
2
#1 opened 7 days ago
by
sharpenb
sharpenb
published
a
model
7 days ago
sharpenb
updated
a
model
7 days ago
sharpenb
published
a
model
7 days ago
Upload folder using huggingface_hub
2
#1 opened 7 days ago
by
sharpenb
Post
510
How to deploy compressed ML models in your pipeline?
We wrote a series of blogs on this topics. Hope that it can be helpful to people:
- Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline
- Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai
- Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination
Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
We wrote a series of blogs on this topics. Hope that it can be helpful to people:
- Standard Model Compression in ML Pipeline: https://www.pruna.ai/blog/standard-model-compression-ml-pipeline
- Boost Your Replicate Models with Pruna AI: A Step-by-Step Guide: https://www.pruna.ai/blog/guide-replicate-pruna-ai
- Pruna + Triton: A Winning Combination for High-Performance AI Deployments: https://www.pruna.ai/blog/pruna-triton-combination
Feel free to join our discord (https://discord.com/invite/rskEr4BZJx) if you have questions ;)
Post
1893
We compressed SmolLMs to make 135 variations of them (see https://huggingface.co/PrunaAI?search_models=smolLM) with different quantization configurations with
We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
pruna (https://docs.pruna.ai/en/latest/). We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
-
- 3 replies
sharpenb
in
PrunaAI/Hachipo-Qwen2.5-Coder-0.5B-Instruct_MIFT-en_manywords_2000-HQQ-4bit-smashed
about 2 months ago
Upload folder using huggingface_hub
2
#1 opened about 2 months ago
by
sharpenb
sharpenb
updated
a
model
about 2 months ago
Upload folder using huggingface_hub
2
#1 opened about 2 months ago
by
sharpenb
sharpenb
updated
a
model
about 2 months ago
nifleisch
published
a
model
about 2 months ago
Upload folder using huggingface_hub
2
#1 opened about 2 months ago
by
nifleisch
nifleisch
updated
a
model
about 2 months ago