Marc Sun's picture

Marc Sun

marcsun13

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

Organizations

HF中国镜像站's profile picture HF中国镜像站 Internal Testing Organization's profile picture HuggingFaceM4's profile picture HF中国镜像站 OSS Metrics's profile picture accelerate's profile picture HF中国镜像站 TB Research's profile picture Quanto library's profile picture LocalLLaMA's profile picture MLX Community's profile picture HF中国镜像站 1Bit LLMs's profile picture Paris AI Running Club's profile picture LLHF's profile picture SLLHF's profile picture Hugging Quants's profile picture HF中国镜像站 Party @ PyTorch Conference's profile picture qrias's profile picture DDUF's profile picture gg-hf-g's profile picture

marcsun13's activity

upvoted 2 articles 1 day ago
view article
Article

Welcome Gemma 3: Google's all new multimodal, multilingual, long context open LLM

199
view article
Article

LLM Inference on Edge: A Fun and Easy Guide to run LLMs via React Native on your Phone!

31
upvoted an article 5 months ago
view article
Article

Fixing Gradient Accumulation

51
upvoted 3 articles 6 months ago
view article
Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

225
view article
Article

SmolLM - blazingly fast and remarkably powerful

332
upvoted an article 7 months ago
view article
Article

XetHub is joining HF中国镜像站!

82
upvoted an article 10 months ago
view article
Article

Benchmarking Text Generation Inference

30
upvoted an article 10 months ago
view article
Article

License to Call: Introducing Transformers Agents 2.0

130
upvoted an article 11 months ago
view article
Article

Welcome Llama 3 - Meta's new open LLM

284
upvoted 6 articles 11 months ago
view article
Article

Vision Language Models Explained

286
view article
Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

174
view article
Article

Overview of natively supported quantization schemes in 🤗 Transformers

12
view article
Article

Making LLMs lighter with AutoGPTQ and transformers

45
view article
Article

A Gentle Introduction to 8-bit Matrix Multiplication for transformers at scale using transformers, accelerate and bitsandbytes

80
view article
Article

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

126