Article
71
Morgan Funtowicz
mfuntowicz
AI & ML interests
Model inference low-level optimization, hardware affinity and large-scale distributed training.
Recent Activity
upvoted
an
article
about 2 months ago
Yay! Organizations can now publish blog Articles
upvoted
an
article
about 2 months ago
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
published
an
article
about 2 months ago
Introducing multi-backends (TRT-LLM, vLLM) support for Text Generation Inference
Organizations
Collections
1
Tracks papers and links about neural network compression and quantization technics
-
LLM.int8(): 8-bit Matrix Multiplication for Transformers at Scale
Paper • 2208.07339 • Published • 5 -
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers
Paper • 2210.17323 • Published • 8 -
SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models
Paper • 2211.10438 • Published • 4 -
AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration
Paper • 2306.00978 • Published • 9
Papers
1
models
6
mfuntowicz/SmolLM2-360M-Instruct-Q4_K_M-GGUF
Updated
•
26
mfuntowicz/gemma-2b
Text Generation
•
Updated
•
19
•
1
mfuntowicz/xlm-roberta-large-squad2
Updated
mfuntowicz/wav2vec2-large-960h-lv60-self
Updated
mfuntowicz/bert-base-cased-finetuned-sst2
Text Classification
•
Updated
•
109
mfuntowicz/test-model
Updated
datasets
None public yet