Rombos-LLM-70b-Llama-3.3 AWQ 4-Bit Quantized

This repository provides the AWQ 4-bit quantized version of rombodawg/Rombos-LLM-70b-Llama-3.3, originally developed by Meta AI and finetuned by rombodawg.

Downloads last month
10
Safetensors
Model size
11.3B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for kosbu/Rombos-LLM-70b-Llama-3.3-AWQ