--- license: apache-2.0 base_model: - keeeeenw/MicroLlama pipeline_tag: text-generation --- # yujiepan/microllama-0.3B This is the same model as [keeeeenw/MicroLlama](https://huggingface.co/keeeeenw/MicroLlama/) but is converted in BF16. It is a small pretrained model that can do text generation. Very useful for algorithm development / debugging. Special thanks to the original author [keeeeenw](https://huggingface.co/keeeeenw/) for the hard work and contribution. **This repo is just a backup for myself. If you find this model useful, consider using the original repo instead.** Wikitext2 PPL - FP32: 33.07 - BF16: 33.09