---
license: apache-2.0
base_model:
- keeeeenw/MicroLlama
pipeline_tag: text-generation
---

# yujiepan/microllama-0.3B

This is the same model as [keeeeenw/MicroLlama](https://huggingface.co/keeeeenw/MicroLlama/) but is converted in BF16.

It is a small pretrained model that can do text generation. Very useful for algorithm development / debugging.

Special thanks to the original author [keeeeenw](https://huggingface.co/keeeeenw/) for the hard work and contribution.

**This repo is just a backup for myself. If you find this model useful, consider using the original repo instead.**


Wikitext2 PPL

- FP32: 33.07
- BF16: 33.09