You need to agree to share your contact information to access this model

This repository is publicly accessible, but you have to accept the conditions to access its files and content.

yujiepan/microllama-0.3B

This is the same model as keeeeenw/MicroLlama but is converted in BF16.

It is a small pretrained model that can do text generation. Very useful for algorithm development / debugging.

Special thanks to the original author keeeeenw for the hard work and contribution.

This repo is just a backup for myself. If you find this model useful, consider using the original repo instead.

Wikitext2 PPL

FP32: 33.07
BF16: 33.09

Downloads last month: 102

Safetensors

Model size

305M params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for yujiepan/microllama-0.3B

Base model

keeeeenw/MicroLlama

Finetuned

(16)

this model