Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
Doctor-Shotgun 's Collections
Doc's Choice
Doc's Diffusion
Doc's LLM
Doc's LLM Loras
LLM Speculative Decoding Experiments
Doc's Graveyard

LLM Speculative Decoding Experiments

updated about 16 hours ago

Tiny language models meant to serve as draft models for speculative decoding.

Upvote
3

  • Doctor-Shotgun/TinyLlama-1.1B-32k

    Text Generation • Updated Feb 2, 2024 • 75 • 29

  • Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct

    Text Generation • Updated Jun 7, 2024 • 8.13k • 12

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta

    Text Generation • Updated Jan 10, 2024 • 6 • 1

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft

    Text Generation • Updated Jan 10, 2024 • 8 • 2

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft-limarp

    Text Generation • Updated Jan 10, 2024 • 10

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-linear

    Text Generation • Updated Jan 10, 2024 • 16
Upvote
3
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs