README.md

metadata

license: apache-2.0
model_name: Mistral-Small-3.1-24B-Instruct-2503
base_model: mistralai/Mistral-Small-3.1-24B-Instruct-2503
model_creator: mistralai
quantized_by: Second State Inc.
inference: false
language:
  - en
  - fr
  - de
  - es
  - pt
  - it
  - ja
  - ko
  - ru
  - zh
  - ar
  - fa
  - id
  - ms
  - ne
  - pl
  - ro
  - sr
  - sv
  - tr
  - uk
  - vi
  - hi
  - bn
tags:
  - transformers
pipeline_tag: image-text-to-text

Mistral-Small-3.1-24B-Instruct-2503-GGUF

Original Model

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Run with Gaianet

Prompt template:

prompt template:

• Chat: mistral-small-chat

Context size:

chat_ctx_size: 32000

Run with GaiaNet:

• Quick start: https://docs.gaianet.ai/node-guide/quick-start

• Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b4944