MaralGPT Mistral 7B version 0.1

MaralGPT is a Larage Language Model project launched in middle of the year 2023 by Iranian entrepreneur and engineer Muhammadreza Haghiri as an attempt to improve the AI for Persian language and also it is a part of Mann-E project.

Training procedure

The following bitsandbytes quantization config was used during training:

quant_method: gptq
bits: 4
tokenizer: None
dataset: None
group_size: 128
damp_percent: 0.1
desc_act: True
sym: True
true_sequential: True
use_cuda_fp16: False
model_seqlen: None
block_name_to_quantize: None
module_name_preceding_first_block: None
batch_size: 1
pad_token_id: None
disable_exllama: False
max_input_length: None

Framework versions

PEFT 0.5.0