Model Details

WARNINNGS: This Model IS Pre-Trained, in the future will be finetuned.

Model Description

The First Persian SLM By YSNRFD, This Model support Only Persian text Inputs, In The Future I Want Add Englih Language Support.

  • Developed by: ysnrfd
  • Funded by: ysnrfd
  • Shared by: ysnrfd
  • Model type: SLM
  • Language(s) (NLP): Persian
  • License: ysnrfd LICENSE

Training Data

ysnrfd Sample Persian Text LINK: https://huggingface.co/datasets/ysn-rfd/fibonacci_alpaca_to_sharegpt_gpt_format_convert_new_dataset_release

Training Hyperparameters

  • Training regime: fp32 mixed precision

Evaluation

Not Yet

Testing Data, Factors & Metrics

ysnrfd Sample Persian Text

Testing Data

Not Yet

Summary

The Fisrt Persian SLM Trained From Scratch

  • Hardware Type: Nvidia P100
  • Hours used: 21H
  • Cloud Provider: Kaggle

Model Architecture and Objective

YSNRFD Architecture

Hardware

Nvidia P100

Software

Python Code, From Scratch, Pytorch

Downloads last month
178
Safetensors
Model size
124M params
Tensor type
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train ysn-rfd/First_Persian_SLM_Big_Update_Version3_ULTIMATE_ysnrfd

Collection including ysn-rfd/First_Persian_SLM_Big_Update_Version3_ULTIMATE_ysnrfd