kaitchup
/

Mayonnaise-4in1-03

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Model Card for Model ID

This is a mixture of experts created with mergekit and based on mistralai/Mistral-7B-v0.1.

Model Details

The model was created using a recipe detailed in this article: The Mayonnaise: Rank First on the Open LLM Leaderboard with TIES-Merging

Model Description

Developed by: The Kaitchup
Model type: Causal
Language(s) (NLP): English
License: Apache 2.0

Model Sources

Created with mergekit with this configuration:

models:
  - model: mncai/mistral-7b-dpo-v5
    # no parameters necessary for base model
  - model: flemmingmiguel/MBX-7B
    parameters:
      density: 0.3
      weight: 0.3
  - model: BarryFutureman/NeuralTurdusVariant1-7B
    parameters:
      density: 0.3
      weight: 0.5
merge_method: ties
base_model: mncai/mistral-7b-dpo-v5
parameters:
  normalize: true
dtype: float16

Downloads last month: 82

Safetensors

Model size

7.24B params

Tensor type

FP16

·

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for kaitchup/Mayonnaise-4in1-03

Quantizations

1 model

Spaces using kaitchup/Mayonnaise-4in1-03 5

Collection including kaitchup/Mayonnaise-4in1-03

The Mayonnaise

A collection of 7B models made with mergekit. • 6 items • Updated Mar 19