XMemTransfer Mistral adaptor from LLaMA-2 source (R4, 20M/20M)

This repository contains a target-side adaptor checkpoint for the XMemTransfer cross-model QA setting.

Project links

Files

  • adaptor_best.pt: best target-side adaptor checkpoint
  • config.json: adaptor configuration
  • results.json: summary metrics from the run

Related source memory

This adaptor is loaded on top of mistralai/Mistral-7B-v0.3 and uses the frozen source memory released at OLAResearchX/xmemtransfer-llama2-source-20m.

Provenance

  • source memory: LLaMA-2 7B WikiText-2021 source memory
  • target model family: Mistral 7B
  • reader setting: dual-layer, 4-branch
  • token budgets: 20M source / 20M target-side fitting

Usage and limitations

These files are research artifacts for the XMemTransfer implementation, not standalone Transformers pipeline checkpoints. Follow the project code to construct the memory reader and load the checkpoint. Results depend on the paired backbone, source memory, data preprocessing, and configuration released with the model.

Citation

Please cite the XMemTransfer paper when using these artifacts.

Downloads last month
23
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for OLAResearchX/xmemtransfer-mistral-from-llama2-r4-20m20m

Finetuned
(462)
this model

Dataset used to train OLAResearchX/xmemtransfer-mistral-from-llama2-r4-20m20m

Collection including OLAResearchX/xmemtransfer-mistral-from-llama2-r4-20m20m

Paper for OLAResearchX/xmemtransfer-mistral-from-llama2-r4-20m20m