Example for Fine-Tuning Models on Asymmetric Semantic Search with Hard Negatives.

#98
by wilfoderek - opened

Hi everyone!
I am currently working on a project focused on asymmetric semantic search involving hard negative sentences, and I would like to fine-tune a model using this approach. I am seeking a practical example to better understand the process.

Could you please provide an example or reference on:

  1. Preparing the dataset for fine-tuning, including how to structure pairs with hard negatives for asymmetric tasks?
  2. Implementing the fine-tuning process using Hugging Face tools (e.g., transformers or datasets)?

A step-by-step example or notebook reference would be extremely helpful!

Thank you so much for your guidance.

Hi, did you ever find the resources you were looking for?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment