Hugging Face's logo
Nicolay Rusnachenko's picture
7 23 40

Nicolay Rusnachenko

nicolay-r
gustavoia2023's profile picture aden3432's profile picture wallace43545's profile picture
Ā·
https://nicolayr.com/

AI & ML interests

Information Retrieval惻Medical Multimodal NLP (šŸ–¼+šŸ“) Research Fellow @BU_Research惻software developer http://arekit.io惻PhD in NLP

Recent Activity

posted an update 5 days ago
šŸš€ For those who interested in summarization of the long textual reports in medical domain šŸ“šŸ©ŗ, @Xiaolihai and I delighted to share that we experiment with distillation tuning adaptation for Qwen-2.5 0.5B. We use reports from the MultiClinSum dataset and pass it through 72B version to retrieve report explanations in order to initiate ditillation tuning for 0.5B model. We experiment with passages written in English, French, Portuguese, and Spanish. šŸ”‘ We find that using distil-technique results in 2-4% performance increment on fine-tuning and similar improvements for reports in English (non-official and official evaluation). For the other it results in systems that perform similar to the convential tuning (standard) (see result below). Dataset: https://zenodo.org/records/15459174 Competition: https://participants-area.bioasq.org/general_information/MultiClinSum/ Github: https://github.com/nicolay-r/distil-tuning-llm model: https://huggingface.co/nicolay-r/qwen25-05b-multiclinsum-distil
updated a model 23 days ago
nicolay-r/qwen25-05b-multiclinsum-distil
liked a model 29 days ago
Xiaolihai/flan-t5-large_MeDistill
View all activity

Organizations

None yet