Databricks

databricks's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

nthakur 

authored 3 papers 12 days ago

FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents

Paper • 2504.13128 • Published Apr 17 • 5

Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses

Paper • 2504.20006 • Published Apr 28

Fixing Data That Hurts Performance: Cascading LLMs to Relabel Hard Negatives for Robust Information Retrieval

Paper • 2505.16967 • Published 15 days ago • 22

nthakur 

posted an update 2 months ago

view post

Post

1638

Last year, I curated & generated a few multilingual SFT and DPO datasets by translating English SFT/DPO datasets into 9-10 languages using the mistralai/Mistral-7B-Instruct-v0.2 model.

I hope it helps the community for pretraining/instruction tuning multilingual LLMs! I added a small diagram to briefly describe which datasets are added and their sources.

Happy to collaborate in either using these datasets for instruction FT, or wishes to extend translated versions of newer SFT/DPO english datasets!

nthakur/multilingual-sft-and-dpo-datasets-67eaf56fe3feca5a57cf7d74

See translation

• 

🔥

8

8

+

Reply

nthakur 

authored a paper 3 months ago

MMTEB: Massive Multilingual Text Embedding Benchmark

Paper • 2502.13595 • Published Feb 19 • 34

mylesbaker 

in databricks/databricks-dolly-15k 4 months ago

Your employees were clearly bored

3

#18 opened 4 months ago by

ChuckMcSneed

nthakur 

authored a paper 7 months ago

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems

Paper • 2410.13716 • Published Oct 17, 2024

vchiley 

authored a paper 8 months ago

Inference-Friendly Models With MixAttention

Paper • 2409.15012 • Published Sep 23, 2024

nthakur 

authored a paper 10 months ago

Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track

Paper • 2406.16828 • Published Jun 24, 2024

rishab-partha 

authored 2 papers 12 months ago

Vid3D: Synthesis of Dynamic 3D Scenes using 2D Video Diffusion

Paper • 2406.11196 • Published Jun 17, 2024 • 8

Hydra: Sequentially-Dependent Draft Heads for Medusa Decoding

Paper • 2402.05109 • Published Feb 7, 2024 • 1

vchiley 

authored 6 papers about 1 year ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15, 2024 • 89

Online Normalization for Training Neural Networks

Paper • 1905.05894 • Published May 15, 2019

Pipelined Backpropagation at Scale: Training Large Models without Batches

Paper • 2003.11666 • Published Mar 25, 2020

Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation

Paper • 2104.09648 • Published Apr 19, 2021

Adaptive Braking for Mitigating Gradient Delay

Paper • 2007.01397 • Published Jul 2, 2020

RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network

Paper • 2206.14098 • Published Jun 28, 2022

nthakur 

posted an update about 1 year ago

view post

Post

3534

🦢 The SWIM-IR dataset contains 29 million text-retrieval training pairs across 27 diverse languages. It is one of the largest synthetic multilingual datasets generated using PaLM 2 on Wikipedia! 🔥🔥

SWIM-IR dataset contains three subsets :
- Cross-lingual:nthakur/swim-ir-cross-lingual
- Monolingual: nthakur/swim-ir-monolingual
- Indic Cross-lingual: nthakur/indic-swim-ir-cross-lingual

Check it out:
https://huggingface.co/collections/nthakur/swim-ir-dataset-662ddaecfc20896bf14dd9b7

🔥

3

3

👀

1

1

🤯

1

1

+

Reply

abhi-db 

updated 2 models about 1 year ago

databricks/dbrx-instruct

Text Generation • Updated Apr 19, 2024 • 5.33k • 1.11k

databricks/dbrx-base

Text Generation • Updated Apr 19, 2024 • 2 • 558