4
Chinese Late Chunking
⚡
中文Late Chunking Gradio服务
jclian91
jclian91
·
AI & ML interests
None yet
Recent Activity
liked
a Space
about 1 month ago
jclian91/Chinese_Late_Chunking
updated
a dataset
3 months ago
jclian91/math-solver
published
a dataset
3 months ago
jclian91/math-solver
Organizations
None yet
jclian91's activity
liked
a
Space
about 1 month ago
updated
a
dataset
3 months ago
published
a
dataset
3 months ago
liked
a
dataset
3 months ago
updated
a
dataset
3 months ago
liked
a
model
6 months ago
updated
a
Space
6 months ago
updated
a
model
9 months ago
updated
a
Space
10 months ago
[bot] Conversion to Parquet
#1 opened 12 months ago
by
parquet-converter
updated
a
dataset
12 months ago
[bot] Conversion to Parquet
#1 opened about 1 year ago
by
parquet-converter
updated
a
dataset
about 1 year ago
liked
a
model
about 1 year ago
reacted to
akhaliq's
post with ❤️
over 1 year ago
Post
In Search of Needles in a 10M Haystack
Recurrent Memory Finds What LLMs Miss
paper addresses the challenge of processing long documents using generative transformer models. To evaluate different approaches, we introduce BABILong, a new benchmark designed to assess model capabilities in extracting and processing distributed facts within extensive texts. Our evaluation, which includes benchmarks for GPT-4 and RAG, reveals that common methods are effective only for sequences up to 10^4 elements. In contrast, fine-tuning GPT-2 with recurrent memory augmentations enables it to handle tasks involving up to 10^7 elements. This achievement marks a substantial leap, as it is by far the longest input processed by any open neural network model to date, demonstrating a significant improvement in the processing capabilities for long sequences
Recurrent Memory Finds What LLMs Miss
paper addresses the challenge of processing long documents using generative transformer models. To evaluate different approaches, we introduce BABILong, a new benchmark designed to assess model capabilities in extracting and processing distributed facts within extensive texts. Our evaluation, which includes benchmarks for GPT-4 and RAG, reveals that common methods are effective only for sequences up to 10^4 elements. In contrast, fine-tuning GPT-2 with recurrent memory augmentations enables it to handle tasks involving up to 10^7 elements. This achievement marks a substantial leap, as it is by far the longest input processed by any open neural network model to date, demonstrating a significant improvement in the processing capabilities for long sequences
liked
a
model
over 1 year ago
updated
a
dataset
over 1 year ago
liked
a
model
almost 2 years ago
updated
a
dataset
almost 2 years ago