lingtrain/labse-udmurt
Sentence Similarity
•
Updated
•
6
•
4
Sergei Averkiev
averoo
AI & ML interests
None yet
Recent Activity
liked
a model
about 20 hours ago
lingtrain/labse-udmurt
updated
a model
about 21 hours ago
lingtrain/labse-udmurt
upvoted
a
paper
1 day ago
Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
Organizations
averoo's activity
liked
a
model
about 20 hours ago
updated
a
model
about 21 hours ago
upvoted
a
paper
1 day ago
liked
a
model
2 days ago
upvoted
a
paper
2 days ago
upvoted
2
papers
6 days ago
reacted to
singhsidhukuldeep's
post with 👍
7 days ago
Post
2932
Exciting breakthrough in Retrieval-Augmented Generation (RAG): Introducing MiniRAG - a revolutionary approach that makes RAG systems accessible for edge devices and resource-constrained environments.
Key innovations that set MiniRAG apart:
Semantic-aware Heterogeneous Graph Indexing
- Combines text chunks and named entities in a unified structure
- Reduces reliance on complex semantic understanding
- Creates rich semantic networks for precise information retrieval
Lightweight Topology-Enhanced Retrieval
- Leverages graph structures for efficient knowledge discovery
- Uses pattern matching and localized text processing
- Implements query-guided reasoning path discovery
Impressive Performance Metrics
- Achieves comparable results to LLM-based methods while using Small Language Models (SLMs)
- Requires only 25% of storage space compared to existing solutions
- Maintains robust performance with accuracy reduction ranging from just 0.8% to 20%
The researchers from Hong Kong University have also contributed a comprehensive benchmark dataset specifically designed for evaluating lightweight RAG systems under realistic on-device scenarios.
This breakthrough opens new possibilities for:
- Edge device AI applications
- Privacy-sensitive implementations
- Real-time processing systems
- Resource-constrained environments
The full implementation and datasets are available on GitHub: HKUDS/MiniRAG
Key innovations that set MiniRAG apart:
Semantic-aware Heterogeneous Graph Indexing
- Combines text chunks and named entities in a unified structure
- Reduces reliance on complex semantic understanding
- Creates rich semantic networks for precise information retrieval
Lightweight Topology-Enhanced Retrieval
- Leverages graph structures for efficient knowledge discovery
- Uses pattern matching and localized text processing
- Implements query-guided reasoning path discovery
Impressive Performance Metrics
- Achieves comparable results to LLM-based methods while using Small Language Models (SLMs)
- Requires only 25% of storage space compared to existing solutions
- Maintains robust performance with accuracy reduction ranging from just 0.8% to 20%
The researchers from Hong Kong University have also contributed a comprehensive benchmark dataset specifically designed for evaluating lightweight RAG systems under realistic on-device scenarios.
This breakthrough opens new possibilities for:
- Edge device AI applications
- Privacy-sensitive implementations
- Real-time processing systems
- Resource-constrained environments
The full implementation and datasets are available on GitHub: HKUDS/MiniRAG
- 1 reply
liked
a
dataset
8 days ago
updated
a
Space
9 days ago
liked
a
model
10 days ago
upvoted
3
papers
15 days ago
3DIS-FLUX: simple and efficient multi-instance generation with DiT rendering
Paper
•
2501.05131
•
Published
•
34
MiniMax-01: Scaling Foundation Models with Lightning Attention
Paper
•
2501.08313
•
Published
•
270
MangaNinja: Line Art Colorization with Precise Reference Following
Paper
•
2501.08332
•
Published
•
55
updated
2
Spaces
15 days ago