Describe Anything
Collection
Multimodal Large Language Models for Detailed Localized Image and Video Captioning
•
7 items
•
Updated
•
52
Adam Leary
aplrat
·
AI & ML interests
RL recommenders LLM
Recent Activity
upvoted
a
collection
2 months ago
Describe Anything
liked
a model
2 months ago
facebook/Perception-LM-3B
upvoted
a
collection
2 months ago
Perception LM
Organizations
None yet
upvoted
a
collection
2 months ago
liked
a
model
2 months ago
upvoted
a
collection
2 months ago
liked
a
dataset
2 months ago
updated
a
collection
6 months ago
upvoted
a
collection
6 months ago
updated
a
collection
6 months ago
upvoted
a
paper
6 months ago
upvoted
2
papers
8 months ago
updated
a
collection
about 1 year ago
upvoted
a
paper
about 1 year ago
updated
a
collection
about 1 year ago
upvoted
a
paper
about 1 year ago
reacted to
anakin87's
post with 😎👍
about 1 year ago
Post
2283
⚙️ Prompt Optimization with Haystack and DSPy
Experimental notebook: 🧪📓 https://github.com/deepset-ai/haystack-cookbook/blob/main/notebooks/prompt_optimization_with_dspy.ipynb
When building applications with LLMs, writing effective prompts is a long process of trial and error. 🔄
Often, if you switch models, you also have to change the prompt. 😩
What if you could automate this process?
💡 That's where DSPy comes in - a framework designed to algorithmically optimize prompts for Language Models.
By applying classical machine learning concepts (training and evaluation data, metrics, optimization), DSPy generates better prompts for a given model and task.
Recently, I explored combining DSPy with the robustness of Haystack Pipelines.
Here's how it works:
▶️ Start from a Haystack RAG pipeline with a basic prompt
🎯 Define a goal (in this case, get correct and concise answers)
📊 Create a DSPy program, define data and metrics
✨ Optimize and evaluate -> improved prompt
🚀 Build a refined Haystack RAG pipeline using the optimized prompt
Experimental notebook: 🧪📓 https://github.com/deepset-ai/haystack-cookbook/blob/main/notebooks/prompt_optimization_with_dspy.ipynb
When building applications with LLMs, writing effective prompts is a long process of trial and error. 🔄
Often, if you switch models, you also have to change the prompt. 😩
What if you could automate this process?
💡 That's where DSPy comes in - a framework designed to algorithmically optimize prompts for Language Models.
By applying classical machine learning concepts (training and evaluation data, metrics, optimization), DSPy generates better prompts for a given model and task.
Recently, I explored combining DSPy with the robustness of Haystack Pipelines.
Here's how it works:
▶️ Start from a Haystack RAG pipeline with a basic prompt
🎯 Define a goal (in this case, get correct and concise answers)
📊 Create a DSPy program, define data and metrics
✨ Optimize and evaluate -> improved prompt
🚀 Build a refined Haystack RAG pipeline using the optimized prompt
- 1 reply
liked
a
Space
about 1 year ago
liked
2
models
about 1 year ago
updated
a
collection
about 1 year ago