5 2 10

Jannik PRO

MJannik

https://github.com/langfuse/langfuse

AI & ML interests

None yet

Recent Activity

new activity 1 day ago

agents-course/notebooks:Missing file in notebooks (file only available on github repo). I let you upload the final file (opened pull request on github side for tiny change on code).

new activity 1 day ago

agents-course/notebooks:Missing file in notebooks (file only available on github repo).

reacted to davidberenstein1957's post with ❤️ 2 days ago

🚨 New Bonus Unit: Tracing & Evaluating Your Agent! 🚨 Learn how to transform your agent from a simple demo into a robust, reliable product ready for real users. UNIT: https://huggingface.co/learn/agents-course/bonus-unit2/introduction In this unit, you'll learn: - Offline Evaluation – Benchmark and iterate your agent using datasets. - Online Evaluation – Continuously track key metrics such as latency, costs, and user feedback. Happy testing and improving! Thanks Langfuse team!

View all activity

Organizations

MJannik's activity

New activity in agents-course/notebooks 1 day ago

Missing file in notebooks (file only available on github repo). I let you upload the final file (opened pull request on github side for tiny change on code).

#57 opened 3 days ago by

christopheduc

Missing file in notebooks (file only available on github repo).

#58 opened 3 days ago by

christopheduc

reacted to davidberenstein1957's post with ❤️ 2 days ago

Post

1827

🚨 New Bonus Unit: Tracing & Evaluating Your Agent! 🚨

Learn how to transform your agent from a simple demo into a robust, reliable product ready for real users.

UNIT: https://huggingface.co/learn/agents-course/bonus-unit2/introduction

In this unit, you'll learn:
- Offline Evaluation – Benchmark and iterate your agent using datasets.
- Online Evaluation – Continuously track key metrics such as latency, costs, and user feedback.

Happy testing and improving!

Thanks Langfuse team!

New activity in agents-course/notebooks 2 days ago

Rename file to fix links

#63 opened 2 days ago by

MJannik

add notebook for bonus unit 2 - agent evaluation

#62 opened 2 days ago by

MJannik

commented on 🪢 Langfuse and 🤗 Hugging Face: 5 Ways to use them Together 10 days ago

Hi @shahules786 , yes the integration should work with all model gateways. Which with gateway & model do you have an issue with?

published an article 14 days ago

Article

🪢 Langfuse and 🤗 Hugging Face: 5 Ways to use them Together

•

14 days ago

• 13

posted an update 14 days ago

Post

1734

I've published an article showing five ways to use 🪢 Langfuse with 🤗 Hugging Face.

My personal favorite is Method #4: Using Hugging Face Datasets for Langfuse Dataset Experiments. This lets you benchmark your LLM app or AI agent with a dataset hosted on Hugging Face. In this example, I chose the GSM8K dataset ( openai/gsm8k) to test the mathematical reasoning capabilities of my smolagent :)

Link to the Article here on HF: https://huggingface.co/blog/MJannik/hugging-face-and-langfuse

New activity in agents-course/course-images 14 days ago

docs: add images for bonus unit 2 - agent observability and evaluation

#9 opened 14 days ago by

MJannik

reacted to Kseniase's post with 👍 23 days ago

Post

9639

8 Free Sources about AI Agents:

Agents seem to be everywhere and this collection is for a deep dive into the theory and practice:

1. "Agents" Google's whitepaper by Julia Wiesinger, Patrick Marlow and Vladimir Vuskovic -> https://www.kaggle.com/whitepaper-agents
Covers agents, their functions, tool use and how they differ from models

2. "Agents in the Long Game of AI. Computational Cognitive Modeling for Trustworthy, Hybrid AI" book by Marjorie McShane, Sergei Nirenburg, and Jesse English -> https://direct.mit.edu/books/oa-monograph/5833/Agents-in-the-Long-Game-of-AIComputational
Explores building AI agents, using Hybrid AI, that combines ML with knowledge-based reasoning

3. "AI Engineer Summit 2025: Agent Engineering" 8-hour video -> https://www.youtube.com/watch?v=D7BzTxVVMuw
Experts' talks that share insights on the freshest Agent Engineering advancements, such as Google Deep Research, scaling tips and more

4. AI Agents Course from Hugging Face -> https://huggingface.co/learn/agents-course/en/unit0/introduction
Agents' theory and practice to learn how to build them using top libraries and tools

5. "Artificial Intelligence: Foundations of Computational Agents", 3rd Edition, book by David L. Poole and Alan K. Mackworth -> https://artint.info/3e/html/ArtInt3e.html
Agents' architectures, how they learn, reason, plan and act with certainty and uncertainty

6. "Intelligent Agents: Theory and Practice" book by Michael Wooldridge -> https://www.cs.ox.ac.uk/people/michael.wooldridge/pubs/ker95/ker95-html.html
A fascinating option to dive into how agents were seen in 1995 and explore their theory, architectures and agent languages

7. The Turing Post articles "AI Agents and Agentic Workflows" on Hugging Face -> https://huggingface.co/Kseniase
We explore agentic workflows in detail and agents' building blocks, such as memory and knowledge

8. Our collection "8 Free Sources to Master Building AI Agents" -> https://www.turingpost.com/p/building-ai-agents-sources

4 replies

liked a Space about 1 month ago

631

Open Deep-Research

🏆

OpenAI's Deep Research, but open

upvoted an article about 1 month ago

Article

Open-source DeepResearch – Freeing our search agents

Feb 4

• 1.19k

liked 5 Spaces 2 months ago

Langfuse

🪢

Langfuse Dashboard

🪢

Loading... an AI-driven assessment tool

Langfuse Dashboard Shared

🪢

Shared Langfuse Dashboard for Success Team

Langfuse

🪢

Display loading screen for web app

Langfuse

🪢

Display loading animation and theme

reacted to cfahlgren1's post with 🔥 3 months ago

Post

1763

Wow, I just added Langfuse tracing to the Deepseek Artifacts app and it's really nice 🔥

It allows me to visualize and track more things along with the cfahlgren1/react-code-instructions dataset.

It was just added as a one click Docker Space template, so it's super easy to self host 💪

reacted to andrewrreed's post with 🤗 3 months ago

Post

2805

🚀 Supercharge your LLM apps with Langfuse on Hugging Face Spaces!

Langfuse brings end-to-end observability and tooling to accelerate your dev workflow from experiments through production

Now available as a Docker Space directly on the HF Hub! 🤗

🔍 Trace everything: monitor LLM calls, retrieval, and agent actions with popular frameworks
1⃣ One-click deployment: on Spaces with persistent storage and integrated OAuth
🛠 Simple Prompt Management: Version, edit, and update without redeployment
✅ Intuitive Evals: Collect user feedback, run model/prompt evaluations, and improve quality
📊 Dataset Creation: Build datasets directly from production data to enhance future performance

Kudos to the Langfuse team for this collab and the awesome, open-first product they’re building! 👏 @marcklingen @Clemo @MJannik

🔗 Space: langfuse/langfuse-template-space
🔗 Docs: https://huggingface.co/docs/hub/spaces-sdks-docker-langfuse

1 reply