5 3 10

Jannik PRO

MJannik

https://github.com/langfuse/langfuse

AI & ML interests

None yet

Recent Activity

posted an update 1 day ago

Hi everyone, we’ve got big news! Starting today, all Langfuse product features are available as free OSS (MIT license). You can now upgrade your self-hosted Langfuse to access features like: - Managed LLM-as-a-Judge evaluations - Annotation queues - Prompt experiments - LLM playground We’re incredibly grateful for the support of this amazing community and can’t wait to hear your feedback on the new features! More on this change here: https://langfuse.com/blog/2025-06-04-open-sourcing-langfuse-product

published a dataset about 2 months ago

MJannik/test-synthetic-dataset

updated a dataset about 2 months ago

MJannik/test-synthetic-dataset

View all activity

Organizations

MJannik's activity

posted an update 1 day ago

Post

476

Hi everyone, we’ve got big news! Starting today, all Langfuse product features are available as free OSS (MIT license).

You can now upgrade your self-hosted Langfuse to access features like:
- Managed LLM-as-a-Judge evaluations
- Annotation queues
- Prompt experiments
- LLM playground

We’re incredibly grateful for the support of this amazing community and can’t wait to hear your feedback on the new features!

More on this change here: https://langfuse.com/blog/2025-06-04-open-sourcing-langfuse-product

published a dataset about 2 months ago

MJannik/test-synthetic-dataset

Viewer • Updated Apr 9 • 10 • 37

updated 2 datasets about 2 months ago

MJannik/test-synthetic-dataset

Viewer • Updated Apr 9 • 10 • 37

MJannik/my-distiset-f88837c8

Viewer • Updated Apr 9 • 20 • 16

published a dataset about 2 months ago

MJannik/my-distiset-f88837c8

Viewer • Updated Apr 9 • 20 • 16

upvoted an article about 2 months ago

Article

Synthetic data: save money, time and carbon with open source

•

Feb 16, 2024

• 75

New activity in agents-course/notebooks 2 months ago

Missing file in notebooks (file only available on github repo). I let you upload the final file (opened pull request on github side for tiny change on code).

#57 opened 2 months ago by

christopheduc

Missing file in notebooks (file only available on github repo).

#58 opened 2 months ago by

christopheduc

reacted to davidberenstein1957's post with ❤️ 2 months ago

Post

2095

🚨 New Bonus Unit: Tracing & Evaluating Your Agent! 🚨

Learn how to transform your agent from a simple demo into a robust, reliable product ready for real users.

UNIT: https://huggingface.co/learn/agents-course/bonus-unit2/introduction

In this unit, you'll learn:
- Offline Evaluation – Benchmark and iterate your agent using datasets.
- Online Evaluation – Continuously track key metrics such as latency, costs, and user feedback.

Happy testing and improving!

Thanks Langfuse team!

New activity in agents-course/notebooks 2 months ago

Rename file to fix links

#63 opened 2 months ago by

MJannik

add notebook for bonus unit 2 - agent evaluation

#62 opened 2 months ago by

MJannik

commented on 🪢 Langfuse and 🤗 Hugging Face: 5 Ways to use them Together 3 months ago

Hi @shahules786 , yes the integration should work with all model gateways. Which with gateway & model do you have an issue with?

published an article 3 months ago

Article

🪢 Langfuse and 🤗 Hugging Face: 5 Ways to use them Together

•

Mar 14

• 13

posted an update 3 months ago

Post

1774

I've published an article showing five ways to use 🪢 Langfuse with 🤗 Hugging Face.

My personal favorite is Method #4: Using Hugging Face Datasets for Langfuse Dataset Experiments. This lets you benchmark your LLM app or AI agent with a dataset hosted on Hugging Face. In this example, I chose the GSM8K dataset ( openai/gsm8k) to test the mathematical reasoning capabilities of my smolagent :)

Link to the Article here on HF: https://huggingface.co/blog/MJannik/hugging-face-and-langfuse

reacted to Kseniase's post with 👍 3 months ago

Post

9774

8 Free Sources about AI Agents:

Agents seem to be everywhere and this collection is for a deep dive into the theory and practice:

1. "Agents" Google's whitepaper by Julia Wiesinger, Patrick Marlow and Vladimir Vuskovic -> https://www.kaggle.com/whitepaper-agents
Covers agents, their functions, tool use and how they differ from models

2. "Agents in the Long Game of AI. Computational Cognitive Modeling for Trustworthy, Hybrid AI" book by Marjorie McShane, Sergei Nirenburg, and Jesse English -> https://direct.mit.edu/books/oa-monograph/5833/Agents-in-the-Long-Game-of-AIComputational
Explores building AI agents, using Hybrid AI, that combines ML with knowledge-based reasoning

3. "AI Engineer Summit 2025: Agent Engineering" 8-hour video -> https://www.youtube.com/watch?v=D7BzTxVVMuw
Experts' talks that share insights on the freshest Agent Engineering advancements, such as Google Deep Research, scaling tips and more

4. AI Agents Course from Hugging Face -> https://huggingface.co/learn/agents-course/en/unit0/introduction
Agents' theory and practice to learn how to build them using top libraries and tools

5. "Artificial Intelligence: Foundations of Computational Agents", 3rd Edition, book by David L. Poole and Alan K. Mackworth -> https://artint.info/3e/html/ArtInt3e.html
Agents' architectures, how they learn, reason, plan and act with certainty and uncertainty

6. "Intelligent Agents: Theory and Practice" book by Michael Wooldridge -> https://www.cs.ox.ac.uk/people/michael.wooldridge/pubs/ker95/ker95-html.html
A fascinating option to dive into how agents were seen in 1995 and explore their theory, architectures and agent languages

7. The Turing Post articles "AI Agents and Agentic Workflows" on Hugging Face -> @Kseniase
We explore agentic workflows in detail and agents' building blocks, such as memory and knowledge

8. Our collection "8 Free Sources to Master Building AI Agents" -> https://www.turingpost.com/p/building-ai-agents-sources