Hugging Face's logo

Pseudo Lab

non-profit
https://pseudo-lab.com
Pseudo-Lab
Activity Feed Request to join this org

AI & ML interests

Non-profit ML community

Recent Activity

juyoungmlย  authored a paper 12 days ago
MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models
juyoungmlย  authored a paper 12 days ago
LLM-as-an-Interviewer: Beyond Static Testing Through Dynamic LLM Evaluation
juyoungmlย  authored a paper 12 days ago
Trillion 7B Technical Report
View all activity

pseudolab's activity

Nymboย 
posted an update 4 days ago
view post
Post
559
PSA for anyone using Nymbo/Nymbo_Theme or Nymbo/Nymbo_Theme_5 in a Gradio space ~

Both of these themes have been updated to fix some of the long-standing inconsistencies ever since the transition to Gradio v5. Textboxes are no longer bright green and in-line code is readable now! Both themes are now visually identical across versions.

If your space is already using one of these themes, you just need to restart your space to get the latest version. No code changes needed.
juyoungmlย 
authored 3 papers 12 days ago
emreย 
authored a paper about 1 month ago
emreย 
posted an update about 1 month ago
view post
Post
3388
having trouble with auto train
hello there this is the first time i am testing auto train with a 1.8k SFT dataset. Howevery i am not quite sure the training is going smooth. Logs seem quite confusing, token did not match can not auth, generates confusing train splits, do you know how i can check my running job properly?
what is being used for training as data?
any ideas?
  • 1 reply
ยท
Tonicย 
posted an update about 2 months ago
view post
Post
1422
๐Ÿ™‹๐Ÿปโ€โ™‚๏ธHey there folks,

Did you know that you can use ModernBERT to detect model hallucinations ?

Check out the Demo : Tonic/hallucination-test

See here for Medical Context Demo : MultiTransformer/tonic-discharge-guard

check out the model from KRLabs : KRLabsOrg/lettucedect-large-modernbert-en-v1

and the library they kindly open sourced for it : https://github.com/KRLabsOrg/LettuceDetect

๐Ÿ‘†๐Ÿปif you like this topic please contribute code upstream ๐Ÿš€

  • 2 replies
ยท
Tonicย 
posted an update 2 months ago
view post
Post
785
Powered by KRLabsOrg/lettucedect-large-modernbert-en-v1 from KRLabsOrg.

Detect hallucinations in answers based on context and questions using ModernBERT with 8192-token context support!

### Model Details
- **Model Name**: [lettucedect-large-modernbert-en-v1]( KRLabsOrg/lettucedect-large-modernbert-en-v1)
- **Organization**: [KRLabsOrg]( KRLabsOrg )
- **Github**: [https://github.com/KRLabsOrg/LettuceDetect](https://github.com/KRLabsOrg/LettuceDetect)
- **Architecture**: ModernBERT (Large) with extended context support up to 8192 tokens
- **Task**: Token Classification / Hallucination Detection
- **Training Dataset**: [RagTruth]( wandb/RAGTruth-processed)
- **Language**: English
- **Capabilities**: Detects hallucinated spans in answers, provides confidence scores, and calculates average confidence across detected spans.

LettuceDetect excels at processing long documents to determine if an answer aligns with the provided context, making it a powerful tool for ensuring factual accuracy.
Tonicย 
posted an update 3 months ago
view post
Post
2407
๐Ÿ™‹๐Ÿปโ€โ™‚๏ธhey there folks ,

Goedel's Theorem Prover is now being demo'ed on huggingface : Tonic/Math

give it a try !
Tonicย 
posted an update 3 months ago
view post
Post
2993
๐Ÿ™‹๐Ÿปโ€โ™‚๏ธ Hey there folks ,

our team made a game during the @mistral-game-jam and we're trying to win the community award !

try our game out and drop us a โค๏ธ like basically to vote for us !

Mistral-AI-Game-Jam/TextToSurvive

hope you like it !
Tonicย 
posted an update 4 months ago
view post
Post
1918
๐Ÿ™‹๐Ÿปโ€โ™‚๏ธ Hey there folks ,

Facebook AI just released JASCO models that make music stems .

you can try it out here : Tonic/audiocraft

hope you like it
Tonicย 
posted an update 4 months ago
view post
Post
2477
๐Ÿ™‹๐Ÿปโ€โ™‚๏ธHey there folks , Open LLM Europe just released Lucie 7B-Instruct model , a billingual instruct model trained on open data ! You can check out my unofficial demo here while we wait for the official inference api from the group : Tonic/Lucie-7B hope you like it ๐Ÿš€
Tonicย 
posted an update 4 months ago
view post
Post
1735
microsoft just released Phi-4 , check it out here : Tonic/Phi-4

hope you like it :-)
peaceAshย 
authored a paper 5 months ago
juyoungmlย 
authored a paper 5 months ago
lunarfluย 
posted an update 5 months ago
kinam0252ย 
authored a paper 5 months ago
Tonicย 
posted an update 6 months ago
view post
Post
3608
๐Ÿ™‹๐Ÿปโ€โ™‚๏ธhey there folks,

periodic reminder : if you are experiencing โš ๏ธ500 errors โš ๏ธ or โš ๏ธ abnormal spaces behavior on load or launch โš ๏ธ

we have a thread ๐Ÿ‘‰๐Ÿป https://discord.com/channels/879548962464493619/1295847667515129877

if you can record the problem and share it there , or on the forums in your own post , please dont be shy because i'm not sure but i do think it helps ๐Ÿค—๐Ÿค—๐Ÿค—
  • 2 replies
ยท
Tonicย 
posted an update 6 months ago
view post
Post
1193
boomers still pick zenodo.org instead of huggingface ??? absolutely clownish nonsense , my random datasets have 30x more downloads and views than front page zenodos ... gonna write a comparison blog , but yeah... cringe.
  • 1 reply
ยท
Tonicย 
posted an update 6 months ago
view post
Post
864
๐Ÿ™‹๐Ÿปโ€โ™‚๏ธ hey there folks ,

really enjoying sharing cool genomics and protein datasets on the hub these days , check out our cool new org : seq-to-pheno

scroll down for the datasets, still figuring out how to optimize for discoverability , i do think on that part it will be better than zenodo[dot}org , it would be nice to write a tutorial about that and compare : we already have more downloads than most zenodo datasets from famous researchers !