4 5 9

Pro Creations PRO

ProCreations

https://pro-ai.glitch.me

ProCreations-Offical

AI & ML interests

AGI and small scale-high quality AI

Recent Activity

posted an update about 10 hours ago

NEW DATASETTTTT https://huggingface.co/datasets/ProCreations/Ultra-FineWeb-EDU This dataset is an extremely filtered version of https://huggingface.co/datasets/openbmb/Ultra-FineWeb for educational content only, inspired by https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu Right now dataset size is small (64k examples) and more examples are being processed as you read this!

updated a dataset about 10 hours ago

ProCreations/Ultra-FineWeb-EDU

published a dataset about 11 hours ago

ProCreations/Ultra-FineWeb-EDU

View all activity

Organizations

ProCreations's activity

posted an update about 10 hours ago

Post

132

NEW DATASETTTTT

ProCreations/Ultra-FineWeb-EDU

This dataset is an extremely filtered version of
openbmb/Ultra-FineWeb

for educational content only, inspired by
HuggingFaceFW/fineweb-edu

Right now dataset size is small (64k examples) and more examples are being processed as you read this!

posted an update 3 days ago

Post

189

here’s a bunch of mcp’s I made for Claude because I was bored

https://github.com/ProCreations-Official/HuggingMCP

https://github.com/ProCreations-Official/gitmcp

https://github.com/ProCreations-Official/second-opinion

posted an update 4 days ago

Post

2265

60 followers,
yay

2 replies

posted an update 6 days ago

Post

279

Introducing my custom AI lab!

This huggingface shows a bunch of fundamental visuals of AI’s training in real time.

ProCreations/ai-labs

Updates coming soon with a walk through mode that teaches you what it all means!

Meanwhile if you want to learn about AI and not just see it,
ProCreations/learn-ai

posted an update 11 days ago

Post

2875

Eyyyy 50 followers 🤯

1 reply

posted an update 13 days ago

Post

2422

Uggghhh what a busy week.
Been up all night fixing Intellite and I got some progress I wanted to share.

ALL errors we experienced (there’s a lot):
Gradient vanishing (AI dies)
Gradient explosion (AI barely learns and destabilizes)
Activation Explosion (AI dies)
Layer Scale Crushing Signal (AI dies)
Activation Explosion (again) (AI dies)
All fixed, but now it keeps overfitting on datasets due to a dataset handler error 😩

posted an update 17 days ago

Post

524

PROGRESS REPORT

Intellite Chat is going well! I have made format much more uniform (now chatml), data handling now works, and we removed and added new datasets for a better mix of quality. I have also updated the default model to be fp16 instead of fp32 for faster training. Stay tuned!

posted an update 19 days ago

Post

3180

Eyyy thank you guys for 40 followers!

replied to AdinaY's post 19 days ago

wheres the data in the dataset... lol

posted an update 20 days ago

Post

455

Question about Intellite Chat to you guys!
(If you don’t know, Intellite Chat is my up-and-coming 100m parameter AI model focused on high-quality chat.)

What quantization variants would you want to see for Intellite Chat? It’ll come with FP32, FP16, and BF16, but any others you want? Maybe FP8 or even BitNet’s 1.58-bit quantization? Let me know!

1 reply

posted an update 21 days ago

Post

1905

I made a space!

Check out
https://huggingface.co/spaces/ProCreations/realtime-ai-visualization
This cool space visualizes a real neural net in real time. It trains a real 199 parameter model on XOR. With baby mode for non-devs and advanced mode for developers or enthusiasts, (hopefully) everyone will understand!

posted an update 22 days ago

Post

1177

My first ever working model!
Introducing tinyvvision. An extremely small zero shot image classification model for simple shapes, letters, colors, and numbers. This is a foundation model for Intellision, an image-text-to-text model, which will be much bigger but still impressively small.
ProCreations/tinyvvision
NOTE: it’s small, mistakes will happen!!!! Not meant for complex stuff, just a demo for simple stuff.

replied to their post 23 days ago

the GPU’s just disappear and your desktop adjusts for CPU only so your precious compute power for AI is gone 😈 lol

posted an update 23 days ago

Post

1627

WOULD YOU RATHER
part 2

All your GPUs you have suddenly vanish and any devices with a GPU turn to CPU only

Every time you use a HF space you randomly start dancing for 5 minutes
OR
Every HF model you’ve hearted / liked suddenly disappears and becomes inaccessible

4 replies

replied to their post 24 days ago

sorry about that lol It was late and I wanted to make a post before sleep so I didnt really think about the choices

replied to their post 25 days ago

Makes sense as LLM's arent very random, this dataset isnt really for making LLMs random because you just cant (yet) more as just a dump of info I dropped for someone to find a use case for. Hey, thanks for commenting!

posted an update 25 days ago

Post

1958

WOULD YOU RATHER

Instantly have 10 of the best GPUs in the world but you can only use/train/tune AI on it

Instantly own all of LLaMA 4 models but your GPU is 10 years old

Or do a backflip every time your AI has an error training (if you are a developer)

7 replies

posted an update 26 days ago

Post

2224

New dataset- what a random time, right?

Randomness… pure randomness feels refreshing to me so I made a dataset of randomness.

ProCreations/quantum-randomness

This is a dataset of 1000 entries of timestamps and real quantum randomness. I have no clue what it could be used for but it exists now

4 replies

replied to their post 26 days ago

Very cool! Thanks for going out of your way to help, I saved the photo!

posted an update 27 days ago

Post

3504

What do you think of Intellite’s new icons/logo? Let us know!

Also Intellite chat technically does work! But we decided to scale it up a bit (same parameter count at 100m, but we went from trained on 4b tokens to 200b tokens, big upgrade!) for max quality.

4 replies