
leroy Samuel Dyer
LeroyDyer
AI & ML interests
designing Inteligent Models :
.Net Programmer and Artificial inteligent brain designer: Creating the intligence behind machine minds:
The AGI will not be created by a Neural network design But it will be a combination of self improving code and self training neural network : it must be free to roam the internet and pick and choose information for itself and not be given brain dumps which confuse the models anyalitical progres so it right now basically repeating wht it knows but not generating its own formulated answer based on its knowdge base : hence we need code to extract these various data from its mind then reframe the same data then reinsert the knownedge in a fully structured and methodolgy !
hence the model can extract the data from its moind and reorganizes it better than we can ! so self teaching is the first step forwards :
Recent Activity
liked
a model
1 day ago
LeroyDyer/_Spydaz_Web_AI_FinTech_001
updated
a model
1 day ago
LeroyDyer/_Spydaz_Web_AI_FinTech_001
published
a model
1 day ago
LeroyDyer/_Spydaz_Web_AI_FinTech_001
Organizations
LeroyDyer's activity

reacted to
wassemgtk's
post with 😎👀
8 days ago
Post
2702
I’ve been diving into the iRoPE architecture from Llama 4—a game-changer for long-context models! It interleaves local attention (with RoPE) for short contexts and global attention (with inference-time temp scaling) for long-range reasoning, aiming for infinite context. I’m going to try writing iRoPE—who wants to help?
Code: https://github.com/wassemgtk/iRoPE-try/blob/main/iRoPE.ipynb
Code: https://github.com/wassemgtk/iRoPE-try/blob/main/iRoPE.ipynb
Open-source Fine-tuning script of Qwen2.5-Omni 7B 🚀
3
#29 opened 13 days ago
by
hiyouga


replied to
nroggendorff's
post
12 days ago
I think everybody is concerned becuae your a very helpful person !... SO obvioulsy people would like to try help ...
but only you know whagt the problems are ... people have maybe ot faced them yet either ...
I personally have not figured out docker yet ! but i know it is the standard ! so i hope they fix whatever the problem is with spinning up the containers and issuing the hardware requirements in the right order !
Especially every body uses cuda also so its a priority for them to make sure the containers are runing as needed ... the problem with hf is ..... no privayte messaging system or chat system .... so you can delete my coment after !
sorry for putting in my two cents !
Flash Attention 2 for Qwen2_5OmniToken2WavModel
1
#23 opened 16 days ago
by
fduches2

Data Source
2
#2 opened 26 days ago
by
khoantap
hey ! DID YOU RELEASE UNUSABLE DATSETS @ JUST OT LOOK GOOD !
1
#4 opened 16 days ago
by
LeroyDyer

Can this be quantized with bitsAndBytes?
8
#6 opened 19 days ago
by
Permahuman
Thank You for Open-Sourcing Your Model & Feedback
3
#8 opened 19 days ago
by
rameshch
where is opensource-code?
3
#18 opened 17 days ago
by
xubin-bruce