leroy Samuel Dyer's picture

leroy Samuel Dyer

LeroyDyer

AI & ML interests

designing Inteligent Models : .Net Programmer and Artificial inteligent brain designer: Creating the intligence behind machine minds: The AGI will not be created by a Neural network design But it will be a combination of self improving code and self training neural network : it must be free to roam the internet and pick and choose information for itself and not be given brain dumps which confuse the models anyalitical progres so it right now basically repeating wht it knows but not generating its own formulated answer based on its knowdge base : hence we need code to extract these various data from its mind then reframe the same data then reinsert the knownedge in a fully structured and methodolgy ! hence the model can extract the data from its moind and reorganizes it better than we can ! so self teaching is the first step forwards :

Recent Activity

Organizations

Gradio-Themes-Party's profile picture SpydazWeb's profile picture Intelligent Estate's profile picture

LeroyDyer's activity

reacted to wassemgtk's post with 😎👀 8 days ago
view post
Post
2702
I’ve been diving into the iRoPE architecture from Llama 4—a game-changer for long-context models! It interleaves local attention (with RoPE) for short contexts and global attention (with inference-time temp scaling) for long-range reasoning, aiming for infinite context. I’m going to try writing iRoPE—who wants to help?

Code: https://github.com/wassemgtk/iRoPE-try/blob/main/iRoPE.ipynb
  • 1 reply
·
replied to nroggendorff's post 12 days ago
view reply

I think everybody is concerned becuae your a very helpful person !... SO obvioulsy people would like to try help ...
but only you know whagt the problems are ... people have maybe ot faced them yet either ...
I personally have not figured out docker yet ! but i know it is the standard ! so i hope they fix whatever the problem is with spinning up the containers and issuing the hardware requirements in the right order !
Especially every body uses cuda also so its a priority for them to make sure the containers are runing as needed ... the problem with hf is ..... no privayte messaging system or chat system .... so you can delete my coment after !

sorry for putting in my two cents !

New activity in Qwen/Qwen2.5-Omni-7B 15 days ago