Friedrich Marty

Smorty100

https://gitlab.com/users/Marty_Friedrich/projects

AI & ML interests

I'm most interested in content rerouting between LLM and VLLM agens for automation possibilities. Using templates for each agent which is then filled in by another agents inputs seems really useful.

Recent Activity

replied to MonsterMMORPG's post 5 days ago

It is now possible to generate 16 Megapixel (4096x4096) raw images with SANA 4K model using under 8GB VRAM, 4 Megapixel (2048x2048) images using under 6GB VRAM, and 1 Megapixel (1024x1024) images using under 4GB VRAM thanks to new optimizations 13 January 2024 Update Installers : https://www.patreon.com/posts/from-nvidia-labs-116474081 New 4K Tutorial Video : https://youtu.be/GjENQfHF4W8 Now the APP will use Diffusers Pipeline and it has huge VRAM optimizations You need to reinstall The models will be downloaded into your Hugging Face cache folder when you first time generate something How to Get Installation Logs and How to Change Hugging Face Cache Folder : https://www.patreon.com/posts/108419878 Please make a fresh install When you enable all 4 optimizations the VRAM usages are like below Make sure shared VRAM is enabled because initial loading of the model need more VRAM Enable VAE Tiling + Enable VAE Slicing + Enable Model CPU Offload + Enable Sequential CPU Offload 1K (1024x1024) : 4 GB GPUs 2K (2048x2048) : 6 GB GPUs 4K (4096x4096) : 8 GB GPUs Still in any case may work on your GPU test it Just Enable VAE Tiling + Enable Model CPU Offload works great in many cases All below attached images are generated via SANA 4K model, they are RAW and their resolution is 5376x3072 Official repo page : https://github.com/NVlabs/Sana

liked a model 7 days ago

PRIME-RL/Eurus-2-7B-PRIME

reacted to Severian's post with 👍 8 days ago

Interesting Solution to the Problem of Misguided Attention So I've been fascinated by the problem of Misguided Attention for a few weeks. I am trying to build an inference algorithm to help LLMs address that issue; but in the process, I found a cool short-term fix I call "Mindful Attention" using just prompt-engineering. Have you ever thought about how our brains filter reality through layers of past experiences, concepts, and mental images? For example, when you look at an oak tree, are you truly seeing that oak tree in all its unique details, or are you overlaying it with a generalized idea of "oak tree"? This phenomenon inspired the new approach. LLMs often fall into a similar trap, hence the Misguided Attention problem. They process input not as it’s uniquely presented but through patterns and templates they’ve seen before. This leads to responses that can feel "off," like missing the point of a carefully crafted prompt or defaulting to familiar but irrelevant solutions. I wanted to address this head-on by encouraging LLMs to slow down, focus, and engage directly with the input—free of assumptions. This is the core of the Mindful Attention Directive, a prompt designed to steer models away from over-generalization and back into the moment. You can read more about the broader issue here: https://github.com/cpldcpu/MisguidedAttention And if you want to try this mindful approach in action, check out the LLM I’ve set up for testing: https://hf.co/chat/assistant/677e7ebcb0f26b87340f032e. It works about 80% of the time to counteract these issues, and the results are pretty cool. I'll add the Gist with the full prompt. I admit, it is quite verbose but it's the most effective one I have landed on yet. I am working on a smaller version that can be appended to any System Prompt to harness the Mindful Attention. Feel free to experiment to find a better version for the community! Here is the Gist: https://gist.github.com/severian42/6dd96a94e546a38642278aeb4537cfb3

View all activity

Organizations

None yet

Smorty100's activity

New activity in nvidia/Cosmos-NeMo-Assets 10 days ago

Video 4 has rapid snapping movements during the end of the video

#2 opened 10 days ago by

Smorty100

New activity in ise-uiuc/Magicoder-S-DS-6.7B 14 days ago

AMAZING CODING MODEL!!!

#1 opened about 1 year ago by

rombodawg

New activity in huggingchat/chat-ui 14 days ago

Every model is going nuts now

#647 opened 15 days ago by

sneedingface

New activity in huggingchat/chat-ui 17 days ago

Your feedback on HuggingChat

264

#1 opened over 1 year ago by

victor

New activity in cfahlgren1/react-code-instructions 17 days ago

Potential bad generations cannot be labeled in the Deepseek Artifacts UI, dislike button would be appreciated

#2 opened 17 days ago by

Smorty100

New activity in huggingchat/chat-ui 19 days ago

Please add newer models (deepseek v3)

#645 opened 21 days ago by

Someone2077

[MODELS] Discussion

561

#372 opened 11 months ago by

victor

New activity in huggingchat/chat-ui 21 days ago

Errors of Using All Tools

#643 opened 22 days ago by

JaySStest

New activity in deepseek-ai/DeepSeek-V3 21 days ago

How can we thank you enough, whale bros?

#1 opened 23 days ago by

KrishnaKaasyap

New activity in huggingface/inference-playground 24 days ago

[FEEDBACK] Inference Playground

#1 opened 4 months ago by

victor

New activity in huggingchat/chat-ui 24 days ago

[FEATURE] Tools

#470 opened 8 months ago by

victor

New activity in huggingchat/chat-ui 2 months ago

New Copy Paste System Problems.

#603 opened 3 months ago by

M-I-O-H

New activity in arcee-ai/raspberry-3B 3 months ago

The details link seems broken

#4 opened 3 months ago by

Smorty100

New activity in amd/AMD-Llama-135m-code 4 months ago

Code completion functionality

#1 opened 4 months ago by

Smorty100

New activity in unsloth/Llama-3.2-11B-Vision-Instruct 4 months ago

Mistake in the table

#1 opened 4 months ago by

Smorty100

New activity in upstage/solar-pro-preview-instruct 4 months ago

There really seems to be some problem with the tokenizer or the ggufs

#12 opened 4 months ago by

Smorty100

New activity in G-reen/gpt5o-reflexion-q-agi-llama-3.1-8b 4 months ago

Insane breakthrough

#12 opened 4 months ago by

Zuccx

HELP MY MOUSE IS MOVING BY ITSELF

#13 opened 4 months ago by

r3muxd

This model wrote my application and now I have an apprenticeship at a wizards tower!?

#19 opened 4 months ago by

Smorty100

New activity in huggingchat/chat-ui 7 months ago

[NEW] Assistants

175

#357 opened 12 months ago by

victor