How to run without trust remote code on in Oobabooga?
#1
by
OrangeApples
- opened
Hello @bartowski . I downloaded the 6bpw exl2 but when I try loading it in ooba I get this:
ValueError: Loading models\bartowski_bagel-20b-v04-llama-exl2_6_5 requires you to execute the configuration file in that repo on your local machine. Make sure you have read the code there to avoid malicious use, then set the option trust_remote_code=True to remove this error.
This is the first model that I've used that triggered this error, and I'd rather not have to enable trust_remote_code. Would you know if there is any workaround for this?
Hmm that's interesting, and shouldn't be possible.. lemme get back to you