NYC models
Collection
Finetuning models on posts and responses on the /r/AskNYC subreddit
•
5 items
•
Updated
•
2
Adapter model / weights only for https://huggingface.co/monsoon-nlp/nyc-savvy-llama2-7b
Usage
from peft import AutoPeftModelForCausalLM
from transformers import AutoTokenizer
# this model
model = AutoPeftModelForCausalLM.from_pretrained("monsoon-nlp/nyc-savvy-llama2-7b-lora-adapter").to("cuda")
# base model for the tokenizer
tokenizer = AutoTokenizer.from_pretrained("monsoon-nlp/nyc-savvy-llama2-7b")
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.