How to use peft-internal-testing/tiny-random-BertModel-lora with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("peft-internal-testing/tiny-random-BertModel-lora", dtype="auto")