peft Questions

Ubuntu – FastAPI custom Validator Error: FastAPI/Pydantic not recognizing custom validator functions (RuntimeError: no validator found for <class>)

September 20, 2023
wferguson8
2 Answers

I'm working on a fastAPI project on an Amazon EC2 instance running Ubuntu 20.04.5. The nature of the project requires me to have several custom types (written by me) and third party types (from HuggingFace transformers, hf peft, Langchain) as…

VIEW QUESTION

Ubuntu – How to load a fine-tuned peft/lora model based on llama with Huggingface transformers?

June 22, 2023
Lucas Azevedo
2 Answers

I've followed this tutorial (colab notebook) in order to finetune my model. Trying to load my locally saved model model = AutoModelForCausalLM.from_pretrained("finetuned_model") yields Killed. Trying to load model from hub: yields import torch from peft import PeftModel, PeftConfig from transformers…

VIEW QUESTION