Amazon web services – Problem with deploying finetuned gemma in AWS sagemaker as an endpoint
I have finetuned a gemma 7b LLM from HuggingFace using Lora and stored the model as a compressed .tar.gz file. I have finetuned locally in sagemaker. this is my .tar.gz file structure of finetuned model : finetuned_gemma/model-00004-of-00004.safetensors finetuned_gemma/tokenizer_config.json finetuned_gemma/model.safetensors.index.json finetuned_gemma/config.json…