skip to Main Content

Ubuntu – How to fix Segmentation fault when training GPT-2 model using Hugging Face Transformers?

I'm trying to fine-tune a GPT-2 model using the Hugging Face Transformers library, but I'm encountering a segmentation fault during training. Here's a minimal reproducible example: import torch from transformers import GPT2Tokenizer, GPT2LMHeadModel, Trainer, TrainingArguments, DataCollatorForLanguageModeling from datasets import load_dataset…

VIEW QUESTION

Amazon web services – Problem with deploying finetuned gemma in AWS sagemaker as an endpoint

I have finetuned a gemma 7b LLM from HuggingFace using Lora and stored the model as a compressed .tar.gz file. I have finetuned locally in sagemaker. this is my .tar.gz file structure of finetuned model : finetuned_gemma/model-00004-of-00004.safetensors finetuned_gemma/tokenizer_config.json finetuned_gemma/model.safetensors.index.json finetuned_gemma/config.json…

VIEW QUESTION
Back To Top
Search