Using Ubuntu 20.04, Pytorch 1.10.1. I am trying to solve a music generation task with a transformer architecture and multi-embeddings, for processing tokens with several characteristics. In each training iteration, I have to calculate the loss of each token characteristic…
I was training models last night on my Ubuntu workstation, and then woke up this morning and saw this message: Failed to initialize NVML: Driver/library version mismatch Apparently the NVIDIA system driver automatically updated itself, and now I need to…
I am struggling like hell to make old python scripts work, and it is driving me crazy. I truly thought scripts from 4 years ago wouldn't be so hard to run today... So I am trying to run this project…
I am traning YOLOV5 "L6" model for my important project. I have a so huge dataset contains UAV and drone image, and I need the train with huge input dimension (A few months ago I train "M" model with 640x640…
I am using pytorch geometric to train a graph neural network. The problem that led to this question is the following error: RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and…
I want to create a function that labels the location of certain HTML tags (e.g., italics tags) in a string with respect to the locations of characters in a tagless version of the string. (I intend to use this label…
I have a Python script as shown below: import torch from torch.multiprocessing import set_start_method, Pipe, Process def func(conn): data = conn.recv() print(data) if __name__ == "__main__": set_start_method('spawn') a, b = Pipe() data = torch.tensor([1, 2, 3], device='cuda') proc = Process(target=func,…
When trying to use Huggingface estimator on sagemaker, Run training on Amazon SageMaker e.g. # create the Estimator huggingface_estimator = HuggingFace( entry_point='train.py', source_dir='./scripts', instance_type='ml.p3.2xlarge', instance_count=1, role=role, transformers_version='4.17', pytorch_version='1.10', py_version='py38', hyperparameters = hyperparameters ) When I tried to increase the version…
I've trained a segmentation_models_pytorch.PSPNet model for image segmentation. For prediction I load whole image in PyTorch tensor and scan it with 384x384 pixels window. result = model.predict(image_tensor[:, :, y:y+384, x:x+384]) My Windows machine has 6Gb GPU, while Ubuntu has 8…
I am following this tutorial about hardware-accelerated gpu encoding/decoding for PyTorch [https://pytorch.org/audio/main/hw_acceleration_tutorial.html], I am encountering an error with the following code: import torch import torchaudio print(torch.__version__) # 1.14.0.dev20221013+cu116 print(torchaudio.__version__) # 0.13.0.dev20221013+cu116 print(torchaudio._extension._FFMPEG_INITIALIZED) # True from torchaudio.io import StreamReader local_src =…