I want to read multiple text file from s3 bucket which will make up a data frame of 10M records and 900 columns. But it is taking too long to read data using ml.p3.2xlarge instance. Moreover, I would like to…
I'm getting the following message while running the Sagemaker SDK on my lambda function. I have installed the correct libraries that are comparable with python 3.11 and the lambda. The log data from lambda: sagemaker.config INFO - Not applying SDK…
I am not able to run from sagemaker.predictor import csv_serializer Following is the import error I am getting. ImportError: cannot import name 'csv_serializer' from 'sagemaker.predictor' (/home/ec2-user/anaconda3/envs/python3/lib/python3.10/site-packages/sagemaker/predictor.py) I tried running following command on notebook instance in sagemaker. !{sys.executable} -m pip install…
I'm not able to associate a new role for my EC2 instance created via : CreatePresignedNotebookInstanceUrl. I've created a notebook instance via sagemaker like here : cloud.hacktricks.xyz. I've got my EC2 instance hosted in an AWS-owned account. When I do…
I am trying to test https://aws.amazon.com/blogs/machine-learning/llama-2-foundation-models-from-meta-are-now-available-in-amazon-sagemaker-jumpstart/ llama2 model on sagemaker studio. I am able to run the code in sagemkaer notebook and when I run it it gives me endpoints a well. So I have endpoint link. Usually when I…
As AWS administrator, how I can limit the sagemaker instances running ti me for users. SO, each user can run notebook instances or training job for a specified limited time.? Thanks in advance I could limit the instance type using…
I have seen answers to this question and the answer is always that these files are located in /home/ec2-user/Sagemaker/ however when I'm in Terminal in Sagemaker Studio I don't see this. It seems that Sagemaker Studio has a different directory…
I am creating a Lambda function to start one SageMaker notebook instance as following: import boto3 import logging def lambda_handler(event, context): client = boto3.client('sagemaker') client.start_notebook_instance(NotebookInstanceName='experiment') return 0 I want to pass some information from event (e.g., S3 bucket name and…
I trained a sklearn model and stored it as a .joblib file. This is a large model, about 13.5 gb big. You can download it here This is my script to train the model: import os import pickle import pandas…
I have a notebook on Sagemaker notebook instance that runs some logic and updated files on S3 accordingly. I would like to automate that notebook to run at scheduled times. I copied the script to S3 and created a lambda…