I have a file in Azure storage that i want to copy to AWS S3 bucket.
I want to have as minimal cost as possible.
I have copied from Azure storage to a local machine and then from local machine to AWS S3 bucket.
But I will be charged twice , copying to local and then to AWS.
Is there a way i can copy straight from Azure to AWS and have one cost ?
I am using the aws az cli and az cli for Azure.
UPDATE:
i HAVE A 150G file
- SAVE IN AZURE STORAGE (COST) ?
- Pull from Azure to local machine (COST) ?
- PULL FROM LOCAL MACHINE TO AWS (COST) ?
whereas if i did the following
- SAVE IN AZURE STORAGE (COST) ?
- Pull from Azure Storage to AWS (COST) ?
The second scenario has one less action ?
2
Answers
You can create a data pipeline in Azure Data Factory to copy data directly from Azure Blob Storage to AWS S3.
https://learn.microsoft.com/en-us/azure/data-factory/connector-amazon-simple-storage-service?tabs=data-factory
Is there a way I can copy straight from Azure to AWS and have one cost?
No. You are using two different services and each will charge you for their part of the copy process.
Azure will charge you for:
AWS will charge you for:
Storage costs are charged "per GB month" based on how long you store the file. Thus, storage costs are not part of the cost of copying the file.