I’ve been using SageMaker for a while and have performed several experiments already with distributed training. I am wondering if it is possible to test and run SageMaker distributed training in local mode (using SageMaker Notebook Instances)?
Question posted in Amazon Web Sevices
The official Amazon Web Services documentation can be found here.
The official Amazon Web Services documentation can be found here.
2
Answers
No, not possible yet. local mode does not support the distributed training with
local_gpu
for Gzip compression, Pipe Mode, or manifest files for inputsYes, SageMaker supports distributed training in local mode. But as @Philipp Schmid said some other features (like pipemode are not supported).