Question 95433 in Amazon Web Sevices Question posted in
The official Amazon Web Services documentation can be found here.

Does SageMaker built-in LightGBM algorithm support distributed training? – Amazon web services

Does Amazon SageMaker built-in LightGBM algorithm support distributed training?

I use Databricks for distributed training of LightGBM today. If SageMaker built-in LightGBM supports distributed training, I would consider migrating to SageMaker. It is not clear in the Amazon SageMaker’s built-in LightGBM‘s documentation on whether it supports distributed training.

Thanks very much for any suggestion or clarification on this.

Tags:

3

Answers


  1. 0

    Currently SageMaker LightGBM doesn’t support distributed training.

    Login or Signup to reply.
  2. 0

    I went through the LightGBM section of SageMaker documentation and there are no references that it supports distributed training. One of the example here uses single instance type. Also looked at lightGBM documentation here . Here are the parameters that you need to specify

    tree_learner=your_parallel_algorithm,

    num_machines=your_num_machines,

    Given I couldnt find any reference of above in SageMaker documentation, I assume its not supported.

    Login or Signup to reply.
  3. 0

    https://aws.amazon.com/blogs/machine-learning/amazon-sagemaker-built-in-lightgbm-now-offers-distributed-training-using-dask/

    SageMaker LightGBM algorithm offers distributed training using the Dask framework for both tabular classification and regression tasks.

    Login or Signup to reply.
Please signup or login to give your own answer.

Back To Top
Search