Machine Learning at AWS

AWS Service Overview

General Purpose Machine Learning Services

Text and Speech Services

Image and Video Services

Toy Services

Other Services

Python API

Services

Performance Experiment with EC2 and LightGBM

Given:

  • LightGBM Classification
  • x_train.shape (13788428, 30)
  • x_val.shape (2433253, 30)
  • y_train.shape (13788428,)
  • y_val.shape (2433253,)
  • num_classes: 401
  • num_boost_round: 4

Results:

  • c5.24xlarge, 4,656 $/h, 96 vCPUs, 2nd Gen Intel Xeon Platinum 8275CL, 3.6 GHz, 192 GiB RAM, time: 512 s
  • m5.8xlarge, 1,84 $/h, 32 vCPUs, Intel Xeon Platinum 8175, 3.1 GHz, 128 GiB RAM, time: 574 s
  • r5.4xlarge, 1,216 $/h, 16 vCPUs, Intel Xeon Platinum 8175, 3.1 GHz, 128 GiB RAM, time: 763 s
  • other server, 4 (8) CPUs, Xeon W-2123, 3.6 GHz, 128 GiB RAM, time: 856 s

Connect

Last modified July 16, 2022: fix headlines in ML doc (a533e7c)