Training job sizes
Choose the right size machine for running your training job.
CPU jobs
The following machine sizes are available for training jobs that only require CPUs. The cost of the job is the Cost Factor multiplied by your per-minute CPU rate.
| Training Job Size | CPUs | GB RAM | Cost Factor | AWS Instance Type |
|---|---|---|---|---|
small | 2 | 15 | 1 | r6id.large |
medium | 4 | 30 | 2 | r6id.xlarge |
large | 8 | 60 | 4 | r6id.2xlarge |
xlarge | 16 | 120 | 8 | r6id.4xlarge |
2xlarge | 32 | 240 | 16 | r6id.8xlarge |
4xlarge | 64 | 480 | 32 | r6id.16xlarge |
GPU jobs
If your training job requires a GPU, use one of the following machine sizes. The cost of the job is the Cost Factor multiplied by your per-minute GPU rate.
| Training Job Size | CPUs | GB RAM | GPU | GB VRAM | GPU Cost Factor | AWS Instance Type |
|---|---|---|---|---|---|---|
gpu_small | 4 | 15 | T4 | 16 | 1 | g4dn.xlarge |
gpu_medium | 16 | 60 | A10G | 24 | 5 | g5.4xlarge |
gpu_large | 32 | 120 | A10G | 24 | 8 | g5.8xlarge |
gpu_xlarge | 16 | 120 | L40S | 48 | 11 | g6e.4xlarge |
gpu_4xlarge | 48 | 350 | 4x L40S | 4x 48 | 34 | g6e.12xlarge |
gpu_8xlarge | 192 | 1430 | 8x L40S | 8x 48 | 96 | g6e.48xlarge |
Other machine types
We are always happy to add larger machines or special hardware for your training job. Please reach out to Modelbit support to provision a machine of your choice!