Compute environments
Your Modelbit deployments can be configured to run in different compute environments with different capabilities.
The default compute environment is the multi-core CPU
environment. You can change the compute environment of any version of any deployment after it is deployed. You can also set the compute environment using git or with the require_gpu
parameter of mb.deploy
.
Different compute environments have different costs. The following table summarizes the capabilities and costs of each environment:
Compute Environment | GPU | Cost Factor |
---|---|---|
CPU | -- | 1 x CPU Rate |
T4 | NVIDIA T4 (16 GB VRAM) | 1 x GPU Rate |
A10G | NVIDIA A10G (24 GB VRAM) | 2 x GPU Rate |