Search…
EC2 instances
There are a variety of instance types to choose from when creating a Cortex cluster. If you are unsure about which instance to pick, review these options as a starting point.
This is not a comprehensive guide so please refer to the AWS's documentation for more information.
Note: There is an instance limit associated with your AWS account for each instance family in each region, for on-demand and for spot instances. You can check your current limit and request an increase here (set the region in the upper right corner to your desired region, type "on-demand" or "spot" in the search bar, and click on the quota that matches your instance type). Note that the quota values indicate the number of vCPUs available, not the number of instances; different instances have a different numbers of vCPUs, which can be seen here.
Instance Type
CPU
Memory
GPU Memory
Starting price per hour*
Notes
T3
low
low
-
$0.0416 (t3.medium)
good for dev clusters
M5
medium
medium
-
$0.096 (m5.large)
standard cpu-based
C5
high
medium
-
$0.085 (c5.large)
high cpu
R5
medium
high
-
$0.126 (r5.large)
high memory
G4
high
high
~15GB (g4dn.xlarge)
$0.526 (g4dn.xlarge)
standard gpu-based
P2
high
very high
~12GB (p2.xlarge)
$0.90 (p2.xlarge)
high host memory gpu-based
Inf1
high
medium
~8GB (inf1.xlarge)
$0.368 (inf1.xlarge)
very good price/performance ratio
* on-demand pricing for the US West (Oregon) AWS region.
Last modified 10mo ago
Copy link