EC2 instances

There are a variety of instance types to choose from when creating a Cortex cluster. If you are unsure about which instance to pick, review these options as a starting point.

This is not a comprehensive guide so please refer to the AWS's documentation for more information.

Note: There is an instance limit associated with your AWS account for each instance family in each region, for on-demand and for spot instances. You can check your current limit and request an increase here (set the region in the upper right corner to your desired region, type "on-demand" or "spot" in the search bar, and click on the quota that matches your instance type). Note that the quota values indicate the number of vCPUs available, not the number of instances; different instances have a different numbers of vCPUs, which can be seen here.

Instance Type

CPU

Memory

GPU Memory

Starting price per hour*

Notes

T3

low

low

-

$0.0416 (t3.medium)

good for dev clusters

M5

medium

medium

-

$0.096 (m5.large)

standard cpu-based

C5

high

medium

-

$0.085 (c5.large)

high cpu

R5

medium

high

-

$0.126 (r5.large)

high memory

G4

high

high

~15GB (g4dn.xlarge)

$0.526 (g4dn.xlarge)

standard gpu-based

P2

high

very high

~12GB (p2.xlarge)

$0.90 (p2.xlarge)

high host memory gpu-based

Inf1

high

medium

~8GB (inf1.xlarge)

$0.368 (inf1.xlarge)

very good price/performance ratio

* on-demand pricing for the US West (Oregon) AWS region.