Containers

Job specification
If you need access to any parameters in the job submission (e.g. config), the entire job specification is available at /cortex/spec/job.json in your API containers' filesystems.
Multiple containers
Your Task's pod can contain multiple containers. The /mnt directory is mounted to each container's filesystem, and is shared across all containers.
Observability
See docs for logging, metrics, and alerting.
Using the Cortex CLI or client
It is possible to use the Cortex CLI or client to interact with your cluster's APIs from within your API containers. All containers will have a CLI configuration file present at /cortex/client/cli.yaml, which is configured to connect to the cluster. In addition, the CORTEX_CLI_CONFIG_DIR environment variable is set to /cortex/client by default. Therefore, no additional configuration is required to use the CLI or Python client (which can be instantiated via cortex.client()).
Note: your Cortex CLI or client must match the version of your cluster (available in the CORTEX_VERSION environment variable).
Chaining APIs
It is possible to submit Task jobs from any Cortex API within a Cortex cluster. Jobs can be submitted to http://ingressgateway-operator.istio-system.svc.cluster.local/tasks/<api_name>, where <api_name> is the name of the Task API you are making a request to.
For example, if there is a Task API named hello-world running in the cluster, you can make a request to it from a different API in Python by using:
import requests
​
response = requests.post(
    "http://ingressgateway-operator.istio-system.svc.cluster.local/tasks/hello-world",
    json={"config": {"my_key": "my_value"}},
)
To make requests from your Task API to a Realtime, Batch, or Async API running within the cluster, see the "Chaining APIs" docs associated with the target workload type.

Configuration

Jobs

Last modified 8mo ago

Copy link

Outline

Job specification

Multiple containers

Observability

Using the Cortex CLI or client

Chaining APIs