Files
nodepool/nodepool/tests/fixtures/kubernetes-pool-quota-extra.yaml
James E. Blair ac187302a3 Add extra-resources quota handling to the k8s driver
Some k8s schedulers like run.ai use custom pod annotations rather
than standard k8s resources to specify required resources such as
gpus.  To facilitate quota handling for these resources in nodepool,
this change adds an extra-resources attribute to labels that can be
used to ensure nodepool doesn't try to launch more resources than
can be handled.

Users can already specify a 'max-resources' limit for arbitrary
resources in the nodepool config; this change allows them to also
specify arbitrary resource consumption with 'extra-resources'.

Change-Id: I3d2612a7d168bf415d58029aa295e60c3c83cecd
2023-06-27 14:06:08 -07:00

28 lines
537 B
YAML

zookeeper-servers:
- host: {zookeeper_host}
port: {zookeeper_port}
chroot: {zookeeper_chroot}
zookeeper-tls:
ca: {zookeeper_ca}
cert: {zookeeper_cert}
key: {zookeeper_key}
labels:
- name: pod-fedora
providers:
- name: kubespray
driver: kubernetes
context: admin-cluster.local
pools:
- name: main
max-resources:
mygpu: 2
labels:
- name: pod-fedora
type: pod
image: docker.io/fedora:28
extra-resources:
mygpu: 1