Caelus
Caelus is a set of Kubernetes solutions for reusing idle resources of nodes by running extra batch jobs, these resources come from the underutilization of online jobs, especially during low traffic periods. To make batch jobs compatible with online jobs, caelus dynamically manages multiple resource isolation mechanisms and also checks abnormalities of various metrics. Batch jobs will be throttled or even killed if interference detected.
Features
-
Collect various metrics, including node resources, cgroup resources and online jobs latency
-
Batch jobs could be running on YARN or Kubernetes
-
Predict total resource usages of the node, including online jobs and kernel modules, such as slab
-
Dynamically manage multiple resource isolation mechanisms, such as CPU, memory, and disk space
-
Dynamically check abnormalities of various metrics, such as CPU usage or online jobs latency
-
Throttle or even kill batch jobs when resource pressure or latency spike detected
-
Prometheus metrics supported
-
Alarm supported
Usage
Find more usage at Tutorial.md. The project also have two attached tools:
nm_operator
nm_operator is used to execute YARN commands in the way of remote API.
metric_adapter
metric_adapter is used to collect more application metrics with adapter extension.
Getting started
build
# binary build, which generates binary under _output/bin/
$ make build
# image build
$ make image
# run unit test
$ make test
Run
# running in script
$ caelus --config=hack/config/caelus.json --hostname-override=xxx --v=2
# running in image
$ kubectl create -f hack/yaml/caelus.json
$ kubectl label node colation=true
$ kubectl -n kube-system get daemonset
Contributing
For more information about contributing issues or pull requests, see our Contributing to Caelus.
License
Caelus is under the Apache License 2.0. See the License file for details.
