======= Qinling ======= .. note:: Qinling refers to Qinling Mountains in southern Shaanxi Province in China. The mountains provide a natural boundary between North and South China and support a huge variety of plant and wildlife, some of which is found nowhere else on Earth. Qinling is Function as a Service for OpenStack. This project aims to provide a platform to support serverless functions (like AWS Lambda). Qinling supports different container orchestration platforms (Kubernetes/Swarm, etc.) and different function package storage backends (local/Swift/S3) by nature using plugin mechanism. * Free software: Apache license * Documentation: http://docs.openstack.org/developer/qinling * Source: http://git.openstack.org/cgit/openstack/qinling * Features: https://blueprints.launchpad.net/qinling * Bugs: http://bugs.launchpad.net/qinling Quick Start ~~~~~~~~~~~ Installation ------------ A fast and simple way to try Qinling is to create a Vagrant VM including all related components and dependencies of Qinling service. For your convenience, Qinling team already provide a Vagrantfile in ``tools/vagrant`` folder. Qinling is a FaaS implemented on top of container orchestration system such as Kubernetes, Swarm, etc. Particularly, Kubernetes is a reference backend considering its popularity. So, you need to setup Kubernetes first before installing Qinling. The easiest way to setup Kubernetes is to use `Minikube `_, it runs a single-node Kubernetes cluster inside a VM alongside Qinling vagrant VM, so they can communicate with each other without any network configuration. .. note:: In order to manage resources on Kubernetes, it is recommended to install `kubectl `_ command line tool. After Kubernetes installation, perform the following commands on your local host. #. Setup HTTP proxy to access the Kubernetes API: .. code-block:: console $ kubectl proxy --accept-hosts='.*' --address='0.0.0.0' Starting to serve on [::]:8001 .. end #. Clone Qinling repo and go to ``vagrant`` directory: .. code-block:: console $ git clone https://github.com/LingxianKong/qinling.git $ cd qinling/tools/vagrant .. end #. Modify Qinling sample config file according to your own environment. Suppose your IP address of your local host is ``192.168.200.50``, default Kubernetes API HTTP proxy port is ``8001``, and Qinling vagrant VM IP address is ``192.168.33.18`` (the default value in ``Vagrantfile``): .. code-block:: console $ sed -i 's/KUBERNETES_API_HOST/192.168.200.50/' qinling.conf.sample $ sed -i 's/KUBERNETES_API_PORT/8001/' qinling.conf.sample $ sed -i 's/QINLING_API_ADDRESS/192.168.33.18/' qinling.conf.sample .. end #. Now, start Qinling vagrant VM: .. code-block:: console $ vagrant up .. end Getting started with Qinling ---------------------------- **Currently, RESTful API is the only way to interact with Qinling, python-qinlingclient is still under development.** ``httpie`` is a convenient tool to send HTTP request, make sure you installed ``httpie`` via ``pip install httpie`` before playing with Qinling. Perform following commands on your local host, the process will create runtime/function/execution in Qinling. #. (Optional) Prepare a docker image including development environment for a specific programming language. For your convenience, I already build one (``lingxiankong/python-runtime``) in my docker hub account that you could directly use to create runtime in Qinling. Only ``Python 2`` runtime is supported for now, but it is very easy to add another program language support. If you indeed want to build a new image, run the following commands in ``qinling`` repo directory, replace ``DOCKER_USER`` with your own docker hub username: .. code-block:: console $ cd runtimes/python2 $ docker build -t DOCKER_USER/python-runtime . $ docker push DOCKER_USER/python-runtime .. end #. Create runtime. A runtime in Qinling is running environment for a specific language, this resource is supposed to be created/deleted/updated by cloud operator. After creation, check the runtime status is ``available``: .. code-block:: console $ http POST http://192.168.33.18:7070/v1/runtimes name=python2.7 \ image=DOCKER_USER/python-runtime HTTP/1.1 201 Created Connection: keep-alive Content-Length: 194 Content-Type: application/json Date: Fri, 12 May 2017 04:37:08 GMT { "created_at": "2017-05-12 04:37:08.129860", "id": "c1d78623-56bf-4487-9a72-1299b2c55e65", "image": "DOCKER_USER/python-runtime", "name": "python2.7", "project_id": "default", "status": "creating" } $ http GET http://192.168.33.18:7070/v1/runtimes/c1d78623-56bf-4487-9a72-1299b2c55e65 HTTP/1.1 200 OK Connection: keep-alive Content-Length: 246 Content-Type: application/json Date: Fri, 12 May 2017 04:37:50 GMT { "created_at": "2017-05-12 04:37:08", "description": null, "id": "c1d78623-56bf-4487-9a72-1299b2c55e65", "image": "DOCKER_USER/python-runtime", "name": "python2.7", "project_id": "default", "status": "available", "updated_at": "2017-05-12 04:37:08" } .. end #. Create a customized function package: .. code-block:: console $ mkdir ~/qinling_test $ cat < ~/qinling_test/main.py import requests def main(): r = requests.get('https://api.github.com/events') return len(r.json()) if __name__ == '__main__': main() EOF $ pip install requests -t ~/qinling_test $ zip ~/qinling_test/qinling_test.zip ~/qinling_test/* .. end #. Create function, ``runtime_id`` comes from the output of above command: .. code-block:: console $ http -f POST http://192.168.33.18:7070/v1/functions name=github_test \ runtime_id=c1d78623-56bf-4487-9a72-1299b2c55e65 \ code='{"package": "true"}' \ package@~/qinling_test/qinling_test.zip HTTP/1.1 201 Created Connection: keep-alive Content-Length: 234 Content-Type: application/json Date: Fri, 12 May 2017 04:49:59 GMT { "code": { "package": "true" }, "created_at": "2017-05-12 04:49:59.659345", "description": null, "entry": "main", "id": "352e4c02-3c6b-4860-9b85-f72344b1f986", "name": "github_test", "runtime_id": "c1d78623-56bf-4487-9a72-1299b2c55e65" } .. end #. Invoke the function by specifying ``function_id``: .. code-block:: console $ http POST http://192.168.33.18:7070/v1/executions \ function_id=352e4c02-3c6b-4860-9b85-f72344b1f986 HTTP/1.1 201 Created Connection: keep-alive Content-Length: 255 Content-Type: application/json Date: Thu, 11 May 2017 23:46:12 GMT { "created_at": "2017-05-12 04:51:10", "function_id": "352e4c02-3c6b-4860-9b85-f72344b1f986", "id": "80cd55be-d369-49b8-8bd5-e0bfc1d20d25", "input": null, "output": "{\"result\": 30}", "status": "success", "sync": true, "updated_at": "2017-05-12 04:51:23" } .. end If you invoke the same function again, you will find it is much faster thanks to Qinling cache mechanism.