starlingx/app-intel-device-plugins
Code Issues Proposed changes
master
app-intel-device-plugins/python3-k8sapp-intel-device-plugins-operator/k8sapp_intel_device_plugins_operator/setup.cfg

51 lines
2.1 KiB
INI
Raw Permalink Normal View History

Integration of Intel Device Plugins as a system app This commit creates directory structure and changes for python plugin for Intel Device Plugins. This is basic system application python plugin for app lifecycle management which is defined in the python3-k8sapp-intel-device-plugins-operator directory within the app-intel-device-plugins repo. This enables the intel-device-plugins-operator which generates the custom resource definitions (CRDs) for device plugins like QAT and GPU. Based on that, QAT and GPU plugins will be enabled. In the upcoming code review, app label, tolerations and affinity will be implemented as part of Helm configuration for QAT and GPU plugins. Test Plan: PASSED: Build process is successful with creation of debian package. PASSED: Extract the content of stx-intel-device-plugins-helm_1.0-1.stx.1_amd64.deb and check if the helm tar file is present. PASSED: AIO-SX app upload using 'system application-upload' command. PASSED: AIO-DX app upload using 'system application-upload' command. PASSED: AIO-SX app apply using 'system application-apply' command. PASSED: AIO-DX app apply using 'system application-apply' command. PASSED: Tested app upload/apply/remove/delete in AIO-SX and AIO-DX. Story: 2010604 Task: 48793 Change-Id: I0940704787035bfb250ab1b83f7156f150d84afc Signed-off-by: Md Irshad Sheikh <mdirshad.sheikh@windriver.com>
2023-10-13 10:00:57 +00:00
[metadata]
name = k8sapp-intel-device-plugins-operator
summary = StarlingX sysinv extensions for intel-device-plugins-operator
long_description = file: README.rst
long_description_content_type = text/x-rst
license = Apache 2.0
author = StarlingX
author-email = starlingx-discuss@lists.starlingx.io
home-page = https://www.starlingx.io/
classifier =
Environment :: OpenStack
Intended Audience :: Information Technology
Intended Audience :: System Administrators
License :: OSI Approved :: Apache Software License
Operating System :: POSIX :: Linux
Programming Language :: Python
Programming Language :: Python :: 2
Programming Language :: Python :: 2.7
Programming Language :: Python :: 3
Programming Language :: Python :: 3.4
Programming Language :: Python :: 3.5
Programming Language :: Python :: 3.9
[files]
packages =
k8sapp_intel_device_plugins_operator
[global]
setup-hooks =
pbr.hooks.setup_hook
[entry_points]
systemconfig.helm_applications =
intel-device-plugins-operator = systemconfig.helm_plugins.intel_device_plugins_operator
systemconfig.helm_plugins.intel_device_plugins_operator =
001_intel-device-plugins-operator = k8sapp_intel_device_plugins_operator.helm.intel_device_plugins_operator:IntelDevicePluginsOperatorHelm
Add QAT plugin to app-intel-device-plugins This commit adds helm chart of the QAT plugin to the Intel Device Plugins app. Also it adds FluxCDKustomizeOperator plugin that supports enabling/disabling helm charts dynamically based on the platform configuration. Also this commit adds code to label the node with the help of NFD (Node Feature Discovery) app. Node Feature Rule is defined in qat.yaml file which recognizes the device id of QAT hardware and label the node with intel.feature.node.kubernetes.io/qat: "true". nodeSelector is used to match the label and create the pod of QAT plugin in the node where the QAT devices (hardware) exists. So NodeAffinity and Tolerations are not required to use. Test Plan: PASSED: Build process is successful with creation of debian package. PASSED: Extract the content of stx-intel-device-plugins-helm_1.0-1.stx.1_amd64.deb and check if the helm tar file is present. PASSED: Upload using 'system application-upload' command PASSED: Check the status of charts using below command, it should be disabled. "system helm-override-list app_name --long" PASSED: Enable the charts using below command: "system helm-chart-attribute-modify --enabled true app_name chart_name namespace" PASSED: Apply the app using "system application-apply" command PASSED: Testing on QAT supported hardware (AIO-SX): After apply, QAT pod should be running. Verify using below command. "kubectl get pods -A | grep qat" PASSED: Testing on QAT not supported hardware (AIO-SX): After apply, Daemonset should be running, but qat plugin pod should not be created. Verify using below command. "kubectl get ds -A | grep qat" PASSED: Tested app upload/apply/remove/delete in AIO-SX. PASSED: Tested app version using command "system application-update". Story: 2010604 Task: 49007 Change-Id: I7b993486b1ae508626ede2b41dc358f8654fe734 Signed-off-by: Md Irshad Sheikh <mdirshad.sheikh@windriver.com>
2023-10-27 08:27:49 -04:00
002_intel-device-plugins-qat = k8sapp_intel_device_plugins_operator.helm.intel_device_plugins_qat:IntelDevicePluginsQatHelm
Add DSA plugin to app-intel-device-plugins This commits adds helm chart of Intel DSA (Data Streaming Accelerator) plugin to Intel Device Plugins app. Intel DSA is a high-performance data copy and transformation accelerator integrated into processors starting with 4th Generation Intel Xeon processors. It is targeted for optimizing streaming data movement and transformation operations common with applications for high-performance storage, networking, persistent memory, and various data processing applications. The Intel DSA device plugin discovers DSA work queues and presents them as node resources. This commit also overrides default dsa helm chart value for nodeFeatureRule to true, which labels the node with the help of NFD (Node Feature Discovery) app. Node Feature Rule is defined in dsa.yaml file which recognizes the device id of DSA hardware and label the node with intel.feature.node.kubernetes.io/dsa: "true". nodeSelector is used to match the label and create the pod of DSA plugin in the node where the DSA devices (hardware) exists. So NodeAffinity and Tolerations are not required to use. Moreover, this commit patches the upstream helm chart to allow a custom configuration for DSA device by setting the overrideConfig value via system helm-chart-overrides. The default config is based on upstream intel-device-plugins repository: https://github.com/intel/intel-device-plugins-for-kubernetes/blob/release-0.29/deployments/dsa_plugin/overlays/dsa_initcontainer/dsa-config.yaml Test Plan: PASS: Build process is successful with creation of debian package. PASS: Extract the content of stx-intel-device-plugins-helm_*.deb and check if the dsa helm tar file is present. PASS: Upload using 'system application-upload' command PASS: Check the status of charts using below command, it should be disabled. "system helm-override-list app_name --long" PASS: Enable the charts using below command: "system helm-chart-attribute-modify --enabled true app_name chart_name namespace" PASS: Apply the app using "system application-apply" command PASS: Testing on DSA supported hardware (AIO-SX): After apply, DSA sample pod should be running. Verify using below command: "kubectl get pods -A | grep dsa" PASS: Testing on DSA not supported hardware (AIO-SX): After apply, Daemonset should be running, but dsa plugin pod should not be created. Verify using below command. "kubectl get ds -A | grep dsa" PASS: Tested app upload/apply/remove/delete in AIO-SX. PASS: Override DSA config and confirm that it is applied via idxd-initcontainer after system application-apply Story: 2011040 Task: 49559 Change-Id: I8bdb615ffd2b0a7d304a47e6056a8b67c1e8fd9a Signed-off-by: Alyson Deives Pereira <alyson.deivespereira@windriver.com>
2024-02-02 16:48:04 -03:00
003_intel-device-plugins-dsa = k8sapp_intel_device_plugins_operator.helm.intel_device_plugins_dsa:IntelDevicePluginsDsaHelm
Certificate management for intel-device-plugins-operator 1. Added patches to intel-device-plugins-operator helm charts to change the issuer to point to system-local-ca. 2. SecretObserver sidecar POD integration SecretObserver sidecar POD is added to the helm chart and configured to monitor a change to the certificate secret and restart the deployment if/when it changes. Test Plan: PASSED: Build process is successful with creation of debian package. PASSED: Extract the content of stx-intel-device-plugins-helm_*amd64.deb and check if the helm tar file is present. PASSED: Upload using 'system application-upload' command PASSED: Apply the app using "system application-apply" command PASSED: Verified the QAT Pod is up and running fine PASSED: Tested app upload/apply/remove/delete in AIO-SX. PASSED: Manually updated the certificate time stamp and verified the deployment restart Depends-On: https://review.opendev.org/c/starlingx/helm-charts/+/917412 Story: 2010604 Task: 49988 Change-Id: I782f2c2f46ebac3493dd5eb3d1ac5ffe91d18bec Signed-off-by: Sabyasachi Nayak <sabyasachi.nayak@windriver.com>
2024-05-06 22:37:38 -04:00
004_secret-observer = k8sapp_intel_device_plugins_operator.helm.secret_observer:SecretObserverHelm
Add GPU plugin to app-intel-device-plugins This commit adds helm chart of the GPU plugin to the Intel Device Plugins app. TEST CASES: PASSED: Build is success. PASSED: Extract the content of stx-intel-device-plugins-helm_*amd64.deb and check if the helm tar file is present. PASSED: Upload using 'system application-upload' command PASSED: Check the status of charts using below command, it should be disabled. "system helm-override-list app_name --long" PASSED: Enable the charts using below command: "system helm-chart-attribute-modify --enabled true app_name chart_name namespace" PASSED: Apply the app using "system application-apply" command PASSED: Check the daemonset of GPU using command: "kubectl get ds -n intel-device-plugins-operator". Status is in pending state because of no GPU hardware available. PASSED: Tested app upload/apply/remove/delete in AIO-SX. Story: 2010604 Task: 49075 Change-Id: Idac5be302f209b2fcdd1b40c0d1dd9b1d08f18dc Signed-off-by: Md Irshad Sheikh <mdirshad.sheikh@windriver.com>
2024-06-05 05:48:05 -04:00
005_intel-device-plugins-gpu = k8sapp_intel_device_plugins_operator.helm.intel_device_plugins_gpu:IntelDevicePluginsGpuHelm
Add QAT plugin to app-intel-device-plugins This commit adds helm chart of the QAT plugin to the Intel Device Plugins app. Also it adds FluxCDKustomizeOperator plugin that supports enabling/disabling helm charts dynamically based on the platform configuration. Also this commit adds code to label the node with the help of NFD (Node Feature Discovery) app. Node Feature Rule is defined in qat.yaml file which recognizes the device id of QAT hardware and label the node with intel.feature.node.kubernetes.io/qat: "true". nodeSelector is used to match the label and create the pod of QAT plugin in the node where the QAT devices (hardware) exists. So NodeAffinity and Tolerations are not required to use. Test Plan: PASSED: Build process is successful with creation of debian package. PASSED: Extract the content of stx-intel-device-plugins-helm_1.0-1.stx.1_amd64.deb and check if the helm tar file is present. PASSED: Upload using 'system application-upload' command PASSED: Check the status of charts using below command, it should be disabled. "system helm-override-list app_name --long" PASSED: Enable the charts using below command: "system helm-chart-attribute-modify --enabled true app_name chart_name namespace" PASSED: Apply the app using "system application-apply" command PASSED: Testing on QAT supported hardware (AIO-SX): After apply, QAT pod should be running. Verify using below command. "kubectl get pods -A | grep qat" PASSED: Testing on QAT not supported hardware (AIO-SX): After apply, Daemonset should be running, but qat plugin pod should not be created. Verify using below command. "kubectl get ds -A | grep qat" PASSED: Tested app upload/apply/remove/delete in AIO-SX. PASSED: Tested app version using command "system application-update". Story: 2010604 Task: 49007 Change-Id: I7b993486b1ae508626ede2b41dc358f8654fe734 Signed-off-by: Md Irshad Sheikh <mdirshad.sheikh@windriver.com>
2023-10-27 08:27:49 -04:00
systemconfig.fluxcd.kustomize_ops =
intel-device-plugins-operator = k8sapp_intel_device_plugins_operator.kustomize.kustomize_intel_device_plugins:IntelDevicePluginsFluxCDKustomizeOperator
Integration of Intel Device Plugins as a system app This commit creates directory structure and changes for python plugin for Intel Device Plugins. This is basic system application python plugin for app lifecycle management which is defined in the python3-k8sapp-intel-device-plugins-operator directory within the app-intel-device-plugins repo. This enables the intel-device-plugins-operator which generates the custom resource definitions (CRDs) for device plugins like QAT and GPU. Based on that, QAT and GPU plugins will be enabled. In the upcoming code review, app label, tolerations and affinity will be implemented as part of Helm configuration for QAT and GPU plugins. Test Plan: PASSED: Build process is successful with creation of debian package. PASSED: Extract the content of stx-intel-device-plugins-helm_1.0-1.stx.1_amd64.deb and check if the helm tar file is present. PASSED: AIO-SX app upload using 'system application-upload' command. PASSED: AIO-DX app upload using 'system application-upload' command. PASSED: AIO-SX app apply using 'system application-apply' command. PASSED: AIO-DX app apply using 'system application-apply' command. PASSED: Tested app upload/apply/remove/delete in AIO-SX and AIO-DX. Story: 2010604 Task: 48793 Change-Id: I0940704787035bfb250ab1b83f7156f150d84afc Signed-off-by: Md Irshad Sheikh <mdirshad.sheikh@windriver.com>
2023-10-13 10:00:57 +00:00
systemconfig.app_lifecycle =
intel-device-plugins-operator = k8sapp_intel_device_plugins_operator.lifecycle.lifecycle_intel_device_plugins_operator:IntelDevicePluginsAppLifecycleOperator
[wheel]
universal = 1
Copy Permalink