ed42e5535b
We updated python-base and python-builder to include arm64 images in support of nodepool's arm64 python-builder image. In doing so we have discovered a number of issues, but the biggest is slowness of building python packages in an emulated environment. In order to speed up package builds we consume the OpenDev linaro cloud arm64 wheel cache. This doesn't have wheels for every package we need, but for the things that it does have it will speed up our builds. One of the risks with this setup is that we're relying on wheels built for openstack on arm64 and those follow openstack's contraints. In order to mitigate this risk we set pip install's --prefer-binary flag in the pip.conf. This means that if openstack's constraints lag what is availale on pypi we should use the existing wheels as long as they are valid version according to requirements rather than trying to build from sdist. Co-Authored-By: James E. Blair <corvus@inaugust.com> Co-Authored-By: Ian Wienand <iwienand@redhat.com> Change-Id: I3b358721eebbceafc12daf9d706306634048b196
96 lines
3.3 KiB
Docker
96 lines
3.3 KiB
Docker
# Copyright (c) 2019 Red Hat, Inc.
|
|
#
|
|
# Licensed under the Apache License, Version 2.0 (the "License");
|
|
# you may not use this file except in compliance with the License.
|
|
# You may obtain a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS,
|
|
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
|
# implied.
|
|
# See the License for the specific language governing permissions and
|
|
# limitations under the License.
|
|
|
|
FROM docker.io/opendevorg/python-builder:3.7 as builder
|
|
# ============================================================================
|
|
|
|
ARG ZUUL_SIBLINGS=""
|
|
COPY . /tmp/src
|
|
RUN if [ `uname -m` = "aarch64" ] ; then \
|
|
echo "Installing arm64 pip.conf" ; \
|
|
cp /tmp/src/tools/pip.conf.arm64 /etc/pip.conf ; \
|
|
cp /tmp/src/tools/pip.conf.arm64 /output/pip.conf ; \
|
|
fi
|
|
RUN assemble
|
|
|
|
FROM docker.io/opendevorg/python-base:3.7 as nodepool-base
|
|
# ============================================================================
|
|
|
|
COPY --from=builder /output/ /output
|
|
RUN if [ -f /output/pip.conf ] ; then \
|
|
echo "Installing pip.conf from builder" ; \
|
|
cp /output/pip.conf /etc/pip.conf ; \
|
|
fi
|
|
RUN /output/install-from-bindep nodepool_base
|
|
|
|
RUN useradd -u 10001 -m -d /var/lib/nodepool -c "Nodepool Daemon" nodepool
|
|
|
|
FROM nodepool-base as nodepool
|
|
# ============================================================================
|
|
|
|
CMD ["/usr/local/bin/nodepool"]
|
|
|
|
FROM nodepool-base as nodepool-launcher
|
|
# ============================================================================
|
|
|
|
CMD _DAEMON_FLAG=${DEBUG:+-d} && \
|
|
_DAEMON_FLAG=${_DAEMON_FLAG:--f} && \
|
|
/usr/local/bin/nodepool-launcher ${_DAEMON_FLAG}
|
|
|
|
FROM nodepool-base as nodepool-builder
|
|
# ============================================================================
|
|
|
|
# dib needs sudo
|
|
RUN echo "nodepool ALL=(ALL) NOPASSWD:ALL" > /etc/sudoers.d/nodepool-sudo \
|
|
&& chmod 0440 /etc/sudoers.d/nodepool-sudo
|
|
|
|
# We have some out-of-tree of binary dependencies expressed below:
|
|
#
|
|
# * vhd-util is required to create .vhd images, mostly used in
|
|
# Rackspace. For full details see:
|
|
# https://docs.openstack.org/diskimage-builder/latest/developer/vhd_creation.html
|
|
#
|
|
# * debootstrap unmounts /proc in the container causing havoc when
|
|
# using -minimal elements on debuntu. Two unmerged fixes:
|
|
# https://salsa.debian.org/installer-team/debootstrap/-/merge_requests/26
|
|
# https://salsa.debian.org/installer-team/debootstrap/-/merge_requests/27
|
|
# are incoporated into the openstack-ci-core version
|
|
|
|
COPY tools/openstack-ci-core-ppa.asc /etc/apt/trusted.gpg.d/
|
|
|
|
RUN \
|
|
echo "deb http://ppa.launchpad.net/openstack-ci-core/vhd-util/ubuntu focal main" >> /etc/apt/sources.list \
|
|
&& echo "deb http://ppa.launchpad.net/openstack-ci-core/debootstrap/ubuntu focal main" >> /etc/apt/sources.list \
|
|
&& apt-get update \
|
|
&& apt-get install -y \
|
|
curl \
|
|
debian-keyring \
|
|
git \
|
|
kpartx \
|
|
qemu-utils \
|
|
ubuntu-keyring \
|
|
vhd-util \
|
|
debootstrap \
|
|
procps \
|
|
yum \
|
|
yum-utils \
|
|
zypper \
|
|
&& apt-get clean \
|
|
&& rm -rf /var/lib/apt/lists/*
|
|
|
|
CMD _DAEMON_FLAG=${DEBUG:+-d} && \
|
|
_DAEMON_FLAG=${_DAEMON_FLAG:--f} && \
|
|
/usr/local/bin/nodepool-builder ${_DAEMON_FLAG}
|