This commit updates the stable-wheels.cfg to align with the
stable/train upper-constraints.txt file, to ensure the train images
built have the proper content:
- If an appropriate prebuilt wheel is available at pypi.org, remove
the entry from stable-wheels.cfg to avoid changing the configured
train constraint.
- If building from a tar or zip and the configured train constraint
has changed, update the entry with the new version.
- Added entres to build pyrsistent, psycopg2, and thriftpy2 from
tarballs, as they are needed for various images and no prebuilt wheels
are available.
Change-Id: I6cebb9a9867c37746500e3d6d4762ed7668d60df
Story: 2006544
Task: 37427
Signed-off-by: Don Penney <don.penney@windriver.com>
The use of pike/master naming when building StarlingX docker images
does not properly reflect the differences in how images are built,
resulting in some confusion for developers. Partly to address this,
and to allow for independence between images, this is being migrated
to use stable/dev build streams.
The stable build stream uses a base image (ie. stx-centos) that has
software repo configuration that points to StarlingX build output as a
source for software package installation. Images that use an upstream
repo as the main project code would generally use a stable branch for
this build stream, as well. For example, once Openstack Stein is
released, the stable builds for StarlingX Openstack services will be
updated to build from a stable/stein branch.
The dev build stream uses only upstream sources for software
installation, with images building from upstream master branches,
generally.
The stx-libvirt image, for example, is built solely from StarlingX
build output, and is therefore built in the stable build stream.
An image lineup for the stx-openstack application could therefore be a
mixture of stable and dev build stream images. The "stable"
application lineup (once we have Stein) would be all stable build
stream images, while the "dev" lineup would be dev build stream images
plus stable images for any that are stable-only (such as stx-libvirt).
To roll out these changes without impacting designers or builds, the
pike/master builds will still be supported for a short period.
This update provides the tool and base configuration changes to
support the introduction of the stable/dev build streams.
Change-Id: Ib5dc9a7c1d8c37368d073e28d83eeb883766ee3f
Story: 2005248
Task: 30098
Signed-off-by: Don Penney <don.penney@windriver.com>
There have been intermittent failures building StarlingX
docker images due to failures to reach the mirrors within
the default timeout, during the formal CENGN builds. This
update adds a step to the docker files for the stx-centos
base image and the base wheel builder image to set a new
timeout value in the yum.conf file, increasing from the
default 30 seconds to 120 seconds.
Change-Id: Ide52cdebb053f639cfe6d4c3a6c5eef71e6fa8ab
Story: 2004751
Task: 29636
Signed-off-by: Don Penney <don.penney@windriver.com>
This update provides the following enhancements to the wheel tools:
- Add a prefix to config files for openstack release
- Change auto-generated version format
- Skip base wheel build if all base wheels are present
- Clean unneeded images from docker after build
- Fix bash globbing issue in get-stx-wheels.sh
Change-Id: I17dbf01288c29662fddae4fd3d9d90ab2521037f
Story: 2003907
Task: 27531
Signed-off-by: Don Penney <don.penney@windriver.com>
This update adds tools for building wheels for upstream python
modules, and generating a StarlingX wheels tarball.
Building upstream python modules is done within a docker container,
with a wheels.cfg configuration file that identifies the upstream
sources and expected python wheel output. The build-base-wheels.sh
tool will create the wheel builder image, launch it, and run the
build script.
The get-stx-wheels.sh tool will extract the python wheels built by
the StarlingX load.
The build-wheel-tarball.sh script will combine the wheels from the
base and StarlingX wheel sets into a single tarball that can be used
when building container images for StarlingX services.
Story: 2003907
Task: 27531
Change-Id: Icf6c63699a635d1173dcef9eb1d12ae7c4e39108
Signed-off-by: Don Penney <don.penney@windriver.com>