x/microstack
Code Issues Proposed changes
cbe8209969
microstack/tools/make-a-microstack.sh

71 lines
2.3 KiB
Bash
Raw Normal View History

Refactor snap to work with core18. (#73) Refactor snap to work with core18. Giving the snapcraft.yaml a base property helps tremendously with the efficiency of the build process, and I believe that it puts us in a better position to reliably support non Ubuntu distros going forward. This also bases us on long supported bionic libraries, and gives us a nice place to work from as we add Python 3 and Stein support, as well as general polish and fixes.
2019-06-25 11:31:42 -04:00
#!/bin/bash
##############################################################################
#
Added testing for control nodes Ported basic-test.sh to test_basic.py, and folded in test_horizonlogin.py. Made a testing framework for shared components. Added test_control.py Got rid of default .stestr.conf, as we're going to have multiple tests running, and one conf is confusing. Manually ordering functional tests for now, as stestr noms too much output, and runs things in parallel, which doesn't work for our functional tests. Skipping compute node test for now, as it won't work until we can connect to a control node with databases and such. Moved very-basic-test.sh to tools/make-a-microstack.sh. It's really more of a tool for manual testing than an automated test. Added test-requirements and updated gitignore. Moved auto-detection of kvm extensions to init, rather than test, as it makes more sense there. Change-Id: Iba7f7fe07cbb066790f802cf2a7c87c68994062c
2019-10-09 17:31:31 +00:00
# Make a microstack!
Refactor snap to work with core18. (#73) Refactor snap to work with core18. Giving the snapcraft.yaml a base property helps tremendously with the efficiency of the build process, and I believe that it puts us in a better position to reliably support non Ubuntu distros going forward. This also bases us on long supported bionic libraries, and gives us a nice place to work from as we add Python 3 and Stein support, as well as general polish and fixes.
2019-06-25 11:31:42 -04:00
#
Added testing for control nodes Ported basic-test.sh to test_basic.py, and folded in test_horizonlogin.py. Made a testing framework for shared components. Added test_control.py Got rid of default .stestr.conf, as we're going to have multiple tests running, and one conf is confusing. Manually ordering functional tests for now, as stestr noms too much output, and runs things in parallel, which doesn't work for our functional tests. Skipping compute node test for now, as it won't work until we can connect to a control node with databases and such. Moved very-basic-test.sh to tools/make-a-microstack.sh. It's really more of a tool for manual testing than an automated test. Added test-requirements and updated gitignore. Moved auto-detection of kvm extensions to init, rather than test, as it makes more sense there. Change-Id: Iba7f7fe07cbb066790f802cf2a7c87c68994062c
2019-10-09 17:31:31 +00:00
# This is a tool to very quickly spin up a multipass vm, install
# microstack (from the compiled local .snap), and get a shell in
# microstack's environment.
#
# It requires that you have installed petname.
Refactor snap to work with core18. (#73) Refactor snap to work with core18. Giving the snapcraft.yaml a base property helps tremendously with the efficiency of the build process, and I believe that it puts us in a better position to reliably support non Ubuntu distros going forward. This also bases us on long supported bionic libraries, and gives us a nice place to work from as we add Python 3 and Stein support, as well as general polish and fixes.
2019-06-25 11:31:42 -04:00
#
##############################################################################
set -ex
DISTRO=18.04
MACHINE=$(petname)
# Make a vm
multipass launch --cpus 2 --mem 16G $DISTRO --name $MACHINE
# Install the snap
Use focal/core20/Ussuri/OVN & enable confinement Major changes: * Plumbing necessary for strict confinement with the microstack-support interface https://github.com/snapcore/snapd/pull/8926 * Until the interface is merged, devmode will be used and kernel modules will be loaded via an auxiliary service. * upgraded OpenStack components to Focal (20.04) and OpenStack Ussuri; * reworked the old patches; * added the Placement service since it is now separate; * addressed various build issues due to changes in snapcraft and built dependencies: * e.g. libvirt requires the build directory to be separate from the source directory) and LP: #1882255; * LP: #1882535 and https://github.com/pypa/pip/issues/8414 * LP: #1882839 * LP: #1885294 * https://storyboard.openstack.org/#!/story/2007806 * LP: #1864589 * LP: #1777121 * LP: #1881590 * ML2/OVS replated with ML2/OVN; * dnsmasq is not used anymore; * neutron l3 and DHCP agents are not used anymore; * Linux network namespaces are only used for neutron-ovn-metadata-agent. * ML2 DNS support is done via native OVN mechanisms; * OVN-related database services (southbound and northbound dbs); * OVN-related control plane services (ovn-controller, ovn-northd); * core20 base support (bionic hosts are supported); * the removal procedure now relies on the "remove" hook since `snap remove` cannot be used from the confined environment anymore; * prerequisites to enabling AppArmor confinement for QEMU processes created by the confined libvirtd. * Added the Spice html5 console proxy service to enable clients to retrieve and use it via `microstack.openstack console url show --spice <servername>`. * Added missing Cinder templates and DB migrations for the Cinder DB. * Added experimental support for a loop device-based LVM backend for Cinder. Due to LP: #1892895 this is not recommended to be used in production except for tempest testing with an applied workaround; * includes iscsid and iscsi-tcp kernel module loading; * includes LIO and loading of relevant kernel modules; * An LVM PV is created on top of a loop device with a backing file present in $SNAP_COMMON/cinder-lvm.img; * A VG is created on top of the PV; * LVs are created by Cinder and exported via LIO over iscsi to iscsid which hot-plugs new SCSI devices. Those SCSI devices are then propagated by Nova to libvirt and QEMU during volume attachment; * Added post-deployment testing via rally and tempest (via the microstack-test snap). A set of tests included into Refstack 2018.02 is executed (except for object storage tests due to the lack of object storage support). Change-Id: Ic70770095860a57d5e0a55a8a9451f9db6be7448
2020-05-25 21:51:06 +00:00
multipass copy-files microstack_ussuri_amd64.snap $MACHINE:
Refactor snap to work with core18. (#73) Refactor snap to work with core18. Giving the snapcraft.yaml a base property helps tremendously with the efficiency of the build process, and I believe that it puts us in a better position to reliably support non Ubuntu distros going forward. This also bases us on long supported bionic libraries, and gives us a nice place to work from as we add Python 3 and Stein support, as well as general polish and fixes.
2019-06-25 11:31:42 -04:00
multipass exec $MACHINE -- \
Use focal/core20/Ussuri/OVN & enable confinement Major changes: * Plumbing necessary for strict confinement with the microstack-support interface https://github.com/snapcore/snapd/pull/8926 * Until the interface is merged, devmode will be used and kernel modules will be loaded via an auxiliary service. * upgraded OpenStack components to Focal (20.04) and OpenStack Ussuri; * reworked the old patches; * added the Placement service since it is now separate; * addressed various build issues due to changes in snapcraft and built dependencies: * e.g. libvirt requires the build directory to be separate from the source directory) and LP: #1882255; * LP: #1882535 and https://github.com/pypa/pip/issues/8414 * LP: #1882839 * LP: #1885294 * https://storyboard.openstack.org/#!/story/2007806 * LP: #1864589 * LP: #1777121 * LP: #1881590 * ML2/OVS replated with ML2/OVN; * dnsmasq is not used anymore; * neutron l3 and DHCP agents are not used anymore; * Linux network namespaces are only used for neutron-ovn-metadata-agent. * ML2 DNS support is done via native OVN mechanisms; * OVN-related database services (southbound and northbound dbs); * OVN-related control plane services (ovn-controller, ovn-northd); * core20 base support (bionic hosts are supported); * the removal procedure now relies on the "remove" hook since `snap remove` cannot be used from the confined environment anymore; * prerequisites to enabling AppArmor confinement for QEMU processes created by the confined libvirtd. * Added the Spice html5 console proxy service to enable clients to retrieve and use it via `microstack.openstack console url show --spice <servername>`. * Added missing Cinder templates and DB migrations for the Cinder DB. * Added experimental support for a loop device-based LVM backend for Cinder. Due to LP: #1892895 this is not recommended to be used in production except for tempest testing with an applied workaround; * includes iscsid and iscsi-tcp kernel module loading; * includes LIO and loading of relevant kernel modules; * An LVM PV is created on top of a loop device with a backing file present in $SNAP_COMMON/cinder-lvm.img; * A VG is created on top of the PV; * LVs are created by Cinder and exported via LIO over iscsi to iscsid which hot-plugs new SCSI devices. Those SCSI devices are then propagated by Nova to libvirt and QEMU during volume attachment; * Added post-deployment testing via rally and tempest (via the microstack-test snap). A set of tests included into Refstack 2018.02 is executed (except for object storage tests due to the lack of object storage support). Change-Id: Ic70770095860a57d5e0a55a8a9451f9db6be7448
2020-05-25 21:51:06 +00:00
sudo snap install --dangerous microstack*.snap
multipass exec $MACHINE -- \
sudo snap connect microstack:libvirt
multipass exec $MACHINE -- \
sudo snap connect microstack:netlink-audit
multipass exec $MACHINE -- \
sudo snap connect microstack:firewall-control
multipass exec $MACHINE -- \
sudo snap connect microstack:hardware-observe
multipass exec $MACHINE -- \
sudo snap connect microstack:kernel-module-observe
multipass exec $MACHINE -- \
sudo snap connect microstack:kvm
multipass exec $MACHINE -- \
sudo snap connect microstack:log-observe
multipass exec $MACHINE -- \
sudo snap connect microstack:mount-observe
multipass exec $MACHINE -- \
sudo snap connect microstack:netlink-connector
multipass exec $MACHINE -- \
sudo snap connect microstack:network-observe
multipass exec $MACHINE -- \
sudo snap connect microstack:openvswitch-support
multipass exec $MACHINE -- \
sudo snap connect microstack:process-control
multipass exec $MACHINE -- \
sudo snap connect microstack:system-observe
multipass exec $MACHINE -- \
sudo snap connect microstack:network-control
multipass exec $MACHINE -- \
sudo snap connect microstack:system-trace
multipass exec $MACHINE -- \
sudo snap connect microstack:block-devices
multipass exec $MACHINE -- \
sudo snap connect microstack:raw-usb
multipass exec $MACHINE -- \
sudo snap connect microstack:hugepages-control
# TODO: add the below once the interface is merge into snapd.
# multipass exec $MACHINE -- \
# sudo snap connect microstack:microstack-support
Refactor snap to work with core18. (#73) Refactor snap to work with core18. Giving the snapcraft.yaml a base property helps tremendously with the efficiency of the build process, and I believe that it puts us in a better position to reliably support non Ubuntu distros going forward. This also bases us on long supported bionic libraries, and gives us a nice place to work from as we add Python 3 and Stein support, as well as general polish and fixes.
2019-06-25 11:31:42 -04:00
# Drop the user into a snap shell, as root.
multipass exec $MACHINE -- \
Added testing for control nodes Ported basic-test.sh to test_basic.py, and folded in test_horizonlogin.py. Made a testing framework for shared components. Added test_control.py Got rid of default .stestr.conf, as we're going to have multiple tests running, and one conf is confusing. Manually ordering functional tests for now, as stestr noms too much output, and runs things in parallel, which doesn't work for our functional tests. Skipping compute node test for now, as it won't work until we can connect to a control node with databases and such. Moved very-basic-test.sh to tools/make-a-microstack.sh. It's really more of a tool for manual testing than an automated test. Added test-requirements and updated gitignore. Moved auto-detection of kvm extensions to init, rather than test, as it makes more sense there. Change-Id: Iba7f7fe07cbb066790f802cf2a7c87c68994062c
2019-10-09 17:31:31 +00:00
sudo snap run --shell microstack.init
Refactor snap to work with core18. (#73) Refactor snap to work with core18. Giving the snapcraft.yaml a base property helps tremendously with the efficiency of the build process, and I believe that it puts us in a better position to reliably support non Ubuntu distros going forward. This also bases us on long supported bionic libraries, and gives us a nice place to work from as we add Python 3 and Stein support, as well as general polish and fixes.
2019-06-25 11:31:42 -04:00
Copy Permalink