699 Commits

Author SHA1 Message Date
wu.chunyang
4deefe3e92 remove unused library
trivial modify

Change-Id: I27d5b85d2c745fee5ff0643e7771b46faebd23a6
2018-12-12 10:30:20 +00:00
Eduardo Gonzalez
1a682fab28 Support stop specific containers
With this change, an operator may be able to stop a
service container without stopping all services in a host.
This change is the starting point to start
fast-forward upgrades support.
In next changes new flags will be introducced to disable
stop dataplane services during upgrades.

Change-Id: Ifde7a39d7d8596ef0d7405ecf1ac1d49a459d9ef
Implements: blueprint support-stop-containers
2018-11-26 08:07:01 +00:00
Nick Jones
f704a78029 Add new option to perform an on-demand backup of MariaDB
blueprint database-backup-recovery

Introduce a new option, mariadb_backup, which takes a backup of all
databases hosted in MariaDB.

Backups are performed using XtraBackup, the output of which is saved to
a dedicated Docker volume on the target host (which defaults to the
first node in the MariaDB cluster).

It supports either full (the default) or incremental backups.

Change-Id: Ied224c0d19b8734aa72092aaddd530155999dbc3
2018-11-22 09:20:59 +00:00
Dat Le
5bbecaa3ed Fix "Error: Connection activation failed: Failed to find a compatible device for this connection"
Change-Id: I7887ff3317f9eac068fee117b493db10b0e97862
2018-11-20 15:00:17 +07:00
Zuul
0bc44c9ae9 Merge "Refactor tests/templates/globals.yml" 2018-11-08 16:33:18 +00:00
Eduardo Gonzalez
26af377a3b Refactor tests/templates/globals.yml
Improve where openstack services are deployed
to a variable, so we will avoid many conditions
when more CI jobs are added with different configs.
Heat is enabled by default in globals.yml, lets deploy it
at least.

Change-Id: If0f009cf434c3ed5874b3171d8c75911ef8e4be1
2018-11-08 10:15:38 +00:00
Michal Nasiadka
9257c18469 Add logs_dir to kolla-ansible CI jobs
Change-Id: Ie3efb4d5de046ba90a72e2d722130a685c4fcabf
2018-11-07 20:30:18 +01:00
Mark Goddard
f92de48c28 Refactor CI testing scripts
This change is intended to ease the addition of new test scenarios, by
splitting the existing setup_gate.sh script up into several smaller
scripts. We may wish to further break these scripts up in future,
depending on the requirements of new test jobs.

Change-Id: Ifa442ac79a54f749c56d20f5f7383c3852d95268
2018-11-06 16:43:19 +00:00
Zuul
f941d47dcb Merge "Don't use 'become' in CI tests" 2018-11-06 16:31:25 +00:00
Hongbin LU
f57c1aec6c Add Zun scenario job for ubuntu
Introduce a job 'kolla-ansible-ubuntu-source-zun' to test kolla
with Zun enabled. To reduce CI resource, this job will be triggered
only if there are changes on the Zun's ansible roles.

Change-Id: I0ba207e1d3761da2d6992c5834d4f59e7e1d6628
2018-10-22 14:24:36 +00:00
Zuul
83de86960c Merge "Use openstackclient instead of neutronclient" 2018-10-22 06:45:31 +00:00
Hongbin Lu
9691d53009 Use openstackclient instead of neutronclient
The python-neutronclient is deprecated. We should use openstackclient
and openstacksdk for the equivalent functionality.

Change-Id: Iaf49d6b7942343104e0b40b6db89b78a793b858b
2018-10-21 19:42:47 +00:00
Zuul
453fca37ad Merge "Revert commit of fixing ceph gates" 2018-10-15 08:39:06 +00:00
Mark Goddard
8399fc7813 Don't use 'become' in CI tests
Kolla Ansible now claims [1] to support executing as a user other than
root.  We should ensure that this is tested in CI.

This change removes the 'become' from hosts in the inventory, and sets
the remote user to 'kolla', as configured via the bootstrap-servers
command. The bootstrap-servers command and other ansible commands
executed before it still need to execute as the zuul user and not as
kolla, since kolla does not exist yet.

The autogenerated SSH private key in passwords.yml is now added to the
zuul user's SSH config, such that it can SSH as the kolla user, which
has authorised this key.

[1]
https://blueprints.launchpad.net/kolla-ansible/+spec/ansible-specific-task-become

Change-Id: I8f3587e2908bc5b8889cd6fbc01981a6186d33e6
2018-10-02 09:30:18 +01:00
Zuul
225d7c70a1 Merge "ovs-dpdkctl.sh function list_dpdk_nics only grabs the first nic" 2018-10-01 10:04:02 +00:00
confi-surya
dfd372b6e2 Revert commit of fixing ceph gates
This patch is to test and revert the change

Change-Id: If930306a357e40ad02c4d7f71779701a9a52b94a
revert: Ie8feb03e9a07a6486a8b375d3304c9e6f1f8b890
2018-09-23 04:29:47 +00:00
Paul Bourke
b163cb02d1 Update rabbitmq to use new conf & clustering
Depends-On: I75e00312b36e1678b90a42cf58d24652323eff27
Change-Id: Ia716fabffca41eff816e59bbf9f4cab79ee8b72f
2018-09-21 16:47:59 +00:00
Zuul
95135e7f03 Merge "Temporarily remove the rabbitmq clusterer plugin" 2018-09-20 07:43:17 +00:00
Mark Goddard
354894e2e9 Add check.yml for prometheus and vitrage
Without this, kolla-ansible check fails with the following error:

Unable to retrieve file contents
Could not find or access '/path/to/kolla-ansible/ansible/check.yml'"}

Also adds the check command to the CI tests, to ensure that it does not
break again.

Change-Id: I9fc2f9999f55cb742ac3ac38579dcf26524a9fc7
Closes-Bug: #1790653
2018-09-04 15:36:34 +01:00
Paul Bourke
0d03fc2789 Temporarily remove the rabbitmq clusterer plugin
In order to migrate to the latest release of rabbitmq (3.7), we need to
first remove this deprecated plugin which is no longer supported (the
problems it solved are now addressed in rabbitmq itself).

This avoids a circular dependency in CI where the new images depend on
the new clustering and the new clustering depends on the new images.

Change-Id: I921459f3e40b9e0d4af9497384e49aabf0abe79b
2018-08-21 11:24:09 +00:00
Mark Goddard
c71de0e2c9 Fix the name of the CI log for reconfigure
The reconfigure output was previously overwriting the post-deploy
output.

Change-Id: Idada4b0b1d34b6a37a99f022407c74aff043497a
2018-08-02 15:59:39 +01:00
Eduardo Gonzalez
8998877021 Fix ceph gates
Cinder removed some parameters from the API.
Openstack client is not updated yet and failing.

Revert this change once is fixed.

Change-Id: Ie8feb03e9a07a6486a8b375d3304c9e6f1f8b890
2018-08-01 12:20:27 +02:00
Eduardo Gonzalez
cc5cdba7c8 Fix depends on kolla changes
Depends on needs chrony image to succeed deploy

Change-Id: Id4bcbffad2392d8b2dabd8359330139448c6f7b7
2018-07-31 10:12:48 +02:00
Zuul
c7cbb4f488 Merge "Update the help text of init-runonce" 2018-07-31 05:38:45 +00:00
chenxing
380647ffb5 Update the help text of init-runonce
openrc should be admin-openrc.sh

Change-Id: I9b3d874fe39488206ce880247b51d0a26826eeb6
2018-07-27 09:39:17 +08:00
Jeffrey Zhang
b51eeed89e Use include_tasks instead of include
include is marked as deprecated since ansible 2.4[0]

[0] https://docs.ansible.com/ansible/2.4/include_module.html#deprecated

Co-Authored-By: confi-surya <singh.surya64mnnit@gmail.com>
Change-Id: Ic9d71e1865d1c728890625aeddf424a5734c0a8a
2018-07-25 23:57:22 +08:00
Zuul
bf709bf542 Merge "Fix pre-commit-hook can't work" 2018-07-23 07:40:54 +00:00
Zuul
7c8b0e704e Merge "Add safe shutdown systemd jobs to tools" 2018-07-23 03:15:54 +00:00
Clint Byrum
d648be03ec Add safe shutdown systemd jobs to tools
Without these jobs, a compute node that is rebooted or powered off may
violently kill off the VMs running inside of it. This has been kept
separate from the main portion of kolla-ansible since no current role
modifies the systemd jobs of the system.

Change-Id: I0a4424f97b5ad872ff0398258c1dc42d31d0ef07
2018-07-21 00:43:50 +00:00
Zuul
4b6a913653 Merge "Allow passing forks to kolla-ansible script" 2018-07-18 17:24:01 +00:00
Clint Byrum
7321fe772d Allow passing forks to kolla-ansible script
For large installations it makes sense to use a higher number of forks
than the default.

Change-Id: I34cdc146a4ed2185fb36fbb34ab72916ec98bee5
2018-07-16 17:40:51 +00:00
MinSun
f692b4c9ac Make nova nova_instance_datadir_volume configurable.
User can use custom directory for nova instance.
For example using a shared file system as backend.

Change-Id: I11fe4891719a2e2a34888d8b798df5602e294e4f
2018-07-05 10:16:59 +08:00
Zuul
fd3f54faed Merge "Add a job for testing deployment of bifrost" 2018-07-04 15:51:45 +00:00
yuqian
8f156691ce fixed destroy confirmation no properly evaluated
To destroy a kolla-ansible environment a confirmation string should be passed
along with kolla-ansible command: kolla-ansible destroy -i ~/multinode \
--yes-i-really-really-mean-it
However, this string is not evaluated right and just putting --y starts destroy
process: ./kolla-ansible destroy -i ~/multinode --y

Change-Id: I5983f9c7fd3859d60741dfd23ad10dfd91872eeb
Closes-Bug: #1701313
2018-07-02 14:08:54 +08:00
Liping Mao (limao)
6531dc9668 Fix pre-commit-hook can't work
remove unused validate-all-json.sh and validate-all-dockerfiles.

Change-Id: Ia534c200f771c23d015ab32b0cc952ca36354451
Closes-Bug: #1778146
2018-06-24 15:32:50 +08:00
Mark Goddard
45a4f9c075 Add a job for testing deployment of bifrost
Deploys a bifrost container using kolla-ansible bifrost-deploy.

IPA and disk images are downloaded rather than built to improve
reliability.

Currently only minimal testing of the deployment is performed, creating
and deleting an ironic node. Ideally we would perform a bare metal node
deployment.

The job is based on CentOS, as Ubuntu bifrost deployment is currently
failing with a python-MySQLdb error.

Change-Id: Ic45094594c21116b5b0d6a606f568fc7954175e3
2018-06-18 13:40:43 +01:00
Zuul
7cfeffaa35 Merge "ovs-dpdkctl.sh syntax error" 2018-06-12 07:30:54 +00:00
Borne Mace
c7c61fca06 Avoid removing kolla-cli directories on destroy
When running the kolla-ansible destroy playbook most of the files
under /etc/kolla are cleaned up.  This change will cause the
clean-up to skip the kolla-cli related directories.  When running
the deployment code in a container or a separate VM this is not
an issue, but when doing an all-in-one or running the deployment
process from one of the systems being deployed onto it would have
previously destroyed the kolla-cli inventory and any generated
certificates used for TLS.

Change-Id: Icd62e177964b8fb31052131785c6d7b138975a28
2018-06-07 13:44:24 -07:00
Jeffrey Zhang
4ab76ed9e1 Put upper limit on cmd2 in kolla-toolbox
This fixes an issue with cmd2 >= 0.9.0 requiring python3.

Change-Id: I5f88f0b0540785f8e7b7ab7c5252c6a51f314922
Closes-Bug: #1773938
2018-05-30 16:00:58 +08:00
johjuhyun
6f398cefb6 ovs-dpdkctl.sh syntax error
ovs-dpdkctl.sh doesn't work properly

Closes-Bug: #1770045
Change-Id: Ia450553296f7613f4883b79e9dd1eb3bc950e9c6
Signed-off-by: johjuhyun <juhyun.joh@samsung.com>
2018-05-12 03:31:03 +00:00
Jeffrey Zhang
c567055176 Fix ansible warning
- rename action and serial to kolla_ansible and kolla_serial
- use become instead of "sudo <command>" in shell
- Remove quota for failed_when and changed_when in rabbitmq tasks

Change-Id: I78cb60168aaa40bb6439198283546b7faf33917c
Implements: blueprint migrate-to-ansible-2-2-0
2018-05-11 02:54:02 +00:00
Jorge Niedbalski
6c5a6c65f1 Enforce removal of container network namespace.
This patch enforces the removal of the container
network namespace when the environment is destroyed.

Closes-Bug: #1769651

Change-Id: I9b0bbbb5a59e6067a745635c555051ef97b79f9a
Signed-off-by: Jorge Niedbalski <jorge.niedbalski@linaro.org>
2018-05-07 16:23:02 -03:00
ZhijunWei
44b49adda1 Add test for credentials set
the /etc/kolla/adminrc.sh should be export before
init vpn script, this ps to add test for credentials
set to avoid it missing.

Change-Id: Ib849d5f5804221c507c2466f2f08179340188c24
2018-04-28 15:43:06 +00:00
Paul Bourke
e5a8481847 Simplify init-runonce boot command
openstack cli now supports --network foo rather than having to find the
network uuid. Thanks to mgoddard for the tip.

Change-Id: I9ce94a86c6950b81ef3ec70fe10ee565cc1f1171
2018-04-13 17:17:04 +01:00
Jeffrey Zhang
def7d35404 Implement ARA sqlite databases over http feature
More info please check[0][1].

[0] http://lists.openstack.org/pipermail/openstack-dev/2018-March/128902.html
[1] https://ara.readthedocs.io/en/latest/advanced.html

Change-Id: I5cf68c0bb54878e328387143712dec9582be04a1
2018-04-02 14:13:54 +08:00
Eduardo Gonzalez
ea1a1dee0d Verify YAML syntax in gates
This patchset implements yamllint test to all *.yml
files.

Also fixes syntax errors to make jobs to pass.

Change-Id: I3186adf9835b4d0cada272d156b17d1bc9c2b799
2018-03-26 17:56:22 +02:00
Zuul
378b8dd932 Merge "Use local cirros image if available" 2018-02-27 05:18:55 +00:00
Zuul
39d9327d29 Merge "Fixes ceph deploy gates" 2018-01-25 14:46:34 +00:00
Zuul
3318cbd19b Merge "Support policy.yaml file [part 8]" 2018-01-24 14:07:54 +00:00
Eduardo Gonzalez
e0d37de9d0 Fixes ceph deploy gates
- Ceph images are not being built when using depends-on a kolla build
  job.
- Sync inventory files with current ones which causes ceph to fail due
  missing groups.
- Small corrections in ceph config.yml syntax.
- fix preparse the disk only once
- enable ceph nfs only when enable_ceph_nfs is true

Co-Authored-By: Jeffrey Zhang <zhang.lei.fly@gmail.com>
Change-Id: Id0c7963bf59e2af4944834dcd16589a638e78ba5
2018-01-24 15:10:01 +08:00