59 Commits

Author SHA1 Message Date
Emilien Macchi
300718bea5 scenario002: disable swift backend for Glance on Ubuntu
UCA contains a wrong version on glance-store that is not working when
running Swift backend.

Until they update the package to 0.13.0, we can't test Swift backend
anymore on Trusty.

Change-Id: I43f64f757cc28232f367a4a454b6e499f31c5fe8
2016-03-07 11:54:22 -05:00
Emilien Macchi
6761b3a5cf Fix CI status on both ubuntu/centos
Both changes need to happen in the same patchset.

1/ centos/workaround: make sure Keystone installed before RabbitMQ

We currently have an issue in Puppet OpenStack CI where DIB image for
centos7 has a modified version of /etc/login.defs that allows RabbitMQ
to steal UID of OpenStack packaging (Keystone most often).

While we are investigating that, this patch is a workaround to make sure
we first install Keystone and then RabbitMQ, on centos7 systems.

2/ disable telemetry tests on Ubuntu.
UCA is currently updating Ceilometer / Aodh and tests are broken now.
Let's skip them.

Change-Id: Ibfc3988a4de47c9d7d97159e7d1c0e57d64979ae
2016-03-03 22:16:24 -05:00
Emilien Macchi
a0c3df6eae scenario002: deploy RabbitMQ with IPv6 binding
* Configure RabbitMQ to bind on IPv6 (scenario002 only).
* Configure OpenStack service to connect with an IPv6 on
  RabbitMQ (scenario002 only).

Change-Id: I0e4ab4b03d7b1c7bb47c55a751bc04f29292a621
2016-03-01 14:32:47 -05:00
Emilien Macchi
4a81d1da98 refactorize SSL configuration
Add config.pp file so we can enable common features (ssl, ipv6, ...)
more easily.
Also move the logic into config.pp so we avoid dupplicated code.

Change-Id: Ib7993ad1fbabfc22dc4ee22f72671303190e39e2
2016-03-01 14:32:08 -05:00
Emilien Macchi
2be3e3f9d2 scenario002: deploy RabbitMQ with SSL
* Manage Puppet OpenStack CI CA and create a common certificate,
  auto-signed.
* Configure RabbitMQ to activate SSL on scenario002
* Configure OpenStack services that run on scenario002 to connect to
  RabbitMQ using SSL protocol.

Change-Id: Ic435078472ba4e0e0eaf04a64e5bcb7aabba7b3d
2016-02-29 14:37:56 -05:00
Denis Egorenko
918a6c9342 Use swift backend for glance in scenario002 jobs
This commit adds ability to use swift as glance backend for our
scenario002 integration jobs.

Depends-On: I232536d179db92d82f1c7459a0f13e5ca5576f42

Change-Id: Ie187ffb0e80a623ca2837b0bd0c0502e9d7dc9dd
2016-02-29 14:15:23 +00:00
Denis Egorenko
8bd3df72c5 Add testing Cinder+ISCSI backend for scenario002 jobs
Change-Id: I6d5b3baabc00b61fcf29598b0157df4520b4352c
2016-02-26 16:33:18 +03:00
Emilien Macchi
78c86def03 Minor change in AIO & Readme
* Fix README to reflect what is actually deployed.
* Fix AIO scenario to test Cinder, since it's deployed.

Change-Id: I1baf74eb363ef042cf84f6befad42f918251aa0b
2016-02-25 10:12:13 -05:00
Emilien Macchi
a129a0cf05 create scenario003 to relax other scenarios
Create scenario003 that will install and test:
* keystone/nova/neutron/glance
* trove (moved from scenario001)
* horizon/heat/sahara (moved from scenario002)

Change-Id: I39870bbac6f2f9a050f85772d1fb0f6ac839e410
2016-02-24 16:41:09 -05:00
Emilien Macchi
6c272cdf16 rename scenario003 to scenario-aio
scenario003 is going to be a scenario gated in OpenStack Infra.
It was created to be a AIO scenario, for our testers, so let's rename it
to scenario-aio.

In a further iteration, scenario003 will be a scenario used by our CI.

Change-Id: I53852757d013abfae10e5f4afd41ddbb18da3b03
2016-02-24 14:50:52 -05:00
Emilien Macchi
478f8208ad scenario001: deploy Cinder and Nova with RBD backend
This patch enables robust and complete testing of a compute scenario
where RBD is used for Cinder and Nova.

* Allow cinder.pp and nova.pp to configure RBD backend.
* Switch scenario001 to run Cinder and Nova with RBD backend.
* Update README with more documentation about Cinder & Nova backends.
* Configure volume_clear option to 'none' so volumes are quickly
  deleted.
* Enable rbd_default_features to 15 to increase ceph performances.
* Increase compute build_interval in Tempest to 60s, useful for
  Bootfromvolume test where instance deletion can take time with RBD
  backend.

Depends-On: I69a7d40e7d1847be06a843986ace4f0602272fe1
Depends-On: I7302b89da5a995e779ec349ab0c0f519c69a3a98
Depends-On: Ic410cb66e7620b6ca6acbea38360d8dd890000c9

Change-Id: I5c8d9cf2ff8fc361553b3eed73b697ad87170434
2016-02-23 09:09:42 -05:00
Emilien Macchi
7c2ff7daf3 scenario001: deploy Glance with RBD backend
* Allow glance.pp to configure RBD backend.
* Switch scenario001 to run Glance with RBD backend.
* Update README with more documentation about Glance backends.

Change-Id: Ib2dd8a83b5b6a3c39030c44f5e6a0ae7db31c12c
2016-02-18 12:43:43 +00:00
Emilien Macchi
78178746ee Deploy MongoDB on scenario002
Some services (like Zaqar) require MongoDB in place to be tested.
We plan to test Zaqar soon, when the Puppet module will be finished.

So this patch is a first iteration by deploying MongoDB.

It also bump the version of puppetlabs-mongodb to use latest release
(0.12).

Change-Id: I408049e658e1b7466dfce9dc565480b538656230
2016-02-15 08:00:14 -05:00
Emilien Macchi
9c942a604e Deploy Ceph on scenario001
Deploy a simple Ceph setup on scenario001 with one mon and one osd.

Change-Id: I816f763c9ac89f62304c955184daf1e5a4406c3c
2016-02-01 13:39:44 +01:00
Emilien Macchi
6a0a79dff2 Deploy Gnocchi, TDBaaS in OpenStack
* Deploy Gnocchi services
* Create default archive policy and archive policy rule
* Configure Aodh with Gnocchi which is used to evaluate the alarms for threshold

Note: Tempest does not fully support Gnocchi yet.
* test_alarming_api will work (Aodh) with Gnocchi
* test_telemetry_notification_api will not work (Ceilometer) with
  Gnocchi. That's why we don't configure Ceilometer to use Gnocchi
  dispatcher.

Depends-On: I4ed26d3e294e82c383afc443914b0d7bb1906e46
Depends-On: Ib818b5ae4fa301c6c496fe800ae45c9b0a73222c
Change-Id: I32e5f80e4eb8a5cd8fc07798aaf6d710332fcdda
2016-01-28 14:24:34 -05:00
Emilien Macchi
83223875a1 scenario001: enable Aodh on ubuntu platform
Since Mitaka, Aodh has been packaged so we can now enable it and test
it like it's done for centos7.

See http://reqorts.qa.ubuntu.com/reports/ubuntu-server/cloud-archive/mitaka_versions.html
Change-Id: Iae1b30f8752293ccf0cf3331fe1c7c9e217d21de
2016-01-14 14:04:36 -05:00
Jenkins
2c940011e2 Merge "Provide a toggle to disable repository management by puppet" 2016-01-12 03:17:37 +00:00
Emilien Macchi
8d5fe5e952 Deploy & Test Ironic
* Create manifest to deploy Ironic services with 'fake' driver.
* Add bits to tempest class to enable the service.
* Update README.
* Add api.baremetal tests so we actually test Ironic.

Depends-On: I93fd4740d09b0c7e926c4dba7a7602f4d295d2ea
Depends-On: I01c83a6daa3909d4d9b1cb559836b7b5e54c7c7e
Change-Id: Ice03be261e687af43e677a9f60a1cc3c79acdf8b
2016-01-07 22:44:12 -05:00
Adam Vinsh
838e2e44ac scenario002 swift ring devices >= replica count
New in mitaka: swift-ring-builder requires that
ring devices be >= replica count.

Change-Id: I4a3997ca53d1c632c395a90e51debe37c9aafadb
2016-01-05 16:15:40 -05:00
Emilien Macchi
62eb545ad9 Refactor fixtures & manifests to reduce code lines
Create manifests for each project and include them in the right
fixtures manifests, so we can reduce the code and avoid dupplicated
puppet manifests.

Change-Id: I66a98691b3014998f4c2529d2e3389ef1cbcc5f4
2016-01-02 17:43:03 -05:00
David Moreau Simard
28007a665d Provide a toggle to disable repository management by puppet
By default, repositories will be managed by puppet through
manifests/repos.pp.
If someone wants to set up different repositories outside
of puppet entirely, he can "export MANAGE_REPOS=false" and
run_tests will not run repos.pp.

Change-Id: I3a09a2be1d2a064e784ed24f189fec41476330d9
2015-12-22 09:47:46 -05:00
David Moreau Simard
366269b926 Update scenario003 to use the common manifests
Change-Id: I8f51f5d412d6b0dba41878d32adeeddc0baef726
2015-12-15 15:24:12 -05:00
Emilien Macchi
770ac62ec8 scenario003: fix tempest path
In 6d26ea258fdfa5677c99f107eace9936a8e168c0 we wanted to do aregulart
clone of tempest and we made sure the path was /tmp/openstack/tempest -
but we missed to update the path in ::tempest Puppet class.

This patch fix it.

Change-Id: Ie0bc6c6ad887898234870d44b77a80d4b65a5419
2015-12-04 12:24:02 -05:00
Jenkins
b4a39fdcca Merge "scenario001: deploy & test Aodh" 2015-12-01 14:58:31 +00:00
Emilien Macchi
d1bf32c5e5 scenario001: deploy & test Aodh
Aodh is the new service that replaces Ceilometer Alarm.
This patch aims to:

* deploy Aodh in scenario001 (beside Ceilometer).
* drop ceilometer alarm code (replaced by puppet-aodh).
* add TelemetryAlarming testing (to validate Telemetry Alarm with Aodh).

Change-Id: I1acde0fad6c36429562d8576663c4cb9d393a79d
2015-11-27 23:29:24 +01:00
David Moreau Simard
6d26ea258f Do a regular clone of tempest if we're running outside the gate
Disable git_clone from scenario003, all-in-one.sh leverages
run_tests which will now properly clone tempest if whether or not
we're in the gate.

Change-Id: I687464f26913bc9ee978e00e5c78efe91b062ec2
2015-11-25 12:31:42 -05:00
Emilien Macchi
e1c20c9b1f Create manifests directory for common bits
Change-Id: Ibf7d3aa962e2e0727f0593f70186521602c48ca6
2015-11-18 15:09:18 +00:00
Jenkins
6935f77caf Merge "tempest: use $::id fact for permissions" 2015-11-12 03:56:10 +00:00
Jenkins
206add02a9 Merge "Implement all-in-one.sh script" 2015-11-06 23:53:56 +00:00
Jenkins
ccf9efb43e Merge "Bump UCA and RDO to Liberty GA" 2015-11-06 19:55:15 +00:00
Emilien Macchi
6b87e4026f Implement all-in-one.sh script
This script will help newcomers to run this script and deploy a simple
scenario of an OpenStack Cloud with Puppet OpenStack modules.

Change-Id: I559e5e0a0d21a02d04b3d999b77dee23bb38c341
2015-11-06 08:58:37 -05:00
Emilien Macchi
8c84fa23f4 Bump UCA and RDO to Liberty GA
Bump from UCA RDO Liberty testing to GA repos.

Depends-On: I709ae10101b7156a60efc10e88866abe3e643417
Change-Id: I19a1588c488d56b647703c0267540c7649fdc6d1
2015-11-06 09:07:01 +00:00
Emilien Macchi
417aaba282 tempest: use $::id fact for permissions
Instead of harcoding 'jenkins' user, use $::id fact so we can re-use
this manifest somewhere 'jenkins' user is not present.

Change-Id: I781e21112c3c0dfadd568f4d9436ddbd7d4a28b6
2015-11-05 12:53:55 -05:00
Sergey Kolekonov
37857ce086 Switch from nova_admin_* options for Neutron to actual
nova_admin_ parameters are deprecated and were replaced with Keystone
authentication plugins related options.

Change-Id: Idb8c4f3348345670c9ec61d885329fd0b16ec687
2015-11-05 18:52:17 +03:00
Denis Egorenko
9d4a169004 Remove workaround for Sahara
Bug #1356053 was fixed in upstream and now we don't need specify
another service type for Sahara service.

Change-Id: I2d95f17a27bab3871ca561e6480655696df7557d
2015-10-15 19:28:16 +03:00
Emilien Macchi
e45bd6059b scenario002: add dashboard service
* Install & Configure Horizon
* Enable dashboard tests in Tempest
* Beside 'smoke', run 'dashboard' test

Change-Id: I5bd182ac20a03242972f5837422f98dab49c6bd4
2015-10-12 17:25:43 -04:00
Emilien Macchi
2bc07b5a04 scenario001: deploy & test Trove
* Install & configure Trove (database as a service)
* Configure Tempest to run tests
* Run Trove tests

Change-Id: Ic8a05550cdf30ade95a698a340a52595892e3212
2015-10-05 17:14:48 -04:00
Emilien Macchi
4c40b18e2a Split scenarios001 in two scenarios
* Split scenario001 in two scenarios: scenario001 and scenario002
* Create README and initiate Puppet OpenStack Integration documentation.

Depends-On: Iba6791199f7a2c7fef24b1e8752ed0b564b8512f
Depends-On: Id8366cd5d2ddf6da468ecc7adb7d55eb8be4c8d8
Change-Id: Iec58e1cd01963155f35b099f7d9a8a97c26a8d27
2015-10-03 14:37:26 -04:00
Emilien Macchi
d3a13fcd0c scenario001: use 2 workers for sahara-api
Like others services, use 2 workers for sahara-api.

Change-Id: I016ef5865fde3549e934f9dd696006773a58ee5e
2015-09-30 11:08:15 -04:00
Emilien Macchi
30efa3463c scenario001: enable object service
* Install and configure Swift
* Enable Swift tests in Tempest

Change-Id: If62c238babfb798226102388911178a5acbd127b
2015-09-29 20:48:15 +00:00
Emilien Macchi
eb711ffff7 scenario001: enable orchestration service
* install & configure Heat
* run Tempest orchestration tests

Change-Id: Ibf5ca75302ef3212873a41f69c4c4e4bf5dad7b8
2015-09-28 22:08:15 -04:00
Emilien Macchi
5f2403df8f scenario001: use Default as Keystone default domain
Do not try to use another domain name for default domain.
Let's validate our modules with default features and we will iterate
later with specific use cases.

Change-Id: Iaac6f0feb2ff3f8f35d1ee02309f3b3f01390e97
2015-09-29 02:04:40 +00:00
Emilien Macchi
cc1b9c5db6 scenario001: run 2 workers
Run 2 workers for OpenStack services so we save RAM.

Change-Id: Id4ad28ff37967c19a0f314075d50a4739ea9a17c
2015-09-28 22:04:03 -04:00
Denis Egorenko
67c05c86cb scenario001: enable data processing service
* Install & configure Sahara services
* Enable telemetry tests in Tempest

Change-Id: I8934ee620096fadc20897cb0fd95a68492bcff2f
Depends-On: Ic4054404a4683a6faf766eca02cf1c0c846d57c2
2015-09-25 14:32:49 +03:00
Emilien Macchi
452e9f2b79 scenario001: enable telemetry service
* Install & configure Ceilometer services
* Configure Nova to send events to RabbitMQ
* Configure Glance to send events to RabbitMQ
* Enable telemetry tests in Tempest

Depends-On: I2b8d55613f0a962662d67b9fd82db17b758af80f
Change-Id: I8690007e9a3be3c0188777f859b517375d95ec1d
2015-09-24 18:36:04 +00:00
Emilien Macchi
dbb4feae20 scenario001: add volume service
* Install & Configure Cinder with iSCSI backend
* Enable volume tests in Tempest
* Add default_floating_pool parameter to Nova API configuration
  to tempest volume scenario can work, since it uses Nova API to
  associate the floating IP.

Change-Id: I8bc007f3182741b2710dc0615261d9bd403f781f
2015-09-22 21:27:50 +00:00
Emilien Macchi
ae784b33e6 scenario001: set API workers number to 4
When installing OpenStack-All-in-One with Puppet in OpenStack Infra
Gate, we noticed [1] the same issues than devstack-gate [2] previously
had.
Let's use the same workers number as devstack is currently using so we
avoid more memory issues.
Also, using tox with 4 workers instead of 8.

[1] http://logs.openstack.org/74/224974/11/check/gate-puppet-openstack-integration-dsvm-trusty/8217abb/logs/dstat.txt.gz
[2] http://lists.openstack.org/pipermail/openstack-dev/2014-September/045396.html

Change-Id: I2ca3d897212cdcf25d8f50c0aef5f377395d4bc6
2015-09-22 21:27:26 +00:00
Emilien Macchi
d4a358aca9 Bump RDO packages to tested repos
RDO has now [1] a repo that is tested against real CI.
Using this repository will avoid more failures in our CI.

[1] http://trunk.rdoproject.org/centos7-liberty/current-passed-ci/

Change-Id: I46821aa3621745596aff572ad50bd47674f6ccb7
2015-09-22 13:47:53 -04:00
Emilien Macchi
81dcaf9df2 Prepare Tempest and run smoke
Still hacking on the patch to make it pass trusty systems.

* Create 2 flavors, used by Tempest Compute tests
* Create 'public' network, used by Tempest Compute tests for floating-ip
* Configure Tempest to be aware about the 2 created flavors refs
* Configure Tempest to be aware about the public network
* Add some Puppet Exec code that prepare virtual bridging to reach floating IPs
* Add scenario parameters
* Run Smoke suite that includes 2 scenarios & some important API tests.
* Pin python-netaddr on ubuntu so we can test floating-IP.

Change-Id: Iebb83e110fbb0c072f06b3ca2ad84987e0efe3a6
2015-09-11 17:21:25 -04:00
Emilien Macchi
68576fcecf switch RDO to CBS repositories
This patch changes the repositories used to install OpenStack Liberty on
RDO by using CBS repositories and RDO trunk.

Here is the RDO roadmap that is suggested if we want to run Liberty:
From now until GA:
http://trunk.rdoproject.org/centos7-liberty/current/
http://cbs.centos.org/repos/cloud7-openstack-liberty-testing/x86_64/os/
http://cbs.centos.org/repos/cloud7-openstack-common-testing/x86_64/os/

After GA:
http://mirror.centos.org/centos/7/cloud/x86_64/openstack-liberty

Note about EPEL: deps from EPEL are rebuilt in CBS, so EPEL could be
disabled in the future.

Change-Id: I2841425c0989f34e11207d53c6c99ebbe36ec3ef
2015-09-10 19:52:43 -04:00