Commit Graph

691 Commits (a5e65fc6fcc87b34a99dcab8381678832f5bb76f)

Author SHA1 Message Date
Sagi Shnaidman a5e65fc6fc Support exclude list for logs collecting
Sometimes we want to collect everything, but specific files and
folders. Support exclude list for this.

Change-Id: I10302ee50c5539fbacd539371dde0e7d0d7c4f71
2017-02-13 15:42:26 +02:00
Jenkins 39c3e4a7fd Merge "Add optional Sphinx build verification" 2017-02-13 13:26:21 +00:00
Jenkins 060852919e Merge "Install pip" 2017-02-13 08:50:55 +00:00
Raoul Scarazzini 1e9a27a2c3 Collect and manage logs when validating HA
This commit manages all the stdout and stderr status of each HA
validation test.
In this way it will be possible to have all the logs related to the
tests in one place (on the undercloud) that will be collected by the
collect_logs role and so accessible from the external location where
the logs will be stored.

Change-Id: Ie803a920a17bd2f24ccd89f733781dd7e4d07fdd
2017-02-10 10:29:07 +01:00
Jenkins b3be924765 Merge "Make validation HA tests atomic" 2017-02-09 19:26:30 +00:00
Jenkins 37ddaa3529 Merge "[undercloud-deploy] Add ability to override ironic httpd ipxe port" 2017-02-09 17:12:25 +00:00
Arx Cruz b3f4d5b55a Install pip
Pip isn't installed on undercloud, making Install stackviz task fails
because isn't able to find it.

Change-Id: I3aac9a91e1ca74f03d84694239b0a8299dfc9c85
2017-02-09 16:36:16 +01:00
Jenkins dfe47ea163 Merge "Adds a Bashate target to tox.ini." 2017-02-08 23:49:21 +00:00
Jenkins 7aa0d90b29 Merge "Fix service logs collection" 2017-02-08 21:54:00 +00:00
Jenkins fef59a238b Merge "updates to the static template for job doc." 2017-02-08 21:12:37 +00:00
Jenkins 46c1d50cfc Merge "Fix and improve flake8 test." 2017-02-08 21:04:53 +00:00
Jenkins 322529307f Merge "Add ReNo support for managing release notes in TripleO-Quickstart-Extras" 2017-02-08 21:04:38 +00:00
Sagi Shnaidman 0486042bca Fix service logs collection
It's broken because wrong identation.

Change-Id: Ibe2e0204492013fb6b6ba67778f3633d45cfe53e
2017-02-08 21:00:56 +02:00
John Trowbridge 74c078df04 [undercloud-deploy] Add ability to override ironic httpd ipxe port
This is needed for tripleo-ci and is the quickstart equivalent of:
https://git.openstack.org/cgit/openstack-infra/tripleo-ci/commit/?id=2c9257747261d3ac5b0741187e84a724176536b0

Change-Id: I6a4dae61fa5c750499aac4bc4ededf0803600759
2017-02-08 11:21:01 -05:00
Jenkins 96b94395a1 Merge "Support uploading files in modify image role" 2017-02-08 15:45:12 +00:00
Harry Rybacki 4f8220735e Add optional Sphinx build verification
We need a simple, togglable way to verify that Sphinx has, at a
minimum, generated each of the files outlined within the
`artcl_create_docs_payload.table_of_contents` and added them to
the resulting index.html

- Add togglable var to collect-logs role, `artcl_verify_sphinx_build`
  default to false
- Update artcl_collect_dir to pull from common/defaults

Change-Id: I76fef28a026730818d44274ab01741034f9fa40d
2017-02-08 14:15:54 +00:00
Jenkins 94e211723c Merge "List nova instances after overcloud deploy" 2017-02-08 12:44:45 +00:00
Jenkins 097a93a9cd Merge "Add option to leave tar.gz logs files and flat log" 2017-02-07 19:47:44 +00:00
Gael Chamoulaud 5533b8f7a1 Adds a Bashate target to tox.ini.
This will now run bashate on all shell scripts. We could ignore the
following list of bashate errors:

- E006: Line longer than 79 columns (as many scripts use jinja
        templating, this is very difficult)
- E040: Syntax error determined using `bash -n` (as many scripts
        use jinja templating, this will often fail and the syntax
        error will be discovered in execution anyway)

Change-Id: I6f6d454ac54a0ac98d8b8a092fa522cba092a592
Signed-off-by: Gael Chamoulaud <gchamoul@redhat.com>
2017-02-07 12:23:45 +01:00
Gael Chamoulaud 619c512594 Fix and improve flake8 test.
Previously the 'flake8' command was running but didn't seem to
check out something in all cases.

- This patch decouples the 'ansible-lint' and the 'flake8' sections
  into separated 'testenv'.
- And this patch fixes all the 'flake8' issues.

Change-Id: I30169598d086515121175ca322882ee00f05b913
Signed-off-by: Gael Chamoulaud <gchamoul@redhat.com>
2017-02-07 12:20:19 +01:00
Gael Chamoulaud e0df5f7108 Add ReNo support for managing release notes in TripleO-Quickstart-Extras
Add ReNo [1] support to manage release notes
[1] - http://docs.openstack.org/developer/reno/

Change-Id: Ief133240354404d9abdc40e05bb1696c13a6b606
Signed-off-by: Gael Chamoulaud <gchamoul@redhat.com>
2017-02-07 12:19:28 +01:00
Dimitri Savineau 6446c98b06 Tempest: ensure heat_stack_owner is present
The orchestration role used in tempest configuration should be create
before running tempest.

Change-Id: I129831c5821e60493f649b2ce71256cf82b1f197
2017-02-06 16:40:06 -05:00
Jenkins 313b56df87 Merge "Remove unused undercloud_post_install_script and its log" 2017-02-06 15:02:44 +00:00
Sagi Shnaidman 78f88bdfcf List nova instances after overcloud deploy
Nova instances status is essentially required for investigation
of failed overcloud deployments.

Change-Id: I324d208df5a0098143da1c23b86d1d018804a692
2017-02-06 13:43:04 +02:00
John Trowbridge 3ae1e2e335 [overcloud-ssl] fix library to work with ocata
Change-Id: Iea069b0c80ffc51f9ef6d23842cefb2ac7dedfc1
2017-02-03 08:43:27 -05:00
Sagi Shnaidman cfd1c02fe4 Add option to leave tar.gz logs files and flat log
When publishing logs in usptream we need an option to get
all files from host together both getting only one of them.
Save and upload the whole tar.gz for host together with flattened
logs and configs.

Change-Id: Ib272841a9ddf15d9ccd36a5d42a9dd94bf934f8f
2017-02-01 17:07:41 +02:00
Jenkins c3bd5078de Merge "validate-simple: small improvements" 2017-01-31 17:38:45 +00:00
Attila Darazs 9ddd43f440 validate-simple: small improvements
* silence the console output from curl but keep error output to avoid
  garbled download output in the logs
* acquire the floating IP address from the stack output to test the same
  way as tripleo-ci
* follow up the heat template differences (key -> key_pair)

Change-Id: I4c2bbbc3d542bf62f375d81f70069dff2490fc36
2017-01-31 17:28:58 +01:00
Eugene Bagdasaryan 298ef45fe3 Remove unused undercloud_post_install_script and its log
Remove unused undercloud_post_install_script and log from parameters
and documentation since it's not used anymore.

Change-Id: I88de9555b17d83b1359e2d7ca88a99818f3e07a1
2017-01-30 18:19:30 -05:00
Jenkins 2d85013e95 Merge "Leave and collect delorean build logs" 2017-01-30 16:48:18 +00:00
Raoul Scarazzini c5f6368498 Make validation HA tests atomic
This commit defines a var file for each release containing the list of
the HA validation tests that should be done. These new variables are now
also used as booleans to determine if a test should be executed or not.
With this new approach a user will be able to exclude (or include) tests
at runtime, like this:

./quickstart.sh \
  --retain-inventory \
  ...
  ...
  --release mitaka \
  --tags "overcloud-validate-ha" \
  --extra-vars test_ha_failed_actions=false \
  --extra-vars test_ha_master_slave=false \
  --extra-vars test_ha_keystone_constraint_removal=false \
  --extra-vars test_ha_instance=true \
  $VIRTHOST

In this case I will test just the instance deployment.
This means that without any extra var tests will be the default
depending on the release, otherwise specific tests will be made.
It also updates the README with all these new informations.

Change-Id: I113b8e929dddb9ff18b57faa905a754e2f6b5999
2017-01-30 15:44:27 +01:00
Sagi Shnaidman 5a0e394294 Return default for change list
If the task or role is skipped, ansible still tries to evaluate
variables and doesn't consider set_fact, having ansible change
list as undefined, which stops playbook with fatal error.

Change-Id: I7417918b26893fb37bed35260eee7cc98feaea9a
2017-01-29 10:50:24 +02:00
Sagi Shnaidman 61ef59ff2c Support uploading files in modify image role
Support for uploading files to image.

Change-Id: I5cf1959437097f410cc36e1a1536141bfc9da325
2017-01-27 14:24:08 +00:00
Jenkins 376509fb44 Merge "[build-test-packages] combine all methods of providing changes" 2017-01-26 20:58:34 +00:00
Jenkins 771bdb149a Merge "Fixing setuptools version" 2017-01-26 15:31:52 +00:00
Raoul Scarazzini b97b13b83c Fix node cycle on HA Validation
This commit fixes the way the test suite is cloned on each node.
With the new ansible release the old fashion is not good anymore, it
fails while substituting items.
This solution has been tested and it is working.

Change-Id: I7609945b5ef2e6b932ba23441c7e773631dc60b4
2017-01-26 10:00:55 +01:00
John Trowbridge d736c8ab19 [build-test-packages] combine all methods of providing changes
The current implementation of build-test-packages allows for
precisely one method of providing what changes to build.
Either passing a artg_change_list dict directly via variable,
reading GERRIT vars from the env, or reading ZUUL vars from
the env.

This patch makes it possible for multiple of these methods to
be used without stomping on eachother. It is needed to be able
to run the gate which specifically exercises this role, but may
be useful in other scenarios as well.

Change-Id: Ib2290411865f9bb1a2804af64e85541530ae2e97
2017-01-25 19:30:46 +00:00
Arx Cruz ebf252cbec Fixing setuptools version
Until https://github.com/pypa/setuptools/issues/945 closes, we are
tagging setuptools to latest known working version.

Change-Id: I4d6a04fac12afcceacd33fcea2c4d009f8e62c2c
2017-01-25 11:20:16 +01:00
Jenkins 5c25c362df Merge "Remove floating IPs in tempest config script" 2017-01-24 22:19:02 +00:00
Jenkins cbd1f16694 Merge "Use new parameters for the undercloud public/admin hostnames" 2017-01-24 22:15:45 +00:00
John Trowbridge df7f888aa6 Remove duplicate meta/main from undercloud-setup role
Accidentally got in via:

62cf304ede

Change-Id: I721900c2601ae3ea335c5dcbf46551496ab2852f
2017-01-24 15:21:32 -05:00
Wes Hayutin 62cf304ede virtualbmc setup is not working in devmode.sh
Some workflows like devmode will not have facts
collected on the virthost e.g. devmode.sh. This
occurs when quickstart.sh is invoked multiple times.

Do not rely on facts to get the uuid of the
non_root_user, instead delegate to the virthost
and get the uuid and set a fact.

Closes-Bug: #1657248

Change-Id: I5d087983b1794c10c311bc44b162428c2cc7e476
2017-01-24 19:57:00 +00:00
Juan Antonio Osorio Robles b8b4ebbb87 Use new parameters for the undercloud public/admin hostnames
These parameters deprecated the undercloud_(public/admin)_vip
parameters and are eventually used by the keystone endpoints and the
certificate generation. they were introduced in
I53151d4f555d5d161a3e53ce5f022e3bf3b2ffbd .

Change-Id: I985d50135aa3b8fd73c2680044a44337454fc63a
2017-01-24 21:31:42 +02:00
Harry Rybacki ba359352ce Ensure docs directory exists before generating docs
- Also ignore errors will prevent issues with Sphinx from failing
  jobs without a good reason.

Change-Id: I50380f0ff1504cc864599b8ff938c5214ea74af6
2017-01-24 11:28:52 -05:00
Jenkins 9190248138 Merge "collect-logs: broader txt.gz rename conditions" 2017-01-24 16:24:17 +00:00
Sagi Shnaidman 0c0a76c23e Remove floating IPs in tempest config script
If cleaning leftovers from previous runs we need to remove firslty
all floating IPs.

Change-Id: Iaa8dee12a46b2ee1c9777be326e9c12c163f0667
2017-01-24 18:08:12 +02:00
Jenkins dff49a0324 Merge "Fix minor issues with doc templates" 2017-01-24 16:05:53 +00:00
Jenkins a20695b649 Merge "Add doc templating to validate-tempest role" 2017-01-24 15:49:32 +00:00
Jenkins 166c35c942 Merge "Write down segfaults, avc denials and oom-killers" 2017-01-24 15:10:41 +00:00
Jenkins 265d2b5b36 Merge "Add -k (insecure) option to curl console logs command" 2017-01-24 14:30:50 +00:00