7054 Commits

Author SHA1 Message Date
Zuul
65c8da3051 Merge "Imported Translations from Zanata" 2020-12-15 06:35:45 +00:00
Zuul
89cb7f60fe Merge "Run nova-ceph-multistore only when tempest is ran" 2020-12-15 05:35:53 +00:00
Erno Kuvaja
795dad7633 Bump lower_constraints and requirements
This is to unblock the stuck gate due to the lower_constraints
job failing.

Change-Id: Ifd55c44fef4e2187052d77084dc9c0fa9c9a0d16
2020-12-14 21:39:58 +00:00
Erno Kuvaja
e26f9b40d8 Run nova-ceph-multistore only when tempest is ran
Change-Id: I4e5af52caedb78ace15d84c8a84acad2dc8490fa
2020-12-14 17:16:21 +00:00
OpenStack Proposal Bot
ac2036fd7d Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I6051be3d52956f13e66564f4f5bafa838b66bd7d
2020-12-11 06:31:37 +00:00
Brian Rosmaita
f102b74a28 Remove 'admin_role' option
This option was deprecated in the Ussuri release by change
I0f61f85a0aaa4f68e345fa08fbb6b039d3d32587 and it is now eligible
for removal following the standard OpenStack deprecation policy.

Change-Id: I78ec79f97bfdcc39772448296140f8d8f35adea1
2020-11-24 20:31:21 -05:00
whoami-rajat
1344c45772 Adding gate job for glance cinder store
Depends-On: https://review.opendev.org/743800
Change-Id: Ib192550182008754644b74636ede0d85bbcc4faf
2020-10-05 09:54:38 -04:00
OpenStack Proposal Bot
45749c30c1 Imported Translations from Zanata
For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I3bede3dd6f6896c06202203fab252f01394dd102
2020-10-04 06:28:58 +00:00
Zuul
9fc9148564 Merge "Bump Images API version to 2.11" 2020-10-02 06:29:53 +00:00
Erno Kuvaja
0e3d274915 Bump Images API version to 2.11
Co-authored-by: Brian Rosmaita <rosmaita.fossdev@gmail.com>

Change-Id: I1e200c47f20ec6945981dbd92f859cfec234e42d
related-bug: #1897773
2020-09-29 17:47:45 -04:00
Dan Smith
b49c042467 Adjust jobs for devstack WSGI mode default
Devstack is switching the default glance operational model back to pure-WSGI
mode for parity with the rest of the services. This adjusts our jobs to fit
with that so that we're testing the default, but also the standalone case.
After this change, we end up with the following for the vanilla devstack
jobs:

 - The "-import" job, which takes the devstack default of WSGI mode,
   with all the tweaks required for import to be enabled. It configures
   import conversion to raw, metadata injection, and confirms that with a
   post-run check for that metadata.
 - The "-import-standalone" job, which inherits all the behaviors from
   the job above, but configures glance in standalone mode.

Depends-On: https://review.opendev.org/#/c/742884
Change-Id: Ia3fb8aba83bbd7a1399aef136ce8857b14d08435
2020-09-29 06:43:27 -07:00
Abhishek Kekane
6504588aaa Victoria RC-1 release notes
Change-Id: I91bb8614f47c0283c88b96ca10e8280655d2d1fb
2020-09-23 12:46:20 +00:00
Zuul
d7c033bf21 Merge "Do not use OSC in infra playbook" 2020-09-23 10:16:08 +00:00
Victor Coutellier
922c2ed5ad Fix cleaning of web-download image import
If import flow fail before reaching the end it never execute
the _DeleteFromFS task and the node_staging_uri is never cleaned up.

Implement the revert() function of the _WebDownload task to remove the
temporary file.

Change-Id: I6dd6a6e2a95a5bd17a80b6256852bb9fac5fa339
Co-Authored-By: Grégoire Unbekandt <gregoire.unbekandt@gmail.com>
Co-Authored-By: Abhishek Kekane <akekane@redhat.com>
Closes-Bug: #1795950
2020-09-22 20:31:30 +02:00
Erno Kuvaja
df0495676e Do not use OSC in infra playbook
Using the supported glanceclient instead.

Change-Id: I373467d2cdefb2301a949c9236f445dbbc641a2a
2020-09-22 18:07:39 +01:00
Grégoire Unbekandt
68c202d38b Image import "web-download" check downloaded size
If the downloaded data size is different from the expected one, the
task "web-download" in the image import process will now fail.

Change-Id: Ie260486d795a6f4af1632f6f3708abc92fb47a3a
Closes-Bug: #1895663
2020-09-22 14:04:15 +00:00
Zuul
ab151973bd Merge "Run the nova-ceph-multistore job against glance" 2020-09-18 15:50:12 +00:00
Stephen Finucane
54a2231f17 docs: Remove cruft from 'conf.py'
Change-Id: Ie44453b647ce78a26246b8293794ebdec68fd120
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2020-09-17 17:21:55 +01:00
Stephen Finucane
d3d9982e66 docs: Convert table of image properties to definition list
This renders much flatter as is similar to what's used nowadays for
config options (via the 'oslo_config.sphinxext' extension)

Change-Id: If204d887ed0d65cfc5e75cc7739b0f8f59ce000f
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2020-09-17 17:21:51 +01:00
Stephen Finucane
e1fe3024bb docs: Remove references to XenAPI driver
The XenAPI driver is dead. Let's hold the tissues and clear out
references from the documentation instead.

Change-Id: I6ec331cf7d2d1ded924893f707ed963027939754
Signed-off-by: Stephen Finucane <sfinucan@redhat.com>
2020-09-17 17:09:17 +01:00
Abhishek Kekane
213660d8b5 Victoria milestone 3 release notes
Note: Fixed formatting for import-locking-behavior
release note.

Change-Id: I914d5b901483b3f3942ade3e3856a62901592521
2020-09-15 14:09:55 +00:00
Dan Smith
1a9b345840 Run the nova-ceph-multistore job against glance
Nova has a job where both nova and glance are configured for multistore
ceph, and where the image gets automatically copied from the file to
rbd stores on first use. Run that on glance to get the coverage for
it as well.

Change-Id: I9c734fabaabe78ea8f7e77d0aa2112ebe867ecb6
2020-09-14 10:01:08 -07:00
Abhishek Kekane
e16d5c9ba3 Corrections in default value of all_stores_must_succeed
Change-Id: I7b04f8ba86e0d6f42ef436e30ece9f019221e318
Closes-Bug: #1884996
2020-09-11 06:03:30 +00:00
Zuul
b1715c96ff Merge "[Docs] Cinder multiple stores for glance" 2020-09-10 17:16:26 +00:00
Zuul
dfd31cdaf6 Merge "Refresh Glance example configs for Victoria milestone 3" 2020-09-09 16:42:10 +00:00
Abhishek Kekane
9bd06d24ac [Docs] Cinder multiple stores for glance
Change-Id: I1ec4d3f3f57f8a0576ea5ed09a289ab27882104b
2020-09-09 15:04:07 +00:00
Zuul
a3343cff96 Merge "Support cinder multiple stores" 2020-09-08 20:22:37 +00:00
Zuul
1e46b62a25 Merge "Remove babel.cfg etc" 2020-09-08 12:31:52 +00:00
whoami-rajat
98a1e792c6 Support cinder multiple stores
This patch updates the location URL of the legacy images while
upgrading from single cinder store to multiple stores.
It does that with the help of lazy loading logic i.e. while
GET images call, it checks the location URL and metadata
of the image against the configured store ids and updates
images to respective stores on the basis of volume type (comparing
image-volume's type with the configured cinder_volume_type).
Legacy image URL:
cinder://<volume-id>
New image URL:
cinder://<store-id>/<volume-id>

NOTE: bumping lower-constraints/requirements of glance-store to 2.3.0 as
it includes changes[1] that are a hard requirement for cinder multiple
stores to work with glance

[1] https://review.opendev.org/#/c/746556/

Change-Id: I087a89c20813378fea8ff22ddf81d7a10c220db3
Implements: blueprint multiple-cinder-backend-support
2020-09-07 09:07:42 +00:00
Zuul
5126ca0242 Merge "[Trivial]Add missing print parameters in log messages" 2020-09-03 07:02:35 +00:00
likui
a8fb4e2587 Remove babel.cfg etc
Remove babel.cfg and the translation bits from setup.cfg, those are not
needed anymore.

Change-Id: I221173c724d23c1221febb8928c67bae1150bf5e
2020-09-03 15:01:23 +08:00
Abhishek Kekane
19229d7990 Refresh Glance example configs for Victoria milestone 3
Change-Id: Ibd02882c1e42de3db7f78b50dd974b99b0d9ded1
2020-09-03 05:53:06 +00:00
Zuul
c5bf4d42e3 Merge "Make our ceph job enable thin provisioning" 2020-09-02 21:43:09 +00:00
Zuul
3f9c5afe4d Merge "Make our import-workflow job also convert images to raw" 2020-09-02 21:43:06 +00:00
Zuul
552d902b91 Merge "Add a release note about import locking" 2020-09-01 13:56:11 +00:00
Zuul
20cb03f2d9 Merge "Cleanup import status information after busting a lock" 2020-09-01 13:56:09 +00:00
Zuul
ef72e8b5fe Merge "Add ImageLock to base flow checks" 2020-09-01 12:56:52 +00:00
Dan Smith
bb7774c99b Add a release note about import locking
This adds a release note detailing the new locking behavior and criteria
for stealing the lock.

Related-Bug: #1884596
Change-Id: I19c713c91794694f990f1372fda61cc2e20fac54
2020-08-31 07:45:42 -07:00
zhufl
179d111c1f [Trivial]Add missing print parameters in log messages
This is to add missing print parameters in log message.

Change-Id: I300a3f19a0dfacb23903ac3e92571855ed32cd83
2020-08-31 11:25:05 +08:00
Zuul
8da47cb5ca Merge "Functional test enhancement for lock busting" 2020-08-29 21:48:08 +00:00
Zuul
2f533251dc Merge "Handle atomic image properties separately" 2020-08-29 19:13:33 +00:00
Zuul
c1cf511a7c Merge "Fix metadefs for compute-watchdog" 2020-08-29 03:02:57 +00:00
Zuul
5e9a14aee1 Merge "Move SynchronousAPIBase to a generalized location" 2020-08-29 01:45:04 +00:00
Zuul
0260ab5922 Merge "Disable wait_for_fork() kill aggression if expect_exit=True" 2020-08-28 03:34:41 +00:00
Dan Smith
c023445d05 Make our import-workflow job also convert images to raw
This enables image conversion on the import-workflow job so that we at
least run those code paths somewhere in CI.

Change-Id: Ie4a9171f002b42a13c1786268057bdc0ab3804d0
2020-08-27 07:29:12 -07:00
Dan Smith
76667323d7 Disable wait_for_fork() kill aggression if expect_exit=True
In some cases, we spawn a process that we expect to run to completion
and exit. In those cases, disable the force-kill logic in wait_for_fork()
to avoid killing those processes too early.

Related-Bug: #1891190
Change-Id: Ia78d101ae3702d9f761ca8f04b4b10af4a6d84fb
2020-08-25 10:31:45 -07:00
Dan Smith
b6380424f8 Make our ceph job enable thin provisioning
Depends-On: https://review.opendev.org/#/c/744282
Change-Id: Ifa05b30cd8a810c6ae0678eaa1e433c16e0b7b93
2020-08-24 08:41:34 -07:00
Dan Smith
552da84400 Cleanup import status information after busting a lock
When we bust a lock, we now own the image for that time period
and may exclude the other task (if still running) from updating
the import status information. If not still running, we should
take responsibility of that cleanup since we know what task we
stole the lock from. We should, however, only do that if we
succeed in grabbing the lock to avoid racing with another thread
which might be trying to do the same thing.

Change-Id: Iff3dfbfcbfb956a06d77a144e5456bdb556c5a2c
2020-08-24 06:41:13 -07:00
Dan Smith
3636915dd4 Add ImageLock to base flow checks
This adds the ImageLock flow atom to the test_async flow assertions to
make sure it gets included. Also changed are the magic numbers for
expected flow lengths, per feedback on the
Icb3c1d27e9a514d96fca7c1d824fd2183f69d8b3 review.

Change-Id: I0795e3835a500f20102e0c393a9a15f00672c87a
2020-08-24 06:41:13 -07:00
Dan Smith
a86062c492 Functional test enhancement for lock busting
This enhances our test for the import lock-busting case to include
freeing the stuck import task and letting the new and old ones proceed
to make sure that the end state looks like what we expect.

Note that this includes another task lock check after exiting the
ImportAction context before we call image save. While writing these
tests I determined that we can end up with the original task racing
to update the image locations. If set_data() took a very long time,
caused our lock to be stolen and another task is running, when our
set_data() finally finishes we may overwrite their newly-added
location when we go to save our (now stale) list. Thus, the extra
task check (imperfectly) tries to avoid us doing anything else after
our task lock is stolen.

Change-Id: I74baf53fac1c3e23f6dc743058165ecb39074626
2020-08-24 06:41:13 -07:00