994 Commits

Author SHA1 Message Date
73a16ecaa9 Update .gitreview for stable/victoria
Change-Id: I500e57d706b93f7a8d6a56e1e34fd1be6e2ee7db
victoria-eom
2021-03-09 17:21:47 +00:00
Tim Burke
acd7091f60 Fix multiple CI failures
1. Clean up some requirements

* Drop the py26 marker for futures; we don't support 2.6 anymore.
* Split hacking version used based on python version.
* Clean up sphinx split -- 2.0+ aren't available to install on py2,
  anyway.

Depends-On: https://review.opendev.org/#/c/752340/
Depends-On: https://review.opendev.org/#/c/752736/
(cherry picked from commit 5cb906148709ccc74ca96463fd69a5cae2381edb)

2. Drop lower-constraints testing

The OpenStack community consensus seems to be that it's not worth the
hassle of fixing. *Maybe* we can revisit this if we ever drop py2
support?

Reasonable spot to start on ML threads:
http://lists.openstack.org/pipermail/openstack-discuss/2021-January/019672.html

(cherry picked from commit 06b36ae0e2ee6054162bfb1d9f3cdda39eacbad5)

3. [goal] Migrate testing to ubuntu focal

As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

- Keep py2 functional job run on Bionic node

Story: #2007865
Task: #40221

(cherry picked from commit 9f69908f759daafc99a162b136b24570a2822ee2)

tests: Make test_delete_container_versions less flakey

Hammering that test in a tight loop, I'd often see failures due to
ordering issues. Make the delete single-threaded to avoid that.

(cherry picked from commit c73792c2e55e4fbdff78a192a991e064a317e840)

Change-Id: I5a6ba8e65c23ada7297f6684dcbdd886591d0af5
2021-03-01 11:44:46 +01:00
Zuul
9d8db8f612 Merge "Speed up test_lazy_connections" victoria-em 2020-09-03 04:12:21 +00:00
Tim Burke
89c8d9b853 Speed up test_lazy_connections
It doesn't really need to sleep a full second.

Change-Id: Ida80f0c5a983edb33a93662badb6aa1a25f9a27c
2020-07-28 11:28:30 -07:00
Meuh
842086d27f Add max_backoff and starting_backoff for get_conn in swift service
Change-Id: I45f5d3009e0e2015c7366384ee826113fc27c70b
2020-07-28 20:03:11 +02:00
Tim Burke
22d1f3a39a Clean up some warnings
Change-Id: Iae149533d04c7b173c4ef88fb775f5fe13c16466
2020-06-17 21:05:25 -07:00
Zuul
b63d9a3e96 Merge "Application credential support follow-up" 2020-06-17 22:41:58 +00:00
Zuul
7852314b0b Merge "Remove references to swift-specs and blueprints" 2020-06-03 17:03:30 +00:00
Tim Burke
d1f894c124 Remove references to swift-specs and blueprints
Those have been dead for a long while.

Change-Id: I21306a40479ad319c0ef48aa8bfb88f261011390
2020-06-02 13:34:49 -07:00
Zuul
d1e69b195b Merge "Ussuri contrib docs community goal" 2020-06-01 23:33:33 +00:00
Tim Burke
257a7185a8 Application credential support follow-up
Following the recent v3applicationcredentials patch, if you have your
environment variables set up to work with python-openstackclient using
swiftclient's v1password plugin, swiftclient won't work:

   $ env | egrep '^(OS|ST)_'
   ST_KEY=testing
   ST_USER=test:tester
   OS_AUTH_URL=http://saio/auth/v1.0
   ST_AUTH=http://saio/auth/v1.0
   OS_USERNAME=test:tester
   OS_AUTH_TYPE=v1password
   OS_PASSWORD=testing

   $ openstack object store account show
   +------------+----------------------------+
   | Field      | Value                      |
   +------------+----------------------------+
   | Account    | AUTH_test                  |
   | Bytes      | 0                          |
   | Containers | 11                         |
   | Objects    | 0                          |
   +------------+----------------------------+

   $ swift stat
   Only "v3applicationcredential" is supported for --os-auth-type

We don't really want to allow (and mostly ignore) arbitrary OS_AUTH_TYPE
values, though -- there are a whole bunch of plugins we don't remotely
support. But it seems OK to allow any of the password plugins; while we
won't actually use them (currently), we provide roughly equivalent
functionality.

Handful of other drive-bys:
 * Use a None sentinel to determine whether keystoneauth1 is installed
   instead of trying to catch a NameError.
 * Clarify error state when keystoneauth1 is not installed.
 * Fix a typo: "sses" -> "sess".

Change-Id: Id7ea9c3ea8278ae86a04d057a472a8f8a87b8eae
Related-Change: I9190e5e7e24b6a741970fa0d0ac792deccf73d25
2020-05-27 15:17:09 -07:00
fuzihao
9b6d1c7e88 Fix pygments style
New theme of docs (Victoria+) respects pygments_style.
Since we starts using Victoria reqs while being on Ussuri,
this patch ensures proper rendering both in Ussuri and Victoria.

Change-Id: Iad418798277b9d7a1190e42e9079080a3d2707f3
2020-05-20 15:27:49 +08:00
Zuul
5840efe1d6 Merge "Support v3 application credentials auth." 2020-05-13 08:36:17 +00:00
Matthew Oliver
6e000d11e4 Ussuri contrib docs community goal
This patch standardizes the CONTRIBUTING.rst file and adds the
required doc/source/contributor/contributing.rst

The contibuting.txt points to the Swift contributor documentation.

Change-Id: Ia6c105698dd0269479536645270d12a7c1061bc7
2020-05-13 15:36:22 +10:00
Zuul
eecdcdefbc Merge "Fixed capability discovery endpoint hardcode" 2020-04-25 02:07:18 +00:00
Sean McGinnis
e44ca6d8af
Bump default tox env from py37 to py38
Python 3.8 is now our highest level supported python runtime.
This updates the default tox target environments to swap out
py37 for py38 to make sure local development testing is
covering this version.

This does not impact zuul jobs in any way, nor prevent local
tests against py37. It just changes the default if none is
explicitly provided.

Change-Id: I7bc7d7a49de746cc8fdb58a44619bc5ce66b7003
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2020-04-24 10:25:58 -05:00
Ivan Kolodyazhny
947c09f30c Fixed capability discovery endpoint hardcode
It fixes get_capabilities() method to process
correctly endpoints like: 'https://<ip>:<port>/v1',
'https://<ip>:<port>/swift/v1'.

Co-Authored-By: Daniel Cech <dcech@mirantis.com>
Change-Id: Ib4037d0b49da1bce959947100629370805f510d5
Closes-bug: #1712358
2020-04-24 12:50:58 +03:00
Tim Burke
77993f242b Add py38 classifier
Change-Id: I28bf4aeb12c1f3833d2c6501b49d184b54d36093
2020-04-20 10:10:46 -07:00
Andreas Jaeger
bb3888e73e Update docs building
Update docs building:
* Switch to sphinx-build
* Update requirements for Sphinx and openstackdocstheme for
  python 3
* Remove unneeded doc and translation sections from setup.cfg
* Remove install_command, it's unneeded, the default is fine.

Change-Id: Ib9fe754b700bceb164ba0f596cbcc6d864ccbadc
2020-04-19 09:57:27 +02:00
Charles Hsu
02b637cdca Support v3 application credentials auth.
Use keystoneauth1 application credential plugin and session to fetch
a token and endpoint catalog url.

$ swift --os-auth-url http://172.16.1.2:5000/v3 --auth-version 3\
      --os-application-credential-id THE_ID \
      --os-application-credential-secret THE_SECRET \
      --os-auth-type v3applicationcredential auth

Change-Id: I9190e5e7e24b6a741970fa0d0ac792deccf73d25
Closes-Bug: 1843901
Closes-Bug: 1856635
2020-04-16 12:41:04 +08:00
Zuul
c36616292f Merge "Change recommended test config to use auth_uri" 2020-04-14 17:41:57 +00:00
Tim Burke
06c5c30fa4 Change recommended test config to use auth_uri
...instead of piecing it together from auth_host, auth_port, auth_ssl,
auth_prefix, and (sort of, sometimes) auth_version.

Change-Id: Ie9c36e778d6a03f905899074d7136b767812ea11
2020-04-13 22:45:25 -07:00
Zuul
2baef86966 Merge "Add Python3 victoria unit tests" 2020-04-13 23:30:17 +00:00
Zuul
a0608f223a Merge "Update master for stable/ussuri" 2020-04-13 18:50:42 +00:00
Zuul
2cbc583fb9 Merge "Improve list --versions output" 2020-04-13 18:29:42 +00:00
89ae9d77cb Add Python3 victoria unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for victoria.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I2fa8505451caadbe895cc3262c0bf1470795968b
2020-04-13 10:12:15 -07:00
a15eaec826 Update master for stable/ussuri
Add file to the reno documentation build to show release notes for
stable/ussuri.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/ussuri.

Change-Id: I75dc03a9d29c65b8d104b8d3a95915094cba6320
Sem-Ver: feature
2020-04-13 10:12:15 -07:00
Andreas Jaeger
f9f2090a02 Drop pypy testing
The pypy job is always failing, drop it.

Change-Id: Ibc80d23846b364bfcd82043430ef71ad4b6e271b
2020-04-12 20:41:23 +02:00
Tim Burke
9b0da49c0b Improve list --versions output
Have `--versions` imply `--long` and add a new column for version_id.

Also, have version-aware listings show all versions as "null" on old
Swifts that don't support object versioning (or when object versioning
is not enabled).

Change-Id: I0e009bce2471d1c140ac9b83700591cb355fee3f
2020-04-10 17:16:15 -07:00
Clay Gerrard
78edffa46c object versioning features
* add --versions to list
 * add --versions to delete
 * add --version-id to stat
 * add --version-id to delete
 * add --version-id to download

Change-Id: I89802064921778fee7efe57c7d60c976cdde3a27
2020-04-08 13:07:26 -07:00
Tim Burke
02e8f4f228 Blacklist stestr 3.0.0
It claims py2 support, but that's a lie.

Also, switch our tempest job to the py3 variant, now that glance (at
least) is py3-only and tempest-full is broken.

Change-Id: Ic30fe82ff72fe4d138ec4823d36f2a1cc56f1ac7
2020-04-08 12:48:36 -07:00
Tim Burke
259b98f69d Authors/changelog for 3.9.0
Change-Id: I661503e0d6bb7934f7e7a28b094264a2ee73a419
2020-02-12 17:34:25 -08:00
Zuul
67e5f6ab5c Merge "Make py38 job voting" 2020-01-25 01:20:15 +00:00
Tim Burke
0bbc2cdbec Make py38 job voting
Depends-On: https://review.opendev.org/#/c/693401/
Change-Id: Ifb4e466eda0c45b49c16e63b0c77023f65b039b8
2020-01-22 08:31:23 -08:00
Tim Burke
13970ac5fa packaging: Properly flag universal wheel
I'm not sure we've *ever* done this properly; see the PyPA docs:
https://packaging.python.org/guides/distributing-packages-using-setuptools/#universal-wheels

Change-Id: I8bb9e05f386076aa652b3955f0abf757d229afed
2020-01-20 21:20:22 -08:00
Zuul
80cdada0c2 Merge "Add test for bulk-delete-attempt-counter fix" 2020-01-16 00:58:12 +00:00
Zuul
90e71f5506 Merge "Cleanup session on delete" 2019-12-09 23:39:57 +00:00
Alex Schultz
1f26c57369 Cleanup session on delete
If an external http connection was not passed into the client, we
create one with a requests.Session() on our own. Once this is used,
it may still have an open socket when the connection is closed. We need
to handle the closing of the requests.Session() ourselves if we created
one. If you do not close it, a ResourceWarning may be reported about the
socket that is left open.

Change-Id: I200ad0cdc8b7999c3f5521b9a822122bd18714bf
Closes-Bug: #1838775
2019-12-08 20:11:17 -06:00
Tim Burke
e83cd32e2a Add test for bulk-delete-attempt-counter fix
Change-Id: Ifdeefeb4a5a3fc6895bd6cda695684de02f8c602
Related-Change: If4af9141fe4f3436a4e9e0e2dfc24c6ec7292996
Related-Bug: #1852808
2019-11-15 22:08:51 +00:00
Sébastien Blaisot
709ab385c6 Fix printed object names on successful bulk-delete
Replace the 1 always concatenated to printed object names for each
successfully deleted object in bulk-delete with an optional [after x
attempts] if x > 1

Change-Id: If4af9141fe4f3436a4e9e0e2dfc24c6ec7292996
Closes-Bug: 1852808
2019-11-15 22:37:38 +01:00
Tim Burke
c4bef14fc1 v1auth: support endpoint_data_for() api
...so we can be used with openstacksdk.

Also, add a few functests that use openstacksdk.

Change-Id: Ie6987f5de48914ec8932254cde79a973a0264877
2019-11-06 08:47:24 +00:00
Tim Burke
1eda8f9f3e Rename "tests" directory to be "test" like in the swift repo
In addition to being less confusing for devs, this lets us actually run
tempauth tests in swiftclient dsvm jobs.

The job definition (over in the swift repo) specifies test/sample.conf,
which does not exist in this repo. As a result, those tests would skip
with

    SKIPPING FUNCTIONAL TESTS DUE TO NO CONFIG

Change-Id: I558dbf9a657d442e6e19468e543bbec855129eeb
2019-11-06 03:48:02 +00:00
kangyufei
9527d0497f Switch to Ussuri jobs
Change-Id: Ibf51928ce55e4a96f0d674c693559b2bf9256f11
2019-10-22 14:33:33 +08:00
606951c736 Update master for stable/train
Add file to the reno documentation build to show release notes for
stable/train.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/train.

Change-Id: I8831476757575fd54fc07154450c6d545fbe6463
Sem-Ver: feature
2019-09-13 14:38:50 -07:00
Tim Burke
72b90fed4c Authors/changelog for 3.8.1
Change-Id: I4f178c30723e0da6ba1ec8c8c171137ada631496
2019-09-12 16:30:58 -07:00
Matthew Oliver
14095c109f PDF Documentation Build tox target
This patch adds a `pdf-docs` tox target that will build
PDF versions of our docs. As per the Train community goal:

  https://governance.openstack.org/tc/goals/selected/train/pdf-doc-generation.html

Story: 2006122
Task: 35514
Change-Id: I7e0ee410ac603774e4b03f859ac3aa20e5afc9b8
2019-09-04 11:29:37 -07:00
Tim Burke
a0f0aedb41 docs: Fix warning treated as error
Change-Id: I669533334419e94ca925e859f2b0d5d2afe9f7f1
2019-09-04 11:21:04 -07:00
Zuul
00efcfc9ca Merge "Add Python 3 Train unit tests" 2019-08-15 22:40:23 +00:00
Zuul
4f320bd034 Merge "Fix up requests so we can send non-RFC-compliant headers on py3" 2019-08-02 07:55:23 +00:00
Tim Burke
7875398746 Delete/overwrite symlinks better
Previously, when deleting a symlink that points to an xLO, we'd clean
up the xLO's segments then delete the symlink, leaving the xLO itself
busted.

Similar trouble would come from overwriting a symlink pointing to an
xLO. Check for a Content-Location in the HEAD response and leave such
segments.

Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>
Change-Id: I45b210cf380a68bd88187c91fa2d63a8b2bb709b
2019-08-01 20:42:31 -07:00