1052 Commits

Author SHA1 Message Date
Tim Burke
c73792c2e5 tests: Make test_delete_container_versions less flakey
Hammering that test in a tight loop, I'd often see failures due to
ordering issues. Make the delete single-threaded to avoid that.

Change-Id: Iff45be32a7c3f258214cce78001fd33ad0a39b8c
2020-09-21 16:40:09 -07:00
5728bf4a50 Add Python3 wallaby unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for wallaby.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I9a2e832e8165232c15731cfb97d401c84abf95c0
2020-09-21 10:17:03 -07:00
16b377c623 Update master for stable/victoria
Add file to the reno documentation build to show release notes for
stable/victoria.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/victoria.

Change-Id: Ic1dc50f7e9d0b38f04a114eb22de25466ba83e56
Sem-Ver: feature
2020-09-21 10:17:03 -07:00
Zuul
b13712949f Merge "(Mostly) revert "Cleanup session on delete"" 2020-09-19 03:44:31 +00:00
Ghanshyam Mann
9f69908f75 [goal] Migrate testing to ubuntu focal
As per victoria cycle testing runtime and community goal[1]
we need to migrate upstream CI/CD to Ubuntu Focal(20.04).

- Keep py2 functional job run on Bionic node

Story: #2007865
Task: #40221

Change-Id: I578abeb1552d73a2e5c5a24ba7afab975508ea0c
2020-09-19 01:39:35 +00:00
Andreas Jaeger
e367b6270c Switch to newer openstackdocstheme and reno versions
Switch to openstackdocstheme 2.2.1 and reno 3.1.0 versions. Using
these versions will allow especially:
* Linking from HTML to PDF document
* Allow parallel building of documents
* Fix some rendering problems

Update Sphinx version as well.

Set openstackdocs_pdf_link to link to PDF file. Note that
the link to the published document only works on docs.openstack.org
where the PDF file is placed in the top-level html directory. The
site-preview places the PDF in a pdf directory.

Disable openstackdocs_auto_name to use 'project' variable as name.

Change pygments_style to 'native' since old theme version always used
'native' and the theme now respects the setting and using 'sphinx' can
lead to some strange rendering.

Remove docs requirements from lower-constraints, they are not needed
during install or test but only for docs building.

openstackdocstheme renames some variables, so follow the renames
before the next release removes them. A couple of variables are also
not needed anymore, remove them.

See also
http://lists.openstack.org/pipermail/openstack-discuss/2020-May/014971.html

Change-Id: I4418f86c3066353d43758118865baf66d1741c79
2020-09-18 12:22:01 -07:00
Tim Burke
5cb9061487 Clean up some requirements
* Drop the py26 marker for futures; we don't support 2.6 anymore.
* Split hacking version used based on python version.
* Clean up sphinx split -- 2.0+ aren't available to install on py2,
  anyway.

Depends-On: https://review.opendev.org/#/c/752340/
Depends-On: https://review.opendev.org/#/c/752736/
Change-Id: I5a6ba8e65c23ada7297f6684dcbdd886591d0af5
2020-09-18 12:22:01 -07:00
Tim Burke
0f6713ed5b Include transaction ID in ClientException.__str__
It's fairly annoying getting a traceback in swift's probe tests then
only having a URL and status code to go searching for in logs.

Leave the shell.py output untouched, though, since we output the
transaction ID on a new line anyway.

Change-Id: Idb849848ec08b6c04812b088467c9a687c2a7e27
2020-09-09 15:32:43 -07:00
Tim Burke
0c70d164ba (Mostly) revert "Cleanup session on delete"
This reverts commit 1f26c5736949e1c3b57c024a315e33fc419f126e for py2.
Apparently the existence of the __del__ method on Python 2 prevents us
from cleaning up all file descriptors.

Change-Id: Id6cff5dd7b9faf9c4240c0cb26b74d05ed37da5b
Closes-Bug: #1873435
Related-Bug: #1838775
2020-09-08 15:04:54 -07:00
Zuul
9d8db8f612 Merge "Speed up test_lazy_connections" victoria-em 2020-09-03 04:12:21 +00:00
Tim Burke
89c8d9b853 Speed up test_lazy_connections
It doesn't really need to sleep a full second.

Change-Id: Ida80f0c5a983edb33a93662badb6aa1a25f9a27c
2020-07-28 11:28:30 -07:00
Meuh
842086d27f Add max_backoff and starting_backoff for get_conn in swift service
Change-Id: I45f5d3009e0e2015c7366384ee826113fc27c70b
2020-07-28 20:03:11 +02:00
Tim Burke
22d1f3a39a Clean up some warnings
Change-Id: Iae149533d04c7b173c4ef88fb775f5fe13c16466
2020-06-17 21:05:25 -07:00
Zuul
b63d9a3e96 Merge "Application credential support follow-up" 2020-06-17 22:41:58 +00:00
Zuul
7852314b0b Merge "Remove references to swift-specs and blueprints" 2020-06-03 17:03:30 +00:00
Tim Burke
d1f894c124 Remove references to swift-specs and blueprints
Those have been dead for a long while.

Change-Id: I21306a40479ad319c0ef48aa8bfb88f261011390
2020-06-02 13:34:49 -07:00
Zuul
d1e69b195b Merge "Ussuri contrib docs community goal" 2020-06-01 23:33:33 +00:00
Tim Burke
257a7185a8 Application credential support follow-up
Following the recent v3applicationcredentials patch, if you have your
environment variables set up to work with python-openstackclient using
swiftclient's v1password plugin, swiftclient won't work:

   $ env | egrep '^(OS|ST)_'
   ST_KEY=testing
   ST_USER=test:tester
   OS_AUTH_URL=http://saio/auth/v1.0
   ST_AUTH=http://saio/auth/v1.0
   OS_USERNAME=test:tester
   OS_AUTH_TYPE=v1password
   OS_PASSWORD=testing

   $ openstack object store account show
   +------------+----------------------------+
   | Field      | Value                      |
   +------------+----------------------------+
   | Account    | AUTH_test                  |
   | Bytes      | 0                          |
   | Containers | 11                         |
   | Objects    | 0                          |
   +------------+----------------------------+

   $ swift stat
   Only "v3applicationcredential" is supported for --os-auth-type

We don't really want to allow (and mostly ignore) arbitrary OS_AUTH_TYPE
values, though -- there are a whole bunch of plugins we don't remotely
support. But it seems OK to allow any of the password plugins; while we
won't actually use them (currently), we provide roughly equivalent
functionality.

Handful of other drive-bys:
 * Use a None sentinel to determine whether keystoneauth1 is installed
   instead of trying to catch a NameError.
 * Clarify error state when keystoneauth1 is not installed.
 * Fix a typo: "sses" -> "sess".

Change-Id: Id7ea9c3ea8278ae86a04d057a472a8f8a87b8eae
Related-Change: I9190e5e7e24b6a741970fa0d0ac792deccf73d25
2020-05-27 15:17:09 -07:00
fuzihao
9b6d1c7e88 Fix pygments style
New theme of docs (Victoria+) respects pygments_style.
Since we starts using Victoria reqs while being on Ussuri,
this patch ensures proper rendering both in Ussuri and Victoria.

Change-Id: Iad418798277b9d7a1190e42e9079080a3d2707f3
2020-05-20 15:27:49 +08:00
Zuul
5840efe1d6 Merge "Support v3 application credentials auth." 2020-05-13 08:36:17 +00:00
Matthew Oliver
6e000d11e4 Ussuri contrib docs community goal
This patch standardizes the CONTRIBUTING.rst file and adds the
required doc/source/contributor/contributing.rst

The contibuting.txt points to the Swift contributor documentation.

Change-Id: Ia6c105698dd0269479536645270d12a7c1061bc7
2020-05-13 15:36:22 +10:00
Zuul
eecdcdefbc Merge "Fixed capability discovery endpoint hardcode" 2020-04-25 02:07:18 +00:00
Sean McGinnis
e44ca6d8af
Bump default tox env from py37 to py38
Python 3.8 is now our highest level supported python runtime.
This updates the default tox target environments to swap out
py37 for py38 to make sure local development testing is
covering this version.

This does not impact zuul jobs in any way, nor prevent local
tests against py37. It just changes the default if none is
explicitly provided.

Change-Id: I7bc7d7a49de746cc8fdb58a44619bc5ce66b7003
Signed-off-by: Sean McGinnis <sean.mcginnis@gmail.com>
2020-04-24 10:25:58 -05:00
Ivan Kolodyazhny
947c09f30c Fixed capability discovery endpoint hardcode
It fixes get_capabilities() method to process
correctly endpoints like: 'https://<ip>:<port>/v1',
'https://<ip>:<port>/swift/v1'.

Co-Authored-By: Daniel Cech <dcech@mirantis.com>
Change-Id: Ib4037d0b49da1bce959947100629370805f510d5
Closes-bug: #1712358
2020-04-24 12:50:58 +03:00
Tim Burke
77993f242b Add py38 classifier
Change-Id: I28bf4aeb12c1f3833d2c6501b49d184b54d36093
2020-04-20 10:10:46 -07:00
Andreas Jaeger
bb3888e73e Update docs building
Update docs building:
* Switch to sphinx-build
* Update requirements for Sphinx and openstackdocstheme for
  python 3
* Remove unneeded doc and translation sections from setup.cfg
* Remove install_command, it's unneeded, the default is fine.

Change-Id: Ib9fe754b700bceb164ba0f596cbcc6d864ccbadc
2020-04-19 09:57:27 +02:00
Charles Hsu
02b637cdca Support v3 application credentials auth.
Use keystoneauth1 application credential plugin and session to fetch
a token and endpoint catalog url.

$ swift --os-auth-url http://172.16.1.2:5000/v3 --auth-version 3\
      --os-application-credential-id THE_ID \
      --os-application-credential-secret THE_SECRET \
      --os-auth-type v3applicationcredential auth

Change-Id: I9190e5e7e24b6a741970fa0d0ac792deccf73d25
Closes-Bug: 1843901
Closes-Bug: 1856635
2020-04-16 12:41:04 +08:00
Zuul
c36616292f Merge "Change recommended test config to use auth_uri" 2020-04-14 17:41:57 +00:00
Tim Burke
06c5c30fa4 Change recommended test config to use auth_uri
...instead of piecing it together from auth_host, auth_port, auth_ssl,
auth_prefix, and (sort of, sometimes) auth_version.

Change-Id: Ie9c36e778d6a03f905899074d7136b767812ea11
2020-04-13 22:45:25 -07:00
Tim Burke
2eba2dd42a Add cacert test config option
Change-Id: I3936f862e0fef176cad34f277598b136a40de1eb
2020-04-13 22:29:44 -07:00
Zuul
2baef86966 Merge "Add Python3 victoria unit tests" 2020-04-13 23:30:17 +00:00
Zuul
a0608f223a Merge "Update master for stable/ussuri" 2020-04-13 18:50:42 +00:00
Zuul
2cbc583fb9 Merge "Improve list --versions output" 2020-04-13 18:29:42 +00:00
89ae9d77cb Add Python3 victoria unit tests
This is an automatically generated patch to ensure unit testing
is in place for all the of the tested runtimes for victoria.

See also the PTI in governance [1].

[1]: https://governance.openstack.org/tc/reference/project-testing-interface.html

Change-Id: I2fa8505451caadbe895cc3262c0bf1470795968b
2020-04-13 10:12:15 -07:00
a15eaec826 Update master for stable/ussuri
Add file to the reno documentation build to show release notes for
stable/ussuri.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/ussuri.

Change-Id: I75dc03a9d29c65b8d104b8d3a95915094cba6320
Sem-Ver: feature
2020-04-13 10:12:15 -07:00
Andreas Jaeger
f9f2090a02 Drop pypy testing
The pypy job is always failing, drop it.

Change-Id: Ibc80d23846b364bfcd82043430ef71ad4b6e271b
2020-04-12 20:41:23 +02:00
Tim Burke
9b0da49c0b Improve list --versions output
Have `--versions` imply `--long` and add a new column for version_id.

Also, have version-aware listings show all versions as "null" on old
Swifts that don't support object versioning (or when object versioning
is not enabled).

Change-Id: I0e009bce2471d1c140ac9b83700591cb355fee3f
2020-04-10 17:16:15 -07:00
Clay Gerrard
78edffa46c object versioning features
* add --versions to list
 * add --versions to delete
 * add --version-id to stat
 * add --version-id to delete
 * add --version-id to download

Change-Id: I89802064921778fee7efe57c7d60c976cdde3a27
2020-04-08 13:07:26 -07:00
Tim Burke
02e8f4f228 Blacklist stestr 3.0.0
It claims py2 support, but that's a lie.

Also, switch our tempest job to the py3 variant, now that glance (at
least) is py3-only and tempest-full is broken.

Change-Id: Ic30fe82ff72fe4d138ec4823d36f2a1cc56f1ac7
2020-04-08 12:48:36 -07:00
Tim Burke
259b98f69d Authors/changelog for 3.9.0
Change-Id: I661503e0d6bb7934f7e7a28b094264a2ee73a419
2020-02-12 17:34:25 -08:00
Zuul
67e5f6ab5c Merge "Make py38 job voting" 2020-01-25 01:20:15 +00:00
Tim Burke
0bbc2cdbec Make py38 job voting
Depends-On: https://review.opendev.org/#/c/693401/
Change-Id: Ifb4e466eda0c45b49c16e63b0c77023f65b039b8
2020-01-22 08:31:23 -08:00
Tim Burke
13970ac5fa packaging: Properly flag universal wheel
I'm not sure we've *ever* done this properly; see the PyPA docs:
https://packaging.python.org/guides/distributing-packages-using-setuptools/#universal-wheels

Change-Id: I8bb9e05f386076aa652b3955f0abf757d229afed
2020-01-20 21:20:22 -08:00
Zuul
80cdada0c2 Merge "Add test for bulk-delete-attempt-counter fix" 2020-01-16 00:58:12 +00:00
Zuul
90e71f5506 Merge "Cleanup session on delete" 2019-12-09 23:39:57 +00:00
Alex Schultz
1f26c57369 Cleanup session on delete
If an external http connection was not passed into the client, we
create one with a requests.Session() on our own. Once this is used,
it may still have an open socket when the connection is closed. We need
to handle the closing of the requests.Session() ourselves if we created
one. If you do not close it, a ResourceWarning may be reported about the
socket that is left open.

Change-Id: I200ad0cdc8b7999c3f5521b9a822122bd18714bf
Closes-Bug: #1838775
2019-12-08 20:11:17 -06:00
Tim Burke
e83cd32e2a Add test for bulk-delete-attempt-counter fix
Change-Id: Ifdeefeb4a5a3fc6895bd6cda695684de02f8c602
Related-Change: If4af9141fe4f3436a4e9e0e2dfc24c6ec7292996
Related-Bug: #1852808
2019-11-15 22:08:51 +00:00
Sébastien Blaisot
709ab385c6 Fix printed object names on successful bulk-delete
Replace the 1 always concatenated to printed object names for each
successfully deleted object in bulk-delete with an optional [after x
attempts] if x > 1

Change-Id: If4af9141fe4f3436a4e9e0e2dfc24c6ec7292996
Closes-Bug: 1852808
2019-11-15 22:37:38 +01:00
Tim Burke
c4bef14fc1 v1auth: support endpoint_data_for() api
...so we can be used with openstacksdk.

Also, add a few functests that use openstacksdk.

Change-Id: Ie6987f5de48914ec8932254cde79a973a0264877
2019-11-06 08:47:24 +00:00
Tim Burke
1eda8f9f3e Rename "tests" directory to be "test" like in the swift repo
In addition to being less confusing for devs, this lets us actually run
tempauth tests in swiftclient dsvm jobs.

The job definition (over in the swift repo) specifies test/sample.conf,
which does not exist in this repo. As a result, those tests would skip
with

    SKIPPING FUNCTIONAL TESTS DUE TO NO CONFIG

Change-Id: I558dbf9a657d442e6e19468e543bbec855129eeb
2019-11-06 03:48:02 +00:00