759 Commits

Author SHA1 Message Date
Martin Kopec
5790634ff4 Update documentation, add playbook for developers
The patch updates the user-faced documentation and adds a playbook
together with a doc meant mainly for RefStack developers which
helps with running the server instance locally.

Change-Id: I268fdf717c8f0e2cd0c130c560306bf54e48f348
2021-06-25 10:11:36 +02:00
Martin Kopec
0395f676ab Clean requirements, add pip check job
Removes redundant requirements and adds a new job which runs
'tox -epip-check-reqs' in order to avoid having redundant
dependencies specified or missing some.

Change-Id: I5ca35922213cfbe4c2b4b49388bffcc0b8fc6a96
2021-06-23 12:50:15 +00:00
Martin Kopec
95680a792d Update refstack.conf.sample
The sample config file hasn't been regenerated for years. A few
config options got changed over the years, mainly those from oslo.
The file has just been regenerated by oslo-config-generator -
'tox -egenconfig'.

Change-Id: I298baf65460fa4f1bb4c43dbd5d4758df35c9f18
2021-06-23 12:31:19 +00:00
Martin Kopec
2a0a147dfa Update the guidelines location, try #2
[1] wasn't fully complete change/preparation for guidelines
move which lead to some issues and we had to revert [2].
We revisited [2] and proposed the change again with a few
improvements [3].
This patch should change everything we need in refstack in
order to merge [3].

[1] https://review.opendev.org/c/osf/refstack/+/790940
[2] https://review.opendev.org/c/osf/interop/+/786116
[3] https://review.opendev.org/c/osf/interop/+/796413

Change-Id: Ib9f083d1f1a713b3fa26c5daca781fedfa4923fc
2021-06-22 22:43:10 +00:00
Martin Kopec
6ecd3a925c Replace freenode by OFTC
As a result of recent event the OpenStack community is moving
to new IRC network - OFTC
http://lists.openstack.org/pipermail/openstack-discuss/2021-May/022718.html

Change-Id: I20d653dabb4f9460b62305a46b3c3a76495bd1f8
2021-06-14 08:23:23 +00:00
Zuul
481eb0b9aa Merge "Update meeting info and remove old links" 2.0.0 2021-05-15 03:10:18 +00:00
Martin Kopec
81928c2e10 Update the guidelines location
This patch updates the guidelines location. The guidelines will be
moved there by [1]. In order to shorten the transition period we
are intentionally doing this *before* [1] is merged (before the
guidelines are actually moved) because it takes some time to get
this change to production. Due to that the patch also implement
a fail-safe mechanism - if the get request for guidelines returns
404, the code will try again with the old (at this moment the
current) location.
When this gets to production, we will merge [1]. Then the
fail-safe mechanism will no longer be needed, therefore it will be
removed in a follow up patch.

[1] https://review.opendev.org/c/osf/interop/+/786116

Change-Id: I5d81d0168601f2b6c3b5cae996b531ebdb33d9d0
2021-05-12 10:12:58 +00:00
Martin Kopec
1ab07795dd Update meeting info and remove old links
README showed old meeting time, the patch updates that and redirects
a user to a Wiki page where the current meeting info can be found.
The patch also removes outdated links from the README.

Change-Id: I48352caa1408960df5bad49cf8b2ecf9b4aef3de
2021-05-12 09:04:03 +00:00
Martin Kopec
65ee83693a Use Xena zuul job template
The template contains also py39 job.

Newer releases of requests-cache are not compatible with
requests package (or the other way around) resulting in:
AttributeError: 'Response' object has no attribute 'from_cache'
Therefore the patch caps requests-cache for now.

Change-Id: If64a52d975bacc43b23ee055a118dec6e3e6b42d
2021-05-03 09:18:04 +00:00
Martin Kopec
6566d87dc7 Add shared-file-system guideline
Refstack backend was missing shared-file-system in the mapping
which resulted in backend not being able to parse the Shared
File System guideline download from the interop repo.
The refstack-ui needs to be edited as well so that it can properly
render the Shared File System guideline on the website.

Change-Id: I017a331ab010f94b223add22a2b55a02b6996db5
2021-03-08 12:21:44 +00:00
Martin Kopec
a33296ed0a Target name in the downloaded list's name
When downloading a test list from [1] (click on Test List link)
include the target name in the filename.

Example for the orchestration target:
Current name of the file would be: 2020.11-test-list.txt
The new name will be: orchestration.2020.11-test-list.txt
Or the compute target:
2020.11-test-list.txt -> compute.2020.11-test-list.txt

[1] https://refstack.openstack.org/#/guidelines

Change-Id: I3337120e16e59c9e48a6a0b1d37f877e4b839a13
2021-03-08 12:21:03 +00:00
Martin Kopec
0074bf3b70 [Trivial] Assign value after the encode
In the previous fix [1] the value of pubkey.encode() was
forgotten to be assigned which basically makes it a noop
operation. This patch fixes that.

[1] https://review.opendev.org/c/osf/refstack/+/776168

Change-Id: I93a4e5d8afde7e3abfdcf66220c64cda111d4a48
2021-02-26 01:15:29 +00:00
Martin Kopec
476f4ce243 Encode pubkey in validators
Follow up change for py2->py3 migration.
The pubkey must be encoded in order to avoid 'data must be
bytes-like' error. The key is a type of str which in py2 meant
bytes, however, in py3 it's just string. Therefore the pubkey
must be encoded before it's passed to load_ssh_public_key which
requires bytes-like data.

Change-Id: I943438a59923bd9c4e9dd38058020e49fd2f3d24
2021-02-17 14:10:23 +00:00
Martin Kopec
bbbe1f525b Use opendev interop repo for querying guidelines
Refstack server was still downloading guidelines and
capabilities from the old interop repositoty hosted
on github.com. This patch changes default repo URLs
so that the guidelines are download from the current
interop repo hosted on opendev.org.

Change-Id: Ic05a2a784c8e513e09bc430139011aa73bea062e
2021-02-17 11:42:29 +00:00
Martin Kopec
23fcee1239 Remove decode call from db migrations script
This is a follow up on 'py3 only' changes. Previously in py2
current_name variable had unicode type, however in py3 it is
a str type which leads to an Attribute error when the code
is executed by py3 ('str' object has no attribute 'decode').

Now when refstack is py3 only, we don't need to be decoding
current_name variable, the patch removes this conversion.

More about str and unicode and their meaning in py2 and py3:
 * https://portingguide.readthedocs.io/en/latest/strings.html

Change-Id: Ibc76a8797b467d45b05c6e6e61d4bc703a5d701f
2021-01-28 19:11:46 +00:00
Zuul
94b1fa594f Merge "Use unittest.mock instead of mock" 2021-01-25 20:44:23 +00:00
Hervé Beraud
da9cb79e93 Use unittest.mock instead of mock
The mock third party library was needed for mock support in py2
runtimes. Since we now only support py36 and later, we can use the
standard lib unittest.mock module instead.

Change-Id: I70a406c060ba681ddc000788b3fa5ab2bba4d41f
2021-01-25 19:38:53 +00:00
Hervé Beraud
4047e51216 Stop to use the __future__ module.
The __future__ module [1] was used in this context to ensure compatibility
between python 2 and python 3.

We previously dropped the support of python 2.7 [2] and now we only support
python 3 so we don't need to continue to use this module and the imports
listed below.

Imports commonly used and their related PEPs:
- `division` is related to PEP 238 [3]
- `print_function` is related to PEP 3105 [4]
- `unicode_literals` is related to PEP 3112 [5]
- `with_statement` is related to PEP 343 [6]
- `absolute_import` is related to PEP 328 [7]

[1] https://docs.python.org/3/library/__future__.html
[2] https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html
[3] https://www.python.org/dev/peps/pep-0238
[4] https://www.python.org/dev/peps/pep-3105
[5] https://www.python.org/dev/peps/pep-3112
[6] https://www.python.org/dev/peps/pep-0343
[7] https://www.python.org/dev/peps/pep-0328

Change-Id: I6bc5768e9c06f266c71188b867d15c3dde417d44
2021-01-22 08:57:16 +00:00
Martin Kopec
052de8653b Replace six by python3 code style
As we have already dropped python2 support,
usage of six module is redundant.
The patch also edits the classifiers in setup.cfg
which comply with the wallaby cycle goals.

Change-Id: I2b0e4050e489ddfc7cbabe4165d5499ba6788422
2021-01-11 20:33:56 +00:00
Martin Kopec
a1f2375875 Inclusive jargon
tox deprecated its whitelist_externals option in
3.18 release. The patch bumps the min version of tox
to 3.18 and renames the option from whitelist_externals
to allowlist_externals.

Change-Id: I12d4bb75839adf78c17e8e562535fbf0d7e2e816
2021-01-09 15:26:19 +00:00
Goutham Pacha Ravi
78c4ce8ac8 Fix broken links and redirects
This repository is hosted on opendev.org's
gitea server, and doesn't get mirrored to
github currently (we may add mirroring in
the future). We can swap a bunch of URLs
that assume the content is on github and
older infra cgit servers with correct URLs.

Meetings have moved from IRC to MeetPad,
fix the corresponding details in the README.

Also use this commit to strip trailing
whitespaces across the repository.

Change-Id: Ica0a7ba08d9c437f94fbc9ab282bd929f01df8ff
2021-01-08 21:17:29 +00:00
Martin Kopec
69c4d81773 Comply with the newest release of PyJWT
A new version of PyJWT==2.0.0 got released a few days back which
changes a few significant things such as return types and option
names, see:
03610f0103/CHANGELOG.md (v200)
This commit edits the code of refstack in order to comply with the newest
changes of PyJWT.

Change-Id: I153384cd39ebadb8ee9eb3d99cd21aa02b8c0673
2021-01-08 20:15:27 +00:00
Zuul
aa78240eec Merge "fix a typo" 2021-01-06 14:38:16 +00:00
Martin Kopec
35b3a1da4f Fix CI, Drop python2 and 3.5, update jobs to python3
* Starting in mysql8, we can't expect a db user to be
  created with the GRANT command, we'll need to create
  one explicitly.

* OpenStack has dropped the py2.7 and py3.5 support
  in ussuri cycle. From now on, refstack will test only
  with py3 jobs. Complete discussion & schedule can be
  found in
  - http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
  - https://etherpad.openstack.org/p/drop-python2-support

  Ussuri Communtiy-wide goal:
  https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html

* Replace the "refstack-tox-py36-func-mysql" with
  "refstack-tox-functional" to simplify naming and use the system default
  python3 version for this functional job.

* replace testr unit test runner by stestr. testr runner hasn't been updated
  for ~ 6 years - stestr is its successor

Story: 2003257
Task: 24062
Change-Id: I90ab2eca6366f0b6256f097712efac2ffe08b2c0
2020-12-18 20:59:21 +00:00
Andreas Jaeger
fe84ebb7ea Update .gitreview after repo rename
Interop repos have been removed from
openstack namespace to osf namespace (Depends-On),
which need update the .gitreview to start using the
new location.

Disable failing jobs to be able to merge this change.

Depends-On: https://review.opendev.org/#/c/734669/
Change-Id: I015e8f1ee0c3bdfe490b4fbf9d67206a178af8a4
2020-06-13 09:40:16 +02:00
Clark Boylan
0af3a46e16 Force PEM filetype with ssh-keygen
At some point ssh-keygen changed its default output format and now
python cryptography can't read the new default. Address this by forcing
the PEM output format which cryptography can read without problems.

Note this is a docs only change to help end users generate keys that
work with refstack after a user reported trouble with this.

Change-Id: I9d1f503817fee69fe22f19a98b506448bda1f888
2020-05-06 14:42:23 -07:00
Clark Boylan
e6fd078a8b Update deps so that refstack builds and deploys
In bindep we specify we need GCC to compile deps and set tags to compile
and test as appropriate as none of these packages are needed as runtime
dependencies. In requirements.txt we unpin alembic and beaker and add
PyMySQL. Alembic and beaker need to be unpinned to work with modern
python3 and PyMySQL is a python only runtime dep if using MySQL.

This makes building docker images much simpler.

Change-Id: I18a296de190324c545feda3b1b87e0a9424d0f96
2020-01-31 09:43:02 -08:00
Clark Boylan
4f1f07cf73 Add utility to install js tools
This is a small utility script to install nodejs and npm and yarn for
you.

Change-Id: Iebfadb0d7cfa341f95b4dcd025313a1b8f4d3b55
2020-01-31 09:41:21 -08:00
liushuobj
b1cf16c17c fix a typo
Change-Id: I2ba52622f3a7f0a0b23ea53193751b60f24c45d2
2019-12-27 16:27:06 +08:00
huang.zhiping
b1403ead09 Change openstack-dev to openstack-discuss
Mailinglists have been updated. Openstack-discuss replaces openstack-dev.

Change-Id: I30311d87eaaa33edf42201f59ef597e21808d4b9
2019-11-06 11:28:44 +00:00
Zuul
13d6da49ba Merge "Rename review.openstack.org to review.opendev.org" 2019-09-14 19:22:01 +00:00
Elod Illes
91c56ed9a1 Add local bindep.txt and py36-func-mysql job
As it was announced [1] global bindep-fallback.txt was removed and now
projects need to have a local bindep.txt to be able to install binary
dependencies for testing.

In test jobs the script tools/test-setup.sh is called which requires
mysql and postgres servers and clients to be installed.

To eliminate 'ERROR: InterpreterNotFound: python3.5' of the zuul job
refstack-tox-py35-func-mysql, simply replace the tox environment
py35-func-mysql to py36-func-mysql with a base python of 3.6 instead of
3.5 and rename the zuul job to contain py36 in the name.

Update the Zuul template to use nodejs6 jobs, this makes the single jobs
obsolete, remove them. Without this change, the gate will use
nodejs4 and fail.

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-June/007272.html

Change-Id: I90cb912befb9d09fed330bd8d27a491caffbf7b9
2019-09-14 20:35:16 +02:00
melissaml
443250d9b5 Rename review.openstack.org to review.opendev.org
There are many references to review.openstack.org, and while the
redirect should work, we can also go ahead and fix them.

Change-Id: I70c590322ca5c20636ac8f4e0a5233dae4cb832e
2019-07-25 07:41:39 +08:00
OpenDev Sysadmins
f6c6c85379 OpenDev Migration Patch
This commit was bulk generated and pushed by the OpenDev sysadmins
as a part of the Git hosting and code review systems migration
detailed in these mailing list posts:

http://lists.openstack.org/pipermail/openstack-discuss/2019-March/003603.html
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004920.html

Attempts have been made to correct repository namespaces and
hostnames based on simple pattern matching, but it's possible some
were updated incorrectly or missed entirely. Please reach out to us
via the contact information listed at https://opendev.org/ with any
questions you may have.
2019-04-19 19:35:58 +00:00
Martin Kopec
b6f9f8611b Change testrepository for stestr in doc
Tempest has switched from stestr some time ago, so tempest
results are no longer stored under .tempest/.testrepository
but they are stored under .tempest/.stestr instead.

Change-Id: I2f0f47c8989138b361375ba91c1e9cd719ea9a8b
2018-10-18 20:43:49 +00:00
Andreas Jaeger
0c4a30a402 Use openstack-tox-cover template
Use openstack-tox-cover template, this runs the cover job
in the check queue only.

Remove jobs and use template instead.

Change-Id: I02c0c5e8b706c1170bd5b782eb624b4429d97053
2018-09-07 12:49:50 +02:00
Doug Hellmann
4df8a38787 add python 3.6 unit test job
This is a mechanically generated patch to add a unit test job running
under Python 3.6 as part of the python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: Ib27ba59598ed03b7c8ae671bcd067c0e71df3c85
Story: #2002586
Task: #24759
2018-08-30 18:10:46 -04:00
Doug Hellmann
12db47651c switch documentation job to new PTI
This is a mechanically generated patch to switch the documentation
jobs to use the new PTI versions of the jobs as part of the
python3-first goal.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: I0e29ab2bad85fe535438665260a3535eae75ad12
Story: #2002586
Task: #24759
2018-08-30 18:10:43 -04:00
Doug Hellmann
578348f9af import zuul job settings from project-config
This is a mechanically generated patch to complete step 1 of moving
the zuul job settings out of project-config and into each project
repository.

Because there will be a separate patch on each branch, the branch
specifiers for branch-specific jobs have been removed.

Because this patch is generated by a script, there may be some
cosmetic changes to the layout of the YAML file(s) as the contents are
normalized.

See the python3-first goal document for details:
https://governance.openstack.org/tc/goals/stein/python3-first.html

Change-Id: Ia4fb2dfa84eeac7a56ff2bef90034a38bc2a106b
Story: #2002586
Task: #24759
2018-08-30 18:10:30 -04:00
Zuul
27865868ba Merge "Invalid link of doc reference" 2018-07-25 21:42:40 +00:00
Megan Guiney
b12fe44c13 Remove extraneous print statement from unit test
A quick fix that doesn't really fit well into any of the exisiting
patches in progress

Change-Id: I3c46ed22105c6be974b985ec4c7b2695390f5482
2018-07-20 21:08:33 -07:00
Dao Cong Tien
174b5ca87d Invalid link of doc reference
Change-Id: If865b4093796ad99741583d6a10e53578f3f7bd9
2018-07-11 15:10:19 +07:00
Zuul
2e18fdc842 Merge "Add line in mysql setup to ensure that sbin is in path" 2018-07-06 18:37:02 +00:00
Megan Guiney
1a17a94472 Add line in mysql setup to ensure that sbin is in path
mysqld is installed to sbin by default, so if sbin is not in your
path, the tests will fail to set up properly.

Change-Id: I8ca72822ccf19046d1f5634245e972f184f5675a
2018-07-03 22:15:25 -07:00
Megan Guiney
23c5dc54fb add nodejs install back into setup docs
If not explicitly installed, node packages fail to resolve
properly.

Change-Id: Id18e6004f82b51904ea18eb674cef10490d0e427
2018-06-25 10:56:22 -07:00
Megan Guiney
aee81c6121 fix documentation formatting
New documentation regarding how to install yarn needed double
newlines rather than the current single newlines. As is, it is
rendering as a single line, which is obfuscating eyesore.

Change-Id: I4a3e921342703ea00a4ab622b304c70250006063
2018-06-16 00:11:00 -07:00
Chris Hoge
902d0362c7 Migrating from bower to yarn
* Works with the Docker development image
  * Requires an upgrade to Node 8
  * Using bower-away and yarn for simplicity

Change-Id: I353fb2f01f50f88707341369221d32ac9de513b1
2018-06-13 16:19:14 -07:00
Megan Guiney
0f55b39a6b allow for the addition of new capability sources
This change will modify a number of things about the way
we manage guideline sources
  - it allows the api to pull guidelines from a list of
    additional guideline sources, as specified in conf
  - changes the object returned by the guidelines api
    from a list to a dictionary of lists pertaining to
    a specific guideline type

Change-Id: Ic42197b32d4c9030a35e613cae8cc64dca794c85
2018-05-08 06:16:05 -07:00
Chris Hoge
18c8c1e211 Fix the apt upgrade command in the Docker file
apt update was being run without '-y', which was causing the
update to fail trying to install out of date packages. This
patch adds the `-y` and fixes the Docker build

Change-Id: I1260bb7f0dbcf95378bcda9d449293d02fa9f200
2018-04-03 14:58:39 -07:00
Zuul
c49a760567 Merge "Reconcile inconsistencies in the db api namescheme" 2018-03-27 16:08:36 +00:00