92 Commits

Author SHA1 Message Date
Andreas Jaeger
f205ff1cd1 Cleanup py27 support
Make a few cleanups:
- Remove python 2.7 stanza from setup.py
- Add requires on python >= 3.6 to setup.cfg so that pypi and pip
  know about the requirement
- Remove obsolete sections from setup.cfg:
  * Wheel is not needed for python 3 only repo
  * Some other sections are obsolete
- Update classifiers
- Update requirements, no need for python_version anymore

Change-Id: I45df1dd05d88a5b97e89c0bc07cad6ad93422efe
2020-04-05 10:34:47 +02:00
Luigi Toscano
513aaff688 [ussuri][goal] Drop python 2.7 support and testing
OpenStack is dropping the py2.7 support in ussuri cycle.

sahara plugins do works with python 3 and the sahara core
does not support python 2.7 anymore anyway.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal:
https://governance.openstack.org/tc/goals/selected/ussuri/drop-py27.html

Change-Id: Ie0208c416771944b1b6b98c23c825a8892fac7a4
2020-01-26 21:58:32 +01:00
ZhongShengping
d6b6947c60 Update Python 3 test runtimes for Train
This goal is to implement the process set out in the 2018-10-24 Python
Update Process TC resolution[1], for the Train cycle to ensure unit
testing is in place for all of the Tested Runtimes for Train[2].
In practice, this generally means adding unit tests for Python 3.7 and dropping
unit tests for Python 3.5. Using the Zuul template for Train will ensure that
all projects that support Python3 will be tested against the agreed runtime
versions, and make it easier to update them in future.

[1]https://governance.openstack.org/tc/resolutions/20181024-python-update-process.html
[2]https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: Ib2d10c734e99066c8d5364e25df6cdd8641f6760
Depends-On: https://review.opendev.org/#/c/641878/
2019-05-09 17:34:52 +08:00
ZhongShengping
47a9338be5 Dropping the py35 testing
All the integration testing has been moved to
Bionic now[1] and py3.5 is not tested runtime for
Train or stable/stein[2].

As per below ML thread, we are good to drop the py35
testing now:
http://lists.openstack.org/pipermail/openstack-discuss/2019-April/005097.html

[1] http://lists.openstack.org/pipermail/openstack-discuss/2019-April/004647.html
[2]
https://governance.openstack.org/tc/reference/runtimes/stein.html
https://governance.openstack.org/tc/reference/runtimes/train.html

Change-Id: I7d8b22d8a6220f176cb8812f9ae37f64998d56dc
2019-04-15 09:13:28 +08:00
ZhongShengping
7a20d8a12a Update mailinglist from dev to discuss
openstack-dev was decomissioned this night in https://review.openstack.org/621258
Update openstack-dev to openstack-discuss

Change-Id: Id3fb3340174f424d2e614bf76fd853a4ba24fa8e
2019-01-23 15:28:42 +08:00
Luigi Toscano
d6c0df6c6c Post-import fixes: name, license, doc, translations
- fix the name of the module in setup.cfg, according the correct
  pattern (otherwise the name of the directory is not correct);
- add LICENSE file, required by (at least some) distributions;
- setup the translations;
- fix the name of the manpage, use the name of the module;
- add the classifier for Python 3.6.

Change-Id: I11421603a6f097cbebe0347ead869bab9c26c335
2019-01-14 23:43:00 +01:00
Telles Nobrega
0637de5fdb Plugins splitted from sahara core
Change-Id: I43e0beec6508f93a436a150749bfa23571986b9d
2019-01-03 14:55:23 -03:00
akhiljain23
5dd969dcca Add framework for sahara-status upgrade check
This commit adds the functionality of sahara-status CLI for performing
upgrade checks as part of the Stein cycle upgrade-checkers goal.
It only includes a sample check which must be replaced by real checks in
future.

Change-Id: Idcb8d9eaf689800812cf6087e9c5937058c89ea6
Story: 2003657
Task: 26152
2018-10-19 14:08:44 +00:00
Jeremy Freudberg
01d542e14f S3 data source
* Create S3 data source type for EDP
* Support storing S3 secret key in Castellan
* Unit tests for new data source type
* Document new data source type and related ideas
* Add support of S3 configs into Spark and Oozie workflows
* Hide S3 credentials in job execution info, like for Swift
* Release note

Change-Id: I3ae5b9879b54f81d34bc7cd6a6f754347ce82f33
2018-07-02 14:27:46 -04:00
Nguyen Hai
a7828391ca Follow the new PTI for document build
For compliance with the Project Testing Interface as described in:
https://governance.openstack.org/tc/reference/project-testing-interface.html
http://lists.openstack.org/pipermail/openstack-dev/2017-December/125710.html

Remove the '[build_sphinx]' section as described in:
http://lists.openstack.org/pipermail/openstack-dev/2018-March/128594.html

Change-Id: Ia8e8d6b4e23c2737a9e948e7c4b682dca697f6a4
2018-03-27 19:48:02 +09:00
Jeremy Freudberg
d1287d273a S3 job binary and binary retriever
* Create common module for managing S3 job binaries
* Add new dependency on botocore
* Use common S3 library to create S3 job binary type for EDP
* Use common S3 library to create S3 job binary retriever
* Support storing S3 secret key in Castellan
* Document new job binary type (and foreshadow the S3 data source type)
* Unit tests for new code

Change-Id: I6781203d802305446ba1418ed6999186db4dfe9b
Partially-Implements: bp sahara-support-s3
2017-12-28 20:20:37 +00:00
Telles Nobrega
b665ca7c22 Policy in code for Sahara
This patch is part of the community goal to move policies into code.

https://governance.openstack.org/tc/goals/queens/policy-in-code.html

Change-Id: I8f228ca40acc589b9aa41fc1e80a1c0308f179cf
2017-10-23 11:46:31 -03:00
Jesse Pretorius
0bfb401c61 Add default configuration files to data_files
In order to make it simpler to use the default
configuration files when deploying services
from source, the files are added to pbr's
data_files section so that the files are
included in the built wheels and therefore
deployed with the code. Packaging and deployment
tools can then more easily use the default files
if they wish to.

This pattern is already established with similar
files for neutron, designate and glance as has
been mentioned in the related bug report.

Change-Id: Iae987bdae55b75143f192f9a642cf1ff564c62b6
Closes-Bug: #1718356
2017-09-22 13:54:51 +01:00
chenxing
d084dc136d Update Documention link
Change-Id: I39f0bc1c7b5ef8114f6391058ab4378638b50907
2017-07-13 13:26:47 +00:00
pawnesh.kumar
329164cc5f Enable warnings as errors for doc building
Treat warnings as errors for doc building - adding Sphinx'
warning-is-errors variable.

Change-Id: I12f9c92e8b8f9245614797e65af1ae48a0714923
2017-07-11 05:29:08 +00:00
Marianne Linhares Monteiro
2adfb21f99 Support Job binary pluggability
Changes to support the job binary abstraction.

Change-Id: If5133f2d35974f0b4ca1776bc9fe39f011575389
Implements: blueprint data-source-plugin
2017-03-18 21:19:02 +00:00
Jenkins
4d7042f8ea Merge "Support Data Source pluggability" 2017-03-18 21:12:58 +00:00
Marianne Linhares Monteiro
7e4bcb188d Support Data Source pluggability
Changes to support the data source abstraction.

Change-Id: I62274c08619c8e720231eb6aa0563ac6e12497f1
Implements: blueprint data-source-plugin
2017-03-15 09:06:12 -03:00
Cao Xuan Hoang
f03e927caf Remove support for py34
The gating on python 3.4 is restricted to <= Mitaka. This is due to
the change from Ubuntu Trusty to Xenial, where only python3.5 is
available. There is no need to continue to keep these settings.

Change-Id: Ifbe877705dbd87dea34d2b1974d2ae3ed7cac9a3
2017-02-08 10:34:02 +07:00
Shu Yingya
67287a3e85 Remove entry point of sahara tempest plugin
In patch [1], tempest-like test of sahara client has been removed.
But in setup.cfg, there still is entry point of it. Remove it!

[1]:https://review.openstack.org/#/c/367980/

Change-Id: I802e27b91486baa43286bc949e304448ad1610f1
2016-09-11 23:25:58 +08:00
Jenkins
1e47f59685 Merge "Add Python 3.5 classifier and venv" 2016-07-25 10:33:38 +00:00
PanFengyun
0f81f39f38 Add Python 3.5 classifier and venv
Now that there is a passing gate job, we can claim support for
Python 3.5 in the classifier. This patch also adds the convenience
py35 venv.

Change-Id: I15a761c0b6d5769b2dba9f521ef96cf43c99e552
2016-07-14 21:49:12 +08:00
Ethan Gafford
2f7eaf13a5 CLI for Plugin-Declared Image Declaration
Introduces a new libfuestfs-driven CLI for packing of
Sahara images, using the same recipe definition scheme
introduced in the validate-image-spi blueprint.

Documentation and plugin image packing configurability
can and will be provided in separate patches for ease
of review.

Partially-implements: blueprint image-generation-cli
Change-Id: I6788108e3fb6232045fc56937639a6348768a7bc
2016-07-13 14:41:00 -04:00
Vitaly Gridnev
cc0990c375 Remove hdp 2.0.6 plugin
Newton release is opened, so we can remove this
plugin from sahara codebase

Implements blueprint: remove-hdp206
Change-Id: I1ebf90e716964151c88de53d127789251bef066b
2016-05-17 23:28:12 +03:00
Doug Hellmann
0d788ceab3 register the config generator default hook with the right name
No config generator hooks should ever be registered with a name that
belongs to another project. In this case, using oslo.middleware.cors
means that *every other project* that loads the middleware gets this
application's defaults when the generator is run on a system with
everything installed (such as a dev box with devstack). Use the name
of the app instead, to ensure that the defaults are only set when this
app's sample config and documentation are being generated.

Change-Id: I6a8c7d44b9db9325003ff2fdb667b0ced7739e96
Signed-off-by: Doug Hellmann <doug@doughellmann.com>
2016-03-11 15:30:36 -05:00
Michael Krotscheck
11a970511a Moved CORS middleware configuration into oslo-config-generator
The default values needed for sahara's implementation of cors
middleware have been moved from paste.ini into the configuration
hooks provided by oslo.config. Furthermore, these values have been
added to the default initialization procedure. This ensures
that if a value remains unset in the configuration file, it will
fallback to using sane defaults. It also ensures that an operator
modifying the configuration will be presented with that same
set of defaults.

Change-Id: Iedcaa002ff3d40cf61168769bc3946f8c6e42b87
Closes-Bug: 1551836
2016-03-03 14:01:09 -08:00
Sergey Reshetnyak
94cbc2bac8 Add support running Sahara as wsgi app
This patch adds support of running sahara-api as wsgi application.
Tested with apache + mod_wsgi web server.

Change-Id: I7355b09ebedd44e51242a252e96ac3a51073b2e6
2016-02-15 14:40:55 +03:00
Sergey Lukjanov
d232589b9b Remove version from setup.cfg
Per [1] we now want to use the git repository for knowing the version instead
of just trying to modify the setup.cfg file.

[1] http://lists.openstack.org/pipermail/openstack-dev/2015-November/080692.html

Change-Id: I790506ea15e67f0cdeaed62b5b87a7d51c589e7b
Depends-On: I001a18895489a56eb55a5eb8c73ab6a3d4b1d4d0
2015-12-03 03:25:23 -08:00
Vitaly Gridnev
8cc3625882 Drop direct engine support
This change remove support of direct engine in Sahara.
Unit tests related to direct engine were removed.

Implements blueprint: remove-direct-engine

Change-Id: Iba292996dd052a069a98f1024441255a15c0f734
2015-11-19 07:59:23 +00:00
Thierry Carrez
c59d305daa Open Mitaka development
Bump preversion to mark the start of the Mitaka development branch.
The liberty release branch will be cut from the previous commit.

Change-Id: I2e08186efb1d4f0d280bce11f2c3ac710bfa0a5d
2015-09-25 09:06:36 +02:00
Luigi Toscano
b849a27850 Adapt python client tests to use Tempest plugin interface
Use the Tempest plugin interface for python client tests (which
are already tempest-based) instead of copying the tests inside
the tempest tree.

Inspired by the same type of change applied to Manila,
see Ie5ed64a6777ed1acf8dd56522c26705ae897596d

Depends-On: I06f1e13207cc6d661c078c4c4cf1ae7974ecf3da
Change-Id: I6073a528413aefd96882179a1eb8bbe715c6417b
2015-09-18 14:13:04 +02:00
Sergey Reshetnyak
b5d8ebc72d New version of HDP plugin
Current features:
* Set up Ambari server and Ambari agents from pre-built image
* Support Ambari 2.0 / 2.1
* Password generation for management console

partially implements bp: hdp-22-support

Change-Id: I53084a83cccde52654a42911f449cc8b7d769bea
2015-08-20 13:04:43 +03:00
Sergey Vilgelm
6092c81310 Remove openstack.common package
Clean up the unused modules from the openstack.common package

Closes-Bug: #1476407
Change-Id: I5697f761c310dd8e13b7219b2968c3e6f4cfb299
2015-07-20 21:24:22 +00:00
Doug Hellmann
cf41777780 Update version for Liberty
Update the version for Liberty, switching from date-based versioning
to pre-versioning using SemVer. See
http://lists.openstack.org/pipermail/openstack-dev/2015-May/065211.html
and
http://lists.openstack.org/pipermail/openstack-dev/2015-June/067082.html
for details.

Change-Id: I6a35fa0dda798fad93b804d00a46af80f08d475c
2015-06-17 21:20:46 +00:00
Jenkins
9a2648e0d8 Merge "Open Liberty development" 2015-04-09 10:17:46 +00:00
Thierry Carrez
c796670f2f Open Liberty development
Bump pre-version in setup.cfg to formally open Liberty development.
Kilo release branch will be cut from the previous commit.

Change-Id: I6fa1e9e45fbaae62f7feb64039565266cbc86788
2015-04-07 14:14:11 +02:00
Sergey Lukjanov
920f38e3b5 Migrate to oslo.policy lib instead of copy-pasted oslo-incubator
The first official oslo.policy was released and so we're ready to
migrate from the copy-pasted oslo-incubator code to the separated
lib.

Change-Id: I8e404d2b622876389d9b1019ae50f1e1a8cecdf1
2015-04-06 10:13:51 +03:00
Trevor McKay
3015b044f4 Add a CLI tool for managing default templates
This change adds a CLI called sahara-templates to manage default
templates.

Partial-implements: blueprint default-templates
Change-Id: I4f30bd6bc378d90fda41b512c04afe8023d2b4b2
2015-04-01 13:01:46 -04:00
Andrew Lazarev
3bfa8cb3da Reorganized heat template generation code
* Extracted heat template generation from
  'utils/openstack/heat.py' to 'service/heat/templates.py'.
  Now heat.py is for heat client only.
* Moved heat template resources from 'resources' to
  'service/heat/resources'
* Separated tests for heat templates and heat client.

Change-Id: I4c7a561f1648f34e71574a556cbc07ed2cf9b173
Closes-Bug: #1373075
2015-02-18 20:56:11 +00:00
Jenkins
8ad03a26f2 Merge "Remove log module from common modules" 2015-02-03 09:57:14 +00:00
Vitaly Gridnev
0836598e6c Remove log module from common modules
Log module was removed from oslo-incubator,
so let's sync with latest oslo-incubator and remove
log module.

Change-Id: Id27ade473ed8597f2741ed0c746fa6b7ef6c7f06
Related-bug: #1412673
2015-02-02 09:30:02 +00:00
ChangBo Guo(gcb)
d7141618db Drop cli/sahara-rootwrap
It can be automatically generated from console_scripts entry in
setup.cfg. So we don't need maintain it for sahara.

Change-Id: Ibe2a170cc60eb69b44aec43fb61f367e53c47b9f
2015-01-30 14:41:40 +00:00
Andrew Lazarev
82317fdc7e Added ability to listen HTTPS port
* Added oslo-inclubator 'sslutils' module dependency
* Added config params from sslutils
* Added ability to make SSL port for sahara-api

Implements blueprint: sahara-support-https

Change-Id: I184e39b6a0eb6ad17b51aa408a65a455983bfb0c
2015-01-09 14:43:01 -08:00
Jenkins
e3879f571a Merge "Cleaned up config generator settings" 2015-01-08 02:07:37 +00:00
Michael McCune
5dc786b24a Adding Storm entry point to setup.cfg
This change allows the stevedore package to find the Storm plugin when
enabling extensions.

Change-Id: I1748609caff74e073171d5e4a1b76fda9efef1d6
Closes-Bug: 1407120
2015-01-06 16:18:38 -05:00
Andrew Lazarev
74ee80c8b0 Cleaned up config generator settings
1. Sahara opts are listed once
2. Oslo incubator opts are listed separately
3. Groups are referenced by variables

Still things to improve:
1. opt-group mapping is listed twice now (in reg and in list)
2. registering spread across the project (should be in one place)
3. dependancies are not managed (it should be one place with CONF)

Change-Id: I4b8edf26187b3c23d08f9efbee42086652efea5a
Closes-Bug: #1407834
2015-01-06 12:14:44 -08:00
Vitaly Gridnev
ad0de19c64 Drop obsolete oslo-confing-generator
Change-Id: Ie25d7081b57dd4242d39c52a22ba65955d210691
Closes-Bug:#1380725
2014-11-10 16:15:08 +03:00
Artem Osadchiy
e2a86520e7 MapR plugin implementation
Change-Id: Id08a3c7a8a40fd826cd902cedbc2590ca284e548
Implements: blueprint mapr-plugin
2014-10-20 17:10:14 +03:00
Michael McCune
ddb5ddd6e2 Adding support for oslo.rootwrap to namespace access
Changes
* adding configuration options for rootwrap
* refactoring ssh connection to use rootwrap as a proxy when requested
* adding documentation for rootwrap configuration
* adding default rootwrap filters file
* adding default sudoers conf file for sahara user
* adding default rootwrap conf file for sahara-rootwrap
* adding sahara-rootwrap cli script
* adding requirement for oslo.rootwrap

Change-Id: I7871400b2342a4cd1a8910ae5121b1bfdc46078d
Closes-Bug: #1271349
2014-10-06 19:06:02 -04:00
Thierry Carrez
81a8531d9f Open Kilo development
Bump pre-version to 2015.1 to formally open master branch to Kilo
development.

Change-Id: Ibd929d8f826bab9b87e44b8de881f58768874294
2014-09-30 09:24:07 +02:00