Release notes for 0.11.0
Change-Id: I0d26a082dd50a59dff281ea6cbe42115d75363ad
This commit is contained in:
Andrey Kurilin
parent
e7d6155298
commit
565947d453
263
doc/release_notes/archive/v0.11.0.rst
Normal file
263
doc/release_notes/archive/v0.11.0.rst
Normal file
@ -0,0 +1,263 @@
|
|||||||
|
=============
|
||||||
|
Rally v0.11.0
|
||||||
|
=============
|
||||||
|
|
||||||
|
Overview
|
||||||
|
--------
|
||||||
|
|
||||||
|
+------------------+-----------------------+
|
||||||
|
| Release date | **02/15/2018** |
|
||||||
|
+------------------+-----------------------+
|
||||||
|
|
||||||
|
* Stabilize Rally releases (see requirements section)
|
||||||
|
* Publishing docker images is returned!
|
||||||
|
* Environment introduction (see Deployment section)
|
||||||
|
|
||||||
|
Details
|
||||||
|
-------
|
||||||
|
|
||||||
|
Requirements
|
||||||
|
~~~~~~~~~~~~
|
||||||
|
|
||||||
|
As for long time we tried to make our releases stable and workable even after
|
||||||
|
a year from release date. For this purpose, upper limits for all our
|
||||||
|
requirements were used. Such solution helped to make releases more stable, but
|
||||||
|
it did not work well and created more pain than a profit.
|
||||||
|
The main issue was related to new releases of not-direct rally
|
||||||
|
dependencies which can be incompatible which each other.
|
||||||
|
|
||||||
|
From Rally 0.11.0 we are stopping adding upper version limits for our
|
||||||
|
`requirements
|
||||||
|
<https://github.com/openstack/rally/blob/0.11.0/requirements.txt>`_ (this does
|
||||||
|
not apply to cases when we sure that some new releases of dependency broke us
|
||||||
|
for sure).
|
||||||
|
|
||||||
|
As alternative solution, the `upper-constraints file
|
||||||
|
<https://github.com/openstack/rally/blob/0.11.0/upper-constraints.txt>`_ is
|
||||||
|
selected. It is a file with a list of packages and their versions which we used
|
||||||
|
in our CI while testing. Versions from this list are suggested to use in
|
||||||
|
production.
|
||||||
|
Please note, that it also contains not direct Rally dependencies (dependencies
|
||||||
|
of rally dependencies and dependencies of dependencies of rally dependencies
|
||||||
|
as well) and packages which possibly doesn't relate to Rally at all.
|
||||||
|
|
||||||
|
The example ou usage:
|
||||||
|
|
||||||
|
.. console:: bash
|
||||||
|
|
||||||
|
$ git clone https://github.com/openstack/rally && cd rally
|
||||||
|
$ pip install . --constraint upper-constraints.txt
|
||||||
|
|
||||||
|
Logging
|
||||||
|
~~~~~~~
|
||||||
|
|
||||||
|
The default value of ``use_stderr`` option of Rally config is changed to
|
||||||
|
**True**. It is done to ensure that json output of rally commands will not be
|
||||||
|
messed with logging and integration with third-party tools and scripts should
|
||||||
|
become simpler.
|
||||||
|
|
||||||
|
Docker
|
||||||
|
~~~~~~
|
||||||
|
|
||||||
|
Unfortunately, we lost access to `rallyforge organization at DockerHub
|
||||||
|
<https://hub.docker.com/r/rallyforge/>`_, so our docker images were not
|
||||||
|
published anywhere officially for some time. Docker Support did not help us a
|
||||||
|
lot. At least, the original repo is removed now and we can start new
|
||||||
|
organization at DockerHub from the scratch.
|
||||||
|
|
||||||
|
The new docker images for Rally+OpenStack plugins with an updated HowTo you
|
||||||
|
can find at `xrally/xrally-openstack repo
|
||||||
|
<https://hub.docker.com/r/xrally/xrally-openstack>`_. It contains all Rally
|
||||||
|
releases + latest tag which maps to master branch.
|
||||||
|
|
||||||
|
|
||||||
|
Command Line Interface
|
||||||
|
~~~~~~~~~~~~~~~~~~~~~~
|
||||||
|
|
||||||
|
* Introduce `rally db ensure
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#rally-db-ensure>`_
|
||||||
|
command. It is going to create Rally DB if it doesn't exist, otherwise it
|
||||||
|
does nothing.
|
||||||
|
|
||||||
|
* Various improvements for `rally db
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#category-db>`_.
|
||||||
|
Such as printing results of operations as well as connection string to DB,
|
||||||
|
hiding credentials by default, etc.
|
||||||
|
|
||||||
|
* Various changes in returning error codes. Error codes become different for
|
||||||
|
different exceptions. Also, `rally task start
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#rally-task-start>`_
|
||||||
|
began to return 1 in case of any runtime issues and 2 if any workload doesn't
|
||||||
|
pass it's SLA.
|
||||||
|
|
||||||
|
* The new CLI for new component (see ``Environments & Deployments`` section
|
||||||
|
for more details) - `rally env
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#category-env>`_
|
||||||
|
|
||||||
|
Environments & Deployments
|
||||||
|
~~~~~~~~~~~~~~~~~~~~~~~~~~
|
||||||
|
|
||||||
|
Deployment Component is fundamental part of Rally which is used by Task and
|
||||||
|
Verification components. Whereas Task and Verification components experienced
|
||||||
|
redesigns (some parts were redesigned even several times), Deployment component
|
||||||
|
was only extended over the time.
|
||||||
|
Currently, we are at the point when further extending requires much work and
|
||||||
|
user experience become worth. It is a hard decision, as like we had done with
|
||||||
|
Verification component in Rally 0.8, the Deployment component is re-written
|
||||||
|
from the scratch. To be clear, the new version of the component has not only
|
||||||
|
the new code, but the new name as well - it is the Environment.
|
||||||
|
|
||||||
|
We are at the stage when Rally is suitable not only for OpenStack but for
|
||||||
|
various platforms and systems. The Environment is some entity against which
|
||||||
|
Rally should perform load. The specific Environment can include credentials for
|
||||||
|
OpenStack or for Kubernetes or for both. The Environment is a way to describe
|
||||||
|
the complex system/cloud which all of us have. As well it can be used for
|
||||||
|
simple systems as easy as for complex.
|
||||||
|
|
||||||
|
If you are regular Rally user which tests OpenStack clusters, nothing is
|
||||||
|
changing for you at this moment. `rally deployment
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#category-deployment>`_
|
||||||
|
CLI still works and it is not even deprecated. It will be kept for a while.
|
||||||
|
But you can start looking at our new CLI `rally env
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#category-env>`_ .
|
||||||
|
|
||||||
|
As for writing plugins for external platforms - we are working on updating our
|
||||||
|
documentary.
|
||||||
|
|
||||||
|
Task component
|
||||||
|
~~~~~~~~~~~~~~
|
||||||
|
|
||||||
|
* The json results are extended with context execution stats (i.e when and
|
||||||
|
which context was executed, how much time setup and cleanup methods took,
|
||||||
|
etc). Also, `volumes@openstack
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/plugins/plugin_reference.html#volumes-context>`_
|
||||||
|
and
|
||||||
|
`volume_types@openstack
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/plugins/plugin_reference.html#volume-types-context>`_
|
||||||
|
are ported to include detailed stats of executed actions. In further
|
||||||
|
releases, all existing contexts will be adopted to the similar behavior.
|
||||||
|
|
||||||
|
* Better OSProfiler integration
|
||||||
|
|
||||||
|
Rally environment&deployment config began accept
|
||||||
|
``profiler_conn_str`` property which is used to generate OSProfiler native
|
||||||
|
html-report and to embed it to Rally's html-report.
|
||||||
|
|
||||||
|
* HTML report is extended to include a timestamp of failures.
|
||||||
|
|
||||||
|
Plugins
|
||||||
|
~~~~~~~
|
||||||
|
|
||||||
|
As it mentioned above, the Deployment Component will be replaced soon. Such
|
||||||
|
decision led to abandoning all deployment-related plugins (engines, providers,
|
||||||
|
etc).
|
||||||
|
|
||||||
|
|
||||||
|
**Scenarios**:
|
||||||
|
|
||||||
|
* *NEW!!*
|
||||||
|
|
||||||
|
`NovaServers.boot_server_attach_volume_and_list_attachments
|
||||||
|
<https://rally.readthedocs.io/en/0.10.0/plugins/plugin_reference.html#novaservers-boot-server-attach-volume-and-list-attachments-scenario>`_
|
||||||
|
|
||||||
|
|
||||||
|
* *UPDATED!!*
|
||||||
|
|
||||||
|
- Extend several Nova&Neutron related scenarios with
|
||||||
|
``create_floating_ip_args`` parameter
|
||||||
|
|
||||||
|
`NovaServers.boot_and_associate_floating_ip
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/plugins/plugin_reference.html#novaservers-boot-and-associate-floating-ip-scenario>`_
|
||||||
|
`NovaServers.boot_server_associate_and_dissociate_floating_ip
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/plugins/plugin_reference.html#novaservers-boot-server-associate-and-dissociate-floating-ip-scenario>`_
|
||||||
|
|
||||||
|
- Modify Bgpvpn scenarios to test true bgpvpn
|
||||||
|
|
||||||
|
All Bgpvpn scenarios began to boot a server to add active port in the
|
||||||
|
network associated to the bgpvpn which allows to test not only the record in
|
||||||
|
the database, but true bgpvpn
|
||||||
|
|
||||||
|
|
||||||
|
**Contexts**:
|
||||||
|
|
||||||
|
*UPDATED!!*
|
||||||
|
|
||||||
|
`network@openstack
|
||||||
|
<https://rally.readthedocs.io/en/latest/plugins/plugin_reference.html#network-context>`_
|
||||||
|
context is extended with ability to specify external router information.
|
||||||
|
|
||||||
|
Fixed bugs
|
||||||
|
~~~~~~~~~~
|
||||||
|
|
||||||
|
* [backported into 0.10.1][deployment] Suppress deprecation warning about an
|
||||||
|
old format in case of using `--fromenv option of rally deployment create
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#deployment-create-fromenv>`_
|
||||||
|
|
||||||
|
* [backported into 0.10.1][deployment] Failure `rally deployment show
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#deployment-show>`_
|
||||||
|
while displaying the information about deployment with a config in an old
|
||||||
|
format.
|
||||||
|
|
||||||
|
* [backported into 0.10.1][task] New json report processed the hook results in
|
||||||
|
a wrong way
|
||||||
|
|
||||||
|
`Launchpad bug-report #1734336
|
||||||
|
<https://bugs.launchpad.net/rally/+bug/1734336>`_
|
||||||
|
|
||||||
|
* [backported into 0.10.1][task] Failure while generating trends reports in
|
||||||
|
case of failures in setup method of any context
|
||||||
|
|
||||||
|
`Launchpad bug-report #1732193
|
||||||
|
<https://bugs.launchpad.net/rally/+bug/1732193>`_
|
||||||
|
|
||||||
|
* [backported into 0.10.1][task] Failure to export results in ElasticSearch 5.x
|
||||||
|
cluster in case of extra ``/`` in the end of destination url.
|
||||||
|
|
||||||
|
* [deployment] OpenStack deployment creation with `--fromenv
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/cli_reference.html#deployment-create-fromenv>`_
|
||||||
|
option used old deprecated format.
|
||||||
|
|
||||||
|
* [verify] Rally did not support creating verifiers from Gerrit/SSH source.
|
||||||
|
|
||||||
|
`Launchpad bug-report #1737529
|
||||||
|
<https://bugs.launchpad.net/rally/+bug/1737529>`_
|
||||||
|
|
||||||
|
* [task][openstack] Removing default security group in users@openstack context
|
||||||
|
did not take into account that neutron can return multiple resources in some
|
||||||
|
configuration instead of one security group which relates to requested
|
||||||
|
tenant.
|
||||||
|
|
||||||
|
* [task][openstack] Existing openstack users get their roles un-assigned if
|
||||||
|
they are equal to what roles@openstack context is configured to assign.
|
||||||
|
|
||||||
|
`Launchpad bug-report #1720270
|
||||||
|
<https://bugs.launchpad.net/rally/+bug/1720270>`_
|
||||||
|
|
||||||
|
* [task][openstack] Validation step ignores roles@openstack context and
|
||||||
|
marks as "invalid" valid cases
|
||||||
|
|
||||||
|
Some actions in openstack can be performed only if the user has specific
|
||||||
|
role. Since these roles can be different in different OpenStack installations
|
||||||
|
Rally has `roles@openstack context
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/plugins/plugin_reference.html#roles-context>`_
|
||||||
|
context which can assign roles to the users.
|
||||||
|
Validation step did not check for specified roles in workload config and made
|
||||||
|
wrong assumption about accessibility of resources
|
||||||
|
|
||||||
|
`Launchpad bug-report #1539878
|
||||||
|
<https://bugs.launchpad.net/rally/+bug/1539878>`_
|
||||||
|
|
||||||
|
* [task][openstack] Wrong identifiers were used for filtering Mistral resources
|
||||||
|
while cleanup step.
|
||||||
|
|
||||||
|
* [task][openstack] `NovaServers.boot_and_live_migrate_server
|
||||||
|
<https://rally.readthedocs.io/en/0.11.0/plugins/plugin_reference.html#novaservers-boot-and-live-migrate-server-scenario>`_
|
||||||
|
does wrong target host selection
|
||||||
|
|
||||||
|
`Launchpad bug-report #1734914
|
||||||
|
<https://bugs.launchpad.net/rally/+bug/1734914>`_
|
||||||
|
|
||||||
|
Thanks
|
||||||
|
~~~~~~
|
||||||
|
|
||||||
|
2 Everybody!
|
||||||
@ -1 +1 @@
|
|||||||
./archive/v0.10.1.rst
|
archive/v0.11.0.rst
|
||||||
Loading…
Reference in New Issue
Block a user