1359 Commits

Author SHA1 Message Date
Jenkins
46d50a6b8e Merge "Add a debugging userrc after keystone is up" 2015-10-14 03:05:44 +00:00
Sean Dague
95c33d532f add timing infrastructure to devstack
this adds a timing infrastructure to devstack to account for time
taken up by set of operations. The first instance of this is
accounting the time taken up by doing apt_get calls.

Change-Id: I855ffe9c7a75e9943106af0f70cf715c34ae25c5
2015-10-12 23:08:56 +00:00
Chris Dent
c6d470142e Perform additional disable_service checks
With the advent of plugins and their settings files it has become
possible to disable_service in local.conf only to have the service
re-enabled in a plugin settings file. This happens because of
processing order.

To get around this the disable_service function now aggregates
service names into a DISABLED_SERVICES variable which is then checked
during enable_service. If something tries to enable something that
was previously disabled, a warning is produced in the log and the
service is not enabled.

Then after all configuration has been sourced a final check is to
done by verify_disabled_services to confirm that something has not
manually adjusted ENABLED_SERVICES to overcome a previously called
disable_service. If something has, the stack dies with an error.

Change-Id: I0f9403f44ed2fe693a46cd02486bd94043ce6b1a
Closes-Bug: #1504304
2015-10-09 16:34:32 +00:00
Jenkins
b2b82a0f34 Merge "Move $DEST creation after logging setup" 2015-10-09 13:58:23 +00:00
Sean Dague
56037e9a6e provide devstack lockout with .no-devstack file.
This lets you specify that devstack should not be run by the user on
the box that you are on. Helps with running commands in the wrong
window.

Change-Id: I7aa26df1a2e02331d596bbfefb0697937787252f
2015-10-08 12:27:07 -04:00
Einst Crazy
9e11e098c3 Move $DEST creation after logging setup
Setup the log output before calling functions like
check_path_perm_sanity that want to write out to
the error log.

Change-Id: I9815965257c399a48f8cf0f344814d954137aecb
Closes-Bug: #1500834
2015-10-08 17:00:59 +08:00
Ian Wienand
7adf15df5c Add a debugging userrc after keystone is up
As a follow-on to the issues raised by
I069f46f95656655ae7ba8f3dd929f47eae594b68, rather than a re-write of
create_userrc.sh logic, create a temporary userrc that can be helpful
for debugging until we have the whole system bootstrapped

Change-Id: I3325acffd259cf7f6f4a153c88037cfe8405ca50
2015-10-08 10:12:34 +11:00
Jenkins
17491f37d7 Merge "Revert "Revert "Convert identity defaults to keystone v3 api""" 2015-10-07 19:30:18 +00:00
Jenkins
c4564dfbe6 Merge "Install python db client if a db backend is configured" 2015-10-03 22:58:35 +00:00
Steve Martinelli
050a0d5b30 Revert "Revert "Convert identity defaults to keystone v3 api""
This reverts commit f768787bdd6dddf2790f83a884618d29677ca77c.
And sets OS_AUTH_VERSION so swift CLI doesn't fall flat when
not using v2 keystone

Change-Id: If44a7e0d85e48020a3c90d8c5c027513129f0f3b
2015-09-29 19:52:28 +00:00
Olivier Lemasle
7dd890d6e1 Install python db client if a db backend is configured
If `DATABASE_TYPE` is configured in `local.conf`, the database backend
is currently configured with `initialize_database_backends` even if no
database backend is enabled.

On a multi-nodes Devstack environment, such as devstack-vagrant, the
compute node currently fails because it does not have PyMysql. This
compute node has no database backend enabled, but has to connect to
the database on another node.

We should install the python client if DATABASE_TYPE is set, even
if no database backend is enabled.

Closes-Bug: 1501001
Change-Id: Iffd5f7243a0dfdbe56cf6b9a87b96ed7678c81dd
2015-09-29 21:05:20 +02:00
Jenkins
1de69ff47d Merge "Removed unused TOKEN from upload_image" 2015-09-28 20:46:25 +00:00
Jenkins
b27ab6fb25 Merge "stackrc set the LC_ALL to C" 2015-09-28 20:19:43 +00:00
Jenkins
f845b22a45 Merge "Remove ceilometer in favor of plugin" 2015-09-28 17:49:32 +00:00
Einst Crazy
f327b1e119 stackrc set the LC_ALL to C
It will report 'unknown locale: UTF-8', when the env is UTF-8.
Default set the LC_ALL to C in the stackrc, instead. And delete
the duplicate option in stack.sh.

Closes-Bug: 1499296

Change-Id: I14121b25ac314a1a93e6dd6811e196ce2a7c0eb5
2015-09-28 11:23:03 +08:00
Andrey Pavlov
5090142969 Revert change I2f8ae86e17d26ec4defa16e843faa8987d27fac9
The commit breaks creation of user rc file.
Now devstack doesn't create certificate for user
(because it's too early to do it) and doesn't react
to changes of EC2/S3 urls if they is recreated by devstack plugins.
So the commit totally broke ec2-api gating for example.

Change-Id: I069f46f95656655ae7ba8f3dd929f47eae594b68
2015-09-22 22:59:46 +03:00
Peter Stachowski
5aeea6ae3e Removed unused TOKEN from upload_image
Changeset https://review.openstack.org/#/c/225426/ changed how images
were uploaded into Glance, however the (now) unused TOKEN variable
and function argument to upload_image remained.

These have been removed.

Change-Id: I9910c469f72d52e56111048cc24ea3c992c1d480
2015-09-22 19:40:40 +00:00
Monty Taylor
31c313d3a3 Use normal API not token/endpoint for image uploads
There is no reason to use keystone token bootstrapping for image
uploads. Glance is a service, and images can be uploaded to it normally
without special shenanigans.

Depends-On: If7b81c4a6746c8a1eb0302c96e045fb0f457d67b
Change-Id: I7092fb10cbe243e091789134263fab081af0c7f4
2015-09-21 15:45:33 -05:00
Monty Taylor
7224eecb98 Extract writing clouds.yaml to function
It's a bit wordy to be directly in stack.sh and not in a function.

Change-Id: Ibddfd8018d861191f1b1dc3270e0e81c274733cd
2015-09-21 15:45:23 -05:00
Monty Taylor
16a2d64f37 Move writing of credentials earlier in the process
If something goes wrong after keystone is running with services
registered, but before credentials are written, it's hard to poke at the
existing half-running state because none of the auth information is
recorded.

Write the files right after we're done bootstrapping keystone.

Change-Id: I2f8ae86e17d26ec4defa16e843faa8987d27fac9
2015-09-21 15:45:13 -05:00
Jenkins
a54c0d67fd Merge "check LIBS_FROM_GIT" 2015-09-11 19:14:22 +00:00
Sean Dague
c71973eb04 check LIBS_FROM_GIT
after the glance_store vs. upper-constraints bug, it's probably worth
actually enforcing and sanity checking that devstack is doing what
it's being asked of with LIBS_FROM_GIT. This will hopefully reduce
user generated error.

This *might* not work with the current oslo naming, we'll have to test
and normalize that.

Change-Id: Iffef2007f99a0e932b68c4c897ebbfb748cac2b4
2015-09-11 07:01:02 -04:00
Jenkins
f25c9ec366 Merge "Fix typos in devstack/stack.sh" 2015-09-09 23:46:37 +00:00
Chris Dent
e9a4750fe1 Remove ceilometer in favor of plugin
The ceilometer project is moving to using a devstack plugin rather
than having ceilometer in the base devstack. This is to allow
greater control and flexibility.

Change-Id: I413ab159474b7d7231ad66d3a482201f74efe8a8
2015-09-09 16:44:29 +00:00
Wei Jiangang
2af6915e08 Fix typos in devstack/stack.sh
log to the the file => log to the file
pluggins => plugins

Change-Id: Iff5c54c39afb4398962bfe6a0500b1f011c75c8a
2015-09-08 18:08:41 +08:00
Lucas Alvares Gomes
f768787bdd Revert "Convert identity defaults to keystone v3 api"
This change have broke the Ironic tests. Reverting to unblock the Ironic
gate.

This reverts commit 4b115ad526df7e12bbdc71e0280b3c691e53ed04.

Closes-Bug: #1492216
Change-Id: I03acfdf47caf435cede1df08fd79b288a6662435
2015-09-04 15:35:01 +01:00
Jenkins
7594b10012 Merge "Convert identity defaults to keystone v3 api" 2015-09-03 22:24:40 +00:00
Jenkins
7b227387cf Merge "Move xtrace early" 2015-08-28 01:09:00 +00:00
Shashank Hegde
2d91fe8a6b Cloning requirements repository before pip install
The commit 05aa3846a0402edc9cc49f4ba36f09592004b273 into devstack exposed a bug
where pip_install is called before the requirements repository is cloned. This
change ensures that the requirements repository exists before pip_install is
called.

Change-Id: I60b157fc98691764a69cf022852e7a95fc50cdd7
Closes-Bug: #1486304
2015-08-18 19:08:58 -07:00
Jenkins
987dc6453e Merge "Just use constraints everywhere" 2015-08-18 23:07:53 +00:00
Jenkins
92d996bf3a Merge "Move horizon apache root to /dashboard" 2015-08-18 20:41:49 +00:00
Clark Boylan
05aa3846a0 Just use constraints everywhere
Having behavior on your laptop diverge from behavior in the gate is
confusing. Just use constraints on every devstack run to be consistent.
Users of devstack can edit the requirements repo in order to change
these constraints locally if necessary.

Change-Id: I843208e2e982eb04931b76f5cb4bd219fbcd70de
2015-08-18 09:39:04 -07:00
Jamie Lennox
4b115ad526 Convert identity defaults to keystone v3 api
At this point all our function calls should be using the V3 APIs anyway
so switch the authentication credentials to v3 compatible ones and
remove all the hacks we added to force v3 API calls.

Implements: bp keystonev3
Change-Id: If92d3e11b9a363454f77527783b6d25f4da9c249
2015-08-15 05:03:41 +00:00
David Lyle
7b105c572e Move horizon apache root to /dashboard
With keystone's move to /identity, a conflict in for resources was
created as both keystone and horizon used /identity. The keystone
config took precedence and rendered API output in the horizon UI.

This patch sets the root for horizon to /dashboard and serves all
horizon content from there. Additionally, a RedirectMatch has been added
to the apache config for horizon to redirect '/' to '/dashboard' this
will allow the implementation to change without being immediately
painful to users.

Also made the path '/dashboard/' configurable in stackrc.

Closes-Bug: #1478306
Depends-On: I9a04f936ed6d8c14775a332dc28e903992806c42

for devstack-gate changes to remove hard coded horizon url structure
assumptions.

Change-Id: I6fbca5cea9e44df160afbccc71bd045437657320
2015-08-13 01:41:57 +00:00
Clark Boylan
57aafb5a9a Clone reqs repo prior to using pip constraints
We pull the pip constraints from the requirements repo so need to clone
that repo prior to using the constraints. In fixup_stuff.sh devstack
attempts to install packages like prettytable using the constraints. It
is also possible to need constraints before fixup_stuff.sh if tracking
depends. To deal with this clone requirements repo before any possible
use of constraints in pip_install.

Change-Id: I42e981c8c5ce1b8a57b9f6cce213065c72d6af11
2015-08-03 10:42:48 -07:00
Jenkins
3805b3770c Merge "Allow installing keystoneauth from git" 2015-07-23 14:17:49 +00:00
Jenkins
69ba244ca8 Merge "Update Centos/RHEL to use Kilo RDO packages" 2015-07-09 14:05:11 +00:00
Ian Wienand
f0247ed21a Move xtrace early
I dug back through the history to see why xtrace is enabled where it
is.  Originally (like first commit originally), it was somewhat sanely
placed to turn on tracing after it had done the interactive
"read_password" prompt stuff.  Over time, it has just shuffled it's
way down as stuff got added around it.

This was noticed this because I was looking for tracing of earlier
commands when looking at the repo setup (see
Iec2ad7b5598fdaefbc2338ade702bc7b08963b96) and couldn't find it.

Putting this at the start means we both capture all output
unconditionally, and avoid needlessly getting this interleaved at some
odd place again.

Change-Id: I441d7eecbab9d204258c18a071ccc1cbf4f7512a
2015-07-09 15:49:16 +10:00
Zhang Jinnan
23cd71ac94 Update Centos/RHEL to use Kilo RDO packages
Update Centos/RHEL to use Kilo based RDO

Change-Id: I901c4e9dfb6bce377b6afb19bbce94c71dfe127f
2015-07-09 04:23:32 +00:00
Jenkins
56ecd79782 Merge "Log all input/output in rootwrap calls" 2015-07-08 23:58:44 +00:00
Jamie Lennox
21a9077d7c Allow installing keystoneauth from git
Keystoneauth is not marked as stable yet however to ensure that the
integration between it, keystoneclient and other services don't break
compatibility we want to test it with tempest.

Unfortunately you can't put -e links in requirements.txt files so add
it to devstack so we can set the test environment. This will also make
it available when keystoneauth is released.

Change-Id: I43ca1df9c6ae2f0ac1a687c9ce1e2ccb97e81652
2015-07-06 23:17:15 +00:00
Brian Haley
180f5eb652 Add IPv6 support to devstack infrastructure
By default, most Openstack services are bound to 0.0.0.0
and service endpoints are registered as IPv4 addresses.
With this change we introduce two new variables to control
this behavior:

SERVICE_IP_VERSION - can either be "4" or "6".

When set to "4" (default if not set) devstack will operate
as today - most services will open listen sockets on 0.0.0.0
and service endpoints will be registered using HOST_IP as the
address.

When set to "6" devstack services will open listen sockets on ::
and service endpoints will be registered using HOST_IPV6 as the
address.

There is no support for "4+6", more work is required for that.

HOST_IPV6 - if SERVICE_IP_VERSION=6 this must be an IPv6
address configured on the system.

Some existing services, like the Openvswitch agent, will continue
to use IPv4 addresses for things like tunnel endpoints.  This is
a current restriction in the code and can be updated at a later
time.  This change is just a first step to supporting IPv6-only
control and data planes in devstack.

This change is also partly based on two previous patches,
https://review.openstack.org/#/c/140519/ and
https://review.openstack.org/#/c/176898/

Change-Id: I5c0b775490ce54ab104fd5e89b20fb700212ae74
Co-Authored-By: Sean Collins <sean@coreitpro.com>
Co-Authored-By: Baodong Li <baoli@cisco.com>
Co-Authored-By: Sridhar Gaddam <sridhar.gaddam@enovance.com>
Co-Authored-By: Adam Kacmarsky <adam.kacmarsky@hp.com>
Co-Authored-By: Jeremy Alvis <jeremy.alvis@hp.com>
2015-07-02 15:16:34 -06:00
Jenkins
7a0f6833ad Merge "remove non RabbitMQ messaging" 2015-07-02 20:09:05 +00:00
Jenkins
fee742ba72 Merge "Move Sahara into in-tree plugin" 2015-07-02 18:39:38 +00:00
Robert Collins
635a5ba992 constraints file support for devstack.
Constraints files allow a global view of dependencies for devstack
without the side effect that requirements files have of installing
everything everytime. This is part of the cross project
requirements-management spec.

Change-Id: If089d30146629e6cf817edd634e5c2b80f1366dd
2015-07-02 11:37:22 +12:00
Sergey Lukjanov
3381e09f72 Move Sahara into in-tree plugin
Once the Sahara related code moved to Sahara repo and used, we can
remove Sahara specific code from Devstack.

Partial-Implements: bp sahara-devstack-intree

Change-Id: I34412b5cb2e86944b8555b8fd04b43556eb2bbe6
Depends-on: I2e00b2ebc59dd3be6a0539dea2985f2e801a1bd7
Depends-on: I07c3fede473030e8a110cbf5a08309f890905abf
2015-07-01 16:09:56 +00:00
Jenkins
7bc1f3c15f Merge "Use Keystone v3 API for user creation" 2015-06-30 17:15:58 +00:00
Jenkins
c782781a4c Merge "Add devstack-admin cloud to clouds.yaml" 2015-06-25 12:11:38 +00:00
Jenkins
065fdf2456 Merge "Update clouds.yaml" 2015-06-25 11:58:31 +00:00
Sean Dague
b0160d0fa9 Log all input/output in rootwrap calls
This should make it easier to understand possible interactions between
rootwrap processes calling commands that might be the cause of race
bugs.

Closes-Bug: 1081524
Change-Id: Ic1f1fa42e4478a9d30f0f582a68f648935d0097d
2015-06-24 21:01:00 +00:00