266 Commits

Author SHA1 Message Date
Jenkins
a3bb131c13 Merge "Remove unused KEYSTONE_CATALOG_BACKEND" 2016-11-23 02:16:07 +00:00
Jenkins
7976f31fb9 Merge "Unset admin_project config options for Keystone" 2016-11-16 00:04:44 +00:00
Steve Martinelli
dc486bc12f Switch fernet to be the default token provider
this is the first patch in a series to actually make fernet the default
token provider in keystone. the patches for grenade, release notes, and
actually switching the value in keystone all depend on this patch first.

reasons for switching over:

- fernet tokens are the recommended token provider
- the install guide for newton recommends deployers use fernet tokens [0]
- we previously attempted this switch but ran into timing issues [1],
  the timing issues have been resolved [2]

[0] http://docs.openstack.org/newton/install-guide-ubuntu/keystone-install.html
[1] 153db269705f37d4144ad3fcf26dc67269755d7d
[2] https://review.openstack.org/#/q/topic:make-fernet-default

Change-Id: I3b819ae8d2924f3bece03902e05d1a8c5e5923f1
2016-10-31 14:57:11 +00:00
Eric Brown
fb73d85afe Remove unused KEYSTONE_CATALOG_BACKEND
This patch simply removes a var noted to be removed back in Newton.

Change-Id: I7c66e1d8d65f562596543ed8ca402dba8c8ea271
2016-10-28 02:03:37 -07:00
Eric Brown
7b07ccf5e4 Remove deprecated/obsolete ldap options
The devstack ldap configuration for keystone is still using some
old options that are no longer valid. The write support is
being removed this release. And in previous releases, the ldap
assignment driver support was removed and was not removed here.

Change-Id: I538626b681eaee6a7ac10dfbc29605b73fbe13bf
2016-10-27 16:24:16 +00:00
Adam Young
4440da8563 Unset admin_project config options for Keystone
Until the policy changes land for Nova, Glance, etc, this
value is not used.  Additionally, by having it set, it actually
makes it hard/impossible for the required changes to land in
the other services.  Disable/comment out the changes in the
Keystone specific lib file for now, and we will re-enable once
the Services can make use of them.

Change-Id: Ia1de9083c21107dac2f0abb56bda166bdb37a69d
2016-10-26 11:40:08 +02:00
Sean Dague
ec498cd061 remove sites-enabled/keystone.conf link on clean
doing a clean.sh / stack.sh cycle with USE_SSL=True was failing
because we were no longer cleaning up the keystone site fully, so some
of the early mod_ssl queries hit an invalid apache configuration.

Change-Id: Ic6f3f601e532ec50c0234d928c25b378d9e95e32
2016-10-06 15:00:44 -04:00
Jenkins
792a7ab31f Merge "Mount identity admin script at /identity_admin" 2016-09-26 20:39:11 +00:00
Jenkins
e18d6fae72 Merge "Switch keystone to dogpile.cache.memcached backend" 2016-09-26 16:54:00 +00:00
Jenkins
590e21f9a4 Merge "Keystone uwsgi set lazy-apps=true" 2016-09-26 16:53:52 +00:00
Jamie Lennox
04e69de6c5 Mount identity admin script at /identity_admin
The /identity_admin endpoint is the port 80/443 equivalent of the
service that typically runs on port 35357. In v2 some operations must be
performed on the admin endpoint whereas on v3 the services on 5000 and
35357 are exactly the same. This would be why the service was mounted at
/identity_v2_admin however that is misleading because both the v2 and v3
services are present on that endpoint.

This is particularly confusing because we set this as the OS_AUTH_URL
endpoint and it makes it seem like we are doing v2 authentication when
we are not.

Change-Id: If73735026079fb19ca5bd44b3a4dc1f507b5c99d
2016-09-26 14:44:40 +00:00
Jenkins
a2d1848419 Merge "Use apache for tls-proxy ssl termination" 2016-09-21 18:19:40 +00:00
Gregory Haynes
4b49e409f8 Use apache for tls-proxy ssl termination
Stud is now abandonware (see https://github.com/bumptech/stud) and is
not packaged in xenial. Lets use Apache for SSL termination since its
there already.

Change-Id: Ifcba410f5969521e8b3d30f02795541c1661f83a
2016-09-20 08:14:11 -07:00
Jenkins
b74fc6886f Merge "Keystone re-enable catalog caching" 2016-09-08 00:59:33 +00:00
Brant Knudson
eb77eef8a5 Keystone re-enable catalog caching
Catalog caching was disabled due to bug 1537617, but this has been
fixed for some time. Re-enabling to get some performance back.

Change-Id: Ic0edf5c70a5040edf3393dbd1e110ab5fb56c110
Related-Bug: 1537617
2016-08-31 16:26:30 -05:00
Brant Knudson
542abbab3b Keystone uwsgi set lazy-apps=true
Keystone had a problem where there was a memcached socket
opened very early on startup which then got shared between
worker processes when running under uwsgi. This can be
prevented by setting lazy-apps so this is the recommended
setting.

See http://uwsgi-docs.readthedocs.io/en/latest/ThingsToKnow.html

"""uWSGI tries to (ab)use the Copy On Write semantics of the
fork() call whenever possible. By default it will fork after
having loaded your applications to share as much of their
memory as possible. If this behavior is undesirable for some
reason, use the lazy-apps option. This will instruct uWSGI to
load the applications after each worker’s fork(). Beware as
there is an older options named lazy that is way more invasive
and highly discouraged (it is still here only for backward
compatibility) """

Change-Id: I6f271dc906528f0c86060452deaf15df81b267d2
Related-Bug: 1600394
2016-08-31 15:47:56 -05:00
Lance Bragstad
69d4a71dfe Allow setup of credential encryption using fernet
With the addition of encrypted credential in keystone, we need to be able to
add setup steps in devstack to configure the credential repository with
encryption keys.

Depends-On: I97e7701bc5b8765d207cc721793643bcefa2d4e2
Depends-On: Id3e8922adc154cfec5f7a36613e22eb0b49eeffe
Change-Id: I433da9a257daa21ec3b5996b2bca571211f1fbba
2016-08-29 21:18:47 +00:00
Brant Knudson
0a318ab8a6 Switch keystone to dogpile.cache.memcached backend
memcache_pool is there to keep a limited number of thread-associated
connections open rather than a connection for every thread. If you
don't have a huge number of threads it doesn't offer anything.
Keystone is an example of a service where memcache_pool doesn't
improve things -- eventlet isn't supported anymore and more threads
is not useful due to GIL.

As such, keystone cache backend is changed to dogpile.cache.memcached.

See https://review.openstack.org/357407 for the oslo.cache help text
change.

Change-Id: I4452a8c4968073cdea4c0f384453a5a28519fa08
2016-08-18 13:50:18 -05:00
Jenkins
e88c51cc1b Merge "Keystone uwsgi performance tuning" 2016-06-15 01:11:46 +00:00
Brant Knudson
75ace7a5ed Correct keystone memcached host setting
keystone was configured to connect to memcached on the host IP
address. Unfortunately, memcached is only listening on localhost,
so this setting actually hurts performance as keystone fails to
connect to the memcached server. There's no indication of this in
the keystone logs since this is just how memcache client works
(ignoring errors).

You can verify this by
1) in /etc/memcached.conf, set -vv
2) restart memcached: service memcached restart
3) watch /var/log/memcached.log
4) There will be no output

with this change, there will be output in /var/log/memcached.log

Also the performance should be a lot better.

Change-Id: I95d798d122e2a95e27eb1d2c4e786c3cd844440b
2016-06-07 17:44:06 -05:00
Brant Knudson
b97a60e90c Keystone uwsgi performance tuning
I ran some tests locally that showed that when using the uwsgi
deploy the keystone server wasn't using all the processes
available. When I switched from "threads" to "processes" the
concurrent performance improved considerably. So I'm proposing
that devstack switch to processes to improve performance.

Change-Id: I8cfe9272e098e636441b7cfb51bff08d62c3336e
2016-06-05 18:48:03 -05:00
Jenkins
f5998b0253 Merge "Use path-mounted keystone when running in httpd" 2016-05-24 20:13:19 +00:00
Jenkins
ade7898e52 Merge "Revert "Switch fernet to be the default token provider"" 2016-05-18 15:35:32 +00:00
Matt Riedemann
153db26970 Revert "Switch fernet to be the default token provider"
This reverts commit 181588b9ba50fefea12617a9a5e774daddfed20c.

Since this change landed on 4/29 it's been the cause of the
top two gate failures (besides known latent infra issues) and
hasn't had good progress on landing a fix, so until it's a
priority for the keystone team we need to revert this change
to get the integrated gate jobs moving again.

Change-Id: I588a84c5179eab072d21bc1394aea2df00929650
Related-Bug: #1577558
Related-Bug: #1578866
2016-05-18 14:05:14 +00:00
Jenkins
b671d83850 Merge "Change the domain name in keystone.conf" 2016-05-18 13:42:43 +00:00
Jenkins
a898099634 Merge "Set config file to db sync and other manage operation" 2016-05-17 10:42:50 +00:00
Jens Rosenboom
0afe207cb3 Create service project in service domain
When creating service users, the assumption is that the service
project lies within the service domain, so create it there.

Change-Id: I4880e789f5eaf340634ceb792397eef12a5a6b51
Closes-Bug: 1580998
2016-05-12 14:09:03 +02:00
Einst Crazy
4f55c2d5c3 Set config file to db sync and other manage operation
Currently, the db sync operation does not specify the config dir or
config file.
If there is a config file in the home path, it will use this one,
but not the right one devstack write.

Set config file to these operations.

Change-Id: Id1fbc3d85280c19596f5ebd301c46bcf018fa2f6
Closes-Bug: #1578098
2016-05-09 01:43:32 +00:00
Rabi Mishra
d1c9198bbe Change the domain name in keystone.conf
As we are creating a domain with id 'default' and name
'Default', we should iniset the correct name.

Change-Id: If67338fbbd255b8aa1b91e18e4cf8213baebab95
2016-05-04 16:11:09 +05:30
Brant Knudson
841fdafa0b Use path-mounted keystone when running in httpd
When running in httpd, keystone accepts requests on /identity and
/identity_v2_admin.

The path endpoints should be preferred over the ports so keystone
is configured to point applications to the path endpoints by
setting admin_endpoint and public_endpoint.

Change-Id: I34569b9e03c3f36748c92d803349e22a7ee1a633
2016-05-02 19:10:18 -05:00
Jenkins
5b83e986de Merge "Switch fernet to be the default token provider" 2016-04-29 17:27:15 +00:00
Jenkins
039fc1a542 Merge "Allow putting service users in a seperate domain" 2016-04-20 21:49:02 +00:00
Brant Knudson
181588b9ba Switch fernet to be the default token provider
Use the fernet token provider as the default for keystone.

 The Keystone token provider of choice is changing from UUID to Fernet.
 However, due the the need for multi-site keystone deploys to have keys
 kept in sync, we cannot change the default in upstream Keystone
 without  breaking existing deployments.  Fernet requires a deliberate
 setup step like what is done in devstack.  Making the change in
 devstack documents the expected setup.

Change-Id: I8c0db244634b0861b0eb3c48fe6ede153f7f04f2
2016-04-19 19:04:37 +00:00
Jamie Lennox
cbcbd8f33c Allow putting service users in a seperate domain
Make it possible to construct the service users in their own seperate
domain. Changing this away from Default will not work for everyone yet,
though it does work for basic service interaction however enabling it
will allow us to start testing and hopefully gating that services aren't
relying on v2 only concepts.

Change-Id: I7e73df5dd1caabf355783da2bc0f3007ade92fba
2016-04-18 09:59:52 +10:00
Ian Wienand
982b9911fb Deprecate SERVICE_TENANT
This is a follow-on to I6f392d3c16726f6dd734184dcf3014fb4f388207 to
note the variable is kept for backwards compatibility.

Change-Id: I1008b2d4e2baf82e1aa531d9eaf96a084beb69aa
2016-04-14 13:41:34 +10:00
Jenkins
2e23e64151 Merge "change tenant to project in keystone bootstrapping" 2016-04-13 23:35:52 +00:00
Jenkins
846254620e Merge "Revert "Revert "Use unversioned keystone endpoints""" 2016-04-08 15:47:24 +00:00
Armando Migliaccio
8dda061a1f Revert "Revert "Use unversioned keystone endpoints""
This reverts commit da1ca6e07c0d54d0ec5b94ebd78da81c6a46e780.

Depends-on: Id2c7e09611c1f8b06e6d272589b4ea3435b8de86
Change-Id: I1b2a65179b5863d8bcbc5dd02b615f4e6e564213
2016-04-07 17:00:37 +00:00
Jenkins
2bf6095925 Merge "Revert "Use unversioned keystone endpoints"" 2016-04-07 00:10:16 +00:00
Armando Migliaccio
da1ca6e07c Revert "Use unversioned keystone endpoints"
This reverts commit 4921d4dbb937b8a9ca26379a33252f0bebcfb53f.

Change-Id: Ic8888fca5d25ca6caa3f29f712db319f1d3869ba
2016-04-06 21:57:28 +00:00
Jenkins
4bb3e20655 Merge "Use unversioned keystone endpoints" 2016-04-06 18:31:02 +00:00
Sean Dague
0b1465b6f6 change tenant to project in keystone bootstrapping
Change-Id: I6f392d3c16726f6dd734184dcf3014fb4f388207
2016-04-05 11:40:25 -04:00
Brant Knudson
556eeb0d35 Drop keystone eventlet support
Keystone has dropped support for running under eventlet (using
keystone-all).

Change-Id: Ib38c0b1a54633a6b6dfa3a0a605cd2b02ca48989
2016-03-24 14:01:57 -05:00
Attila Fazekas
9ea497539b Configure the admin as admin
Make our usual admin user to be a real admin,
and open the way for improving the per project
policy.json files.

Change-Id: I133a5953d209bc1edbd03ecfae750f77e3eaa64d
Related-Change: https://review.openstack.org/#/c/242232
2016-03-23 19:03:14 +01:00
Jenkins
0a2a7ae847 Merge "Updated deprecated keystone_authtoken option" 2016-03-18 20:24:03 +00:00
Ihar Hrachyshka
198887e890 logging: don't set logging format strings for keystone
Don't override those format strings since the overridden
values are identical to those used by oslo.log by default [1].

logging_exception_prefix is still set since it changes the logging
format to use TRACE label for exceptions instead of default ERROR.

[1]: https://git.openstack.org/cgit/openstack/oslo.log/tree/oslo_log/_options.py?id=c47a91dbbb586c27d8521b1016bf7901c47b1c90#n110

Closes-Bug: #1433687
Change-Id: Ibd11cd6b0defb6dc709dbd3e718a49fd71cce6b6
2016-03-17 13:09:56 +01:00
Jamie Lennox
4921d4dbb9 Use unversioned keystone endpoints
Insert the unversioned keystone URLs into the service catalog. Services
should be able to determine the correct URL for their work from this.

Depends-On: I931f0c558aafc8dfaa5519744c6e4e7fcffc3205
Change-Id: I6171f782a1dd397720a9b2a3393b30ae5aca0cc2
2016-03-17 12:39:49 +11:00
Jenkins
428f86e84f Merge "uwsgi keystone under master process" 2016-03-15 01:01:16 +00:00
Jenkins
c47340efb7 Merge "Cleanup duplication in keystone uwsgi options" 2016-03-15 01:01:08 +00:00
Jenkins
4b56bc3507 Merge "Use extended keystone-manage bootstrap parameters" 2016-03-14 21:03:08 +00:00