904 Commits

Author SHA1 Message Date
Jenkins
ffa0bf7ce4 Merge "Fix typo in debian-ceph-hammer log files" 2016-05-07 02:43:36 +00:00
Paul Belanger
7331598762
Add ubuntu-precise logging to nodepool-builder
Change-Id: I0d884456daaa6844251a421ba02746177ea9548d
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-05 07:53:42 -04:00
Paul Belanger
6b1c661a1b
Remove devstack-centos7 logging for nodepool
Change-Id: I445abfccd10f532142a57cb754e7f7785ae091d3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-03 12:33:43 -04:00
Paul Belanger
0fb4078426
Fix typo in debian-ceph-hammer log files
Trivial change to fix logfile path names.

Change-Id: I27a77e0bc35776a106d33b45559ebda29aa7e1cd
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-05-01 09:15:47 -05:00
Jenkins
03a687ee2d Merge "Add puppetdb.o.o trusty support" 2016-04-29 20:05:34 +00:00
Paul Belanger
20e5d5b58d Add puppetdb.o.o trusty support
Changes include changing upstream git clone and pinning to the version
we run in production.  Also new apache 2.4 syntax.

Change-Id: I3a214a42d3c49a1ea36fe84d21a275d736dfb889
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-29 12:50:47 -07:00
James E. Blair
a159ea06f6 Zuul status: Link to logs.o.o on completed builds
Change-Id: I8af0fbe82acadc0e3c05bc5164eca5a318706023
Depends-On: Ida811e2b097a32b8d560aad8a0b18c8048a36279
2016-04-19 09:02:05 -07:00
James E. Blair
0a28946607 Stop linking to jenkins in zuul status page
See I99bf3cfbcd92f65376638e00683574252e8bda02.

Change-Id: I24d147003d85089ab740ebdc790ac545b9d5651d
2016-04-15 16:18:31 -07:00
Jenkins
3526c3ae58 Merge "Normalize list indentation in clouds.yaml" 2016-04-15 18:57:53 +00:00
Jenkins
f549b11d45 Merge "Also set the network info for internap ci account" 2016-04-15 18:57:43 +00:00
Jenkins
1cd1ce60e4 Merge "Use floating_ip_source for tripleo cloud" 2016-04-15 18:52:45 +00:00
Jenkins
ddda4057fb Merge "Add network entries to clouds.yaml for internap" 2016-04-15 18:52:37 +00:00
Jenkins
dcbbc5942f Merge "Remove HP Cloud from clouds.yaml" 2016-04-15 18:51:16 +00:00
Clark Boylan
657bcc4a00 Don't mirror udeb on ceph debian mirror
The ceph debian mirror does not have udeb components so don't attempt to
mirror them. Attempting to mirror them makes reprepro fail.

Change-Id: Ica8e99092d762445af78bb0a7f7f789c8576a1c5
2016-04-15 10:38:36 -07:00
James E. Blair
542999b05e Normalize list indentation in clouds.yaml
Yes, they both work, but generally we use this form.

Change-Id: I7d04194cacc9fcaeab9176c761de4b2730ac4667
2016-04-15 10:33:11 -07:00
Michael Krotscheck
8832f7c55e
Moved npm rewrite rules out of directory scope
mod_rewrite has inconsistent behavior inside of a directory tag. For
example, it doesn't appear to update the value of REQUEST_URI in
subsequent redirects, and the modifiable URI passed to the RewriteRule
is different from that passed to the RewriteCond.

This patch moves the rewrite rules for the npm mirror out of the
directory block, in order to fix unexpected 500 errors when accessing
packages with single file names. It also switches the <directory>
configuration block to only match on subdirectories of /npm/, so that
listing the contents of /npm does not redirect the user to the
/npm/index.json/ package.

Why that package exists is left as an exercise to the user.

Change-Id: Idbad41867d3d3546a59fe0c4fa54c5be22e31438
2016-04-15 08:37:13 -07:00
Monty Taylor
16c9274213
Also set the network info for internap ci account
Same as the previous nodepool patch - it's important that we configure
internap correctly in our other clouds.yaml files.

Change-Id: I100fa7f7aa4836579dc8ddcfd40d78402aef38ef
2016-04-15 08:13:03 -05:00
Monty Taylor
84dac6c5cc
Use floating_ip_source for tripleo cloud
Instead of just turning off neutron, purely tell shade to use nova for
floating ips.

Change-Id: I731adfb1f5de788a3e2f5f66ab0be24c22a39b08
2016-04-15 08:10:21 -05:00
Monty Taylor
fb69f68776
Add network entries to clouds.yaml for internap
It's not possible to determine which networks are public and private at
internap. But we can configure them.

Change-Id: Ica0d271188261c96e03a6e8af9b664b1031ab945
2016-04-15 07:53:45 -05:00
Monty Taylor
6cab98a2c6
Remove HP Cloud from clouds.yaml
It does not exist anymore. Sniff.

Change-Id: I86f156aae84e3963f4fecc8698016d6e31a1c340
2016-04-15 07:51:00 -05:00
Clark Boylan
3878c06e1b Apt mirror for ceph hammer release
Mirror the trusty packages for the ceph hammer release to aid in process
of making ceph testing more robust. Use reprepro which is already in use
to mirror the main ubuntu trusty repos.

Change-Id: Ifd09272c7b1e07de9135be5a96be06153a3f611e
2016-04-14 14:01:27 -07:00
Michael Krotscheck
320c399a91
Add NPM mirror hosting to unified mirrors
This patch makes the necessary modifications to host npm packages
on our mirrors. Changes include:

- index.json as a DirectoryIndex
- Rewrite rules for the AFS folder structure
- mod_substitute invocation to correctly reference absolute tarball
  url's described in the index.json files.

Change-Id: I1a5d560068e37e20ec565b8d864f89732ff5ad74
2016-04-13 08:50:37 -07:00
Michael Krotscheck
80cd50c593
Revert "Add NPM mirror hosting to unified mirrors"
This reverts commit e47c469cc690db071f8b8d727080d36961e82a72.

Change-Id: I7a09640cff418b55ce061a785162960db713c00c
2016-04-13 07:01:20 -07:00
Michael Krotscheck
e47c469cc6
Add NPM mirror hosting to unified mirrors
This patch makes the necessary modifications to host npm packages
on our mirrors. Changes include:

- index.json as a DirectoryIndex
- Rewrite rules for the AFS folder structure
- mod_substitute invocation to correctly reference absolute tarball
  url's described in the index.json files.

Change-Id: I7f7c6caa6af16101cf104f950968f3c6319b8243
2016-04-13 05:46:12 -07:00
Jenkins
3a3ded19db Merge "Added NPM Mirror to mirror_update" 2016-04-12 21:10:51 +00:00
Michael Krotscheck
841e7e2f57 Added NPM Mirror to mirror_update
This patch adds a cron job to our mirror_update servers which will
begin mirroring the npm registry into our own AFS mirror directories,
under the /npm path.

It uses two major components: First, the registry-static project,
available here: https://github.com/davglass/registry-static

Secondly, a custom implementation of the fs-blob-store named
afs-blob-store, which creates a virtual filesystem that automatically
translates paths to accomodate AFS' folder size limit. This project
is currently still hosted on github, however will be added to
OpenStack soon: https://github.com/krotscheck/js-afs-blob-store

This will require creating ACL's as well as the AFS principal before
this can be landed.

Change-Id: Ib78852fc5cde4fb04fe6439e01a591ca2781ce21
2016-04-11 17:34:30 +00:00
Monty Taylor
749babc4c7
Tell os-client-config that tripleo doesn't have neutron
The TripleO cloud does not work when the neutron-based floating ip
logic creates a floating ip directly on a server port. The problem is
that the floating IP is correctly created and correctly associated with
the server, but Nova has no clue that this has happened, so GET calls to
/server do not show that the server has the floating IP. As that's the
way we track success, we can't use it. However, if a floating IP is
created using the nova proxy, it all works - so just configure the cloud
with "has_network: False" so that direct neutron interactions are not
attempted.

Change-Id: Idb90cad36feb99bc5aa19da4874ce97f868681c7
2016-04-10 13:14:18 -05:00
Paul Belanger
5b452e4df2 Increase verbosity for reprepro command
In an effor to better debug reprepo failures, lets increase the
logging.

Change-Id: I66073a26a60721221587b5e94825fdfdfe52fef9
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-01 17:12:30 -04:00
Paul Belanger
17cbda7375 Add trailing whitespace to reprepo distributions
Otherwise, we get the following errors:

  Error parsing /etc/reprepro/ubuntu/distributions, line 42: Second
  appearance of 'Origin' in the same chunk!

Change-Id: I11fb815eddae1efa7ff072f8065af5b9ddee5e85
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-04-01 14:08:12 -04:00
Jenkins
d771177e02 Merge "Add server and port caching settings for nodepool" 2016-04-01 16:20:24 +00:00
Paul Belanger
11d676c384 Sync nodepool-builder logging with latest changes
Here we are removing devstack-trusty and adding ubuntu-xenial logs.

Change-Id: Ia4e2b3426442849efa02fe932d86d8ce5a1df48f
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-03-30 17:03:08 -04:00
Monty Taylor
bfb7934c84 Add server and port caching settings for nodepool
The default of shade is not to cache server or port lists. However, we
would like to do so in nodepool - so configure that behavior.

Change-Id: Ic6a64b67a429910396dd801a4ef7577496e40fbf
2016-03-28 16:04:01 -05:00
James E. Blair
6a5ebe6643 Remove old pypi vhost template
This is no longer used.

Change-Id: If2ef3099531e640c5115effea2b553fbc1dc1768
2016-03-24 08:40:24 -07:00
Tim Buckley
6925f865b4 Fix tab name indices in status template
When the extra OpenStack Health link was removed in
I293e326e45e1939dc57556d1477434cd1cfb56a2, the indices for the
'tabsName' array were not updated to reflect the change causing all
links after 'Rechecks' to be off by one. This patch restores the
correct index order to fix the issue.

Change-Id: I4eea976c3fb1a0b9b75d38ba5895b7d5fa5b0de3
2016-03-17 14:02:15 -06:00
Ian Wienand
968f09bfa9 Cleanup of nodepool builder logging
We can use textwrap to break up the ridiculously long lines in the
logging configuration (with less images, it's less ridiculous than it
used to be, but it's still easier to parse).  Only trick is to put
spaces between the arguments to give it somewhere to split (and better
for readability) and stop it splitting on words/hyphens.

Change-Id: I04840e98b0564dc531b74b96e8595f9d18b284af
2016-03-17 09:37:23 +11:00
Paul Belanger
ba185210c3 Regenerate nodepool.logging config
This adds the centos7, debian-jessie and removes devstack-centos7-dib.

Change-Id: Ifcc8390b32713601fae98c96b761e313b7d2d6f3
Signed-off-by: Paul Belanger <pabelanger@redhat.com>
2016-03-16 19:05:48 +03:00
Clint Byrum
539205484b Disable automatic installation of backports
In Ubuntu, the archive configures backports as something you must
explicitly request when installing packages. One does this by specifying
a package name of 'backports/$packagename'. But our reprepro mirrors of
backports do not have this flag set, and so, all systems get backported
versions of packages, instead of the one from the released stable
archive.

Change-Id: I8f266dc7045e971567ed934d1206c7b83cacd178
2016-03-11 16:12:36 -08:00
Clark Boylan
85d319d9e9 Use ruby 1.8 compat erb for logstash config
The old logstash config was not ruby 1.8 compatible and we got funny
results out of it. This version should work with ruby 1.8 and beyond.

Change-Id: Ibe824dda7c96e5b333329ce25f65a14d3ebdef9c
2016-03-10 15:16:04 -08:00
Jenkins
4978adf39e Merge "Logstash 2.0 compat ES output rule" 2016-03-10 22:22:20 +00:00
Clark Boylan
1fa20ffef6 Logstash 2.0 compat ES output rule
Logstash 2.0 defaults to HTTP elasticsearch output which means that the
elasticsearch output (no _http) does HTTP and a new elasticsearch_java
output exists if you want to continue doing the native api output. We
had been doing HTTP so just need to update the output name. The host
parameter is also deprecated and you must pass an array to the hosts
parameter instead so update that as well.

Note that this switches from using a local ES daemon to talking to the
cluster itself directly because new logstash is able to load balance
over http. This reduces the overhead necessary to have resilient ES
connections.

Note this is not compatbile with Logstash 1.3.3 which is what we are
currently running so this change should only go in as part of an upgrade
to Logstash 2.0 and beyond.

Change-Id: I788ecb936f9fa5a006332ed626f90c33a255d9bf
2016-03-10 09:58:53 -08:00
Jenkins
4efacbf741 Merge "Remove QA health link from status page" 2016-03-10 16:31:55 +00:00
Clark Boylan
e2404a45a2 Use osic-cloud1
Due to the possibility for multiple OSIC clouds we need to distinguish
between them in our clouds.yaml. Do that now before it becomes a problem
later and refer to the current cloud as osic-cloud1.

Change-Id: I3f35db2911a44200f0486e71fc215d021aa7c227
2016-03-04 15:37:49 -08:00
Clark Boylan
8818183c33 Verify SSL with OSIC
OSIC now has DNS configured with a proper verifiable certificate so use
it.

Change-Id: If09d716b8aa466678fffd5bdddc176fbaaf7b949
2016-03-04 13:25:29 -08:00
Jenkins
b557e1d179 Merge "Use project_name not _id with OSIC" 2016-03-02 05:41:36 +00:00
Clark Boylan
ec6d3dc206 Add vexxhost cloud credentials
Add vexxhost account credentials to our various clouds.yaml files. This
covers the all clouds, ansible, and nodepool clouds.yaml files. With
this in place we can work to deploying tests onto vexxhost.

Change-Id: I42101e9acc9f62897a3f63b85dd34a14adcf2394
2016-03-01 15:36:35 -08:00
Clark Boylan
f2db5bd96a Use project_name not _id with OSIC
Project names are easier for humans to deal with use the project_name
key in clouds.yaml for OSIC not the project_id key.

Change-Id: I15b6424e355c711941a43e78116ffb71f6647cb7
2016-03-01 15:14:14 -08:00
Clark Boylan
65b26d95fe Add OSIC clouds.yaml details
This adds clouds.yaml information to our three clouds.yaml files for our
two users in the OSIC cloud. This will let us manage the OSIC cloud
resources and start deploying tests to OSIC with nodepool.

Change-Id: I5a392d165fb6db2e70036008a55cd99eed237ab4
2016-02-29 19:07:22 -08:00
Elizabeth K. Joseph
d46972e4cf Remove QA health link from status page
In I9f61c4bb1f5634df0b0da909466b4c1b1b149ba5 when the Release link
was removed, a QA health link was added.

However, I57825f7e04bbdb405f7a1e67e4639d6afd7f3c5c is actually the
preferred change to this, which has the wording "OpenStack-Health"
instead.  Matthew Treinish left a comment saying so when I tried
to revert it in Ia9355c3f4206ba089c19a51556bb5321e9df9b6b

Change-Id: I293e326e45e1939dc57556d1477434cd1cfb56a2
2016-02-29 17:28:42 -08:00
Spencer Krum
f6fc0c426d Remove infracloudwest from ansible-clouds.yaml
Ansible-clouds.yaml becomes /etc/openstack/clouds.yaml on the
puppetmaster and is used forr the ansible dynamic inventory. When a
cloud there does not respond, the ansible inventory fails completely.
Remove infracloudwest from all-clouds.yaml until it comes back.

Change-Id: I34d265a60f0a97f040b6703ab74c93a8fd0063af
2016-02-29 17:08:56 -08:00
Joshua Hesketh
7ab7d45d12 Infra-cloud-west is currently offline
The infra-cloud-west is currently unavailable due to being relocated
causing the inventory for ansible to not be generated:
Inventory script (/etc/ansible/hosts/openstack) had an execution error: Error fetching server list on openstackci-infracloud-west:RegionOne:

This means ansible and hence puppet fail to run.

For now remove infra-cloud-west from clouds.yaml. This should be added back
in one the cloud is turned back on.

Change-Id: I16fe54c3c040c273977b0cb2e51bf7f804832380
2016-02-29 10:57:05 +11:00