619 Commits

Author SHA1 Message Date
confi-surya
8acba6ff56 Update hacking version
Use latest release 1.1.0 and compatible changes w.r.t pep8

Change-Id: Ia3d1166a2746a46591e4e5a04ea91e03ddc28d93
2018-12-27 12:02:17 +00:00
Victor Morales
d8d7281ab4 Fix mkdir instruction of tools/setup_Debian.sh
The mkdir instruction tries to create the
/etc/systemd/system/docker.service.d folder wich in some cases might
not exists. This change includes hte -p argument.

Change-Id: Ia278a2c4dd50a2e57a93b568d0c415e9451fc51f
2018-12-14 14:42:58 -08:00
Mark Goddard
3d4f69f579 Bump storage available to Docker in CI to 25G
Currently CentOS binary jobs are often failing due to running out of
storage while building images.

See
http://logs.openstack.org/87/612887/8/check/kolla-build-centos-binary/b467920/logs/build/000_FAILED_heat-all.txt.gz
for an example, and
http://logs.openstack.org/87/612887/8/check/kolla-build-centos-binary/b467920/logs/df.txt.gz
for the corresponding df output that shows the /var/lib/docker loopback
mount at 97%.

Change-Id: I2f3d04452c517f8643b124550148cc9d8320b937
2018-11-23 10:04:59 +00:00
Eduardo Gonzalez
3b264a919a Ingore monasca-thresh in version-check.py
monasca-thresh package is not published in
tarballs.openstack.org and fails to detect
proper version for it.
Add to external managed packages list

Change-Id: I5da4da1f5291e993fdcd04177c634147204ad9ed
2018-09-14 16:50:19 +02:00
Jon Schlueter
2b023ba13e validate-indentation: expand check to also catch macros.install_packages
Fixed up 5 Dockerfile.j2 files that had the issue

Change-Id: I8a5551050a75d64712c36d53573437a18777a82f
2018-07-26 14:51:41 -04:00
Jon Schlueter
b7c0f053b0 validate-indentation was failing locally for me
grep -E '^\s+[A-Z]+\s' was matching any
"  a "
"  FOO "

where this was trying to only catch " FOO " case

Change-Id: Ife64cb9f02b3f1463d5143e57629418bc478de49
2018-06-21 14:51:19 -04:00
Zuul
b1796384f7 Merge "Validate Dockerfile indentation in pep8" 2018-01-17 07:41:41 +00:00
Jeffrey Zhang
898caa8c4c Make validate-all-dockerfile work with python3
Change-Id: I9895c958a4cea91fca014d8f28f448a00b2ae02c
2018-01-09 15:14:17 +08:00
Martin André
3364720f34 Validate Dockerfile indentation in pep8
Delegate code style validation to computers, they're better than human
at it :)

This commit adds a new `tools/validate-indentation.sh` script that
errors when it finds an indented Dockerfile instruction, and enables
the validation in the pep8 check.

Also adjust the logic of `tools/validate-all-dockerfiles.sh` so that it
doesn't stop on first errors but instead shows all of them.

Fixes the remaining indentations in Dockerfiles.

Change-Id: I53c0d38304cb4f6d64a5dfab67f70d69b3eae587
2017-12-05 10:53:49 +01:00
Michal (inc0) Jastrzebski
c506e626e7 Dockerhub publisher job
This patchset includes pushing mechanism for daily periodic jobs.

Change-Id: Ic4179ffd3a6e640abfb181dbd000bc75cc64b750
2017-11-06 09:18:22 -08:00
Zuul
323ee0b09c Merge "Moving jobs to kolla repo" 2017-10-19 16:01:23 +00:00
Jeffrey Zhang
b64198cce0 Moving jobs to kolla repo
This is zuulv3 migration patch. This patch only implement build jobs.
Deploy jobs will be pushed in another one.

Partial-Bug: #1720601
Change-Id: Ib9157ed132820d752ef1dbd7a53353ebd68b1934
2017-10-19 10:34:03 +08:00
Bertrand Lallau
adc2603ef5 Remove a Pike release note generated in bad place
All release notes must leave in "releasenotes/notes" directory.
One of them has been generated in wrong place
"tools/releasenotes/notes" for Pike release.
This patch just remote it.

Change-Id: I2f6d22954288445b2d9e325f1d104e9bf43d0029
2017-10-06 15:11:40 +02:00
Jenkins
7b25352312 Merge "Create swapfile only on nodepool nodes" 2017-09-21 14:36:55 +00:00
Jenkins
d8c0b9f72f Merge "Remove demos directory from contrib" 2017-09-19 16:03:00 +00:00
Eduardo Gonzalez
da9d2c3383 Pin ansible to <2.4 to make ara work in gates
ARA does not work yet with ansible 2.4
ARA has pinned to lower version than 2.4
https://review.openstack.org/#/c/500651/

Change-Id: Idfe1e7ad46efac965a22b4f7fa833babf22ba375
2017-09-19 08:13:21 +00:00
Christian Berendt
2c2bc48630 Remove demos directory from contrib
The demos are already part of kolla-ansible repository.

Change-Id: I075ea1308c24d4260cafbc502a2f2815df1ee14c
2017-09-12 09:50:23 +02:00
Christian Berendt
9748226688 Create swapfile only on nodepool nodes
TrivialFix

Change-Id: I73d208d2a52c018ad6027f811c6b3a2eee802015
2017-09-11 09:30:41 +00:00
Eduardo Gonzalez
d0a5ff1050 Fix gates out of disk space
Sometimes gates fails due lack of space,
post merge jobs gates fails always for oraclelinux
binary, not being able create a tarball registry.

This change mounts a second disk in opt and moves
registry data to opt.
Disk format commands are excepts from devstack-gate:
dc49f9e6eb/functions.sh (L306)

Closes-Bug: #1713652
Change-Id: I883e51042841709eb9ab348cfdce9fecbd4fb890
2017-08-29 19:52:07 +00:00
Jenkins
c1ceeada03 Merge "Make Oraclelinux use infra mirrors" 2017-08-29 17:29:08 +00:00
Michal (inc0) Jastrzebski
ac5bbdac06 Make Oraclelinux use infra mirrors
Due to typo oraclelinux didn't use mirrors provided by infra

Change-Id: If25a9a028636cbf66d707a0a58e288f17e65cc71
2017-08-28 14:32:16 -07:00
Surya Prakash Singh
6566ace236 Changed as per the standard convention set to use "."
When we have to source a script file use . instead of source
For Reference follow below link:
https://docs.openstack.org/contributor-guide/writing-style/code-conventions

Change-Id: Icc6a692d37e8a5bc1146d803c873505cbf6cd03f
2017-08-28 09:27:45 +00:00
Jeffrey Zhang
795be59124 Fix wrong permission check for kolla_logs folder
kolla_logs is only accessed by root. So use sudo when checking whether
kolla_logs folder exist.

Closes-Bug: #1711996
Change-Id: If324ad6818f53c16d55cd95f8c7bed03f1906721
2017-08-21 05:48:41 +00:00
Jenkins
b1525533b3 Merge "Corrected tmp location of ansible prechecks command" 2017-07-27 07:43:35 +00:00
Jenkins
e5909b824d Merge "Add openstack logs in deploy gates" 2017-07-25 10:23:45 +00:00
Jenkins
56cf66bb37 Merge "Use latest docker ce in gate" 2017-07-25 04:44:16 +00:00
Surya Prakash Singh
b38d6543b6 Corrected tmp location of ansible prechecks command
Just to avoid the confusion in reading the location, improved
the readability.

Change-Id: I2f2ce2f275674ab2dc686d5e4df2701880fbe4c0
2017-07-25 10:01:21 +05:30
Eduardo Gonzalez
8410edc50d Add openstack logs in deploy gates
Change-Id: I9195ecb2ab3d20714cb533496e914124c5933ad2
2017-07-21 09:33:44 +01:00
Michal (inc0) Jastrzebski
cea6c30cdd Fix tarball name again
I messed up first one:(

Change-Id: Icf81ec03233c38a6ca1a7dafb0a3bb2d3bc8b69e
2017-07-20 09:39:06 -07:00
Michal (inc0) Jastrzebski
5397070c48 Fix incorrect tarballs naming
Last patch with publisher pipeline broke our post jobs. This is supposed
to fix it

Change-Id: I1040b4db7fe44ad631a3047292038da3445c20b5
2017-07-19 22:54:18 -04:00
Michal (inc0) Jastrzebski
1cdc18211a Dockerfile publishing pipeline
We now have experimental gates which will eventually be daily jobs to
build, test and publish images to dockerhub. First step is to mimic our
tarball publisher to build images -> save them to temp space -> run set
of jobs that will sign off these images -> move images to regular
tarballs.

Depends-on: I0231bd07415ef05b3f4f937e32a9df4cd0643672
Change-Id: If578edcd4e431c0b93cb9cedcc3d9db47d41a637
2017-07-18 15:03:06 -07:00
Jeffrey Zhang
cf58a12fb0 Use latest docker ce in gate
Change-Id: I1cb6189cec2704edfc461538ef593d38e81ca343
2017-07-18 09:29:02 +08:00
Jenkins
e4245aa415 Merge "Add bandit check to all python code" 2017-07-16 13:19:55 +00:00
Jenkins
e602088c3f Merge "Remove ignore tempest project in version-check" 2017-07-13 08:22:35 +00:00
Eduardo Gonzalez
8c6585155d Remove ignore tempest project in version-check
Tempest is present in openstack/releases project

Change-Id: Ib4c48108ecfe9eb9e3276ed039af083438385837
Closes-Bug: #1703395
2017-07-10 16:51:02 +02:00
Eduardo Gonzalez
4097672aff Fix gnocchi in version_check script
Gnocchi is moved out of openstack/releases project.
Version-check need to be updated with gnocchi in
skipped projects.

Closes-Bug: #1703386
Change-Id: I2b37aeb7042756be534559615878e698275783c6
2017-07-10 16:41:48 +02:00
Eduardo Gonzalez
cc7aabc12e Add bandit check to all python code
Bandit was not running in all directories
due missing -r parameter.

Also, this change fix bandit errors.
* Add nosec to subprocess module
* Change /tmp/releases to .releases
* Change /tmp/ to tmp/, tmp/ is not checked
  and in unittest is not an issue, simpler that mocking tempfile
  and make more complex tests.

Change-Id: I42bafa4707a9a4d1faeb01cb9b5a843f56280deb
2017-07-06 15:54:58 +02:00
Jenkins
db38eef3ae Merge "Migrate cinder-api under apache" 2017-07-06 07:55:25 +00:00
Eduardo Gonzalez
e58e677d47 Migrate cinder-api under apache
Cinder-api in ubuntu binary was migrated
under apache because ubuntu packages removed
support to system services.
This change migrate other install_types under apache
to unify all types.

Change-Id: Iad6792142019134513a378a7ad9955888ef320e9
2017-07-04 08:44:12 +00:00
Jenkins
2548c67ad9 Merge "Upgrade from docker-py to docker" 2017-06-30 20:06:59 +00:00
Jenkins
357eeadce4 Merge "Get OpenStack service versions from openstack/releases repo" 2017-06-22 19:00:11 +00:00
Hongbin Lu
7e2486c3d9 Upgrade from docker-py to docker
The pypi package 'docker-py' [1] has been renamed to 'docker' [2].
It is better to move to the new 'docker' package because the old
package will be deprecated and all the new features will go into
the new package only.

Package 'docker' has been added to requirements [3]. The old
package 'docker-py' is still allowed to be in the global requirements
during the transition period but it should be removed after all or
most of the projects finsih the migration.

[1] https://pypi.python.org/pypi/docker-py
[2] https://pypi.python.org/pypi/docker
[3] https://review.openstack.org/#/c/423715/

Change-Id: I3ffd8bb6461e8b7edacc5e833754f00c4249b854
2017-06-21 19:20:35 +00:00
Michal (inc0) Jastrzebski
6ed623d74b Fix deploy gate
Enabling multiscenario gates broken deployment gates in Kolla.
Sorry:(

Change-Id: I46e6cea62555145d8e9d6962e9bb0f036077a305
2017-06-21 08:09:28 -07:00
Michal (inc0) Jastrzebski
cac89f9f65 Fix kolla deploy gates
Since we changed kolla-ansible gating, we need to change logic in kolla
too

Change-Id: Ie9196d01b9ce1ca0199cd657cecd4ca33a1f050e
2017-06-08 20:48:06 -07:00
Jeffrey Zhang
ffbc25c1d2 Get OpenStack service versions from openstack/releases repo
In old implementation, version-check always get the latest versions
rather than versions for certain release. it is useless for stable
branch. And it parses from tarballs.openstack.org site, which is
very slow.

In this new implementation, version-check gets versions from
openstack/releases repo, which is faster and accurate. It also support
get versions for certain OpenStack release. For example, get the Ocata
latest release version.

./verion-check.py --openstack-release ocata

Closes-Bug: #1554337
Change-Id: Ie8951625817d82f38cf820cf9bd44ae447e2eb75
2017-05-20 12:55:04 +08:00
Eduardo Gonzalez
508f73e059 Add ssh-keyscan to unblock kolla gate
As a change to remove puppet from infra nodepool,
ssh-keyscan is needed for each node [0]

Permissions to ssh/config file should be 600 instead
of current 664 [1]

Refs:
[0] http://lists.openstack.org/pipermail/openstack-dev/2017-April/116036.html
[1] http://logs.openstack.org/68/461368/1/check/gate-kolla-ansible-dsvm-deploy-centos-binary-centos-7-nv/0a94da7/console.html#_2017-05-01_12_06_08_440775

Closes-Bug: #1687408
Change-Id: I338e457fff35d8a28bd9f96e88dbb4ee55a47864
2017-05-01 13:00:59 +00:00
Chen
8c463a47a9 Use LABEL instead of MAINTAINER (deprecated) in all Dockerfile.j2
Use LABEL instruction instead of MAINTAINER (deprecated) instruc-
tion as suggested by Docker's official dockerfile guide.
docs.docker.com/engine/reference/builder/#maintainer-deprecated

Closes-Bug: #1683652

Change-Id: Ie87a1ddf31aefcd0b623fd2837d78de420e76898
2017-04-20 16:50:05 +09:00
Jenkins
285dd5885a Merge "Switch to RDO proxy mirrors" 2017-04-12 21:05:53 +00:00
Jenkins
71d9f4cf48 Merge "Get correct tag name when job is running in release pipeline" 2017-04-11 08:47:08 +00:00
Mohammed Naser
833f3ff117
Switch to RDO proxy mirrors
We download a large number of packages from trunk.rdoproject.org, the
OpenStack Infra team has setup a per-region caching proxy to speed
up builds and reduce reliance on the internet.

This patch switches builds to use the new mirror and also stops
defining our own mirror variables and rely on the one provided by
nodepool instead.  As part of this patch, we also drop getting the
delorean.repo file from buildlogs.centos.org as it could be out of
sync and essentially broken (until the job to sync runs).  We prefer
going to trunk.rdoproject.org as it will be proxied and cached.

Change-Id: Ia28225de715089bbf5b023d1e134f2fb7da93fbd
2017-04-10 14:27:01 -04:00