Commit Graph

2533 Commits

Author SHA1 Message Date
Joshua Harlow
276fd091e3 Fix self variable went missing.
Change-Id: I09e58de071a8abcbd0ca30d61473e8cb2feaaf12
2013-07-01 08:56:20 -07:00
Joshua Harlow
b3fa0ba30f Turn on dup listing so duplicates can be checked.
Change-Id: I5fe680eda8cb41c8d113bc73e752230b78df4941
2013-06-30 19:13:26 -07:00
Joshua Harlow
a276cc8e3a Update examples
Add a build example and refresh the bootstrap,
prepare and install examples to reflect there
current output.

Change-Id: I41d304b914d26ae621fb6f3d2cf91c02e1b5e251
2013-06-30 18:43:04 -07:00
Joshua Harlow
67d2d0d608 Daemon args went missing.
Change-Id: Ie87301e8fce2c7b99dbb3ae0c026635285997540
2013-06-30 18:21:06 -07:00
Joshua Harlow
32759689e1 Remove patches that aren't applicable on master.
Change-Id: Ia1829637824ca1b18cf12739a9e4d12267e22699
2013-06-30 18:02:41 -07:00
Joshua Harlow
72dd8e0089 A few pep8 cleanups.
Change-Id: Ic5a7f3f24c1312e3b48e380457729791ea9eab03
2013-06-30 17:50:33 -07:00
Jenkins
3929d1b939 Merge "Handle rpm name versions correctly." 2013-07-01 00:47:21 +00:00
Jenkins
4dda8ef5f4 Merge "Fix building anvils requirements." 2013-07-01 00:46:44 +00:00
Jenkins
84068a9e57 Merge "Ensure that we add in the missing paths." 2013-07-01 00:46:21 +00:00
Jenkins
000e41205b Merge "Nova and quantum configurations fixed. L3 and DHCP agents were added." 2013-06-30 19:54:30 +00:00
Anastasia Karpinska
b0b143b412 Nova and quantum configurations fixed. L3 and DHCP agents were added.
Change-Id: I0c46d19cacac234564a72b6d12ff99db8fff5b59
2013-06-30 12:53:58 -07:00
Jenkins
053cf7f6bf Merge "Add yet another failure message" 2013-06-30 19:48:39 +00:00
Ivan A. Melnikov
c7711f33ee Add yet another failure message
Change-Id: I6d7e5116041939005090268f0f40b5943228dcda
Refs: xkcd 1133
2013-06-30 12:48:13 -07:00
Ivan A. Melnikov
96a7f52d23 Support custom release in all components
This commit adds support for setting release (what goes to RELEASE
rpm tag) to components that are build with py2rpm (not from custom
specfiles).

Change-Id: I80edd646e0b7d5b34dda4bcc94777fbfc38f99f2
Refs: bug 1190432
2013-06-30 12:44:03 -07:00
Nikita Savin
7328ff55e3 Put patches in proper dirs, cleanup components config
Change-Id: I8be53fcc926f5b0ab425b31e74fefe2c247acbec
2013-06-30 12:35:27 -07:00
Ivan A. Melnikov
c939d48904 Add default value for component patches
If no patches are specified for particular component, we now look for
them in conf/patches/<component_name>/<section>, where section is
'download' or 'package'.

Change-Id: Iee40ef1eee13783650929525d478195cc0428170
Fixes: bug 1194187
2013-06-30 12:32:17 -07:00
Joshua Harlow
ddaea63ffe Handle rpm name versions correctly.
Ensure that we cut off the python -> rpm name
versions correctly and don't put duplicate names
into the returned array.

Change-Id: I4767ed815ecbfcfb4756c751be2b2e5ccd0deb40
2013-06-30 12:17:02 -07:00
Joshua Harlow
3bf677aa51 Fix building anvils requirements.
It doesn't appear like the correct versions are being
built so create a helper tool that can search for the
correct versions and install those if they exist or
build the ones that are missing.

Change-Id: I03869556a8e321c06ad3ed0b81bb7e8f647e4c8e
2013-06-30 10:56:33 -07:00
Joshua Harlow
1075c1dc8e Ensure that we add in the missing paths.
Certain openstack components when built with sdist seem to
be missing, which will break either pbr (and setup.py) or
break doc building or i8ln building so make sure that we
pickup these paths if they are not automatically included.

Also include a few tracewriter tracking additions and few
wording adjustments.

Fixes bug: #1195842

Change-Id: I0ce68db9aa28fcc3b839c7583468927d0e2647c6
2013-06-29 21:09:11 -07:00
Jenkins
b504addad5 Merge "Add in the build step to the docs." 2013-06-28 18:16:45 +00:00
Joshua Harlow
79af4e312b Add in the build step to the docs.
Change-Id: I421566a09e12e241092e93c29cb696746ce67d5b
2013-06-28 11:15:51 -07:00
Jenkins
2b9b75635a Merge "Fix how images are expected in /var/lib/glance/images." 2013-06-28 17:21:30 +00:00
Alessio Ababilov
7cba1cd48d Use parallel make to build packages
Parallelize build of dependencies SRPMs and all
binary RPMs.

Implements: blueprint parallel-build
Change-Id: Ieed5aa199e325524390327b823ce3fef0b801f4a
2013-06-25 17:48:09 +03:00
Alessio Ababilov
963eb3f2e7 Drop new unused tags in git repos
openstack.common.setup can report version incorrectly
(several version instead of one). This happens when
several tags contain the commit.

Solution: remove all extra new tags.

Change-Id: I5dedb522169bc90649eace41a405c2ceb8467cc3
Fixes: bug #1190588
2013-06-25 16:07:51 +03:00
Alessio Ababilov
78185e215b bootstrap: install requirements before removing conflicts
Change-Id: I239601417f9b7b5fb50bad05a0ee2ee279e6596b
2013-06-25 16:07:51 +03:00
Alessio Ababilov
fcd9690ef4 Do not download Python packages again
Maintain a file indicating that all downloads are finished
and ensure that all requirements are satisfied.

Implements: blueprint pip-download-once
Change-Id: I0ddd39885d195da9a59bef2453be63990a784d32
2013-06-25 16:07:46 +03:00
Alessio Ababilov
b6e3ccde9f Drop legacy kombu-requirement.patch
Fixes: bug #1194488
Change-Id: I7ce7667187cb47c0d5b36c6d550a5eee04a84a6b
2013-06-25 15:56:05 +03:00
Alessio Ababilov
5a0518db39 Add PyYAML to package map
Change-Id: I48ffd6d980a757375cc83b47eb52043b1d8695f8
2013-06-25 11:19:23 +03:00
Alessio Ababilov
34031b158a requirements.txt: add pyyaml
Change-Id: Iddeb24ff48756c5d86968835151a6164010b871f
2013-06-25 11:06:39 +03:00
Alessio Ababilov
68c3a39ad0 smithy: remove conflicting packages
Change-Id: I39b493311c0372ab5997663bb34221c6aa64200d
2013-06-25 11:05:38 +03:00
Alessio Ababilov
6b3c4292cd py2rpm: add --binary-only option
Change-Id: I78b43e499747b085b3b2e5398b7647f958afdb3c
2013-06-25 10:26:01 +03:00
Alessio Ababilov
0b10346479 Fix keystone epoch
Fixes: bug #1194213
Change-Id: I9cfefda575975df38d40919879316973f7790436
2013-06-24 21:10:06 +03:00
Ivan A. Melnikov
fe6bedfb5d tools/pre-commit: Don't use stashes
Using stashes in pre-commit hook had the following demerits:
- when stash was not needed, it was not created, so some other stash
  created by user was poped on exit -- this was a source of great
  confusion;
- files with unstaged changes were touched, which caused unwanted
  side effects with some tools like editors or build systems.

This commit changes the way we get the clean source by checking out
index tree to temporary dir without modifying working tree. This
might be a bit slower for large repositories, but in my tests for
this repo it is within 5%.

Change-Id: Ic32fc2f52958b63131fcbe363ea47fca13099ea3
2013-06-24 21:09:27 +03:00
Joshua Harlow
302612003d Fix no_remove variable name.
Change-Id: I33f9e44ce6fac08737f6b7920f079dc9c83046da
2013-06-21 22:44:24 -07:00
Joshua Harlow
d37e725773 Cleanups after new changes/features.
- Some style adjustments.
- Use SRC_REPOS for mapping repo name to source repository name.
- Split the build_binary into individual tiny functions.
- Fix up the progress bars and iterable logging.
- Ensure that we log that we wrote to /etc/yum.repos.d and leave a trace for later cleanup.
- Quiet some of the new executes (and put there output to files).
- Add a smithy clean_pip() function that will help avoid hitting https://github.com/pypa/pip/issues/982
- Further cleanup of smithy after it being partially rewritten.
- Instead of hard coding 'conf/distros/rhel.yaml' in smithy, take this from the sourced file.
- Ensure that we can't remove packages smithy requires to operate.
- Ensure the package version that py2rpm is building is also trimmed of zeros.

Change-Id: I2df8a47f0115de2684777b64db42e08d50ef4115
2013-06-21 22:23:13 -07:00
Alessio Ababilov
a362c5399a Do not add script twice in py2rpm
Change-Id: I846fd987d15cad3d1d11cef7866f09834aebb404
2013-06-21 19:55:56 -07:00
Alessio Ababilov
ecb639570b Drop deps patches
They were used with non-trivial EPEL packages
that are replaced with straightforward editions.

Change-Id: If3b85c07abda47aa2238283ef7b84e69f4982df2
2013-06-21 19:55:14 -07:00
Alessio Ababilov
fcbc1ab59d Change build and bootstrap procedure
* add build action to build binary packages
* remove conflicting packages on install phase
* process rhel.yaml to get required RPM package names
* allow including only /usr directory to packages

Build action is run as root after prepare action.

Change-Id: I6beec02e1c6ff48ec24a6ae382aae0193c1af95f
Fixes: bug #1193088
Fixes: bug #1193085
2013-06-21 19:53:15 -07:00
Alessio Ababilov
d6a3292d2b Enable restart for database
Change-Id: I7bf8d93e2d8620e051f2d91f4107c89f967fc6cc
2013-06-21 18:01:51 -07:00
Alessio Ababilov
654a6a959b Do not use novnc anymore
spicehtml5proxy is used instead.

Change-Id: Ifefa39dbcc58f5b251b203c3ac45add05df11d58
2013-06-21 18:00:32 -07:00
Alessio Ababilov
df36f0f901 Do not use bdist_rpm in py2rpm
bdist_rpm is buggy. It cannot handle multiline descriptions.

Change-Id: I198fd61a8e02398355e4ba112707d084140e9566
2013-06-21 17:56:37 -07:00
Alessio Ababilov
3f49306540 Switch to pbr
* add requirements.txt and test-requirements.txt
* add .mailmap and MANIFEST.in
* drop autogenerated AUTHORS file

Change-Id: I8228dd0e1d1ceb48e2f9b990a1b5ac877becacca
2013-06-21 17:44:48 -07:00
Alessio Ababilov
64d1c0ee33 Fix pylint errors for quantum configuration fixes
Change-Id: I89f7b4185e5bbe288b08283f7fea61b01b807015
2013-06-21 17:42:35 -07:00
Ivan A. Melnikov
957a1fe018 Add package patches to RPMs
This commit adds all patches mentioned in components configuration
to RPMs, so that they are applied during build (on %prep stage).

Package patches were ignored since we started building RPMs
from custom specs (commit:da861bc).

Change-Id: Idca0e7cf1c67d12ff27cc5374cfbf0ce6e5d6a3b
Fixes: bug #1190429
2013-06-21 17:29:46 -07:00
Ivan A. Melnikov
5cd537f9cc Require nose and coverage for general
We use them to run tests, so it is fair to say we require them.

Change-Id: Ic16e17f17dc9706f5d7d730d1a014ac92a8adf40
Refs: bug #1187912
2013-06-21 17:12:13 -07:00
Vasyl Khomenko
e471f65113 Run unittests using nose instead of run_tests.sh (testr)
Using community's testr cause import sequence errors sometimes. Most
stable way seems to be run test using nose.
Also use coverage to gather coverage statistics.

Cherry-picked with certain corrections from 7ff4b3855.

Change-Id: Ic6de91086e64e376d83a22f0a16d6e6fa9feccee
2013-06-21 17:10:33 -07:00
Ivan A. Melnikov
cd1cee1455 Write tests output to stdout
This allows to watch test progress, in color.

Change-Id: I7ceebddae420d7d942f70a6b74ee0a3d11cf105e
Refs: bug #1187912
2013-06-21 17:06:48 -07:00
Ivan A. Melnikov
2d96967101 Install and remove all rpms, including dependencies
This also installs test dependencies if use_tests_requires
was set to true.

Refs: bug #1187912

Change-Id: I980dccb02ff29ff5267c2cf8744091e71d94233a
2013-06-21 17:05:11 -07:00
Ivan A. Melnikov
f46aa4a5f7 Exclude OpenStack packages from dependencies list earlier
There were several places where we tried to avoid to treat
OpenStack package as dependency. Now it is done in one place,
at the very beginning of dependency information gathering
process.

Change-Id: I9df4bed730e4593cf832ff3f160574292d389423
2013-06-21 16:47:33 -07:00
Ivan A. Melnikov
309d5a69c9 Add release and version_suffix package parameters
This allows to adjust package version and release from configurations
and provides support for some interesting build scenarios.

This feature is now supported for all our custom specfiles.

Fixes: bug #1190432

Change-Id: I23e25ff4e8404d26b97c1e8bf446c92b3e0fb83d
2013-06-21 16:05:52 -07:00