tools/centos-mirror-tools
Felipe de Jesus Ruiz Garcia ff8f643bd5 removing no require lines for download pkg
rpms_from_3rd_parties.lst file does not support comments.
deleting lines that could abort the download's.

Change-Id: I4c460893b0413441ae7fbc7e11bd5cd1b530fb3b
Signed-off-by: Felipe de Jesus Ruiz Garcia <felipe.de.jesus.ruiz.garcia@intel.com>
2018-07-05 16:15:34 -05:00
..
rpm-gpg-keys Adding StarlingX_3rd.repo sourcelist for 3rd pkgs 2018-06-27 21:07:36 -05:00
dl_other_from_centos_repo.sh Add build tools 2018-06-08 17:01:43 -05:00
dl_rpms.sh Clean up formatting to pass linters job and make it voting 2018-06-29 11:55:28 -05:00
Dockerfile Adding StarlingX_3rd.repo sourcelist for 3rd pkgs 2018-06-27 21:07:36 -05:00
download_mirror.sh StarlingX: Tar Compressed files repository 2018-07-03 06:04:28 -07:00
mvn-artifacts.lst StarlingX: Tar Compressed files repository 2018-07-03 06:04:28 -07:00
other_downloads.lst Add build tools 2018-06-08 17:01:43 -05:00
README.md Improving centos mirror Dockerfile 2018-06-20 14:11:07 -05:00
rpms_from_3rd_parties.lst removing no require lines for download pkg 2018-07-05 16:15:34 -05:00
rpms_from_centos_3rd_parties.lst Add docker-ce binary 2018-07-04 11:01:02 -04:00
rpms_from_centos_repo.lst Add packages for Collectd+InfluxDb-RMON Replacement 2018-07-04 10:59:05 -04:00
show_imported_rpm_gpg_keys.sh Add build tools 2018-06-08 17:01:43 -05:00
StarlingX_3rd.repo Adding StarlingX_3rd.repo sourcelist for 3rd pkgs 2018-06-27 21:07:36 -05:00
StarlingX.repo Merge "Open vSwitch integration with host and configuration framework" 2018-06-18 14:57:26 +00:00
tarball-dl.lst Mirror Tools: spectre-meltdown-checker package 2018-07-03 19:49:24 -07:00
tarball-dl.sh StarlingX: Tar Compressed files repository 2018-07-03 06:04:28 -07:00

Create mirror for StarlingX

Step 0 - Build the container

Build the docker image on your Linux host (with Docker supported). NOTE: if necessary you might have to set http/https proxy in your Dockerfile before building the docker image below.

$ docker build -t <your_docker_image_name>:<your_image_version> -f Dockerfile .

Step 1 - Run the container

The container shall be run from the same directory where the other scripts are stored.

$ docker run -it -v $(pwd):/localdisk <your_docker_image_name>:<your_image_version>

The container can also be run the following way, so the download_mirror.sh runs automatically without having to enter the container and the step 2can be simplified.

$ docker run -it -v $(pwd):/localdisk <your_docker_image_name>:<your_image_version> download_mirror.sh

As /localdisk is defined as the workdir of the container, the same folder name should be used to define the volume. The container will start to run and populate a logs and output folders in this directory. The container shall be run from the same directory where the other scripts are stored.

step 2 - Run the download_mirror.sh script

Once inside the container run the downloader script

$ ./download_mirror.sh

NOTE: in case there are some downloading failures due to network instability (or timeout), you should download them manually, to assure you get all RPMs listed in "rpms_from_3rd_parties.lst" and "rpms_from_centos_repo.lst".

step 3 - Copy the files to the mirror

After all downloading complete, copy the download files to mirror.

$ find ./output -name "*.i686.rpm" | xargs rm -f
$ chown  751:751 -R ./output
$ cp -rf  output/stx-r1/ <your_mirror_folder>/

In this case <your_mirror_folder> can be whatever folder you want to use as mirror.

step 4 - Tweaks in the StarlingX build system.

NOTE: step below is not needed if you've synced the latest codebase.

Go into StarlingX build system (another container which hosts cgcs build system), and follow up below steps:

Debugging issues

The download_mirror.sh script will create log files in the form of centos_rpms_*.txt. After the download is complete, it's recommended to check the content of these files to see if everything was downloaded correctly.

A quick look into these files could be:

$ cd output/
$ cat *missing*

In this case, there shoudn't be any package in the "missing" files.