rally/tests/check_samples/test_certification_task.py
Andrey Kurilin 1194aa4311 [ci] Start fixing CLI job
Patch I7fc109ee5785f426211fbff7eb9b4553a3671ba7 splitted functional and
samples check into 2 separate modules. It was done due to some conflicts
while launching tests in parallel.
Despite the fact it was a good patch, it had a bug - missed `set -e`
called in the launch script. Which results in ignoring results of
launching functional tests for more then 2 months. Now we have 1/4 tests
fail.

This patch starts refactoring CLI job. First of all, we need to stop
ignoring the results of functional tests. The broken tests are marked as
skipped, so we can enable a part of tests right away.

Also, this patch moves test_certification_task.py to the proper dir with
samples check.

The new tox environment is introduced for launching only functional
tests(which should not depend on OpenStack): tox -efunctional

Change-Id: I222c13f724e8e70d10d58ca546094c076d73d737
2017-10-12 12:13:18 +03:00

42 lines
1.5 KiB
Python

# Copyright 2014: Mirantis Inc.
# Copyright 2014: Catalyst IT Ltd.
# All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License. You may obtain
# a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.
import os
import traceback
import unittest
import rally as rally_m
from tests.functional import utils
class TestPreCreatedTasks(unittest.TestCase):
@unittest.skip("It started failing due to broken launching script. "
"Requires investigation.")
def test_task_samples_is_valid(self):
rally = utils.Rally()
full_path = os.path.join(
os.path.dirname(rally_m.__file__), os.pardir, "tasks", "openstack")
task_path = os.path.join(full_path, "task.yaml")
args_path = os.path.join(full_path, "task_arguments.yaml")
try:
rally("task validate --task %s --task-args-file %s" % (task_path,
args_path))
except Exception:
print(traceback.format_exc())
self.fail("Wrong task config %s" % full_path)