Propose a new graph flow that will run every task in the graph at the same time but will use a count down latch concept to ensure that a tasks dependents are provided before the task itself can run. This allows for tasks to run in parallel (if they have no dependents or are placed in disjoint parts of graph). Note: although this flow uses threads it is typically expected that the underlying threads would be greenthreads since python native threading is still suboptimal (for various reasons). Implements: blueprint locally-run-many-at-once Change-Id: If434abd77758aa12fc99da395a2559995305a853
45 lines
1.2 KiB
Python
45 lines
1.2 KiB
Python
# -*- coding: utf-8 -*-
|
|
|
|
# vim: tabstop=4 shiftwidth=4 softtabstop=4
|
|
|
|
# Copyright (C) 2012 Yahoo! Inc. All Rights Reserved.
|
|
#
|
|
# Licensed under the Apache License, Version 2.0 (the "License"); you may
|
|
# not use this file except in compliance with the License. You may obtain
|
|
# a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
|
|
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
|
|
# License for the specific language governing permissions and limitations
|
|
# under the License.
|
|
|
|
# Job states.
|
|
CLAIMED = 'CLAIMED'
|
|
FAILURE = 'FAILURE'
|
|
PENDING = 'PENDING'
|
|
RUNNING = 'RUNNING'
|
|
SUCCESS = 'SUCCESS'
|
|
UNCLAIMED = 'UNCLAIMED'
|
|
|
|
# Flow states.
|
|
FAILURE = FAILURE
|
|
INTERRUPTED = 'INTERRUPTED'
|
|
PENDING = 'PENDING'
|
|
RESUMING = 'RESUMING'
|
|
REVERTING = 'REVERTING'
|
|
RUNNING = RUNNING
|
|
STARTED = 'STARTED'
|
|
SUCCESS = SUCCESS
|
|
CANCELLED = 'CANCELLED'
|
|
INCOMPLETE = 'INCOMPLETE'
|
|
|
|
# Task states.
|
|
FAILURE = FAILURE
|
|
STARTED = STARTED
|
|
SUCCESS = SUCCESS
|
|
TIMED_OUT = 'TIMED_OUT'
|
|
CANCELLED = CANCELLED
|