Files

Joshua Harlow 6520b9c35e Add a basic map/reduce example to show how this can be done

Since we can create tasks, run them in a parallel then direct
there result into a result task we can create a workflow that
can define how this can be accomplished and have the map ops
run in parallel (with the reduction op happening after all the
map ops have finished).

Part of blueprint more-examples

Change-Id: I7c04f5508b35b945c49e5798ece0e298d2e1b979

2014-12-17 19:13:45 +00:00

4.8 KiB

Raw Blame History

Passing values from and to tasks

Note

Full source located at simple_linear_pass.

../../taskflow/examples/simple_linear_pass.py

Making phone calls

Note

Full source located at simple_linear.

../../taskflow/examples/simple_linear.py

Making phone calls (automatically reverting)

Note

Full source located at reverting_linear.

../../taskflow/examples/reverting_linear.py

Building a car

Note

Full source located at build_a_car.

../../taskflow/examples/build_a_car.py

Watching execution timing

Note

Full source located at timing_listener.

../../taskflow/examples/timing_listener.py

Linear equation solver (explicit dependencies)

Note

Full source located at calculate_linear.

../../taskflow/examples/calculate_linear.py

Linear equation solver (inferred dependencies)

Source: graph_flow.py

../../taskflow/examples/graph_flow.py

Linear equation solver (in parallel)

Note

Full source located at calculate_in_parallel

../../taskflow/examples/calculate_in_parallel.py

Creating a volume (in parallel)

Note

Full source located at create_parallel_volume

../../taskflow/examples/create_parallel_volume.py

Summation mapper(s) and reducer (in parallel)

Note

Full source located at simple_map_reduce

../../taskflow/examples/simple_map_reduce.py

Storing & emitting a bill

Note

Full source located at fake_billing

../../taskflow/examples/fake_billing.py

Suspending a workflow & resuming

Note

Full source located at resume_from_backend

../../taskflow/examples/resume_from_backend.py

Creating a virtual machine (resumable)

Note

Full source located at resume_vm_boot

../../taskflow/examples/resume_vm_boot.py

Creating a volume (resumable)

Note

Full source located at resume_volume_create

../../taskflow/examples/resume_volume_create.py

Running engines via iteration

Note

Full source located at run_by_iter

../../taskflow/examples/run_by_iter.py

Controlling retries using a retry controller

Note

Full source located at retry_flow

../../taskflow/examples/retry_flow.py

Distributed execution (simple)

Note

Full source located at wbe_simple_linear

../../taskflow/examples/wbe_simple_linear.py

Distributed mandelbrot (complex)

Note

Full source located at wbe_mandelbrot

Output

$Generated mandelbrot fractal$

Code

../../taskflow/examples/wbe_mandelbrot.py

Jobboard producer/consumer (simple)

Note

Full source located at jobboard_produce_consume_colors

../../taskflow/examples/jobboard_produce_consume_colors.py

4.8 KiB Raw Blame History

Passing values from and to tasks

Making phone calls

Making phone calls (automatically reverting)

Building a car

Watching execution timing

Linear equation solver (explicit dependencies)

Linear equation solver (inferred dependencies)

Linear equation solver (in parallel)

Creating a volume (in parallel)

Summation mapper(s) and reducer (in parallel)

Storing & emitting a bill

Suspending a workflow & resuming

Creating a virtual machine (resumable)

Creating a volume (resumable)

Running engines via iteration

Controlling retries using a retry controller

Distributed execution (simple)

Distributed mandelbrot (complex)

Output

Code

Jobboard producer/consumer (simple)

4.8 KiB

Raw Blame History