20 Commits

Author SHA1 Message Date
Bryan Strassner
38e58cfd30 Add Action API
This change introduces a large section of the API for the next major
version of Shipyard - the action api.  By interfacing with Airflow,
Shipyard will invoke workflows and allow for controlling and querying
status of those workflows. Foundationally, this patchset introduces
a lot of framework code for other apis, including error handling
to a common output format, database interaction for persistence of
action information, and use of oslo_config for configuration support.

Add GET all actions primary code - db connection not yet impl
Update base classes to have more structure
Add POST actions framework
Add GET action by id
Add GET of validations and steps
Add control api
Add unit tests of action api methods
Re-Removed duplicate deps from test reqs
Add routes for API
Removed a lot of code better handled by falcon directly
Cleaned up error flows- handlers and defaults
Refactored existing airflow tests to match standard output format
Updated json validation to be more specific
Added basic start for alembic
Added alembic upgrade at startup
Added table creation definitions
Added base revision for alembic upgrade
Bug fixes - DB queries, airflow comm, logic issues, logging issues
Bug fixes - date formats and alignment of keys between systems
Exclusions to bandit / tox.ini
Resolved merge conflicts with integration of auth
Update to use oslo config and PBR
Update the context middleware to check uuid in a less contentious way
Removed routes and resources for regions endpoint - not used
Add auth policies for action api
Restructure execptions to be consistent class hierarchy and common handler
Add generation of config and policy examples
Update tests to init configs
Update database configs to not use env. vars
Removed examples directory, it was no longer accurate
Addressed/removed several TODOs - left some behind as well
Aligned input to DAGs with action: header
Retrieved all sub-steps for dags
Expanded step information
Refactored auth handling for better logging
rename create_actions policy to create_action
removed some templated file comments in env.py generated by alembic
updated inconsistent exception parameters
updated to use ulid instead of uuid for action ids
added action control audit code per review suggestion
Fixed correlation date betwen dags/actions by more string parsing

Change-Id: I2f9ea5250923f45456aa86826e344fc055bba762
2017-09-22 21:47:13 -05:00
Scott Hussey
af698b6b21 Merge "Update to make the commitconfigdocs API be sync." 2017-08-30 21:44:26 -04:00
Stacey Fletcher
936d0e095b Update README with new location of issues for github
This patchset updates the location that the community can add
issues.

Change-Id: I2bd3b4f77f1e168f1d845f3482397575346c1859
2017-08-30 10:33:20 -05:00
Bryan Strassner
1c6e396e2d Update to make the commitconfigdocs API be sync.
Removed the commit_configdocs action.

Change-Id: I30e908d5afb6e70cb487a7db089f45a08ef2f848
2017-08-29 09:55:42 -05:00
Bryan Strassner
59fabf8cac Updated the API documentation for shipyard:
Incorporated feedback from reviews

Added steps to the action commands document

Added renderedconfigdocs resource for rendered representations of
documents

Updated POST configdocs to be collection based

Added append and force parameter behaviors for POST configdocs

Updated verbiage for the document staging API to be collection
based

Update GET behaviors for configdocs to clarify when collections
are removed vs. not represented.

Remove the secrets API, as it will be handled by the configdocs

change to have document versions referenced by verion=rollback|staged
instead of lastDeployed=true|false.
Updated to make clearer when documents move from staged to rollback

reformatted for 80 cols

removed extraneous trailing whitespace

Change-Id: I59ceb8643d7da5ef335b746ea98053a8338207be
2017-08-24 09:55:47 -05:00
Anthony Lin
32c33c7a66 Update Deployment Guide
Update steps for deployment of Shipyard Helm Chart

Change-Id: I9bd1d8fd679e938e06b2d835ce9570812c523d3b
2017-08-16 19:12:00 +00:00
Anthony Lin
065bf9259a Update Deployment Guide
- Change Namespace to shipyard instead of airflow
- Add steps to add custom dags and operators to mount point on host machine
- Update steps to retrieve shipyard chart

Change-Id: Ia54201a7d1241b0aa6da092bb60705a15b5d9c71
2017-08-10 16:34:06 +00:00
Bryan Strassner
15fb380ab8 Update verbiage for staging API's use of shipyard and versions 2017-08-03 08:55:43 -05:00
Bryan Strassner
07713d97be Add feedback related items around naming and workflows 2017-08-02 13:55:11 -05:00
Bryan Strassner
ea22d97202 Update various API design details based on review feedback 2017-08-01 17:18:16 -05:00
Bryan Strassner
fc3923cdf9 Split the actions for the API to a separate markdown file 2017-08-01 10:00:14 -05:00
Bryan Strassner
390912847f Update list of commands and actions supported
Update the scheduledTasks to scheduledDAGs to use a more correct
language about what's being done.
2017-07-31 17:11:11 -05:00
Bryan Strassner
9061ba594a Fix heading level for DELETE operation. 2017-07-28 15:12:09 -05:00
Bryan Strassner
746812d700 Add documentation for the shipyard API.
Also added comments to the existing API documentation to indicate
intentions going forward.
2017-07-28 15:07:30 -05:00
eanylin
9480b7cc19 Update README 2017-07-03 12:55:28 -05:00
eanylin
2a1c3292c8 Update deployment guide link
Corrected the deployment guide link
2017-07-03 12:37:17 -05:00
eanylin
8f70f485f2 Update README
Updated README with Mission, Roadmap, Getting
Started and Bugs
2017-07-03 12:31:14 -05:00
eanylin
2f9981994f Add REST API Documentation 2017-07-03 11:02:29 -05:00
eanylin
2405095a58 Update format of the Deployment Guide 2017-07-03 11:02:29 -05:00
eanylin
c500767a15 Add deployment guide and docs folder 2017-07-03 11:02:29 -05:00