Report the version number on startup of verifier and worker daemons
to make debugging of deployments easier.
Change-Id: Ib6f9008ab103a67d958004e7151f30065daa5a3d
Fix memory usage for verifiers. Events to verify were being loaded
from the db into an in-memory fifo queue to spool to worker processes.
This was not being limited, resulting in a large amount of memory
being used if events were read from the DB faster than they were
being processed. This change pauses the loading of events if the
in-memory queue grows larger than specified batchsize.
Also, verifier child processes were not handling signals (like SIGTERM)
properly, resulting in them not shutting down properly.
Added proper signal handling.
Change-Id: Ife25ca07398acf111f4388071b5f2e4eafeecb05
If the stacktach verifier crashes, notifications
'in-flight' can be stuck in 'verifying' status'.
This change flips those back to 'pending' so they get
processed.
Change-Id: Ie4aabed0c4991429a3e18e3b28813917d822867a
If an exception is thrown in the verifier child process for a
specific exchange, log it properly.
Was simply printing to stdout, which goes nowhere for daemon processes.
Change-Id: I528ad08e70d7bdf03e9a8e1d8abe45d09f2eb476
Fixed a bug that was introduced that prevents verifier from starting
without special environment variables et
Change-Id: I5b69851c688d4fdc43343422df58ec3edde67b0e
Added instance hours report
Initial version of report to calculate unit hours used
for nova instances
Breakdown by flavor, flavor class, account/billing types and by tenant.
Moved license so script has shebang as the first line
Add tenant info cache.
Refactor Instance hr report.
Added cache table for basic tenant info for reports.
Refactor instance_hours report to use table.
Improve performance of tenant info update.
use bulk sql operations to speed up the tenant info update,
as it's taking ~40s/1000 tenants to update on a decent machine.
Fix some tests broken by rebase. Fix unittests broken by
rebase. Also, renumber migration due to collision.
Add Apache license header to new files.
Fixed bug with fetching deployment information in
reconciler. Reverted old method for fetching
current usage's deployment and added new method to
fetch latest deployment information for
a request_id.
Made the field mismatch error message more readable
Refactored nova and glance verifier tests
the exists are updated with 201 send_status as part of stacktach down repair mechanism
Revert "Fixed bug with fetching deployment information in"
Revert "Adding host and deployment info to missing exists entries in the nova usage audit"
Revert "Added column headers for host and deployment in json reports"
Only log ERROR on last retry
fixed the wrong status name for sent_failed variable in audit report
fixing documentation for urls that are not available for glance
deprecating stacky urls (usage, deletes, exists) that are not
used anymore
Revert "Revert "Added column headers for host and deployment in json reports""
Revert "Revert "Adding host and deployment info to missing exists entries in the nova usage audit""
Revert "Revert "Fixed bug with fetching deployment information in""
Cell and compute info added for verification failures as well.
If that is not present(request_id is not populated for an
InstanceUsage entry), the cells display '-'
Add tox support for move to stackforge
Add tox support for move to stackforge
Change-Id: Id94c2a7f1f9061e972e90c3f54e39c9dec11943b
First, setting up the default logger name for worker and verifier.
Without this, logging from the reconciler and the database api
will end up in stacktach-default. This would mean both the
verifier and worker will be attempting to rotate that log file,
thus locking themselves.
Second, using the child logging process when calling the
info/warn/error functions directly in stacklog. Othweise this will
cause the callers to get or create the parent logger process.
the same owner and raw_id separately. This ensures that if there are
multiple exists notifications for each owner pending verification,
we send an individual verified notification for each of them.
- Fixed race condition which was causing multiple verified messages to be
sent by starting the async verify process per owner instead of per image.
- Extracted common verifier functionality into a base verifier
- Extracted messaging specific functionality into message service
- Moved methods into models
- Moved reconciler creation into start_verifier
