8bcfb8bc4a
The current SQL query will not correctly limit the number of buildsets when some of the buildsets are related to multiple refs (circular dependencies). The problem is that LIMTI works on number of rows, but we want to limit only on the number of buildsets. This corrects the problem by using a subquery to identify the distinct buildsets, limiting that, and then querying for all of the information about those buildsets. This also updates the methods which perform the same function for builds, even though we are not yet seeing an issue in practice. It is theoretically possible to call the getBuilds method with 'provides' and 'limit' arguments, which would produce the same problem as the buildsets query. That is not possible in practice, as the REST API doesn't support provides, and the scheduler which does pass the provides argument doesn't pass limit. However, that could easily change in the future. Additionally, this future-proofs us if we add more queryable one-to-many relationships to builds in the future (such as if we linked builds to multiple refs). Also, it's easier to maintain these methods if they follow the same pattern. There does not appear to be a performance loss in either mysql or postgres with local testing on large data sets. There may actually be an improvement (but it's within the margin of error, so hard to say). The index hints previously needed for mysql appear to no longer be necessary and are removed. Change-Id: Ib19e4cb8171f5d4d2873fb6b9c0301eb5d4ee43d Co-Authored-By: James E. Blair <jim@acmegating.com> |
||
---|---|---|
.. | ||
ansible | ||
cmd | ||
connection | ||
driver | ||
execution_context | ||
executor | ||
lib | ||
manager | ||
merger | ||
reporter | ||
source | ||
sphinx | ||
trigger | ||
vendor | ||
web | ||
zk | ||
__init__.py | ||
_setup_hook.py | ||
change_matcher.py | ||
configloader.py | ||
exceptions.py | ||
model_api.py | ||
model.py | ||
nodepool.py | ||
scheduler.py | ||
version.py |