cloudkitty/releasenotes/notes/optimize_gnochi-fetcher-41b502e7ca242cb1.yaml
Rafael Weingärtner 13a249969b Optimize Gnocchi fetcher
Depending on the environment where CloudKitty is applied, when using
Gnocchi fetcher, if the environment is too big, CloudKitty tends to
consume too much RAM. This happens because before retrieving the scope
IDs and filtering out only the unique ones, it loads all of the Gnocchi
resources to memory.

This patch proposes a change in that process, to load the chunk of
Gnocchi resources and execute the retrieval of the scope ID and
selecting only the unique ones right away. Then, in the worst case
scenario, we would only have 1000 resources being loaded to memory.

Change-Id: Ibcc6af5aa5cf544be9032e33d3ac90eb1f6b14ef
2023-01-23 15:30:13 +01:00

6 lines
167 B
YAML

---
issues:
- |
Optimize Gnocchi fetcher to avoid consuming too much RAM when CloudKitty
runs in cloud environments with hundreds of thousands of resources.