Extract Cloud Composer utilization metrics and map them to expected Astronomer resources
Ensure that you are authenticated with Google Cloud and that the Monitoring API is enabled
Requires python >= 3.11. Create a virtual environment, activate it and install the requirements
python -m venv .venv
source .venv/bin/activate
pip install -r requirements.txt
Run the extract_metrics.py file with the command line options corresponding to your GCC environment. To view required args, run
python extract_metrics.py --help
IMPORTANT: If using with GCC 3, please include the gcc3 flag in your command line arguments and omit the -c argument.
python extract_metrics.py -p {PROJECT_ID} -e {ENVIRONMENT_NAME} -c {CLUSTER_NAME} -l {LOCATION} --gcc3