I am running Vertex AI pipelines to deploy models ( particularly the image classification one given in the Vertex AI tutorials ) .
Each pipeline is used to deploy an image classification model starting from creating a dataset , training model with that dataset and finally deploying model to an endpoint .
Suppose I ran the same pipeline 10 times , resulting in 10 dataset creations , 10 model trainings , 10 endpoint deployments .
How can I get individual costs of running these pipelines with all the google cloud resources used in running the pipelines as well ?
Hi @gauravpant,
you can generate services costs using the Google Pricing Calculator inserting the resources and other parameters that you will use:
https://cloud.google.com/products/calculator-legacy --> I suggest you to use the old version that is more practical.
Hi @MaxImbrox ,
I don't want this static calculation like thing .
What I want is whenever a pipeline is run in my google cloud project , I get the associated cost .
I came across this doc :
https://cloud.google.com/vertex-ai/docs/pipelines/understand-pipeline-cost-labels
This document starts with :
" You can review the cost of your pipeline runs using Cloud Billing export to BigQuery. "
I am not able to figure it out yet but I assume the flow should be something like : I run a pipeline , then using sinks , the pipeline related logs are stored in a BigQuery dataset and this BigQuery dataset also contains cost of the pipeline run.
User | Count |
---|---|
15 | |
1 | |
1 | |
1 | |
1 |