This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
I am using vertex AI online prediction with a custom container. To save
on autoscaling time, I am using mutateDeployedModel
API(https://cloud.google.com/vertex-ai/docs/reference/rest/v1/projects.locations.endpoints/mutateDeployedModel)
The strange is...
I am using GCP vertex AI online prediction for model deployment with a
custom container. The deployed model is working fine with less
number(<50) of minimum nodes with n1-highmem-2.But when I tried giving
the higher number of minimum nodes(>50), I am...
Thanks for the reply.But if the same model container is working on the
same machine type(n1 -highmem-2) with a lesser number of nodes, why it
is going out of memory with a larger number of nodes?
Thanks for the reply.But if the same model container is working on the
same machine type(n1 -highmem-2) with a lesser number of nodes, why it
is going out of memory with a larger number of nodes?
Hey, thanks for the reply!@Poala_Tenorio, first of all, thanks for
providing the detailed explanation. But I am also having the queries as
posted in the above reply.Can you please provide some
clarification?Thanks!
