About fredzanarbor

fredzanarbor

Hi,I am encountering too many 504 deadline exceeded messages -- maybe half of my requests.I would like to implement exponential backoff. There is an @backoff function decorator available in OpenAI. How do I achieve this in gemini?Using google-generat...

fredzanarbor

class init: self.generation_config = { "temperature": 1, "top_p": 0.95, "top_k": 0, "max_output_tokens": 8192, } def process_text(self, model_name, safety_settings, generation_config, text, system_instruction, user_prompt): self.configure_api() try: ...

fredzanarbor

Dario set me on the right path. I was using version 0.52 of google-generativeai. When I did pip install -U google-generativeai to version 0.62, the problem went away.

fredzanarbor

Thanks Dario.

AppSheet Creators Community

My Stats

fredzanarbor's Bio

Badges fredzanarbor Earned

Recent Activity

How to implement exponential backoff with gemini? too many 504s

why doesn't response_mime_type = json work here?

Re: why doesn't response_mime_type = json work here?

Re: why doesn't response_mime_type = json work here?