You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
bigquery: add jobRateLimitExceeded as retryable error #3795
Is your feature request related to a problem? Please describe.
With the limit of 100 concurrent jobs, we have the jobRateLimitExceeded error when we have 100s of concurrent calls to client.Query(...).Read(ctx):
googleapi: Error 400: Job exceeded rate limits: Your project_and_region exceeded quota for concurrent queries. For more information, see https://cloud.google.com/bigquery/troubleshooting-errors, jobRateLimitExceeded
Describe the solution you'd like
Since the error rateLimitExceeded is already a retryable error, we could add the error jobRateLimitExceeded to the set of retryable errors since it us very similar to rateLimitExceeded and could benefit from the backoff of gax.Backoff.
Describe alternatives you've considered
Alternatively, we could implement the retry mechanism client side and wrap the BigQuery client, however having the client automatically retry on jobRateLimitExceeded would greatly simplify the approach and avoid logic duplication.
Reacted by Samuel Vaillant, Benjamin Baron, Matthieu Dumont and Matthieu Beauché
changed the title [-]BigQuery Go Client: add jobRateLimitExceeded as retryable error[/-][+]bigquery: add jobRateLimitExceeded as retryable error[/+]on Mar 11, 2021
Activity
[-]BigQuery Go Client: add jobRateLimitExceeded as retryable error[/-][+]bigquery: add jobRateLimitExceeded as retryable error[/+]alvarowolfx commentedon Apr 18, 2024
fixed by #9726