Repository navigation

Add automatic retry logic for transient Gemini API errors (503, 429) - #385

Merged

aksg87 merged 3 commits into

google:mainfrom

YuqiGuo105:fix/chunk-retry-503

Apr 21, 2026

YuqiGuo105 commented Feb 20, 2026 •

edited

Loading

Contributor

Description

Fixes #240

This change implements exponential backoff retry for transient errors in the Gemini provider, preventing entire document processing failures when a single chunk encounters temporary service overload (503) or rate limiting (429) errors.

Changes:

Add retry configuration parameters (max_retries, retry_delay, max_retry_delay)
Implement _is_retryable_error() to distinguish temporary vs permanent errors
Add exponential backoff retry logic in _process_single_prompt()
Each chunk retries independently without affecting other chunks
Add comprehensive test coverage (30 test cases)

How Has This Been Tested?

Test suite in tests/test_gemini_retry.py with 30 test cases covering error classification, retry logic, parallel processing, and configuration.

Checklist

My code follows the style guidelines of this project
I have performed a self-review of my own code
I have commented my code, particularly in hard-to-understand areas
My changes generate no new warnings or errors
I have added tests that prove my fix is effective
New and existing unit tests pass locally with my changes

google-cla Bot commented Feb 20, 2026

Thanks for your pull request! It looks like this may be your first contribution to a Google open source project. Before we can look at your pull request, you'll need to sign a Contributor License Agreement (CLA).

View this failed invocation of the CLA check for more information.

For the most up to date status, view the checks section at the bottom of the pull request.

github-actions Bot added the size/L label

YuqiGuo105 force-pushed the fix/chunk-retry-503 branch from beaf0dc to 5152918 Compare

February 20, 2026 03:57

YuqiGuo105 mentioned this pull request

langextract chunking does not recover from 503 error "The model is overloaded" #240

Closed

YuqiGuo105 force-pushed the fix/chunk-retry-503 branch 3 times, most recently from 65139a1 to 5152918 Compare

February 22, 2026 08:16

github-actions Bot commented Feb 25, 2026

⚠️ Branch Update Required

Your branch is 1 commits behind main. Please update your branch to ensure CI checks run with the latest code:

git fetch origin main
git merge origin/main
git push

Note: Enable "Allow edits by maintainers" to allow automatic updates.

1 similar comment

github-actions Bot commented Mar 21, 2026

⚠️ Branch Update Required

Your branch is 1 commits behind main. Please update your branch to ensure CI checks run with the latest code:

git fetch origin main
git merge origin/main
git push

Note: Enable "Allow edits by maintainers" to allow automatic updates.

github-actions Bot commented Mar 29, 2026

⚠️ Branch Update Required

Your branch is 6 commits behind main. Please update your branch to ensure CI checks run with the latest code:

git fetch origin main
git merge origin/main
git push

Note: Enable "Allow edits by maintainers" to allow automatic updates.

github-actions Bot commented Apr 5, 2026

⚠️ Branch Update Required

Your branch is 8 commits behind main. Please update your branch to ensure CI checks run with the latest code:

git fetch origin main
git merge origin/main
git push

Note: Enable "Allow edits by maintainers" to allow automatic updates.

github-actions Bot commented Apr 12, 2026

⚠️ Branch Update Required

Your branch is 11 commits behind main. Please update your branch to ensure CI checks run with the latest code:

git fetch origin main
git merge origin/main
git push

Note: Enable "Allow edits by maintainers" to allow automatic updates.

github-actions Bot commented Apr 19, 2026

⚠️ Branch Update Required

Your branch is 15 commits behind main. Please update your branch to ensure CI checks run with the latest code:

git fetch origin main
git merge origin/main
git push

Note: Enable "Allow edits by maintainers" to allow automatic updates.


          Add automatic retry logic for transient Gemini API errors (503, 429)

bf25b90

Fixes google#240

This change implements exponential backoff retry for transient errors
in the Gemini provider, preventing entire document processing failures
when a single chunk encounters temporary service overload (503) or rate
limiting (429) errors.

Changes:
- Add retry configuration parameters (max_retries, retry_delay, max_retry_delay)
- Implement _is_retryable_error() to distinguish temporary vs permanent errors
- Add exponential backoff retry logic in _process_single_prompt()
- Each chunk retries independently without affecting other chunks
- Add comprehensive test coverage (30 test cases)

Benefits:
- Prevents API quota waste from re-processing entire documents
- Reduces 429 errors from excessive retries
- Improves reliability for large batch processing

aksg87 added a commit to YuqiGuo105/langextract that referenced this pull request


          review: narrow retry classifier, add backoff jitter, guard SDK stacking

eb4dda3

Maintainer polish on top of google#385:

- Typed google.genai APIError.code classification for 408/429/5xx; fall
  through to httpx transient subclasses (TimeoutException, NetworkError,
  RemoteProtocolError, ProxyError) and stdlib ConnectionError/TimeoutError.
  LocalProtocolError and UnsupportedProtocol intentionally excluded since
  they indicate client/config bugs.
- Narrow regex fallback for exceptions that only carry the status in a
  message; avoids matching permanent failures like bare "quota" or
  "unavailable".
- Multiplicative jitter (uniform(0.5, 1.5)) with post-jitter cap at
  max_retry_delay so the named maximum bounds the real sleep.
- Keyword-only retry knobs (max_retries, retry_delay, max_retry_delay)
  with init-time validation.
- Guard against stacking with google-genai HttpOptions.retry_options.
  Matches the SDK's own normalization: retry_options with attempts in
  {0, 1} is treated as "retries disabled" and allowed; None or >1 raises
  InferenceConfigError. Covers HttpOptions object, HttpOptionsDict
  snake-case, and HttpOptionsDict camelCase shapes.
- Rename tests/test_gemini_retry.py -> tests/gemini_retry_test.py to match
  the repo's pytest discovery pattern (python_files = "*_test.py").
- 65 parametrized tests (absl.testing.parameterized) covering the
  classifier, retry loop, parallel-chunk scenarios, init validation, and
  the SDK stacking guard matrix.

aksg87 force-pushed the fix/chunk-retry-503 branch from 55e2fdd to eb4dda3 Compare

April 21, 2026 01:15

github-actions Bot added size/M and removed size/L labels


          review: narrow retry classifier, add backoff jitter, guard SDK stacking

7e5f7ba

Maintainer polish on top of google#385:

- Typed google.genai APIError.code classification for 408/429/5xx; fall
  through to httpx transient subclasses (TimeoutException, NetworkError,
  RemoteProtocolError, ProxyError) and stdlib ConnectionError/TimeoutError.
  LocalProtocolError and UnsupportedProtocol intentionally excluded since
  they indicate client/config bugs.
- Narrow regex fallback for exceptions that only carry the status in a
  message; avoids matching permanent failures like bare "quota" or
  "unavailable".
- Multiplicative jitter (uniform(0.5, 1.5)) with post-jitter cap at
  max_retry_delay so the named maximum bounds the real sleep.
- Keyword-only retry knobs (max_retries, retry_delay, max_retry_delay)
  with init-time validation.
- Guard against stacking with google-genai HttpOptions.retry_options.
  Matches the SDK's own normalization: retry_options with attempts in
  {0, 1} is treated as "retries disabled" and allowed; None or >1 raises
  InferenceConfigError. Covers HttpOptions object, HttpOptionsDict
  snake-case, and HttpOptionsDict camelCase shapes.
- Rename tests/test_gemini_retry.py -> tests/gemini_retry_test.py to match
  the repo's pytest discovery pattern (python_files = "*_test.py").
- 65 parametrized tests (absl.testing.parameterized) covering the
  classifier, retry loop, parallel-chunk scenarios, init validation, and
  the SDK stacking guard matrix.

aksg87 force-pushed the fix/chunk-retry-503 branch from eb4dda3 to 7e5f7ba Compare

April 21, 2026 02:12

github-actions Bot added size/L and removed size/M labels

aksg87 added the ready-to-merge label

aksg87 had a problem deploying to live-keys

April 21, 2026 02:17

— with

GitHub Actions Failure

aksg87 mentioned this pull request

CI: fix secure fork live test workflow #456

Merged

aksg87 added ready-to-merge and removed ready-to-merge labels

aksg87 had a problem deploying to live-keys

April 21, 2026 06:25

— with

GitHub Actions Failure


          Format provider imports for CI

e25a160

aksg87 merged commit 3aab86c into google:main

14 of 22 checks passed

aksg87 mentioned this pull request

ci: unify formatter tool pins across PR checks #457

Merged

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ready-to-merge size/L