ci(release): switch PyPI watch to JSON API instead of pip index#70
Merged
lukeocodes merged 1 commit intomainfrom May 8, 2026
Merged
ci(release): switch PyPI watch to JSON API instead of pip index#70lukeocodes merged 1 commit intomainfrom
lukeocodes merged 1 commit intomainfrom
Conversation
The 'Wait for new deepctl version on PyPI' step in the release workflow polled `pip index versions deepctl`, which queries PyPI's simple index behind a CDN cache that can lag 5-15 minutes after a successful publish. v0.2.21 (PR #3 on homebrew-tap) and v0.2.22 (PR #4 on homebrew-tap) both hit this — PyPI confirmed the release was installable, but the cached simple index hadn't picked it up by the time the 10-minute window (30 × 20s) ran out, so bump-brew-formula failed and we had to re-run the formula bump manually. Switch to GET https://pypi.org/pypi/deepctl/<version>/json. That endpoint flips to HTTP 200 the instant a release is published. Same 30 × 20s loop shape, just a different probe — total runtime budget unchanged at 10 minutes worst case but the typical wait should drop to a single iteration. Verified locally that the JSON endpoint already returned 200 for 0.2.22 while `pip index versions` still missed it. No other changes needed — release-please outputs and downstream jobs are untouched.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Problem
The "Wait for new deepctl version on PyPI" step in
.github/workflows/release.ymlpollspip index versions deepctl. That endpoint queries PyPI's simple index, which sits behind a CDN cache that can lag 5-15 minutes after a release is actually published.Two consecutive releases hit this:
In both cases PyPI confirmed the release was installable (any user could
pip install deepctl==X.Y.Z), but the cached index hadn't picked it up before the 10-minute window (30 × 20s) ran out. Thebump-brew-formulajob failed → we had to regenerate the formula manually.Fix
GET https://pypi.org/pypi/deepctl/<version>/json— the PyPI JSON API endpoint flips to HTTP 200 the instant a release is published, no CDN cache between us and the source-of-truth catalog.Same 30 × 20s loop shape, total worst-case budget unchanged at 10 minutes. Typical wait should drop from 5-15 minutes to a single iteration.
Verification
While diagnosing v0.2.22 today:
JSON API: live. Simple index: lagging. The fix is to probe the source of truth.
What it doesn't change
bump-brew-formula's downstream pipeline (homebrew-pypi-poetresource generation, etc.) is unchanged. That step's ownpip install deepctl==<version>may still hit the simple-index lag for ~30-60s after this watch step succeeds, but that's a much smaller window and the install retry is implicit in the script's own behaviour.