Skip to content

[ty] Run Ruff and ty doctests as regular Rust tests - #29859

Open
charliermarsh wants to merge 4 commits into
mainfrom
migrate-rust-doctests
Open

charliermarsh wants to merge 4 commits into
mainfrom
migrate-rust-doctests

Conversation

@charliermarsh

@charliermarsh charliermarsh commented Oct 31, 2026 •

Copy link
Copy Markdown
Member

Summary

Moving 207 Rust doctests into the regular test suite cut the median warm test time for the affected crates from 70.6s to 59.0s (16.5%). The assertions now run under nextest, so CI skips the separate cargo test --doc step. In one run per revision, the platform build and test steps were 8–13s faster.

Hawk still compiles the documentation examples to see which public APIs they use. A warm Hawk run took 26.6s with the existing 16-crate limit and 32.1s across the whole workspace. Skipping that pass took 13.0s but produced 38 unnecessary_public findings.

@charliermarsh charliermarsh added testing Related to testing Ruff or ty ci Related to internal CI tooling ty The ty type checker labels Oct 31, 2026 — with ChatGPT Codex Connector
@astral-automations-bot

astral-automations-bot Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Typing conformance results

No changes detected ✅

Current numbers
The percentage of diagnostics emitted that were expected errors held steady at 98.60%. The percentage of expected errors that received a diagnostic held steady at 98.86%. The number of fully passing files held steady at 137/146.

Results for d8ede85 · Workflow run

@astral-automations-bot

astral-automations-bot Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

Memory usage report

Memory usage unchanged ✅


Results for d8ede85 · Workflow run

@astral-automations-bot

astral-automations-bot Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

ecosystem-analyzer results

No diagnostic changes detected ✅

Full report with detailed diff · Timing results


Results for d8ede85 · Workflow run

@astral-automations-bot

astral-automations-bot Bot commented Oct 31, 2026 •

Copy link
Copy Markdown
Contributor

ruff-ecosystem results

Linter (stable)

✅ ecosystem check detected no linter changes.

Linter (preview)

✅ ecosystem check detected no linter changes.

Formatter (stable)

✅ ecosystem check detected no format changes.

Formatter (preview)

✅ ecosystem check detected no format changes.

Linter (stable) · Linter (preview) · Formatter (stable) · Formatter (preview)


Results for d8ede85 · Workflow run

@charliermarsh
charliermarsh marked this pull request as ready for review November 1, 2026 11:24

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How do we ensure that the tests stay up to date with the doctests?

This branch was previously deployed

1 inactive deployment
automations — d8ede854 Deployed Nov 1, 2026 by charliermarsh via security-review / security review #96467
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci Related to internal CI tooling testing Related to testing Ruff or ty ty The ty type checker

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants