Back

pytorch #174239

[CI] Add sharding support to operator microbenchmark jobs

by jainapurva · Feb 06, 2026 at 19:21 UTC · scan-e8cd370771431ec7

View on Github · Download JSON
Medium Risk (30%)

Get this automatically on every PR

Install the Axiomo GitHub App to get Signals as check runs and PR comments on every pull request.

Install App

Risk Assessment

Risk level: Medium (30%)

Risk Drivers

  • touches_ci_config: Modifies ci_config code

Intent

4/5 criteria met

Add sharding support to operator microbenchmark jobs to reduce execution time

Acceptance Criteria

  • ✓
    Each operator test runs as a separate parallel job

    operator_microbenchmark.yml updates to add matrix field, split tests

  • ?
    Reduce wall-clock time from ~500 minutes to ~50-120 minutes

    Timing improvement inferred, no run-time stats in diff

  • ✓
    Add op_benchmark_tests field in workflow YAML

    operator_microbenchmark.yml adds op_benchmark_tests field

  • ✓
    test.sh uses OP_BENCHMARK_TESTS environment variable if set

    test.sh includes logic to use OP_BENCHMARK_TESTS

  • ✓
    Remove TODO comment about implementing sharding

    Comment about TODO removed from test.sh

Confidence: 95.0% Source: diff analysis AI: openai

Contributors

jainapurva PR Author 2 commits ? Low Trust
Account Age: 3546 days
Prior PRs: 42

Has 0 merged PRs to this repo.

Evidence

Evidence Completeness: 43.0%
ci_passing Pending
tests_passing Failing
build_successful Passing
Missing: lint_passing, security_scan_clean, coverage_maintained

Supply Chain

Elevated Risk
Modifies dependencies
Modifies lockfile
Modifies CI config
Modifies build scripts

Focus Files

Focus on 1 critical file(s)

.github/workflows/operator_microbenchmark.yml +53

Modifies ci_config code; 53 lines changed; Configuration

critical
.ci/pytorch/test.sh +14

Standard file

low

Triage

9

minutes to review

medium

effort level

none

staleness risk

Standard review process

Recommendation

COMMENT 53.0% readiness

Some concerns to address before approval

Next Steps

Concern .github/workflows/operator_microbenchmark.yml

Requires security review for ci_config changes

Question

Why is lint_passing missing? Consider adding this check.

Question

Why is security_scan_clean missing? Consider adding this check.

Concern .github/workflows/operator_microbenchmark.yml

Critical file: Modifies ci_config code; 53 lines changed; Configuration

Suggestion .github/workflows/operator_microbenchmark.yml

CI configuration changed - verify build/deploy behavior