Back

transformers #43067

Internalise the NomicBERT model

by ed22699 · Feb 06, 2026 at 19:24 UTC · scan-a6516a82b8e1deaf

Critical Risk (100%)

Get this automatically on every PR

Install the Axiomo GitHub App to get Signals as check runs and PR comments on every pull request.

Install App

Risk Assessment

Risk level: Critical (100%)

Risk Drivers

  • large_diff: Large change: 3041 lines modified
  • multiple_concerns: Spans 7 directories
  • new_contributor: First contribution from 2 contributors
  • cross_concern_spread: Touches 3 functional domains: configuration, documentation, testing
  • api_surface_change: API surface changed in 5 file(s)

Intent

4/5 criteria met

Internalize the NomicBERT model in the codebase.

Acceptance Criteria

  • Modular file: modular_nomic_bert.py implemented and verified

    File modular_nomic_bert.py added with +594 lines.

  • Conversion script: convert_nomic_bert_to_hf.py added with usage examples

    File convert_nomic_bert_to_hf.py added with +84 lines.

  • Integration tests: End-to-end tests with exact output matching

    File test_modeling_nomic_bert.py added with +624 lines.

  • Documentation: Model docs added/updated

    File nomic_bert.md added with +144 lines.

  • ?
    Pattern reuse: Verified against similar models

    No explicit verification details in diff.

Confidence: 95.0% Source: pr description AI: openai

Contributors

ed22699 PR Author 69 commits ? New Contributor
Account Age: 862 days
Prior PRs: 1

First-time contributor to this repository. unfamiliar with 10 files being modified.

Bumsparkle 1 commit ? New Contributor
Account Age: 1940 days
Prior PRs: 0

First-time contributor to this repository.

Evidence

Evidence Completeness: 10.0%
tests_passing Failing
Missing: ci_passing, lint_passing, security_scan_clean, coverage_maintained, build_successful

Supply Chain

None Risk
Modifies dependencies
Modifies lockfile
Modifies CI config
Modifies build scripts

Focus Files

Focus on 4 critical file(s)

src/transformers/models/nomic_bert/configuration_nomic_bert.py +158

158 lines changed; New file; Source code

critical
src/transformers/models/nomic_bert/modeling_nomic_bert.py +1354

1354 lines changed; New file; Source code

critical
src/transformers/models/nomic_bert/modular_nomic_bert.py +594

594 lines changed; New file; Source code

critical
tests/models/nomic_bert/test_modeling_nomic_bert.py +624

624 lines changed; New file; Source code

critical
src/transformers/models/nomic_bert/convert_nomic_bert_to_hf.py +84

84 lines changed; New file; Source code

high
src/transformers/models/nomic_bert/__init__.py +28

New file; Source code

high
tests/models/nomic_bert/__init__.py +0

New file; Source code

high
docs/source/en/model_doc/nomic_bert.md +144

144 lines changed; New file

medium
src/transformers/conversion_mapping.py +40

Source code

medium
src/transformers/models/auto/modeling_auto.py +9

Source code

medium

+4 more files

Triage

240

minutes to review

extensive

effort level

none

staleness risk

Schedule dedicated review time; consider pair review

Recommendation

REQUEST CHANGES 14.0% readiness

Critical risk level requires changes before approval

Next Steps

Concern

Consider breaking into smaller PRs

Question

Why is ci_passing missing? Consider adding this check.

Question

Why is lint_passing missing? Consider adding this check.

Concern src/transformers/models/nomic_bert/configuration_nomic_bert.py

Critical file: 158 lines changed; New file; Source code

Concern src/transformers/models/nomic_bert/modeling_nomic_bert.py

Critical file: 1354 lines changed; New file; Source code

Concern src/transformers/models/nomic_bert/modular_nomic_bert.py

Critical file: 594 lines changed; New file; Source code

Concern tests/models/nomic_bert/test_modeling_nomic_bert.py

Critical file: 624 lines changed; New file; Source code

Concern src/transformers/models/nomic_bert/convert_nomic_bert_to_hf.py

New file in high-priority area: 84 lines changed; New file; Source code