Changelog¶
Last Updated: 2026-08-06 Version: v0.3.0
All notable changes to this project will be documented in this file.
Unreleased — 2026-08-06¶
Hardened Dependabot Consolidation (GAP-DEPENDABOT-CONSOLIDATE-01)¶
- Tightened
.github/dependabot.ymlso every package ecosystem now usesopen-pull-requests-limit: 1and a catch-allgroupsentry (all-dependencies/python-all), enforcing at most one grouped PR per ecosystem. - Added
scripts/ci/dependabot_consolidator.pyto merge eligible Dependabot branches into a single cross-ecosystem consolidation branch and PR, with--dry-runand--base-branchsupport, conflict detection/abort, security-label exclusion, and idempotent reuse of an existingdependabot-consolidatedPR. - Added
.github/workflows/dependabot-consolidation.ymlscheduled after Dependabot windows and available viaworkflow_dispatchwith adry_runtoggle; uses concurrencydependabot-consolidationand least-privilegecontents: write+pull-requests: writepermissions. - Added
tests/ci/test_dependabot_consolidator.pywith mocked subprocess and GitHub API calls covering zero/one PR exits, clean merge, conflict handling, security exclusion, dry-run, and existing consolidation PR reuse. - Updated accountability report and AI agent utilities registry.
CCA Dependabot Graph Failure Remediation — Run 31061088340¶
- Hardened
.github/dependabot.ymlwith agithub-actionsregistry (type: git,url: https://github.com) authenticated via${{ secrets.GITHUB_TOKEN }}. Associated the registry with thegithub-actionsecosystem so Dependabot CLI/proxy can resolve action metadata even when token scoping is tight. - Added remediation context comments documenting:
- Commit-signing failures caused by missing
gh-gpgsignbinaries should be handled by ensuring the signing tool exists or disabling commit signing for the updater step. - Long-running Node agents should set
NODE_OPTIONS="--max-old-space-size=8192"to reduce SIGABRT risk from heap exhaustion. - Re-pinned the four actions that emitted invalid PURL warnings to verified commit SHAs:
PyO3/maturin-action→e83996d129638aa358a18fbd1dfb82f0b0fb5d3b(rust-ffi.yml)aquasecurity/trivy-action→ed142fd0673e97e23eac54620cfb913e5ce36c25(container-scan.yml,security-scanning-suite.yml)dorny/test-reporter→3eeb9fc888e82e8be2fb356bbeec2750231672bc(reasoning-engine-monitor.yml)dtolnay/rust-toolchain→4360b52568e2003a75bf9bc1d59f33a8e3fc893c(dependency-security-gate.yml,optimized-test-execution.yml)- Verified all updated SHA references resolve to real GitHub commits.
- Note: the failing step is inside the GitHub-managed dynamic workflow
dynamic/copilot-swe-agent/copilot; repository-side mitigations are applied above.
CCA Runtime Hardening — Run 30980481579 Recovery¶
- Added fail-fast "🔒 Validate CCA lock variables" step to
.github/workflows/copilot-setup-steps.ymlbefore session pre-load. ValidatesCOPILOT_AGENT_CCA_VERSION_LOCK=stable,COPILOT_AGENT_DEDUPLICATION_ENABLED=true, andCOPILOT_AGENT_TURN_ISOLATION_ENABLED=truevia repository variables; aborts bootstrap with clear::error::messages if any value is wrong. - Delegated parallel follow-up lanes:
ci-testing-agent: fix deduplication/turn-isolation regression tests in.github/copilot-evolution/.workflow-health-monitor: assess/add CCA trailing-work telemetry watcher.- Verified previous multi-lane campaign deliverables remain green locally:
pytest tests/orchestration/test_chronicle_cli_gaps.py tests/test_chronicle_cost.py tests/orchestration/test_phase_4d_optimization.py -q→ 33 passed.mypy src/aries_serpent_core/logging/chronicle_cost.py src/orchestration/simulation.py --config-file mypy.ini→ clean.
Unreleased — 2026-08-04¶
PR #5462 Merge Conflict Resolution + Documentation Sync¶
- Resolved stacked PR merge conflict by rebasing
copilot/fix-rag-module-test-timeoutonto latest0D_base_. - Preserved base-branch
.codex/session_startup_packet.jsonto avoid generated timestamp churn. - Synced
docs/accountability/AGENT_ACCOUNTABILITY_REPORT.mdto canonical archive copy atdocs/accountability/.codex/archive/reports/AGENT_ACCOUNTABILITY_REPORT.md. - Synced
docs/CHANGELOG.mdupdates to rootCHANGELOG.md.
PR #5454 & PR #5448 Reconstruction Session¶
- RAG Module Tests timeout fix: Increased job timeout from 30 to 60 minutes and optimized test execution timeout (3300s → 2700s) to prevent premature SIGTERM during model loading and test execution. Updated
.github/workflows/test-rag.ymlwith comprehensive rationale. - Pytest summary parsing validation: Verified
scripts/validation/update_legacy_debt_quarantine.pycorrectly handles both singular "error" and plural "errors" in pytest summary output; confirmed control flow optimization (no duplicate pytest runs). - Boundary regression guard formatting: Applied Ruff formatting cleanup to
tests/cognitive_brain/test_boundary_regression_guards.py(consolidated multi-line function signature to single line, no behavioral changes). - Test validation: All 37 boundary regression guard tests pass; 18 comprehensive tests added for pytest summary parsing validation.
- Documentation: Updated
docs/CHANGELOG.mdanddocs/accountability/AGENT_ACCOUNTABILITY_REPORT.md.
Unreleased — 2026-08-03¶
Final Operationalization — PR #5430 Phase 3¶
- Branch protection required-check contract: Added “Required Checks Contract” section to
docs/validation/POST_MERGE_VALIDATION_PR5430.mdwith exact job names fromcognitive-brain-required-gate.yml; added.github/workflows/cognitive-brain-required-check-selftest.ymlto detect drift. - Legacy debt auto-tracking: Added
scripts/validation/update_legacy_debt_quarantine.pyand.github/workflows/cognitive-brain-legacy-debt-update.yml(weekly) to refreshdocs/validation/LEGACY_TEST_DEBT_QUARANTINE.md; added Trend Table and 20% week-over-week escalation threshold. - Telemetry baseline dashboard: Added
scripts/validation/generate_cognitive_brain_telemetry_baseline.py, generateddocs/validation/COGNITIVE_BRAIN_TELEMETRY_BASELINE.md, and added.github/workflows/cognitive-brain-telemetry-baseline.ymlfor path-triggered regeneration. - Regression guard expansion: Extended
tests/cognitive_brain/test_boundary_regression_guards.pywith negative architecture test for directsession.createpaths, required-check name drift test, and legacy quarantine schema validator. - Governance sync: Updated
docs/accountability/AGENT_ACCOUNTABILITY_REPORT.md,docs/CHANGELOG.md, anddocs/validation/INDEX.md.
Post-Merge Durability Pass — PR #5430¶
- Validation report:
docs/validation/POST_MERGE_VALIDATION_PR5430.md— merge commit7a54909c6d287524462c5405ee46cd1cbeb72ff1, command matrix, pass/fail outcomes, scope and residual risk statements. - Legacy debt quarantine:
docs/validation/LEGACY_TEST_DEBT_QUARANTINE.md— 24 failed + 13 errored non-cognitive_brain failures classified and tracked with phased remediation. - CCA runtime boundary notes:
docs/validation/CCA_RUNTIME_BOUNDARY_NOTES.md— repo-controlled vs hosted-runtime-controlled mitigation matrix. - CI signal separation: Added
.github/workflows/cognitive-brain-required-gate.yml(blocking ruff/mypy/pytest/regression) and.github/workflows/cognitive-brain-legacy-debt.yml(non-blocking informational lane). - Regression meta-tests: Added
tests/cognitive_brain/test_boundary_regression_guards.pylocking session/create boundary, shell adversarial vectors,assert_loadedenforcement, and forensics field preservation. - Verification: ruff/mypy clean on
src/codex/cognitive_brain; 231+ targeted cognitive_brain tests passing.
Cognitive Brain Runtime — Phase 2 (PR #5430 continuation)¶
shell_policy.py— Shell execution safety layer: allow/deny glob rules, working-directory constraints, timeout ceilings, retry limits, token redaction (GitHub PATs, ******--token/--passwordflags).PolicyVerdictenum (ALLOW / DENY / AUDIT). Env-gated singleton.session_guard.py— Centralsession.createsafety wrapper: guarantees every session creation passes throughModelNegotiator; emitssession_guardtelemetry withdecision_id,turn_id,task_id.telemetry.py— Addeddecision_id,turn_id,task_idfields toTelemetryEvent; newforensics()emit method for traceable decision records; backward-compatible NDJSON deserialization.capability_registry.py—ToolSurfaceCategoryenum, versionedToolSurfaceProfiledataclass,CAPABILITY_SCHEMA_VERSION="2.0.0",get_tool_surface_registry()(GitHub MCP 35 / Playwright 21 / web_search 1 / shell 1),check_capability_schema_version().kernel.py—assert_loaded()entrypoint guard;plan_tools()now emits forensics event with selected toolchain and rejected alternatives.- Tests — 5 new test files; total 231 cognitive brain tests passing.
- CI —
cognitive-brain-regression-guard.yml(dispatch-only): 7-step regression guard covering reasoning-param, negotiator, auto-load, shell bypass, capability outage, stale cache, and full suite. - Docs —
docs/cognitive_brain/OPERATOR_RUNBOOK.md: 13-section operator runbook.
Unreleased — 2026-08-02¶
Documentation¶
- Repository explanation accuracy: Neutralized stale marketing claims in
README.md,docs/system/CODEBASE_COGNITIVE_MAP.md, anddocs/CHANGELOG.md(agent count 145 → 131, workflow count 285 → 229 active/205 archived, coverage/tests/CVE wording aligned withpyproject.tomland CI evidence). - Section 11 onboarding: Added per-task quick-start commands, MCP boundary clarifications, and default-disabled-autonomy note to
docs/REPOSITORY_EXPLANATION.md.
[0.3.0] — 2026-07-11¶
Release Summary¶
Security & Infrastructure Hardening Release: v0.3.0 focuses on security vulnerability fixes, infrastructure improvements, and production deployment validation.
- Status: Production Release
- Authority: @mbaetiong (D-tier autonomous deployment authority)
- Timestamp: 2026-07-11T12:00:00Z
- Distribution: PyPI + GitHub Releases
- Distribution Quality: All 32 certification gates passed
Security Fixes¶
- CWE-89: SQL Injection vulnerability fixed (commit be200c40)
- CWE-79: Cross-Site Scripting protection enhanced (commit be200c40)
- CWE-502: Unsafe deserialization prevention implemented (commit be200c40)
- CWE-798: Hardcoded credentials removed, token-based auth enabled (commit 9dd50a12)
- CWE-22: Path traversal vulnerabilities fixed (commits 44f401cd, dad39ddf)
- Total: 6 critical vulnerabilities addressed; see
SECURITY.mdandpyproject.tomlfor current dependency security posture.
Infrastructure Improvements¶
- PyPI Publishing: Token-based authentication configured
- GitHub Actions: Security-critical actions pinned to commit SHAs
- Action Versions: Updated to latest security-patched versions
- Workflow Compliance: 99.5% compliance score achieved
- SBOM Updates: Security Bill of Materials updated and validated
Documentation¶
- Release Notes: Comprehensive v0.3.0 release notes published
- Migration Guide: v0.2.2 → v0.3.0 upgrade path documented
- Installation Guide: Updated with v0.3.0 syntax examples
- Security Advisory: Vulnerability disclosures documented
Testing & Quality¶
- Test suite: Thousands of test files and test functions across
tests/; seepytest.iniand CI artifacts for current collection results. - New Security Tests: 14 tests added for CWE validation
- Test Coverage: Coverage baseline is 34% (locked 2026-07-02); 80%+ is an aspirational target. See
.codex/COVERAGE_GAP_REPORT.md. - Code Quality: Security scanning gates passed (CodeQL, Bandit, Semgrep)
Dependencies Updated¶
- setuptools>=78.1.1,<82 (Security: PYSEC-2025-49, PYSEC-2026-1918)
- wheel>=0.46.2 (Security: CVE-2026-24049)
- cryptography>=48.0.0,<50.0.0 (Security: CVE-2026-26007)
- PyJWT>=2.13.0,<3.0.0 (Security: PYSEC-2026-120)
Backward Compatibility¶
- ✅ Full backward compatibility maintained
- ✅ No breaking changes to public API
- ✅ Existing installations can upgrade without code changes
- ✅ Configuration files remain compatible
Verification¶
- All security scanning gates passed (CodeQL, Bandit, Semgrep)
- Production deployment readiness: stable core functionality; review
.codex/COVERAGE_GAP_REPORT.mdand readiness checklists before production deployment. - Full backward compatibility verified
[0.2.1] — 2026-07-11¶
Release Summary¶
Phase 3 Release: Production deployment verification and documentation updates for v0.2.0.
- Status: Production Release
- Authority: @mbaetiong (Full autonomous deployment authority)
- Timestamp: 2026-07-11T07:56:48Z
- Tag: v0.2.0
- Distribution: PyPI + GitHub Releases
Added¶
- Phase 3 Execution: Tag & Release cycle complete with GitHub Pages documentation updates
- Documentation: Comprehensive changelog and version information for v0.2.0
- GitHub Pages: Updated version badges, installation links, and release information
- Distribution Quality Assurance: Verification of PyPI packages and GitHub Releases
Improvements¶
- Workflow Compliance: Achieved 99.5% workflow compliance score (Phase 3 target)
- SBOM Updates: Security Bill of Materials updated and validated
- Production Verification: Complete validation of production deployment readiness
- Link Validation: 4,676 documentation links validated with 98.3% health
Fixed¶
- Documentation Links: All broken links resolved and validated
- Version References: Updated all version references across documentation (0.1.0 0.2.1)
- Installation Examples: Updated pip install commands with v0.2.0 references
- Release Metadata: Updated GitHub Pages configuration with new release information
Release Verification¶
- Phase 1-3 Improvements verified
- SBOM validation complete
- Production deployment confirmed
- Distribution quality assured
- Zero new vulnerabilities introduced
- Full backward compatibility maintained
[0.1.1] — 2026-07-10¶
Release Summary¶
Patch Release: Patch version bump from v0.2.0 to v0.2.0 for incremental updates and improvements.
- Status: Production Release
- Authority: @mbaetiong (Full autonomous deployment authority)
- Timestamp: 2026-07-10T20:59:08Z
- Tag: v0.2.0 (replaces immutable v0.2.0)
- Distribution: PyPI + GitHub Releases
Fixed¶
- build: Version constraint update v0.2.0 v0.2.0 (pyproject.toml)
- release: Post-merge release automation configured with 4-step deployment process (tag, GitHub release, PyPI publish, community announcement)
Updated¶
- docs: Post-merge execution brief for v0.2.0 release cycle
- accountability: Session context for v0.2.0 deployment recorded
Release Verification¶
- All 32 certification gates passed (inherited from v0.2.0-final)
- Production readiness: stable core functionality; review
.codex/COVERAGE_GAP_REPORT.mdand readiness checklists before production deployment. - Zero new vulnerabilities introduced
- Full backward compatibility maintained
Unreleased¶
Fixed (S255 — PR #3831 — 2026-03-31)¶
- fix(ci):
tests/config/conftest.py— always-first sys.path pattern: remove existing_SRCentries then insert at index 0 (review thread suggestion). - fix(changelog): Corrected S254 perf numbers to 55K45K/20ms40ms (accurate net diff vs. main; review thread).
- feat(auto-post):
copilot-agent-session-done.ymlwired to auto-fix pre-flight REQ-4/5 whenAuto-Post @copilot review After Agent Sessioncheckbox is checked. - feat(wrapup):
session_wrapup_autofix.py— newAuto-Postcheckbox added to_REQUIRED_PR_CHECKBOXES.
Fixed (S254 — PR #3831 — 2026-03-31)¶
- fix(mlflow):
maybe_mlflow()generator refactored —mlflow.start_run()moved beforeyieldto preventRuntimeError: generator didn't stop after throw()(gemini HIGH alert).returnafteryield _NoOpLogger()ensures correct generator termination. - fix(perf): Performance threshold
dict_lookup_10000adjusted 55K45K; latency assert tightened 20ms40ms (gemini MEDIUM suggestions — better regression detection vs. CI reliability balance). - feat(pr-template):
Auto-Post @copilot review After Agent Sessioncheckbox added to all 6 PR body template locations (both static templates + 4 workflow-generated bodies). -
feat(brain):
cognitive-brain-manager.mdv4.4v4.5 — S254 status, gemini review thread resolution patterns. -
fix(ci):
tests/config/conftest.py— added explicitsys.path.insert(0, src/)guard (with directory-depth comment) to fixModuleNotFoundError: No module named 'config.openai_client'in the Resilient Validation Suite. Root cause: pytest-split workers resolvetests/config/ahead of the rootconftest.pypath injection. Verified: 24/24test_openai_client.pytests pass. - feat(brain):
.github/agents/cognitive-brain-manager.mdv4.3v4.4 — Sprint 13 status table, iterative self-review loop Mermaid architecture diagram, AfterMath patterns (RP-NEW-001/002/003), Phase 3+4 next-phase plan, PDA Loop front-matter enabled. - feat(agent):
.github/agents/post-merge-doc-alignment-agent.mdv1.0v1.1 — PDA Loop integration,self_healingconfig block (enabled, max 3 iterations),iteration_historytracking S244/S251/S252/S253 runs,cognitive_integration_level: 3. - fix(docs):
docs/index.md"Last Updated" refreshed to 2026-03-31. - health(sweep): Issue #3829 nightly health sweep S200 completed — ruff check 0 violations; CodeQL on main success (3 consecutive); last 5 CI runs on main: success/skipped ; cognitive brain metadata updated; accountability report updated.
Fixed (auto-update — PR #3831)¶
-
Auto-fix:
session_wrapup_autofix.pyupdated 2026-07-13 -
CI Rescue Pipeline (
docs/ci/CI_RESCUE_PIPELINE.md): New canonical reference documenting the end-to-end lifecycle from workflow failure to Copilot fix session. Includes 9 Mermaid diagrams (flowchart, sequence, state machine, timeline, dependency graph, anti-pattern maps) and a component responsibility matrix. Golden-path example from PR #3818 comment #4158728043. - CI/CD Index updated (
docs/ci/INDEX.md): CI Rescue Pipeline added as the top entry under a new " CI Rescue Pipeline (Golden Path)" section. - Homepage quick-links updated (
docs/index.md): " CI Rescue & Health" section added with direct link to the new CI Rescue Pipeline doc. - Nav entry added (
mkdocs.yml): "CI Rescue & Health" section with CI Rescue Pipeline at top. - 8 CI scripts shipped (all under
scripts/ci/): ci_rescue.py— Pattern-analysis engine for structured RCA commentsauto_fix_common_issues.py— Auto-fix dispatcher for known CI failure patternssync_tracked_files.py— Tracked-files sync for.secrets.baseline/ CODEX_MANIFESTcheck_cross_references.py— Cross-reference validator with explicit URL allow-listcheck_pr_comments.py— PR comment reviewer with latency metricssession_bootstrap.py— Session pre-flight and cognitive-brain bootstrapgenerate_coverage_map.py— Multi-suite coverage map generator (coverage_map.json)check_deferral_language.py— Deferral-language gate for commits/PRs- New test file:
tests/ci/test_generate_coverage_map.py— unit tests for the coverage map generator (multi-suite merge, branch-rate calculation, edge cases).
Fixed (2025-12-16) - CI/CD Pipeline Restoration (PR #2509)¶
- Critical Build Fix: Fixed package directory mapping for
agentspackage: - Added
agents = "agents"to[tool.setuptools.package-dir]in pyproject.toml - Resolved "error: package directory 'src/agents' does not exist" blocking all CI jobs
-
Root cause:
agents/exists at repository root, not insrc/, but no mapping existed -
Workflow Fixes (7+ critical errors resolved):
scheduled-archival.yml: Fixed GITHUB_OUTPUT format (grouped outputs with count-first ordering)self-healing-feedback-loop.yml: Upgradedactions/upload-artifact@v3@v4(4 occurrences)optimized-ci.yml: Added missingpytest-splitdependency for test shardingaudit-improvement-pipeline.yml: Added filename sanitization for NTFS compatibility, removed invalid CLI argsdetect-duplicates.yml: Added PR context guards forworkflow_dispatchmanual runspre-release-deployment.yml: Upgradedactions/upload-artifact@v3@v4(6 occurrences)workflow-validator.yml: Fixed duplicate PR comment issue (now updates existing comments)-
decode-validate-artifact.yml: Upgradedactions/checkout@v3@v4 -
YAML Syntax Fixes (3 workflow files):
duplicate-detection-weekly.yml: Fixed Python heredoc parsing issuesbom.yml: Fixed heredoc YAML syntaxrepo-organization.yml: Fixed Python heredoc indentation
Added (2025-12-16) - Documentation & Tooling (PR #2509)¶
- GitHub Pages Workflow: New
pages-mkdocs.ymlfor MkDocs-based documentation deployment - Automatically builds and deploys documentation on push to main
-
Requires GitHub Pages source set to "GitHub Actions" (now configured)
-
Copilot Task Execution Protocol (CTEP): New protocol for comprehensive task completion
Copilot_Task_Execution_Protocol.md: Full protocol specificationCTEP_Usage_Examples.md: Comprehensive usage examplesCTEP_Quick_Reference.md: Quick reference card- Updated
copilot-instructions.mdwith CTEP activation logic - Activation commands: "Enable CTEP", "CTEP Mode: ON", "Task mode: ON"
Changed (2025-12-16) - CI/CD Improvements (PR #2509)¶
- All 45 workflow files now pass YAML validation (was 42/45)
- CI/CD Success Rate: 14% 100% (pending GitHub Pages manual config - now complete)
- Build Success Rate: 0% (12/12 failures) 100%
Unreleased¶
Added (2025-11-18) - MCP + ITA Integration (PR #2297)¶
- MCP Modules: Complete implementation of Model Context Protocol integration:
src/mcp/registry.py- Tool registry withMCPToolRegistry,compute_tool_checksum, and confirmation supportsrc/mcp/config.py- Configuration management withMCPConfig, environment variable overrides (ITA_URL,ITA_API_KEY)src/mcp/versioning.py- Protocol version negotiation withMCP_VERSIONSandnegotiate_version()-
Enhanced
src/mcp/errors.pywith JSON-RPC error code mappings (jsonrpc_codeattribute on all error classes) -
Test Coverage: Comprehensive MCP test suite with 200/200 tests passing (100% success rate):
- Registry tests (19), Config tests (7), Auth tests (26), Server tests (4)
- Protocol tests (24), Error handling tests (14), Schema validation tests (21)
- Tools integration tests (59), Multi-tenant tests (12), Observability tests (12)
- Core smoke tests (12), Integration tests (1)
Fixed (2025-11-18) - Security & Consistency (PR #2297)¶
- Security: Fixed principal_id entropy reduction vulnerability:
- Changed
Principal.from_credential()to use full 64-character SHA-256 hash instead of truncated 16 characters - Updated ITA app (
services/ita/app/main.py) to use complete hash for identity verification -
Eliminated entropy loss from 256 bits to 64 bits, restoring full cryptographic security
-
Naming Consistency: Standardized
Principalfield naming across codebase: - Changed all
Principal(id=...)toPrincipal(principal_id=...) - Updated test expectations for 64-character hash tokens
- Fixed authentication token format to use deterministic SHA-256 hashing
Changed (2025-11-18) - Code Quality (PR #2297)¶
- Code Quality: Applied comprehensive validation standards:
- Formatted all MCP modules with Black (zero formatting errors)
- Fixed all Ruff linting issues (zero linting errors)
- Added type annotations for Mypy compliance (8/8 source files passing)
-
Removed trailing whitespace and standardized code style
-
ITA Integration: Enhanced MCP error handling and rate limiting in ITA service:
- Added
MCPErrorexception handler with proper JSON responses - Implemented rate limiting using
MCPRateLimiter(5 req/sec, burst 20) - Improved error reporting with X-Request-Id headers
Added¶
- API docs generator:
--fail-on-missingflag for strict module checking in CI/CD workflows. When enabled, the build exits with code 3 if any requested modules are missing, allowing CI to enforce complete dependency installation. Default behavior remains graceful (non-strict) for local development. Return codes: 0=success, 2=no modules found, 3=strict failure. Module availability is checked usingimportlib.util.find_spec(). (PR #2118)
Fixed¶
- API docs generator: Include optional packages (
codex_ml,codex_ml.peft,codex_ml.distributed) in generated API documentation when optional dependencies are installed. Previously the script documented onlycodex.cliandcodex.loggingeven whencodex_mlwas available, preventing the main ML API from appearing in generated docs. The script now dynamically includes optional modules by default and logs the final module list for visibility. (PR #2118)
Changed¶
- API docs generator:
filter_modules()now returns a tuple(available_modules, missing_modules)instead of just a list, enabling better tracking of module availability for strict mode checks. - API docs generator: Module availability checks use
importlib.util.find_spec()to determine if modules can be imported without actually loading them into memory, improving efficiency for large packages.
Added (continued)¶
- Safety: training and evaluation CLIs honor new
sanitize_promptsflags and sanitize inline datasets by default. - Checkpointing: PEFT/LoRA adapters are bundled alongside standard model
weights, enabling seamless resume when
peftis available. - Tooling:
tools/validate_configs.pyvalidates Hydra configs against JSON/YAML schemas and is wired into thenox -s gatessession. - Tooling:
tools/ndjson_to_csv.pyconverts metrics logs to CSV; sample data lives atsamples/metrics_sample.ndjson. - Plugins: opt-in entry-point discovery via
plugins.enable_entry_pointsand config-driven group overrides. - Tooling: Documented fence validator architecture and added focused tests covering default returns, skip lists, and warn-mode output.
Fixed (2025-11-19) - Metrics¶
- BLEU brevity penalty: Corrected corpus BLEU brevity penalty logic in
src/codex_ml/metrics/generation.pyto iterate over hypotheses and their reference sets in lockstep, preventingnorm_refs.index(refs)from pairing multiple references with the first hypothesis when reference lists are reused. - Regression tests: Added
tests/metrics/test_bleu_brevity_penalty.pyto reproduce the misalignment, assert the fixed penalty, and validatecompute_corpus_bleu()precision. - Impact: BLEU scores for corpora that reuse or duplicate reference lists
will now reflect the correct brevity penalty and may change relative to prior
(buggy) calculations. A migration/email template for model owners lives at
docs/migrations/bleu_brevity_penalty_migration.mdto guide downstream threshold updates.
2025-10-26¶
Added¶
- Operational templates (v0.2.0): Introduced Python File Relocation, CLI Hardening, and Intent Validation templates under
docs/templates/with a navigation index. - Files:
docs/templates/Migration_PythonFileRelocation.md,docs/templates/Migration_CLIHardening.md,docs/templates/Planning_IntentValidation.md,docs/templates/README.md - Include role-gated workflows,
[PLACEHOLDER: …]customization prompts, and cross-references to runtime shims (sitecustomize.py), CLI modules, and pytest suites. - Documentation: Extended
docs/README.mdwith usage triggers and a handoff checklist for the templates, and refresheddocs/CONTRIBUTING.mdwith a role-based workflow plus a task-to-template mapping table. - Tests: Added
tests/templates/test_template_discovery.pyandtests/templates/test_template_structure.pyto verify template presence, metadata, and required sections.
Notes¶
- No GitHub Actions were created or modified.
- Hooks are local-only and optional to run in CI.
2025-10-26 (Self-management)¶
Added¶
- Local status reporter:
tools/status_report.pyto run gates and emitSTATUS_REPORT.md.- Docs in
docs/ops/status_reports.mdand template indocs/templates/status_update.md. - Manual pre-commit hook
codex-status. - Tests under
tests/status/. - selection_report.py: local-only candidate scoring & guard enforcement with rationale; produces
SELECTION_REPORT.md. - pre-commit (manual):
codex-selectionhook to run the selection report. - docs:
docs/ops/selection_reports.mdusage guide; link from README. - tests: selection smoke test on the sample summary.
- nox:
statussession to render a status report in template mode. - .editorconfig: unify line endings and indentation.
Enhanced¶
tools/status_report.py- Added
--templaterich rendering, local repo scan heuristics, and capability table support. - Added
--verboseto embed stdout/stderr and--save-logsto persist tool output under.codex/status/. - Report footer now notes saved artifacts when applicable.
- Optional section to embed a condensed selection summary when
--summaryis provided. - Documentation
- Expanded
docs/ops/status_reports.mdwith verbose/artifact usage details. - README quickstart now calls out offline-first setup and status reporting flags.
- Cross-links selection and status flows; clarified generated artifacts.
Fix¶
- Evaluator DX: emit a friendly installation hint when optional dependencies such as
pydanticortyperare missing. - Minor typos and normalized headings in ops docs.
Added¶
requirements-dev.txtwith local dev tools.noxfile.pysessions:gates,tests,precommit.- Updated
docs/ops/local_gates.mdand added ADR for self-management.
2025-10-25