Skip to content

docs: align README and design docs with current architecture - #249

Open
dhuzard wants to merge 15 commits into
openscientist-io:mainfrom
dhuzard:main
Open

dhuzard wants to merge 15 commits into
openscientist-io:mainfrom
dhuzard:main

Conversation

@dhuzard

@dhuzard dhuzard commented Jul 24, 2026 •

Copy link
Copy Markdown

Summary

Updates project documentation to reflect the current OpenScientist implementation.

  • Documents the Claude Code, Codex, and OMP agent harnesses.
  • Documents all registered providers, including vLLM and llama.cpp.
  • Explains that harness selection is orthogonal to provider selection.
  • Describes PostgreSQL-backed knowledge state.
  • Updates the agent, MCP server, execution broker, and executor-container architecture.
  • Refreshes the repository structure and configuration guidance, including the job manager and Makefile.
  • Reconciles the README and design-document MCP tool lists.
  • Corrects the bundled Phenix skill name and removes outdated claims about planned Codex and pluggable-skill support.
  • Replaces broken Vertex and Phenix setup links with existing resources.

The contributor branch was synced with current upstream main without a force-push. The final diff against current upstream main remains limited to README.md and docs/DESIGN.md.

Validation

  • uv run --frozen pre-commit run --files README.md docs/DESIGN.md
  • git diff --check
  • Audited every relative Markdown link in README.md and docs/DESIGN.md; all resolve.
  • Verified the newly documented repository and built-in skill paths exist.

The full GitHub Actions workflow requires maintainer approval because this PR originates from a fork.

…nd support details

test(docs): add test for broken repository-relative links in documentation
Comment thread tests/test_documentation_links.py Outdated
dhuzard and others added 10 commits July 28, 2026 13:00
- Implemented the Skill Creator page to guide users through creating and validating skills.
- Introduced UI components for defining task contracts, reviewing drafts, and accepting/exporting skills.
- Added backend logic for skill validation and draft generation using AI.
- Created tests for skill authoring and evidence librarian functionalities to ensure reliability.

test: Add unit tests for skill authoring and evidence librarian

- Developed comprehensive tests for skill authoring, including validation and draft generation.
- Implemented tests for evidence planning, approval, and skill composition to ensure correct behavior.
- Added behavioral tests for the Skill Creator page to validate user input requirements and export conditions.
feat: add skill authoring studio and Evidence Librarian
feat: add controls for active jobs
…nd support details

test(docs): add test for broken repository-relative links in documentation
@dhuzard dhuzard closed this Aug 26, 2026
@dhuzard dhuzard reopened this Aug 26, 2026
@dhuzard

dhuzard commented Aug 26, 2026

Copy link
Copy Markdown
Author

@LucaCappelletti94 I refreshed this PR onto current main without force-pushing and addressed the prior review by keeping link checking out of pytest. The final diff is now limited to README.md and docs/DESIGN.md, updated for Claude Code, Codex, OMP, all registered providers, and the current container architecture. Local lockfile, Ruff lint/format, and diff checks pass. Could you please re-review and approve the fork workflow run? GitHub currently marks CI as action_required pending maintainer approval.

@sonarqubecloud

sonarqubecloud Bot commented Sep 2, 2026

Copy link
Copy Markdown

@codacy-production

Copy link
Copy Markdown
Contributor

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

AI Reviewer: first review requested successfully. AI can make mistakes. Always validate suggestions.

Run reviewer

TIP This summary will be updated as you push new changes.

@codacy-production codacy-production Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

The documentation updates successfully reflect the architectural shift to a PostgreSQL-backed, containerized multi-agent system. However, the PR is not yet ready for merging due to significant inconsistencies between the visual project structure and the actual commands provided for installation and execution. Most notably, the removal of the 'Makefile' and the 'job_manager' module from the README tree will lead to user confusion given their presence in bootstrap and build instructions.

Furthermore, the 'DESIGN.md' file introduces a 15-minute auto-continuation policy in Coinvestigate Mode which poses a safety and budget risk for users who expect a human-in-the-loop pause. Lastly, the README references several auxiliary documentation files that are not included in this commit, creating broken links. While Codacy results are up to standards, these alignment issues constitute an implementation gap relative to the goal of synchronizing documentation with the current state.

About this PR

  • The documentation claims to align the current architecture but introduces references to 'docs/DEPLOYMENT.md' and 'docs/SECURITY_REVIEW.md' which are not included in the repository or this PR.
2 comments outside of the diff
README.md

line 188 🟡 MEDIUM RISK
The bootstrap command references 'openscientist.job_manager', which is not listed in the new project structure (lines 104-115). If the module has been moved or replaced, the documentation for this command must be updated to prevent execution errors.

docs/DESIGN.md

line 137 🟡 MEDIUM RISK
The 15-minute auto-continuation policy for Coinvestigate Mode presents a safety and budget risk. Users selecting this mode typically expect the agent to remain paused until explicit authorization is provided. Consider making this timeout configurable or requiring manual intervention to proceed.

Test suggestions

  • Verify harness auto-selection logic correctly maps providers to harnesses (e.g., Anthropic to Claude Code)
  • Verify execute_code tool correctly handles Rust and SPARQL execution within the executor container
  • Validate PostgreSQL schema migrations for the knowledge_state (findings, hypotheses, literature)
  • Confirm OMP harness functionality with non-vLLM/llama.cpp providers when explicitly selected
  • Verify agent container egress policy correctly isolates jobs while allowing model provider access
Prompt proposal for missing tests
Consider implementing these tests if applicable:
1. Verify harness auto-selection logic correctly maps providers to harnesses (e.g., Anthropic to Claude Code)
2. Verify execute_code tool correctly handles Rust and SPARQL execution within the executor container
3. Validate PostgreSQL schema migrations for the knowledge_state (findings, hypotheses, literature)
4. Confirm OMP harness functionality with non-vLLM/llama.cpp providers when explicitly selected
5. Verify agent container egress policy correctly isolates jobs while allowing model provider access

TIP Improve review quality by adding custom instructions
TIP How was this review? Give us feedback

Comment thread README.md
Comment thread README.md
Comment thread README.md Outdated
@dhuzard

dhuzard commented Sep 8, 2026

Copy link
Copy Markdown
Author

Review feedback is addressed in e4ac180:

  • Synced the contributor branch with current upstream main without force-pushing.
  • Added job_manager.py and Makefile to the README project tree.
  • Reconciled the README and DESIGN MCP coverage (read_document, save_iteration_summary, and parse_alphafold_confidence).
  • Corrected the built-in skill slug to phenix-tools-reference and refreshed the Codex wording/design date.
  • Confirmed that docs/DEPLOYMENT.md and docs/SECURITY_REVIEW.md exist and that every relative link in the edited documents resolves.
  • Left the documented 15-minute Coinvestigate timeout unchanged because it accurately reflects the current implementation; changing that runtime policy belongs in a separate behavior-focused issue/PR.

The final diff against current upstream main is still documentation-only (README.md and docs/DESIGN.md). Document-relevant pre-commit hooks and git diff --check pass, and Codacy is green.

@LucaCappelletti94, could you please re-review to clear the earlier changes-requested state? A maintainer also needs to approve the fork workflow run: https://github.com/openscientist-io/openscientist/actions/runs/34217543741

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants