Leaderboard/Research/PaperOrchestra
Last commit on July 13, 2026·Created on April 9, 2026

Ar9av/PaperOrchestra

An automated pipeline for drafting and refining academic research papers through simulated peer review.
Combined rank
#447
across all skills
In Research
#24
category rank
Stars
661
+1.1% in last 7d
Forks
92
0.0% in last 7d
Watchers
3
0.0% in last 7d
Traction scoreGitHub stars can be faked, so popularity alone can be misleading. Traction Score looks for broader signs of recent attention, adoption, and active maintenance.
TL;DR

PaperOrchestra provides a structured framework for AI research scientists to automate the drafting of academic papers. It transforms raw experimentation logs into formal manuscripts by iteratively refining LaTeX drafts through a simulated peer review process.

The system employs deterministic decision bands and a devil's advocate guard to ensure critical findings are resolved before a draft is accepted, maintaining detailed worklogs and snapshots for every iteration.

WHO IT'S FOR
AI research scientists
automate the drafting of academic papers
Coding agent power users
convert agent logs into research inputs
ML engineers
aggregate experimentation logs for documentation
AI agent / automation builders
implement multi-agent research pipelines
Repository contents

9 skill files

Compatible AgentsThe repository documents support for these agents. The skills may also work with other agents that can load SKILL.md files, but they may need some setup or small changes.

Use this skill collection

Follow the documented setup, then try a first task.

Setup

Automated setup for supported agents

Installs: Complete nine-skill PaperOrchestra bundle, installed into repository-local and global agent skill directories. · Claude Code, Cursor, Windsurf, Antigravity, Gemini, Codex, OpenClaw, OpenCode, Factory Droid

Before you start
  • Git
  • Bash
  • Python 3.10+ with pip
  • pdflatex for pipeline PDF compilation (texlive-latex-recommended and texlive-latex-extra)
  • matplotlib
  • numpy

Run from: ~/paper-orchestra

  1. In a terminal, replace the literal <this repo> placeholder with the PaperOrchestra repository URL, clone the repository into ~/paper-orchestra, enter that directory, and install the deterministic helper requirements.

    git clone <this repo> ~/paper-orchestra
    cd ~/paper-orchestra
    pip install -r requirements.txt   # deterministic helpers only
  2. From the repository root, run the setup script in a terminal. It prompts for optional Semantic Scholar, Exa, and Tavily API keys and a PaperBanana executable path; leave a prompt blank to skip it. The script installs all nine skills into the documented local and global agent directories.

    bash setup.sh
README.md · Checked Sep 18, 2026examples/agentic-security-report/README.md · Checked Sep 18, 2026setup.sh · Checked Sep 18, 2026

Give it something to do.

Suggested first task

Generate and validate a paper outline

Uses outline-agent

  • [workspace path] containing workspace/inputs/idea.md
  • workspace/inputs/experimental_log.md
  • workspace/inputs/template.tex
  • workspace/inputs/conference_guidelines.md

Check the repository for this skill’s setup.

Use the outline-agent skill on [workspace path]. Read workspace/inputs/idea.md, experimental_log.md, template.tex, and conference_guidelines.md; generate workspace/outline.json with its plotting, literature-review, and section plans; validate the JSON; and stop before Steps 2 and 3.
skills/outline-agent/SKILL.md · Checked Sep 18, 2026
Suggested first task

Extract a sparse benchmark idea from a paper

Uses paper-writing-bench

  • [paper PDF or extracted markdown]
  • [paper_id] used for the output directory

Check the repository for this skill’s setup.

Use the paper-writing-bench skill on [paper PDF or extracted markdown] for benchmark ID [paper_id]. As a first result, create bench/[paper_id]/idea_sparse.md with the four documented sections, stopping before empirical verification and excluding citations, URLs, author identities, LaTeX math, and experimental results.
Suggested first task

Score one paper's literature review

Uses paper-autoraters

  • [paper PDF or text]
  • [reference average citation count]

Check the repository for this skill’s setup.

Use the paper-autoraters skill's Literature Review Quality autorater on [paper PDF or text] with [reference average citation count]. Return the documented JSON assessment with axis_scores, penalties, summary, and overall_score; do not compare it with another paper.
skills/paper-autoraters/SKILL.md · Checked Sep 18, 2026