Skip to content

docs(peekaboo): harden Jarvis automation rules#895

Draft
artemgetmann wants to merge 1 commit into
mainfrom
codex/peekaboo-skill-gui-plan-20260610
Draft

docs(peekaboo): harden Jarvis automation rules#895
artemgetmann wants to merge 1 commit into
mainfrom
codex/peekaboo-skill-gui-plan-20260610

Conversation

@artemgetmann

Copy link
Copy Markdown
Owner

Review Fast Path

  • User path fixed: Jarvis-style agents using Peekaboo for GUI automation now get explicit safe defaults for targeting, paste, analysis, and coordinate use.
  • Proof: peekaboo --version, brew info steipete/tap/peekaboo, targeted Peekaboo command help checks, pnpm dlx markdownlint-cli2 skills/peekaboo/SKILL.md, git diff --check origin/main...HEAD.
  • Shared-state footgun removed: skill now rejects unscoped focus-dependent actions and documents that --analyze needs separate Peekaboo provider config instead of inheriting Jarvis/Codex model context.
  • Still hurts: bigger GUI runtime bakeoff is intentionally not implemented in this PR.

Why This Matters

  • The bad run failed from ordinary automation mistakes: unscoped actions, unsafe coordinate translation, and assuming Peekaboo AI analysis had provider context.
  • This makes the bundled Peekaboo skill teach the safer Jarvis operating path first.

Scope Boundary

  • Changed only skills/peekaboo/SKILL.md.
  • Did not edit the user-level skill at /Users/user/.agents/skills/peekaboo/SKILL.md.
  • Did not restart, deploy, or touch shared runtime.
  • Did not implement the later GUI runtime bakeoff.

Verification

  • peekaboo --version -> Peekaboo 3.1.2 (main/3f1ea6dd, built: 2026-05-11T06:50:44+01:00).
  • brew info steipete/tap/peekaboo -> installed 3.1.2, stable upgrade path 3.3.0.
  • peekaboo paste --help, click --help, see --help, image --help confirmed relevant flags.
  • Extra example flags checked with peekaboo press --help, hotkey --help, drag --help, scroll --help, type --help.
  • pnpm dlx markdownlint-cli2 skills/peekaboo/SKILL.md -> Summary: 0 error(s).
  • git diff --check origin/main...HEAD -> passed with no output.

AI Assistance

  • AI-assisted
  • Testing degree: targeted

- What: add Jarvis-safe Peekaboo targeting, paste, analysis, and coordinate rules to the bundled skill.
- Why: prevent focus drift, Retina coordinate mistakes, and accidental reliance on Peekaboo AI provider state during GUI automation.
- Risk: docs-only change; validation covered markdown lint and whitespace checks.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant