Personal Agent OS map · 2026-05-14

Connor’s compounding brain stack

A visual map of the live system: Hermes as the operator, GBrain as the durable knowledge graph, the brain repo as source-of-truth markdown, crons as habits, systemd as always-on infrastructure, and custom CLIs as capability surfaces.

Hermes gateway running via systemdGBrain MCP connected privatelyAudio memory live capturedocs.cforsyth.com publishing16 active crons
102GBrain pages
208embedded chunks
228graph links
47timeline entries
89/100brain score

1. System shape at a glance

The system is best understood as six loops. The user interfaces create signal; Hermes interprets and acts; tools/skills/CLIs expand action space; GBrain stores durable truth; crons/systemd keep the loops running; docs and Telegram/SMS surface the results.

InterfacesSMS · Telegram Voice + mediaTwilio streamsYouTube URLs Hermes Agentgateway · tools · skillsSOUL.md signal rulesmemory hot contextdelegation + terminalcron scheduler GBrain/root/gbrainMCP: gbrain servePostgres + pgvectorhybrid search + graph Brain repo/root/brain markdownsource of truth Automation16 active cronssystemd serviceswatchdogs + reports Custom CLIsyoutube-memoryPrinting Press skillssaas deploy tooling OutputsTelegramSMSdocs sitedaily briefsvalue reports Operating principleHot memory stays compact inside Hermes; cold memory compounds in GBrain; raw evidence lives in source pages; crons extract links, facts, salience, timelines, and reports.

2. The memory stack

Hot memory: Hermes

Small always-injected profile and notes.

  • User preferences, stable identity, environment facts.
  • Capacity-limited by design: fast context, not a database.
  • Rejected eligible memories fall back into GBrain inbox pages.

Cold memory: GBrain

Durable graph + vector search.

  • Pages, chunks, embeddings, typed links, timelines, facts.
  • Brain-first reads before answering about people, projects, companies, concepts.
  • MCP private mode: GBRAIN_STDIO_PRIVATE=1.

Source truth: /root/brain

Git-tracked markdown corpus.

  • People, companies, projects, concepts, originals, sources, inbox.
  • GBrain imports, embeds, extracts links/timelines from it.
  • Current source registered as default.

3. Capture and compounding flows

Conversation signal

SMS/Telegram messages hit Hermes. SOUL rules detect original thinking, entities, preferences, commitments, and stable facts.

Immediate use

Hermes queries GBrain before answering and uses skills/tools/terminal/CLIs to act.

Durable write

Important facts become GBrain facts, pages, links, timeline entries, or brain repo markdown.

Maintenance loop

Crons sync, import, embed, extract links/timelines, repair health, and produce salience/value reports.

4. Live infrastructure map

LayerWhat is liveRole
Hermes gatewaysystemd user service: hermes-gateway.serviceMessaging ingress/egress, tool execution, MCP child lifecycle, long-running agent interface.
GBrain MCP/root/.bun/bin/gbrain serve child processExposes query, search, page, link, timeline, fact, source, health, job tools into Hermes.
Audio memory APIsystem service: audio-memory-api.service on localhost:8088Twilio Voice Media Streams capture endpoint behind Caddy at capture.cloopos.com.
Audio live workeraudio_memory.cli live run --loopChunked local STT loop over recent audio windows.
Docs hostCaddy + /var/www/docs-cforsythPublishes visual briefs and system docs at docs.cforsyth.com.
System registry/projects/model/deploy/services.jsonDefines domains, static roots, backend ports, websocket flags, environments.

5. Scheduled habits

GBrain crons

gbrain-sync every 15mcompound maintenance every 6hdream cycle dailyauto-update weeklyweekly value report

These keep the graph indexed, linked, embedded, audited, and narratively useful.

Audio crons

watchdog 15mlive worker watchdog 5malerts 5mdaily brief 08:15daily reflection 20:00

These monitor capture health, live STT, and surface personal black-box memories.

Operator crons

morning systems briefingmarket digestcodex usageHermes self-heal

These make the stack self-reporting: status, usage, external signal, and failures.

6. Capabilities and extension surfaces

Skills are procedural memory

There are broad installed skill families: autonomous agents, GBrain, audio/youtube, Printing Press, GitHub, SaaS docs publishing, architecture diagrams, research, devops, and productivity. Skills tell Hermes how to do recurring workflows correctly.

CLIs are fast API surfaces

Live/discovered CLIs include hermes, gbrain, youtube-memory, SaaS deploy tooling, and Printing Press binaries under /root/go/bin/*-pp-cli.

MCP makes tools native

GBrain is configured as a native MCP server, so search/query/page/fact/health operations appear as direct Hermes tools rather than shell-only commands.

Registry makes deployment legible

The SaaS Factory registry maps domains to static roots and backend ports. Current relevant entries include docs.cforsyth.com → /var/www/docs-cforsyth and capture.cloopos.com → ports 8091 and 8088.

7. Audio and media memory

Phone callTwilio streamCaddycapture.cloopos.comAudio APIlocalhost:8088Local STTfaster-whisperGBrainsources/audioYouTube URLcaptions firstyoutube-memoryCLI pipelineFallbackyt-dlp + whisperRawtranscript pagesReviewcandidate inbox

8. Current health and known edges

Healthy

  • 100% embedding coverage.
  • 0 missing embeddings.
  • 0 dead links.
  • Schema version current; RLS enabled.

Watch

  • Doctor reports warnings: one double-encoded files.metadata row and one frontmatter issue.
  • Timeline coverage is useful but still a growth area.
  • One health surface reported an orphan count mismatch; CLI health after repair reported clean.

Extensibility

  • Add a new source collector.
  • Write raw evidence to /root/brain.
  • Import/embed/extract into GBrain.
  • Add a cron or webhook to make it habitual.
  • Expose high-friction APIs as CLIs or MCP.
Mental model: don’t treat this as one app. It is an agent operating system: interfaces → agent → tools → durable graph → scheduled reflection → surfaced outputs.

9. Suggested next upgrades

Observability console

A single docs/admin page that shows gateway status, GBrain health, cron outcomes, audio capture health, current model/provider, and recent salience.

Integration registry

A machine-readable registry for every ingestion loop: owner, source, storage path, cron, output, failure mode, and next review date.

Capability browser

Generate a searchable page of installed skills and CLIs so you can see “what can Hermes do for me right now?”

Generated from live system inventory, GBrain stats/health, Hermes config/status, cron list, services registry, systemd state, and installed skill/CLI surfaces. Secrets intentionally omitted.