Weaving cosmic threads...
Weaving cosmic threads...
Supabase + pgvector are live. Rest is planned.
Markdown + JSONML + pgvector HNSW work today inside Arcanea. Arweave, S3, Google Drive, Syncthing, and Obsidian export arrive through Q2 2026 as part of the ingestion workstream.
Storage & Knowledge Graph
Markdown + JSONML for content. pgvector for semantic search. Your choice of backend — Supabase, Arweave, S3, Google Drive, or local files. Open standards top to bottom.
Markdown + JSONML
Open formats
pgvector HNSW
Semantic index
150x faster
vs keyword search
Obsidian native
Sync compatible
The storage stack
From raw markdown to semantic retrieval — every layer is open, inspectable, and replaceable.
Layer 01
Markdown + JSONML
Every chapter, character, world note, and dialogue is stored as plain Markdown with YAML frontmatter. Structured nodes use JSONML — a superset that keeps human readability while adding typed edges.
Layer 02
Frontmatter + Linked Data
Frontmatter carries structured metadata: gate, type, tags, relationships. Linked-data triples let you query across worlds with SPARQL-style selectors. Machines read it; humans edit it.
Layer 03
pgvector + HNSW
On every save, content is embedded using your model of choice (text-embedding-3-large, Gemini, or local). Stored as pgvector in Supabase. HNSW indexing makes retrieval sub-12ms at any scale.
Layer 04
HNSW Graph
The Hierarchical Navigable Small World graph sits over your vectors. Approximate nearest-neighbor search that stays fast as your world grows — from 100 nodes to 1M+.
Layer 05
Semantic + Graph Queries
The query layer combines semantic similarity with graph traversal. Ask 'what characters are linked to this location across all my worlds?' and get typed, ranked results in milliseconds.
Where your data lives
Start with Arcanea Cloud, migrate to self-hosted when you're ready, or go fully on-chain. Your data travels with you.
Zero setup. Zero compromise.
Managed Supabase under the hood. Postgres + pgvector fully configured, backups running, row-level security enforced. BYOK for AI — we never train on your content.
Your schema, your instance.
Clone our open-source schema and run your own Supabase instance. Completely independent. Point Arcanea at your Supabase URL and anon key — everything works.
Your disk. Your rules.
Export your entire vault as a folder of Markdown and JSONML files. Sync with Syncthing, iCloud Drive, or just git. Works in Obsidian natively.
Permanent. Verified. Cross-world.
Publish worlds, characters, or entire vaults to Arweave for permanent storage. IPFS for content-addressed retrieval. Signed with your wallet for cryptographic provenance.
File formats
Every file you create is stored in open formats. No proprietary lock. Export, edit, move, or delete with zero friction.
Every piece of content is plain Markdown with YAML frontmatter. Human-writable, version-controllable, readable in any editor.
---
type: character
name: Kael Dawnstrider
gate: Source
element: Wind
faction: Starlight Corps
relationships:
- { target: "Rina Ashveil", type: "ally" }
- { target: "The Vault", type: "home" }
tags: [detective, wind-user, lore-anchor]
created: 2026-04-14
---
# Kael Dawnstrider
Former intelligence analyst turned rogue archivist. Kael carries
a fractured Source shard — enough to read memory echoes, not
enough to stay sane doing it.
## Abilities
- Echo Reading — touch an object and see its last 3 owners
- Wind-Skip — short teleport using ambient air currents
- Signal Null — block remote sensing within 10m radius
Sync across tools
Write in any tool, sync through any path, search through everything — the semantic layer handles the rest.
Write in Arcanea, Obsidian, your plain text editor, or even Notion. Everything uses open Markdown with structured frontmatter — any tool can author.
Point Syncthing, iCloud Drive, or git at your vault folder. Arcanea watches for changes and re-embeds anything new or updated. Conflict-free merge via CRDT-style timestamps.
pgvector indexes it all into the semantic layer within seconds. Ask anything across your entire world graph — characters, locations, events — and get ranked, relevant results.
Compatible sync methods
Integrations
Arcanea storage works with the tools you already use. Supabase, Notion, Google Drive, Obsidian, git — all first-class.
Storage + sync tools
Obsidian
Vault + plugin
Syncthing
P2P sync
Logseq
Graph import
Arweave
Permanent store
Infrastructure
Vercel
Production hosting
Supabase
DB + Auth + pgvector
Vercel AI SDK
Chat streaming
Notion
Docs sync
Linear
ARC project sync
Google Drive
Studio ingestion
Obsidian
Vault sync
Stripe
x402 preferred first
Performance
pgvector with HNSW indexing — the same engine powering production AI apps at billions of embeddings.
150x
faster vs keyword search
12ms
avg semantic query latency
4x
memory reduction w/ quantization
1M+
vectors indexed per world
Hierarchical Navigable Small World graph achieves O(log n) search — stays fast whether you have 1,000 or 10,000,000 vectors.
Float32 embeddings compressed to Float16 via pgvector's built-in quantization. Same recall, half the storage, 2x cache utilization.
BM25 keyword search + cosine similarity combined with RRF fusion. Every query uses both pathways and ranks the merged result.
PgBouncer handles up to 10,000 concurrent connections per world. No cold starts. No connection exhaustion.
Your backup, your rules
Arcanea never holds your data hostage. Export, backup, version, or delete on your terms.
Point to any S3-compatible bucket — Cloudflare R2, AWS S3, Backblaze B2. Backups run on your schedule with AES-256 encryption at rest.
One click to download your entire world — every character, chapter, asset, and metadata — as a structured .zip you can open in any editor.
Every save can push a commit to your GitHub repo. Full diff history, branching, rollback — your worlds get full software-grade version control.
When you delete content, it is gone. No 30-day retention. No shadow backups. Cascade deletes remove embeddings, metadata, and linked data immediately.
Open source
The entire storage schema, embedding pipeline, and sync protocol is MIT licensed on GitHub. Fork it, extend it, run it on your own infrastructure.
github.com/frankxai/arcaneaOpen. Sovereign. Yours.
Start with Arcanea Cloud, migrate to your own Supabase, sync to your Obsidian vault, or publish to Arweave. Open standards all the way down.
MIT licensed core. No vendor lock-in. Export anytime.