relayers new code

docs/indexation.md

@@ -38,4 +38,60 @@ values:^[
 2. User uploads content cover to server (/api/v1/storage)
 3. User send /api/v1/blockchain.sendNewContentMessage to server and accept the transaction in wallet
 4. Indexer receives the transaction and indexes the content. And send telegram notification to user.
+# Network Index & Sync (v3)
+
+This document describes the simplified, production‑ready stack for content discovery and sync:
+
+- Upload via tus → stream encrypt (ENCF v1, AES‑GCM‑SIV, 1 MiB chunks) → `ipfs add --cid-version=1 --raw-leaves --chunker=size-1048576 --pin`.
+- Public index exposes only encrypted sources (CID) and safe metadata; no plaintext ids.
+- Nodes full‑sync by pinning encrypted CIDs; keys are auto‑granted to trusted peers for preview/full access.
+
+## ENCF v1 (Encrypted Content Format)
+
+Unencrypted header and framed body; same bytes on all nodes ⇒ stable CID.
+
+Header (all big endian):
+
+```
+MAGIC(4):  'ENCF'
+VER(1):    0x01
+SCHEME(1): 0x01 = AES_GCM_SIV (0x02 AES_SIV legacy)
+CHUNK(4):  plaintext chunk bytes (1048576)
+SALT_LEN(1)
+SALT(N)
+RESERVED(5): zeros
+```
+
+Body: repeated frames `[p_len:4][cipher][tag(16)]` where `p_len <= CHUNK` for last frame.
+
+AES‑GCM‑SIV per frame, deterministic `nonce = HMAC_SHA256(salt, u64(frame_idx))[:12]`, AAD unused.
+
+## API
+
+- `GET /api/v1/content.index` → `{ items:[...], schema, ETag }` with signed items.
+- `GET /api/v1/content.delta?since=ISO8601` → `{ items:[...], next_since, schema }` with ETag.
+- `POST /api/v1/sync.pin` (NodeSig required) → queue/pin CID.
+- `POST /api/v1/keys.request` (NodeSig required) → sealed DEK for trusted peers.
+- `GET /api/v1/content.derivatives?cid=` → local ready derivatives (low/high/preview).
+
+## NodeSig
+
+Canonical string:
+
+```
+METHOD\nPATH\nSHA256(body)\nTS\nNONCE\nNODE_ID
+```
+
+Headers: `X-Node-Id`, `X-Node-Ts`, `X-Node-Nonce`, `X-Node-Sig`.
+Window ±120s, nonce cache ~10min; replay → 401.
+
+## Sync daemon
+
+- Jitter 0–30s per peer; uses ETag/`since`.
+- Disk watermark (`SYNC_DISK_LOW_WATERMARK_PCT`) stops pin burst.
+- Pinned concurrently (`SYNC_MAX_CONCURRENT_PINS`) with pre‑`findprovs` `swarm/connect`.
+
+## Keys policy
+
+`KEY_AUTO_GRANT_TRUSTED_ONLY=1` — only KnownNode.meta.role=='trusted' gets DEK automatically. Preview lease TTL via `KEY_GRANT_PREVIEW_TTL_SEC`.