Files
Warp/server/internal/storage/federation.go
T
tajniak81andClaude Opus 5.5 6aaf554336
CI / Test (ubuntu-latest) (push) Canceled after 0s
CI / Test (windows-latest) (push) Canceled after 0s
CI / Storage tests on PostgreSQL (push) Canceled after 0s
CI / Complement (federation off) (push) Canceled after 0s
CI / golangci-lint (push) Canceled after 0s
CI / Smoke test the binary (push) Canceled after 0s
Phase 5: federation
Implements PLAN.md Phase 5: the Server-Server API. Warp joins rooms on
other servers and lets their users join its rooms, invites across servers
with the invitee's server countersigning, rejects remote invites (locally
if the inviter is unreachable), and exchanges events, typing, receipts and
to-device messages with other homeservers — all behind the runtime switch,
which now starts and stops real outbound traffic.

The protocol lives in internal/federation with no knowledge of rooms:
X-Matrix signing (fuzzed parser), the spec's discovery algorithm keeping
the dial address and the TLS name apart, a signed client that refuses
every request while the switch is off or the policy denies the
destination, and a key ring that caches other servers' keys for at most a
week, with optional notaries.

The roomserver takes events from elsewhere through the spec's intake:
signatures and hashes (a hash mismatch keeps the redacted form), the rules
against the event's own auth events, against the state before it — with
/get_missing_events for small gaps and /state_ids for wide ones — and
against the current state, where a failure is a soft failure. Events held
without their state are outliers: a column on roomserver_events, because
the current state of a room joined over federation is almost all
outliers, and excluded from every timeline query. Forks are resolved at
the room's head. Membership across servers is make_join/send_join,
make_leave/send_leave and countersigned invites, in both directions;
m.room.server_acl is enforced on everything another server sends.
History before a remote join is backfilled when /messages pages past it,
stored at negative stream positions.

internal/federationapi is the running component: the inbound endpoints,
and an outbound queue that persists what it owes each destination, sends
it in transactions of 50 PDUs and 100 EDUs, backs off from ten seconds to
six hours, survives restarts, and drops events persisted while federation
is off rather than delivering a backlog in one burst. Its Module is what
the switch starts and stops.

Also: a TLS listener for port 8448, trusted key servers, key validity and
an outbound CA bundle in the config; per-destination health and backoff
reset in the admin API; remote profiles, aliases and directories in the
Client-Server API; a Complement federation profile. See
docs/federation.md, including its known gaps (no partial-state joins, no
key rotation).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-16 17:14:20 +02:00

124 lines
3.8 KiB
Go

package storage
import "context"
// ServerKey is one signing key of another server, as its key server or a
// notary reported it.
type ServerKey struct {
ServerName string
// KeyID is the full identifier, algorithm included: "ed25519:abc".
KeyID string
// PublicKey is the unpadded base64 key, as it is on the wire.
PublicKey string
// ValidUntilTS is how long the server vouched for the key, in
// milliseconds since the epoch.
ValidUntilTS int64
// ExpiredTS is when the server stopped signing with the key, for one
// it listed as an old_verify_key; zero for a key still in use.
ExpiredTS int64
FetchedAtMS int64
}
// The kinds of item in the outbound queue.
const (
QueueKindPDU = "pdu"
QueueKindEDU = "edu"
)
// QueuedItem is one PDU or EDU waiting for a destination.
type QueuedItem struct {
// ID is assigned by Enqueue and orders a destination's items.
ID int64
Destination string
// Kind is QueueKindPDU or QueueKindEDU.
Kind string
// RoomID and EventID describe a PDU, for logs and the admin API.
RoomID string
EventID string
// Payload is the JSON that goes on the wire.
Payload []byte
QueuedAtMS int64
}
// Destination is the delivery health of one remote server.
type Destination struct {
ServerName string
// Failures is how many sends in a row have failed. Zero is a healthy
// destination.
Failures int
// RetryAtMS is when the next attempt may be made; zero means now.
RetryAtMS int64
LastSuccessMS int64
LastFailureMS int64
LastError string
}
// DestinationSummary is a destination with the size of its queue, for the
// admin API.
type DestinationSummary struct {
Destination
QueuedPDUs int
QueuedEDUs int
}
// FederationStore persists what federation needs to survive a restart:
// other servers' keys, the outbound queue, the per-destination backoff and
// the log of inbound transactions.
type FederationStore interface {
// StoreServerKeys inserts or replaces keys. A key already stored is
// overwritten with the newer report of it.
StoreServerKeys(ctx context.Context, keys []ServerKey) error
// ServerKeys returns the stored keys of a server. An empty keyIDs
// returns all of them.
ServerKeys(ctx context.Context, serverName string, keyIDs []string) ([]ServerKey, error)
// Enqueue adds items to the outbound queue, assigning their IDs.
Enqueue(ctx context.Context, items []QueuedItem) ([]QueuedItem, error)
// Queued returns up to limit of a destination's items of one kind,
// oldest first.
Queued(ctx context.Context, destination, kind string, limit int) ([]QueuedItem, error)
// Dequeue removes delivered items.
Dequeue(ctx context.Context, ids []int64) error
// QueuedDestinations lists the destinations that have anything queued,
// which is where a restarted queue picks up.
QueuedDestinations(ctx context.Context) ([]string, error)
// Destination reads one destination's delivery health. A server that
// has never been sent anything comes back as a zero Destination with
// its name filled in and no error.
Destination(ctx context.Context, serverName string) (Destination, error)
// SetDestination records a destination's delivery health.
SetDestination(ctx context.Context, d Destination) error
// Destinations lists every destination known to the queue, with its
// queue depth, ordered by server name.
Destinations(ctx context.Context) ([]DestinationSummary, error)
// InboundTransaction returns the response recorded for a transaction
// already received from origin, and whether there was one.
InboundTransaction(ctx context.Context, origin, txnID string) ([]byte, bool, error)
// RecordInboundTransaction stores the response to a transaction so
// that a retransmission is answered the same way.
RecordInboundTransaction(ctx context.Context, origin, txnID string, response []byte, atMS int64) error
}