Implements PLAN.md Phase 7: the server half of end-to-end encryption.
Devices upload identity, one-time and fallback keys; other devices query
and claim them, across servers too, and every one-time key is handed out
exactly once. Cross-signing, signature uploads, device list tracking and
server-side key backup complete the set.
internal/keyserver is the component. Keys are stored in canonical JSON
so that re-uploading the same key is a byte comparison, and signatures
uploaded later are kept apart from the key they sign and merged in on
read, so a key's own JSON stays what its owner uploaded. Device keys must
be for the caller's own device; cross-signing keys must be the
uploader's, carry the right usage and, for self- and user-signing keys,
be signed by the master key. Signatures are verified against the key as
stored. Replacing a master key asks for the password; a first upload or
an upload of the keys already stored does not, as the spec allows. A
signature of another user's master key is shown only to the user who
made it and never federated.
Every write that changes what /keys/query answers moves the device list
stream in the same transaction, one position per device, and wakes the
syncs of everyone sharing a room. The stream is the sixth field of a sync
token; older tokens still parse. The syncapi works out device_lists
changed and left from the stream and from membership moves in the
window, skipping invites and knocks, and reports
device_one_time_keys_count and device_unused_fallback_key_types, the
latter as [] when empty. GET /keys/changes uses the same logic.
Over federation: /user/keys/query, /user/keys/claim and
/user/devices/{userId}, and m.device_list_update and m.signing_key_update
both ways. Remote keys are not cached; an update about a remote user
sharing a room moves them in the stream so local clients re-query.
Device display names are not sent to other servers. With federation off,
remote users are reported in failures at once.
Deleting a device deletes its keys, through a new userapi
DeviceObserver. Key backup keeps the better copy of each session by the
spec's rule, never reuses a deleted version's number, and answers writes
to a stale version with M_WRONG_ROOM_KEYS_VERSION.
Storage is migration 0008 for sqlite and postgres, with a PocketBase
stub. The Complement target sets gain the key, device list, fallback,
cross-signing and backup tests.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
224 lines
7.6 KiB
Go
224 lines
7.6 KiB
Go
// Package keyserver holds what end-to-end encryption needs a homeserver to
|
|
// keep for its users' devices: their identity keys, their one-time and
|
|
// fallback keys, the user's cross-signing keys and the signatures between
|
|
// all of those, the server-side backup of room keys, and the device list
|
|
// stream that tells other devices when any of it changed.
|
|
//
|
|
// None of it is something the server can use. Every key here is public, or
|
|
// encrypted to a key the server never sees; what the server provides is a
|
|
// place to publish them, the guarantee that a one-time key is handed out
|
|
// once, and the bookkeeping of who has to be told about a change. That is
|
|
// the whole of the design, and the reason the package is mostly checks:
|
|
// the server cannot tell a good key from a bad one, but it can refuse a
|
|
// key uploaded for somebody else's device, a cross-signing key that its
|
|
// master key did not sign, and a signature that does not verify.
|
|
//
|
|
// The transport of encrypted messages between devices — to-device
|
|
// messaging — is the syncapi's, because a device only ever receives one in
|
|
// a /sync. So is the reporting of device list changes, for the same
|
|
// reason: whose keys changed is one of the streams of a sync response.
|
|
// What is here is the writing of that stream.
|
|
//
|
|
// Phase 7 of PLAN.md.
|
|
package keyserver
|
|
|
|
import (
|
|
"context"
|
|
"errors"
|
|
"fmt"
|
|
"log/slog"
|
|
"time"
|
|
|
|
"github.com/dariuszjaniak/warp/server/internal/federation"
|
|
"github.com/dariuszjaniak/warp/server/internal/matrix/id"
|
|
"github.com/dariuszjaniak/warp/server/internal/storage"
|
|
)
|
|
|
|
// Errors callers have to tell apart. Each is wrapped with the detail of
|
|
// what was wrong, so a handler can answer with the right errcode and still
|
|
// tell the client which key it was.
|
|
var (
|
|
// ErrInvalidParam is a request that is well-formed JSON but not a
|
|
// valid one: keys for another user's device, a key ID without an
|
|
// algorithm, a cross-signing key with the wrong usage.
|
|
ErrInvalidParam = errors.New("invalid parameter")
|
|
|
|
// ErrMissingParam is a request that leaves out something it needs,
|
|
// such as a self-signing key with no master key to have signed it.
|
|
ErrMissingParam = errors.New("missing parameter")
|
|
|
|
// ErrInvalidSignature is a signature that does not verify.
|
|
ErrInvalidSignature = errors.New("invalid signature")
|
|
|
|
// ErrKeyConflict is a one-time key uploaded under an ID that already
|
|
// holds a different one.
|
|
ErrKeyConflict = storage.ErrKeyConflict
|
|
|
|
// ErrNoSuchBackup is a key backup version that does not exist.
|
|
ErrNoSuchBackup = storage.ErrNoSuchBackup
|
|
|
|
// ErrNoSuchBackupKey is a room key that is not in the backup.
|
|
ErrNoSuchBackupKey = storage.ErrNoSuchBackupKey
|
|
)
|
|
|
|
// WrongBackupVersionError is a write to a key backup version that is not
|
|
// the user's current one. The spec answers it with the current version, so
|
|
// that a client whose backup was replaced from another device finds out
|
|
// which one to use.
|
|
type WrongBackupVersionError struct {
|
|
Current string
|
|
}
|
|
|
|
func (e *WrongBackupVersionError) Error() string {
|
|
return fmt.Sprintf("backup version is not the current one (%s)", e.Current)
|
|
}
|
|
|
|
// Rooms says who shares a room with whom, which is who has to be told when
|
|
// a user's keys change. *roomserver.API satisfies it.
|
|
type Rooms interface {
|
|
UsersSharingRooms(ctx context.Context, userID string) ([]string, error)
|
|
}
|
|
|
|
// Notifier wakes the long polls of users. *syncapi.Notifier satisfies it.
|
|
type Notifier interface {
|
|
NotifyUsers(userIDs []string)
|
|
}
|
|
|
|
// Devices is the part of the userapi the keyserver reads: a user's devices,
|
|
// for their display names and to tell a device that still exists from one
|
|
// that does not. *userapi.API satisfies it.
|
|
type Devices interface {
|
|
Devices(ctx context.Context, localpart string) ([]storage.Device, error)
|
|
}
|
|
|
|
// Remote asks other servers about their users' keys. *federation.Client
|
|
// satisfies it; it refuses every request while federation is off, which is
|
|
// what keeps a key query from reaching out with the switch down.
|
|
type Remote interface {
|
|
QueryUserKeys(ctx context.Context, destination string, req federation.UserKeysQueryRequest) (federation.UserKeysQueryResponse, error)
|
|
ClaimUserKeys(ctx context.Context, destination string, req federation.UserKeysClaimRequest) (federation.UserKeysClaimResponse, error)
|
|
}
|
|
|
|
// Outbound queues EDUs to other servers. *federationapi.Queue satisfies it.
|
|
type Outbound interface {
|
|
Running() bool
|
|
QueueEDU(ctx context.Context, destinations []string, edu federation.EDU)
|
|
}
|
|
|
|
// API is the keyserver component.
|
|
type API struct {
|
|
serverName string
|
|
store storage.KeyStore
|
|
rooms Rooms
|
|
notifier Notifier
|
|
devices Devices
|
|
remote Remote
|
|
outbound Outbound
|
|
log *slog.Logger
|
|
}
|
|
|
|
// Options configure the component.
|
|
type Options struct {
|
|
// ServerName is the Matrix server name.
|
|
ServerName string
|
|
|
|
// Store is the key half of storage.
|
|
Store storage.KeyStore
|
|
|
|
// Rooms says who shares a room with a user. Nil means nobody does,
|
|
// which is only useful in a test.
|
|
Rooms Rooms
|
|
|
|
// Notifier wakes the syncs a key change concerns. Nil wakes nobody.
|
|
Notifier Notifier
|
|
|
|
// Devices is the userapi.
|
|
Devices Devices
|
|
|
|
// Remote asks other servers for their users' keys. Nil fails every
|
|
// remote user in a query or claim as unreachable.
|
|
Remote Remote
|
|
|
|
// Outbound sends device list updates to other servers. Nil, or a
|
|
// queue that is not running, sends nothing.
|
|
Outbound Outbound
|
|
|
|
Logger *slog.Logger
|
|
}
|
|
|
|
// New builds the component.
|
|
func New(opts Options) (*API, error) {
|
|
switch {
|
|
case opts.ServerName == "":
|
|
return nil, errors.New("keyserver: ServerName must not be empty")
|
|
case opts.Store == nil:
|
|
return nil, errors.New("keyserver: Store must not be nil")
|
|
case opts.Devices == nil:
|
|
return nil, errors.New("keyserver: Devices must not be nil")
|
|
}
|
|
if opts.Logger == nil {
|
|
opts.Logger = slog.Default()
|
|
}
|
|
return &API{
|
|
serverName: opts.ServerName,
|
|
store: opts.Store,
|
|
rooms: opts.Rooms,
|
|
notifier: opts.Notifier,
|
|
devices: opts.Devices,
|
|
remote: opts.Remote,
|
|
outbound: opts.Outbound,
|
|
log: opts.Logger,
|
|
}, nil
|
|
}
|
|
|
|
// SetOutbound connects the federation queue, which is built after the
|
|
// keyserver's own dependencies. Nil disconnects it.
|
|
func (k *API) SetOutbound(o Outbound) { k.outbound = o }
|
|
|
|
// isLocal reports whether a user belongs to this server.
|
|
func (k *API) isLocal(userID string) bool {
|
|
server, err := id.ServerNameOf(userID)
|
|
return err == nil && server == k.serverName
|
|
}
|
|
|
|
// localpartOf returns the localpart of a local user.
|
|
func (k *API) localpartOf(userID string) (string, bool) {
|
|
localpart, server, err := id.SplitUserID(userID)
|
|
if err != nil || server != k.serverName {
|
|
return "", false
|
|
}
|
|
return localpart, true
|
|
}
|
|
|
|
// defaultRemoteTimeout is how long a key query or claim waits for other
|
|
// servers when the client did not say. A client asking for keys is about
|
|
// to send a message, and a server that has not answered in ten seconds is
|
|
// better reported as a failure than waited on.
|
|
const defaultRemoteTimeout = 10 * time.Second
|
|
|
|
// maxRemoteTimeout caps what a client may ask for.
|
|
const maxRemoteTimeout = time.Minute
|
|
|
|
// remoteTimeout clamps a client's timeout.
|
|
func remoteTimeout(d time.Duration) time.Duration {
|
|
switch {
|
|
case d <= 0:
|
|
return defaultRemoteTimeout
|
|
case d > maxRemoteTimeout:
|
|
return maxRemoteTimeout
|
|
}
|
|
return d
|
|
}
|
|
|
|
func invalidParamf(format string, args ...any) error {
|
|
return fmt.Errorf("%w: %s", ErrInvalidParam, fmt.Sprintf(format, args...))
|
|
}
|
|
|
|
func missingParamf(format string, args ...any) error {
|
|
return fmt.Errorf("%w: %s", ErrMissingParam, fmt.Sprintf(format, args...))
|
|
}
|
|
|
|
func invalidSignaturef(format string, args ...any) error {
|
|
return fmt.Errorf("%w: %s", ErrInvalidSignature, fmt.Sprintf(format, args...))
|
|
}
|