3 people 39bc9cd0ef s3api: copy the trailer checksum before reading the next trailer line (#11583) ...

* s3api: copy the trailer checksum before reading the next trailer line

parseChunkChecksum kept the checksum value as a sub-slice of the line
returned by bufio.Reader.ReadSlice, which is only valid until the next
read. When the trailer lines arrive in separate TCP segments, reading
x-amz-trailer-signature refills the buffer and overwrites the saved
value, so a correct upload fails with InvalidDigest ("The Content-Md5
you specified is not valid").

The AWS SDK for Java v2 (>= 2.30) on a Linux JDK sends the trailer that
way; about half of its signed streaming uploads failed.

Fixes #11582

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

* s3api: reuse crc32 writer and trim comments in trailer split test

---------

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Co-authored-by: Chris Lu <chris.lu@gmail.com>

2026-10-04 01:14:15 +08:00

..

admin

volume: validate copy/tail source addresses before dialing (#11390)

2026-09-18 12:55:47 -07:00

cluster

master,filer: fix lock ring poisoning after leader change (#11453)

2026-09-26 11:57:00 +08:00

command

filer.sync: resubscribe the metadata stream when a failure pins the offset (#11581)

2026-10-04 00:06:55 +08:00

credential

s3: gate internal LifecycleDelete gRPC behind admin Bearer auth (#11291)

2026-09-13 13:07:10 -07:00

ec

shell: let volume.deleteEmpty drop volumes with no live needles (#11437)

2026-09-26 15:53:39 +08:00

filer

filer: skip UpdateEntry when inline content is unchanged (#11580)

2026-10-03 21:00:51 +08:00

filer_client

fix: resolve gRPC DNS resolution issues in Kubernetes #8384 (#8387)

2026-02-19 15:46:02 -08:00

glog

go fmt

2026-04-10 17:31:14 -07:00

iam

iam: manage OIDC providers and roles over the filer IAM gRPC service (#11523)

2026-10-03 08:36:19 +08:00

iamapi

iam: authorize IAM management actions as IAM actions (#10593)

2026-08-05 17:08:21 -07:00

images

Add codespell support with configuration and typo fixes (#10393)

2026-07-22 14:38:06 -07:00

kms

kms: cache decrypted data keys so cache_enabled/cache_ttl take effect (#10173)

2026-06-30 21:23:53 -07:00

mount

master,filer: fix lock ring poisoning after leader change (#11453)

2026-09-26 11:57:00 +08:00

mq

filer: authorize the chunk proxy and the root listing like the rest of the filer port (#11152)

2026-09-04 16:39:36 -07:00

notification

security: add BearerPrefix constant for Authorization headers (#10101)

2026-06-24 19:36:42 -07:00

operation

filer: evict remote-cached objects under storage pressure (#11515)

2026-09-29 22:05:42 +08:00

pb

filer.sync: resubscribe the metadata stream when a failure pins the offset (#11581)

2026-10-04 00:06:55 +08:00

placement

placement: let callers reject candidates placement cannot judge (#10581)

2026-08-05 00:18:22 -07:00

plugin/worker

shell: reset noLock in the admin script dispatcher too (#11059)

2026-08-31 23:14:37 -07:00

query

s3: invalidate stale reader cache locations on chunk read failure (#10156)

2026-06-30 13:27:49 -07:00

remote_storage

filer: keep lazy remote reads from resurrecting deleted paths (#11452)

2026-09-26 08:00:39 +08:00

replication

filer.sync: resubscribe the metadata stream when a failure pins the offset (#11581)

2026-10-04 00:06:55 +08:00

s3api

s3api: copy the trailer checksum before reading the next trailer line (#11583)

2026-10-04 01:14:15 +08:00

security

util: serialize all ViperProxy access so startup cannot hit concurrent map read/write (#11470)

2026-09-26 16:09:29 +08:00

sequence

[nfs] Add NFS (#9067)

2026-04-14 20:48:24 -07:00

server

volume server: ec.decode verifies, cleans up and compacts like Go, off the runtime (#11547)

2026-10-03 14:55:15 +08:00

sftpd

sftp: reject an empty password (#11095)

2026-09-02 11:33:25 -07:00

shell

shell: say which read-only volumes volume.vacuum leaves alone (#11525)

2026-10-01 01:08:48 +08:00

static

adjust logo

2026-04-23 10:05:51 -07:00

stats

filer: evict remote-cached objects under storage pressure (#11515)

2026-09-29 22:05:42 +08:00

storage

volume server: refuse the rest of a grouped run after a durable index failure (#11576)

2026-10-03 21:04:30 +08:00

telemetry

telemetry: keep only clusters that store at least 10 GiB (#11138)

2026-09-03 12:36:00 -07:00

topology

vacuum: bound master vacuum RPCs with phase deadlines (#11579)

2026-10-03 12:32:42 +08:00

util

filer.sync: resubscribe the metadata stream when a failure pins the offset (#11581)

2026-10-04 00:06:55 +08:00

wdclient

s3: track filer joins and leaves pushed by the master (#11563)

2026-10-03 09:10:43 +08:00

worker

ecbalancer: honour total-shards-per-rack cap in Place / PlaceDurabilityFirst (#11553)

2026-10-01 22:22:34 +08:00

Makefile

Move SQL engine and PostgreSQL server to their own binaries (#8417)

2026-02-23 16:27:08 -08:00

weed.go

shell: exit non-zero when a piped command fails (#11117)

2026-09-02 22:12:51 -07:00