mirror of
https://github.com/seaweedfs/seaweedfs.git
synced 2026-10-23 06:20:48 +02:00
* s3: resolve versionId ACL requests to the version ACL actions A request for an object's ACL carrying versionId acted on the historical version but authorized against the current-object action (s3:GetObjectAcl/s3:PutObjectAcl), because the acl block in resolveFromQueryParameters returned before versionId was considered - the same gap closed for tagging. An identity granted only current-object ACL access - or explicitly denied s3:*ObjectVersionAcl - could still read and modify ACLs on noncurrent versions. ?acl&versionId=<id> on an object now resolves to s3:GetObjectVersionAcl/s3:PutObjectVersionAcl; ?acl alone keeps the current-object actions and bucket ACL is unaffected. s3:PutObjectVersionAcl is mapped onto the WriteAcp identity action so policies can name it. * s3: resolve versionId attributes requests to the version attributes action GET /bucket/key?attributes&versionId=<id> fetched the historical version's attributes but authorized against s3:GetObjectAttributes, so a grant limited to the current-object attributes action could reach noncurrent versions. The request now resolves to s3:GetObjectVersionAttributes, and both attributes actions map onto the Read identity action so policies can name them (s3:GetObjectAttributes was previously rejected as an unmapped action). * s3api: recheck the version action on versioned ACL/attributes requests The phase-2 policy recheck inside GetObjectAclHandler, PutObjectAclHandler, and GetObjectAttributesHandler passed the current-object action even when the request carried versionId and phase 1 had resolved the version action. A Deny scoped to s3:*VersionAcl or s3:GetObjectVersionAttributes could never fire in the recheck, and an Allow limited to the version action went unevaluated. Select the action the same way the resolver does — versioned whenever versionId is present. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com> * s3api: recheck the version action on versioned tagging requests The same phase-2 gap exists in the tagging handlers left by the earlier version-tagging resolution change: versioned GetObjectTagging / PutObjectTagging / DeleteObjectTagging rechecks evaluated the current-object tagging action, so a Deny on s3:*VersionTagging could not fire. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com> * s3api: resolve HEAD ?acl as the head-object action, not an ACL action No HEAD acl route exists, so HEAD /bucket/key?acl lands on HeadObjectHandler — which serves object headers, not the ACL. Resolving it to an ACL action denied readers who hold only GetObject(Version) and let ACL grants reach a head-object read. Dropping HEAD from the acl branch lets the request fall through to GetObject/GetObjectVersion, matching how the tagging branch already treats HEAD. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com> * s3api: require the version read grant for versioned attributes AWS asks for s3:GetObjectVersion alongside s3:GetObjectVersionAttributes when a GetObjectAttributes request names a versionId; the resolved version-scoped action on its own left a lone s3:GetObjectVersion Deny unable to cover the attributes read. Check the version read grant too: the identity side through VerifyActionPermission, the bucket-policy side through the same recheck that evaluates the scoped action. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com> * s3api: check the version read grant on a synthesized versioned GET The versioned attributes check passed the literal s3:GetObjectVersion action, but both policy paths re-resolve the action from the request, so the attributes query parameter mapped it back to s3:GetObjectVersionAttributes and a lone version-read Deny never fired. The literal action also reached the legacy CanDo path, where a plain Read grant no longer matched. Evaluate the grant on a request shaped like a plain versioned GET instead. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com> * s3api: reject a named versionId on buckets without versioning Tagging, ACL, and attributes handlers answered versionId requests on never-versioned buckets as the current object while evaluating the version-scoped action, so a grant limited to the version action could authorize changes to the live entry. Reject the request up front through the existing checkVersionIdConfigured gate. Generated with [Devin](https://devin.ai) Co-Authored-By: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com> * s3api: carry presign params onto synthesized policy requests objectKeyPolicyRequest rebuilt the query with only versionId and the STS token, so a presigned request's s3:authType condition value silently changed from REST-QUERY-STRING to unset during phase-2 rechecks (version read grant, copy source, delete keys, post-policy writes). A policy conditioned on s3:authType would then deny a request it already allowed. Carry the SigV2/SigV4 presign keys through; none of them steer ResolveS3Action. --------- Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
311 lines
12 KiB
Go
311 lines
12 KiB
Go
package s3api
|
|
|
|
import (
|
|
"context"
|
|
"net/http"
|
|
"net/url"
|
|
"testing"
|
|
|
|
"github.com/stretchr/testify/assert"
|
|
"github.com/stretchr/testify/require"
|
|
|
|
"github.com/seaweedfs/seaweedfs/weed/s3api/s3_constants"
|
|
"github.com/seaweedfs/seaweedfs/weed/s3api/s3err"
|
|
)
|
|
|
|
// newCopyRequest builds a request that mimics what a CopyObject caller sends:
|
|
// a PUT to the destination bucket/object with X-Amz-Copy-Source pointing at the
|
|
// source. The destination is what the Auth middleware would have authorized.
|
|
func newCopyRequest(t *testing.T, dstBucket, dstObject, copySource string) *http.Request {
|
|
t.Helper()
|
|
req, err := http.NewRequest(http.MethodPut, "http://s3.local/"+dstBucket+"/"+dstObject, nil)
|
|
require.NoError(t, err)
|
|
req.Header.Set("X-Amz-Copy-Source", copySource)
|
|
return req
|
|
}
|
|
|
|
// TestAuthorizeCopySource_AuthDisabled verifies the source check is a no-op when
|
|
// the IAM is not enabled (no identities configured).
|
|
func TestAuthorizeCopySource_AuthDisabled(t *testing.T) {
|
|
iam := &IdentityAccessManagement{}
|
|
require.False(t, iam.isEnabled())
|
|
|
|
req := newCopyRequest(t, "dst-bucket", "dst-obj", "/src-bucket/src-obj")
|
|
errCode := iam.AuthorizeCopySource(req, nil, "src-bucket", "src-obj", "")
|
|
assert.Equal(t, s3err.ErrNone, errCode)
|
|
}
|
|
|
|
// TestAuthorizeCopySource_NilIdentityDenies verifies that with auth enabled we
|
|
// fail closed if no identity is available.
|
|
func TestAuthorizeCopySource_NilIdentityDenies(t *testing.T) {
|
|
iam := &IdentityAccessManagement{}
|
|
iam.identities = []*Identity{{Name: "anyone"}}
|
|
iam.isAuthEnabled = true
|
|
require.True(t, iam.isEnabled())
|
|
|
|
req := newCopyRequest(t, "dst-bucket", "dst-obj", "/src-bucket/src-obj")
|
|
errCode := iam.AuthorizeCopySource(req, nil, "src-bucket", "src-obj", "")
|
|
assert.Equal(t, s3err.ErrAccessDenied, errCode)
|
|
}
|
|
|
|
// TestAuthorizeCopySource_AdminAllowed verifies admin identities bypass the
|
|
// source check.
|
|
func TestAuthorizeCopySource_AdminAllowed(t *testing.T) {
|
|
iam := &IdentityAccessManagement{}
|
|
iam.identities = []*Identity{{Name: "admin", Actions: []Action{s3_constants.ACTION_ADMIN}}}
|
|
iam.isAuthEnabled = true
|
|
|
|
admin := &Identity{Name: "admin", Account: &AccountAdmin, Actions: []Action{s3_constants.ACTION_ADMIN}}
|
|
req := newCopyRequest(t, "dst-bucket", "dst-obj", "/src-bucket/src-obj")
|
|
errCode := iam.AuthorizeCopySource(req, admin, "src-bucket", "src-obj", "")
|
|
assert.Equal(t, s3err.ErrNone, errCode)
|
|
}
|
|
|
|
// TestAuthorizeCopySource_PrefixScopedIdentity checks that an identity scoped
|
|
// to prefix-a/* is denied when copying from prefix-b/*, even when its
|
|
// destination (prefix-a/*) write permission is fine.
|
|
func TestAuthorizeCopySource_PrefixScopedIdentity(t *testing.T) {
|
|
iam := &IdentityAccessManagement{}
|
|
iam.isAuthEnabled = true
|
|
|
|
scoped := &Identity{
|
|
Name: "scoped",
|
|
Account: &AccountAdmin,
|
|
Actions: []Action{
|
|
Action("Read:bucket-a/prefix-a/*"),
|
|
Action("Write:bucket-a/prefix-a/*"),
|
|
},
|
|
}
|
|
iam.identities = []*Identity{scoped}
|
|
|
|
t.Run("source within scope is allowed", func(t *testing.T) {
|
|
req := newCopyRequest(t, "bucket-a", "prefix-a/dst.bin", "/bucket-a/prefix-a/src.bin")
|
|
errCode := iam.AuthorizeCopySource(req, scoped, "bucket-a", "prefix-a/src.bin", "")
|
|
assert.Equal(t, s3err.ErrNone, errCode)
|
|
})
|
|
|
|
t.Run("source outside scope is denied", func(t *testing.T) {
|
|
req := newCopyRequest(t, "bucket-a", "prefix-a/dst.bin", "/bucket-a/prefix-b/src.bin")
|
|
errCode := iam.AuthorizeCopySource(req, scoped, "bucket-a", "prefix-b/src.bin", "")
|
|
assert.Equal(t, s3err.ErrAccessDenied, errCode)
|
|
})
|
|
|
|
t.Run("source in different bucket is denied", func(t *testing.T) {
|
|
req := newCopyRequest(t, "bucket-a", "prefix-a/dst.bin", "/other-bucket/src.bin")
|
|
errCode := iam.AuthorizeCopySource(req, scoped, "other-bucket", "src.bin", "")
|
|
assert.Equal(t, s3err.ErrAccessDenied, errCode)
|
|
})
|
|
}
|
|
|
|
// TestAuthorizeCopySource_IAMIntegrationGetsSourceResource verifies that the
|
|
// STS / IAM path is invoked with the SOURCE bucket/object and a GetObject-style
|
|
// action — not the destination from the request URL.
|
|
func TestAuthorizeCopySource_IAMIntegrationGetsSourceResource(t *testing.T) {
|
|
var capturedAction Action
|
|
var capturedBucket, capturedObject string
|
|
var capturedMethod string
|
|
var capturedURLPath string
|
|
|
|
mock := &MockIAMIntegration{
|
|
authorizeFunc: func(ctx context.Context, identity *IAMIdentity, action Action, bucket, object string, r *http.Request) s3err.ErrorCode {
|
|
// Resolve the action like S3IAMIntegration.AuthorizeAction would,
|
|
// so the assertion reflects the s3:* the policy engine sees.
|
|
capturedAction = Action(ResolveS3Action(r, string(action), bucket, object))
|
|
capturedBucket = bucket
|
|
capturedObject = object
|
|
if r != nil {
|
|
capturedMethod = r.Method
|
|
if r.URL != nil {
|
|
capturedURLPath = r.URL.Path
|
|
}
|
|
}
|
|
// Deny: simulate a session policy that does not grant Read on src.
|
|
return s3err.ErrAccessDenied
|
|
},
|
|
}
|
|
|
|
iam := &IdentityAccessManagement{iamIntegration: mock}
|
|
iam.identities = []*Identity{{Name: "sts"}}
|
|
iam.isAuthEnabled = true
|
|
|
|
stsIdentity := &Identity{
|
|
Name: "arn:aws:sts::assumed-role/scopedRole/session",
|
|
Account: &AccountAdmin,
|
|
Actions: []Action{}, // STS identity
|
|
PrincipalArn: "arn:aws:sts::assumed-role/scopedRole/session",
|
|
}
|
|
|
|
req := newCopyRequest(t, "bucket-a", "prefix-a/dst.bin", "/bucket-a/prefix-b/src.bin")
|
|
req.Header.Set("X-Amz-Security-Token", "test-session-token")
|
|
|
|
errCode := iam.AuthorizeCopySource(req, stsIdentity, "bucket-a", "prefix-b/src.bin", "")
|
|
assert.Equal(t, s3err.ErrAccessDenied, errCode)
|
|
assert.True(t, mock.authCalled, "IAM integration must be invoked for STS source check")
|
|
|
|
// Action passed through ResolveS3Action: GET method + ACTION_READ -> s3:GetObject.
|
|
assert.Equal(t, "s3:GetObject", string(capturedAction))
|
|
assert.Equal(t, "bucket-a", capturedBucket)
|
|
assert.Equal(t, "prefix-b/src.bin", capturedObject)
|
|
assert.Equal(t, http.MethodGet, capturedMethod, "synthetic source request must be a GET")
|
|
assert.Equal(t, "/bucket-a/prefix-b/src.bin", capturedURLPath, "synthetic URL must target the source")
|
|
|
|
// Original request must not be mutated by the source check.
|
|
assert.Equal(t, http.MethodPut, req.Method)
|
|
assert.Equal(t, "/bucket-a/prefix-a/dst.bin", req.URL.Path)
|
|
}
|
|
|
|
// TestAuthorizeCopySource_IAMIntegrationAllow verifies the IAM integration can
|
|
// grant access; the source check then returns ErrNone.
|
|
func TestAuthorizeCopySource_IAMIntegrationAllow(t *testing.T) {
|
|
mock := &MockIAMIntegration{
|
|
authorizeFunc: func(ctx context.Context, identity *IAMIdentity, action Action, bucket, object string, r *http.Request) s3err.ErrorCode {
|
|
return s3err.ErrNone
|
|
},
|
|
}
|
|
|
|
iam := &IdentityAccessManagement{iamIntegration: mock}
|
|
iam.identities = []*Identity{{Name: "sts"}}
|
|
iam.isAuthEnabled = true
|
|
|
|
stsIdentity := &Identity{
|
|
Name: "arn:aws:sts::assumed-role/role/session",
|
|
Account: &AccountAdmin,
|
|
Actions: []Action{},
|
|
PrincipalArn: "arn:aws:sts::assumed-role/role/session",
|
|
}
|
|
|
|
req := newCopyRequest(t, "bucket-a", "prefix-a/dst.bin", "/bucket-a/prefix-a/src.bin")
|
|
req.Header.Set("X-Amz-Security-Token", "test-session-token")
|
|
|
|
errCode := iam.AuthorizeCopySource(req, stsIdentity, "bucket-a", "prefix-a/src.bin", "")
|
|
assert.Equal(t, s3err.ErrNone, errCode)
|
|
}
|
|
|
|
// TestAuthorizeCopySource_VersionIdPropagated verifies that when copying a
|
|
// specific source version, the IAM check sees a versionId on the synthetic
|
|
// request so that s3:VersionId conditions and s3:GetObjectVersion resolution
|
|
// work.
|
|
func TestAuthorizeCopySource_VersionIdPropagated(t *testing.T) {
|
|
var capturedAction Action
|
|
var capturedRawQuery string
|
|
|
|
mock := &MockIAMIntegration{
|
|
authorizeFunc: func(ctx context.Context, identity *IAMIdentity, action Action, bucket, object string, r *http.Request) s3err.ErrorCode {
|
|
capturedAction = Action(ResolveS3Action(r, string(action), bucket, object))
|
|
if r != nil && r.URL != nil {
|
|
capturedRawQuery = r.URL.RawQuery
|
|
}
|
|
return s3err.ErrNone
|
|
},
|
|
}
|
|
|
|
iam := &IdentityAccessManagement{iamIntegration: mock}
|
|
iam.isAuthEnabled = true
|
|
|
|
stsIdentity := &Identity{
|
|
Name: "arn:aws:sts::assumed-role/role/session",
|
|
Account: &AccountAdmin,
|
|
Actions: []Action{},
|
|
PrincipalArn: "arn:aws:sts::assumed-role/role/session",
|
|
}
|
|
|
|
req := newCopyRequest(t, "bucket-a", "dst.bin", "/bucket-a/src.bin?versionId=abc123")
|
|
req.Header.Set("X-Amz-Security-Token", "test-session-token")
|
|
|
|
errCode := iam.AuthorizeCopySource(req, stsIdentity, "bucket-a", "src.bin", "abc123")
|
|
assert.Equal(t, s3err.ErrNone, errCode)
|
|
assert.Equal(t, "s3:GetObjectVersion", string(capturedAction), "versioned source should resolve to GetObjectVersion")
|
|
assert.Equal(t, "versionId=abc123", capturedRawQuery)
|
|
}
|
|
|
|
// TestAuthorizeCopySource_PresignedURLSessionTokenPreserved guards against a
|
|
// regression where the synthetic source request dropped X-Amz-Security-Token
|
|
// from the original query string. Presigned URLs carry the STS token there
|
|
// (not in headers), and VerifyActionPermission/authorizeWithIAM use it to
|
|
// route the request to IAM authorization.
|
|
func TestAuthorizeCopySource_PresignedURLSessionTokenPreserved(t *testing.T) {
|
|
var capturedSessionToken string
|
|
var capturedRawQuery string
|
|
|
|
mock := &MockIAMIntegration{
|
|
authorizeFunc: func(ctx context.Context, identity *IAMIdentity, action Action, bucket, object string, r *http.Request) s3err.ErrorCode {
|
|
if r != nil {
|
|
capturedSessionToken = r.URL.Query().Get("X-Amz-Security-Token")
|
|
capturedRawQuery = r.URL.RawQuery
|
|
}
|
|
// The IAM mock receives the propagated session token via IAMIdentity too.
|
|
if identity != nil && identity.SessionToken != "" {
|
|
capturedSessionToken = identity.SessionToken
|
|
}
|
|
return s3err.ErrNone
|
|
},
|
|
}
|
|
|
|
iam := &IdentityAccessManagement{iamIntegration: mock}
|
|
iam.isAuthEnabled = true
|
|
|
|
stsIdentity := &Identity{
|
|
Name: "arn:aws:sts::assumed-role/role/session",
|
|
Account: &AccountAdmin,
|
|
Actions: []Action{},
|
|
PrincipalArn: "arn:aws:sts::assumed-role/role/session",
|
|
}
|
|
|
|
// Presigned URL: session token is in the query string, no
|
|
// X-Amz-Security-Token header. The destination URL also carries the rest of
|
|
// the SigV4 presign params, which ride along so auth-derived policy
|
|
// conditions (s3:authType) match the real request; none of them steer
|
|
// ResolveS3Action.
|
|
req, err := http.NewRequest(http.MethodPut,
|
|
"http://s3.local/bucket-a/dst.bin?X-Amz-Algorithm=AWS4-HMAC-SHA256"+
|
|
"&X-Amz-Credential=stsKey%2F20260518%2Fus-east-1%2Fs3%2Faws4_request"+
|
|
"&X-Amz-Date=20260518T000000Z&X-Amz-Expires=900"+
|
|
"&X-Amz-Security-Token=presigned-session-token"+
|
|
"&X-Amz-SignedHeaders=host&X-Amz-Signature=deadbeef", nil)
|
|
require.NoError(t, err)
|
|
req.Header.Set("X-Amz-Copy-Source", "/bucket-a/src.bin")
|
|
|
|
errCode := iam.AuthorizeCopySource(req, stsIdentity, "bucket-a", "src.bin", "")
|
|
assert.Equal(t, s3err.ErrNone, errCode)
|
|
assert.Equal(t, "presigned-session-token", capturedSessionToken,
|
|
"session token from presigned-URL query must reach the IAM check")
|
|
capturedQuery, err := url.ParseQuery(capturedRawQuery)
|
|
require.NoError(t, err)
|
|
assert.Equal(t, "presigned-session-token", capturedQuery.Get("X-Amz-Security-Token"))
|
|
assert.Equal(t, "AWS4-HMAC-SHA256", capturedQuery.Get("X-Amz-Algorithm"))
|
|
assert.False(t, capturedQuery.Has("versionId"))
|
|
assert.False(t, capturedQuery.Has("acl"))
|
|
}
|
|
|
|
// TestAuthorizeCopySource_PreservesCopySourceHeader verifies that the synthetic
|
|
// source request still carries the X-Amz-Copy-Source header so policy condition
|
|
// keys like s3:x-amz-copy-source remain available.
|
|
func TestAuthorizeCopySource_PreservesCopySourceHeader(t *testing.T) {
|
|
var capturedCopySource string
|
|
|
|
mock := &MockIAMIntegration{
|
|
authorizeFunc: func(ctx context.Context, identity *IAMIdentity, action Action, bucket, object string, r *http.Request) s3err.ErrorCode {
|
|
if r != nil {
|
|
capturedCopySource = r.Header.Get("X-Amz-Copy-Source")
|
|
}
|
|
return s3err.ErrNone
|
|
},
|
|
}
|
|
|
|
iam := &IdentityAccessManagement{iamIntegration: mock}
|
|
iam.isAuthEnabled = true
|
|
|
|
stsIdentity := &Identity{
|
|
Name: "arn:aws:sts::assumed-role/role/session",
|
|
Account: &AccountAdmin,
|
|
Actions: []Action{},
|
|
PrincipalArn: "arn:aws:sts::assumed-role/role/session",
|
|
}
|
|
|
|
req := newCopyRequest(t, "bucket-a", "dst.bin", "/bucket-a/src.bin")
|
|
req.Header.Set("X-Amz-Security-Token", "test-session-token")
|
|
|
|
_ = iam.AuthorizeCopySource(req, stsIdentity, "bucket-a", "src.bin", "")
|
|
assert.Equal(t, "/bucket-a/src.bin", capturedCopySource)
|
|
}
|