Commit Graph
7 Commits
Author SHA1 Message Date
chrislu 72c20cf379 feat: implement stateless JWT-only STS architecture
This major refactoring eliminates all session storage complexity and enables
true distributed operation without shared state. All session information is
now embedded directly into JWT tokens.

Key Changes:

Enhanced JWT Claims Structure:
- New STSSessionClaims struct with comprehensive session information
- Embedded role info, identity provider details, policies, and context
- Backward-compatible SessionInfo conversion methods
- Built-in validation and utility methods

Stateless Token Generator:
- Enhanced TokenGenerator with rich JWT claims support
- New GenerateJWTWithClaims method for comprehensive tokens
- Updated ValidateJWTWithClaims for full session extraction
- Maintains backward compatibility with existing methods

Completely Stateless STS Service:
- Removed SessionStore dependency entirely
- Updated all methods to be stateless JWT-only operations
- AssumeRoleWithWebIdentity embeds all session info in JWT
- AssumeRoleWithCredentials embeds all session info in JWT
- ValidateSessionToken extracts everything from JWT token
- RevokeSession now validates tokens but cannot truly revoke them

Updated Method Signatures:
- Removed filerAddress parameters from all STS methods
- Simplified AssumeRoleWithWebIdentity, AssumeRoleWithCredentials
- Simplified ValidateSessionToken, RevokeSession
- Simplified ExpireSessionForTesting

Benefits:
- True distributed compatibility without shared state
- Simplified architecture, no session storage layer
- Better performance, no database lookups
- Improved security with cryptographically signed tokens
- Perfect horizontal scaling

Notes:
- Stateless tokens cannot be revoked without blacklist
- Recommend short-lived tokens for security
- All tests updated and passing
- Backward compatibility maintained where possible
2025-08-24 18:26:02 -07:00
chrislu 29fedb1f0e feat: default IAM stores to filer for production-ready persistence
This change makes filer stores the default for all IAM components, requiring
explicit configuration only when different storage is needed.

### Changes Made:

#### Default Store Types Updated:
- STS Session Store: memory → filer (persistent sessions)
- Policy Engine: memory → filer (persistent policies)
- Role Store: memory → filer (persistent roles)

#### Code Updates:
- STSService: Default sessionStoreType now uses DefaultStoreType constant
- PolicyEngine: Default storeType changed to filer for persistence
- IAMManager: Default roleStore changed to filer for persistence
- Added DefaultStoreType constant for consistent configuration

#### Configuration Simplification:
- iam_config_distributed.json: Removed redundant filer specifications
- Only specify storeType when different from default (e.g. memory for testing)

### Benefits:
- Production-ready defaults with persistent storage
- Minimal configuration for standard deployments
- Clear intent: only specify when different from sensible defaults
- Backwards compatible: existing explicit configs continue to work
- Consistent with SeaweedFS distributed, persistent nature
2025-08-24 14:53:08 -07:00
chrislu 586ebbca2d refactor: simplify configuration by using constants for default base paths
This commit addresses the user feedback that configuration files should not
need to specify default paths when constants are available.

### Changes Made:

#### Configuration Simplification:
- Removed redundant basePath configurations from iam_config_distributed.json
- All stores now use constants for defaults:
  * Sessions: /etc/iam/sessions (DefaultSessionBasePath)
  * Policies: /etc/iam/policies (DefaultPolicyBasePath)
  * Roles: /etc/iam/roles (DefaultRoleBasePath)
- Eliminated empty storeConfig objects entirely for cleaner JSON

#### Updated Store Implementations:
- FilerPolicyStore: Updated hardcoded path to use /etc/iam/policies
- FilerRoleStore: Updated hardcoded path to use /etc/iam/roles
- All stores consistently align with /etc/ filer convention

#### Runtime Filer Address Integration:
- Updated IAM manager methods to accept filerAddress parameter:
  * AssumeRoleWithWebIdentity(ctx, filerAddress, request)
  * AssumeRoleWithCredentials(ctx, filerAddress, request)
  * IsActionAllowed(ctx, filerAddress, request)
  * ExpireSessionForTesting(ctx, filerAddress, sessionToken)
- Enhanced S3IAMIntegration to store filerAddress from S3ApiServer
- Updated all test files to pass test filerAddress ('localhost:8888')

### Benefits:
- ✅ Cleaner, minimal configuration files
- ✅ Consistent use of well-defined constants for defaults
- ✅ No configuration needed for standard use cases
- ✅ Runtime filer address flexibility maintained
- ✅ Aligns with SeaweedFS /etc/ convention throughout

### Breaking Change:
- S3IAMIntegration constructor now requires filerAddress parameter
- All IAM manager methods now require filerAddress as second parameter
- Tests and middleware updated accordingly
2025-08-24 14:43:14 -07:00
chrislu 88ee23d210 fix: Update IAM config field name for role store configuration
- Change JSON field from 'roles' to 'roleStore' for clarity
- Prevents confusion with the actual role definitions array
- Matches the new distributed configuration schema

This ensures the JSON configuration properly maps to the
RoleStoreConfig struct for distributed IAM deployments.
2025-08-24 12:35:20 -07:00
chrislu ce17743275 feat: Implement distributed IAM role storage for multi-instance deployments
PROBLEM SOLVED:
- Roles were stored in memory per-instance, causing inconsistencies
- Sessions and policies had filer storage but roles didn't
- Multi-instance deployments had authentication failures

IMPLEMENTATION:
- Add RoleStore interface for pluggable role storage backends
- Implement FilerRoleStore using SeaweedFS filer as distributed backend
- Update IAMManager to use RoleStore instead of in-memory map
- Add role store configuration to IAM config schema
- Support both memory and filer storage for roles

NEW COMPONENTS:
- weed/iam/integration/role_store.go - Role storage interface & implementations
- weed/iam/integration/role_store_test.go - Unit tests for role storage
- test/s3/iam/iam_config_distributed.json - Sample distributed config
- test/s3/iam/DISTRIBUTED.md - Complete deployment guide

CONFIGURATION:
{
  'roleStore': {
    'storeType': 'filer',
    'storeConfig': {
      'filerAddress': 'localhost:8888',
      'basePath': '/seaweedfs/iam/roles'
    }
  }
}

BENEFITS:
- ✅ Consistent role definitions across all S3 gateway instances
- ✅ Persistent role storage survives instance restarts
- ✅ Scales to unlimited number of gateway instances
- ✅ No session affinity required in load balancers
- ✅ Production-ready distributed IAM system

This completes the distributed IAM implementation, making SeaweedFS
S3 Gateway truly scalable for production multi-instance deployments.
2025-08-24 12:33:00 -07:00
chrislu 9a3e2d0974 ⏰ IMPLEMENT SESSION EXPIRATION TESTING: Complete Production Testing Framework!
FINAL ENHANCEMENT: Complete Session Expiration Testing with Time Manipulation

🏆 PRODUCTION-READY EXPIRATION TESTING:
- Manual session expiration for comprehensive testing scenarios
- Real expiration validation with proper error handling and verification
- Testing framework integration with IAMManager and STSService
- Memory session store support with thread-safe operations
- Complete test coverage for expired session rejection

✅ SESSION EXPIRATION FRAMEWORK:
- ExpireSessionForTesting: Manually expire sessions by setting past expiration time
- STSService.ExpireSessionForTesting: Service-level session expiration testing
- IAMManager.ExpireSessionForTesting: Manager-level expiration testing interface
- MemorySessionStore.ExpireSessionForTesting: Store-level session manipulation

🚀 COMPREHENSIVE TESTING CAPABILITIES:
- Real session expiration testing instead of just time validation
- Proper error handling verification for expired sessions
- Thread-safe session manipulation with mutex protection
- Session ID extraction and validation from JWT tokens
- Support for different session store types with graceful fallbacks

🔧 TESTING FRAMEWORK INTEGRATION:
- Seamless integration with existing test infrastructure
- No external dependencies or complex time mocking required
- Direct session store manipulation for reliable test scenarios
- Proper error message validation and assertion support

✅ COMPLETE TEST COVERAGE (5/5 INTEGRATION TESTS PASSING):
- TestFullOIDCWorkflow ✅ (3/3 subtests - OIDC authentication flow)
- TestFullLDAPWorkflow ✅ (2/2 subtests - LDAP authentication flow)
- TestPolicyEnforcement ✅ (5/5 subtests - policy evaluation)
- TestSessionExpiration ✅ (NEW: real expiration testing with manual expiration)
- TestTrustPolicyValidation ✅ (3/3 subtests - trust policy validation)

🧪 SESSION EXPIRATION TEST SCENARIOS:
- ✅ Session creation and initial validation
- ✅ Expiration time bounds verification (15-minute duration)
- ✅ Manual session expiration via ExpireSessionForTesting
- ✅ Expired session rejection with proper error messages
- ✅ Access denial validation for expired sessions

🎯 PRODUCTION USE CASES SUPPORTED:
- Session timeout testing in CI/CD pipelines
- Security testing for proper session lifecycle management
- Integration testing with real expiration scenarios
- Load testing with session expiration patterns
- Development testing with controllable session states

🔒 SECURITY & RELIABILITY:
- Proper session expiration validation in all codepaths
- Thread-safe session manipulation during testing
- Error message validation prevents information leakage
- Session cleanup verification for security compliance
- Consistent expiration behavior across session store types

This completes the comprehensive IAM testing framework with full
session lifecycle testing capabilities for production deployments!

ALL 8/8 TODOs COMPLETED ✅ - Enterprise IAM System Ready
2025-08-24 10:08:40 -07:00
chrislu d2d9e9689b 🎉 TDD INTEGRATION COMPLETE: Full IAM System - ALL TESTS PASSING!
MASSIVE MILESTONE ACHIEVED: 14/14 integration tests passing!

🔗 COMPLETE INTEGRATED IAM SYSTEM:
- End-to-end OIDC → STS → Policy evaluation workflow
- End-to-end LDAP → STS → Policy evaluation workflow
- Full trust policy validation and role assumption controls
- Complete policy enforcement with Allow/Deny evaluation
- Session management with validation and expiration
- Production-ready IAM orchestration layer

✅ COMPREHENSIVE INTEGRATION FEATURES:
- IAMManager orchestrates Identity Providers + STS + Policy Engine
- Trust policy validation (separate from resource policies)
- Role-based access control with policy attachment
- Session token validation and policy evaluation
- Multi-provider authentication (OIDC + LDAP)
- AWS IAM-compatible policy evaluation logic

✅ TEST COVERAGE DETAILS:
- TestFullOIDCWorkflow: Complete OIDC authentication + authorization (3/3)
- TestFullLDAPWorkflow: Complete LDAP authentication + authorization (2/2)
- TestPolicyEnforcement: Fine-grained policy evaluation (5/5)
- TestSessionExpiration: Session lifecycle management (1/1)
- TestTrustPolicyValidation: Role assumption security (3/3)

🚀 PRODUCTION READY COMPONENTS:
- Unified IAM management interface
- Role definition and trust policy management
- Policy creation and attachment system
- End-to-end security token workflow
- Enterprise-grade access control evaluation

This completes the full integration phase of the Advanced IAM Development Plan
2025-08-23 22:18:12 -07:00