mirror of
https://github.com/seaweedfs/seaweedfs.git
synced 2026-10-07 06:47:51 +02:00
chrislu
e7f5fff989
- Add OpenFileCache with ML file detection and chunk-level metadata tracking - Implement MLCachePolicy with intelligent eviction based on ML workload patterns - Create FUSEMLIntegration for seamless integration with FUSE operations - Add MLIntegrationManager as main interface for mount package integration - Support for ML file type detection (datasets, models, configs, tensors, logs) - Multi-factor eviction scoring considering access patterns, file types, and ML heuristics - Enhanced cache timeouts for different ML file types - FOPEN_KEEP_CACHE and writeback cache optimizations for ML workloads Features: - ML file type detection based on extensions, paths, and size heuristics - Intelligent cache eviction with ML-aware scoring (frequency, recency, size, ML factors) - Open file tracking with chunk-level metadata and access pattern integration - FUSE integration with ML-specific optimizations (keep cache, writeback, extended timeouts) - Comprehensive metrics and monitoring for all ML cache components - Concurrent access support with proper locking Test Results: 18/22 tests passing - core functionality solid Architecture: Clean separation into dedicated ml package with integration layer