feat: Add support for skipping processed files in transfer configs

- Introduce new `skip_processed_files` option for transfer configurations
- Add database migration to support the new column
- Update config form and UI to include skip processed files toggle
- Enhance scheduler to respect skip processed files setting
- Modify file processing logic to optionally skip previously processed files
- Add environment variable support for skip processed files configuration
This commit is contained in:
StarFleetCPTN committed 2025-03-10 16:05:30 -07:00
1 parent 6d0c215c38
commit 5eac95818e
14 files changed
+305 -134

No files matched your search

+4
View File
@@ -58,6 +58,10 @@ components/providers/common/*.go
# Ignore the data directory
data/
# Ignore .env files
.env
*.env
# Ignore the tmp directory
tmp/