chrislu
|
ccf1795e6f
|
wait a bit before getting the next volume id if the leader is recently elected
|
2024-11-23 19:58:45 -08:00 |
|
chrislu
|
04081128a9
|
use math rand v2
|
2024-11-21 08:54:03 -08:00 |
|
chrislu
|
54204bc89b
|
format error
|
2024-11-21 08:52:39 -08:00 |
|
chrislu
|
75f5afa571
|
fix compilation
|
2024-11-21 00:41:22 -08:00 |
|
chrislu
|
1c143cfcea
|
display actual offset value
|
2024-11-21 00:38:03 -08:00 |
|
chrislu
|
c9f3448692
|
ReadAt may return io.EOF t end of file
related to https://github.com/seaweedfs/seaweedfs/issues/6219
|
2024-11-21 00:37:38 -08:00 |
|
chrislu
|
be09d08eb6
|
adjust error message
|
2024-11-20 23:49:01 -08:00 |
|
chrislu
|
6b2612690b
|
consistent error message if auth is not setup
fix https://github.com/seaweedfs/seaweedfs/issues/6262
|
2024-11-20 23:11:18 -08:00 |
|
chrislu
|
96f1a2e01a
|
adjust error message
|
2024-11-19 14:16:06 -08:00 |
|
chrislu
|
e28f55eb08
|
typo
|
2024-11-19 08:32:31 -08:00 |
|
chrislu
|
98f03862aa
|
rename
|
2024-11-19 08:31:54 -08:00 |
|
chrislu
|
07cf8cf22d
|
minor
|
2024-11-19 08:31:33 -08:00 |
|
chrislu
|
2caa0e3741
|
java 3.80
|
2024-11-18 22:41:59 -08:00 |
|
chrislu
|
bc7650bd61
|
adds more info on skipped volumes
|
2024-11-18 18:25:44 -08:00 |
|
chrislu
|
7b3c0e937f
|
3.80
|
2024-11-18 09:48:33 -08:00 |
|
chrislu
|
113c9ce6a8
|
remove the direct_io flag, as it is not well-supported on macOS
|
2024-11-07 14:18:59 -08:00 |
|
chrislu
|
88a1eee31c
|
adjust logs
|
2024-11-07 13:00:12 -08:00 |
|
chrislu
|
62c4980754
|
add debug info
|
2024-11-06 11:59:03 -08:00 |
|
chrislu
|
706d1a8e22
|
fix tests
|
2024-11-05 08:52:07 -08:00 |
|
chrislu
|
90acfd9394
|
remove case when read request is out side of the file size
|
2024-11-05 08:42:44 -08:00 |
|
chrislu
|
6161d0b05d
|
a bit optimization
|
2024-11-05 08:41:14 -08:00 |
|
chrislu
|
98b519b113
|
fix FUSE mount on mac
|
2024-11-05 08:28:54 -08:00 |
|
chrislu
|
0f2c3648dc
|
fix mount: cannot locate OSXFUSE
addressing https://github.com/seaweedfs/seaweedfs/discussions/6193
|
2024-11-03 13:08:19 -08:00 |
|
chrislu
|
ad6240f066
|
fix parameter
|
2024-10-30 20:30:51 -07:00 |
|
chrislu
|
8802843511
|
pass in bytes buffer to avoid possible race condition
related to https://github.com/seaweedfs/seaweedfs/issues/6180
|
2024-10-30 09:31:22 -07:00 |
|
chrislu
|
3feb66d0a1
|
adding more debug message
related to https://github.com/seaweedfs/seaweedfs/issues/6180
|
2024-10-30 09:16:40 -07:00 |
|
chrislu
|
228946369c
|
3.79
|
2024-10-28 19:44:39 -07:00 |
|
chrislu
|
9873b033d1
|
backward compatible vif loading
|
2024-10-28 19:44:30 -07:00 |
|
chrislu
|
9105c6bdd1
|
fix format
|
2024-10-28 11:29:08 -07:00 |
|
chrislu
|
ebbb35d533
|
3.78
|
2024-10-27 17:44:22 -07:00 |
|
chrislu
|
089d4316ef
|
ensure 2 volume space since actual need 1.4x volume size empty space
|
2024-10-24 22:44:53 -07:00 |
|
chrislu
|
6e388e29c9
|
correcting free volume count, factor it during ec encoding to ensure enough disk space available
fix https://github.com/seaweedfs/seaweedfs/issues/6163
|
2024-10-24 22:42:38 -07:00 |
|
chrislu
|
8d6189bcc5
|
adjust output format
|
2024-10-24 21:41:39 -07:00 |
|
chrislu
|
2f3d820f52
|
rename proto field
This should not have any impact.
|
2024-10-24 21:36:56 -07:00 |
|
chrislu
|
ae5bd0667a
|
rename proto field from DestroyTime to expire_at_sec
For TTL volume converted into EC volume, this change may leave the volumes staying.
|
2024-10-24 21:35:11 -07:00 |
|
chrislu
|
1c2b10303a
|
remove X-Forwarded-For
fix https://github.com/seaweedfs/seaweedfs/issues/6136
|
2024-10-23 17:52:45 -07:00 |
|
chrislu
|
73921ce4f6
|
adjust help message
|
2024-10-22 08:51:02 -07:00 |
|
chrislu
|
970059d4ce
|
typo
|
2024-10-22 02:17:13 -07:00 |
|
chrislu
|
d38456dc06
|
do not delete collection metrics when unmount a volume
fix https://github.com/seaweedfs/seaweedfs/issues/6139
|
2024-10-22 00:44:52 -07:00 |
|
chrislu
|
6c7824c813
|
consistent sorted tags elastic,gocdk,rclone,sqlite,tikv,ydb
|
2024-10-21 22:53:29 -07:00 |
|
chrislu
|
0df4a4298b
|
adjust comment
|
2024-10-21 22:36:25 -07:00 |
|
chrislu
|
f11567816e
|
Revert "fix: volume data integrity check (#6118)"
This reverts commit e12b9ab746.
|
2024-10-17 18:52:30 -07:00 |
|
chrislu
|
804e765397
|
remove unused
|
2024-10-13 23:12:10 -07:00 |
|
chrislu
|
6845e25318
|
set proxied request content length
|
2024-10-10 13:55:32 -07:00 |
|
chrislu
|
35fd1e1c9a
|
optimize memory usage for large number of volumes
1. unwrap the map to avoid extra map object creation
2. fix ec shard counting in UpdateEcShards
|
2024-10-10 10:00:30 -07:00 |
|
chrislu
|
b28b1a3402
|
3.77
|
2024-10-10 01:28:06 -07:00 |
|
chrislu
|
07df5c53de
|
avoid nil
I1010 03:10:25.220345 mount_std.go:281 This is SeaweedFS version 30GB 3.76 82ed61c655 linux amd64
^[OR^[OR2024/10/10 03:12:56 Unimplemented opcode POLL
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x28 pc=0x3983b41]
goroutine 112 [running]:
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2.mergeProceesors.1(0xc000513540)
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:30 +0x41
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata.makeSubscribeMetadataFunc.func1({0x514a560, 0xc0009b06d0})
/github/workspace/weed/pb/filer_pb_tail.go:87 +0x293
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1.1(0xc000d9e008)
/github/workspace/weed/mount/wfs_filer_client.go:27 +0x68
github.com/seaweedfs/seaweedfs/weed/pb.WithGrpcClient(0xa9?, 0x9d1f90fb?, 0xc00098fbe0, {0xc000e1c078, 0x15}, 0x0?, {0xc000a76bd0?, 0x1?, 0x1?
})
/github/workspace/weed/pb/grpc_client_server.go:155 +0x33a
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient.func1()
/github/workspace/weed/mount/wfs_filer_client.go:25 +0x14c
github.com/seaweedfs/seaweedfs/weed/util.Retry({0x489a10c, 0xa}, 0xc00098fcf8)
/github/workspace/weed/util/retry.go:16 +0xa7
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).WithFilerClient(0x0?, 0x30?, 0xc00056a568?)
/github/workspace/weed/mount/wfs_filer_client.go:18 +0x65
github.com/seaweedfs/seaweedfs/weed/pb.WithFilerClientFollowMetadata({0x50f5898, 0xc000e2c180}, 0xc00101e000, 0xc000d22030)
/github/workspace/weed/pb/filer_pb_tail.go:51 +0x87
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func2()
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:115 +0xcb
github.com/seaweedfs/seaweedfs/weed/util.RetryUntil({0x48b8b35, 0x11}, 0xc00098fef0, 0x4af0048)
/github/workspace/weed/util/retry.go:64 +0x4e
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents(0xc000d1d980, 0x9d1f90fb, {0x50f5898, 0xc000e2c180}, {0x7ffdf6f98dca,
0x4}, 0x17fcf8b7c7ecf8cf, {0xc0000ac208, 0x1, 0x1})
/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:113 +0x39b
created by github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).StartBackgroundTasks in goroutine 1
/github/workspace/weed/mount/weedfs.go:150 +0x146
|
2024-10-09 22:46:00 -07:00 |
|
chrislu
|
82ed61c655
|
3.76
|
2024-10-06 19:37:03 -07:00 |
|
chrislu
|
c0e36231ad
|
use only one metadata follow process
|
2024-10-06 12:55:19 -07:00 |
|
chrislu
|
a3a8f6217e
|
fix
|
2024-10-03 09:03:17 -07:00 |
|
chrislu
|
117c3aebda
|
3.75
|
2024-10-03 08:33:35 -07:00 |
|
chrislu
|
ff47956530
|
add helper functions
|
2024-10-03 00:13:46 -07:00 |
|
chrislu
|
11e53dd8ef
|
skip error if conf file is not created
|
2024-10-01 22:46:48 -07:00 |
|
chrislu
|
f747767aa1
|
support load balancer in front of s3
|
2024-10-01 12:57:45 -07:00 |
|
chrislu
|
7dd480acad
|
handle missing leading zero padding in replica
|
2024-10-01 10:16:21 -07:00 |
|
chrislu
|
e3fa87bcc1
|
3.74
|
2024-09-30 11:29:01 -07:00 |
|
chrislu
|
cdd7fa81ab
|
fix help message
|
2024-09-29 21:53:07 -07:00 |
|
chrislu
|
20929f2a57
|
adjust resource heavy for volume.fix.replication
|
2024-09-29 11:32:18 -07:00 |
|
chrislu
|
6564ceda91
|
skip resource heavy commands from running on master nodes
|
2024-09-29 10:51:17 -07:00 |
|
chrislu
|
ec30a504ba
|
refactor
|
2024-09-29 10:38:22 -07:00 |
|
chrislu
|
9cd263b2ce
|
refactor
|
2024-09-29 10:35:53 -07:00 |
|
chrislu
|
701abbb9df
|
add IsResourceHeavy() to command interface
|
2024-09-28 20:23:01 -07:00 |
|
chrislu
|
4ec6eab004
|
fix max volume count auto setting
related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182
|
2024-09-19 09:13:08 -07:00 |
|
chrislu
|
50e22864cf
|
refactor
|
2024-09-17 23:10:41 -07:00 |
|
chrislu
|
99ae99e3b9
|
fix nil filer conf
fix https://github.com/seaweedfs/seaweedfs/issues/6034
|
2024-09-17 11:07:29 -07:00 |
|
chrislu
|
a9c9e1bcb3
|
refactor
|
2024-09-12 22:45:30 -07:00 |
|
chrislu
|
6063a889ed
|
3.73
|
2024-09-12 13:11:55 -07:00 |
|
chrislu
|
d660d5c7d4
|
increasing default cache size
|
2024-09-10 10:30:19 -07:00 |
|
chrislu
|
f23015ac5b
|
weed mount caching
|
2024-09-10 10:30:05 -07:00 |
|
chrislu
|
93decd1114
|
remove unused
|
2024-09-10 10:29:25 -07:00 |
|
chrislu
|
69fcdd0840
|
adjust logging
|
2024-09-10 10:28:49 -07:00 |
|
chrislu
|
43d9f68219
|
more consistent server header for s3 apis
|
2024-09-09 09:07:58 -07:00 |
|
chrislu
|
ff3d46637d
|
better logging for volume growth
|
2024-09-07 12:38:34 -07:00 |
|
chrislu
|
accba3070a
|
refactor
|
2024-09-07 11:54:22 -07:00 |
|
chrislu
|
eb02946c97
|
support write once read many
fix https://github.com/seaweedfs/seaweedfs/issues/5954
|
2024-09-04 02:25:07 -07:00 |
|
chrislu
|
18afdb15b6
|
Revert "weed mount, weed dav add option to force cache"
This reverts commit 7367b976b0.
|
2024-09-04 01:38:29 -07:00 |
|
chrislu
|
7367b976b0
|
weed mount, weed dav add option to force cache
|
2024-09-04 01:19:14 -07:00 |
|
chrislu
|
66ac82bb8f
|
default cacheDirWrite to cacheDir
|
2024-09-04 00:05:58 -07:00 |
|
chrislu
|
8d5a6d7e74
|
fix for spreading ec shards
|
2024-09-03 22:30:11 -07:00 |
|
chrislu
|
8e4bffc66b
|
copy ec shards to disks already having ec volumes
fix https://github.com/seaweedfs/seaweedfs/issues/5615
|
2024-09-03 21:19:10 -07:00 |
|
chrislu
|
3c0854e986
|
unnecessary skipping
|
2024-08-30 16:38:01 -07:00 |
|
chrislu
|
654b8210f7
|
parameter name
|
2024-08-30 14:52:07 -07:00 |
|
chrislu
|
8679870008
|
fix typo
|
2024-08-30 14:51:55 -07:00 |
|
chrislu
|
22d5d2ea96
|
adjust warning log
|
2024-08-30 14:51:42 -07:00 |
|
chrislu
|
a4b25a642d
|
math/rand => math/rand/v2
|
2024-08-29 09:52:21 -07:00 |
|
chrislu
|
ded5e084ea
|
ensure none zero lastGrowCount
|
2024-08-27 09:03:11 -07:00 |
|
chrislu
|
0cf2c15828
|
rename
|
2024-08-27 09:02:48 -07:00 |
|
chrislu
|
bebc385607
|
randomly pick one replica to write
|
2024-08-27 09:02:39 -07:00 |
|
chrislu
|
3b7bb62e38
|
logs on error
|
2024-08-26 09:09:11 -07:00 |
|
chrislu
|
4463296811
|
add parallel vacuuming
|
2024-08-21 22:53:54 -07:00 |
|
chrislu
|
5535b60e8c
|
fix replication range check
fix for https://github.com/seaweedfs/seaweedfs/wiki/Replication#replication-string
|
2024-08-21 16:58:43 -07:00 |
|
chrislu
|
6ce27affa4
|
also use /healthz for most consistent health check
|
2024-08-21 10:55:39 -07:00 |
|
chrislu
|
b3696024d1
|
add warning for not enough copies when skipping vacuuming volumes
fix https://github.com/seaweedfs/seaweedfs/issues/5906
|
2024-08-20 09:39:35 -07:00 |
|
chrislu
|
e50d85c0f3
|
3.72
|
2024-08-18 21:51:53 -07:00 |
|
chrislu
|
e8462ba3ad
|
prevent compacting on the same volume
|
2024-08-18 12:08:43 -07:00 |
|
chrislu
|
8f1f1730e9
|
minor
|
2024-08-15 19:12:11 -07:00 |
|
chrislu
|
fdf7193ae7
|
rename
|
2024-08-13 13:59:24 -07:00 |
|
chrislu
|
07f4998188
|
add dat file size into vif for EC
|
2024-08-13 13:56:00 -07:00 |
|
chrislu
|
3a2e21fee7
|
fix EC reading on nLargeBlockRows
fix https://github.com/seaweedfs/seaweedfs/issues/5465
|
2024-08-13 12:01:46 -07:00 |
|
chrislu
|
915f9f5054
|
update java client to 3.71, also adjust the groupId
|
2024-08-12 17:30:21 -07:00 |
|