Commit Graph
100 Commits
Author SHA1 Message Date
Chris Lu 528702d30b errors when reading uncached files from cloud drive (#6674)
fix https://github.com/seaweedfs/seaweedfs/issues/6672
2025-03-29 16:44:01 -07:00
Chris Lu 669a3917af add lua redis store to ensure atomicity (#6671) 2025-03-28 11:27:39 -07:00
Chris Lu 02773a6107 Accumulated changes for message queue (#6600)
* rename

* set agent address

* refactor

* add agent sub

* pub messages

* grpc new client

* can publish records via agent

* send init message with session id

* fmt

* check cancelled request while waiting

* use sessionId

* handle possible nil stream

* subscriber process messages

* separate debug port

* use atomic int64

* less logs

* minor

* skip io.EOF

* rename

* remove unused

* use saved offsets

* do not reuse session, since always session id is new after restart

remove last active ts from SessionEntry

* simplify printing

* purge unused

* just proxy the subscription, skipping the session step

* adjust offset types

* subscribe offset type and possible value

* start after the known tsns

* avoid wrongly set startPosition

* move

* remove

* refactor

* typo

* fix

* fix changed path
2025-03-09 23:49:42 -07:00
Chris Lu 3ed52662df Revert "chore(deps): bump github.com/parquet-go/parquet-go from 0.24.0 to 0.25.0" (#6599)
Revert "chore(deps): bump github.com/parquet-go/parquet-go from 0.24.0 to 0.2…"

This reverts commit 3ee4d6e69e.
2025-03-04 08:24:40 -08:00
Chris Lu 91a9631904 Revert "Removed unused certificate mounts from helm chart" (#6597)
Revert "Removed unused certificate mounts from helm chart (#6581)"

This reverts commit 65b0a7cf83.
2025-03-03 10:59:28 -08:00
Chris Lu df436d342b add cassandra2 (#6582) 2025-02-26 17:29:22 -08:00
Chris Lu cc05874d06 Add message queue agent (#6463)
* scaffold message queue agent

* adjust proto, add mq_agent

* add agent client implementation

* remove unused function

* agent publish server implementation

* adding agent
2025-01-20 22:19:27 -08:00
Chris Lu 72b14a451e delete aborted ec shards from both source and target servers (#6221)
fix https://github.com/seaweedfs/seaweedfs/issues/6205#issuecomment-2465004586
2024-11-09 11:32:08 -08:00
Chris Lu dc784bf217 merge current message queue code changes (#6201)
* listing files to convert to parquet

* write parquet files

* save logs into parquet files

* pass by value

* compact logs into parquet format

* can skip existing files

* refactor

* refactor

* fix compilation

* when no partition found

* refactor

* add untested parquet file read

* rename package

* refactor

* rename files

* remove unused

* add merged log read func

* parquet wants to know the file size

* rewind by time

* pass in stop ts

* add stop ts

* adjust log

* minor

* adjust log

* skip .parquet files when reading message logs

* skip non message files

* Update subscriber_record.go

* send messages

* skip message data with only ts

* skip non log files

* update parquet-go package

* ensure a valid record type

* add new field to a record type

* Update read_parquet_to_log.go

* fix parquet file name generation

* separating reading parquet and logs

* add key field

* add skipped logs

* use in memory cache

* refactor

* refactor

* refactor

* refactor, and change compact log

* refactor

* rename

* refactor

* fix format

* prefix v to version directory
2024-11-04 12:08:25 -08:00
Chris Lu 952afd810c Fix dead lock (#5815)
* reduce locks to avoid dead lock

Flush->FlushData->uplloadPipeline.FluahAll
uploaderCount>0

goroutine 1 [sync.Cond.Wait, 71 minutes]:
sync.runtime_notifyListWait(0xc0007ae4d0, 0x0)
	/usr/local/go/src/runtime/sema.go:569 +0x159
sync.(*Cond).Wait(0xc001a59290?)
	/usr/local/go/src/sync/cond.go:70 +0x85
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).waitForCurrentWritersToComplete(0xc0002ee4d0)
	/github/workspace/weed/mount/page_writer/upload_pipeline_lock.go:58 +0x32
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).FlushAll(0xc0002ee4d0)
	/github/workspace/weed/mount/page_writer/upload_pipeline.go:151 +0x25
github.com/seaweedfs/seaweedfs/weed/mount.(*ChunkedDirtyPages).FlushData(0xc00087e840)
	/github/workspace/weed/mount/dirty_pages_chunked.go:54 +0x29
github.com/seaweedfs/seaweedfs/weed/mount.(*PageWriter).FlushData(...)
	/github/workspace/weed/mount/page_writer.go:50
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).doFlush(0xc0006ad600, 0xc00030d380, 0x0, 0x0)
	/github/workspace/weed/mount/weedfs_file_sync.go:101 +0x169
github.com/seaweedfs/seaweedfs/weed/mount.(*WFS).Flush(0xc0006ad600, 0xc001a594a8?, 0xc0004c1ca0)
	/github/workspace/weed/mount/weedfs_file_sync.go:59 +0x48
github.com/hanwen/go-fuse/v2/fuse.doFlush(0xc0000da870?, 0xc0004c1b08)

SaveContent -> MemChunk.RLock ->
	ChunkedDirtyPages.saveChunkedFileIntervalToStorage
	pages.fh.AddChunks([]*filer_pb.FileChunk{chunk})
		fh.entryLock.Lock()

sync.(*RWMutex).Lock(0x0?)
	/usr/local/go/src/sync/rwmutex.go:146 +0x31
github.com/seaweedfs/seaweedfs/weed/mount.(*FileHandle).AddChunks(0xc00030d380, {0xc00028bdc8, 0x1, 0x1})
	/github/workspace/weed/mount/filehandle.go:93 +0x45
github.com/seaweedfs/seaweedfs/weed/mount.(*ChunkedDirtyPages).saveChunkedFileIntervalToStorage(0xc00087e840, {0x2be7ac0, 0xc00018d9e0}, 0x0, 0x121, 0x17e3c624565ace45, 0x1?)
	/github/workspace/weed/mount/dirty_pages_chunked.go:80 +0x2d4
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*MemChunk).SaveContent(0xc0008d9130, 0xc0008093e0)
	/github/workspace/weed/mount/page_writer/page_chunk_mem.go:115 +0x112
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).moveToSealed.func1()
	/github/workspace/weed/mount/page_writer/upload_pipeline.go:187 +0x55
github.com/seaweedfs/seaweedfs/weed/util.(*LimitedConcurrentExecutor).Execute.func1()
	/github/workspace/weed/util/limited_executor.go:38 +0x62
created by github.com/seaweedfs/seaweedfs/weed/util.(*LimitedConcurrentExecutor).Execute in goroutine 1
	/github/workspace/weed/util/limited_executor.go:33 +0x97

On metadata update
fh.entryLock.Lock()
	fh.dirtyPages.Destroy()
		up.chunksLock.Lock => each sealed chunk.FreeReference => MemChunk.Lock

goroutine 134 [sync.RWMutex.Lock, 71 minutes]:
sync.runtime_SemacquireRWMutex(0xc0007c3558?, 0xea?, 0x3fb0800?)
	/usr/local/go/src/runtime/sema.go:87 +0x25
sync.(*RWMutex).Lock(0xc0007c35a8?)
	/usr/local/go/src/sync/rwmutex.go:151 +0x6a
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*MemChunk).FreeResource(0xc0008d9130)
	/github/workspace/weed/mount/page_writer/page_chunk_mem.go:38 +0x2a
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*SealedChunk).FreeReference(0xc00071cdb0, {0xc0006ba1a0, 0x20})
	/github/workspace/weed/mount/page_writer/upload_pipeline.go:38 +0xb7
github.com/seaweedfs/seaweedfs/weed/mount/page_writer.(*UploadPipeline).Shutdown(0xc0002ee4d0)
	/github/workspace/weed/mount/page_writer/upload_pipeline.go:220 +0x185
github.com/seaweedfs/seaweedfs/weed/mount.(*ChunkedDirtyPages).Destroy(0xc0008cea40?)
	/github/workspace/weed/mount/dirty_pages_chunked.go:87 +0x17
github.com/seaweedfs/seaweedfs/weed/mount.(*PageWriter).Destroy(...)
	/github/workspace/weed/mount/page_writer.go:78
github.com/seaweedfs/seaweedfs/weed/mount.NewSeaweedFileSystem.func3({0xc00069a6c0, 0x30}, 0x6?)
	/github/workspace/weed/mount/weedfs.go:119 +0x17a
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.NewMetaCache.func1({0xc00069a6c0?, 0xc00069a480?}, 0x4015b40?)
	/github/workspace/weed/mount/meta_cache/meta_cache.go:37 +0x1c
github.com/seaweedfs/seaweedfs/weed/mount/meta_cache.SubscribeMetaEvents.func1(0xc000661810)
	/github/workspace/weed/mount/meta_cache/meta_cache_subscribe.go:43 +0x570

* use locked entry everywhere

* modifiable remote entry

* skip locking after getting lock from fhLockTable
2024-07-24 23:46:40 -07:00
Chris Lu 5059a7a621 Update README.md 2024-06-27 08:50:51 -07:00
Chris Lu d87f884186 Update README.md 2024-06-16 09:25:54 -07:00
Chris Lu cfcf383ee7 fix wrong prefix example 2024-05-21 21:45:29 -07:00
Chris Lu 32cb9b3276 fix unaligned 64-bit atomic operation in weed mount on arm when readi… (#5308)
fix unaligned 64-bit atomic operation in weed mount on arm when reading a file

fix #5306
2024-02-19 18:51:45 -08:00
Chris Lu 966cf91dd6 Update go.mod 2024-02-14 08:29:30 -08:00
Chris Lu 580940bf82 Merge accumulated changes related to message queue (#5098)
* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* balance partitions on brokers

* prepare topic partition first and then publish, move partition

* purge unused APIs

* clean up

* adjust logs

* add BalanceTopics() grpc API

* configure topic

* configure topic command

* refactor

* repair missing partitions

* sequence of operations to ensure ordering

* proto to close publishers and consumers

* rename file

* topic partition versioned by unixTimeNs

* create local topic partition

* close publishers

* randomize the client name

* wait until no publishers

* logs

* close stop publisher channel

* send last ack

* comments

* comment

* comments

* support list of brokers

* add cli options

* Update .gitignore

* logs

* return io.eof directly

* refactor

* optionally create topic

* refactoring

* detect consumer disconnection

* sub client wait for more messages

* subscribe by time stamp

* rename

* rename to sub_balancer

* rename

* adjust comments

* rename

* fix compilation

* rename

* rename

* SubscriberToSubCoordinator

* sticky rebalance

* go fmt

* add tests

* tracking topic=>broker

* merge

* comment
2023-12-11 12:05:54 -08:00
Chris Lu 76a62859ff fix lock table (#4863)
* adjust for better logs

* if shared lock, still need to wait for exclusive lock to release

* fix compilation

* fix waiting condition

* avoid deleting the entry too early
2023-09-23 12:51:01 -07:00
Chris Lu 9215ba24be Revert "Add disk type to prometheus metrics" (#4777)
Revert "Add disk type to prometheus metrics (#4736)"

This reverts commit 9956d93a40.
2023-08-21 11:38:12 -07:00
Chris Lu 2c4dbaedf2 Update helm_chart_release.yml 2023-02-21 11:56:29 -08:00
chrislusf 673214574a Publish seaweedfs-3.43.tgz 2023-02-21 01:05:07 +00:00
Chris Lu d531fffc89 Revert "build(deps): bump github.com/seaweedfs/goexif from 1.0.3 to 2.0.0+incompatible" (#4232)
Revert "build(deps): bump github.com/seaweedfs/goexif from 1.0.3 to 2.0.0+incompatible (#4229)"

This reverts commit e70cf681fe.
2023-02-20 12:23:33 -08:00
Chris Lu e3c48e987b Update helm_chart_release.yml 2023-02-18 20:40:01 -08:00
Chris Lu bac45912e3 go 1.20 (#4192) 2023-02-08 16:41:23 -08:00
Chris Lu e98739598a Update README.md 2023-01-23 12:53:57 -08:00
Chris Lu ca901742cb Update README.md 2023-01-16 17:55:55 -08:00
Chris Lu a3060c11df increase timeout 2023-01-15 21:39:55 -08:00
Chris Lu 1cd2e64aac merge chunks during upload (#4130)
* merge chunks during upload

* fix test
2023-01-12 23:07:36 -08:00
Chris Lu d4566d4aaa more solid weed mount (#4089)
* compare chunks by timestamp

* fix slab clearing error

* fix test compilation

* move oldest chunk to sealed, instead of by fullness

* lock on fh.entryViewCache

* remove verbose logs

* revert slat clearing

* less logs

* less logs

* track write and read by timestamp

* remove useless logic

* add entry lock on file handle release

* use mem chunk only, swap file chunk has problems

* comment out code that maybe used later

* add debug mode to compare data read and write

* more efficient readResolvedChunks with linked list

* small optimization

* fix test compilation

* minor fix on writer

* add SeparateGarbageChunks

* group chunks into sections

* turn off debug mode

* fix tests

* fix tests

* tmp enable swap file chunk

* Revert "tmp enable swap file chunk"

This reverts commit 985137ec47.

* simple refactoring

* simple refactoring

* do not re-use swap file chunk. Sealed chunks should not be re-used.

* comment out debugging facilities

* either mem chunk or swap file chunk is fine now

* remove orderedMutex  as *semaphore.Weighted

not found impactful

* optimize size calculation for changing large files

* optimize performance to avoid going through the long list of chunks

* still problems with swap file chunk

* rename

* tiny optimization

* swap file chunk save only successfully read data

* fix

* enable both mem and swap file chunk

* resolve chunks with range

* rename

* fix chunk interval list

* also change file handle chunk group when adding chunks

* pick in-active chunk with time-decayed counter

* fix compilation

* avoid nil with empty fh.entry

* refactoring

* rename

* rename

* refactor visible intervals to *list.List

* refactor chunkViews to *list.List

* add IntervalList for generic interval list

* change visible interval to use IntervalList in generics

* cahnge chunkViews to *IntervalList[*ChunkView]

* use NewFileChunkSection to create

* rename variables

* refactor

* fix renaming leftover

* renaming

* renaming

* add insert interval

* interval list adds lock

* incrementally add chunks to readers

Fixes:
1. set start and stop offset for the value object
2. clone the value object
3. use pointer instead of copy-by-value when passing to interval.Value
4. use insert interval since adding chunk could be out of order

* fix tests compilation

* fix tests compilation
2023-01-02 23:20:45 -08:00
Chris Lu dac9c28d05 Revert "refactor: moved to locked entry" (#4035)
* Revert "refactor: moved to locked entry"

This reverts commit 94bc9afd9d.

* only add LockedEntry, no changes to entryLock

* fix compilation
2022-12-05 12:32:27 -08:00
Chris Lu f7e4359b59 Temporarily enable cgo
Temporarily enable cgo following findings from https://github.com/seaweedfs/seaweedfs/discussions/3152 by https://github.com/dyus

Resolve build issue:
```
# github.com/mattn/go-ieproxy
/go/pkg/mod/github.com/mattn/go-ieproxy@v0.0.3/ieproxy.go:36:9: undefined: getConf
/go/pkg/mod/github.com/mattn/go-ieproxy@v0.0.3/ieproxy.go:41:9: undefined: reloadConf
/go/pkg/mod/github.com/mattn/go-ieproxy@v0.0.3/ieproxy.go:48:2: undefined: overrideEnvWithStaticProxy
/go/pkg/mod/github.com/mattn/go-ieproxy@v0.0.3/ieproxy.go:53:13: psc.findProxyForURL undefined (type *ProxyScriptConf has no field or method findProxyForURL, but does have FindProxyForURL)
```
2022-08-24 02:24:21 -07:00
Chris Lu e88392b50f Fix s3 pagination (#3436)
* Revert previous changes

* s3: use cursor to track tree traversal

fix https://github.com/seaweedfs/seaweedfs/issues/3166

* special cases for empty prefix and empty directory

* use constants

* address empty folder

* undo local changes

* fix IsTruncated

* adjust counting directories

* fix cases when prefix is a directory

* s3: handle directory object

works for

aws --endpoint-url http://127.0.0.1:8333/ s3api list-objects-v2 --bucket test --prefix "fakedir"
2022-08-15 00:30:19 -07:00
Chris Lu 9b006250b2 Update pull_request_template.md 2022-08-09 01:25:55 -07:00
Chris Lu 33a5225302 Update README.md 2022-08-08 15:58:36 -07:00
Chris Lu fdd85b34f9 Merge pull request #3399 from kaiwalyajoshi/kjoshi/init-container-support
feat: Add support for k8s Init-Containers.
2022-08-03 14:58:02 -07:00
Chris Lu fc8035d672 Merge pull request #3394 from kmlebedev/metricsReplicatedWrite
Detailed metrics VolumeServerRequestHistogram for writing to disk and replication
2022-08-01 13:31:01 -07:00
Chris Lu 25b9062152 Merge pull request #3390 from kmlebedev/gentle_vacuum
vacuum stats of percent util LA
2022-08-01 09:33:24 -07:00
Chris Lu f0e0073b84 Merge pull request #3391 from seaweedfs/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.66
Bump github.com/aws/aws-sdk-go from 1.44.65 to 1.44.66
2022-08-01 08:54:41 -07:00
Chris Lu 0e441b48a6 Merge pull request #3392 from seaweedfs/dependabot/go_modules/github.com/fclairamb/ftpserverlib-0.19.0
Bump github.com/fclairamb/ftpserverlib from 0.18.0 to 0.19.0
2022-08-01 08:51:35 -07:00
Chris Lu ed5b08c284 Merge pull request #3393 from seaweedfs/dependabot/go_modules/google.golang.org/protobuf-1.28.1
Bump google.golang.org/protobuf from 1.28.0 to 1.28.1
2022-08-01 08:51:27 -07:00
Chris Lu b59bc607bf Merge pull request #3338 from kmlebedev/issues/3083
rollback over onPeerUpdate implementation of automatic clean-up of failed servers in favor of synchronous ping
2022-08-01 08:23:10 -07:00
Chris Lu 69e4725812 Merge pull request #3387 from i404788/master
Added details on helm deployment
2022-07-31 17:14:54 -07:00
Chris Lu 0bb3ba17ae Merge pull request #3385 from Woellchen/feature/cluster-status-return-healthy
Add healthy indicator for raft status
2022-07-30 11:55:30 -07:00
Chris Lu c15b356b81 Merge pull request #3379 from seaweedfs/dependabot/go_modules/modernc.org/sqlite-1.18.0
Bump modernc.org/sqlite from 1.17.3 to 1.18.0
2022-07-29 01:36:14 -07:00
Chris Lu 39c6d53a1b Merge pull request #3383 from seaweedfs/dependabot/go_modules/github.com/ydb-platform/ydb-go-sdk/v3-3.30.0
Bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.29.5 to 3.30.0
2022-07-29 01:35:20 -07:00
Chris Lu ef84609010 Merge pull request #3382 from seaweedfs/dependabot/go_modules/github.com/arangodb/go-driver-1.3.3
Bump github.com/arangodb/go-driver from 1.3.2 to 1.3.3
2022-07-29 01:35:14 -07:00
Chris Lu b67fe6223b Merge pull request #3381 from seaweedfs/dependabot/go_modules/google.golang.org/api-0.90.0
Bump google.golang.org/api from 0.87.0 to 0.90.0
2022-07-29 01:35:08 -07:00
Chris Lu b09dab3477 Merge pull request #3380 from seaweedfs/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.65
Bump github.com/aws/aws-sdk-go from 1.44.56 to 1.44.65
2022-07-29 01:35:01 -07:00
Chris Lu 8c4edf7b40 Added SeaweedMQ_Architecture.png 2022-07-28 23:22:06 -07:00
Chris Lu 3e7e922d16 Merge pull request #3378 from vanhtuan0409/change-put-policy
PutUserAction should completely replace identity actions
2022-07-28 19:43:25 -07:00
Chris Lu 32d0413be1 Merge pull request #3374 from famosss/fixcreatebucket
fix: Buckets are not created and deleted correctly on the filer with …
2022-07-27 22:37:18 -07:00
Chris Lu b7e4e26778 Merge pull request #3371 from askeipx/issues/3341
delete disk_size metrics when collection deleted
2022-07-27 11:25:42 -07:00
Chris Lu 1f592ae933 Merge pull request #3372 from kmlebedev/replicateWithExcludeDirectories 2022-07-27 09:03:23 -07:00
Chris Lu f18bc2d9dd Merge pull request #3367 from kaiwalyajoshi/kjoshi/v3.18-hostpath-fixes 2022-07-26 08:08:08 -07:00
Chris Lu e05641291e Merge pull request #3364 from kmlebedev/fix_login_else 2022-07-26 07:44:03 -07:00
Chris Lu 03ca0ca2c6 Merge pull request #3358 from chrislusf/dependabot/go_modules/cloud.google.com/go/pubsub-1.24.0 2022-07-25 08:28:11 -07:00
Chris Lu 0f19ad9e87 Merge pull request #3357 from chrislusf/dependabot/go_modules/github.com/Shopify/sarama-1.35.0 2022-07-25 08:26:23 -07:00
Chris Lu 498599ed55 Merge pull request #3356 from chrislusf/dependabot/github_actions/docker/build-push-action-3.1.0 2022-07-25 08:24:04 -07:00
Chris Lu becb987672 Merge pull request #3359 from chrislusf/dependabot/go_modules/github.com/ydb-platform/ydb-go-sdk/v3-3.29.5 2022-07-25 08:23:41 -07:00
Chris Lu bfbb9fffa2 Merge pull request #3360 from chrislusf/dependabot/go_modules/cloud.google.com/go/storage-1.24.0 2022-07-25 08:23:23 -07:00
Chris Lu 068b4401fe Merge pull request #3361 from chrislusf/dependabot/go_modules/github.com/linxGnu/grocksdb-1.7.4 2022-07-25 08:23:12 -07:00
Chris Lu 578eb8f39a Merge pull request #3354 from guo-sj/correct_comment 2022-07-24 21:43:48 -07:00
Chris Lu 0716092b39 Merge pull request #3350 from shichanglin5/optimize_masterclient_vidmap
Solve the problem that `LookupFileId` lookup urls is empty due to lea…
2022-07-22 02:57:50 -07:00
Chris Lu 8d97add89c Merge pull request #3348 from ningfdx/remote
optimiz: master ui will render data in order
2022-07-22 02:43:07 -07:00
Chris Lu 9ec0d1caaa Merge pull request #3337 from guol-fnst/loading_volume 2022-07-20 09:06:06 -07:00
Chris Lu efec31de8d Merge pull request #3340 from vanhtuan0409/put-user-policy 2022-07-20 09:01:14 -07:00
Chris Lu 4820b594a7 Merge pull request #3298 from kmlebedev/evacuateTargetServer
volume server evacuate to target server
2022-07-19 13:56:49 -07:00
Chris Lu 7b80605538 Merge pull request #3339 from kmlebedev/issues/3320 2022-07-19 13:53:29 -07:00
Chris Lu 9667588af0 Merge pull request #3318 from kmlebedev/issues/3310
Use fallback if urls are not found
2022-07-19 11:38:43 -07:00
Chris Lu f0d560060f Merge pull request #3336 from kmlebedev/raftSrvRemove
raftServerRemoval typo and logs
2022-07-19 11:32:17 -07:00
Chris Lu f909265721 Merge pull request #3329 from chrislusf/dependabot/github_actions/actions/dependency-review-action-2.0.4
Bump actions/dependency-review-action from 2.0.2 to 2.0.4
2022-07-18 10:36:51 -07:00
Chris Lu ffec365ddf Merge pull request #3330 from chrislusf/dependabot/go_modules/google.golang.org/grpc-1.48.0
Bump google.golang.org/grpc from 1.47.0 to 1.48.0
2022-07-18 10:36:43 -07:00
Chris Lu 206715bcd8 Merge pull request #3331 from chrislusf/dependabot/go_modules/github.com/ydb-platform/ydb-go-sdk/v3-3.28.3
Bump github.com/ydb-platform/ydb-go-sdk/v3 from 3.28.0 to 3.28.3
2022-07-18 10:36:37 -07:00
Chris Lu 4c0cd753e9 Merge pull request #3332 from chrislusf/dependabot/go_modules/google.golang.org/api-0.87.0
Bump google.golang.org/api from 0.86.0 to 0.87.0
2022-07-18 10:36:27 -07:00
Chris Lu 1567ea2f44 Merge pull request #3333 from chrislusf/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.56
Bump github.com/aws/aws-sdk-go from 1.44.51 to 1.44.56
2022-07-18 10:36:18 -07:00
Chris Lu 84ed7ee393 Merge pull request #3334 from chrislusf/dependabot/go_modules/go.mongodb.org/mongo-driver-1.10.0
Bump go.mongodb.org/mongo-driver from 1.9.1 to 1.10.0
2022-07-18 10:35:57 -07:00
Chris Lu abeb7f65f8 Merge pull request #3314 from shichanglin5/fix_ETag
File upload should succeed should return `ETag` instead of `Etag`
2022-07-14 15:35:41 -07:00
Chris Lu 957c9a2eb2 Merge pull request #3309 from guol-fnst/loading_volume
optimiz concurrency
2022-07-13 23:12:24 -07:00
Chris Lu 1a130125de Merge pull request #3308 from guo-sj/check_duplicate_ak 2022-07-13 09:23:37 -07:00
Chris Lu 31f9f528db Merge pull request #3305 from shichanglin5/fix_iam_shell_override
Check whether there is a duplicate accessKey when modifying iam
2022-07-12 21:47:39 -07:00
Chris Lu fba5219dab Merge pull request #3303 from guol-fnst/loading_volume
speeding up loading volumes
2022-07-12 03:01:24 -07:00
Chris Lu de97ba94c3 Merge pull request #3302 from guo-sj/fix_put_user_policy 2022-07-11 21:15:37 -07:00
Chris Lu cf241c8901 Merge pull request #3301 from chrislusf/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.51 2022-07-11 10:13:34 -07:00
Chris Lu ebcce363e2 Merge pull request #3300 from chrislusf/dependabot/go_modules/github.com/ydb-platform/ydb-go-sdk/v3-3.28.0 2022-07-11 10:13:09 -07:00
Chris Lu 88dcb17be3 Merge pull request #3299 from chrislusf/dependabot/github_actions/actions/setup-go-3.2.1 2022-07-11 10:12:40 -07:00
Chris Lu 7929a50327 Merge pull request #3296 from guo-sj/fix_put_user_policy
refine PutUserPolicy
2022-07-11 01:49:25 -07:00
Chris Lu a77c2232be Merge pull request #3293 from guo-sj/fix_save_inside_filer 2022-07-10 19:19:17 -07:00
Chris Lu b9518e06f5 Merge pull request #3290 from paochiang/fix_dedup_subscribers 2022-07-08 07:40:52 -07:00
Chris Lu 22e05a2942 Merge pull request #3289 from guo-sj/fix_create_policy 2022-07-08 02:46:27 -07:00
Chris Lu aab3ed2347 Merge pull request #3288 from paochiang/fix_spell_error
fix the spelling error
2022-07-08 01:48:35 -07:00
Chris Lu d6a5441391 Merge pull request #3286 from duanhongyi/master
filer tikv support tls
2022-07-07 23:47:56 -07:00
Chris Lu fa8e33ccb8 Update binaries_dev.yml 2022-07-07 22:11:44 -07:00
Chris Lu bfea7008f3 Merge pull request #3277 from kmlebedev/rabbitry_enable_durable 2022-07-06 00:19:49 -07:00
Chris Lu 05510630fd Merge pull request #3270 from chrislusf/dependabot/go_modules/cloud.google.com/go/pubsub-1.23.1 2022-07-04 12:09:06 -07:00
Chris Lu f69a8127a4 Merge pull request #3271 from chrislusf/dependabot/go_modules/github.com/stretchr/testify-1.8.0 2022-07-04 12:06:46 -07:00
Chris Lu 9ea1d093b0 Merge pull request #3272 from chrislusf/dependabot/go_modules/github.com/aws/aws-sdk-go-1.44.47 2022-07-04 12:06:36 -07:00
Chris Lu c2c9c6d60a Merge pull request #3273 from chrislusf/dependabot/go_modules/modernc.org/sqlite-1.17.3 2022-07-04 12:06:27 -07:00
Chris Lu 00d5be61d3 Merge pull request #3274 from chrislusf/dependabot/go_modules/google.golang.org/api-0.86.0 2022-07-04 12:06:13 -07:00
Chris Lu a122baa427 Merge pull request #3268 from guol-fnst/fix_usage
add getting bucket quota
2022-07-04 00:44:43 -07:00
Chris Lu 267d45c313 Merge pull request #3266 from guol-fnst/fix_usage
fix usage
2022-07-03 22:11:37 -07:00
Chris Lu c349f81195 Update binaries_dev.yml 2022-07-03 16:16:44 -07:00