Github-Mirror/seaweedfs
1
0 Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-10-12 17:27:50 +02:00
Code Issues Packages Projects Releases Wiki Activity

Phase 5: Add Protobuf decoder support for Kafka Gateway

Browse Source 
- Add ProtobufDecoder with dynamic message handling via protoreflect
- Support Protobuf binary data decoding to Go maps and SMQ RecordValue
- Implement Confluent Protobuf envelope parsing with varint indexes
- Add Protobuf-to-RecordType inference with nested message support
- Include Protobuf encoding for round-trip message reconstruction
- Integrate Protobuf support into Schema Manager with caching
- Add varint encoding/decoding utilities for Protobuf indexes
- Prepare foundation for full FileDescriptorSet parsing in Phase 8

This enables the Kafka Gateway to process Protobuf-schematized messages.
This commit is contained in:
chrislu committed 2025-09-11 11:40:42 -07:00
1 parent 7b47ad613b
commit 394f49a25f
5 files changed
+605 -13
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

go.mod
+1 -1
View File
@@ -111,7 +111,7 @@ require (
google.golang.org/api v0.247.0
google.golang.org/genproto v0.0.0-20250715232539-7130f93afb79 // indirect
google.golang.org/grpc v1.75.0
google.golang.org/protobuf v1.36.8
google.golang.org/protobuf v1.36.9
gopkg.in/inf.v0 v0.9.1 // indirect
modernc.org/b v1.0.0 // indirect
modernc.org/mathutil v1.7.1