Github-Mirror/seaweedfs
1
0 Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-10-20 13:04:25 +02:00
Code Issues Packages Projects Releases Wiki Activity

Phase 5: Add Protobuf decoder support for Kafka Gateway

Browse Source 
- Add ProtobufDecoder with dynamic message handling via protoreflect
- Support Protobuf binary data decoding to Go maps and SMQ RecordValue
- Implement Confluent Protobuf envelope parsing with varint indexes
- Add Protobuf-to-RecordType inference with nested message support
- Include Protobuf encoding for round-trip message reconstruction
- Integrate Protobuf support into Schema Manager with caching
- Add varint encoding/decoding utilities for Protobuf indexes
- Prepare foundation for full FileDescriptorSet parsing in Phase 8

This enables the Kafka Gateway to process Protobuf-schematized messages.
This commit is contained in:
chrislu committed 2025-09-11 11:40:42 -07:00
1 parent 7b47ad613b
commit 394f49a25f
5 files changed
+605 -13
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

go.sum
+2
View File
@@ -2650,6 +2650,8 @@ google.golang.org/protobuf v1.28.1/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqw
google.golang.org/protobuf v1.30.0/go.mod h1:HV8QOd/L58Z+nl8r43ehVNZIU/HEI6OcFqwMG9pJV4I=
google.golang.org/protobuf v1.36.8 h1:xHScyCOEuuwZEc6UtSOvPbAT4zRh0xcNRYekJwfqyMc=
google.golang.org/protobuf v1.36.8/go.mod h1:fuxRtAxBytpl4zzqUh6/eyUujkJdNiuEkXntxiD/uRU=
google.golang.org/protobuf v1.36.9 h1:w2gp2mA27hUeUzj9Ex9FBjsBm40zfaDtEWow293U7Iw=
google.golang.org/protobuf v1.36.9/go.mod h1:fuxRtAxBytpl4zzqUh6/eyUujkJdNiuEkXntxiD/uRU=
gopkg.in/alecthomas/kingpin.v2 v2.2.6/go.mod h1:FMv+mEhP44yOT+4EoQTLFTRgOQ1FBLkstjWtayDeSgw=
gopkg.in/check.v1 v0.0.0-20161208181325-20d25e280405/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=
gopkg.in/check.v1 v1.0.0-20180628173108-788fd7840127/go.mod h1:Co6ibVJAznAaIkqp8huTwlJQCZ016jof/cbN4VW5Yz0=