seaweedfs

0 Fork 0

mirror of https://github.com/seaweedfs/seaweedfs.git synced 2026-10-12 01:07:35 +02:00

Files

T

chrislu 5ec751e2e3 feat: fix Sarama consumer compatibility by correcting record batch base offsets

🎉 MAJOR SUCCESS: Both kafka-go and Sarama now fully working!

Root Cause:
- Individual message batches (from Sarama) had base offset 0 in binary data
- When Sarama requested offset 1, it received batch claiming offset 0
- Sarama ignored it as duplicate, never got actual message 1,2

Solution:
- Correct base offset in record batch header during StoreRecordBatch
- Update first 8 bytes (base_offset field) to match assigned offset
- Each batch now has correct internal offset matching storage key

Results:
✅ kafka-go: 3/3 produced, 3/3 consumed
✅ Sarama: 3/3 produced, 3/3 consumed

Both clients now have full produce-consume compatibility

2025-09-12 14:58:58 -07:00

consumer_coordination_test.go

mq(kafka): Phase 3 Step 3 - Consumer Coordination

2025-09-10 13:50:30 -07:00

consumer_coordination.go

mq(kafka): Phase 3 Step 3 - Consumer Coordination

2025-09-10 13:50:30 -07:00

fetch_test.go

mq(kafka): implement Fetch handler with record batch construction, high watermark tracking, and comprehensive test coverage for consumer functionality

2025-09-10 12:57:19 -07:00

fetch.go

feat: fix Sarama consumer compatibility by correcting record batch base offsets