 chrislu
|
6870eeba11
|
mq(kafka): Major debugging progress on Metadata v7 compatibility
BREAKTHROUGH DISCOVERIES:
✅ Performance issue SOLVED: Debug logging was causing 6.8s delays → now 20μs
✅ Metadata v7 format partially working: kafka-go accepts response (no disconnect)
✅ kafka-go workflow confirmed: Never calls Produce API - validates Metadata first
CURRENT ISSUE IDENTIFIED:
❌ kafka-go validates Metadata response → returns '[3] Unknown Topic Or Partition'
❌ Error comes from kafka-go's internal validation, not our API handlers
❌ kafka-go retries with more Metadata requests (normal retry behavior)
DEBUGGING IMPLEMENTED:
- Added comprehensive API request logging to confirm request flow
- Added detailed Produce API debugging (unused but ready)
- Added Metadata response hex dumps for format validation
- Confirmed no unsupported API calls being made
METADATA V7 COMPLIANCE:
✅ Added cluster authorized operations field
✅ Added topic UUID fields (16-byte null UUID)
✅ Added is_internal_topic field
✅ Added topic authorized operations field
✅ Response format appears correct (120 bytes)
NEXT: Debug why kafka-go rejects our otherwise well-formed Metadata v7 response.
Likely broker address mismatch, partition state issue, or missing v7 field.
|
2025-09-10 14:55:30 -07:00 |
|