Commit Graph
5 Commits
Author SHA1 Message Date
chrislu b35463c8b4 spark: fix flaky test by sorting DataFrame before first()
- In testLargeDataset(), add orderBy("value") before calling first()
- Parquet files don't guarantee row order, so first() on unordered
  DataFrame can return any row, making assertions flaky
- Sorting by 'value' ensures the first row is always the one with
  value=0, making the test deterministic and reliable
2025-11-22 13:04:44 -08:00
chrislu 6f905acfd2 spark: update compiler source/target from Java 8 to Java 11
- Fix inconsistency between maven.compiler.source/target (1.8) and
  surefire JVM args (Java 9+ module flags like --add-opens)
- Update to Java 11 to match CI environment (GitHub Actions uses Java 11)
- Docker environment uses Java 17 which is also compatible
- Java 11+ is required for the --add-opens/--add-exports flags used
  in the surefire configuration
2025-11-22 13:03:55 -08:00
chrislu fba36f8d1c java: fix NPE in SeaweedWrite and Makefile env var scope
- Add null check for HttpEntity in SeaweedWrite.multipartUpload()
  to prevent NPE when response.getEntity() returns null
- Fix Makefile test target to properly export SEAWEEDFS_TEST_ENABLED
  by setting it on the same command line as mvn test
- Update docker-compose commands to use V2 syntax (docker compose)
  for consistency with GitHub Actions workflow
2025-11-22 13:00:41 -08:00
chrislu e15e2e23c4 fix building 2025-11-22 12:56:43 -08:00
chrislu 89a6d42cee Complete Spark integration test suite 2025-11-22 12:23:48 -08:00