-
Notifications
You must be signed in to change notification settings - Fork 187
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Search before asking
- I had searched in the issues and found no similar issues.
Please describe the bug 🐞
Summary
The example notebook / script shipped with Apache Xtable no longer runs on the current main
branch.
Execution fails for three independent reasons:
- an incorrect JAR coordinate,
- an outdated method invocation, and
- the removal of an internal configuration class.
Details
- Incorrect core-JAR coordinate
<artifactId>xtable-core_${scala.binary.version}</artifactId>
The demo expects a module called xtable-core, but the artifact actually published to Maven Central is xtable-core_${scala.binary.version}.
Because the script loads the wrong coordinate, it cannot find core classes at runtime.
- Extra argument in HudiConversionSourceProvider.init
hudiConversionSourceProvider.init(
spark.sparkContext.hadoopConfiguration,
Collections.emptyMap() // <-- deprecated
)
init now accepts only a single Configuration parameter.
Passing the second argument produces:
cmd3.sc:19: too many arguments (2) for method init: (x$1: org.apache.hadoop.conf.Configuration)Unit
- PerTableConfigImpl removed (PR [297] Refactor config classes #480)
The demo still references PerTableConfigImpl, which was deleted in PR [297] Refactor config classes #480.
cmd3.sc:10: not found: value PerTableConfigImpl
The recommended pattern is to build a ConversionConfig and a list of TargetTable instances instead.
Proposed Fix
- Update the POM line to xtable-core_${scala.binary.version} or the demo scripts.
- Remove the second argument from HudiConversionSourceProvider.init(...).
- Replace PerTableConfigImpl with the new ConversionConfig + TargetTable builder API in the demo.
Are you willing to submit PR?
- I am willing to submit a PR!
- I am willing to submit a PR but need help getting started!
Code of Conduct
- I agree to follow this project's Code of Conduct
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working