ClassNotFoundException: sparkhail.CreateOption with Spark3.5

[mystic985]

I was trying to use sparkhail. This version works with spark2.4, but not Spark3.5.

sc <- spark_connect(master = "local", config = hail_config())

• Using Spark: 3.5.0
  Warning message:
  In normalizePath(unlist(unique(all_jars))) :
  path[1]="": No such file or directory
  Connected to your session in progress, last started 2023-Nov-06 20:45:00 UTC (1 hour ago)

hl <- hail_context(sc)
Error: java.lang.ClassNotFoundException: sparkhail.CreateOption
at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:594)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:315)
at sparklyr.StreamHandler.handleMethodCall(stream.scala:111)
at sparklyr.StreamHandler.read(stream.scala:62)
at sparklyr.BackendHandler.$anonfun$channelRead0$1(handler.scala:60)
at scala.util.control.Breaks.breakable(Breaks.scala:42)
at sparklyr.BackendHandler.channelRead0(handler.scala:41)
at sparklyr.BackendHandler.channelRead0(handler.scala:14)
at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444)
at io.netty.channel.AbstractChannelHandlerContext.invok