Skip to content

Development

Edgar Ruiz edited this page Jul 7, 2022 · 6 revisions

Update JAR files

  • Load the package into your global environment

    devtools::load_all(".")
  • Download the necessary Sacala compilers. The function will only download and unpack the files if they are missing.

    download_scalac()
  • Verify that all the needed Spark versions are locally installed. Pass install = TRUE as an argument if you want the function to automatically install the missing versions.

    sparklyr_jar_verify_spark()
  • Update jar files. The target folder will be the inst/java/ folder

    compile_package_jars()
  • Updated embedded sources

    spark_update_embedded_sources(
      jars_to_skip = "sparklyr-1.5-2.10.jar"
    )