Skip to content
This repository has been archived by the owner on May 31, 2024. It is now read-only.

Support for newer versions of Spark? #34

Closed
tsbriggs02 opened this issue Feb 24, 2023 · 1 comment
Closed

Support for newer versions of Spark? #34

tsbriggs02 opened this issue Feb 24, 2023 · 1 comment
Labels
enhancement New feature or request

Comments

@tsbriggs02
Copy link

My company is currently using Pyspark 3.3.0. Delight looks awesome and I'd like to convince my company to use it, but the documentation says that "Delight is compatible with Spark 2.4.0 to Spark 3.1.1."

I'd like it if Delight could be made compatible with the Pyspark 3.3.x versions.

More generally, the last commit to the repo is from Sept. 2022 -- is Delight still being actively developed?

@tsbriggs02 tsbriggs02 added the enhancement New feature or request label Feb 24, 2023
@ImpSy
Copy link
Contributor

ImpSy commented Mar 9, 2023

Hello,

Sorry for the late response, Delight already support spark 3.3 (even though it's not stated in the readme)
The latest commit was actually to add tests for spark 3.3.0

As for the state of Delight, the project is currently working on auto-pilot but we respond to support request coming through the app

@ImpSy ImpSy closed this as completed May 31, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants