Skip to content

Conversation

SemyonSinchenko
Copy link
Collaborator

@SemyonSinchenko SemyonSinchenko commented Apr 14, 2025

What changes were proposed in this pull request?

  • new pypi publish CI
  • small changes to the build system
  • a new helper-function that simplify adding GraphFrames JAR to the Session

P.S. Just realized, that graphframes can work only with SpJust realized, that graphframes can work only with Spark 3.5+ark 3.5+

Why are the changes needed?

As described in the issue. Close #491

NOTE This won't work out-of-the box!!! It requires changes in the repository setting (write access) which only admins can do. Me and @rjurney are just collaborators, not admins / owners / members.

Just realized, that graphframes can work only with Spark 3.5+
@SemyonSinchenko SemyonSinchenko requested a review from rjurney April 14, 2025 17:03
@SemyonSinchenko SemyonSinchenko self-assigned this Apr 14, 2025
@SemyonSinchenko SemyonSinchenko added pyspark-classic GraphFrames on PySpark Classic pyspark-connect GraphFrames on PySpark Connect labels Apr 14, 2025
@SemyonSinchenko SemyonSinchenko merged commit 1003f2b into graphframes:master Apr 16, 2025
5 checks passed
@SemyonSinchenko SemyonSinchenko deleted the 491-python-build branch July 19, 2025 11:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pyspark-classic GraphFrames on PySpark Classic pyspark-connect GraphFrames on PySpark Connect
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Build a graphframes package and publish it to PyPi
2 participants