Describe the bug

To Reproduce
.

Expected behavior
.

System [please complete the following information]:
.

Component

• Scala Core Internal
• Scala API
• Spark Connect Plugin
• PySpark Classic
• PySpark Connect

Additional context
.

Are you planning on creating a PR?

• I'm willing to make a pull-request