▲ 14 r/apachespark
Apache Spark 3.5.3 vs 4.1.0 — What actually changed, and should you migrate?
Java 8/11 is disabled
Scala 2.12 is disabled
Python 3.9 is disabled
Should we really upgrade to 4.1.0 or just continue with spark 3.5.x or lower?
For the context, most of the production pipelines might be running on 3.5.x or lower?
Any thoughts?
u/DeeRockzz — 17 days ago