BigHugger
sk Skill · Galius5136

spark-3.5-updates

Knowledge base for Spark 3.1→3.5 updates not covered by the Learning Spark 2nd Ed book. Use for: (A) Pandas UDF and Arrow APIs (exam Sec 7 obj 2 'Create and invoke Pandas UDF'); (B) new built-in functions added in 3.3-3.5 (exam Sec 3); (C) AQE evolution post-3.0 — default-on, new sub-configs, SMJ→SHJ conversion (exam Sec 4). NOT covered here: Pandas API on Spark (see skill pandas-on-spark), Spark Connect (see skill…

installs 8w
0
30-day movement
starts with the next reading
Related entries
1
Connections
2
python
Host repository
Galius5136/databricks-spark-3.5-cert-prep
Allowed tools
Read, Grep
Host stars
13