
▲ 7 r/apachespark
Built a small tool to inspect Delta Lake pruning and data skipping. Could this be useful?
Hi! I’ve been working quite a bit with Delta tables lately, so I ended up building a small tool to better understand how partition pruning and data skipping actually work.
Not sure if this is useful beyond my own use case or if it’s just something I built to explore things a bit.
Would be curious to hear what others think. This is the link to the repo: https://github.com/cdelmonte-zg/delta-explain
u/LongjumpingOption523 — 12 days ago