The Hidden DSL in Catalyst
How Spark’s internal rewriting framework — Catalyst — exposes an embedded DSL with a public extension surface, the same one Delta Lake and Iceberg use to plug into the optimizer pipeline.
Compilers
How Spark’s internal rewriting framework — Catalyst — exposes an embedded DSL with a public extension surface, the same one Delta Lake and Iceberg use to plug into the optimizer pipeline.