https://yaooqinn.github.io/tags/query-optimizer/ Recent content in Query-Optimizer on Kent Yao Hugo -- 0.157.0 en-us Wed, 27 May 2026 00:00:00 +0000 https://yaooqinn.github.io/posts/query-engines/rule-rewrite-blindspot-dsb/ Wed, 27 May 2026 00:00:00 +0000 https://yaooqinn.github.io/posts/query-engines/rule-rewrite-blindspot-dsb/ On TPC-H 10GB, a state-of-the-art learned rewriter cuts mean execution time from 69.84s to 37.57s — a 46% win. On DSB 10GB, the same rewriter takes 32.62s to 31.93s — a 2.1% non-event. The gap isn’t query difficulty; it’s whether the benchmark is in the rewriter’s training distribution. “Rule-based systems are stable and reliable” is often a benchmark artifact, not an engineering fact. https://yaooqinn.github.io/posts/query-engines/prompt-anatomy-for-plan-generation/ Wed, 27 May 2026 00:00:00 +0000 https://yaooqinn.github.io/posts/query-engines/prompt-anatomy-for-plan-generation/ DBPlanBench gets GPT-5 to deliver a 4.78× geometric-mean speedup on DataFusion TPC-H SF10 by letting the model rewrite physical plans directly. I read its sql_optimization_prompts.py end to end — 120 lines, 30 of methodology, 90 of contract. That ratio is the most transferable thing in the paper. https://yaooqinn.github.io/posts/spark/branch-flip-analysis-from-postgres-to-spark/ Tue, 26 May 2026 00:00:00 +0000 https://yaooqinn.github.io/posts/spark/branch-flip-analysis-from-postgres-to-spark/ An ETH paper finds 21 previously unknown performance bugs in PostgreSQL, MySQL, CockroachDB and MariaDB by flipping optimization branches on and off. The technique is conceptually simple, the surface in Spark is unusually inviting, and the open-source engine community already ships one of the building blocks. https://yaooqinn.github.io/posts/query-engines/llm-only-rewrite-doesnt-work/ Tue, 26 May 2026 00:00:00 +0000 https://yaooqinn.github.io/posts/query-engines/llm-only-rewrite-doesnt-work/ On TPC-H 10GB, asking GPT-4o to rewrite SQL takes mean execution time from 78.81s down to 74.92s — almost nothing. Swap in an open 14B model, feed it plans, add a reward, fine-tune once, and the same workload drops to 29.67s. Whether LLMs can help SQL rewriting is not a question about model strength; it’s a question about whether you’re willing to give the model the signals it actually needs. https://yaooqinn.github.io/posts/spark/llm-for-join-order-an-apache-spark-perspective/ Mon, 25 May 2026 00:00:00 +0000 https://yaooqinn.github.io/posts/spark/llm-for-join-order-an-apache-spark-perspective/ Databricks and UPenn put an LLM agent to work as an offline join-order tuner and got P90 latency down 41% / geomean 1.288× speedup on JOB’s 113 queries — beating even perfect cardinality estimates. From the trenches of an open-source query engine, here is what that result does and does not prove.