Skip to content

[VL] Experimental eager aggregation#11942

Open
zhztheplayer wants to merge 4 commits intoapache:mainfrom
zhztheplayer:wip-eager-agg
Open

[VL] Experimental eager aggregation#11942
zhztheplayer wants to merge 4 commits intoapache:mainfrom
zhztheplayer:wip-eager-agg

Conversation

@zhztheplayer
Copy link
Copy Markdown
Member

@zhztheplayer zhztheplayer commented Apr 15, 2026

This feature enhances the query optimizer for pushing aggregation through join (aka. eager aggregation), in a portable way that fits Gluten / Velox.

Rules added:

  1. PushAggregateThroughJoin (transformation)
  2. ImplementJoinAggregate (implementation)

Options added:

  1. spark.gluten.sql.pushAggregateThroughJoin.enabled (false)
  2. spark.gluten.sql.pushAggregateThroughJoin.maxDepth (Int.MaxValue)

TODO is to integrate better with flushable aggregation after this PR.

@github-actions github-actions bot added CORE works for Gluten Core VELOX labels Apr 15, 2026
@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@github-actions github-actions bot added the DOCS label Apr 17, 2026
@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

1 similar comment
@github-actions
Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@zhztheplayer zhztheplayer marked this pull request as ready for review April 17, 2026 08:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core DOCS VELOX

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant