Skip to content

Remove redundant and expensive posting warmup#37

Open
rdettai-sk wants to merge 2 commits intosekoiafrom
impr-term-set-efficiency
Open

Remove redundant and expensive posting warmup#37
rdettai-sk wants to merge 2 commits intosekoiafrom
impr-term-set-efficiency

Conversation

@rdettai-sk
Copy link
Copy Markdown
Collaborator

Description

Correlations (lookup of a list of event.id) use a huge amount of bandwidth.

  • event.id is pretty much random, so its term dict is huge (2% of the total split size)

Some user queries that use terms queries are also excessively slow.

  • when using a terms query in a dynamic field
    • the whole _dynamic term dict is warmed up (acceptable, 0.05% of the split size)
    • the whole _dynamic postings list is warmed up (prohibitive, 10% of split size)

Copilot AI review requested due to automatic review settings April 28, 2026 15:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant