Skip to content

[VQueues] Major redesign of vqueues internal design#4573

Merged
AhmedSoliman merged 9 commits intomainfrom
pr4573
Apr 22, 2026
Merged

[VQueues] Major redesign of vqueues internal design#4573
AhmedSoliman merged 9 commits intomainfrom
pr4573

Conversation

@github-actions
Copy link
Copy Markdown

github-actions Bot commented Apr 9, 2026

Test Results

  7 files  ±0    7 suites  ±0   2m 40s ⏱️ -7s
 47 tests ±0   47 ✅ ±0  0 💤 ±0  0 ❌ ±0 
200 runs  ±0  200 ✅ ±0  0 💤 ±0  0 ❌ ±0 

Results for commit 4b9e6e1. ± Comparison against base commit 66162ac.

♻️ This comment has been updated with latest results.

Copy link
Copy Markdown
Contributor

@tillrohrmann tillrohrmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for this amazing piece of work @AhmedSoliman. As far as I can tell, the changes look great. 🤯 probably explains best my current state of mind as I am still processing the new state of the world. I might not have been able to trace all the different state transitions but I believe that you've already tested things well and if there are bugs left, then we iron them out while testing the new vqueue code paths. +1 for merging it!

Comment thread crates/partition-store/src/vqueue_table/entry.rs Outdated
Comment thread crates/partition-store/src/vqueue_table/entry.rs Outdated
Comment thread crates/partition-store/src/vqueue_table/inbox.rs Outdated
Comment thread crates/partition-store/src/vqueue_table/input.rs
Comment thread crates/partition-store/src/vqueue_table/key_codec.rs Outdated
Comment thread crates/vqueues/src/lib.rs
Comment on lines +450 to +461
// Left intentionally for future reference
// pub fn wake_up<T>(
// &mut self,
// at: UniqueTimestamp,
// header: &impl EntryStatusHeader,
// run_at: Option<RoughTimestamp>,
// updated_state: &T,
// ) where
// T: EntryStatusExtra + bilrost::Message + bilrost::encoding::RawMessage,
// (): bilrost::encoding::EmptyState<(), T>,
// {
// }
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What is the reference for? Modulo the generic update_state it looks pretty similar (signature wise) to the current wake_up implementation.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Primarily for the generic and how this can be used for polymorphic extra state type

Comment thread crates/vqueues/src/scheduler.rs
Comment thread crates/worker/src/partition/state_machine/mod.rs Outdated
Comment thread crates/vqueues/src/scheduler/drr.rs
Comment thread crates/worker/src/partition/state_machine/mod.rs Outdated
@AhmedSoliman AhmedSoliman merged commit 16a84ca into main Apr 22, 2026
40 checks passed
@AhmedSoliman AhmedSoliman deleted the pr4573 branch April 22, 2026 08:42
@github-actions github-actions Bot locked and limited conversation to collaborators Apr 22, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants