feat : Implement slot-based MGET batching for cluster clients #908

SoulPancake · 2025-10-04T08:12:38Z

Implement slot-based MGET batching for cluster clients Co-authored-by: SoulPancake <70265851+SoulPancake@users.noreply.github.com>

jit-ci · 2025-10-04T08:12:53Z

Hi, I’m Jit, a friendly security platform designed to help developers build secure applications from day zero with an MVS (Minimal viable security) mindset.

In case there are security findings, they will be communicated to you as a comment inside the PR.

Hope you’ll enjoy using Jit.

Questions? Comments? Want to learn more? Get in touch with us.

rueian

Functionally, it works, but can we optimize allocations?

SoulPancake · 2025-10-10T05:04:47Z

I optimised the slice mem allocation, is there any other potential improvement I can work on? @rueian

helper.go

rueian · 2025-10-10T18:05:04Z

I optimised the slice mem allocation, is there any other potential improvement I can work on? @rueian

I wonder if it is possible to avoid using MGets since it allocates a make(map[uint16]Completed, 8) though I am not sure if it is allocated on the heap or the stack after compiler optimization. Would you mind checking that? If it is allocated on the stack, then it should be fine.

SoulPancake · 2025-10-20T07:29:36Z

I wonder if it is possible to avoid using MGets since it allocates a make(map[uint16]Completed, 8) though I am not sure if it is allocated on the heap or the stack after compiler optimization. Would you mind checking that? If it is allocated on the stack, then it should be fine.

@rueian
make(map[uint16]Completed, 8) in MGets/JsonMGets does escape to heap.
What do you suggest we do here

rueian · 2025-10-20T16:20:18Z

What do you suggest we do here

Try inline MGets/JsonMGets manually.
Then replacing make(map[uint16]Completed, 8) with make(map[uint16]int, 8) where the values are the indexes of cmds.s, eliminating the use of slotCmds.

SoulPancake · 2025-10-21T17:50:57Z

I have some trouble will my personal laptop, I will address these in a week approx, hope that is okay

Co-authored-by: Rueian <rueiancsie@gmail.com>

SoulPancake · 2025-10-29T10:18:36Z

@rueian
I inlined the grouping logic:

Added CRC16 hashing and slot calculation functions (copied from internal/cmds/slot.go) to helper.go for key-to-slot mapping. Let me know if I should move this to a common util?
Replaced the intl.MGets/intl.JsonMGets calls with manual key grouping into a map[uint16][]string.
Built the command slice (cmds.s) directly using the client builder (client.B().Mget().Key(group...).Build().Pin() for MGet, and similarly for JsonMGet with path).
Maintained a parallel cmdKeys slice to track keys per command for response parsing.
Eliminated the intermediate slotCmds map of Completed structs, reducing heap pressure while preserving functionality.

helper.go

SoulPancake · 2025-11-05T13:48:10Z

Hi @rueian Any chance to review this?

helper.go

jit-ci

❌ The following Jit checks failed to run:

secret-detection-trufflehog

#jit_bypass_commit in this PR to bypass, Jit Admin privileges required.

More info in the Jit platform.

rueian · 2025-11-27T02:32:44Z

helper.go

+	slotCount := make(map[uint16]int, len(keys)/2)
+	for _, key := range keys {
+		slotCount[slot(key)]++
+	}
+	cmds := mgetcmdsp.Get(0, len(slotCount))
+	defer mgetcmdsp.Put(cmds)
+	for s := range slotCount {
+		var builder any = client.B().Mget()
+		var first = true
+		for _, key := range keys {
+			if slot(key) == s {
+				if first {
+					builder = builder.(intl.Mget).Key(key)
+					first = false
+				} else {
+					builder = builder.(intl.MgetKey).Key(key)
+				}
+			}
+		}
+		cmds.s = append(cmds.s, builder.(intl.MgetKey).Build().Pin())


Hi @SoulPancake,

Right now, you count the number of keys for each slot, but then discard them, and then iterate over the whole keys slice for each slot, which I think is super inefficient.

How about storing the resulting indexes of cmd.s to the map[uint16]int map first? As I said previously. So that you can use slot(key) to locate the index of cmds.s and only iterate the keys slice twice in total.

helper.go

Co-authored-by: Rueian <rueiancsie@gmail.com>

SoulPancake · 2025-12-07T05:29:21Z

helper.go

+	resps := client.DoMulti(ctx, cmds.s...)
+	defer resultsp.Put(&redisresults{s: resps})
+
+	values := make([][]RedisMessage, len(cmds.s))


Hi @rueian
Sorry I've been caught up with other things and missed focused work on this
Do you think this allocation is still alright?
I cannot think of a better way for this

SoulPancake · 2025-12-07T05:29:55Z

helper.go

+	defer resultsp.Put(&redisresults{s: resps})
+
+	// Convert each response to an array once
+	values := make([][]RedisMessage, len(cmds.s))


only using:

slotIdx map[uint16]int for slot → command index, and

the pooled cmds.s slice for the actual Completed commands.

Initial plan

e226605

Implement slot-based MGET batching for cluster clients Co-authored-by: SoulPancake <70265851+SoulPancake@users.noreply.github.com>

rueian reviewed Oct 5, 2025

View reviewed changes

feat: optimise slices

c79902d

rueian reviewed Oct 10, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

helper.go Outdated Show resolved Hide resolved

rueian reviewed Oct 10, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

helper.go Outdated Show resolved Hide resolved

rueian reviewed Oct 10, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

SoulPancake and others added 3 commits October 29, 2025 15:04

Apply suggestion from @rueian

8657b76

Co-authored-by: Rueian <rueiancsie@gmail.com>

Apply suggestion from @rueian

7e9862a

Co-authored-by: Rueian <rueiancsie@gmail.com>

feat: address comments

39a9e9f

SoulPancake force-pushed the ab/improve-MGET-helper-cluster branch from 32627b2 to 39a9e9f Compare October 29, 2025 10:17

Merge branch 'redis:main' into ab/improve-MGET-helper-cluster

60a8fd6

rueian reviewed Oct 29, 2025

View reviewed changes

helper.go Show resolved Hide resolved

feat: address comment

2ee5f55

rueian reviewed Oct 29, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

feat: remove Slot public func

76f0fd9

rueian reviewed Oct 29, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

feat: address comment

cf97d42

SoulPancake requested a review from rueian October 30, 2025 16:59

rueian reviewed Nov 6, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

SoulPancake added 2 commits November 15, 2025 13:02

Merge branch 'redis:main' into ab/improve-MGET-helper-cluster

7e35f12

feat: eliminate temp slice alloc

e4d6b50

rueian reviewed Nov 19, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

fix: reduce allocations

616dd27

jit-ci bot reviewed Nov 26, 2025

View reviewed changes

rueian reviewed Nov 27, 2025

View reviewed changes

feat: address comments

2d0d7c5

SoulPancake requested a review from rueian November 29, 2025 11:19

rueian reviewed Nov 29, 2025

View reviewed changes

helper.go Outdated Show resolved Hide resolved

SoulPancake and others added 3 commits December 1, 2025 00:20

Merge branch 'redis:main' into ab/improve-MGET-helper-cluster

58b3a03

Update helper.go

fca5225

Co-authored-by: Rueian <rueiancsie@gmail.com>

fix: remove builders slice fix

e0eb5cf

SoulPancake commented Dec 7, 2025

View reviewed changes

feat : Implement slot-based MGET batching for cluster clients #908

Are you sure you want to change the base?

feat : Implement slot-based MGET batching for cluster clients #908

Uh oh!

Conversation

SoulPancake commented Oct 4, 2025

Uh oh!

jit-ci bot commented Oct 4, 2025

Uh oh!

rueian left a comment

Choose a reason for hiding this comment

Uh oh!

SoulPancake commented Oct 10, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

rueian commented Oct 10, 2025

Uh oh!

SoulPancake commented Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

rueian commented Oct 20, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

SoulPancake commented Oct 21, 2025

Uh oh!

SoulPancake commented Oct 29, 2025

Uh oh!

Uh oh!

Uh oh!

Uh oh!

SoulPancake commented Nov 5, 2025

Uh oh!

Uh oh!

Uh oh!

jit-ci bot left a comment

Choose a reason for hiding this comment

Uh oh!

rueian Nov 27, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

SoulPancake Dec 7, 2025

Choose a reason for hiding this comment

Uh oh!

SoulPancake Dec 7, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

SoulPancake commented Oct 20, 2025 •

edited

Loading

rueian commented Oct 20, 2025 •

edited

Loading