Mask while decoding in _sample_top_p #16
Description
The mask in
Line 121 in 067f8a3
~mask since we want to select all those indices where value is less than p.{{ message }}
Mask while decoding in
_sample_top_p #16The mask in
Line 121 in 067f8a3
~mask since we want to select all those indices where value is less than p.