Decoding Methods Comparison
Each decoding method's final answer is printed as soon as it is done. Model used: GPT-2.
Prompt
Clear
Submit
Stop
Greedy
Top-k Sampling
Top-p Sampling
Beam Search
Min-p Sampling (as in https://arxiv.org/abs/2407.01082)
Eta Sampling
Epsilon Sampling
laconic decoding (by Alex Dimakis, 2025, search for twitter thread)
COT Decoding (Chain-of-Thought Reasoning without Prompting, Wang, Zhou, 2024)