The documentation page GRPO_WITH_REPLAY_BUFFER doesn't exist in v1.14.2, but exists on the main version. Click <a href="/docs/trl/main/en/grpo_with_replay_buffer">here</a> to redirect to the main version of the documentation.