google-deepmind/gemma-2b-it

When decoding text, samples from the top k most likely tokens; lower to ignore less likely tokens

When decoding text, samples from the top p percentage of most likely tokens; lower to ignore less likely tokens

Prompt to send to the model.

Adjusts randomness of outputs, greater than 1 is random and 0 is deterministic, 0.75 is a good starting value.

Maximum number of tokens to generate. A word is generally 2-3 tokens

Minimum number of tokens to generate. To disable, set to -1. A word is generally 2-3 tokens.

A parameter that controls how repetitive text can be. Lower means more repetitive, while higher means less repetitive. Set to 1.0 to disable.