Large model output probability logprobs

When the logprobsparameter is enabled in the ChatGPT API, the API returns the logarithmic probability of each output tag, as well as a finite number of the most likely tags and their logarithmic probabilities at each tag location.

https://cookbook.openai.com/examples/using_logprobs

Relevant request parameters include:

• Logprobs: Whether to return the logarithmic probability of the output token. If set to true, returns the logarithmic probability of each output token in the message content. Not currently…