"moonshot-v1-8k"
"moonshot-v1-8k"
Alias for model
Optional
apiAPI key to use when making requests. Defaults to the value of
MOONSHOT_API_KEY
environment variable.
Optional
frequencyFrequency penalty, a number between -2.0 and 2.0. Positive values penalize the newly generated words based on their existing frequency in the text, making the model less likely to repeat the same words verbatim. The default value is 0
Optional
maxmax value is 8192,defaults to 1024
Optional
messagesMessages to pass as a prefix to the prompt
Optional
nThe default value is 1 and cannot be greater than 5. In particular, when temperature is very small and close to 0, we can only return 1 result. If n is already set and > 1, Moonshot will return an invalid input parameter (invalid_request_error).
Optional
presenceThere is a penalty, a number between -2.0 and 2.0. Positive values penalize the newly generated words based on whether they appear in the text, increasing the likelihood that the model will discuss new topics. The default value is 0
Optional
stopOptional
streamingWhether to stream the results or not. Defaults to false.
Optional
temperatureAmount of randomness injected into the response. Ranges from 0 to 1 (0 is not included). Use temp closer to 0 for analytical / multiple choice, and temp closer to 1 for creative and generative tasks. Defaults to 0.95
Optional
topPTotal probability mass of tokens to consider at each step. Range from 0 to 1 Defaults to 0.7
Generated using TypeDoc
Interface defining the input to the MoonshotChatInput class.