This is probably an issue with max_tokens. Please set max_tokens to a higher value to avoid truncation.
Updated over 10 months ago
All CollectionsInference FAQs
My response is getting truncated when running inference. How do I fix this?
Did this answer your question?