Skip to main content
All CollectionsInference FAQs
What is the difference between Chat and Complete for inference?
What is the difference between Chat and Complete for inference?
Updated over a week ago

Complete can be made to behave similar to Chat, but requires formatting the prompts manually. Here's an example of Chat and Complete commands that will produce the same results:

Shell

$ together chat Loading togethercomputer/RedPajama-INCITE-7B-Chat 
Type /quit to quit, /help, or /? to list commands.

>>> List the best restaurants in SF

Shell

$ together complete "<human>: List the best restaurants in SF\n<bot>: "

The key difference is that Chat is a purely interactive experience with features like chat history, while Complete offers a more customizable and manual experience useful for implementations in custom use-cases.


โ€‹

Did this answer your question?