Docs Status Submit a Support Ticket File a Complaint
Docs Status Submit a Support Ticket File a Complaint

Can I run multiple LLMs on a single dedicated endpoint?

Last updated 9 months ago

No, you cannot run multiple models from a single endpoint. Each endpoint is designed to serve one model at a time.

Related Articles
Why don’t I have the option to deploy my fine-tuned model on an endpoint? How is billing calculated for dedicated endpoints? Why wasn’t my endpoint created successfully? How can I stop my endpoint from running? How much will I be charged to deploy a model?