Add the endpoint for legacy v1 completion and the local 8bit quantisation#39

baixiac merged 1 commit intomainCogStack/CogStack-ModelServe:mainfrom

llm-servingCogStack/CogStack-ModelServe:llm-servingCopy head branch name to clipboard