Close

ByteDance rolls out MaaS for large language models

June 28, 2023 11:30 pm

Following in the footsteps of Tencent, ByteDance now joins the ranks of cloud providers launching one-stop large language models (LLMs) services.

On Wednesday, Volcano Engine, the cloud computing arm of ByteDance, unveiled its "Model as a Service (MaaS)" platform specifically designed for LLMs. 

The platform, called "Volcano Ark (火山方舟)", supports a range of domestically developed LLMs, such as MOSS from Fudan University, Xuliehouzi from Mobvoi, and Mencius from LangBoat.

Volcano Ark offers an extensive suite of tools related to LLMs, encompassing model training, reasoning, evaluation, fine-tuning, and more. 

This comprehensive set of services aims to cater to the growing demand for generative AI capabilities, with cloud providers in China recognizing LLMs as a crucial opportunity to propel their cloud computing business forward.

Last week, Tencent Cloud launched its MaaS, which aims to help enterprises that want to integrate LLM solve problems such as high training costs, data security, and lack of expertise.

Sufficient computing power is the basis for LLM model training. In this regard, technology giants such as Tencent, Baidu, Alibaba, and ByteDance are in a leading position in China.

ByteDance has invested heavily in this area, including assigning staff to develop its own LL.M. and ordering more than $1 billion worth of GPUs from Nvidia.