Cloud computing company Lambda launches new cluster service to get Nvidia H100 GPUs on demand

recent,GPU Cloud computing companies Lambda Announced the launch of its new 1-Click Cluster Service, customers can now get Nvidia H100 GPU and Quantum2 InfiniBand clusters on demand. This innovative service enables enterprises to obtain computing power only when they need it, especially for companies that do not need to use GPUs 24 hours a day.

Cloud computing company Lambda launches new cluster service to get Nvidia H100 GPUs on demand

Source Note: The image is generated by AI, and the image is authorized by Midjourney

Robert Brooks, co-founder and vice president of Lambda, said in an interview that the service is designed for companies that are building their own models. In this way, they only need to quickly obtain the required GPU computing power when needed, avoiding the trouble of complex hardware and software coordination in the past. He mentioned that starting an AI company requires a lot of money and time, especially to configure a large GPU cluster.

Unlike the traditional GPU rental model, the Lambda service eliminates the complex process of negotiating usage time with GPU suppliers. Brooks pointed out that Lambda has found a solution to make Nvidia H100 GPUs and Infini networks available at any time in new model training projects.

Many prefer to use pre-trained AI models and fine-tune them with their own data management policies because of the high cost of building and training basic models. In addition, Nvidia GPUs are expensive, and many companies simply cannot afford to build their own data centers to store these GPUs. For small AI companies, they usually have no choice but to rent GPU space or work with cloud service providers in the hope of obtaining the processing required to train models.

While cloud providers like AWS and Microsoft Azure offer access to AI and Nvidia GPUs, Brooks stressed that their focus is on the inference phase of models, not the training phase. Traditional GPU cluster contracts are often signed for a year or more.

The 1-Click cluster is specifically for companies that only need a short-term model, especially those who do not want to sign a long-term contract. Customers can reserve the required nodes as needed, with a minimum reservation period of two weeks. The specific pricing varies depending on the number of nodes and the required time.

Lambda was founded in 2012 and successfully raised $320 million in February this year, with the company's valuation reaching $1.5 billion.

statement:The content is collected from various media platforms such as public websites. If the included content infringes on your rights, please contact us by email and we will deal with it as soon as possible.
Information

Gemini now available at X Google Gemini branding rarely appears

2024-7-26 9:40:48

HeadlinesInformation

The first in the world, a Chinese team developed a multimodal large model for diabetes diagnosis and treatment, DeepDR-LLM

2024-7-26 9:43:43

Search