Aug 31, 2023

August 31, 2023 MosaicML, whose platform is used to develop and train large, complex generative AI models, experiences up to 50 per cent faster performance and cost savings of up to 80 percent. compared to other cloud providers. MosaicML a software developer that provides infrastructure and tools for building machine learning models at scale, has chosen Oracle Cloud Infrastructure (OCI) as its cloud infrastructure of choice to help businesses extract more value from their data. With OCI’s high-performance AI infrastructure, MosaicML has experienced up to 50 per cent. faster performance and cost savings of up to 80 percent. compared to other cloud providers. “Hundreds of organizations rely on MosaicML’s platform to develop and train large, complex generative AI models. We provide the complex systems and hardware so our customers can focus on building and deploying their own high-performance models,” said Naveen Rao, CEO and co-founder of MosaicML. “We chose OCI as we believe it is the best foundation for MosaicML. When we train models with huge amounts of data in the cloud, every minute counts – and with OCI we pay less than with other cloud providers and can scale almost linearly because of the way Oracle has configured its interconnects.” MosaicML helps organizations make training and interpretation of AI models more efficient and accessible with its model training capabilities. To scale its business and meet the growing demand for AI services, MosaicML chose OCI. With OCI, MosaicML has access to the latest NVIDIA GPUs, a very high bandwidth interconnect between nodes, and large compute block sizes to scale to thousands of GPUs. This has enabled MosaicML to help companies and startups operate with AI models, including Twelve Labs. Twelve Labs is an AI startup that builds foundational models for multimodal video understanding. By leveraging MosaicML’s platform running on OCI and OCI’s AI infrastructure, Twelve Labs has been able to scale and deploy their AI models efficiently to help users effortlessly search, classify and more efficiently utilize their video data for various applications. “The combination of MosaicML and Oracle has provided us with the perfect partner to help us handle huge capacities at high speed and follow our long-term growth,” said Jae Lee, founder and CEO of Twelve Labs. “MosaicML enables us to efficiently manage our large AI clusters, while OCI’s AI infrastructure ensures we don’t have to compromise on speed, saving us thousands of hours and tens of thousands of dollars in efficiency.” OCI offers several opportunities for AI, including AI infrastructure. OCI Compute virtual machines and ‘bare metal’ GPU instances can power applications in computer vision, natural language processing, recommender systems and more. For training large, complex models such as language models (LLM) at scale, OCI Supercluster provides ultra-low-latency cluster networking, HPC storage, and OCI Compute ‘bare metal’ instances with NVIDIA GPUs. OCI Compute instances are connected via a high-performance Ethernet network using RoCE v2 (RDMA over Converged Ethernet v2). The bandwidth of NVIDIA A100 Tensor Core GPUs provided by OCI exceeds alternatives by 4X-16X, which in turn reduces the time and cost of machine learning training. “We see many AI companies coming to OCI to run generative AI models because we can run them faster and more economically than other cloud providers. It is not unusual to train a model with 10 billion parameters in hours with OCI where it takes days on other platforms,” said Greg Pavlik, senior vice president at Oracle. “OCI’s architecture and non-blocking, low-latency network design is fundamentally different from anything else on the market.” *The article has been translated based on the content of IT-Kanalen by it-kanalen.dk . If there is any problem regarding the content, copyright, please leave a report below the article. We will try to process as quickly as possible to protect the rights of the author. Thank you very much! *We just want readers to access information more quickly and easily with other multilingual content, instead of information only available in a certain language. *We always respect the copyright of the content of the author and always include the original link of the source article.If the author disagrees, just leave the report below the article, the article will be edited or deleted at the request of the author. Thanks very much! Best regards! Report Content