Zoho and NVIDIA Partner to Build Business-specific LLMs with NeMo Technology and for AI-driven SaaS Applications

Zoho Corporation has partnered with NVIDIA to accelerate the development of large language models (LLMs) designed exclusively for business applications. This partnership entails integrating NVIDIA’s AI-accelerated computing platform, including the NeMo framework, into Zoho’s Software as a Service (SaaS) offerings. The partnership, announced on October 24, 2024, at the NVIDIA AI Summit in Mumbai, intends to create business-specific LLMs that will be available to Zoho’s over 700,000 global customers via Zoho.com and ManageEngine.

Zoho Corporation has announced that it will be using NVIDIA’s AI accelerated computing platform, including NVIDIA NeMo, which is part of the NVIDIA AI Enterprise software, to create and deploy large language models (LLMs) for business use.

These models will be integrated into Zoho’s SaaS products, giving expanded AI capabilities to the company’s over 700,000 customers globally via ManageEngine and Zoho.com.

Zoho has made plans to match its investment in NVIDIA AI technology and GPUs over the past year, totaling more than $10 million.

“Many LLMs on the market today are designed for consumer use, offering limited value for businesses,” says Ramprakash Ramamoorthy, Director of AI at Zoho Corporation. “At Zoho, our mission is to develop LLMs tailored specifically for a wide range of business use cases. Owning our entire tech stack, with products spanning various business functions, allows us to integrate the essential element that makes AI truly effective: context.”

Zoho’s dedication to privacy and compliance has inspired its approach to developing AI models.

Zoho creates models with privacy standards in mind from the start, rather than retrofitting methods. The models are designed to give businesses a fast return on investment by leveraging NVIDIA’s AI software and accelerated computing, which increases throughput and reduces latency.

Multi-Modal AI and Privacy-First Strategy

For more than a decade, Zoho has been developing AI across its ManageEngine and Zoho divisions, which include over 100 products.

Its AI strategy is multimodal, with a focus on giving contextual intelligence to help businesses make decisions. In addition to LLMs, Zoho is building narrow, small, and medium language models, enabling businesses with various data capacities to benefit from specialized AI solutions. The fact that Zoho’s LLMs are not trained on customer data demonstrates how important privacy is to the company’s AI strategy.

“The ability to choose from a range of AI model sizes empowers businesses to tailor their AI solutions precisely to their needs, balancing performance with cost-effectiveness,” Vishal Dhupar, Managing Director, Asia South at NVIDIA, says. “With NVIDIA’s AI software and accelerated computing platform, Zoho is building a broad range of models to help serve the diverse needs of its business customers.”

Improved Performance with NVIDIA Technology

Zoho’s collaboration with NVIDIA includes using NVIDIA Hopper GPUs and the NVIDIA NeMo platform to create custom generative AI for LLMs, multimodal, vision, and speech AI.

The company is also evaluating NVIDIA TensorRT-LLM to optimize its LLMs for deployment, which has already resulted in a 60% boost in throughput and a 35% reduction in latency vs earlier frameworks. Zoho is also boosting additional workloads, such as speech-to-text, using NVIDIA’s accelerated computing infrastructure.

This partnership allows Zoho to provide a variety of AI-powered solutions that are highly optimized for business applications, demonstrating the company’s commitment to providing robust, privacy-conscious AI capabilities to its customers.

Focus on User Privacy and Comprehensive AI Approach

Zoho prioritizes user privacy by creating its models to meet privacy regulations from the start, rather than retrofitting them afterward. The company plans to help businesses achieve a quick return on investment (ROI) by harnessing the full capabilities of NVIDIA AI software and accelerated computing, which improves throughput and lowers latency.

Zoho has almost a decade of expertise integrating AI technologies into over 100 products across its ManageEngine and Zoho divisions. Multi-modal, the company’s strategy focuses on contextual intelligence to help users make informed business decisions.

Zoho is expanding its narrow, small, and medium language models, in addition to standard LLMs, allowing solutions to be tailored to different data sizes and use cases. Especially, these LLMs won’t be trained on customer data, so Zoho’s AI strategy won’t compromise privacy.

Collaboration With NVIDIA

Zoho will use NVIDIA Hopper GPUs to accelerate its LLMs on NVIDIA’s computing platform as a result of this partnership. Custom generative AI with large language models (LLMs), multimodal AI, and capabilities for both vision and speech will be developed by the company using the NVIDIA NeMo platform.