As the costs associated with AI infrastructure continue to escalate, Zoho has launched Nathu La, its first in-house server platform aimed at enhancing its AI and cloud computing capabilities. This initiative seeks to cut operational expenses while improving energy efficiency and providing better control over the technology that supports Zoho's services.
Nathu La is the result of a collaboration between Zoho's engineering team in Nagpur and Intel, utilizing Intel Xeon 6 processors. This strategic move allows Zoho to manage its own data centers more effectively, achieving a 12-18% reduction in power consumption and lowering total ownership costs by 20-30%. Ramprakash Ramamoorthy, Director of AI Research at Zoho, emphasized the need for such a platform, stating, "Infrastructure costs and inference costs are becoming one of the biggest line items for software companies." He also pointed out that the same server configurations that were affordable six months ago have surged to three to four times their previous price.
Currently, Zoho serves over 150 million users worldwide and operates 16 data centers, making the decision to build an in-house server platform crucial amid rising AI-related expenditures. Unlike traditional server manufacturers, Zoho’s Nathu La is not meant for commercial sale; it is designed for internal operations, with a few hundred servers already in use and plans to expand this number to around 2,000 by year-end.
This launch signals Zoho's ambition to take control of its computing infrastructure and highlights a broader trend in the tech industry where companies seek self-reliance amid rising operational costs. The move aligns with the company’s philosophy of "dogfooding"—using its own products internally to ensure quality and performance. Ramamoorthy noted, "We launched a server platform primarily for internal use. We are dogfooding it as we speak. Zoho runs on Zoho."
In light of Nathu La's unveiling, Zoho founder Sridhar Vembu has expressed concerns about the risks of over-reliance on AI tools, particularly among students. Addressing worries about declining performance in computer science courses, Vembu warned that while AI can speed up learning, it may also undermine critical thinking skills. He argued that many students become too dependent on AI, which can impede their educational growth. Vembu stressed the importance of establishing a solid educational foundation before heavily relying on AI technologies, asserting, "AI is not a training wheel; it becomes a crutch."
Vembu's comments have ignited discussions about the future of education and career paths in an AI-driven world. He has identified several professions likely to remain resilient despite advancing AI, including teaching, caregiving, and conservation roles.
As Zoho navigates the complexities of AI infrastructure costs, the launch of Nathu La not only reinforces its commitment to innovation but also marks a strategic shift toward greater self-sufficiency in technology. As the tech sector evolves, Zoho's initiative could serve as a model for other companies facing similar challenges in the AI space.
The stories that move AI & crypto markets — before the market reacts.
Free. 7am ET. Five stories. 62,400 readers.
