What Are the Key AI Trends Impacting Data Centers Today?

"Certainly an exciting time for data centers, private and public alike, isn't it?" This opening remark from Tom Croll of Lionfish Tech Advisors set the stage for a compelling discussion with Ryan Mallory, President and COO of Flexential, on the recent episode of the Tech Transformed podcast. 

The speakers discuss the current AI scenario's impact on data centers, high-density computing, and cloud infrastructure. This is where Flexential comes in. Mallory stresses the importance of trust and verification in AI deployment, especially regarding security and data privacy, which Flexential has established a reputation for.

“How to adapt to the AI boom?” is one question everyone’s asking, Mallory says. From a service provider perspective, it's a "proverbial gold rush" for powered land. This is essential for building the relevant AI infrastructure that will serve as early entry points. 

Flexential's survey reveals that a staggering "90% of people surveyed are contemplating an AI strategy." The number spotlights the widespread interest and impending demand. “This isn't a short-term trend,” says Mallory. He also projects a "12-year" development cycle for AI infrastructure, emphasizing the long-term commitment required from the industry.

Scaling Up for AI

The unprecedented growth in AI demands specialized infrastructure, especially concerning the sustainable use of AI and running data centers, and strong strategies for scalability, reliability, and cost-effectiveness. 

Flexential is uniquely positioned to meet this challenge. "We've been developing high-performance compute facilities for over 10 years," he states. Their "Gen 4 and Gen 5 sites can cool 50 kilowatts per cabinet air-cooled." 

This information has allowed them to readily support the requirements of H100 and H200 type deployments, not just for service providers, but also for ramping deployments in the healthcare and financial sectors.

Looking ahead, the data center industry is preparing for even higher-density racks and the widespread adoption of liquid cooling. While "all of our sites are liquid-cooled ready," Mallory says, thorough airflow studies and CFD analysis show liquid cooling is genuinely necessary. 

Flexential’s air-cooled solutions are already handling "high-dense pods for some of the companies that have recently gone public and other companies that are out there that you hear about in this AI service provider realm,” Mallory added. 

Takeaways

• 90% of surveyed companies are considering an AI strategy.
• The AI industry is experiencing a gold rush for infrastructure.
• Data centers must adapt to high-density computing demands.
• Liquid cooling is essential for high-performance AI deployments.
• AI regulations are shaping how data centers operate.
• Trust but verify is crucial for AI deployment.
• AI democratization is vital for businesses of all sizes.
• Flexential is focused on providing scalable AI infrastructure.
• Security policies are essential for protecting sensitive data.
• AI can enhance productivity, but it requires human oversight.

Chapters

00:00 The Impact of AI on Data Centers

02:51 Infrastructure Challenges and Solutions

05:59 Navigating AI Regulations and Security

08:59 Democratization of AI for...