Posted on

Data Center Liquid Cooling – Is It Time for an Upgrade?

Featured image of a Liquid Cooling Data Center using immersion cooling

As the demand for cloud services, big data analytics and AI computations grows, data centers are housing increasingly dense and powerful computing equipment. This trend has led to higher heat loads, making efficient cooling not only desirable but necessary. In some situations, traditional air-cooled systems, once the backbone of data center cooling, are now being supplemented and even replaced by data center liquid cooling solutions.

In this article, we explore how far our cooling innovations have come and uncover the reality of today’s liquid cooling landscape. We’ll break down the tech news outlet hype around liquid-cooled data centers – what are the options? What makes it special? Is it suitable for every data center? And is this technological shift inevitable? Let’s dive in.


Key Takeaways

By the end of this article, you’ll know:

  • How the growing demands drive a need for better cooling.
  • How liquid cooling works and its benefits in data centers.
  • The challenges of implementing liquid cooling systems in data centers.
A Liquid Cooling Data Center using immersion cooling technology

Immersion Cooling Technology for Data Centers

Why is Liquid Cooling Superior?

Liquid cooling is superior in data centers due to its higher thermal conductivity – liquids conduct heat up to 1,000 times better than air – allowing it to efficiently remove heat directly from high-power computing components. 

This direct heat removal leads to significantly lower operational temperatures, enhancing the performance and longevity of sensitive electronic equipment. Additionally, liquid cooling systems are more energy-efficient than traditional air cooling, reducing operational costs and a creating a smaller carbon footprint.

Energy Savings

Another core benefit that liquid-cooled data centers enjoy is energy savings. In quantitative research conducted by NVIDIA and Vertiv, data centers that use liquid cooling systems reduced their total data center power consumption by 10.2% – an 18.1% reduction in facility power! From a financial perspective, this reduction is $740,000 less than from power-hungry data centers that consume $7.4 million annually.

Types of Data Center Liquid Cooling Systems

There are many data center liquid cooling systems in place – some more complex than others. However, these three are the most dominant ones in use today:

Direct-to-Chip Liquid Cooling

Direct-to-chip (D2C) cooling involves circulating a coolant directly over the heat-generating components, such as CPUs and GPUs. This method significantly increases cooling efficiency by removing heat directly at the source. D2C systems can use a variety of coolants, including water, dielectric fluids, or refrigerants, depending on the application’s needs and the desired cooling capacity.

Immersion Cooling

Immersion cooling takes liquid cooling a step further by submerging the entire server, or parts of it, in a non-conductive liquid. This technique is highly efficient as it ensures even and thorough heat absorption from all components. Immersion cooling is particularly beneficial for high-performance computing (HPC) and can dramatically reduce the space and energy required for cooling.

Rear-Door Heat Exchangers

Rear-door heat exchanger units are a hybrid solution, combining air and liquid cooling. These units are attached to the back of server racks, using a liquid-cooled coil to remove heat from the air exiting the servers. This method is often used as an intermediary.

Direct-to-Chip Liquid Cooling solution for CPU in a Data Center

Close-up view of Direct-to-Chip Liquid Cooling

Data Center Liquid Cooling Cons

“If liquid cooling is so great, why haven’t we implemented it in every data center?” you may be asking yourself. The answer is simple: we haven’t perfected the technology. There are still a number of cons that make this solution more of an option for massive data centers who are willing and can afford to take the risk.

Higher Initial Setup Cost

Implementing liquid cooling in data centers requires a substantial initial investment. This includes the cost of the cooling system itself, such as pumps, pipes, and liquid handling units, and potential modifications to the existing infrastructure to accommodate these new components.

Complex Maintenance Requirements

Liquid cooling systems are day-and-night more complex to maintain than traditional air cooling systems. They require regular monitoring for leaks, proper handling of the cooling liquids, and maintenance of additional components like pumps and liquid distribution systems, necessitating specialized skills and training (more initial expense). Moreover, modern servers that use denser equipment and computers require crane-system assistance for immersion cooling setups, which can be a massive infrastructure endeavor for data centers considering making the shift. 

Risk of Leaks and Liquid Damage

There is an inherent risk of leaks in any liquid cooling system, which can significantly damage expensive data center equipment. Ensuring leak-proof systems and having emergency response plans are essential, but they add to the operational complexity and costs.

Should Your Data Center Opt for Liquid Cooling Solutions?

Probably not. With the current tech and innovation, upgrading to a full liquid-cooled data center can be incredibly expensive with many unknowns. Even apart from its complexity and cost, there are no currently established standards for data centers to follow. However, we’re not saying that it’s a bad idea. 

Liquid cooling data centers have their place in the tech world, but it’s mainly for data centers ready to shell out billions of dollars. The ones eager to be at the forefront of the industry and pave the way for better big data analytics, AI computations, and cloud services. 

For edge computing and businesses requiring a more straightforward, more reliable solution – Modular Data Centers and All-in-One Data Center Cabinets can provide the same benefit without the hefty price tag. 

Are Liquid-Cooled Data Centers the Future 

Based on the current forecast, it looks like it. 

“The global data center liquid cooling market is projected to grow from USD 2.6 billion in 2023 to USD 7.8 billion by 2028“

But is it for every data center operator? Not at the moment. 

In the future, as more and more innovations come up, standards are created, and OEMs create more liquid-cooled-stable equipment, liquid cooling will become a more dominant cooling technology due to its efficiency and eco-friendliness. In the meantime, there are other ways you can increase airflow – contact us to find out more!

FAQs

What is the primary reason for the shift towards data center liquid cooling?

The demand for cloud services, big data analytics, and AI is leading to higher-density, more powerful computing equipment. This equipment generates significant heat, making efficient cooling necessary. Liquid cooling is increasingly being adopted as an alternative or supplement to traditional air-cooled systems.

Why is liquid cooling considered superior to traditional air cooling?

Liquids can conduct heat up to 1,000 times better than air. This allows liquid cooling systems to remove heat more efficiently and directly from high-power components, which helps lower operational temperatures and can enhance the performance and lifespan of electronic equipment.

What are the main types of liquid cooling systems mentioned in the article?

–Direct-to-Chip (D2C) Liquid Cooling: A coolant is circulated directly over heat-generating components like CPUs and GPUs.

-Immersion Cooling: Servers are completely submerged in a non-conductive liquid.

–Rear-Door Heat Exchangers: A hybrid solution that uses a liquid-cooled coil to remove heat from the air exiting the servers.

What are the main disadvantages of implementing liquid cooling?

-Higher initial setup costs.

-Complex maintenance requirements.

-The inherent risk of leaks, which could damage expensive equipment.

-A current lack of established standards for implementation.

Is liquid cooling a suitable solution for every data center?

According to the article, liquid cooling is primarily an option for massive data centers that can handle the substantial investment and are at the forefront of the industry. For most businesses, especially those involved in edge computing, more reliable and straightforward solutions may be a better fit.

About the Author

Louis Chompff - Founder, AnD Cable Products, Rack and Cable ManagementLouis Chompff – Founder & Managing Director, AnD Cable Products
Louis established AnD Cable Products – Intelligently Designed Cable Management in 1989. Prior to this he enjoyed a 20+ year career with a leading global telecommunications company in a variety of senior data management positions. Louis is an enthusiastic inventor who designed, patented and brought to market his innovative Zero U cable management racks and Unitag cable labels, both of which have become industry-leading network cable management products. AnD Cable Products only offer products that are intelligently designed, increase efficiency, are durable and reliable, re-usable, easy to use or reduce equipment costs. He is the principal author of the Cable Management Blog, where you can find network cable management ideas, server rack cabling techniques and rack space saving tips, data center trends, latest innovations and more.
Visit https://andcable.com or shop online at https://andcable.com/shop/

Posted on

Choosing the Right Power Cord – Rack Optimization Tips

Choosing the Right Power Cord - Rack Optimization Tips - AnD Cable Management Blog

There are several aspects of optimizing data centers, from making the best use of space, time, power, and personnel. But there are some surprisingly simple solutions that are often overlooked with power cords, especially when it comes to rack optimization. Here are just a few of them.


Key Takeaways

By the end of this article, you’ll know:

  • The advantages of SVT power cords over traditional SJT cords.
  • The best cable to pair with zero U cable management racks to often more than double rack space.
  • The importance of keeping up with evolving technologies.
Choosing the Right Power Cord - Rack Optimization Tips - AnD Cable Management Blog

SVT vs. SJT Power Cords

One of the first needs of a data center is power, and while there are debates about DC powering data centers, for the most part, AC power is the answer, and that means that a part of rack optimization includes the routing of power cords. 

Related to that is the durability of these cords, their flexibility, and to an extent their cost. However, there is a certain resistance to making the switch from more common SJT cords to their younger, smaller brother, SVT power cords. 

The issue is primarily perception. SJT power cords are thicker, so they must be better, right? The answer is more complex than that. To understand, we need to look briefly at what these cords actually do:

  • Deliver power safely to components in the rack system
  • Have the flexibility to be routed through racks and between delicate components
  • Must be color coded to assist with organization and prevent mistakes during moves and changes

That sounds pretty basic, right? Power cables, and many other cables used in data centers essentially are. So why choose one over the other?

SVT Power Cord Advantages

The primary difference between SVT and SJT cords is thickness, which plays a significant role. Both are portable, can be color coded, easily withstand the heat of the data center environment, and are capable of carrying the exact same loads. 

SJT cords have been standard for a long time, and their thickness may make them seem “tougher”. But thinner SVT cords are capable of more bend angles, take up less room (facilitating airflow), and are lighter. These aid rack optimization and organization.

But of course, SVT cords also cost less per unit. Over large moves and changes or even when designing a new data center, this can make a huge difference. 

In this case, thinner (and cheaper) is better. 

Power Cords are Only Part of the Picture

Of course, when we start talking about power cords, it is important to go back to some of the basics of rack optimization. 

  • First, use 28 AWG “skinny” patch cords. They are 36% thinner than other cables, which allows you to use high-density patch panels. This simple change in cords saves you a lot of rack space, and cuts the RU needed for patch panels in half. Skinnier patch cords also allow for more airflow as well
  • Second, replace 1RU and 2RU horizontal cable managers with AnD Cable Products Zero U Cable Management Racks. They’ve been designed to not take up the valuable vertical space typical cable managers do, but instead install in the same U as the device, saving significant rack space

Once you have done these two things, you’ll often more than double the ports you can fit in a single rack. Not only will you save space and money, and prevent the spaghetti mess of wiring often found in server racks after moves and changes, but you will save additional rack footprints, allowing you to increase density without losing computing power or memory. 

WHITEPAPER – Optimizing Server Cabinet Rack Space to Maximize Efficiency and Reduce Costs

Optimizing Server Cabinet Rack Space to Maximize Efficiency and Reduce Costs FREE Guide - AnD Cable Products

Smart optimization can help you increase rack space and realize significant equipment cost savings. Read our step-by-step guide that shows you how – and how much you could save.

  • How Much Rack Space You Could Save
  • How to Optimize for Maximum Efficiency
  • Savings for New and Retrofit Installations
  • Overall Cost and Space Savings Post-Optimization

Optimizing Other Cables

There are other steps you can take as well. Optimizing your Ethernet cables (while taking into account power, latency, and reach), looking at Direct Attach Copper (DACs) cables, Active Optical Cables (AOCs), and fiber optic cable assemblies for optimization opportunities, and keeping up with innovations like plastic polymer cables can also set you up for the most optimal use of cables and cords in your data center.

The last item highlights perhaps the most important thing you can do to optimize your data center: keeping up with evolving technology. There are always new developments, faster and lighter cords, better power solutions, and more. Consider what you can do each time to make moves or changes to increase the efficiency of your data center no matter what size it is.

The good news is, you don’t have to do this alone. At AnD Cable, we keep up with the newest and best solutions for everything you need for your data center, from racks to cable management to cords and cables. We offer remote monitoring solutions and more. 

Have questions about data center solutions? Do you want to talk about optimizing your  rack usage and cable management? Get in touch today! We can’t wait to start a conversation about how we can help you. And if you’re ready to get started, request a quote. We’ll be with you every step of the way. 

FAQs

What is rack optimization?

Rack optimization is the process of making the best use of a data center rack’s available space, time, power, and personnel.

What are the benefits of using SVT power cords over traditional SJT cords?

SVT cords are thinner and lighter than SJT cords. This allows them to take up less space, facilitate better airflow within the rack, and offer more bend angles for easier cable management, all of which contribute to better organization and increased density.

What is the difference between SJT and SVT cords?

SJT stands for “Service Junior Thermoplastic” and has been the industry standard for a long time. SVT stands for “Service Vacuum Thermoplastic” and is a newer, thinner, and more flexible type of power cord.

What other products are recommended for improving rack density?

The article recommends using 28 AWG “skinny” patch cords, which are 36% thinner than standard patch cords, and AnD Cable Products’ Zero U Cable Management Racks to replace traditional horizontal cable managers.

How can these changes lead to cost savings?

By using thinner cables and improved cable management, you can double the number of ports in a single rack. This increased density reduces the need for additional rack space and can lead to significant cost savings.

About the Author

Louis Chompff - Founder, AnD Cable Products, Rack and Cable ManagementLouis Chompff – Founder & Managing Director, AnD Cable Products
Louis established AnD Cable Products – Intelligently Designed Cable Management in 1989. Prior to this he enjoyed a 20+ year career with a leading global telecommunications company in a variety of senior data management positions. Louis is an enthusiastic inventor who designed, patented and brought to market his innovative Zero U cable management racks and Unitag cable labels, both of which have become industry-leading network cable management products. AnD Cable Products only offer products that are intelligently designed, increase efficiency, are durable and reliable, re-usable, easy to use or reduce equipment costs. He is the principal author of the Cable Management Blog, where you can find network cable management ideas, server rack cabling techniques and rack space saving tips, data center trends, latest innovations and more.
Visit https://andcable.com or shop online at https://andcable.com/shop/