#Nvidia AI chips

[aishuglb12]

Amazon Builds Custom Cooling Tech to Handle Nvidia’s Powerful AI Chips

AWS officially announced the general availability of its new P6e instances, powered by Nvidia’s Blackwell GPUs and utilizing the custom IRHX cooling system, on July 9, 2025. These instances, specifically the P6e-GB200 UltraServers, are designed to deliver the highest GPU-based AI training and inference performance in Amazon EC2.

In the fast-paced world of artificial intelligence, heat is becoming a serious problem — literally. As Nvidia’s ultra-powerful GPUs (graphics processing units) drive the generative AI revolution, keeping these chips cool has become a critical challenge. Now, Amazon Web Services (AWS) has come up with a smart in-house solution to tackle it head-on.

Amazon Web Services (AWS) has come up with a smart in-house solution to tackle it head-on.

Instead of relying on third-party equipment or building entirely new liquid-cooled data centers, Amazon’s engineers designed their own hardware called the In-Row Heat Exchanger (IRHX).

This system can slot into existing or new data centers and cool the high-density Nvidia GPUs efficiently, without taking up too much space or increasing water usage dramatically.

With the new cooling system in place, AWS is now offering P6e instances powered by Nvidia’s Blackwell GPUs.

Better cooling means better performance, longer hardware life, and more cost-efficient AI training for developers and businesses alike.

By designing its own gear, Amazon becomes less dependent on third-party vendors — and it’s clearly working.

In Q1 of 2025, AWS posted its highest operating margin since 2014, contributing significantly to Amazon’s overall profits.

With the explosion of AI workloads, especially large language models and other compute-heavy tasks, traditional air cooling systems are struggling to keep up. Nvidia’s next-gen GPUs, like the ones in the new GB200 NVL72 racks (which cram 72 GPUs into a single rack!), generate an enormous amount of heat.

Many cloud giants — including Microsoft and CoreWeave — have adopted liquid cooling technologies to keep things running smoothly. But AWS decided to take a different path.

The In-Row Heat Exchanger (IRHX)

Instead of relying on third-party equipment or building entirely new liquid-cooled data centers, Amazon’s engineers designed their own hardware called the In-Row Heat Exchanger (IRHX). This system can slot into existing or new data centers and cool the high-density Nvidia GPUs efficiently, without taking up too much space or increasing water usage dramatically.

“They would take up too much data center floor space or increase water usage substantially,” explained Dave Brown, AWS VP of Compute and Machine Learning Services.

This in-house approach not only saves time but also ensures AWS can scale the solution to meet its massive global infrastructure needs.

New P6e Instances: Now Available

With the new cooling system in place, AWS is now offering P6e instances powered by Nvidia’s Blackwell GPUs. These machines are tailor-made for training and running large-scale AI models, bringing high performance and efficient cooling under one roof.

And if you’re wondering why this matters — better cooling means better performance, longer hardware life, and more cost-efficient AI training for developers and businesses alike.

Why Amazon Does It Their Way

This isn’t the first time AWS has built its own hardware. The cloud giant has also developed:

Custom AI chips (like Trainium and Inferentia)

Storage servers

Networking routers

By designing its own gear, Amazon becomes less dependent on third-party vendors — and it’s clearly working. In Q1 of 2025, AWS posted its highest operating margin since 2014, contributing significantly to Amazon’s overall profits.

The Cloud Wars Continue

Microsoft, Amazon’s top cloud rival, isn’t sitting idle. Microsoft is developing its own AI chips (Maia) and custom cooling systems (called Sidekicks) to keep up with rising compute demands.

With AI workloads growing every day, the race to build smarter, more efficient data centers is heating up — and AWS is proving it’s ready to lead the charge with both brains and cooling muscle.

What it will do and its New Features

The IRHX system is a sophisticated cooling solution that combines elements of both liquid and air-based cooling. It functions by circulating chilled liquid directly to the vicinity of the server rows, where it efficiently extracts heat from the tightly packed Nvidia GPUs. This direct-to-chip approach, combined with fan-coil arrays that maintain the air-cooled mechanical layout of standard AWS racks, ensures optimal performance.

Key features and benefits of this innovation include:

Efficient Heat Dissipation: The IRHX is specifically engineered to handle the extreme heat generated by Nvidia’s next-gen GPUs, such as those in the GB200 NVL72 racks, which cram a staggering 72 GPUs into a single rack. This ensures the chips operate at optimal temperatures, preventing thermal throttling and maximizing performance.

Space and Water Efficiency: According to Dave Brown, AWS VP of Compute and Machine Learning Services, traditional liquid cooling solutions often demand excessive data center floor space or lead to substantial increases in water usage. The IRHX circumvents these limitations, offering a more compact and water-conscious approach.

Scalability and Adaptability: Designed by AWS engineers, the IRHX can be deployed rapidly and scaled across AWS’s massive global infrastructure. Its ability to slot into both existing and new data centers provides significant flexibility in meeting evolving AI demands.

Enhanced Hardware Life and Cost-Efficiency: By effectively managing heat, the IRHX contributes to longer hardware lifespan for the expensive Nvidia GPUs. For developers and businesses, this translates into more stable and cost-efficient AI training, as hardware failures due to overheating are minimized.

Why it Matters

This in-house cooling solution is a critical development for several reasons:

Unlocking AI Potential: As AI models grow exponentially in complexity and size, the computational power required to train and run them continues to surge. Effective cooling is no longer a mere operational detail; it’s a fundamental enabler for unlocking the full potential of these advanced AI capabilities.

Competitive Advantage: In the highly competitive cloud computing landscape, custom hardware development is becoming a key differentiator. By designing its own cooling infrastructure, AWS reduces its reliance on third-party vendors, gains greater control over its supply chain, and can optimize its systems specifically for its demanding AI workloads. This vertical integration has historically paid dividends for Amazon, with AWS posting its highest operating margin since 2014 in Q1 2025.

Sustainability: Efficient cooling systems contribute to the overall sustainability of data centers by reducing energy consumption and water usage. AWS’s focus on a water-efficient solution aligns with broader industry efforts towards more environmentally responsible computing.

Future-Proofing Infrastructure: The rapid evolution of AI chips means that cooling needs are constantly changing. By designing its own solutions, AWS can adapt more quickly to these advancements, ensuring its infrastructure remains at the forefront of AI innovation.

Read More : Amazon Builds Custom Cooling Tech to Handle Nvidia’s Powerful AI Chips

[aakhirtak]

Mukesh Ambani’s Nvidia AI Chips Plan: India’s Largest Data Centre

Aakhir Tak – In Shorts Mukesh Ambani plans to build the world’s largest data centre in Jamnagar, Gujarat, with 3 GW capacity. Reliance will use Nvidia’s advanced AI chips for high-performance computations. The centre will run on renewable energy, significantly reducing AI computing costs. This initiative can give India a strong position in the global AI landscape. The estimated project cost…

[l-in-c-future]

DeepSeek spells the end of the dominance of Big Data and Big AI, not the end of Nvidia. Its focus on efficiency jump-starts the race for small AI models based on lean data, consuming slender computing resources. The probable impact of DeepSeek’s low-cost and free state-of-the-art AI model will be the reorientation of U.S. Big Tech away from relying exclusively on their “bigger is better” competitive orientation and the accelerated proliferation of AI startups focused on “small is beautiful.”

Wall Street share market reacted in the wrong way for the wrong thing.

Without Nvidia, Deepseek can't survive because they use specific Nvidia chips that are currently not under US ban.

[talentos]

El Popol Vuh, el ancestral "Libro del Consejo" y la interpretación de IA de DeepSeek-V3

El Popol Vuh, el "Libro de la Comunidad" o "Libro del Consejo" la interpretación de DeepSeek-V3 El Popol Vuh nos recuerda que la sabiduría ancestral está en nuestra conexión con lo divino y la naturaleza. Hoy, la IA de DeepSeek busca respuestas en los datos. ¿Podrán coexistir la intuición milenaria y la inteligencia artificial? 🌍🤖 #SabiduríaAncestral #IA #DeepSeek"

Hoy Nvidia sufrió una pérdida de valor de mercado de 589,000 millones de dólares el 27 de enero de 2025, impulsada por la popularidad de la startup china DeepSeek A. Ai Art by Author La irrupción de DeepSeek evidencia que las barreras de entrada en la industria de chips de IA no son tan sólidas. Este competidor chino ha logrado innovar con menos costos y más accesibilidad, desafiando el dominio…

[peterbordes]

Nvidia’s Jensen Huang says AI agents are ‘a multi-trillion-dollar opportunity’ at last nights CES AI keynote. Let that “multi Trillion” sink in, because this global movement is just getting started.

[memenewsdotcom]

Nvidia stock rises by record

[pulsaris]

Inteligência Artificial - Cooperação entre NVIDIA e Microsoft

A Microsoft e a NVIDIA anunciaram integrações importantes no campo da Inteligência Artificial generativa para empresas em todo o mundo. Saiba mais em: https://news.microsoft.com/2024/03/18/microsoft-and-nvidia-announce-major-integrations-to-accelerate-generative-ai-for-enterprises-everywhere/

______ Direitos de imagem: © Microsoft (via https://news.microsoft.com/)

[semimediapress]

OpenAI to deploy over 2 million AI chips with Oracle in major U.S. data center expansion

July 24, 2025 /SemiMedia/ — OpenAI said Tuesday it will deploy more than 2 million AI-optimized chips across new U.S. data centers developed in partnership with Oracle, as part of a large-scale expansion to support future artificial intelligence training and inference workloads. The effort includes adding 4.5 gigawatts of new capacity, pushing OpenAI’s total infrastructure to over 5GW. Candidate…

[go-21newstv]

What if AI didn’t need the internet? Indian semiconductor startups have an answer

But there was a catch. Each scan, roughly 100 MB in size, had to be uploaded to the cloud, processed and the results sent back. This cycle was time consuming because of internet connectivity issues and power outages, common to rural areas. It resulted in a long line of patients waiting for results. The delayed scan reports made it harder to isolate a patient or start treatment in time. This was a…

[anandnataraj]

From Near-Broke to Trillion-Dollar Titan: The NVIDIA Gamble

20 years of flat growth. One wild bet. $4 trillion later — NVIDIA. They say overnight success stories often take decades — and if there’s one company that embodies this, it’s NVIDIA.When Jensen Huang co-founded NVIDIA in 1993, it wasn’t the AI juggernaut we know today. It started as a humble graphics card company with a bold dream: to make visual computing faster and better.In 1995, NVIDIA…

[advisoryoutlook]

Nvidia CEO Jensen Huang: Chinese Military Unlikely to Rely on U.S. AI Chips

In a recent interview on CNN’s Fareed Zakaria GPS, Nvidia CEO Jensen Huang downplayed fears that China’s military could exploit American-made AI chips, stating unequivocally: “They simply can’t rely on it.”

As the U.S. government intensifies restrictions on technology exports to China, particularly around cutting-edge artificial intelligence chips, Huang offered reassurance that American hardware is unlikely to be a dependable asset for Chinese defense operations. “We don’t have to worry about it,” he said. “It could be, of course, limited at any time.”

Ongoing Export Restrictions

Since 2022, the U.S. has enacted a series of strict measures aimed at blocking China’s access to Nvidia’s most advanced chips. These efforts escalated earlier this year with a ban on the sale of the Nvidia H20 — the most powerful AI chip previously allowed for export to China. These policies stem from national security concerns, as Washington aims to prevent foreign militaries from gaining strategic advantages through AI.

However, these moves have come at a cost. Nvidia and other U.S. tech companies have lost billions in potential revenue. While the goal is to curb China’s access to superior AI capabilities, Huang warns that the long-term effect could be counterproductive.

Huang’s Warning: Sanctions Could Backfire

Speaking candidly, Huang cautioned that continued restrictions could fuel China’s development of homegrown AI technologies that may one day rival — or even surpass — U.S. innovation. This mirrors a broader concern among tech executives: that export bans may slow American business growth while accelerating China’s independence in the semiconductor space.

While maintaining his stance on national security, Huang emphasized the importance of allowing U.S. firms to compete in the global marketplace — especially in China, which remains the world’s largest buyer of semiconductors.

The Case for Engagement, Not Isolation

Last week, Huang visited Washington before heading to Beijing, advocating for a more balanced approach. He met with former President Donald Trump to discuss the challenges facing the semiconductor industry and the need to boost domestic manufacturing.

Trump, who recently praised Nvidia’s meteoric rise — the company became the first U.S. firm to hit a $4 trillion market cap — has also championed efforts to strengthen American chip production.

Despite the meeting, the Biden administration and bipartisan lawmakers remain committed to limiting China’s access to high-performance AI chips. The consensus in Washington appears firm: AI chips with advanced capabilities must stay out of reach of the Chinese military, even at the expense of short-term business opportunities.

The Taiwan Factor

Another complication lies in Nvidia’s reliance on Taiwan Semiconductor Manufacturing Company (TSMC), which handles the production of Nvidia’s most advanced chips. Most TSMC facilities are located in Taiwan, a geopolitical hotspot near mainland China. The proximity continues to raise strategic concerns for the global tech supply chain.

Final Thoughts

Jensen Huang’s remarks highlight the tightrope U.S. companies walk between national security policy and business growth. While the government remains focused on containment, leaders like Huang argue that innovation, engagement, and strategic foresight should guide future tech policy.

The battle over AI supremacy is far from over — and how the U.S. handles exports, alliances, and domestic manufacturing will shape the global AI landscape for years to come.

[newindiaabroad]

Nvidia Becomes First $4 Trillion Company Amid AI Boom

On July 9, Nvidia made history by becoming the first company to surpass $4 trillion in market value, marking a defining moment in Wall Street’s confidence in the transformative power of artificial intelligence.

Led by co-founder and electrical engineer Jensen Huang, Nvidia's stock surged as high as $164.42 after the market opened, briefly pushing its valuation past the $4 trillion threshold before dipping slightly.

Steve Sosnick of Interactive Brokers noted, “The market has an incredible certainty that AI is the future. Nvidia is certainly the company most positioned to benefit from that gold rush.”

Nvidia’s valuation now exceeds the GDP of nations like France, the UK, and India, showcasing how central AI has become to economic outlooks. Investors are betting big that AI will spark a new wave of automation, robotics, and productivity growth—disrupting traditional industries in the process.

The California-based chipmaker’s success is also lifting broader markets. Even amid ongoing tariff tensions, Nvidia’s momentum and investor optimism have helped the S&P 500 and Nasdaq hover near record highs.

Much of this recovery stems from relief that former President Trump has eased some of the harshest tariffs announced earlier this year. Still, trade uncertainty remains, especially with new tariff actions recently introduced.

Despite facing U.S. export restrictions to China, Nvidia continues to expand globally. Its AI infrastructure deal in Saudi Arabia, signed during Trump’s May visit, reflects strategic growth even within complex geopolitical landscapes.

With AI driving explosive market gains and Nvidia at the center of the storm, the chip giant is not just rewriting stock market records—it’s redefining global economic influence.

[aiturtlesai]

Nvidia prepares custom AI chip for China amid US restrictions

  Nvidia will launch an AI chip specifically tailored for the Chinese market as early as September. Based on the Blackwell RTXPro6000, it will be stripped of HBM and NVLink to comply with new US regulations. CEO Huang is returning to China to meet with authorities and strengthen his commitment to the country. Key points: Chip based on the Blackwell RTXPro6000, modified to meet US requirements. High-bandwidth memory and NVLink interconnect will be removed for compliance. Launch expected in China in September, following regulatory approval from... read more: https://www.turtlesai.com/en/pages-2999/nvidia-prepares-custom-ai-chip-for-china-amid-us

[peterbordes]

(via AI inference chip startup Groq closes $640M at $2.8B valuation to meet next-gen LPUs demand)

Groq, a leader in fast AI inference, has secured a $640M Series D round at a valuation of $2.8B. The round was led by funds and accounts managed by BlackRock Private Equity Partners with participation from both existing and new investors including Neuberger Berman, Type One Ventures, and strategic investors including Cisco Investments, Global Brain’s KDDI Open Innovation Fund III, and Samsung Catalyst Fund. The unique, vertically integrated Groq AI inference platform has generated skyrocketing demand from developers seeking exceptional speed.

[10bmnews]

Samsung faces 56% profit decline in Q2, struggles with AI demand | The Express Tribune

Samsung Electronics has projected a 56% decline in operating profits for the second quarter, reflecting challenges in capturing the growing demand for artificial intelligence (AI) chips. The South Korean giant, a leading player in the memory chip and smartphone markets, expects its operating profit for the quarter ending June to be around 4.6 trillion won (approximately $3.5 billion), a…