Taiwan's Semiconductor Dominance and NVIDIA CEO Jensen Huang Insights

Lex Fridman recounts his visit to Taiwan, highlighting his experiences with NVIDIA CEO Jensen Huang, the Computex conference, and the island's pivotal role in the global semiconductor industry.

Taiwan: The Heart of the Semiconductor World

Taiwan, an island two-thirds mountains, is responsible for over 90% of the world's most advanced semiconductors. This concentration of manufacturing is critical for virtually every computer, smartphone, GPU, and AI data center globally. Fridman draws a parallel between Taiwan's mysterious dominance in semiconductors and ancient wonders like Göbekli Tepe or the Egyptian pyramids, noting the difficulty in fully understanding how such a complex industry became so centralized.

He attributes Taiwan's success to cultural factors, particularly an education system that highly values engineering. This has significant technological and geopolitical implications for the future. Fridman emphasizes the importance of understanding and respecting different cultures, fostering collaboration, and maintaining interlinked economies and supply chains. He believes that human connection, through shared experiences like eating and drinking, is crucial for global cooperation.

Jensen Huang: A Humble Leader and Foodie

Fridman spent considerable time with Jensen Huang, CEO and founder of NVIDIA, which he describes as one of the most consequential companies in human history. Fridman praises Huang's humility, his ability to listen, and his recognition of everyone as a human being. He also notes Huang's passion for food, making him an ideal companion for exploring Taiwanese cuisine.

Computex and NVIDIA's Innovations

Fridman attended Computex, a massive conference in Taipei, which he describes as a "sea of engineers." During the visit, Huang showcased NVIDIA's latest advancements:

• 100% Liquid-Cooled Grace Blackwell: The new Grace Blackwell system is entirely liquid-cooled, a significant improvement from the previous generation's 80%. This reduces assembly time from two hours to five minutes, enhancing reliability.
• Vera CPU: NVIDIA is fully committed to its Vera CPU, which offers 1.8 times the performance of x86 CPUs. Huang explains that traditional x86 CPUs were designed for renting cores, focusing on dollars per core. In the new AI paradigm, the focus shifts to generating tokens as fast as possible, making the Vera CPU's architecture more suitable.
• AI as a Five-Layer Cake: Huang uses this analogy to describe the complexity and interconnectedness of AI technology.

The "Beatles in the '60s" Phenomenon

Fridman observes that Jensen Huang receives a rock star-like reception in Taiwan, comparing it to the Beatles in the 1960s. He finds it inspiring to see an engineer treated with such adoration, as engineers are the builders of the world. Huang, in turn, expresses his love for gamers, acknowledging them as NVIDIA's roots and emphasizing the importance of staying grounded.

Reindustrializing the US and the Flywheel Effect

Huang discusses the opportunity for the US to reindustrialize, particularly in the context of the AI boom. He believes that the immense demand for AI technology, coupled with advancements in AI and robotics in manufacturing, presents a perfect time to invest in the grid, sustainable energy, and bring industries back to the US. He highlights Taiwan's role as a strategic partner in this effort, with Taiwanese engineers and investments supporting the establishment of fabs in the US.

Fridman asks Huang about the historical reasons for Taiwan's dominance in the semiconductor industry. Huang traces it back to K.T. Li's vision in the 1950s to bring science and technology manufacturing to the island. This vision attracted Philips, which later spun off the fab that became TSMC and the semiconductor manufacturing equipment company ASML. The timing coincided with the PC revolution, where IBM's open specifications for compatible chipsets allowed Taiwanese companies like TSMC and UMC to thrive by manufacturing these components. This accessibility of chipsets fostered the growth of the PC industry, enabling companies like Dell to emerge.

Export Controls and the Flywheel of Prosperity

Fridman probes Huang's views on export controls. Huang argues that while depriving others of valuable technology can offer a short-term competitive edge, a more sophisticated long-term strategy focuses on optimizing for a "flywheel" of technology leadership and wealth. This flywheel, driven by customer engagement and installed base, fuels further innovation and economic growth.

Huang suggests that America's global flywheel advantage stems from the widespread use of English and American technological standards, making American tech stacks easily deployable worldwide. He cautions against isolationism, stating that closing off from the rest of the world, while offering some benefits, comes at the cost of losing this global advantage. He emphasizes the delicate balance between protecting technology and maximizing platform reach to sustain the flywheel of economic and technological leadership.

Interdependence and Avoiding Conflict

Both Fridman and Huang advocate for interdependence to avoid conflict. They believe that shared hardware, software, academic collaborations, and friendly competition among companies make it harder to divide people and instigate global conflicts. Huang points out that AI is a stack of technologies, with leadership in different areas residing in various countries, highlighting the necessity of global collaboration.

Taiwanese Food Adventures

Throughout the trip, Fridman and Huang embark on numerous culinary adventures, particularly at night markets. Some of the memorable dishes and experiences include:

• Oyster Pancake: Described as "crazy good" and a reason to visit Taiwan.
• Sweet Potato Balls: Empty and crunchy on the outside, like a sweet potato marshmallow.
• Shaved Ice: A first for Fridman, described as "stupid amazing" with ice cream, cilantro, and nuts.
• Braised Pig's Feet: A dish that sounds "iffy" but tastes "really good," according to Huang.
• Taiwanese Breakfast: Including cold soy milk, a hot salty version with a fried donut, and sticky rice with pork floss and egg.
• Turnip Cake: Another dish with a "branding issue" but delicious.
• Soup Dumplings: A mystery of how soup is contained inside.
• Durian: An acquired taste, described as smelling "grotesque" but tasting "really good."
• Green Mangoes: A unique fruit that is ripe despite its green color.
• Onion Pancakes: Made with 90% oil and 10% egg, a classic night market treat.

Huang shares a personal story about getting a scar on his face at a night market as a child, solidifying his fond memories of the place. He also reflects on the humility and generosity of the Taiwanese people, particularly the vendors who work hard and are willing to share.

The Genesis of NVIDIA and TSMC Partnership

Huang recounts the early days of NVIDIA, when they were a small startup looking for a foundry. After being turned down by other foundries that demanded technology licensing, he heard about TSMC and UMC in Taiwan. He initially struggled to connect with TSMC, leaving multiple voicemails and eventually writing a letter to Morris Chang, the founder.

Chang eventually called him back, inviting him to Taiwan. This marked Huang's first return to Taiwan in 30 years and the beginning of a decades-long partnership. Huang chose TSMC over UMC because of Chang's clear philosophy, core values, and commitment to long-term partnership. Chang's promise to "jump through hoops" for NVIDIA proved true for 30 years.

Huang emphasizes that the relationship was built on trust and shared values rather than rigid contracts, operating on a principle of "rough justice" where both sides win over time. He believes that this approach, where partners genuinely want each other to succeed, is crucial for long-term collaboration and the growth of the entire ecosystem.

Conclusion

Fridman concludes his trip expressing gratitude for the incredible experience, the kindness received, and the opportunity to connect with engineers and experience Taiwanese culture. He reiterates the importance of human connection, collaboration, and competing as friends rather than enemies.