Nvidia cooperates with a number of Taiwanese manufacturing companies on "digital twins" to establish an AI R&D center in Taiwan

The Paper reporter Shao Wen

According to Huang Renxun's demonstration, manufacturers such as Foxconn Industrial Internet, Pegatron, Quanta, and Wistron use Nvidia's Omniverse, Isaac Sim, and Metropolis to build virtual factories, robot simulation technologies, and automated inspections.

Nvidia's AI R&D center in Taiwan plans to recruit a team of 1,000 people to invest in forward-looking technology research and development. Nvidia will also work with Taiwanese manufacturers on the development of AI applications.

*During COMPUTEX Taipei International Computer Show, Huang Renxun demonstrated in the keynote speech that the metaverse development platform Omniverse connects various AI assistants to simplify 3D workflow and Python application development. *

On May 29, during the COMPUTEX Taipei International Computer Show, NVIDIA CEO Jensen Huang demonstrated in his keynote speech that the Metaverse development platform Omniverse connects various AI assistants to simplify the development of 3D workflows and Python applications. Huang Renxun single-handedly introduced the landing applications in two fields, one is the advertising industry and the other is the manufacturing industry. The core keywords are both "digital twins".

Digital twin refers to the comprehensive use of information technologies such as perception, computing, and modeling to describe, diagnose, predict, and make decisions on physical space through software definition, and then realize the interactive mapping between physical space and cyberspace.

Huang Renxun revealed that WPP, a world-renowned advertising communication group, is establishing cooperation with Nvidia. Taiwanese electronics manufacturing company Pegatron also announced on the 29th that it has cooperated with Nvidia to introduce the latest artificial intelligence-driven defect detection and digital twin technology into its factories.

Nvidia will also set up an AI research and development center in Taiwan, employ 1,000 employees, and cooperate with Taiwanese universities to train AI talents.

Building a generative AI content engine for digital advertising

"All industries around the world, including the $700 billion digital advertising industry, are racing to realize the advantages of artificial intelligence." According to Huang Renxun, WPP is working with Nvidia to create a generative AI content engine for digital advertising.

The foundation of this content engine is Omniverse Cloud, NVIDIA's open platform built for virtual collaboration and real-time photorealistic simulations. This engine will enable WPP to seamlessly connect tools built for immersive 3D content creation, such as Adobe Substance 3D, CAD, etc., to create on-brand, photorealistic digital twins of client products.

WPP chief executive Mark Read said: "Generative AI is transforming the marketing landscape at an incredible pace."

Jensen Huang also showed how creative teams can connect 3D design tools and build digital twins of client products in Omniverse. Creative teams can also rapidly produce virtual sets with NVIDIA's Picasso, a cloud service for building and deploying generative AI imagery, video and 3D applications.

Cooperate with many manufacturing companies

In his speech, Huang Renxun also demonstrated the first fully digital smart factory in the electronics manufacturing industry. Foxconn Industrial Internet, Pegatron, Quanta and Wistron use NVIDIA Omniverse, Isaac Sim and Metropolis to build virtual factories, robot simulation technology and automated inspection. Specifically, NVIDIA Omniverse can connect computer-aided design (CAD) applications and generative AI application programming interfaces (APIs) and advanced frameworks; Isaac Sim can be used to simulate and test robots; Metropolis vision AI framework can be used for automatic optical inspection.

Foxconn Industrial Internet, Pegatron, Quanta and Wistron use NVIDIA Omniverse, Isaac Sim and Metropolis to build virtual factories, robot simulation technology and automated inspection.

According to Nvidia, Quanta, a large manufacturer of laptops and electronic hardware, is using AI robots from subsidiary Techman Robot to inspect product quality, and Techman Robot is using Isaac Sim to simulate, test and optimize its state-of-the-art collaboration Robots, and use Nvidia products to make the robots themselves able to reason. Wistron, one of the world's largest suppliers of information and communication products, is using Omniverse with input data from AutoCAD (automatic computer-aided design software), Autodesk Revit (building information modeling software) and FlexSim (3D simulation modeling software) to automate its Build a digital twin between receiving lines and operations.

According to Pegatron, its artificial intelligence-driven factory automation workflow will use Nvidia's Metropolis framework and Omniverse to develop, deploy and manage quality control solutions, saving costs and improving production efficiency.

Huang Renxun said: "The world's largest industry manufactures physical objects. If these products can be manufactured digitally first, a lot of costs can be saved. NVIDIA enables electronics manufacturers to easily build and operate virtual factories, and realize manufacturing and manufacturing. The digitization of the inspection workflow has greatly improved quality and safety while reducing last-minute surprises and delays."

Deepu Talla, vice president of Nvidia's embedded and edge computing business, told media including ThePaper that these industrial digitization efforts are using a new workflow that combines Nvidia's generative artificial intelligence, 3D collaboration, simulation, and autonomous machine technology.” From automotive to healthcare, manufacturing, retail, and telecommunications, each of these industries is a massive, multi-trillion-dollar industry, and all of them are in a race to digitize ’ said Tara.

R&D and talent cooperation

According to Taiwan media reports on May 29, Taiwan's economic department stated that Nvidia applied for the "Artificial Intelligence Innovation R&D Center Plan" in 2021, with a total funding of about NT$24.3 billion (about 5.614 billion yuan), and the economic department subsidized 6.7 billion. New Taiwan dollars (approximately 1.548 billion yuan), and self-raised funds of approximately 17.6 billion Taiwan dollars (approximately 4.066 billion yuan). The implementation period of the plan is from March 2022 to March 2027.

Nvidia's AI R&D center in Taiwan plans to recruit a team of 1,000 people to invest in forward-looking technology research and development. In addition, Nvidia will jointly develop AI applications with Taiwanese manufacturers, provide solutions for various industries, and help Taiwanese manufacturers enter the international market.

Nvidia also mentioned the cultivation of AI talents in the content of the plan. Taiwan's economic department stated that Nvidia is expected to cooperate with National Taiwan University, National Cheng Kung University, and Tsinghua University. On May 27, Huang Renxun delivered a speech at the graduation ceremony of National Taiwan University. Chen Wenwen, the president of National Taiwan University, said after the meeting that National Taiwan University will work with Nvidia to create the "NVIDIA-NTU Artificial Intelligence Joint Research Center".