A new version of Moore’s Law is coming The father of ChatGPT: AI computation doubles in 18 months

There is a golden law in the semiconductor industry, that is, Moore's Law proposed by the founder of Intel more than 50 years ago, pointing out that the chip transistors doubled in 18 to 24 months, now it is the age of AI, the father of "ChatGPT" Sam Altman proposed a new version of Moore's Law.

Sam Altman, CEO of OpenAI and known as the father of ChatGPT, has proposed a new version of Moore's Law in a social media post, saying that the amount of global artificial intelligence computing doubles every 18 months.

In 1965, Gordon Moore, then an engineer at Cents Semiconductor who later founded Intel, posted that the transistor density of semiconductor chips would double every 18 months, known as Moore's Law, which was later modified by the time interval to 24 months, or two years to double the chip density and halve the cost.

As for ChatGPT, it currently uses GPT-3 large model with 175 billion parameters, has accumulated 100 million users, more than 13 million daily activities, the total computational power consumption in the training phase is about 3640 PF days (i.e. 1PetaFLOP/s efficiency run 3640 days), and the cost is expected to be in the range of $5 million per time.

In the future, it will be upgraded to the GPT-4 model with 100 trillion parameters, and the computational power will need to increase exponentially.