The AI pre-training age will soon come to an end — OpenAI co-founder

OpenAI co-founder Ilya Sutskever recently gave a lecture at the Neural Information Processing Systems (NeurIPS) 2024 conference in Vancouver, Canada arguing that the age of artificial intelligence pre-training is ending and forecasted the rise of an AI superintelligence.

According to Sutskever, increasing computing power through better hardware, software, and machine-learning algorithms outpaces the total amount of data available for AI model training. The AI researcher likened data to fossil fuels, which will eventually run out. Sutskever said:

“Data is not growing because we have but one internet. You could even say that data is the fossil fuel of AI. It was created somehow, and now we use it, and we’ve achieved peak data, and there will be no more — we have to deal with the data that we have.”

The OpenAI co-founder predicted that agentic AI, synthetic data, and inference time computing were the next evolutions of artificial intelligence that will eventually give rise to an AI superintelligence.

Charts comparing compute power and dataset size for AI pre-training. Source: TheAIGRID, Ilya Sutskever

Related: Decentralized chatbots, gov’t bonds onchain — a16z’s 2025 crypto trends

AI agents take the crypto world by storm

AI agents go beyond the current chatbot models by being able to make decisions without human input and have become a popular narrative in the crypto space with the rise of AI memecoins and large-language models (LLMs) like Truth Terminal.

Truth Terminal went viral after the LLM began to promote a memecoin called Goatseus Maximus (GOAT), which eventually hit a market capitalization of $1 billion — attracting attention from retail investors and venture capitalists.

GOAT token market information. Source: CoinMarketCap

Google’s DeepMind artificial intelligence laboratory unveiled Gemini 2.0 — an artificial intelligence model that will power AI agents.

According to Google, agents built with the Gemini 2.0 framework will be able to assist in complex tasks such as coordinating between websites and logical reasoning.

Advancements in AI agents that can independently act and reason will lay the groundwork for AI to move past data hallucinations. 

AI hallucinations occur due to incorrect data sets and because AI pre-training increasingly relies on using older LLMs to train newer LLMs, which degrades performance over time.

Magazine: A bizarre cult is growing around AI-created memecoin ‘religions’: AI Eye

Related Posts

Task-to-earn Web3 marketing platform grows with advanced targeting tools

With its advanced targeting and real-time data tools, Midle seeks to transform Web3 marketing by empowering projects to reach segmented audiences and develop both short- and long-term data-driven strategies. Despite…

DePIN and spatial streaming bring AI agents to life with a body and soul

Mawari enables real-time streaming of immersive 3D content by leveraging a decentralized network, making spatial computing and extended reality accessible, scalable and cost-effective. Imagine if artificial intelligence could evolve beyond…

Leave a Reply

Your email address will not be published. Required fields are marked *