{"id":642,"date":"2026-09-23T23:48:51","date_gmt":"2026-09-23T23:48:51","guid":{"rendered":"https:\/\/docjulien.me\/?p=642"},"modified":"2026-09-23T23:48:53","modified_gmt":"2026-09-23T23:48:53","slug":"new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it","status":"publish","type":"post","link":"https:\/\/docjulien.me\/fr\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/","title":{"rendered":"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It."},"content":{"rendered":"<p class=\"wp-block-paragraph\">For years, the AI industry has run on one extraordinarily successful idea:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Make the models bigger.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">More parameters. More training data. More GPUs. More electricity. More billions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And it worked.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But new research from MIT gives us a better explanation of <em>why<\/em> scaling works \u2014 and, more interestingly, why simply throwing exponentially more money and computation at LLMs cannot deliver the same gains forever.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That scientific reality arrives at an interesting moment.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AI companies are spending staggering amounts on infrastructure while competing to make AI cheaper. At the same time, some of the executives building the most powerful systems are increasingly warning governments about the dangers of AI and calling for regulation.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Perhaps those things are unrelated.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Or perhaps the people with the best information about the economics of scaling can see the wall before everyone else does.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That second interpretation is speculation. <strong>This article explores it as speculation.<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Why making an LLM bigger actually works<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">An LLM needs to represent an enormous number of words, ideas and relationships using a limited number of internal dimensions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It does this partly through <strong>superposition<\/strong>: multiple concepts share the same representational space.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That&#8217;s efficient, but overlapping representations interfere with each other. Think of it as noise.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">MIT researchers Yizhou Liu, Ziming Liu and Jeff Gore found something remarkably simple about that noise:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>interference \u221d 1 \/ model width<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Make the representation twice as wide and this particular interference roughly halves.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Experiments on GPT-2, OPT, Pythia and Qwen produced a scaling exponent of <strong>0.91 \u00b1 0.04<\/strong>, close to the theoretical prediction of 1.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"768\" src=\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-1024x768.png\" alt=\"chatgpt image sep 24, 2026, 06 44 49 am\" class=\"wp-image-643\" title=\"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It.\" srcset=\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-1024x768.png 1024w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-16x12.png 16w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-300x225.png 300w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-768x576.png 768w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png 1448w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">Suddenly one of the mysteries of LLM scaling looks less mysterious.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Bigger models have more representational room. More room means less interference. Less interference means better predictions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But there is an obvious catch.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>You cannot eliminate the same interference twice.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">As representations gain sufficient room, there is progressively less superposition noise left to remove. The MIT model therefore predicts that this particular scaling mechanism eventually breaks down.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That doesn&#8217;t establish a maximum possible intelligence for AI. Better architectures, algorithms, training methods and other mechanisms can continue improving models.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It does tell us something much more relevant to today&#8217;s industry:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>&#8220;Just make it bigger&#8221; is not an infinite strategy.<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Unfortunately, bigger becomes fantastically expensive<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The second problem is economics.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Classic LLM scaling research found a relationship around:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>loss \u221d compute^-0.05<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That is a nasty equation if your business plan depends on brute force.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Enormous increases in computation buy increasingly small reductions in loss.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"768\" src=\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_44-AM-1024x768.png\" alt=\"chatgpt image sep 24, 2026, 06 44 44 am\" class=\"wp-image-644\" title=\"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It.\" srcset=\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_44-AM-1024x768.png 1024w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_44-AM-300x225.png 300w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_44-AM-16x12.png 16w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_44-AM-768x576.png 768w, https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_44-AM.png 1448w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">The curve doesn&#8217;t technically stop improving. That&#8217;s almost the problem.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It keeps offering another small improvement \u2014 if you&#8217;re prepared to pay an increasingly absurd price for it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A separate ICLR 2025 study approached the problem from another direction and found that language models could store approximately <strong>2 bits of factual knowledge per parameter<\/strong> in controlled experiments.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These aren&#8217;t magical brains whose capabilities expand without physical constraint.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">They are information-processing machines with measurable capacity, interference, compute requirements and diminishing returns.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Which brings us to the money.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Now look at what the AI industry is doing<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The sums being committed to AI infrastructure are extraordinary.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Financial Times reported that OpenAI expects around <strong>$278 billion in negative free cash flow from 2026 through 2030<\/strong>, alongside roughly <strong>$856 billion of projected compute and infrastructure spending<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Stanford&#8217;s 2026 AI Index estimates that OpenAI&#8217;s compute spending rose from <strong>$5.8 billion in 2024 to $16.3 billion in 2025<\/strong>, while Anthropic&#8217;s rose from <strong>$2.5 billion to $6.8 billion<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And training isn&#8217;t the only problem.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Every time somebody asks an AI a question, computation happens again. Successful AI products therefore have a strange property: <strong>more customers can mean dramatically more operating expense.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At the same time, competition is pushing AI prices downward.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">So the industry is caught between two curves.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The cost of extracting the next improvement rises dramatically.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The market price of providing intelligence faces pressure in the opposite direction.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That is not an especially comfortable place to build a trillion-dollar industry.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">And suddenly everyone is worried about AI<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Now comes the cynical interpretation.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Executives at leading AI laboratories have increasingly warned about catastrophic AI risks and advocated various forms of government oversight, frontier-model regulation and safety requirements.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Take those warnings seriously. Some AI risks are plainly real.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But we should also be allowed to ask an uncomfortable question:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What if safety isn&#8217;t the only thing they are worried about?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Imagine running one of these companies.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You know exactly how much the next generation costs. You know how quickly inference expenses are growing. You have better internal scaling data than almost anyone outside the company. You know whether throwing another order of magnitude of compute at the problem is producing revolutionary capabilities or increasingly expensive incremental improvements.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And then you look behind you.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Open models are improving. Competitors are multiplying. Hardware improves. Techniques diffuse. Researchers reproduce ideas. The price customers expect to pay for intelligence keeps falling.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">What would government regulation do?<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Potentially, it raises the price of entry.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Mandatory evaluations, licensing, reporting, security requirements and enormous compliance departments are inconveniences for a company already spending tens of billions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">For a new competitor, they can be a wall.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This possibility is not some secret discovery. Economists have a name for the broader phenomenon: <strong>regulatory capture<\/strong>. Regulation intended to control an industry can eventually protect its dominant companies from competition.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Recent commentary about AI has explicitly raised this concern.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">So consider the alternative interpretation of today&#8217;s AI politics.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Perhaps executives genuinely looked at their creations and became frightened.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But perhaps some also looked at their spreadsheets.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Both can be true.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Truth may be another scaling casualty<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We cannot see inside the heads of AI CEOs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We cannot prove that calls for regulation are secretly motivated by deteriorating scaling economics.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But neither should corporate statements of noble intentions be treated as scientific evidence of corporate motives.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These are companies competing for extraordinary amounts of capital, market dominance, prestige and technological power. Their public statements should be examined with the same skepticism we would apply to the oil industry discussing climate policy, banks discussing financial regulation or pharmaceutical companies discussing patent law.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The timing is at least fascinating.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Scientists are beginning to explain why brute-force LLM scaling produces diminishing returns.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Infrastructure spending is exploding.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Loss improvements become progressively more expensive.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">AI providers are fighting over prices.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Profitability remains uncertain.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">And some of the people with the greatest financial interest in controlling the next stage of AI development are telling governments that the industry needs barriers around it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Maybe that&#8217;s coincidence.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Maybe it&#8217;s responsibility.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Or maybe the AI companies have discovered that regulating the race is becoming more attractive just as winning it through brute-force scaling is becoming ruinously expensive.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We don&#8217;t yet know.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">But when hundreds of billions of dollars, enormous personal fortunes and control of a potentially transformative technology are involved, skepticism isn&#8217;t cynicism for its own sake.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It&#8217;s due diligence.<\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\"\/>\n\n\n\n<h2 class=\"wp-block-heading\">Sources<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Video \u2014 excellent visual explanation of LLM scaling and the MIT research:<\/strong><br><a href=\"https:\/\/youtu.be\/6xQ8LQfkBg4\">https:\/\/youtu.be\/6xQ8LQfkBg4<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Liu, Liu &amp; Gore \u2014 <em>Superposition Yields Robust Neural Scaling<\/em>, MIT \/ NeurIPS 2025:<\/strong><br><a href=\"https:\/\/arxiv.org\/abs\/2505.10465\">https:\/\/arxiv.org\/abs\/2505.10465<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Allen-Zhu &amp; Li \u2014 <em>Knowledge Capacity Scaling Laws<\/em>, ICLR 2025:<\/strong><br><a href=\"https:\/\/proceedings.iclr.cc\/paper_files\/paper\/2025\/hash\/26d3c9a66836ded8f34a944f2bfe868e-Abstract-Conference.html\">https:\/\/proceedings.iclr.cc\/paper_files\/paper\/2025\/hash\/26d3c9a66836ded8f34a944f2bfe868e-Abstract-Conference.html<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Kaplan et al. \u2014 <em>Scaling Laws for Neural Language Models<\/em>:<\/strong><br><a href=\"https:\/\/arxiv.org\/abs\/2001.08361\">https:\/\/arxiv.org\/abs\/2001.08361<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Stanford \u2014 AI Index Report 2026:<\/strong><br><a href=\"https:\/\/hai.stanford.edu\/ai-index\/2026-ai-index-report\">https:\/\/hai.stanford.edu\/ai-index\/2026-ai-index-report<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Financial Times \u2014 OpenAI&#8217;s projected cash burn and infrastructure spending:<\/strong><br><a href=\"https:\/\/www.ft.com\/content\/6011d061-eee3-4193-b3b7-8ee4155f538c\">https:\/\/www.ft.com\/content\/6011d061-eee3-4193-b3b7-8ee4155f538c<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Axios \u2014 AI compute economics:<\/strong><br><a href=\"https:\/\/www.axios.com\/2026\/04\/02\/anthropic-usage-limits-openai\">https:\/\/www.axios.com\/2026\/04\/02\/anthropic-usage-limits-openai<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>The Guardian \u2014 AI slowdown calls, regulation and AI-bubble economics:<\/strong><br><a href=\"https:\/\/www.theguardian.com\/business\/2026\/sep\/20\/ai-slowdown-calls-collapse-of-bubble-datacentre-tech-firms\">https:\/\/www.theguardian.com\/business\/2026\/sep\/20\/ai-slowdown-calls-collapse-of-bubble-datacentre-tech-firms<\/a><\/p>","protected":false},"excerpt":{"rendered":"<p>For years, the AI industry has run on one extraordinarily successful idea: Make the models bigger. More parameters. More training [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":643,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[20],"tags":[7,27,29,28],"class_list":["post-642","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-ai","tag-ai","tag-llm","tag-regulations","tag-technology"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.1.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It. - Web Solutions<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/docjulien.me\/fr\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/\" \/>\n<meta property=\"og:locale\" content=\"fr_CA\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It. - Web Solutions\" \/>\n<meta property=\"og:description\" content=\"For years, the AI industry has run on one extraordinarily successful idea: Make the models bigger. More parameters. More training [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/docjulien.me\/fr\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/\" \/>\n<meta property=\"og:site_name\" content=\"Web Solutions\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/dr.julien\/\" \/>\n<meta property=\"article:published_time\" content=\"2026-09-23T23:48:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-09-23T23:48:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1448\" \/>\n\t<meta property=\"og:image:height\" content=\"1086\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Julien\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@doc_julien\" \/>\n<meta name=\"twitter:site\" content=\"@doc_julien\" \/>\n<meta name=\"twitter:label1\" content=\"\u00c9crit par\" \/>\n\t<meta name=\"twitter:data1\" content=\"Julien\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimation du temps de lecture\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/\"},\"author\":{\"name\":\"Julien\",\"@id\":\"https:\/\/docjulien.me\/#\/schema\/person\/57b233f16e0af89f206bd19cd4c74e18\"},\"headline\":\"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It.\",\"datePublished\":\"2026-09-23T23:48:51+00:00\",\"dateModified\":\"2026-09-23T23:48:53+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/\"},\"wordCount\":1284,\"commentCount\":2,\"publisher\":{\"@id\":\"https:\/\/docjulien.me\/#organization\"},\"image\":{\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png\",\"keywords\":[\"AI\",\"llm\",\"regulations\",\"technology\"],\"articleSection\":[\"AI\"],\"inLanguage\":\"fr-CA\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/\",\"url\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/\",\"name\":\"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It. - Web Solutions\",\"isPartOf\":{\"@id\":\"https:\/\/docjulien.me\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png\",\"datePublished\":\"2026-09-23T23:48:51+00:00\",\"dateModified\":\"2026-09-23T23:48:53+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#breadcrumb\"},\"inLanguage\":\"fr-CA\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage\",\"url\":\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png\",\"contentUrl\":\"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png\",\"width\":1448,\"height\":1086,\"caption\":\"chatgpt image sep 24, 2026, 06 44 49 am\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/docjulien.me\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It.\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/docjulien.me\/#website\",\"url\":\"https:\/\/docjulien.me\/\",\"name\":\"Web Solutions\",\"description\":\"Software integrated solutions\",\"publisher\":{\"@id\":\"https:\/\/docjulien.me\/#organization\"},\"alternateName\":\"Doc Julien\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/docjulien.me\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"fr-CA\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/docjulien.me\/#organization\",\"name\":\"Doc Julien\",\"url\":\"https:\/\/docjulien.me\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\/\/docjulien.me\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/docjulien.me\/wp-content\/uploads\/2025\/07\/cropped-Refined-logo-design-for-Doc-Julien-trans.png\",\"contentUrl\":\"https:\/\/docjulien.me\/wp-content\/uploads\/2025\/07\/cropped-Refined-logo-design-for-Doc-Julien-trans.png\",\"width\":1024,\"height\":454,\"caption\":\"Doc Julien\"},\"image\":{\"@id\":\"https:\/\/docjulien.me\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/dr.julien\/\",\"https:\/\/x.com\/doc_julien\",\"https:\/\/www.linkedin.com\/in\/drjulien\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/docjulien.me\/#\/schema\/person\/57b233f16e0af89f206bd19cd4c74e18\",\"name\":\"Julien\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"fr-CA\",\"@id\":\"https:\/\/docjulien.me\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e7f20c44b4e4e98c4bd9c9eb2545d99df04f98c198ec4a16c98d11181cd58be9?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e7f20c44b4e4e98c4bd9c9eb2545d99df04f98c198ec4a16c98d11181cd58be9?s=96&d=mm&r=g\",\"caption\":\"Julien\"},\"sameAs\":[\"https:\/\/docjulien.me\"],\"url\":\"https:\/\/docjulien.me\/fr\/author\/julien\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It. - Web Solutions","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/docjulien.me\/fr\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/","og_locale":"fr_CA","og_type":"article","og_title":"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It. - Web Solutions","og_description":"For years, the AI industry has run on one extraordinarily successful idea: Make the models bigger. More parameters. More training [&hellip;]","og_url":"https:\/\/docjulien.me\/fr\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/","og_site_name":"Web Solutions","article_publisher":"https:\/\/www.facebook.com\/dr.julien\/","article_published_time":"2026-09-23T23:48:51+00:00","article_modified_time":"2026-09-23T23:48:53+00:00","og_image":[{"width":1448,"height":1086,"url":"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png","type":"image\/png"}],"author":"Julien","twitter_card":"summary_large_image","twitter_creator":"@doc_julien","twitter_site":"@doc_julien","twitter_misc":{"\u00c9crit par":"Julien","Estimation du temps de lecture":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#article","isPartOf":{"@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/"},"author":{"name":"Julien","@id":"https:\/\/docjulien.me\/#\/schema\/person\/57b233f16e0af89f206bd19cd4c74e18"},"headline":"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It.","datePublished":"2026-09-23T23:48:51+00:00","dateModified":"2026-09-23T23:48:53+00:00","mainEntityOfPage":{"@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/"},"wordCount":1284,"commentCount":2,"publisher":{"@id":"https:\/\/docjulien.me\/#organization"},"image":{"@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage"},"thumbnailUrl":"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png","keywords":["AI","llm","regulations","technology"],"articleSection":["AI"],"inLanguage":"fr-CA","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/","url":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/","name":"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It. - Web Solutions","isPartOf":{"@id":"https:\/\/docjulien.me\/#website"},"primaryImageOfPage":{"@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage"},"image":{"@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage"},"thumbnailUrl":"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png","datePublished":"2026-09-23T23:48:51+00:00","dateModified":"2026-09-23T23:48:53+00:00","breadcrumb":{"@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#breadcrumb"},"inLanguage":"fr-CA","potentialAction":[{"@type":"ReadAction","target":["https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/"]}]},{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#primaryimage","url":"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png","contentUrl":"https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png","width":1448,"height":1086,"caption":"chatgpt image sep 24, 2026, 06 44 49 am"},{"@type":"BreadcrumbList","@id":"https:\/\/docjulien.me\/new-mit-study-ai-scaling-has-a-limit-perhaps-silicon-valley-already-knows-it\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/docjulien.me\/"},{"@type":"ListItem","position":2,"name":"New MIT study: AI Scaling Has a Limit. Perhaps Silicon Valley Already Knows It."}]},{"@type":"WebSite","@id":"https:\/\/docjulien.me\/#website","url":"https:\/\/docjulien.me\/","name":"Solutions web","description":"Software integrated solutions","publisher":{"@id":"https:\/\/docjulien.me\/#organization"},"alternateName":"Doc Julien","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/docjulien.me\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"fr-CA"},{"@type":"Organization","@id":"https:\/\/docjulien.me\/#organization","name":"Doc Julien","url":"https:\/\/docjulien.me\/","logo":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/docjulien.me\/#\/schema\/logo\/image\/","url":"https:\/\/docjulien.me\/wp-content\/uploads\/2025\/07\/cropped-Refined-logo-design-for-Doc-Julien-trans.png","contentUrl":"https:\/\/docjulien.me\/wp-content\/uploads\/2025\/07\/cropped-Refined-logo-design-for-Doc-Julien-trans.png","width":1024,"height":454,"caption":"Doc Julien"},"image":{"@id":"https:\/\/docjulien.me\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/dr.julien\/","https:\/\/x.com\/doc_julien","https:\/\/www.linkedin.com\/in\/drjulien\/"]},{"@type":"Person","@id":"https:\/\/docjulien.me\/#\/schema\/person\/57b233f16e0af89f206bd19cd4c74e18","name":"Julien","image":{"@type":"ImageObject","inLanguage":"fr-CA","@id":"https:\/\/docjulien.me\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e7f20c44b4e4e98c4bd9c9eb2545d99df04f98c198ec4a16c98d11181cd58be9?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e7f20c44b4e4e98c4bd9c9eb2545d99df04f98c198ec4a16c98d11181cd58be9?s=96&d=mm&r=g","caption":"Julien"},"sameAs":["https:\/\/docjulien.me"],"url":"https:\/\/docjulien.me\/fr\/author\/julien\/"}]}},"uagb_featured_image_src":{"full":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png",1448,1086,false],"thumbnail":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-150x150.png",150,150,true],"medium":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-300x225.png",300,225,true],"medium_large":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-768x576.png",768,576,true],"large":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-1024x768.png",1024,768,true],"1536x1536":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png",1448,1086,false],"2048x2048":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM.png",1448,1086,false],"trp-custom-language-flag":["https:\/\/docjulien.me\/wp-content\/uploads\/2026\/09\/ChatGPT-Image-Sep-24-2026-06_44_49-AM-16x12.png",16,12,true]},"uagb_author_info":{"display_name":"Julien","author_link":"https:\/\/docjulien.me\/fr\/author\/julien\/"},"uagb_comment_info":2,"uagb_excerpt":"For years, the AI industry has run on one extraordinarily successful idea: Make the models bigger. More parameters. More training [&hellip;]","_links":{"self":[{"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/posts\/642","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/comments?post=642"}],"version-history":[{"count":1,"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/posts\/642\/revisions"}],"predecessor-version":[{"id":645,"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/posts\/642\/revisions\/645"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/media\/643"}],"wp:attachment":[{"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/media?parent=642"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/categories?post=642"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/docjulien.me\/fr\/wp-json\/wp\/v2\/tags?post=642"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}