<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[ROCH Labs]]></title><description><![CDATA[Data driven investment analysis for AI and Crypto]]></description><link>https://www.rochlabs.com</link><image><url>https://substackcdn.com/image/fetch/$s_!Q9Il!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2717745f-e35e-4e1b-b3ab-7ff3399c683f_768x768.png</url><title>ROCH Labs</title><link>https://www.rochlabs.com</link></image><generator>Substack</generator><lastBuildDate>Sat, 30 May 2026 04:53:43 GMT</lastBuildDate><atom:link href="https://www.rochlabs.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Rohit Chauhan]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[rochlabs@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[rochlabs@substack.com]]></itunes:email><itunes:name><![CDATA[Rohit Chauhan]]></itunes:name></itunes:owner><itunes:author><![CDATA[Rohit Chauhan]]></itunes:author><googleplay:owner><![CDATA[rochlabs@substack.com]]></googleplay:owner><googleplay:email><![CDATA[rochlabs@substack.com]]></googleplay:email><googleplay:author><![CDATA[Rohit Chauhan]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[The QCOM Setup: Why Edge Inference is the key, and what makes QCOM so special ]]></title><description><![CDATA[A supply chain scoop, a $45B automotive pipeline, and 39 analyst desks still running a 2022 model.*]]></description><link>https://www.rochlabs.com/p/the-qcom-setup-why-edge-inference</link><guid isPermaLink="false">https://www.rochlabs.com/p/the-qcom-setup-why-edge-inference</guid><dc:creator><![CDATA[Rohit Chauhan]]></dc:creator><pubDate>Tue, 26 May 2026 14:44:17 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!raYu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Qualcomm is priced as a smartphone chipmaker at a 46% discount to the semiconductor sector median. The revenue mix says it stopped being primarily a smartphone business a while ago. That gap between the label and the numbers is the trade.</p><h1>Why I&#8217;m writing this now</h1><p>On May 23, 2026, QCOM moved +11.6% in a single session. Closed at $238.16. The 39-analyst consensus average target before that move was $177-$181. The stock blew clean through the entire analyst target band in one day.</p><p>Here&#8217;s the part that matters: none of those 39 desks have updated their models yet.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!raYu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!raYu!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!raYu!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!raYu!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!raYu!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!raYu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:107572,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://www.rochlabs.com/i/199333194?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!raYu!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!raYu!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!raYu!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!raYu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fea18ff40-77c0-4aff-b611-1a9a6182f85c_1600x1200.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>When Cristiano Amon provides any directional FY2027 framework at the June 24 Investor Day, every one of those analysts has to update simultaneously. That is not a catalyst. It is a mechanical consequence of where the price is relative to where the models are.</p><p>And then there&#8217;s the Ming-Chi Kuo report. Kuo (TF International Securities, 233K followers, the highest-credibility supply chain analyst in consumer electronics) published a survey in late April reporting that Qualcomm and MediaTek are co-development partners with OpenAI on a custom smartphone processor designed for an AI Agent-focused phone. 924K impressions. 179 quote-tweets. Mass production target 2028. Revenue per chip: Kuo estimates one AI chip project is worth 30-40 standard mobile processors in revenue. I&#8217;ll come back to what this means and what the limits of it are.</p><p>Three demand vectors are building simultaneously. The market is pricing one.</p><h1>The three demand vectors</h1><h2>1. Automotive: the cleanest moat in the story</h2><p>Automotive is a genuinely different business from mobile. ADAS inference cannot go to the cloud. Sub-10ms latency requirements for safety-critical workloads make cloud inference physically impossible. Not economically suboptimal. Physically impossible. The round-trip latency on any cloud connection is 40-80ms under ideal conditions. A collision avoidance model cannot wait 40ms. Every automotive ADAS chip sold is a permanent, structurally non-negotiable edge inference win.</p><p>The numbers, per Q2 FY2026 earnings and Q3 guidance:</p><ul><li><p>Automotive revenue: $1.33B in Q2 (+38% YoY, record quarter)</p></li><li><p>Annualized run rate: crossed $5B for the first time</p></li><li><p>Q3 FY2026 guide: ~50% YoY automotive growth</p></li><li><p>FY2026 exit run rate target (management): &gt;$6B annualized</p></li><li><p>Design-win pipeline: $45B (from $3B in 2017)</p></li><li><p>In production now: BMW iX3 Ride Pilot since October 2025</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!XFZd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!XFZd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!XFZd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!XFZd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!XFZd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!XFZd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:120325,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.rochlabs.com/i/199333194?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!XFZd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!XFZd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!XFZd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!XFZd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F25f63a26-d5f5-4162-8aea-bfe63043567a_1600x1200.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The $45B pipeline converts across FY2027-2030. This is not a &#8220;future promise&#8221; number. It is already in quarterly revenue, growing faster than any other segment, with 3-5 year platform refresh cycles baking in the next few years of revenue before the contracts even need renewing.</p><p>Snapdragon Ride Flex is the only shipping chip that unifies digital cockpit and ADAS on a single platform. NVIDIA Orin and Thor are high-performance AV, a different tier entirely. No direct competitor in the unified cockpit+ADAS space.</p><p>This is the demand vector the market is most under-pricing because it doesn&#8217;t look like &#8220;AI&#8221; in the way NVDA&#8217;s data center revenue looks like AI. It is. It just runs at 90mph on a highway in Munich instead of in a hyperscaler rack.</p><h2>2. Data center: the binary on June 24</h2><p>Amon confirmed on the Q2 FY2026 earnings call that Qualcomm will ship custom data center processors to a named hyperscaler before end of 2026. The customer has not been disclosed. The AI200 targets commercial shipments in 2026. The AI250 ships in 2027 and carries up to 768GB onboard memory, which matters because inference at scale is memory-bandwidth-bound, not compute-bound.</p><p>Here is the critical point: as of May 2026, there are zero FY2027 revenue estimates for AI200/AI250 on any bank desk. Zero. Not a single analyst has published a quantified FY2027 data center contribution. There is nothing to model yet because Amon has not given a number. When he gives even a directional range on June 24, every analyst is forced to build a model from scratch for a business line currently sitting at zero in their spreadsheet.</p><p>The stock was at $238 with every desk at $177. Whatever the June 24 number implies, the revision cascade follows mechanically regardless of whether the fundamental thesis is right.</p><p>The bear argument here deserves fair treatment: Google TPU-v6, Amazon Inferentia-3, and Meta Artemis all already exist. Hyperscalers have structural incentives to keep inference in-house and the capability to do it. The unnamed hyperscaler shipment could be a 5,000-unit evaluation run that never converts to commercial volume. One cancelled NRE agreement wipes the narrative. If Amon delivers no FY2027 framework on June 24, the data center thesis stays speculative and the multiple ceiling reverts to 20-22x on handset/auto fundamentals alone.</p><h2>3. AI Agent phone: a 2028 story, not a 2026 trade</h2><p>The Kuo report is worth understanding precisely because it is being misread in both directions.</p><p>What it says: Qualcomm and MediaTek are co-development partners with OpenAI on a custom smartphone processor for an AI Agent phone. The chip handles on-device context awareness and small-model inference continuously. Heavy compute offloads to cloud. Mass production target 2028. Specs and supplier selection expected finalized late 2026 or Q1 2027.</p><p>What it does not say: that QCOM is exclusive. MediaTek is named in the same sentence. Anyone running a thesis that relies on QCOM being the only partner here is building on a factually incorrect premise.</p><p>The revenue math is why this landed with 924K impressions: Kuo frames one AI chip design win as equivalent to 30-40 standard mobile processors in revenue potential. If that holds and QCOM secures meaningful volume for the 2028 ramp, the EPS curve changes materially. At current QCOM automotive ASP dynamics as a reference, that is not an unreasonable order-of-magnitude estimate.</p><p>This is a 2028 story. It has no bearing on June 24. The reason it matters now is signal quality: the best supply chain analyst in consumer electronics hardware is naming QCOM as a co-development partner on the most anticipated AI hardware product of the decade. That does not happen to a company the market should be pricing as a smartphone cyclical at 20x.</p><p>The CT indicator is also worth noting. Jukan05 (124K followers, tech equity account, was explicitly bearish on QCOM as recently as January 2026) quote-tweeted the Kuo report with: &#8220;Should I put together a bull thesis on Qualcomm? $QCOM.&#8221; 60 replies. 363 bookmarks on a single question post. He has not published the full thesis yet. When he does, it will circulate widely. Narrative formation at 124K follower accounts with 363 bookmarks per post is a leading indicator of broader CT uptake.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!tuGY!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!tuGY!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!tuGY!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!tuGY!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!tuGY!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!tuGY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:225590,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.rochlabs.com/i/199333194?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!tuGY!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!tuGY!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!tuGY!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!tuGY!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00f5ae44-f2f5-4efb-a2b5-467cf7756ec9_1600x1200.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h1>The valuation math</h1><p>At $238, QCOM&#8217;s forward P/E is approximately 20x against FY2026 consensus EPS of ~$12.10. The semiconductor sector median forward P/E is 37x. That is a 46% discount.</p><p>For comparison:</p><ul><li><p>NVDA: ~47x forward P/E</p></li><li><p>AMD: ~54x</p></li><li><p>ARM: ~115x</p></li><li><p>AVGO (most comparable on diversified AI infrastructure revenue mix): ~37x</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Rm3D!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Rm3D!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!Rm3D!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!Rm3D!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!Rm3D!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Rm3D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png" width="1456" height="1092" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1092,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:173471,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.rochlabs.com/i/199333194?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Rm3D!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 424w, https://substackcdn.com/image/fetch/$s_!Rm3D!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 848w, https://substackcdn.com/image/fetch/$s_!Rm3D!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 1272w, https://substackcdn.com/image/fetch/$s_!Rm3D!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F38a3cdb8-5bb7-4996-a78a-cff7d0e7424c_1600x1200.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The FCF yield case is the other side of this. At ~9% FCF yield, the market is pricing QCOM the way you price a business in structural decline. The sector median FCF yield is ~2%. A company returning $3.7B to shareholders in a single quarter (Q2 FY2026: $2.8B buybacks + $945M dividends) plus a freshly authorized $20B buyback program does not print 9% FCF yield from a position of weakness.</p><p>The historical context matters here. QCOM traded at ~30x P/E during the 2020-2021 smartphone cycle peak. No AI premium required. Just re-rating the automotive and IoT mix shift to something closer to prior-cycle highs would imply $260-280 on EPS alone. The stock is not expensive relative to its own history. It is trading near mid-cycle valuation while the revenue composition has shifted materially underneath it.</p><p>Re-rating to the sector median (37x) on FY2027 EPS of ~$14.00 implies ~$518. I am not underwriting that. It requires a fully validated data center business with named customers and recurring revenue, which does not exist yet.</p><p>The scenario I think is underwritten:</p><p><em>Partial re-rating to 28x (halfway between current 20x and AVGO&#8217;s 37x) on FY2027 EPS of ~$13.20 implies ~$370, approximately +55% from $238. This does not require QCOM to become NVDA. It requires the Street to stop pricing it as a phone chip company once data center revenue becomes visible.</em></p><h1>The honest bear case</h1><p>The arithmetic runs first.</p><p>QTL generated $1.38B in Q2 FY2026 at 72% EBT margin. That is approximately $1B per quarter in high-margin profit, representing ~30% of non-GAAP operating income. The Apple licence is terminable. If it expires unrenewed, nothing in automotive or IoT replaces that margin on a two-year timeline. This risk sits entirely outside the edge inference and data center thesis and does not get better if both theses deliver.</p><p>Against the edge inference case: AI Hub has 1,800 registered companies and 175+ pre-optimized models. It also has zero published DAU, MAU, or deployment volume figures anywhere. &#8220;1,800 companies&#8221; is a registration count, not an active usage figure. The platform is real. The adoption depth is unverifiable from public data. MediaTek&#8217;s Dimensity 9500 demonstrated a 20B-parameter LLM running on-device. The premium positioning QCOM relies on in Android is compressing faster than the bull case assumes. Thermal throttling is also real: sustained on-device inference degrades significantly from burst-mode TOPS claims under thermal limits. QCOM&#8217;s marketing figures are burst-mode. The sustained benchmark that matters more as usage patterns evolve is lower.</p><p>Against the data center bet: the specific architecture of the AI Agent phone (small model on-device, heavy compute offloads to cloud) means QCOM is not a play on AI data center scale. The OpenAI phone validates edge inference, not cloud inference. The AI200/AI250 is a separate product line from a different category. One validates the thesis that QCOM knows how to build inference silicon. The other has to stand on its own commercial merits, which are unproven.</p><p>The historical reversion pattern is worth naming explicitly. QCOM has run a diversification re-rating story four times: RF front-end (2019), IoT (2021), automotive (2023), and now AI/data center (2026). Each prior attempt saw the multiple expand and then contract when a handset guidance cycle disappointed. The automotive revenue evidence in the current cycle is stronger than in any of the prior three attempts. But the pattern exists and Q3 FY2026 handset guidance -- management guided ~$4.9B in handsets for Q3, down from $6B in Q2 -- means the near-term handset print could reassert the cyclical narrative if it misses.</p><h1>The trade</h1><p>I am not positioned yet. This is a pre-event setup note.</p><p>Entry: $199-207. The post-earnings support base from May 15-21 (five consecutive daily closes), the June-July 2024 structural zone, and approximately 20x forward P/E on FY2026 consensus all converge in that range.</p><p>Stop: $189 daily close. Below the May 20 swing low of $191.02. Risk at entry: 6-9%.</p><p>TP1: $247.9. Reclaim of May 12 intraday high. Pure mechanics, no thesis confirmation required.</p><p>TP2: $300. No overhead supply on weekly chart between $248 and $300.</p><p>TP3: $350-370. Full thesis, conditional on June 24 delivering a quantified FY2027 data center framework.</p><p>R/R to TP1 from mid-entry (~$203): approximately 2.5:1. Catalyst window: June 24 Investor Day.</p><h1>Where I land</h1><p>One thing the Kuo report changes is the narrative ceiling. Before it, the QCOM re-rating case was a valuation argument against a still-skeptical market. After it, the highest-credibility supply chain analyst in the world is naming QCOM as a co-development partner on an OpenAI AI Agent phone with 30-40x the revenue potential of a standard mobile processor.</p><p>MediaTek is in the room too. The exclusive framing is wrong and I want to be precise about that.</p><p>But here is the thing about the setup as a whole. Automotive ADAS cannot go to the cloud on physics grounds. OpenAI is designing a phone around on-device inference. The unnamed hyperscaler is receiving custom data center processors before year end. These three demand vectors are not coincidental. They are converging on the same underlying capability: Qualcomm&#8217;s edge inference silicon is good enough to be chosen for the most latency-sensitive workload in consumer electronics (automotive), the most anticipated AI product of the decade (OpenAI phone), and a hyperscaler&#8217;s production data center.</p><p>The market is pricing a smartphone chip company at 20x.</p><p>The upgrade cascade is not a question of whether. It is a question of when. June 24 is the most likely trigger.</p><p>Watching closely.</p><p><em>*Conviction: MEDIUM. Not positioned. Upgrades to HIGH on two conditions: Amon delivers a quantified FY2027 data center framework on June 24, and Q3 automotive holds the guided ~50% YoY growth. One without the other is not a full re-rating.*</em></p><p><em>*Not investment advice.*</em></p><h1>Sources</h1><p>1. [QCOM Q2 FY2026 Earnings Press Release &#8212; Qualcomm Investor Relations](https://investor.qualcomm.com/news-releases/news-release-details/qualcomm-announces-second-fiscal-quarter-2026-results) &#8212; Q2 FY2026 automotive revenue $1.33B, +38% YoY; annualized run rate; $45B design-win pipeline; $2.8B buybacks + $945M dividends; $20B buyback authorization.</p><p>2. [QCOM Q2 FY2026 Earnings Call Transcript &#8212; Seeking Alpha](https://seekingalpha.com/article/4786000-qualcomm-qcom-q2-2026-earnings-call-transcript) &#8212; Cristiano Amon confirms custom data center processor shipment to named hyperscaler before end of 2026; AI200 commercial shipment timeline; Q3 FY2026 guidance including ~50% YoY automotive growth and ~$4.9B handset segment.</p><p>3. [Qualcomm Investor Day 2026 &#8212; June 24 &#8212; Qualcomm Investor Relations](https://investor.qualcomm.com/events-presentations) &#8212; Scheduled June 24, 2026. Amon to provide strategic framework; data center business update expected.</p><p>4. [Ming-Chi Kuo X Post &#8212; OpenAI AI Agent Phone: Qualcomm and MediaTek as Co-Development Partners](</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/mingchikuo/status/2048587389791269182)&quot;,&quot;full_text&quot;:&quot;https://t.co/Qqi64OWBM3&quot;,&quot;username&quot;:&quot;mingchikuo&quot;,&quot;name&quot;:&quot;&#37101;&#26126;&#37668;&#65372;Ming-Chi Kuo&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1899476262839779328/cLKEoPBG_normal.jpg&quot;,&quot;date&quot;:&quot;2026-04-27T02:17:49.000Z&quot;,&quot;photos&quot;:[],&quot;quoted_tweet&quot;:{},&quot;reply_count&quot;:51,&quot;retweet_count&quot;:148,&quot;like_count&quot;:784,&quot;impression_count&quot;:924306,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>&#8212; TF International Securities supply chain survey. QCOM and MediaTek co-development partners for OpenAI custom smartphone processor. Mass production target 2028. Revenue per AI chip estimated at 30-40x standard mobile processor. 924,241 impressions.</p><p>5. [Jukan05 X Post &#8212; QCOM Bull Thesis Framing](</p><div class="twitter-embed" data-attrs="{&quot;url&quot;:&quot;https://x.com/jukan05/status/2048588853150396790)&quot;,&quot;full_text&quot;:&quot;Should I put together a bull thesis on Qualcomm?\n\n$QCOM&quot;,&quot;username&quot;:&quot;jukan05&quot;,&quot;name&quot;:&quot;Jukan&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/2037840794992988160/tnSqJgqt_normal.jpg&quot;,&quot;date&quot;:&quot;2026-04-27T02:23:38.000Z&quot;,&quot;photos&quot;:[{&quot;img_url&quot;:&quot;https://pbs.substack.com/media/HG4MmtNacAAW_WC.png&quot;,&quot;link_url&quot;:&quot;https://t.co/YriTE4ErDI&quot;}],&quot;quoted_tweet&quot;:{&quot;full_text&quot;:&quot;&quot;,&quot;username&quot;:&quot;mingchikuo&quot;,&quot;name&quot;:&quot;&#37101;&#26126;&#37668;&#65372;Ming-Chi Kuo&quot;,&quot;profile_image_url&quot;:&quot;https://pbs.substack.com/profile_images/1899476262839779328/cLKEoPBG_normal.jpg&quot;},&quot;reply_count&quot;:60,&quot;retweet_count&quot;:55,&quot;like_count&quot;:790,&quot;impression_count&quot;:155260,&quot;expanded_url&quot;:null,&quot;video_url&quot;:null,&quot;belowTheFold&quot;:true}" data-component-name="Twitter2ToDOM"></div><p>&#8212; Quote-tweet of Kuo report. 124K follower tech equity account previously bearish on QCOM as of Jan 2026 flags intent to build bull thesis. 363 bookmarks.</p><p>6. [Snapdragon Ride Flex &#8212; Qualcomm Product Page](https://www.qualcomm.com/products/automotive/snapdragon-ride) &#8212; Unified digital cockpit and ADAS on single platform. Only shipping chip in this category. BMW iX3 Ride Pilot launched October 2025.</p><p>7. [MarketBeat QCOM Analyst Price Targets &#8212; Consensus Data](https://www.marketbeat.com/stocks/NASDAQ/QCOM/price-target/) &#8212; 39-analyst consensus average price target $177-$181 pre-May 23 move. Baird $300 target raised May 1, 2026. 38 desks below current price $238.</p><p>8. [S&amp;P Global Market Intelligence &#8212; Semiconductor Sector Forward P/E Consensus](https://www.spglobal.com/marketintelligence/en/) &#8212; Semiconductor sector median forward P/E approximately 37x; NVDA ~47x; AMD ~54x; ARM ~115x; AVGO ~37x as of May 2026.</p><p>9. [QCOM Form 10-Q Q2 FY2026 &#8212; SEC EDGAR](https://www.sec.gov/cgi-bin/browse-edgar?action=getcompany&amp;CIK=QCOM&amp;type=10-Q) &#8212; QTL segment Q2 FY2026 revenue $1.38B at 72% EBT margin. Full financial statements.</p><p>10. [Qualcomm AI Hub &#8212; Developer Platform](https://aihub.qualcomm.com/) &#8212; 1,800+ registered companies, 175+ pre-optimized models as of May 2026. On-device AI model deployment platform.</p><p>11. [QCOM Historical Price Data &#8212; May 23, 2026 Session](https://finance.yahoo.com/quote/QCOM/history/) &#8212; Closing price $238.16, single-session move +11.6%. May 20 swing low $191.02.</p><p>12. [MediaTek Dimensity 9500 &#8212; On-Device LLM Benchmark](https://www.mediatek.com/products/smartphones/dimensity-9500) &#8212; 20B-parameter LLM on-device capability. Direct competition for premium Android AI processing against Snapdragon Elite.</p><p>13. [Qualcomm AI200/AI250 Data Center Processor Announcement](https://www.qualcomm.com/news/releases/2025/10/qualcomm-announces-ai-inference-processors-for-data-centers) &#8212; AI200 commercial shipments targeted 2026; AI250 ships 2027, up to 768GB onboard memory.</p>]]></content:encoded></item><item><title><![CDATA[The Onchain Inference Trade]]></title><description><![CDATA[The inference cycle is running. Decentralized providers have carved moats in the three places Web2 cannot go.]]></description><link>https://www.rochlabs.com/p/the-onchain-inference-trade</link><guid isPermaLink="false">https://www.rochlabs.com/p/the-onchain-inference-trade</guid><dc:creator><![CDATA[Rohit Chauhan]]></dc:creator><pubDate>Fri, 22 May 2026 14:56:22 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/ab4e66a1-1f6b-4979-b009-e2b2271924df_2752x1536.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h1><strong>TL;DR</strong></h1><p>- OpenRouter processed over 12 trillion tokens per week by early 2026, up 12x year on year (per OpenRouter / a16z State of AI report, Dec 2025). Falling inference costs expand the market via Jevons&#8217; Paradox which is what makes the trade compelling.</p><p>- Decentralized inference providers have real ARR (~$12-14M Venice, ~$6M Chutes) and three structural moats Web2 cannot replicate: privacy, uncensored AI, and a 70-85% pricing advantage.</p><p>- Most revenue is still token-subsidized (Chutes ~90% subsidy ratio is worse than the Helium 78% DePIN benchmark). Organic economics at scale are not yet proven.</p><p>- Galaxy Digital&#8217;s formal institutional report is in production and unpublished. The window for early positioning is open.</p><p>- Core: $VVV, $AKT. Higher beta: $TAO, $POD. Farm: Ritual, Inference Labs.</p><div><hr></div><h2><strong>Conviction Tier: MEDIUM CONVICTION</strong></h2><p>Upgrades to HIGH CONVICTION on enterprise-scale production deployment confirmation from at least one major protocol, OR organic revenue covering more than 50% of total protocol revenue without token subsidies.</p><p>PMF is confirmed (Venice ARR, Chutes OpenRouter #1 ranking, DIEM perpetual credit adoption). Tokenomics innovation is real. Pricing moat is structural. Risks are specific and named: subsidy dependency is the primary one, TAO halving pressure is real, Venice centralization debate is unresolved, enterprise scale remains unproven. Size these positions relative to those risks.</p><div><hr></div><h1>Introduction</h1><p>OpenRouter grew from ~10 trillion tokens processed annually to over 100 trillion as of mid-2025. By early 2026, the platform was handling over 12 trillion tokens per week, a 12x increase YoY (per OpenRouter / a16z State of AI report, Dec 2025). The standard read is that inference is becoming a commodity, costs are collapsing, and that is structurally bad for any provider operating in the space. That read has it backwards, and completely misses the point.</p><p>When a resource gets 10x cheaper and usage grows 30x in response, you are not watching margin compression. You are watching Jevons&#8217; Paradox operate at the scale of global infrastructure. The inference market is not contracting as costs fall. It is expanding faster than any model projected, and the protocols positioned in the correct structural slots are compounding into something that has not been formally covered by a single major research institution.</p><p>That institutional gap is where this piece sits. Galaxy Digital&#8217;s Research Associate Lucas Tcheyan publicly signalled a formal research pivot to decentralized inference in May 2026, soliciting project names for inclusion in a forthcoming report. That report is not yet published. What follows is a synthesis of where the category stands, who the leaders are, and what the real risks look like before that coverage arrives.</p><div><hr></div><h1>The Structural Shift</h1><p>The history of AI acces<strong>s can be told in three phases.</strong></p><ol><li><p><strong>The first was closed AI:</strong> expensive, proprietary, censored. Built by OpenAI, Anthropic, and Google on centralised infrastructure, accessible through APIs with content restrictions and data logging baked into the architecture. The pricing reflected the monopoly on both intelligence and distribution.</p></li><li><p><strong>The second was open AI (not the company ironically)</strong>: The release of Llama, Mistral, and DeepSeek created commoditised base intelligence. Open-weight models collapsed the cost of raw capability. The question that emerged from this phase was not who could build AI, but who would serve it at scale, to whom, and under what terms.</p></li><li><p><strong>The third phase, which is where we are now, is decentralized AI:</strong> Token emissions fund research teams without dilutive venture rounds. Idle consumer GPUs yield inference revenue. Distributed compute networks source capacity at ~70-85% below AWS SageMaker pricing and pass that discount to developers routing inference requests at machine speed through agent harnesses running billions of API calls per session.</p></li></ol><p>The transition from the second phase to the third is not hypothetical. Tools built on top of open-weight models were burning billions of inference tokens daily before major closed labs moved to restrict automated harness usage. That restriction, widely read as bearish for inference demand, is structurally bullish for the decentralized layer. When closed labs restrict access, developers migrate to open-weight models on decentralized rails that carry no content policy. The demand does not disappear. It relocates. This is the thesis, as well as the premise of this piece. </p><div><hr></div><h1>The Business Model</h1><p>The unit economics of a decentralized inference provider are worth understanding precisely, because they are the structural source of the advantage.</p><p>Cutting away the jargon, the whole workflow can be written and understood in a few simple steps:</p><ol><li><p>Source compute from a decentralized cloud marketplace at ~70-85% below AWS SageMaker pricing. </p></li><li><p>Host open-weight and private AI models at that cost basis. </p></li><li><p>Charge developers via API subscriptions or usage fees that are still materially cheaper than OpenAI or Anthropic. </p></li><li><p>Capture the spread. Then layer in token mechanics that create switching costs no centralised provider can replicate.</p></li></ol><p>The two clearest executions of this model are Venice AI and Chutes.</p><h2><strong>Venice AI ($VVV)</strong></h2><p>Venice AI is running ~$12-14M in annual recurring revenue on 50-80B tokens per day, with a single-day peak of 80B tokens, per platform analytics at venicestats.com. </p><p>The tokenomics innovation that matters specifically for Venice is DIEM. Here&#8217;s how it works in practice; Stake $VVV, earn approximately 18% APY, and mint DIEM tokens. Each DIEM token generates one dollar per day in Venice inference credits, indefinitely. </p><p>This is not a governance token or a speculative instrument in the traditional sense. It is a <em><strong>perpetual inference credit: DeFi yield mechanics applied to AI compute.</strong></em> Capital staked into Venice cannot be easily withdrawn without unwinding a position generating daily yield. That lock-in is by design. The Pendle and Penpie analogy from DeFi explain this choice by Venice precisely: PT/YT leverage markets and governance arbitrage on inference credit bribe markets will <strong>follow as the ecosystem matures.</strong></p><h2><strong>Chutes (Subnet 64, Bittensor Ecosystem Project)</strong></h2><p>Chutes, built on Bittensor Subnet 64, is running ~$6M ARR on comparable token volume, ranked number one on OpenRouter for decentralised inference as of May 2026. </p><p>The distinction from Venice is structural: Chutes is fully decentralized, with no centralised infrastructure critique applicable to it. Its subsidy ratio, however, sits at an estimated ~90% i.e. in simple words, nine in every ten dollars of revenue is token-subsidised, not organically generated. This exceeds even Helium&#8217;s 78% benchmark at a comparable stage of the DePIN cycle. That distinction matters significantly for the bear case, which I address directly below.</p><p>Per ETH Denver benchmarks from February 2026, the decentralized inference segment was already at ~$20-30M ARR across Bittensor subnets, against a subnet market cap of  ~$212M. For reference, the broader DePIN sector was generating $72M in revenue against $10B in market cap at the same timeframe. The decentralized inference sub-sector is generating comparable revenue at a fraction of the market cap assigned to DePIN broadly.</p><p>That should tell you how early we are in the narrative cycle despite the ~8x pump recorded by VVV token in the past few weeks. </p><div><hr></div><h1>The Stack</h1><p>Five distinct layers form the decentralized AI inference supply chain. Each carries different maturity, different tokenomics design, and different risk profiles.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pIWi!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pIWi!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 424w, https://substackcdn.com/image/fetch/$s_!pIWi!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 848w, https://substackcdn.com/image/fetch/$s_!pIWi!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 1272w, https://substackcdn.com/image/fetch/$s_!pIWi!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pIWi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png" width="1456" height="1132" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1132,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:351639,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.rochlabs.com/i/198844870?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pIWi!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 424w, https://substackcdn.com/image/fetch/$s_!pIWi!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 848w, https://substackcdn.com/image/fetch/$s_!pIWi!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 1272w, https://substackcdn.com/image/fetch/$s_!pIWi!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F4f4d7bfe-fb31-4d7b-964a-e72adc68e543_2400x1866.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2><strong>The Compute layer</strong></h2><p>Akash Network ($AKT) is the primary decentralized GPU marketplace, the infrastructure backbone from which most inference providers source capacity. Burn-and-mint emissions tokenomics are live for $AKT. Render Network ($RNDR) and io.net ($IO) serve adjacent compute demand across the same structural thesis. </p><p><strong>This is the pick-and-shovel layer:</strong> every inference provider that scales through decentralized compute builds on top of it.</p><h2>The Coordination layer</h2><p>This is where Bittensor ($TAO) sits on the whole map. Its 128 subnets run in continuous Darwinian competition for resources, talent, and inference share. Grayscale has taken stakes in TAO and is building ETF products around the asset. </p><p>The framing that has taken hold institutionally is &#8220;TAO is the BTC of AI,&#8221; a macro-levered coordination layer providing diversified exposure to the entire decentralized AI stack. At ~$20-30M in ecosystem ARR, it is the most levered expression of the category thesis.</p><h2>The Inference layer</h2><p>This is where primary value accrual is happening now. Venice and Chutes lead the current cycle. Lium on Bittensor Subnet 51 is generating ~$600K in monthly burn volume, the largest of any Bittensor subnet. Dolphin AI ($POD) is executing Venice&#8217;s tokenomics playbook on consumer GPU infrastructure, with its v2 peer-to-pool network imminent.</p><p>The Verifiable Inference layer (a sub-segment for now, but a full segment eventually) is the one the market is not pricing. I return to this in the moats section below.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!0WZN!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!0WZN!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 424w, https://substackcdn.com/image/fetch/$s_!0WZN!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 848w, https://substackcdn.com/image/fetch/$s_!0WZN!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 1272w, https://substackcdn.com/image/fetch/$s_!0WZN!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!0WZN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png" width="1456" height="383" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/b5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:383,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:114262,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.rochlabs.com/i/198844870?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!0WZN!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 424w, https://substackcdn.com/image/fetch/$s_!0WZN!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 848w, https://substackcdn.com/image/fetch/$s_!0WZN!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 1272w, https://substackcdn.com/image/fetch/$s_!0WZN!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fb5ec60a4-7418-4db7-88ce-1f0ae14baad5_2400x632.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>The Application layer</h2><p>This covers AI agents, DeFAI, and tooling infrastructure. This is where end-user value accrual eventually concentrates, but where most token fundamentals remain weak relative to the infrastructure layers above them.</p><div><hr></div><h1>The Four Moats</h1><p>Four structural reasons explain why decentralized inference holds territory that centralised labs cannot enter regardless of capital or compute resources. Below I breakdown exactly what makes them special, and defensible against large centralized incumbents:</p><ol><li><p><strong>Privacy:</strong> </p><ol><li><p>Per Cisco&#8217;s 2024 Consumer Privacy Survey, 84% of GenAI users are concerned about data entered in tools going public. For enterprise customers operating under GDPR, CCPA, HIPAA, and financial data regulations, this is not a preference item. It is a liability constraint. </p></li><li><p>OpenAI and Anthropic are structurally compelled to log user interactions for model improvement, abuse detection, and compliance auditing. They cannot offer genuine data separation without dismantling their core model improvement pipelines. </p></li><li><p>Venice AI, Dolphin AI, and the TEE-stack protocols own this market by structural default. The demand is not niche: enterprise legal, healthcare, and financial services clients all face mandates that make inference-with-logging a material compliance exposure.</p></li></ol></li><li><p><strong>Uncensored AI:</strong> </p><ol><li><p>Centralised labs face advertiser sensitivity, regulatory exposure, and reputational risk from uncensored model outputs. Companion AI, penetration testing, red-teaming, political speech in jurisdictions with content restrictions, and enterprise internal tooling with sensitive subject matter are categories the closed labs are structurally blocked from serving at scale. </p></li><li><p>Venice and Dolphin AI sit permanently on the open-weight side of this divide. As model liability frameworks mature and the market split between compliant-censored and open-weight uncensored AI sharpens, this moat deepens rather than narrows.</p></li></ol></li><li><p><strong>Pricing</strong>: </p><ol><li><p>AkashML inference costs ~$2-4 per million tokens. OpenAI&#8217;s API runs ~$15 per million tokens on GPT-class model output; 2026 flagship models range from $2.50 to $30 per million tokens depending on model and token direction. </p></li><li><p>The 70-85% structural discount to AWS is not promotional: it derives from idle consumer GPU supply at near-zero marginal cost of capital, token emission subsidies covering infrastructure overhead, and no centralised data centre CAPEX on the balance sheet. </p></li><li><p>The margin structure improves as the network scales. This is the directional opposite of a traditional cloud provider&#8217;s cost curve, and it is the structural basis for the lock-in mechanics described in the business model section above.</p></li></ol></li><li><p><strong>Verifiable Inference:</strong> </p><ol><li><p>This is the fourth moat and the least understood. TEE-backed inference with cryptographic attestations produces a proof that a specific model generated a specific output, without revealing the model&#8217;s weights or the user&#8217;s input data. </p></li><li><p>For autonomous agents executing financial transactions on-chain, the inference output is the instruction. Without cryptographic proof, that instruction is trusted. With it, it is verified. </p></li><li><p>Ritual, backed by Archetype with ~$25M raised, is building Infernet: smart contracts that natively call ML models with cryptographic proofs. Inference Labs shipped Sertn&#8217;s Proof Inspector in May 2026, generating the highest-engagement technical post in the category that month. Neither has a token. </p></li></ol></li></ol><p>The narrative has not produced a breakout yet, and that&#8217;s understable since we haven&#8217;t seen a breakout success, or proof it can work at scale, or has any specific enterprise deals tied to it yet. Despite that, verifiable inference is arguably the most defensible structural moat in the stack and is currently trading at the lowest awareness premium of the four.</p><div><hr></div><h1>The Bear Case</h1><p>The honest version of this thesis requires stating four risks that could break the thesis around decentralized inference, and make this whole thesis stale. Below I break down each one of them:</p><ol><li><p>Dependency Risk: </p><ol><li><p>Chutes is running an estimated ~90% subsidy ratio which means nine in every ten dollars of revenue is token-subsidised, not organically generated. This exceeds even Helium&#8217;s 78% benchmark from the DePIN cycle, which was itself considered alarming at the time. </p></li><li><p>Most decentralized inference revenue is still token-subsidised rather than organically generated. If token prices fall, compute subsidies shrink, the pricing advantage narrows, and users with no structural switching costs have limited reasons to remain. </p></li><li><p>No protocol in this stack has proven sustainable organic unit economics at scale. That is not a minor caveat. It is the foundational question the thesis must answer to convert from speculative to durable.</p></li></ol></li><li><p><strong>The TAO halving risk:</strong> </p><ol><li><p>This one is specifically for Bittensor-native projects. Daily emissions were cut from 7,200 to 3,600 TAO in December 2025. Subnet miners whose incentives fall below compute cost break-even will exit. </p></li><li><p>The Pareto distribution of subnet quality means a significant portion face meaningful pressure. Inference subnets with real revenue are better insulated than meme subnets, but the halving risk is present across the ecosystem and the 60-day churn data post-halving is the primary risk variable to monitor.</p></li></ol></li><li><p><strong>Venice&#8217;s centralisation critique:</strong> </p><ol><li><p>The argument that Venice runs on centralised infrastructure with a decentralised token wrapper is not a fringe position. </p></li><li><p>If regulatory pressure tightens around centralised AI infrastructure operating with decentralised tokenomics, Venice faces a structural exposure that Chutes, by architectur<strong>e, does not.</strong></p></li></ol></li><li><p><strong>Lopsided demand curve:</strong> </p><ol><li><p>Demand is still scarce relative to supply. Significant capital has been deployed into decentralized AI infrastructure. Institutions are running pilots, not production workloads. </p></li><li><p>No enterprise-scale production deployment is confirmed for any protocol in this stack. The category&#8217;s revenue is real. The scale at which it needs to operate to justify current market caps requires enterprise adoption that has not arrived.</p></li></ol></li></ol><div><hr></div><h2>What to Watch</h2><p>Three developments will determine whether this thesis upgrades from its current state to full institutional validation.</p><ol><li><p><strong>The Galaxy Digital decentralized inference report</strong> is the most important near-term catalyst. When it publishes, it will be the first institutional-grade research document formally scoped to this category. The historical pattern in crypto is consistent: when the first serious institutional report drops on a category with real fundamentals, narrative velocity accelerates regardless of price action at the time of publication. The pre-publication window is where asymmetric positioning has historically been available.</p></li><li><p><strong>The Dolphin AI v2 launch is the nearest product catalyst</strong>: If the peer-to-pool consumer GPU inference network ships with an early ARR trajectory comparable to Venice&#8217;s first months, it validates the hypothesis that the Venice tokenomics model is replicable at scale on distributed consumer hardware, not just enterprise GPU pools sourced from Akash. That would expand the addressable inference supply significantly and harden the pricing moat thesis.</p></li><li><p><strong>The verifiable inference narrative is the sleeper catalyst:</strong> Ritual and Inference Labs have no tokens and no major account has published a dedicated analysis. When the first significant thread or research note covers cryptographic proof of inference at scale, the protocols in this layer will attract pre-token positioning attention. The farming window for those positions exists now, before that awareness arrives.</p></li><li><p><strong>The TAO halving subnet survival data is the ongoing risk monitor:</strong> If churn is manageable and inference subnets with real revenue hold their miner bases over the next 60 days, the halving becomes a supply shock narrative for TAO. If churn is severe, it partially invalidates the Bittensor coordination layer thesis at current prices. It will be interesting to watch how this plays out. </p></li></ol><div><hr></div><h1>In Conclusion</h1><p>The 12x expansion in OpenRouter token consumption in a single year is not a growth rate. It is evidence of a structural transition in how the world processes intelligence (per OpenRouter / a16z State of AI report, Dec 2025). The protocols serving that demand from the positions the large labs cannot occupy (private compute, uncensored inference, cutthroat pricing, cryptographic verification) are already generating real revenue, and the suits don&#8217;t even know as the institutional research coverage has not arrived yet! </p><p>That combination rarely persists. The window between confirmed product-market-fit and institutional narrative is historically short once the first formal report drops. The question is not whether decentralized inference is a real sector: the revenue data answers that. The question is whether the subsidy dependency resolves before the institutional wave fully prices the category.</p><p>That is the risk. And it is worth taking seriously before dismissing either the thesis or the bear case that sits underneath it.</p><div><hr></div><h1>Sources</h1><p>Fact-checked as of <strong>22-May-2026</strong></p><p>- Ritual $25M raise &#8212; Archetype lead (https://cointelegraph.com/news/ai-infrastructure-startup-ritual-raises-25-m-gaps-crypto)</p><p>- Lucas Tcheyan, Research Associate, Galaxy Digital (https://theorg.com/org/galaxy-digital/org-chart/lucas-tcheyan)</p><p>- Cisco 2024 Consumer Privacy Survey (https://www.cisco.com/c/dam/en_us/about/doing_business/trust-center/docs/cisco-consumer-privacy-report-2024.pdf)</p><p>- OpenAI API Pricing 2026 (https://openai.com/api/pricing/)</p><p>- Akash Network GPU pricing (https://akash.network/pricing/gpus/)</p><p>- Bittensor halving December 12, 2025 (https://blog.mexc.com/news/bittensors-historic-first-halving-starts-december-12-will-tao-rally-to-1000-as-daily-emissions-drop-50/)</p><p>- Grayscale TAO ETF filing (https://phemex.com/news/article/grayscale-files-for-bittensor-etf-stabilizing-tao-price-51072)</p><p>- VVV Robinhood listing May 19, 2026 (https://www.cryptotimes.io/2026/05/20/venice-token-vvv-rockets-24-as-robinhood-listing-ignites-rally/)</p><p>- Venice AI: Programmatic Buy &amp; Burns (https://venice.ai/blog/programmatic-vvv-buy-and-burn)</p><p>- Bittensor subnet ARR: Unsupervised Capital (https://www.unsupervised.capital/writing/bittensors-ai-compute-subnets-collectively-reach-20m-arr)</p><p>- OpenRouter / a16z State of AI report (Dec 2025): token consumption data (https://openrouter.ai/state-of-ai)</p><p>- OpenRouter weekly token data context - Trending Topics (https://www.trendingtopics.eu/chinese-ai-models-overtake-us-rivals-in-global-token-consumption/)</p>]]></content:encoded></item><item><title><![CDATA[How I Structure Every Research Note (And Why Most Investment Research Is Theater)]]></title><description><![CDATA[Most investment research is written for engagement, not accountability.]]></description><link>https://www.rochlabs.com/p/how-i-structure-every-research-note</link><guid isPermaLink="false">https://www.rochlabs.com/p/how-i-structure-every-research-note</guid><dc:creator><![CDATA[Rohit Chauhan]]></dc:creator><pubDate>Fri, 15 May 2026 13:17:44 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/81eab84a-8353-453d-97bd-80b3dff39233_2752x1536.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Most investment research is written for engagement, not accountability.</p><p>A chart with arrows. A ten-tweet thread. Numbers specific enough to sound credible. Then the market moves against it and the post disappears. No follow-up. No post-mortem.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>This is not research. Its a prayer disguised as research.</p><p>The tells are always the same. No stated conviction level. No explicit kill conditions. No position disclosures (or worse an advertisement in the garb of research). No mechanism for closing the loop when the thesis fails. The author reserves the right to be right in hindsight and wrong in silence. The reader has no way to distinguish a high-conviction bet from a speculative guess because every post reads the same.</p><p>It is structurally dishonest. So I built a different system.</p><div><hr></div><h2><strong>Conviction Is Not a Feeling but a label</strong></h2><p>Every research note I write opens with one of three words: HIGH, MEDIUM, or SPECULATIVE. That label is the first line. Not buried in paragraph four. Not implied by tone. Written before the thesis begins.</p><p>HIGH conviction means the thesis is tested. Multiple confirming signals exist. I am positioned accordingly. If I cannot name three specific scenarios that would invalidate the call, I do not have HIGH conviction. I have wishful thinking.</p><p>MEDIUM means I am building a position. One or two signals have confirmed. I am staged in and watching for the third. The risk/reward justifies owning it, not fully sizing it.</p><p>SPECULATIVE means the thesis is forming. I may have a starter position or nothing at all. The purpose of a SPECULATIVE note is to document the logic early and state exactly what would upgrade it. If I cannot say what moves it to MEDIUM, I have not thought clearly enough to publish.</p><p>The practical difference matters. A HIGH conviction note on NVDA would require five data-anchored thesis points, a specific catalyst with a date, and three named kill conditions. A SPECULATIVE note on ARM would state explicitly: it will not upgrade until royalty revenue beats by more than 10% and v9 architecture penetration guidance moves above 35%. Same sector, different epistemic states. Same format, different labels.</p><p>Most research platforms publish both types identically. The audience cannot tell which is which until the outcome reveals it. That is not analysis. That is a lottery where the ticket looks the same regardless of odds.</p><div><hr></div><h2><strong>A</strong> <strong>Thesis</strong> <strong>Is</strong> <strong>Not</strong> <strong>a</strong> <strong>Prediction</strong></h2><p>A prediction says: I think this goes up.</p><p>A thesis says: here is the mechanism, here is what would break it, and here is what I own.</p><p>The kill section is what separates them.</p><p>Every HIGH conviction note I write includes it. The format is three specific scenarios that, if they materialize, mean the thesis is wrong and the position is closed. Not vague scenarios. &#8220;Hyperscaler CapEx guidance cut more than 15% in any Q2 earnings call&#8221; is a kill condition. &#8220;Macro deteriorates&#8221; is not.</p><p>This is not hedging. Hedging is writing &#8220;risks include macro uncertainty&#8221; and leaving the reader to interpret it. A kill condition is a commitment device. It states in advance what would change my mind. When that event occurs, I am not permitted to rationalize around it. The condition was pre-defined. The discipline is mechanical.</p><div><hr></div><h2><strong>Losses Should Be Visible</strong></h2><p>When a thesis is killed, I publish a post-mortem in the thesis graveyard. Every one. No exceptions.</p><p>The post-mortem answers three questions: what did I call, what actually happened, and what was the root cause of the miss. The root cause is assigned to one of six categories: narrative risk, timing error, data error, regime change, execution failure, or unknowable at the time of entry.</p><p>Over time, the distribution of categories tells you something specific about your analytical process. If most kills are timing errors, your entry framework is too early. If most are narrative risk, you are overweighting fundamentals relative to market structure. The graveyard is a diagnostic tool, not a confession box.</p><p>The &#8220;unknowable&#8221; category is narrow. Most misses are explainable in retrospect. My ai16z position lost 95% before I exited. The thesis was right; agentic AI infrastructure matters. The bet was wrong. I sized into a team, not a thesis. The infighting and internal breakdown that killed the project were not in my kill section because I was too attached to the position to write honest kill conditions. That is execution failure compounded by attachment bias. The post-mortem said so. Attachment to a position is itself a kill condition. I know that now.</p><p>Most research platforms never close this loop. Kills are silent. The track record is constructed from hits. The audience ends up with a biased sample and no ability to assess actual edge.</p><h2><strong>The Framework in Practice</strong></h2><p>Every note I publish carries a conviction label. Every HIGH conviction note has a kill section. Every closed thesis gets a post-mortem. Every data point is a number. Every position is disclosed at entry, not after the outcome.</p><p>The live data infrastructure is at ai-tracker-sigma.vercel.app. It covers the AI supply chain across equities and tokens. The tracker is the data layer behind every note.</p><p>Over time this expands. More dashboards. More tracked theses. Full transparency on every position I hold and every one I exit. The track record builds in public, not in hindsight.</p><p>The research Discord built on this framework launches soon. It will house every thesis, call, post-mortem, and position update in one place. A living record, not a highlight reel.</p><p>If you&#8217;re curious to join, follow along ROCH Labs or subscribe to be the first to know. </p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[Tether AI: The Genius of Low-Rank Adapation or LoRA]]></title><description><![CDATA[Tether's QVAC Fabric dropped today: the world's first cross-platform BitNet + LoRA Framework]]></description><link>https://www.rochlabs.com/p/tether-ai-the-genius-of-low-rank</link><guid isPermaLink="false">https://www.rochlabs.com/p/tether-ai-the-genius-of-low-rank</guid><dc:creator><![CDATA[Rohit Chauhan]]></dc:creator><pubDate>Tue, 17 Mar 2026 18:30:59 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/27cb179d-cff3-447c-bed8-e1f6197857b8_1280x720.jpeg" length="0" type="image/jpeg"/><content:encoded><![CDATA[<ul><li><p>Earlier today Tether&#8217;s founder and CEO, Paolo Ardoino announced Tether&#8217;s QVAC Fabric breakthrough. </p></li><li><p>The QVAC Fabric LLM is a framework from Tether Data (the team behind the stablecoin,</p><p><a href="https://x.com/search?q=%24USDT&amp;src=cashtag_click">$USDT</a></p><p>) to decentralize AI fine tuning, and enabling private AI.</p></li><li><p>Consider this, if you&#8217;re a MacBook Air M1 user, this framework is particularly relevant to you because the M1 chip&#8217;s Unified Memory Architecture is exactly the kind of &#8220;ordinary device&#8221; this framework is designed to exploit. </p></li><li><p>The QVAC Fabric is a free, open source software framework (think &#8220;toolkit&#8221; or &#8220;engine&#8221;) which lets anyone run and personalize powerful AI models directly.</p></li></ul><p>Usually, if you want a model to know your specific writing style (like your twitter voice) or your specific niche (mine is financial data analysis), you have to upload that data to a cloud provider like Microsoft Azure, which powers OpenAI&#8217;s infrastructure.)</p><p>To receive persaonlized responses from an LLM provider like OpenAI, your data must be sent to and stored on their remote servers.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><blockquote><p><em><strong>QVAC changes this as the framework allows data to stay on your device, and bypass the cloud entirely because the computation happens locally on your hardware. </strong></em></p></blockquote><p>While for most things, it probably doesn&#8217;t matter for the cloud to have access to all your data. But for sensitive stuff, like financial audits, or proprietary investment research, using a local framework like QVAC will allow you to retain 100% custody.</p><p>A pre-trained LLM like Llama, Qwen is like a super-smart but generic university professor who knows everything about the world in general. If you want this professor to become your personal doctor AI (that understands your specific health history, diet, symptoms, and speaks in your style) you need to teach them your private medical notes, blood tests, Whoop data etc.</p><blockquote><p><em><strong>teaching = fine-tuning = updating the model&#8217;s knowledge with your data.</strong></em></p></blockquote><p> In the old way, we would retrain the entire professor from head to toe, and change very single connection in their brain. For a 13B parameter model, that&#8217;s billions of numbers to update. This needs huge servers, costs a fortune in electricity/GPUs, takes days/weeks, and your private data has to leave your phone. </p><p>This is where LoRA (Low-Rank Adaptation) is genius. LoRA says don&#8217;t touch the professor&#8217;s core brain at all. Instead, give them a tiny set of clip-on cheat sheets or post-it notes that they can consult everytime they answer. </p><p>These post-its only contain a very small number of new instructions (often just 0.1% to 1% of the original model&#8217;s size - up to 99% fewer parameters to actually train.)</p><p>The original professor stays frozen (unchanged, safe, no risk of &#8220;forgetting&#8221; general knowledge.)</p><p>When the professor speaks, they combine: original brain (frozen) + tiny LoRA post-its (your personal tweaks). </p><p>The answer feels fully personalized to you, but almost no extra compute/memory is needed. </p><p>Mathematically its clever. The update to any big weight matrix is approximated as the product of two much smaller matrices (low rank = skinny rectangles instead of huge squares). So instead of changing 10,000 x 10,000 numbers, you only train something like 100 x 10,000 + 10,000 x 100 = ~2 million numbers. Huge savings. </p><p>BitNet already makes the base model tiny and fast on phones (weights are just -1/0/+1 instead of full floating point numbers which already saves ~70-90% of memory &amp; compute).</p><p>But fine-tuning BitNet normally was still hard/impossible on phones because even &#8220;updates&#8221; were too heavy. </p><blockquote><p><em><strong>LoRA slashes the update size so dramatically that now the whole personalization process fits in a phone&#8217;s limited RAM and memory.</strong></em></p></blockquote><p>Think of your phone&#8217;s AI as a very compressed zip file of a genius librarian (BitNet makes the zip super small so it fits on phone.)</p><p>LoRA = keep the zipped library untouched, just add a tiny bookmark file with your personal notes/index. Your phone can handle adding/using the bookmark easily, and when you ask questions, the librarian reads the main zip + your bookmark instantly. </p><p><strong>It turns AI from &#8220;rented cloud services that sees all your data&#8221; into &#8220;your own private brain extension that lives on your device and learns only from you.</strong></p><p>No more paying $20/month to OpenAI, no data sent anywhere, no censorship, works offline. </p><p>Tether/QVAC solved making LoRA + BitNet work cross-platform (AMD/Intel/Nvidia/Apple/Mobile GPUs) for the first time. </p><blockquote><p><strong>LoRA is the unlock button that lets billion parameter personalization escape data centers and live in your pocket. That&#8217;s why Paolo and the team are calling it the start of &#8220;Stable intelligence&#8221;. If this clicks now, the rest of the announcement will feel much more exciting and logical. </strong></p></blockquote><p>Now that you understand LoRA, the post should no longer feel &#8220;cool tech jargon + big numbers&#8221; shill. Impressive but abstract! </p><p>Now that you grasp LoRA as the &#8220;tiny post&#8217;it notes&#8221; trick that freezes the huge core model and only trains a minisule add-on layer (up to 99% frwer paramters to update), the whole thing snaps into place and becomes genuinely revolutionary.</p><p>The &#8220;billion-parameter training on a phone&#8221; claim stops sounding impossible.</p><p>Fine-tuning a 13B model normally means updating billions of numbers which needs massive VRAM and power that no phone has.</p><p>But with LoRA, you&#8217;re only training maybe millions (or fewer) of tiny adapter parameters. Add BitNet&#8217;s extreme compression (weights as simple as -1/0/+1), and suddenly that tiny update process fits in a phone&#8217;s limited RAM/battery.</p><blockquote><p><strong>The iPhone demo (13B fine-tine), and Samsung/Pixel 3.8B ones aren&#8217;t hype, they&#8217;re the direct result of LoRA slashing the workload by orders of magnitude.</strong></p></blockquote><p>The &#8220;biggest unlock&#8221; line hits hard. Paolo calls heterogeneous GPU fine-tuning the biggest unlock because LoRA + BitNet now works everywhere (not just Nvidia CUDA). Before, even if BitNet existed, personalizing it required expensive Nvidia rigs or cloud. Now your AMD laptop, Intel PC, Apple Silicon Mac, or flagship phone can do it.</p><p>LoRA is the key that democratizes that persaonlization step azcross hardware - no more &#8220;sorry, only works on $10K GPU&#8221;.</p><p>Privacy and &#8220;serve the people&#8221; vision feels tangible, not fluffy.</p><p>Without LoRA, &#8220;local private AI&#8221; would mean running a generic frozen model (no real personalization) or shipping your data to the cloud for fine-tuning.</p><p><strong>LoRA lets the model learn deeply from your emails/docs/health data entirely on-device, with almost no extra cost. Your AI becomes truly &#8220;yours&#8221; - customized to your life, offline, private forever.</strong></p><p>That&#8217;s why Paolo frames it as the &#8220;first real-world signal of a local private AI that can truly serve the people.&#8221;</p><p>&#8220;Era of Stable Intelligence&#8221; lands as a real shift.</p><blockquote><p><strong>Tether AI is the stablecoin moment for decentralized artificial Intelligence</strong></p></blockquote><p>&#8220;Stable&#8221; here echoes stablecoins: reliable, decentralized, user-controlled, and no central gatekeepers. LoRA + BitNet + cross-platform Fabric =  the technical foundation to escape cloud dependency.  What used to be locked in data centers (personalized frontier AI) now &#8220;escapes&#8221; to your pocket.</p><p>It&#8217;s not just faster/cheaper but it&#8217;s a philosophical unlock toward AI sovereignty.</p><p>In short, LoRA isn&#8217;t just a technique, it&#8217;s the unlock button that turns theoretical edge AI into practical reality today.</p><p>The announcement isn&#8217;t about raw model size anymore. It is about who controls the intelligence (you, on your device) instead of renting it from Big Tech.</p><p>With this lens, the post reads like a declaration of independence for personal AI, and the demos prove it&#8217;s not vaporware.</p><p>Super exciting if you&#8217;re into decentralization, privacy, or just hating monthly API bills. </p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[The Wattage Waterfall of Compute]]></title><description><![CDATA[A single GB200 NVL72 rack draws ~120kW. A standard office building draws ~50-100kW. One AI training rack consumes more power than the entire building you're sitting in.]]></description><link>https://www.rochlabs.com/p/the-wattage-waterfall-of-compute</link><guid isPermaLink="false">https://www.rochlabs.com/p/the-wattage-waterfall-of-compute</guid><dc:creator><![CDATA[Rohit Chauhan]]></dc:creator><pubDate>Thu, 05 Mar 2026 05:56:05 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/bdfc3279-7fc8-4d2c-a660-e4ae371bf620_2752x1536.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>In <a href="https://www.rochlabs.com/p/the-physics-behind-the-ai-trade">Part 1</a> we established that every logic operation costs energy and generates heat, a constraint thermodynamics imposes permanently.</p><p>Today we follow that heat all the way up the stack; from a single chip to a full-scale data center running AI workloads around the clock.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h1>The Wattage Waterfall</h1><p>A single logic operation at the level of a chip generates heat that demands cooling. A cluster of ten thousand chips demand a power grid. A training run demands that the grid run without interruption for weeks, and once a model deploys, inference demand runs the grid forever.</p><h2>The Chip: The micro-unit of compute</h2><p>A single H100 draws 700W of power at peak. One H100 server (8 GPUs) draws 10.2kW of total system power. A single GB200 NVL72 rack - Nvidia&#8217;s current Blackwell configuration draws ~120kW. A standard office building draws roughly 50-100 kW which means one AI training rack consumes more power than an entire office building. (1), (2), (3)</p><h2>The Cluster: Where scale meets physics</h2><p>A frontier model training cluster runs 10k to 25k+ GPUs simultaneously. At 700W per H100, a 10k GPU cluster draws 7MW continuously. xAI&#8217;s colossus cluster in Memphis is ~100,000 H100s drawing ~150-200 MW continuously. (1), (4), (5)</p><h2>The training run level: The wattage it takes to bring GPT-4 to life</h2><p>GPT-4 is estimated to consume ~50 GWh of power for training. This is equivalent to powering ~4,800 average US homes for a full year. For xAI&#8217;s Grok 4, estimates show ~310 GWh of power consumed for training, a 5-6x increase in magnitude over GPT-4. As models become bigger, the training compute will continue to expand, and Epoch AI estimates training compute to scale ~4x per year and by extension the energy cost of training scales at roughly the same rate. (5), (6), (7), (8)</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!6kbR!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!6kbR!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 424w, https://substackcdn.com/image/fetch/$s_!6kbR!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 848w, https://substackcdn.com/image/fetch/$s_!6kbR!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 1272w, https://substackcdn.com/image/fetch/$s_!6kbR!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!6kbR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png" width="1420" height="922" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:922,&quot;width&quot;:1420,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:null,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:null,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:null,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!6kbR!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 424w, https://substackcdn.com/image/fetch/$s_!6kbR!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 848w, https://substackcdn.com/image/fetch/$s_!6kbR!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 1272w, https://substackcdn.com/image/fetch/$s_!6kbR!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff577eb4c-ee3b-43ae-8965-5a4bd9b3fb3a_1420x922.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>The inference level: Where energy demand becomes permanent</h2><p>OpenAI CEO Sam Altman disclosed in a June 2025 blog post that a single ChatGPT query uses ~0.34 watt-hours. Data compiled by Epoch AI independently corroborated Altman&#8217;s own estimates and calculates ~0.3 Wh per query. Altman equated this to an oven in usage for a little over one second, or a high-efficiency lightbulb in use for a couple of minutes in his blog. (6), (9), (10)</p><p>At 2.5B daily queries (or prompts) reported by TechCrunch citing OpenAI in July 2025 allows us to infer that the daily energy demand from inference alone costs 0.34 x 2.5B watt hours of electricity. In other words, ~850 MWh per day, which works to an annual run rate of 850 MWh x 365, ~310 GWh per year. (11)</p><p>As noted above, GPT-4 model training consumed ~50 GWh of electricity. A simple division shows that inference would consume roughly the equivalent of the electricity consumed in the overall training process in ~59 days (50,000 MWh &#247; 850 MWh/day = ~59 days). MIT further states that Inference&#8217;s share of the total AI lifecycle energy is ~80-90%, and reasoning models (o1/o3-class models) only escalate this consumption as data from Epoch AI shows 2.5x more tokens consumed by reasoning models over regular models. (6), (10)</p><h2>The Data Center Level: Where it all aggregates</h2><p>IEA estimates global data center energy consumption to double from ~415 TWh (c.1.5% of global electricity) to 945 TWh as the base case between 2024 and 2030. For context, this is equivalent to the entire current annual electricity consumption of Japan. A Goldman Sachs report further adds that data centers will command 8% of the total US power consumption by 2030 against ~3% in 2022. This massive demand for power explains the approx. $720B grid spending estimates by 2030 by Goldman Sachs, and an estimated ~$736B capex announcements by the top 5 hyperscalers in 2025-26 alone as outlined above. (12), (13)</p><h2>Conclusion</h2><p>The wattage waterfall makes the constraints of physics (thermodynamics) structural requirements. This brings us to the three primary conclusions relevant for all investors trying to build a foundational understanding of the AI trade. </p><p>First, power must be generated. Second, that power must be effectively transmitted across the racks, and third, these AI workloads will generate significant heat which must be removed from the environment. </p><p>These three requirements not only mandate large upfront investments in the build-out for power, grid, and cooling infrastructure; but also force them as structural, not cyclical requirements irrespective of who wins the model race. </p><div><hr></div><p><strong>Now that we&#8217;ve explained the constraints of thermodynamics in Part 1, and the current energy &amp; cooling requirements for SOTA chips powering massive AI workloads, the next question is who builds it, who powers it, and who profits from it. </strong></p><p><strong>In Part 3, I'll map the exact companies whose business models exist to solve the physical constraints outlined above. The investment case for each one is anchored in physical laws that don&#8217;t change regardless of who wins the model race. Stay tuned!</strong></p><p>If you found this useful, <a href="https://www.rochlabs.com/?r=7bpf4y&amp;utm_campaign=subscribe-page-share-screen&amp;utm_medium=web">subscribe</a>. Part 3 drops next week.</p><h1>Citations</h1><ol><li><p>NVIDIA Corporation,<a href="https://www.nvidia.com/en-in/data-center/h100/"> "NVIDIA H100 GPU &#8212; Product Specifications,"</a> accessed February 2026.</p></li><li><p>NVIDIA Corporation,<a href="https://openzeka.com/en/wp-content/uploads/2022/04/ai-for-enterprise-dgx-h100-datasheet-nvidia-a4-2146027-r3-web.pdf"> "NVIDIA DGX H100 Datasheet,"</a> March 2022. Document number A4-2146027-R3.</p></li><li><p>NVIDIA Corporation,<a href="https://www.nvidia.com/en-in/data-center/gb200-nvl72/"> "DGX GB200 NVL72 Datasheet,"</a> NVIDIA Documentation, accessed March 2026.</p></li><li><p>Pilz, K., Rahman, R., Sanders, J. and Heim, L.,<a href="https://epoch.ai/data-insights/training-cluster-size"> "AI Training Cluster Sizes Increased by More Than 20x Since 2016,"</a> Epoch AI, October 23, 2024.</p></li><li><p>James Sanders, Luke Emberson and Yafah Edelman,<a href="https://epoch.ai/data-insights/grok-4-training-resources"> "What did it take to train Grok 4?"</a> Epoch AI, September 12, 2025.</p></li><li><p>James O'Donnell and Casey Crownhart,<a href="https://www.technologyreview.com/2025/05/20/1116327/ai-energy-usage-climate-footprint-big-tech/"> "We did the math on AI's energy footprint,"</a> MIT Technology Review, May 20, 2025.</p></li><li><p>U.S. Energy Information Administration,<a href="https://www.eia.gov/energyexplained/use-of-energy/electricity-use-in-homes.php"> "Electricity Use in Homes,"</a> updated December 18, 2023. Derived estimate: 50 GWh &#247; 10,500 kWh/household/year = ~4,762 households. Rounded to ~4,800 in text.</p></li><li><p>Sevilla, J. and Rold&#225;n, E.,<a href="https://epoch.ai/blog/training-compute-of-frontier-ai-models-grows-by-4-5x-per-year"> "Training Compute of Frontier AI Models Grows by 4-5x Per Year,"</a> Epoch AI, May 28, 2024.</p></li><li><p>Sam Altman,<a href="https://blog.samaltman.com/the-gentle-singularity"> &#8220;The Gentle Singularity,&#8221;</a> blog.samaltman.com, June 11, 2025.</p></li><li><p>You, J.,<a href="https://epoch.ai/gradient-updates/how-much-energy-does-chatgpt-use"> "How much energy does ChatGPT use?"</a> Epoch AI, February 7, 2025.</p></li><li><p>Dastin, J.,<a href="https://techcrunch.com/2025/07/21/chatgpt-users-send-2-5-billion-prompts-a-day/"> &#8220;ChatGPT users send 2.5 billion prompts a day,&#8221;</a> TechCrunch, July 21, 2025.</p></li><li><p>International Energy Agency, &#8220;Energy and AI &#8212; Energy Demand from AI,&#8221; IEA, April 10, 2025.<a href="https://www.iea.org/reports/energy-and-ai/energy-demand-from-ai"> https://www.iea.org/reports/energy-and-ai/energy-demand-from-ai</a></p></li><li><p>Goldman Sachs Research, "<a href="https://www.goldmansachs.com/insights/articles/ai-to-drive-165-increase-in-data-center-power-demand-by-2030">AI to drive 165% increase in data center power demand by 2030</a>," Feb 4, 2025.</p></li></ol><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item><item><title><![CDATA[The Physics Behind the AI Trade]]></title><description><![CDATA[Why Thermodynamics, Not Narratives, Decides Where Value Accrues in the AI Trade]]></description><link>https://www.rochlabs.com/p/the-physics-behind-the-ai-trade</link><guid isPermaLink="false">https://www.rochlabs.com/p/the-physics-behind-the-ai-trade</guid><dc:creator><![CDATA[Rohit Chauhan]]></dc:creator><pubDate>Fri, 27 Feb 2026 15:56:01 GMT</pubDate><enclosure url="https://substack-post-media.s3.amazonaws.com/public/images/388e93a2-2115-40bc-ba4a-b5ed50ef8478_2752x1536.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="native-video-embed" data-component-name="VideoPlaceholder" data-attrs="{&quot;mediaUploadId&quot;:&quot;02849e7b-a1b8-43c5-8edf-740a6642fe98&quot;,&quot;duration&quot;:null}"></div><h1>A Physics first lens to playing the AI trade</h1><p>Physics is the baseline for the natural world, and also the absolute ceiling for any problem we solve (including artificial intelligence.) Everything above the &#8216;physics layer&#8217; are human choices that can theoretically be changed. Confusing human choices for physics laws is what most get wrong.</p><p>The analysis that follows is grounded in the constraints and opportunities physics imposes. Hard science, not media narratives, will decide how to find the winning opportunities in the AI trade.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>The physics that follows exists to serve the investment thesis, not academic completeness. The concepts most applicable are chosen to highlight the constraints, build the analytical foundation, and establish a new lens to evaluate the AI trade.</p><p>This framework also serves as a filter to fact-check every tall claim about AI disruption. physics is the reality check that prevents costly mistakes born of following the crowd rather than grounding analysis in reality.</p><h1>The Physics behind the AI trade</h1><p>At its core, the entire AI lifecycle from inception to end is governed by five primary physical fundamentals. Each manifests at various layers of the AI assembly line.</p><ol><li><p>The law of Thermodynamics (Landauer&#8217;s Limit and Heat Dissipation)</p></li><li><p>The law of speed of light</p></li><li><p>The principles of Quantum Mechanics</p></li><li><p>The laws of information theory (Shannon&#8217;s theorem)</p></li><li><p>The law of Wave physics (Diffraction Limit)</p></li></ol><p>Thermodynamics is already the dominant cost driver in AI infrastructure. The energy and cooling buildout it demands is leading capital allocation decisions across every stakeholder in the race to dominate AI. (1)</p><p>Data compiled by Goldman Sachs shows the five largest hyperscalers in the US will deploy a cumulative $736B in Capex for the AI buildout in 2025 and 2026 alone. Going further, McKinsey has projected a total investment of ~$5.2 trillion for AI data centres by 2030. (2)</p><p>Of that $5.2 trillion, McKinsey estimates $1.3 trillion flows directly into the energisers; the utilities, cooling system manufacturers, and electrical infrastructure providers whose entire business exists to solve the heat and power problem thermodynamics creates. This is the thermodynamics trade expressed in dollars.</p><p>The IEA projects the total demand for energy from data centres to double from ~415 TWh in 2024 to ~945 TWh by 2030, this is the equivalent to adding the entire electricity consumption of Japan in 2024 to the global grid in just six years. These figures establish the scale of what thermodynamics demands in capital terms, and the physics below explains why this demand is permanent. (3, 4)</p><h2>Thermodynamics imposes physical energy constraints on chip compute capabilities</h2><p>If you strip away AI to the precise point where physics shows up, it boils down to a single factor: transistors switching states. Billions of times per second, per chip. Those switching events are what execute the matrix multiplications underlying every model, and every switching event costs energy and generates heat.</p><p>Every compute operation is subject to the constraints imposed by the second law of thermodynamics. A constraint neither engineering nor software can solve. This is nature imposing its will on every transistor switch on every chip at every data centre ever built by humanity.</p><p>The physical law creates two distinct constraints on compute, one theoretical, and one practical. Understanding both builds the foundation for our thesis that the energy infrastructure trade isn&#8217;t cyclical capex but a permanent structural requirement.</p><h3>Constraint 1: Landauer&#8217;s Limit - The Theoretical Floor of Compute</h3><p>First introduced in 1961, the Landauer&#8217;s limit provides the baseline of the minimum quantity of heat dissipated in the environment to erase a single bit of information. At room temperature (~300K), the minimum heat released is 2.8 &#215; 10&#8315;&#178;&#185; joules per bit operation. This is thermodynamics enforcing absolute limits no material, architecture, optimization or engineering can go beyond. This is the theoretical floor of all compute, including AI.</p><p>Peer reviewed literature on this topic argues that modern chips release roughly a million times more energy per logic operation which exceeds the Landauer&#8217;s limit by many orders of magnitude. (5)</p><p>While this sets the physics enforced ceiling on compute per watt, a better lens to understand this is backed by solid research published by Ho, Erdil &amp; Besiroglu (2023) which ignores the Landauer floor and instead tackles the more important and immediate question, &#8220;how much more efficient can silicon transistors realistically get before hitting their own engineering limits?&#8221; (6)</p><p>The current state of the art CMOS architectures, the transistor-based chip designs running today&#8217;s AI GPUs are operating ~207x above the maximum efficiency Ho et al&#8217;s research outlines. In other words, there is capacity to improve chip efficiency to the order of 207x before we hit the practical limits of how much energy per logic operation these chips will consume.</p><p>While this may sound a lot, current AI compute demand is scaling 4-5x per year, and all the efficiency gains are consumed by demand growth before they can actually reduce energy infrastructure requirements. This explains the massive grid capex and hyperscaler expansion efforts in line with the estimates and data compiled by McKinsey and Goldman Sachs outlined above. (7)</p><h3>Constraint 2: Heat Dissipation - The practical constraint of compute</h3><p>Landauer&#8217;s principle is evidence of physics imposing its will on compute. Every switch event is generating heat as a consequence of executing logic operations within the constraints of physics.</p><p>Take the Nvidia H100 for instance, which draws ~700W per chip. The next-gen GB200 NVL72 rack draws nearly 120kW for 72 Blackwell GPUs, in comparison, a single H100 rack consumes 10-30kW. This is 4-12x increase in rack power density in a single generation of GPU offerings. This increase across generations isn&#8217;t a one-time thing either, mapping the energy consumption across four generations of chips starting with V100 (~300W in 2017), A100 (~400W in 2020), H100 (~700W in 2022), and the latest generation of GB200 (~1,000W in 2024) shows how each generation demands meaningfully more power and cooling than the last. (8)</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!YI-k!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!YI-k!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 424w, https://substackcdn.com/image/fetch/$s_!YI-k!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 848w, https://substackcdn.com/image/fetch/$s_!YI-k!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 1272w, https://substackcdn.com/image/fetch/$s_!YI-k!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!YI-k!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png" width="1200" height="520" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:520,&quot;width&quot;:1200,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:43248,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://www.rochlabs.com/i/189370836?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!YI-k!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 424w, https://substackcdn.com/image/fetch/$s_!YI-k!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 848w, https://substackcdn.com/image/fetch/$s_!YI-k!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 1272w, https://substackcdn.com/image/fetch/$s_!YI-k!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F58707a95-a322-45fe-a9e5-189c4ef8b136_1200x520.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><em>Note: Citations 9-12 links to the original source material for the table data above.</em></p><p>At these rates of power consumption, liquid cooling isn&#8217;t just optional infrastructure, it is mandatory, and scales permanently with every watt deployed.</p><p>To sum up, Landauer&#8217;s limit establishes the physical cost of compute which forces generation and consumption of electricity, and heat dissipation mandates cooling infrastructure as heat scales permanently with compute. These aren&#8217;t cyclical capex driven by a temporary infrastructure gap. They are structural requirements imposed by physics.</p><p><strong>Thermodynamics has already decided what the AI infrastructure stack must look like. The next question is who builds it, who powers it, and who profits from it. In Part 2, I'll map the exact companies whose business models exist to solve the physical constraints outlined above. The investment case for each one is anchored in physical laws that don&#8217;t change regardless of who wins the model race. Stay tuned!</strong></p><p>If you found this useful, <a href="https://www.rochlabs.com/?r=7bpf4y&amp;utm_campaign=subscribe-page-share-screen&amp;utm_medium=web">subscribe</a> below. Part 2 drops next week.</p><div><hr></div><h1>Citations</h1><ol><li><p>Goldman Sachs Research, "<a href="https://www.goldmansachs.com/insights/articles/how-ai-is-transforming-data-centers-and-ramping-up-power-demand">How AI Is Transforming Data Centers and Ramping Up Power Demand</a>," July 16, 2024.</p></li><li><p>Jesse Noffsinger et al., "<a href="https://www.mckinsey.com/industries/technology-media-and-telecommunications/our-insights/the-cost-of-compute-a-7-trillion-dollar-race-to-scale-data-centers">The cost of compute: A $7 trillion race to scale data centers</a>," McKinsey Quarterly, April 2025.</p></li><li><p>International Energy Agency, "<a href="https://www.iea.org/reports/energy-and-ai/energy-demand-from-ai">Energy and AI &#8212; Energy Demand from AI</a>," April 2025.</p></li><li><p>Enerdata via Statista, "<a href="https://www.statista.com/statistics/267081/electricity-consumption-in-selected-countries-worldwide/">Electricity consumption worldwide in 2024, by leading country</a>," July 2025.</p></li><li><p>Chattopadhyay, P., Misra, A., Pandit, T., and Paul, G.,<a href="https://arxiv.org/html/2506.10876v1"> "Landauer Principle and Thermodynamics of Computation,"</a>, June 2025.</p></li><li><p>Ho, A., Erdil, E., and Besiroglu, T.,<a href="https://arxiv.org/pdf/2312.08595"> "Limits to the Energy Efficiency of CMOS Microprocessors,"</a> <em>2023 IEEE International Conference on Rebooting Computing</em>, December 2023. . H100 today achieves ~1.4&#215;10&#185;&#178; FP16 FLOP/J. The estimated maximum CMOS efficiency ceiling is ~2.9&#215;10&#185;&#8308; FP16/J. That gap is approximately 207x.</p></li><li><p>Sevilla, J. and Rold&#225;n, E.,<a href="https://epoch.ai/blog/training-compute-of-frontier-ai-models-grows-by-4-5x-per-year"> "Training Compute of Frontier AI Models Grows by 4-5x Per Year,"</a> Epoch AI, May 28, 2024.</p></li><li><p>NVIDIA Corporation,<a href="https://docs.nvidia.com/dgx/dgxgb200-user-guide/hardware.html"> "DGX GB200 User Guide &#8212; Hardware,"</a> NVIDIA Documentation, August 2025.</p></li><li><p>NVIDIA Corporation,<a href="https://images.nvidia.com/content/technologies/volta/pdf/volta-v100-datasheet-update-us-1165301-r5.pdf"> &#8220;NVIDIA V100 Tensor Core GPU Datasheet,&#8221;</a> January 2020.</p></li><li><p>NVIDIA Corporation,<a href="https://www.nvidia.com/content/dam/en-zz/Solutions/Data-Center/a100/pdf/nvidia-a100-datasheet-nvidia-us-2188504-web.pdf"> "NVIDIA A100 Tensor Core GPU Datasheet,"</a> May 2022.</p></li><li><p>NVIDIA Corporation,<a href="https://www.nvidia.com/en-in/data-center/h100/"> "NVIDIA H100 GPU &#8212; Product Specifications,"</a> accessed February 2026.</p></li><li><p>Lenovo, "ThinkSystem NVIDIA HGX B200 180GB 1000W GPU Product Guide," Lenovo Press, LP2226, January 13, 2026. <a href="https://lenovopress.lenovo.com/LP2226">https://lenovopress.lenovo.com/LP2226</a> &#8212; citing NVIDIA GPU specifications, Table 2.</p></li></ol><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://www.rochlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading ROCH Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div>]]></content:encoded></item></channel></rss>