<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
	<channel>
		<title>Inference on Dr. Hitesh Sarda</title>
		<link>https://hitesh.in/tags/inference/</link>
		<description>Recent content in Inference on Dr. Hitesh Sarda</description>
		<generator>Hugo</generator>
		<language>en-US</language>
		
		
		
		
			<lastBuildDate>Thu, 25 Jun 2026 00:00:00 +0000</lastBuildDate>
		
			<atom:link href="https://hitesh.in/tags/inference/index.xml" rel="self" type="application/rss+xml" />
			<item>
				<title>OpenAI&#39;s Chip Is Also a Test of Its Own AI</title>
				<link>https://hitesh.in/2026/openai-jalapeno-chip/</link>
				<pubDate>Thu, 25 Jun 2026 00:00:00 +0000</pubDate>
				<guid>https://hitesh.in/2026/openai-jalapeno-chip/</guid>
				<description>&lt;p&gt;OpenAI &lt;a href=&#34;https://techcrunch.com/2026/06/24/openai-unveils-its-first-custom-chip-built-by-broadcom/&#34;&gt;announced its first custom chip&lt;/a&gt; on Tuesday. It is called Jalapeño, it is built by Broadcom, and it is optimized for inference (specifically the real-time coding models that now account for a meaningful share of their traffic). Custom inference silicon is &lt;a href=&#34;https://hitesh.in/2026/apple-ai-inference-silicon/&#34;&gt;not a differentiator anymore&lt;/a&gt;; it is the minimum, the thing every serious AI company builds once inference cost becomes the line item that actually hurts. Google has TPUs. Amazon has &lt;a href=&#34;https://aws.amazon.com/ai/machine-learning/inferentia/&#34;&gt;Inferentia&lt;/a&gt;. Apple is working on Baltra, also with Broadcom. Welcome to the club.&lt;/p&gt;</description>
			</item>
			<item>
				<title>Will Apple Pull a SpaceX?</title>
				<link>https://hitesh.in/2026/apple-ai-inference-silicon/</link>
				<pubDate>Sat, 20 Jun 2026 00:00:00 +0000</pubDate>
				<guid>https://hitesh.in/2026/apple-ai-inference-silicon/</guid>
				<description>&lt;p&gt;The safe way to read Apple&amp;rsquo;s server-chip plans is that Apple is building silicon to run Apple Intelligence on its own hardware instead of Nvidia&amp;rsquo;s. True, and boring. Every company at Apple&amp;rsquo;s scale now builds its own inference chip. Google has TPUs, AWS has &lt;a href=&#34;https://aws.amazon.com/ai/machine-learning/inferentia/&#34;&gt;Inferentia&lt;/a&gt;, Microsoft has Maia, Meta has MTIA. &lt;a href=&#34;https://www.tomshardware.com/pc-components/cpus/apple-reportedly-readies-baltra-processors-for-ai-servers&#34;&gt;Mark Gurman reports&lt;/a&gt; Apple&amp;rsquo;s entry, codenamed Baltra, is being built with Broadcom on TSMC&amp;rsquo;s 3nm process for 2027, tuned for inference rather than training. Welcome to the club. The chip is table stakes.&lt;/p&gt;</description>
			</item>
	</channel>
</rss>
