<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
	<channel>
		<title>Generative-Ai on Dr. Hitesh Sarda</title>
		<link>https://hitesh.in/tags/generative-ai/</link>
		<description>Recent content in Generative-Ai on Dr. Hitesh Sarda</description>
		<generator>Hugo</generator>
		<language>en-US</language>
		
		
		
		
			<lastBuildDate>Sun, 30 Mar 2025 00:00:00 +0000</lastBuildDate>
		
			<atom:link href="https://hitesh.in/tags/generative-ai/index.xml" rel="self" type="application/rss+xml" />
			<item>
				<title>The Rise of Multimodal Image Generation: A New Era for AI</title>
				<link>https://hitesh.in/2025/the-rise-of-multimodal-image-generation-a-new-era-for-ai/</link>
				<pubDate>Sun, 30 Mar 2025 00:00:00 +0000</pubDate>
				<guid>https://hitesh.in/2025/the-rise-of-multimodal-image-generation-a-new-era-for-ai/</guid>
				<description>&lt;p&gt;Over the past two weeks, both Google and OpenAI have unveiled their new multimodal image generation capabilities. This marks a significant leap forward in AI technology.&#xA;*You would have seen the OpenAI one in action on every other social media post - in the studio Ghibli style. And as always Google&amp;rsquo;s work in completely inaccessible even to paid Gemini users. *&#xA;However this post is not about how to create a cartoon caricature, it delves on other use cases.&#xA;&lt;strong&gt;From Text-to-Image to Multimodal Generation&lt;/strong&gt;&#xA;Previously, when a Large Language Model (LLM) generated an image, it wasn&amp;rsquo;t a direct process. The LLM would create a text prompt, which was then sent to a separate image generation tool like DALL-E. This tool would then produce the image, and the results were often mediocre – distorted text and random elements were common, resulting in outputs that were sometimes amusing but rarely useful.&#xA;Multimodal image generation represents a significant advancement. Now, the AI directly controls the image creation process. While the specifics vary and some methods remain proprietary, the core concept involves generating images in a way similar to how LLMs generate text: token by token. Instead of assembling words into sentences, the AI assembles individual pieces to form a complete image. This allows for much more precise and impressive results, reflecting the LLM&amp;rsquo;s &amp;ldquo;thinking&amp;rdquo; and enabling clear composition and control.&#xA;&lt;strong&gt;Examples of Multimodal Image Generation&lt;/strong&gt;&#xA;&lt;strong&gt;The before:&lt;/strong&gt;&#xA;Image generated from ChatGTP which used DALL-E&#xA;&lt;strong&gt;The after:&lt;/strong&gt;&#xA;Much better, and yet some text glitches. Almost feels like there is an OCR being done. Note: Image is cropped&#xA;&lt;strong&gt;Prompting Images Like People&lt;/strong&gt;&#xA;In the past, I&amp;rsquo;ve emphasized the importance of treating AI like a person when prompting, even though it isn&amp;rsquo;t. Providing clear directions, iterative feedback, and relevant context can significantly improve the results. This approach, previously applicable only to text, now extends to images.&#xA;For instance, when I asked GPT-4o to &amp;lsquo;create an infographic about omni-channel marketing,&amp;rsquo; the AI produced a solid starting point. From there, it was like a conversation: I refined the image by asking it to &amp;lsquo;make the graphics hyper-realistic&amp;rsquo; and then &amp;lsquo;shift the colors from earth tones to vibrant.&amp;rsquo; Even a small error are easily corrected with a simple prompt. This shows how you can work &lt;em&gt;with&lt;/em&gt; the AI to achieve the desired result.&#xA;The capabilities of these models are truly impressive. Consider the following progression of prompts and results:&lt;/p&gt;</description>
			</item>
	</channel>
</rss>
