Google simplified AI text-to-image

Plus: Thought Cloning - AI agents learning to think. ReWOO achieves 5x token efficiency.

Hey there,
AI Enthusiasts and Engineering Leaders!

Get ready for our 34th edition of The AI Edge newsletter. This edition goes through Google Research's mind-boggling breakthrough: A method for greater control over image generation without extra training.

A huge shoutout to all of the awesome readers out there. We appreciate you! 😊

In today’s edition:

🖼️ Google simplifies AI text-to-image
🤔 Thought Cloning - AI agents learning to think
💡 ReWOO achieves 5x token efficiency
🌌 Redream AI lets you make anime in real-time

Let’s go!

---

A method for greater control over image generation without extra training

Diffusion models let you create amazing images given the right prompt (often detailed). But some things are hard to express in text, like where objects should go or how big they should be. How can we get this kind of control?

Google Research and UC Berkeley introduced self-guidance, a zero-shot approach that allows for direct control of the shape, position, and appearance of objects in generated images.

It leverages the rich internal representations learned by pre-trained text-to-image diffusion models – namely, intermediate activations and attention – to steer attributes of entities and interactions between them. Moreover, the method can also be used for editing real images.

Why does this matter?

Many previous works have introduced methods to address the limitation mentioned above. However, they all rely on fine-tuning with expensive paired data or must undergo a costly optimization process to perform a few manipulations. This simple yet effective method serves as a window into the inner workings of diffusion models and provides valuable experimental evidence to inform future research.

Source

---

Thought Cloning - AI agents learning to think

Researchers propose a new approach called Thought Cloning to enhance the cognitive abilities of AI agents in reinforcement learning. Instead of just copying what humans do, it tries to understand the thoughts behind those actions. They demonstrate improved performance and adaptability, particularly in unfamiliar situations.

Thought Cloning also benefits AI safety, interpretability, and debugging, allowing for easier identification and resolution of issues while creating more powerful and safer AI agents.

Why does this matter?

Thought Cloning goes a step further by understanding the underlying thoughts behind actions. It has the potential to enhance human-AI interactions, enhance the cognitive abilities of AI agents in reinforcement learning, and ensure the development of more powerful and safer AI systems that benefit society.

Source

---

ReWOO achieves 5x token efficiency

Researchers have proposed ReWOO (Reasoning WithOut Observation), a modular paradigm to reduce token consumption. The idea behind ReWOO is to separate the reasoning process of the LLM from external observations, which would help reduce the token consumption significantly. It also minimizes the computational load associated with repeated prompts.

ReWOO achieves 5x token efficiency and 4% accuracy improvement on HotpotQA, a multi-step reasoning benchmark.

Why does this matter?

ReWOO offers a promising modular paradigm for ALMs, effectively addressing the challenges of redundant prompts and computation complexity. This advancement has the potential to further enhance the capabilities of Large Language Models, making them more efficient and adaptable for various applications in AI.

Source

---

Redream AI lets you make anime in real-time

The latest Fictiverse Redream update features real-time Stable Diffusion from a screen area using Automatic1111's API. With this update, users can now create anime-style images in real time. Here’s a video of generating images in real time while shooting with an iPhone.

Why does this matter?

This capability opens up exciting possibilities for artists, animators, and enthusiasts who can now produce animated content efficiently and quickly. It also represents AI advancements in real-time processing and mobile applications and the increasing computational power of AI algorithms for instant image manipulations.

Source

---

What Else Is Happening

🎨 Adobe Photoshop AI paints an extended version of Mona Lisa (Link)

🔍 Gmail is getting ML models to help users quickly access relevant emails (Link)

🌈 AI-powered smart glasses assist the visually impaired see for the first time (Link)

📝 Artifact news app now uses AI to rewrite headline of a clickbait article (Link)

🚀 Google rolls out AI-powered image-generating feature to Slides (Link)

🤝 Microsoft’s billion-dollar deal with Nvidia-backed CoreWeave for AI computing power (Link)

---

Trending Tools

• Barua AI: AI-powered email generation. Craft personalized, compelling emails that drive conversions.

• Wavechat: Instantly answer visitors' questions with an AI chatbot trained on your website's content.

• ThemAIGuys: AI service empowering e-commerce and print-on-demand sellers with powerful tools.

• Michael AI: AI-powered Investment Analyst. Access and interact with company documents and financial metrics.

• Split My Expenses: Optimize bill splitting workflow with AI features like receipt parsing and secure integrations.

• ChatX: Powerful AI chat client supporting GPT 3.5 and GPT-4 to generate content and boost efficiency.

• Portaly AI: Transform your website into a Link-in-Bio with customizable building blocks. Powered by AI.

• Wand: Empowers everyone with AI to solve business problems and create value faster.

---

That's all for now!

If you are new to ‘The AI Edge’ newsletter. Subscribe to receive the ‘Ultimate AI tools and ChatGPT Prompt guide’ specifically designed for Engineering Leaders and AI enthusiasts.

Thanks for reading, and see you tomorrow.

---