Apple Is Teaching Siri To Understand Your Screen
Plus: ChatGPT is now instantly accessible, Elon Musk says AI might destroy humanity
Hello Engineering Leaders and AI Enthusiasts!
Welcome to the 244th edition of The AI Edge newsletter. This edition features Apple’s AI that can read and understand your screen context.
And a huge shoutout to our amazing readers. We appreciate you😊
In today’s edition:
📲 Apple's Siri will now understand what’s on your screen
🤖 OpenAI introduces instant access to ChatGPT
🚨 Elon Musk says AI might destroy humanity, but it's worth the risk
📚 Knowledge Nugget: OpenAI Sora: Are we all seeing the same thing? by
Let’s go!
Apple's Siri will now understand what’s on your screen
Apple researchers have developed an AI system called ReALM which enables voice assistants like Siri to understand contextual references to on-screen elements. By converting the complex task of reference resolution into a language modeling problem, ReALM outperforms even GPT-4 in understanding ambiguous references and context.
This innovation lies in reconstructing the screen using parsed on-screen entities and their locations to generate a textual representation that captures the visual layout. This approach, combined with fine-tuning language models specifically for reference resolution, allows ReALM to achieve substantial performance gains compared to existing methods.
Why does this matter?
ReALM's ability to understand screen context creates possibilities for more intuitive and hands-free interactions with voice assistants. Imagine effortlessly instructing Siri to "open the app at the bottom right corner." As Apple races to close the AI gap with rivals like Google and Microsoft, ReALM could be a game-changer in making Siri and other Apple products more contextually aware.
OpenAI introduces instant access to ChatGPT
OpenAI now allows users to use ChatGPT without having to create an account. With over 100 million weekly users across 185 countries, it can now be accessed instantly by anyone curious about its capabilities.
While this move makes AI more accessible, other OpenAI products like DALL-E 3 still require an account. The company has also introduced new content safeguards and allows users to opt out of model training, even without an account. Despite growing competition from rivals like Google's Gemini, ChatGPT remains the most visited AI chatbot site, attracting 1.6 billion visitors in February.
Why does this matter?
By allowing anyone to instantly access ChatGPT, OpenAI is expanding its user base and encouraging more people to explore the potential applications of AI. This move could accelerate the adoption of AI tools across various industries, as users become more comfortable with the technology.
Elon Musk says AI might destroy humanity, but it's worth the risk
Elon Musk recently shared his thoughts on the potential dangers of AI at the Abundance Summit's "Great AI Debate" seminar. He estimated a 10-20% chance that AI could pose an existential threat to humanity.
Despite the risks, Musk believes that the benefits of AI outweigh the potential dangers. He emphasized the importance of teaching AI to be truthful and curious, although he didn't provide specifics on how he arrived at his risk assessment.
Why does this matter?
Musk's comments emphasize the importance of using AI's advantages while addressing its potential risks. This involves creating transparent, accountable AI systems aligned with human values. While his estimate is concerning, continued research in AI safety and governance is necessary to ensure AI remains beneficial.
Enjoying the daily updates?
Refer your pals to subscribe to our daily newsletter and get exclusive access to 400+ game-changing AI tools.
When you use the referral link above or the “Share” button on any post, you'll get the credit for any new subscribers. All you need to do is send the link via text or email or share it on social media with friends.
Knowledge Nugget: OpenAI Sora: Are we all seeing the same thing?
In this detailed article,
dives into what Sora can and cannot do, based on the example videos released by OpenAI. While Sora can generate impressive long video clips (up to 1 minute) from text prompts, it struggles with consistency and realism. Characters' clothing and objects often change between shots, and there are noticeable deformations in the generated assets. As the creative team who worked with Sora noted, the model excels at bringing impossible ideas to life rather than replicating reality.As an initial use case, Sora may be used for creative experimentation, creating b-roll footage, advanced storyboarding, and creating eye-catching visuals. Despite this, he points out that its lack of powerful, fine-grained controls and tooling could be limiting to Sora's practical use.
Why does this matter?
Sora represents a significant step forward in foundational video generation, but it still needs robust tooling and interoperability to completely transform video production. By critically examining the hype surrounding new AI models, we can identify areas for improvement for more practical applications.
What Else Is Happening❗
🚫 Pinecone launches Luna AI that never hallucinates
Trained using a novel "information-free" approach, Luna achieved zero hallucinations by always admitting when it doesn't know an answer. The catch? Its performance on other tasks is significantly reduced. While not yet open-sourced, vetted institutions can access the model's source and weights. (Link)
🤝 US and UK collaborate to tackle AI safety risks
As concerns grow over the potential risks of next-gen AI, the two nations will work together to develop advanced testing methods and share key information on AI capabilities and risks. The partnership will address national security concerns and broader societal issues, with plans for joint testing exercises and personnel exchanges between their respective AI safety institutes. (Link)
🔍 Perplexity to test sponsored questions in AI search
Perplexity's Chief Business Officer, Dmitry Shevelenko, announced the company's plan to introduce sponsored suggested questions later this year. When users search for more information on a topic, the platform will display sponsored queries from brands, allowing Perplexity to monetize its AI search platform. (Link)
🇯🇵 OpenAI expands to Japan with Tokyo office
The Tokyo office will be OpenAI's first in Asia and third international location, following London and Dublin. The move aims to offer customized AI services in Japanese to businesses and contribute to the development of an AI governance framework in the country. (Link)
🤖 Bixby gets a GenAI upgrade
Despite speculation, Samsung isn't giving up on its voice assistant, Bixby. Instead, the company is working hard to equip Bixby with generative AI to make it smarter and more conversational. Samsung introduced a suite of AI features called Galaxy AI to its smartphones, including the Galaxy S24's use of Google's Gemini Nano AI model. (Link)
New to the newsletter?
The AI Edge keeps engineering leaders & AI enthusiasts like you on the cutting edge of AI. From machine learning to ChatGPT to generative AI and large language models, we break down the latest AI developments and how you can apply them in your work.
Thanks for reading, and see you tomorrow. 😊