Microsoft’s New AI Advances Video Understanding with GPT-4V 🎥🤯
Plus: Biden signed an executive order for AI safety, Microsoft’s new AI teaching tool.
Hello Engineering Leaders and AI Enthusiasts!
Welcome to the 136th edition of The AI Edge newsletter. This edition brings you Microsoft Azure AI’s new AI system, “MM-VID,” which enhances video understanding with GPT-4V.
And a huge shoutout to our incredible readers. We appreciate you😊
In today’s edition:
🎥 Microsoft’s New AI Advances Video Understanding with GPT-4V
🖊️US President signed an executive order for AI safety
🎓 Microsoft’s new AI tool in collab with teachers
📚 Knowledge Nugget: The underrated tool of 2023 by
Let’s go!
Microsoft’s New AI Advances Video Understanding with GPT-4V
A paper by Microsoft Azure AI introduces “MM-VID”, a system that combines GPT-4V with specialized tools in vision, audio, and speech to enhance video understanding. MM-VID addresses challenges in analyzing long-form videos and complex tasks like understanding storylines spanning multiple episodes.
Experimental results show MM-VID's effectiveness across different video genres and lengths. It uses GPT-4V to transcribe multimodal elements into a detailed textual script, enabling advanced capabilities like audio description and character identification.
Why does this matter?
Improved video understanding can make content more enjoyable for all viewers. Also, MM-VID's impact can be seen in inclusive media consumption, interactive gaming experiences, and user-friendly interfaces, making technology more accessible and useful in our daily lives.
US President signed an executive order for AI safety
President Joe Biden has signed an executive order directing government agencies to develop safety guidelines for artificial intelligence. The order aims to create new standards for AI safety and security, protect privacy, advance equity and civil rights, support workers, promote innovation, and ensure responsible government use of the technology.
The order also addresses concerns such as the use of AI to engineer biological materials, content authentication, cybersecurity risks, and algorithmic discrimination. It calls for the sharing of safety test results by developers of large AI models and urges Congress to pass data privacy regulations. The order is seen as a step forward in providing standards for generative AI.
Why does this matter?
This order safeguards against AI risks, from privacy concerns to algorithmic discrimination, making AI applications more trustworthy and reliable in everyday life.
Microsoft’s new AI tool in collab with teachers
Microsoft Research has collaborated with teachers in India to develop an AI tool called Shiksha copilot, which aims to enhance teachers' abilities and empower students to learn more effectively. The tool uses generative AI to help teachers quickly create personalized learning experiences, design assignments, and create hands-on activities.
It also helps curate resources and provides a digital assistant centered around teachers' specific needs. The project is being piloted in public schools and has received positive feedback from teachers who have used it, saving them time and improving their teaching practices. The tool incorporates multimodal capabilities and supports multiple languages for a more inclusive educational experience.
Why does this matter?
Shiksha enhances teaching quality and personalized learning for students, benefiting both educators and learners. During the pilot phase, teachers managed to cut their daily lesson planning time from 60-90 minutes to a mere 60-90 seconds. It exemplifies how AI can address educational challenges, making teaching more efficient and personalized.
Enjoying the daily updates?
Refer your pals to subscribe to our daily newsletter and get exclusive access to 400+ game-changing AI tools.
When you use the referral link above or the “Share” button on any post, you'll get the credit for any new subscribers. All you need to do is send the link via text or email or share it on social media with friends.
Knowledge Nugget: 💎 The underrated tool of 2023
In this article, the author
talks about Coda. It’s an underrated tool that is more powerful than Google Docs and more flexible than Airtable or Notion. It allows users to embed multimedia, make docs private or collaborative, and connect to other apps and automation.
Coda also has interactive elements, clickable buttons, and the ability to organize data in searchable databases. Additionally, Coda recently launched AI features such as AI chat, AI editor, and AI auto-fill. Despite its usefulness, Coda is not widely talked about.
Why does this matter?
Coda makes document creation and management more efficient and interactive, improving productivity for individuals and teams. Also, its features can streamline various tasks, from project management to content creation, making it a valuable tool in business, education, and more.
What Else Is Happening❗
📝 Apple has released its new journaling app called Journal
Journal focuses on multimedia content, such as photos and videos, and offers algorithmically curated writing prompts. Apple has expressed no plans to offer Journal on other platforms, despite its work on porting iOS apps to macOS. (Link)
👩🏫 Practica launched a career coaching and mentorship AI chatbot
The AI chatbot acts as a personalized workplace mentor and coach, offering guidance on various topics. It uses a technique called Retrieval Augmented Generation (RAG) to match the best learning resources for users. (Link)
🌟 Alibaba upgraded its AI model and released industry-specific models
Alibaba’s Tongyi Qianwen 2.0 now has "hundreds of billions of" parameters, making it one of the world's most powerful AI models. The company has also launched eight AI models for various industries, including entertainment, finance, healthcare, and legal sectors. (Link)
🧮 NVIDIA showcased how AI can help in designing semiconductor chips
Nvidia's AI NeMo, has been used by semiconductor engineers to assist in the complex process of designing chips. The model, called ChipNeMo, was trained on Nvidia's internal data and can generate and optimize software, as well as assist human designers. (Link)
🚀 MIT scientists developed an AI copilot system ‘Air-Guardian’ for flight safety
The system works with airplane pilots, based on a deep learning system called Liquid Neural Networks, which can detect when a human pilot overlooks a critical situation and intervene to prevent potential incidents. (Link)
That's all for now!
Subscribe to The AI Edge and join the impressive list of readers that includes professionals from Moody’s, Vonage, Voya, WEHI, Cox, INSEAD, and other reputable organizations.
Thanks for reading, and see you tomorrow. 😊