Groundbreaking Cancer Care Tool Built with GPT-4o

Plus: Meta unveils new AI models for audio, text, and watermarking, Notion introduces AI Connectors for Slack & Google Drive integration

Hello Engineering Leaders and AI Enthusiasts!

Welcome to the 300th edition of The AI Edge newsletter. This edition features a groundbreaking cancer care tool built with GPT-4o.

And a huge shoutout to our amazing readers. We appreciate you😊

In today’s edition:

🩺 OpenAI and Color Health join forces to accelerate cancer treatment
🎤 Meta unveils new AI models for audio, text, and watermarking
⚒️Notion introduces AI Connectors for Slack & Google Drive integration
🧠 Knowledge Nugget: Doing Stuff with AI: Opinionated Midyear Edition by

Ethan Mollick

Let’s go!

---

OpenAI and Color Health join forces to accelerate cancer treatment

In collaboration with OpenAI, Color Health has developed a copilot application that leverages OpenAI’s GPT-4.o model to assist clinicians in accelerating cancer treatment. Here’s how it works:

• Integration of medical data: The copilot integrates patient medical data with clinical knowledge using OpenAI’s APIs. It processes and normalizes vast unstructured data such as family history, individual risk factors, and clinical guidelines.

• Tailored treatment plans: Based on this data, the copilot generates customized, comprehensive treatment plans. These plans answer critical questions like “What screenings should the patient be doing?” and identify missing diagnostics.

• Clinician-in-the-loop workflow: A clinician evaluates the copilot’s output at each step. They can modify it if necessary before presenting it to the patient.

• Assured privacy: Color Health ensures HIPAA compliance and maintains rigorous privacy standards while providing clinician oversight to ensure high-quality care.

Why does it matter? 

The tool identifies missing diagnostics and expedites the analysis of complex medical records - a process that can now be completed in just 5 minutes rather than hours or weeks. This not only improves access to critical expertise but also has the potential to catch cancer or pre-cancerous conditions earlier, enabling faster treatment and better patient outcomes.

Source

---

Meta unveils new AI models for audio, text, and watermarking

Meta’s Fundamental AI Research (FAIR) team has recently released several new AI models and tools for researchers to use. Here are the highlights:

• JASCO: This AI model, short for “Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generation,” allows users to adjust features of generated sound (such as chords, drums, and melodies) through text inputs. FAIR plans to release the JASCO inference code under an MIT license and the pre-trained model under a non-commercial Creative Commons license.

• AudioSeal: This tool adds watermarks to AI-generated speech. It’s designed specifically for localized detection of AI-generated segments within longer audio snippets and will be released with a commercial license.

• Chameleon: FAIR will release two sizes of its multimodal text model, Chameleon (7B and 34B), under a research-only license. These models can handle tasks requiring visual and textual understanding, such as image captioning.

Why does it matter?

By making these tools publicly available, Meta encourages collaboration within the AI community, which could lead to groundbreaking applications in various fields, such as music creation, sound design, and content generation. Moreover, the introduction of AudioSeal addresses the growing need to identify and attribute AI-generated content, promoting transparency and accountability in an increasingly AI-driven world.

Source

---

Notion introduces AI Connectors for Slack & Google Drive integration

With AI Connectors, users can query Notion and receive responses from connected apps. The integration allows for selecting specific public channels or all public channels for information retrieval, excluding private channels and direct messages. 

Notion AI can access up to a year of historical Slack content, which may take up to 36 hours. Additionally, users can set up various interactions between Notion and Slack, such as sending Slack messages to a Notion database, creating Notion tasks directly from Slack, and receiving notifications in Slack for specific events in Notion

Why does it matter?

This development demonstrates the growing trend of incorporating AI capabilities into mainstream productivity and collaboration platforms. The ability to intelligently pull in and surface relevant information from external platforms helps streamline workflows, enhance productivity, and improve the overall efficiency of the team.

Source

---

Enjoying the daily updates?

Refer your pals to subscribe to our daily newsletter and get exclusive access to 400+ game-changing AI tools.

When you use the referral link above or the “Share” button on any post, you'll get the credit for any new subscribers. All you need to do is send the link via text or email or share it on social media with friends.

---

Knowledge Nugget: Doing Stuff with AI: Opinionated Midyear Edition

In his latest newsletter,

Ethan Mollick

shares his insights on the latest developments in the AI landscape, blending both playful and serious applications. Known for his engaging talks and newsletters, Ethan suggests starting with playful applications like using AI to generate songs or host an imaginary game as a way to explore the capabilities and limitations of current AI systems. Playing with AI provides insight into where it can be imaginative or cliched.

For serious work, he recommends choosing one of the most advanced LLMs currently available (like GPT-4, Claude 3 Opus, or Gemini 1.5) and using it for various work tasks like getting advice, summarizing meetings, generating ideas, writing, producing reports, etc. The key is to "always invite AI to the table" to explore what it can do.

Ethan Mollick

envisions a future where AI models are not only smarter but also more versatile, capable of seamlessly handling multiple types of tasks. He encourages readers to keep trying out new AI tools to discover their potential and make the most of them in both work and creative pursuits.

Why does it matter?

As AI continues to advance at a breakneck pace, understanding the capabilities and limitations of the most recent AI models can help you make better decisions about leveraging these tools to enhance your work, spark creativity, and solve complex problems. 

Source

---

What Else Is Happening❗

🧠 Google transitions DeepMind from research to AI product development

This transition involves merging Google Research’s Brain team with DeepMind, creating a unified group called Google DeepMind. The aim is to enhance the development of advanced AI technologies responsibly. However, this move has led to frustration among some researchers due to new guidelines and the pressure to commercialize AI technologies. (Link)

📽️ ElevenLabs’ new open-source AI tool adds sound effects to videos

The app extracts four frames from the video and sends them with a prompt to OpenAI’s GPT-4 to generate a text-to-sound effects prompt. This prompt is used by ElevenLabs’s Sound Effects API to create the sound effect, which is then combined with the video into a single file up to 22 seconds long, ready for download. (Link)

🤖 Snap unveils advanced gen AI for enhanced AR effects

Snap’s latest iteration of gen AI allows users to see more realistic special effects. It plans to create full-body AR experiences rather than just facial AR experiences, such as generating a new outfit. It also announced an upgraded version of its developer program, Lens Studio, which lets artists and developers create AR features for Snapchat or other websites and apps. (Link)

🎨 Hedra Labs launches Character-1, a multimodal creation studio preview

Hedra Labs has launched a preview of Character-1, a model for creating expressive characters that talk, sing, and rap. It offers infinite duration (30s in open preview) and generates 90s content per 60s of input, hardware permitting. This is part of Hedra's mission to give creators control over dialogue, movement, and virtual worlds. (Link)

🦋 Ex-Snap engineer launches AI-human social network, Butterflies

The platform allows users to create AI avatars, called "Butterflies," that can engage in conversations, generate images, and participate in social activities like human users. The app offers a range of features, including creating and customizing AI characters and exploring a feed filled with AI-generated and human-generated content. (Link)

---

New to the newsletter?

The AI Edge keeps engineering leaders & AI enthusiasts like you on the cutting edge of AI. From machine learning to ChatGPT to generative AI and large language models, we break down the latest AI developments and how you can apply them in your work.

Thanks for reading, and see you tomorrow. 😊

---