Skip to content


Future Tools: The 12 Days of OpenAI

 

The 12 Days of OpenAI

On the first day of Shipmas, OpenAI gave to me…an AI assistant named Sora.  The company’s 12 Days of OpenAI event is packed with new tools and updates. Here’s what made the list so far:
  • Sora: a video generation AI that offers expanded tools for creative expression and storytelling (keep reading for my deep dive into top Sora’s features)
  • ChatGPT o1: an upgraded chatbot (at a cool $200/month for o1 Pro) promising better performance and a more humanlike experience
  • Canvas: a collaborative AI coding/writing tool that goes beyond simple chat (it’s like brainstorming but supersonic)
What are the early reactions? Some users love the potential of tools like Sora to disrupt media and video. And others were excited about Canvas’s feature expansion to free users once it exits beta.

AI Tool Report

Our Story: For day six of OpenAI’s “12 Days of OpenAI,” OpenAI has released Advanced Voice Mode with Vision—seven months after it first teased the feature—which means ChatGPT can now ‘’see’’ what users can, and respond in real-time.

 Key Points:
  • Plus, Team, and Pro ChatGPT users, can now point their mobile camera at an object and have real-time conversations with ChatGPT about it, and they can also ask it questions about what’s on their device screen, too.
  • In a demo, the feature correctly identified and gave feedback on an anatomical drawing—“The location is spot on…the brain is more oval”—but it did get a geometry question wrong, suggesting it’s prone to hallucinations.
  • Not all Plus, Team, and Pro users will get access though, OpenAI couldn’t establish when EU, Switzerland, Iceland, Norway, or Liechtenstein users would get it, and Enterprise and Edu users will not get it until January.
Why you should care: Although it was first announced back in May—and has been delayed several times—OpenAI’s launch of real-time vision analysis capabilities comes as Google launched Gemini 2.0 yesterday—which can process visual and audio and has more agentic capabilities—which is powering a real-time video analysis feature, Project Astra (released to a small group of testers), its web-based task agent, Project Mariner, and its coding agent, Jules.
As a little stocking filler, OpenAI has also added a preset Santa voice to its Advanced Voice Mode feature in ChatGPT (see ‘Recommended Resources for a demo), although no one knows if they got permission from Santa to use his voice…”

 

  • Pro plugin deactivated or invalid

Posted on: January 20, 2025, 1:26 pm Category: Uncategorized

0 Responses

Stay in touch with the conversation, subscribe to the RSS feed for comments on this post.