SIMA 2: An Agent That Plays, Reasons, and Learns with You in Virtual 3D Worlds

https://deepmind.google/blog/sima-2-an-agent-that-plays-reasons-and-learns-with-you-in-virtual-3d-worlds/

#HackerNews #SIMA2 #VirtualReality #AI #Learning #Gaming #3DWorlds

Ever sketched something so bad it hurt to look at?

Vibe Draw doesn’t care. It turns your chaotic scribbles into full-blown 3D vibes.
Like, actual worlds. From lines. Madness.

Open-source magic here: https://github.com/martin226/vibe-draw

#AIArt #3DWorlds #OpenSource #GenerativeAI #VibeDraw #IndieDev #SketchTo3D #CreativeCoding

"DeepMind, Google’s AI research org, has unveiled a model that can generate an “endless” variety of playable 3D worlds.

Called Genie 2, the model — the successor to DeepMind’s Genie, which was released earlier this year — can generate an interactive, real-time scene from a single image and text description (e.g. “A cute humanoid robot in the woods”). In this way, it’s similar to models under development by Fei-Fei Li’s company, World Labs, and Israeli startup Decart.

DeepMind claims that Genie 2 can generate a “vast diversity of rich 3D worlds,” including worlds in which users can take actions like jumping and swimming by using a mouse or keyboard. Trained on videos, the model’s able to simulate object interactions, animations, lighting, physics, reflections, and the behavior of “NPCs.”"

https://techcrunch.com/2024/12/04/deepminds-genie-2-can-generate-interactive-worlds-that-look-like-video-games/

#AI #GenerativeAI #GeneratedImages #DeepMind #Google #VideoGames #3DWorlds