Google shows its hand: Genie 3 allows you to “step into” famous paintings in 1 second, and everyone can create an interactive world.

The newly released Genie 3 world model by Google is mind - blowing with its amazing AI capabilities: from generating interactive spaces from text, to freely exploring classic masterpieces such as "The Death of Socrates" and "Nighthawks", and even training 3D models for an immersive experience!

Google has shown its hand and stopped pretending!

The Genie 3 world model they released a few days ago is frantically demonstrating the superpowers of AI.

It can not only generate an interactive AI space world from text, but also manipulate images and videos.

For example, you can now enter world - famous paintings and move around and observe at will.

This immersive on - site feeling is extremely exciting for students who love art.

Some netizens used Genie 3 to enter Jacques Louis David's famous painting "The Death of Socrates".

This 1787 oil painting is a representative work of neoclassicism and is currently housed in the Metropolitan Museum of Art in New York.

The painting depicts the moment when Socrates was sentenced to drink hemlock: he was still reasoning and reaching out for the cup, some of his students were crying, while Plato sat quietly beside him.

The picture is clean and sharp, with strong lighting, vividly depicting the hardcore image of "dying for reason" in a shocking way.

In the past, we could only quietly admire the masterpieces of great artists in a two - dimensional plane.

Now, with the help of Genie 3, we have the opportunity to go back more than 2,400 years ago in one second and witness Socrates drinking the hemlock.

By simply pressing a button, you can walk through it and experience art, history, and philosophy more immersively.

This is not only the superpower of AI, but also the meaning of its existence - to better achieve and enhance people!

Bilawal Sidhu, a former member of Google's XR and Map teams, even successfully trained a 3D Gaussian Splat model using the generation capabilities of Genie 3.

The specific process is roughly as follows:

• Genie 3 generates an interactive dynamic 3D world from images (such as oil paintings), supporting real - time navigation and multi - view rendering.
• Then, perform internal painting (removing UI elements) and enlargement processing (using Topaz AI to enhance the resolution by 4 times).
• Finally, use these processed images to train the 3D Gaussian Splat model to achieve efficient radiance field rendering and immersive exploration.

In addition to the Gaussian Splat model, Bilawal Sidhu also tried to process through the classic photogrammetry process to extract a textured 3D mesh, which can be imported into any 3D tool.

Although the effect is not as elegant as that of the Gaussian Splat, it is still usable.

Finally, Bilawal Sidhu kindly shared the links to the two models so that everyone can experience them.

Quite nice👍

Gaussian Splat: https://superspl.at/view?id=e05e5eb7

Photogrammetry technology: https://sketchfab.com/3d-models/socrates-painting-genie-3-to-textured-3d-mesh-147645d6cc2c4d8c86d23a73f3215b8a

Another shocking example is entering Edward Hopper's "Nighthawks".

This is an oil painting completed in 1942 and is currently housed in the Art Institute of Chicago.

The picture shows a late - night diner on a street corner: bright white lights, three customers and a clerk inside the glass window, and an empty street outside with almost no visible door.

It is a symbol of American realism, constantly being paid tribute to in movies, advertisements, and photography, and has almost become a synonym for the "late - night feeling of modern cities".

Entering the painting through Genie 3, you feel as if you are the "nighthawk" yourself.

The street is empty, and the loneliness and coldness hit you more realistically.

Of course, in addition to entering famous paintings, you can also play it like a game.

For example, as shown below, you can control a dog running on the beach.

You can switch perspectives at any time, enjoying that sense of freedom.

Hot comments from netizens

Netizen Hasan sighed that in just 5 - 10 years, each of us will enter our own virtual worlds.

Netizen Peter Dedene agreed, saying that the concept of the "holographic simulation pod" is becoming a reality.

Reference materials

https://x.com/minchoi/status/1954200428482097249

https://x.com/bilawalsidhu/status/1954229425199034753

This article is from the WeChat public account "New Intelligence Yuan", author: Rhino. Republished by 36Kr with permission.