• Latest
  • Trending
  • All
  • News
  • Lifestyle
Google uses crowdsourced photos to recreate landmarks in 3D for AR/VR thumbnail

Google uses crowdsourced photos to recreate landmarks in 3D for AR/VR

August 14, 2020
Crypto Clash: Warren Flags Economic Risk, CZ Defends Industry thumbnail

Crypto Clash: Warren Flags Economic Risk, CZ Defends Industry

July 18, 2025
Democrats push for vote on Epstein files thumbnail

Democrats push for vote on Epstein files

July 16, 2025
Nor'easters slamming New England are growing more powerful thumbnail

Nor’easters slamming New England are growing more powerful

July 16, 2025
10 Disaster Movies That Actually Get Some Science Right thumbnail

10 Disaster Movies That Actually Get Some Science Right

July 14, 2025
Trump threatens 35% tariffs on Canadian goods thumbnail

Trump threatens 35% tariffs on Canadian goods

July 13, 2025
Superman the Immigrant Would Have Saved Texas thumbnail

Superman the Immigrant Would Have Saved Texas

July 12, 2025
Iowa Democrats plot 2028 comeback for caucuses in race for president thumbnail

Iowa Democrats plot 2028 comeback for caucuses in race for president

July 11, 2025
Lionel Messi Makes MLS History with 4th Straight Multi-Goal Game in Inter Miami Win thumbnail

Lionel Messi Makes MLS History with 4th Straight Multi-Goal Game in Inter Miami Win

July 10, 2025
Do tech executives in US Army present conflict of interest? thumbnail

Do tech executives in US Army present conflict of interest?

July 10, 2025
A Vermont dairy farm was raided. The mixed messages from Washington since then have increased fears. thumbnail

A Vermont dairy farm was raided. The mixed messages from Washington since then have increased fears.

July 8, 2025
Former Rams Assistant Gives Inside Look at Houston Texans Offense thumbnail

Former Rams Assistant Gives Inside Look at Houston Texans Offense

July 7, 2025
‘Alligator Alcatraz’ Detention Center Poses Serious Risks to Immigrants Beyond Just Alligators thumbnail

‘Alligator Alcatraz’ Detention Center Poses Serious Risks to Immigrants Beyond Just Alligators

July 7, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact
  • Donate
Saturday, July 19, 2025
66 °f
Wellfleet
58 ° Tue
63 ° Wed
68 ° Thu
61 ° Fri
  • Login
  • Register
FREE Cape Cod News
DONATE
  • FREE Cape Cod News
  • Cape Cod News
  • News
    • News
    • Massachusetts
    • Breaking News
    • Cape Cod Weather
    • Storm Watch
    • Environment
  • Politics
    • democrats
    • republicans
  • Business
    • business
    • cryptocurrency
    • economy
    • money
    • Real Estate
    • Tech
  • World
  • Entertainment
  • Lifestyle
  • Photos
    • Orleans
    • Eastham
    • Wellfleet
    • Truro
    • Provincetown
    • Brewster
    • Chatham
  • Videos
No Result
View All Result
Free Cape Cod News
No Result
View All Result
  • FREE Cape Cod News
  • Cape Cod News
  • News
  • Politics
  • Business
  • World
  • Entertainment
  • Lifestyle
  • Photos
  • Videos
Home News Tech

Google uses crowdsourced photos to recreate landmarks in 3D for AR/VR

FREE Cape Cod News by FREE Cape Cod News
August 14, 2020
in Tech
Reading Time: 2 mins read
Donate
0
Google uses crowdsourced photos to recreate landmarks in 3D for AR/VR thumbnail
634
SHARES
1.4k
VIEWS
Share on TwitterShare on Facebook

Historically, human artists have been challenged to recreate real-world locations as 3D models, particularly when applications call for photorealistic accuracy. But Google researchers have come up with an alternative that could simultaneously automate the 3D modeling process and improve its results, using a neural network with crowdsourced photos of a location to convincingly replicate landmarks and lighting in 3D.

The idea behind neural radiance fields (NeRF) is to extract 3D depth data from 2D images by determining where light rays terminate, a sophisticated technique that alone can create plausible textured 3D models of landmarks. Google’s NeRF in the Wild (NeRF-W) system goes further in several ways. First, it uses “in-the-wild photo collections” as inputs, expanding a computer’s ability to see landmarks from multiple angles. Next, it evaluates the images to find structures, separating out photographic and environmental variations such as image exposure, scene lighting, post-processing, and weather conditions, as well as shot-to-shot object differences such as people who might be in one image but not another. Then it recreates scenes as mixes of static elements — structure geometry and textures — with transient ones that provide volumetric radiance.

As a result, NeRF-W’s 3D models of landmarks can be smoothly viewed from multiple angles without looking jittery or artifacted, while the lighting system uses the detected variations to provide radiance guidance for scene lighting and shadowing. NeRF-W can also treat image-to-image object differences as an uncertainty field, either eliminating or de-emphasizing them, whereas the standard NeRF system allows those differences to appear as cloudlike occluding artifacts, because it doesn’t separate them from structures during image ingestion.

Google’s video comparison of standard NeRF results with NeRF-W suggests that the new neural system can so convincingly recreate landmarks in 3D that virtual reality and augmented reality device users will be able to experience complex architecture as it actually looks, including time-of-day and weather variations, stepping beyond its prior work with 3D models. It’s also an improvement on a similar alternative disclosed last year, Neural Rerendering in the Wild, because it does a better job of separating 3D structures from lighting and looking more temporally smooth as objects are viewed from different angles.

It’s worth noting that Google certainly isn’t the only company researching ways to use photos as input for 3D modeling; Intel researchers, for instance, are advancing their own work in generating synthesized versions of real world locations, using multiple photographs plus a recurrent encoder-decoder network to interpolate uncaptured angles. While Intel’s system appears to outperform numerous alternatives — including standard NeRF — on pixel-level sharpness and temporal smoothness, it doesn’t appear to offer the variable lighting capabilities of NeRF-W or have the same focus on using randomly sourced photos to recreate real-world locations.

Google’s NeRF-W is discussed in detail in this paper, which arrives just ahead of the August 23 European Conference on Computer Vision 2020. A video showing its performance with landmarks such as Berlin’s Brandenburg Gate and Rome’s Trevi Fountain is available here.

Read More

Tags: 3dgoogletechnology

FREE Digital Newspaper Subscription!
Sign up for your free digital subscription. The FREE Cape Cod News

Unsubscribe
FREE Cape Cod News

FREE Cape Cod News

Free Cape Cod News is what's happening in the Cape Cod, U.S and World & what people are talking about right now. Local newspaper. Stay in the know. Subscribe to get notified about our latest news.

Related Posts

Do tech executives in US Army present conflict of interest? thumbnail
News

Do tech executives in US Army present conflict of interest?

by FREE Cape Cod News
July 10, 2025
Trump exempts PCs, smartphones, and components from tariffs thumbnail
News

Trump exempts PCs, smartphones, and components from tariffs

by FREE Cape Cod News
April 14, 2025
Nuclear-powered battery could eliminate need for recharging thumbnail
News

Nuclear-powered battery could eliminate need for recharging

by FREE Cape Cod News
March 31, 2025
How to… delete your 23andMe data thumbnail
News

How to… delete your 23andMe data

by FREE Cape Cod News
March 27, 2025
Load More
Please login to join discussion

Follow Us on Twitter

FREE Cape Cod News - Your source for local Cape Cod news, latest breaking U.S. and World news. Every day, all day. Subscribe for your favorite categories.

  • Trending
  • Comments
  • Latest
Drinking and Boating in Massachusetts. Free Cape Cod News.

Drinking and Boating in Massachusetts

July 23, 2023
People on the beach, Cape Cod, Massachusetts

Exploring the Nuances: Debunking Cape Cod’s Overrated Reputation

May 29, 2023
Biden: Americans with long-COVID symptoms may qualify for disability resources thumbnail

Biden: Americans with long-COVID symptoms may qualify for disability resources

July 27, 2021
Crypto Clash: Warren Flags Economic Risk, CZ Defends Industry thumbnail

Crypto Clash: Warren Flags Economic Risk, CZ Defends Industry

0
Nor'easters slamming New England are growing more powerful thumbnail

Nor’easters slamming New England are growing more powerful

0
Democrats push for vote on Epstein files thumbnail

Democrats push for vote on Epstein files

0
Crypto Clash: Warren Flags Economic Risk, CZ Defends Industry thumbnail

Crypto Clash: Warren Flags Economic Risk, CZ Defends Industry

July 18, 2025
Democrats push for vote on Epstein files thumbnail

Democrats push for vote on Epstein files

July 16, 2025
Nor'easters slamming New England are growing more powerful thumbnail

Nor’easters slamming New England are growing more powerful

July 16, 2025

FREE Cape Cod News On Twitter

Today’s News

  • Crypto Clash: Warren Flags Economic Risk, CZ Defends Industry July 18, 2025
  • Democrats push for vote on Epstein files July 16, 2025
  • Nor’easters slamming New England are growing more powerful July 16, 2025
  • 10 Disaster Movies That Actually Get Some Science Right July 14, 2025
  • Trump threatens 35% tariffs on Canadian goods July 13, 2025
FREE Cape Cod News

Copyright © 2024 Free Cape Cod News

Navigate Site

  • About
  • Advertise
  • Privacy & Policy
  • Contact
  • Donate

Follow Us

Welcome Back!

Login to your account below

Forgotten Password? Sign Up

Create New Account!

Fill the forms below to register

All fields are required. Log In

Retrieve your password

Please enter your username or email address to reset your password.

Log In

Add New Playlist

No Result
View All Result
  • FREE Cape Cod News
  • Cape Cod News
  • News
    • News
    • Massachusetts
    • Breaking News
    • Cape Cod Weather
    • Storm Watch
    • Environment
  • Politics
    • democrats
    • republicans
  • Business
    • business
    • cryptocurrency
    • economy
    • money
    • Real Estate
    • Tech
  • World
  • Entertainment
  • Lifestyle
  • Photos
    • Orleans
    • Eastham
    • Wellfleet
    • Truro
    • Provincetown
    • Brewster
    • Chatham
  • Videos
  • Login
  • Sign Up

Copyright © 2024 Free Cape Cod News