Show HN: Text to 3D simulation on a map (does history pretty well)

mused.com

63 points by lukehollis a day ago

Simulate anything on a map from a text prompt -- and conduct risk analysis against LiveUA map's global realtime data points from social media and news sources. I trained a GPT-2-size model on historical incident data used to predict things that will go wrong.

As historian Benjamin Breen mentions, the leading language models are good historians, so the application will simulate historical events pretty well also.

I include a Multi-Agent RL Urban Mobility model in progress displayed on the map as small white cubes representing traffic and pedestrians. Around SF, it uses real census data and other sources for semantically meaningful day plans, etc. It will populate where you move the map, albeit a little slowly. This is based on previous work on my GitHub--I hope to connect it to Unreal's city samples project soon.

The simulations are pretty simple so far but will grow in complexity soon.

I won the AGI House World Models Hackathon with this and the MARL model.

Many thanks to Shota Matsuda and Garrett Johnson for the cloud and atmospheric effects libraries on Github at takram-design-engineering/three-geospatial

Glad for feedback, and thanks for trying it out!

pedalpete a day ago

We used to do 3D virtual world work, and though I like where you're going with this, I think loading hi-res tiles, for your use-case, is not the right approach.

The direction we were trying to move with https://ayvri.com back in 2018 was to model the world from low-res imagery, and render higher-resolution views. At the time, the AI tech wasn't ready, but I think you can do this now. You don't need a prefect replica of the world, you want a convincing replica, so when you're drawing Tokyo, the architecture and elements in the scene match what would be expected.

  • lukehollis a day ago

    Ayvri is impressive, and thanks for the feedback - I hear what you're saying about the convincing replica

mkbehbehani a day ago

Cool idea, can only use 2D at the moment. Looks like the 3D tile quota is exhausted: "message": "Quota exceeded for quota metric '3D Tiles root requests' and limit '3D Tiles root requests per day' of service 'tile.googleapis.com' for consumer 'project_number:1016378558728'."

https://tile.googleapis.com/v1/3dtiles/root.json?key=AIzaSyB...

  • lukehollis a day ago

    Asking for a quota increase with support! Will build in bring-your-own-key

    • mkbehbehani a day ago

      Random thing worth I ran into once, you may have already handled this but sharing just in case:

      May want to confirm the map renderer is making its requests using the URL with both the session and API key instead of only the API key. If your API requests are base key only, every refresh client-side might be unexpectedly consuming one of your root quota units, rather than each user getting a session of unlimited tile loads for 3 hours. If you're seeing network traffic in the console from your renderer out to the API without the session token in the query string along with the API token, or if you see the session token is totally different after refreshing, that might be a sign of something wonky causing quota depletion.

      Example URL for a tile fetch with both params:

        https://tile.googleapis.com/v1/3dtiles/datasets/CgA/files/UlRPVEYuYnVs.json?session=SESSION_TOKEN&key=YOUR_API_KEY
      Examples:

        https://developers.google.com/maps/documentation/tile/create-renderer#requests-and-responses
      A quick check would be to see how far apart your google analytics for unique users are vs. your API console usage data. If way less than 10,000 unique users depleted the 10,000 unit quota it may be another indicator of something in token/session setup.
rafram a day ago

I don't totally understand this, but it has the potential to be very, very cool.

(The satellite imagery doesn't work in Firefox. Just clouds.)

  • dr_dshiv a day ago

    If this was just a post about generated clouds I would have upvoted anyway. They were cool. Love the vision!

  • lukehollis a day ago

    Sorry, exhausted quota on the 3d tiles from Google Maps Platform -- should have workaround up shortly

  • spuz a day ago

    The map imagery doesn't seem to work in Edge either.

tomaytotomato a day ago

This might be being unfair, but I asked it to simulate the Battle of Goose Green, during the Falklands war of 1982.

Its just a blank screen - https://mused.com/map/sim/2993/battle-of-goose-green

I am excited to see it working though!

  • yreg a day ago

    The sim on your link is not blank anymore. I can see a map, some entities and some simple paths they take.

solardev a day ago

I don't understand what it's supposed to do. I see clouds and a prompt entry. I type something in and it just gives me a text response about New York urban tourism...?

  • caseyy a day ago

    I think it's a 3D visualization of Earth with simulated clouds. You can ask an AI to generate a GIS layer to visualize an event. Then, you can talk to parts of the event in chat.

don-bright a day ago

Dating myself, typed in "Global Thermonuclear War". Watching various cities of the world have their map flash on the screen for a few seconds at a time was certainly nightmare inducing. But fascinating.

mdrzn a day ago

Seems very interesting tho. Maybe pre-generate the three "prompts" that you show when I open the page, and load them from cache when I select them? At least I can see how it should work.

edit: in 2d the map loads, in 3d it doesn't load. But when it works in 2d it's VERY COOL!

Here's my example: https://mused.com/map/sim/3129/roman-civil-wars-of-the-1st-c...

moontear a day ago

Doesn't work in Chrome (no map), doesn't work in Firefox. This sounds really interesting and I would love a video of it working its magic.

conception a day ago

This is magic. I just did volcano and it simulated lava flow, emergency responders, blast zones. Pretty cool stuff.

ElijahLynn a day ago

Prompt box does not show on mobile. I'm using brave on Android. Even when I request the desktop site it does not show it. But when I use brave on Mac it does show it.

This was a confusing landing for me on a mobile device.

  • lukehollis a day ago

    Thanks, this should be updated for a better landing on mobile

taneq a day ago

I asked for a large asteroid impacting the Pacific ocean. Interestingly the resultant tidal wave apparently heads directly to Honolulu, then to Terminal Island, then reverses course and visits Sydney before traveling overland through New South Wales and Queensland, causing some earthquakes in Papua New Guinea, and coming to rest in Tokyo Harbour.

Also I just realised I can talk to the asteroid. It understandably seems a little traumatized.

    me: Hi! What brings you to this particular part of the ocean?
    
    asteroid: *hurtling through the atmosphere at tremendous speed, trailing
        fire* AAARRRRRGGGHHHHH! NOT BY CHOICE! Gravity's got me in its grip! 
        Been floating peacefully through space for millions of years until your 
        planet's pull caught me! CAN'T STOP NOW! *glowing brighter* Ocean impact 
        in approximately 17 seconds! Nothing personal against this particular 
        patch of water! BRACE FOR TSUNAMI! *increasing in brightness and 
        velocity*
https://mused.com/map/sim/2225/asteroid-impact-event
  • walthamstow a day ago

    Couldn't help but start humming Queen's Don't Stop Me Now after reading what the asteroid said

  • lukehollis a day ago

    This is the best thing that anyone has simulated yet hahah

LargeWu a day ago

Incredibly brave of you to post something like this here. How are you monitoring and managing cost/token usage?

  • lukehollis a day ago

    Thanks! The worst is the elevation API -- but yes, I monitored costs throughout today, it's not prohibitively expensive.

lukehollis a day ago

Update: sorry google maps 3d tiles aren't displaying!

Video: https://www.youtube.com/watch?v=zXS9sNcDLJU

The Google Maps 3d Photorealistic Tiles are returning 429 Error too many requests Looks like will need to build in the ability for people to bring their own Google Maps API key. Fix up shortly

  • lukehollis a day ago

    Hey defaulting to 2D map temporarily! 3d will work shortly

thenthenthen a day ago

The scaling is off on mobile, the prompt box is hidden from view etc.

  • eluttmann a day ago

    mobile coming soon. focus is desktop

folli a day ago

I can't get it to work, but it sounds interesting. Does anyone have a screen recording to share?

mkoryak a day ago

it seems to work, but i dont know what i should be doing with it or what i am looking at

WalterGR a day ago

The prompt… er, well, prompt doesn’t appear in portrait orientation on iOS 18.

stevage a day ago

Mostly I seem to be looking at some pretty great looking clouds and some (fake?) satellite imagery, but not seeing any people or armies or anything. And then every now and then it sort of glitches out and resets everything.

I'd love to see a video or something of it in action.

...

Oh, it seems to work much better in 2D. Now I see markers and stuff.

deadbabe a day ago

I tried to simulate peace on Earth.

  • lukehollis a day ago

    you're the best of us. How'd it do? Can you share it?

tetris11 a day ago

I like the idea, but it's really glitchy and borderline epilepsy-inducing

  • lukehollis a day ago

    Updated -- the geocoding was moving the map around too quickly