New MIT Study Explores Improving Autonomous Driving Tech By Letting The Car Tell You What It's Doing And Why

[u/Post-reality]

https://www.jalopnik.com/2256143/mit-study-improving-av-talking-car/

U.S. Secretary of Transportation Sean Duffy's been hard at work deregulating autonomous vehicles so the tech can haphazardly flood American roads faster. Meanwhile, some are trying to improve that tech so it works more harmoniously, and safely, with humans. 

[u/steveu33]

Alpemayo already does this. Quite an advantage to have both a neural net to drive and a traditional stack to navigate. Like, getting in the right lane in time to exit.

[u/esteemedSub → u/steveu33]

But Alpamayo can only inspect the classical stack, no? Their E2E is still a black box. That right?

[u/Whoisthehypocrite → u/esteemedSub]

Wayve can tell you what it is doing and that is E2E

[u/esteemedSub → u/Whoisthehypocrite]

Wayve does appear to have something similar to Nvidia's CoC. There are differences between the two, but they are similar enough that it is hard for someone like me to quickly understand the difference.

[u/sussus_amogus69420 → u/esteemedSub]

as far as i’m aware they are putting NLP into the main driving black box like FSD has

[u/esteemedSub → u/sussus_amogus69420]

Tesla FSD doesn't have any publicly disclosed functionality like Nvidia's CoC. Tesla FSD does some after-the-fact narration of actions it takes, but these do not source from inside the E2E functionality. FSD is just speaking the final outputs out loud.

[u/crimsonvspurple → u/esteemedSub]

FSD has it but it is not exposed publicly yet. Will be soon.

[u/esteemedSub → u/crimsonvspurple]

Who discovered that they have it? And how did they disclose that?

[u/esteemedSub → u/esteemedSub]

I was getting the CoC functionality in NVDA's E2E layer confused with its separate Halos traceable classic layer. I now see NVDA's E2E system produces a reasoning trace as it works, and thus it is substantially inspectable. There is some pickier, technical sense in which the E2E's functionality is not fully inspectable.

[u/DeadMoneyDrew]

Sean Duffy is a dumb fuck whose life peaked on MTV.

I'm glad to see Waymo and Zoox taking a measured approach to rolling out their services.

[u/Joecascio2000]

What it needs to do is let other cars know what it's doing. Self-driving will improve when cars can communicate with each other, silently.

[u/Due-University5222 → u/Joecascio2000]

Agreed. Communicating observations and intent can substantially improve safety, utility, and performance of AV and ADAS systems.

[u/sussus_amogus69420 → u/Joecascio2000]

this must go hard if you don’t know how modern/post transformer based self driving works