This GTA V AI Learning To Drive Is Absolute Chaos And We Can’t Stop Watching

“Charles” is a convolutional neural network that basically learns to drive by crashing into stuff and trying things out – watching the AI car smashing around Los Santos in GTA V makes for surprisingly addictive viewing
Remote video URL

Twitch channel sentdex has been live streaming Charles in action, crashing into whatever it can in GTA V in a bid to learn how to drive.

Some of the streams have lasted over 24 hours, in part due to Charles now being able to be respawned when he drives into lakes or rivers, or gets stuck in someone’s back garden.

Sentdex also posts footage of the AI self-driving on YouTube - there’s a whole series about it. The whole thing makes for hilarious viewing, especially with Michael (who’s sat in the car) making snarky comments about other people’s driving.

Charles “takes all actions based on single frames at a time, and bases his decisions on just pixel data. Charles only sees exactly what you see”.

The aim in the future is to give Charles some short-term memory, which may result in some less-crashy driving. For now, though, it definitely makes for amusing viewing – the tens of thousands watching on Twitch and YouTube clearly agree with us, too.

Sponsored Posts

Comments

ModernChaos

It already drives better than some people I know in real life

05/25/2017 - 21:10 |
89 | 0
Joe dahms

So is it constantly learning?

05/25/2017 - 21:30 |
5 | 0

It’s a bit hard to learn anything when you don’t have a memory, don’t you think? :P

EDIT: Scratch that, it is indeed learning.

05/25/2017 - 23:40 |
6 | 1
Anonymous

Next thing you know they’ll start using GTA V as a simulation in the UK hazard perception test.

05/25/2017 - 21:38 |
16 | 0
K Chaitanya Rao

In reply to by Anonymous (not verified)

They actually might considering how it is being used for other things such as autonomous vehicle development

05/26/2017 - 02:38 |
2 | 0
Anonymous

I can approve

05/25/2017 - 22:40 |
0 | 0
Sivert Grande

As a game dev student, this really amazes me. Making in-game AI is one thing (it basically knows everything that’s happening, and has a set of points to follow), but making an AI that plays the game based only on “visual” info, now that’s impressive.

It might be going all over the place and crashing into almost everything, but you can clearly see it’s trying to follow lines and avoid anything resembling a vehicle.

05/25/2017 - 23:57 |
42 | 0

I’m a game dev and I approve everyrhing you said

05/26/2017 - 10:06 |
7 | 2

True, greetings from Poland, polish game dev student :D

05/26/2017 - 15:21 |
1 | 0
Anonymous

Test Charles in Online for some extreme situations, like what to do if a tank shows up out of nowhere and points the barrel at him.

05/26/2017 - 01:04 |
0 | 0
LukeyWolf

It drives better than most GTA online players

05/26/2017 - 07:21 |
3 | 0
Anonymous

still better than average mustang driver.

05/26/2017 - 08:42 |
3 | 3
SAVAGE DOGG (Ping-Pong Gang) (Corvette Squad)

What it looks like…

05/26/2017 - 12:40 |
4 | 0
RodriguezRacer456 (Aventador SV) (Lambo Squad)

“convolutional neural network” ?

05/26/2017 - 15:07 |
3 | 0