SimuDrive

SimuDrive is a simulator developed with Unity’s ML-Agents with a team of 2 programmers. The vehicle is capable of self driving and self parking. The car is available in RWD, FWD and AWD. I have developed an agent that can guide the car to move forward backwards and turn right and left. If the car hits a wall, it will be punished so it learns along the way. We are using a Discrete learning module to control the behaviour of our vehicle. Discrete is better in this simulation because there are multiple stages for a car to behave during its learning phase, since discrete takes in integer, we can effectively control what behavior this car can do or will do next using integers.

SimuDrive -- Parking simulation

For parking, we used a continuous behavior to train our car. Continuous was easier because the environment is smaller for the AI to navigate.