Ryan
Otsuka

A junior Computer science Student at Georgia Institute of Technology
Ready to pursue real-world challenges and explore ways to support the universe

August 2023 - Present

MCTS Flight Simulation Research

Working with 6DOF and JSBsim to simulate F16 planes and compare planes running MCTS with planes running a pure pursuit algorithm.

MCTS Research Overview

On top of the information above, I'm specifically researching 2v1 multiagent 6DOF with 2 agent and 1 adversary. I run simulated models including the one above to simulate a battle where the agents run a configured MCTS and the adversary runs a pure pursuit algorithm. My goal is to improve this MCTS model to be able to beat the pure pursuit algorithm as best as possible.

MCTS Research Fall Semester

This past fall, I have been looking at reward weighting and health weighting. For reward, I ran simulated models and created new algorithms for reward all in an effort of finding the best reward algorithm. The decided upon algorithm combines damage reward, positional reward, and an energy reward. For health, the starting value can determine the sustainability of the algorithm and also how it runs in the long term. This aspect of the project is what I'll be delving more into this next semester.

  • MCTS
  • 6DOF
  • JSBSim
  • Python