Reinforcement learning & computer vision.

During my time as an undergraduate researcher, I conducted extensive work in reinforcement learning and computer vision.
We have compiled three projects for which the code has been made public.

01

Reinforcement Learning · Graph Neural Networks

2018.09–2021.06 · Undergraduate research student

Route search example

A graph model for generating TSP routes using reinforcement learning

I implemented a graph-based TSP search program that uses reinforcement learning to select the next city to insert into the route.

Reinforcement learningStructure2VecDeep Q-learningGraph neural networkTensorFlowNumPy

Tasks performed

Based on the graph representations and Q-learning concepts from the referenced paper, I implemented experimental code that connects the TSP environment, model, training loop, and insertion rules.

Results

The program takes city locations, distances and visit status as graph input and uses an insertion heuristic to add the city chosen by the model to the route. Comparing the public code against baselines, I also traced why the learning did not work as intended.

  • Step 2 AI city selection + heuristic route insertion
View study
02

Computer vision · Image classification

2021 · Undergraduate research student

Fashion-MNIST prediction example

A model for classifying clothing photos with ResNet

I trained a model to classify K-Fashion photos as dresses, outerwear, trousers or tops and analyzed errors for each class.

TensorFlowResNet50V2Class imbalanceError analysis

Tasks performed

Implemented code for clothing classification using a pre-trained ResNet50V2 model, along with a workflow for class-based sampling and evaluation; misclassifications were analyzed using a confusion matrix.

Results

Built a training and analysis pipeline that classifies K-Fashion photos into dresses, outerwear, pants and tops. Later, on the public Fashion-MNIST dataset, I changed settings one at a time to separate how data augmentation and the shortcut connection affect predictions.

  • 4 types Classification: Dresses, outerwear, pants, and tops
View study
03

Computer vision · Virtual try-on

2021 · Undergraduate research student

Example of preprocessing for pose/human body parsing

Virtual Try-On App for Clothing on Photos of People

I built the Android-to-server workflow that returns a virtual try-on image after the user selects a person photo and a garment.

PyTorchVirtual try-onHuman parsingFlaskAndroid

Tasks performed

Configured input preprocessing and clothing masks for a virtual try-on model; integrated a Flask upload API with an Android client built using Kotlin and Retrofit.

Results

We developed an integrated workflow that takes a person's photo and a selected garment, performs preprocessing, generates an image of the person wearing the item, and returns the result to the app. We reused existing generative models as well as pose and body-parsing models; our own implementation focused on input configuration, mask processing, and the integration between the server and the app.

  • Step 3 Pre-processing → Generate "try-on" image → Return to app
View study

Now covering geometry and manufacturing.

Representation learning and error analysis—topics I was interested in as an undergraduate researcher—
now extend to machining feature recognition in 3D geometry data and CAD/CAM automation.

Recent R&D projects