Gursimran Gursimran

Projects

A selection of open-source contributions and projects in reinforcement learning, multimodal AI, and interactive visualization.

Open Source

LoRA RL fine-tuning in AReaL

Open source, 2026
Integration lead / core contributor.

Integrated LoRA-based RL fine-tuning into AReaL's Megatron engine, including distributed adapter training and synchronization with vLLM. Supports GPU and Ascend execution, pipeline parallelism, and multi-node mixture-of-experts training.

AReaL architecture showing asynchronous training and inference engines
AReaL architecture · source

EPDServe

Open source · ICML 2025 · [code] [paper]

A serving system for large multimodal models that separates encoding, prefill, and decoding into independently scalable stages. Supports intra-request parallelism and dynamic GPU resource allocation to reduce latency and improve throughput.

EPDServe architecture separating encoding, prefill, and decoding
EPDServe architecture · source

Automatic visible watermarking for 3D assets

Open source · WACV 2025 (Oral) · [code] [paper]

A framework for automatically placing visible watermarks on 3D models, balancing asset protection with usability. Includes a watermarking pipeline and support for embossing watermarks onto model surfaces.

Visible watermarks on 3D models, comparing the proposed method with a baseline
3D watermarking examples · source

Course Projects

A Bayesian approach to visual question answering

Course project · Probabilistic Programming · [report]
Work done with Saeid Naderiparizi and Setareh Cohan.

Combined neural perception with symbolic reasoning in a Bayesian model for visual question answering. Explored inference over discrete scene representations on the sort-of-CLEVR dataset.

Bayesian visual question answering model

Enhanced Visual Dialog

Course project · Multimodal Learning · [report]
Work done with Mohit Bajaj and Siddhesh Khandelwal.

Explored question-specific visual filters, attention over dialog history, and end-to-end training for cooperative question-and-answer agents.

Cooperative question and answer agents for visual dialog

Visualizing the bias-variance tradeoff

Course project · Information Visualization · [report]
Work done with Halldor Thorhallsson.

Built interactive polynomial regression and k-nearest neighbours playgrounds to show how data complexity and model choices affect bias and variance.

Interactive polynomial regression visualization