Education

University of California, San Diego

2021 - 2023
Master of Science, Computer Science and Engineering

Relevant Coursework: Probabilistic Artificial Intelligence, Computational Photography, Unsupervised Learning, Virtual Reality Technology, Structured Prediction for NLP, Sampling and Reconstruction of Visual Appearance: From Denoising to View Synthesis, Deep Generative Models.


Visvesvaraya Technological University

2016 - 2020
Bachelor of Engineering, Computer Science

Relevant Courses: Artificial Intelligence, Machine Learning, Data Warehousing and Data Mining, Data Structures and Algorithms, Natural Language Processing

Experience

Google Research

Sep 2022 - Dec 2022
Student Researcher - Perception Team | Advisor: Tanmay Shah

Developed a training free 3D face editing method for Generative NeRFs & obtained realistic 3D face edits for eyeglasses & age. Rendered dataset of 10K+ 3D faces from 2D images. Developed large-scale distributed ML training pipelines of upto 256 GPUs.

UC San Diego + Oppo Research

Dec 2022 - Present
Graduate Researcher | Advisor: Prof. Manmohan Krishna Chandraker, Zhebin Zhang

Investigated CRTF based sub-surface scattering in NeRFs for translucent objects with 10% improvement in novel view synthesis. Working on inverse rendering algorithms for physics-based face relighting with sub-surface scattering effects from 2D images.

Google Research

Jun 2022 - Sep 2022
Research Scientist Intern - Perception Team | Advisor: Dmitry Lagun

Led development of TEGLO: a novel Generative NeRF for 3D reconstruction from single view images obtaining ≥74 db PSNR (≥200% improvement) over state of the art preserving fine details at megapixel resolutions [Under Review].

Microsoft Research

May 2021 - Aug 2021
Idenpendent Research Developer - Real World RL Team | Advisor: Eduardo Salinas

Simplified feature modifications in VW by implementing a reduction for data modification functions to register on the stack. Enabled on-the-fly feature manipulations for contextual bandit learning without requiring re-deploying the source.

Indian Institute of Science (IISc)

Jul 2020 - Aug 2021
Research Assistant, Video Analytics Lab | Advisor: Prof. Venkatesh Babu

Obtained ≥12% improvement over state-of-the-art in few-shot domain adaptation for RAW image enhancement in low light conditions for DSLR & smartphone cameras with new benchmark data [BMVC 2021, Best Student Paper Runner Up] Led the development of a self-supervised image translation method to translate daylight scenes to rain/fog/night and enabled a 5% improvement in image segmentation performance for self-driving cars in adverse weather [ICCV 2021, ILDAV]

Indian Institute of Technology, Bombay

May 2020 - Aug 2020
Research Intern, IITB-Monash Univ | Advisor: Prof. Adinarayana Jagarlapudi
Developed the first synthetic data generation method to enable generalization from handheld spectroradiometer data to drone based UAV cameras to bridge the high quality low-data problem - Climate Change project [JAG 2021]. Identified novel indices for Hyperspectral image analysis to estimate leaf water content and water stress early [ICCV 2021,CVPPA].

Google Summer of Code - TensorFlow (2020)

May 2020 - Aug 2020
Student Developer, Google Brain Team | Advisor: Jaeyoun Kim

Implemented state-of-the-art ML models for TensorFlow mentored by Jaeyoun Kim, Hongkun Yu and Yanhui Liang from Google Brain.Led the development of FineGAN, a fine-grained image generation method with hierarchical disentanglement using TensorFlow. Investigated SIREN with implicit representation networks and evaluated the expressivity of Batchnorm for deep networks.

Google Summer of Code - TensorFlow (2019)

May 2019 - Aug 2019
Student Developer, Google Brain Team | Advisor: Dr. Amit Sabne

Implemented StackGAN: text-to-image Generative Adversarial Network (GAN) with two-stage image super-resolution using TF2. TF Model Garden: Built StackGAN, Mask R-CNN, Conditional VAE, and Face Aging with CycleGANs from the research papers.

Computer Science Dept., Sir MVIT

Jan 2018 - Dec 2018
Undergraduate Research Assistant | Advsior: Prof. Savita Choudhary

Worked on "RainRoof: Automated Shared Rainwater Harvesting Prediction" under the guidance of Dr. Savita Choudhary (Springer LNDECT). Also worked on "Forecasting Dengue and Studying its Plausible Pandemy" under the guidance of Prof. Savita Choudhary (Elsevier). Worked on "Predicting the Network Structure using Harmonic Centrality Values in AODV Routing for Wireless Sensor Networks" under the guidance of Dr. Pallavi Venkatesh and Dr. Banu Prakash (SSN IJSTR 2019).

Publications

Select Projects

Hierarchical Disentanglement for Fine-Grained Image Generation
  • Implemented the 3-Stage FineGAN Architecture with a stage each for Background, Foreground Outline and Foreground Mask generation.
  • This includes the Background scene detector to detect background only patches for the auxiliary discriminator trained on CUB200.
Multilingual Medical Question Answering and Information Retrieval
  • Language agnostic translation with BioBERT question-answer heads training the embedding layers and generative pre-training. Used GPT-2 for generative pre-training for natural language answer generation for medical queries followed by translation.
  • Results from the NLG architecture for health intelligence is under review at the AAAI 2021.
Text to Photo-realistic Image Synthesis
  • Model created from the paper to train StackGAN on the CUB 200 dataset for birds. Includes the 2 stages in the model. Stage 1 takes the latent space and a conditioning vector as input to generate 64x64 resolution images. (With Char-RNN-CNN).
  • The Stage 2 generates 256x256 resolution images from Stage 1 images.

AI Summer School

Eastern European ML Summer School

Jul 2021
EEML 2021 Summer School - CL Track

EEML summer school is focused on core topics regarding machine learning and artificial intelligence. The summer school includes both lectures and practical sessions (labs) to improve the theoretical and practical understanding of these topics. The school is aimed at graduate students. Participated in the Continual Learning track.

Indian Institute of Technology, Kharagpur

Jan 2021
Fairness and Transparency in AI - Winter School

AI School to investigate and comprehend the limitations of the machine learning models and make them more fair, transparent and accountable. This school addresses some fundamental and pressing topics in fairness, accountability and transparency in AI.

Indian Institute of Science (IISc)

Jul 2019
Computer Science and Automation Summer School

Topics covered in the summer school broadly include comprehensive sessions on Machine Learning, AI, Knowledge Graphs, NLP, Game Theory, Discrete Mathematics, Linear Algebra, and Advanced Databases. Interactions with the professors was very engaging.

Skills & Proficiency

Python

TensorFlow