Utkarsh Uppal

I am a research intern at Nvidia where my research is focused on self-supervised learning for incremental task.

Previously, I worked as Machine Learning Researcher at Visio Lab, a Berlin based food checkout system startup and as a research intern under the guidance of Dr Mobarakol Islam and Prof Hongliang Ren, with research focused on model generalization and loss function optimization.

I recently graduated with Bachelors in Electrical and a minor specialization degree in Computer Science from Punjab Engineering College. Previously I,

Email  /  Google Scholar  /  LinkedIn

profile photo
News

  • [NEW]  Presented with the Institute Color Award
  • [NEW]  TA for Fundamentals of Deep Learning workshop @ Nvidia GTC
  • [NEW]  Started a research internship at Nvidia
  • [NEW] Short paper on Normalised Label Distribution accepted at RSEML WS. @ AAAI 2021
  • [NEW]  Volunteer @ NeurIPS 2020
  • [NEW]  Awarded the IEEE Outstanding Student Volunteer Award
  • MIT Hackathon Winning Team - Uboja got featured in True Africa
  • Selected for KubeCon + CloudNativeCon Europe 2020 Scholarship
  • Selected in the ExeCom of IEEE Delhi Section Young Professionals (IEEE YP AG)

Research Overview

My research interests lie at the intersection of Deep Learning, Computer Vision, and sustainable transition of AI to practical applications. Particularly, I am passionate about generalizable deep learning, self-supervised learning, curriculum learning, and sustainable reinforcement learning. I am also inclined towards application based DL & RL with focus on robotics and healthcare.

Normalized Label Distribution: Towards Learning Calibrated, Adaptable and Efficient Activation Maps
Utkarsh Uppal, Bharat Giddwani
Towards Robust, Secure and Efficient Machine Learning, AAAI Conference 2021 [accepted] [pre-print] [code]

The vulnerability of models to data aberrations and adversarial attacks influences their ability to efficiently demarcate distinct class boundaries. We study the significance of changes in ground-truth distribution on the performance and generalizability of various state-of-the-art networks and demonstrate the role of label-smoothing regularization and normalization in yielding better generalizability and calibrated probability distribution.

Brain Tumor Segmentation and Survival Prediction using 3D Attention UNet
Mobarakol Islam, Vibashan VS, V Jeya Maria Jose, Navodini Wijethilake, Uppal Utkarsh, Hongliang Ren
BrainLes, Medical Image Computing & Computer Assisted Intervention (MICCAI) 19' [accepted] [pre-print]

We propose a 3D attention convolutional neural network (CNN) to segment brain tumor; extract novel radiomic features based on geometry, location, the shape of the segmented tumor, and combine them with clinical information to estimate the survival duration for each patient. Our proposed 3D attention module with decoder blocks consists of 3D spatial and channel attention in parallel to skip connections, thus exploiting the ubiquitous features of the receptive field.

Active Research Projects (more coming soon!)
Self-supervised learning for class-incremental learning
in collaboration with Prof. Mayank Vatsa

Incorporating self-supervised learning for class incremental learning. The pre-text task training is based on random label augmentation and downstream task includes projection preservation along the orthogonal direction and feature enhancement by gaussian kernels.

Research Projects
Longitudinal CT Synthesis for Hematoma Expansion Prediction using a Multi-Path GAN
Utkarsh Uppal, Mobarakol Islam, Nicolas Kon Kam King, Hongliang Ren
[under-review] [pre-print]

The paper introduces a 3D conditional Generative Adversarial Networks (cGAN) to synthesize a 24-hour time-advanced Computed Tomography (CT) from the onset time CT of a patient with symptoms of Intracerebral Hemorrhage (ICH). We propose a novel 3D generator architecture fixated on learning both global and local features. Furthermore, we introduce an encoder-decoder type of discriminator framework to penalize the low confidence pixel-map more in comparison to high confidence with supplementary excitation module for improving the attributes of feature maps.

Normalized Label Smoothing Focal Loss to Obtain Well-calibrated Model Uncertainty with Genomic Data
[under-review]

A Normalized Label Smoothing Focalloss (normLSF) to prevent overconfident learning and alleviate miscalibration in the genomic decision-making model. normLSF addresses the class imbalance issue and boosts the model generalization capacity. The proposed cost function is validated on two genomic datasets of the Chinese Glioma Atlas (CGGA) and the Cancer Genome Atlas Project (TCGA) and on CIFAR100 dataset.

UAV for Stubble Burning Tracking
[capstone project]

Enhanced computer vision pipeline by integration of partial convolution based padding and smoothing in the network with UAV to monitor stubble burning.

Useful Links and Information

Press T for Tetris



If we knew what it was we were doing, it would not be called research, would it? ~ Albert Einstein

Feel free to explore Jon's website here :)

This site is under construction.