Devvrit Khatri

devvrit [at] cs [dot] utexas [dot] edu

University of Texas, Austin

About Me

I am a fourth year PhD student at UT Austin, advised by Prof. Inderjit Dhillon. I am also a Student Researcher at Google, working closely with Prateek Jain. My research interests lie in Large Scale Machine Learning, with a focus on efficiency and scalability. I aim to build fundamental ML algorithms that exhibit strong empirical performance coupled with real-world deployability. In a quiet affirmation of their utility, a few of these algorithms have been integrated into the workflows of Google and Microsoft, among other organisations.

In a fantastic previous life, I earned my Bachelors from BITS Pilani, Goa. During my stint at Microsoft Research India, I had the fortune of having Ravishankar Krishnaswamy as my undergraduate thesis advisor, and worked closely with Harsha Simhadri.

Latest Updates

September 2024	MatFormer accepted at NeurIPS'24! See you all in Vancouver 🎉
May 2024	Interning@GoogleDeepMind India with Prateek Jain.
January 2024	CASPR and Efficacy of Dual-Encoders accepted at ICLR'24. 💥
December 2023	MatFormer wins Best Paper Award at ENLSP@NeurIPS23 🏆
December 2023	Attending NeurIPS at NOLA. Come say hello 🤝
October 2023	MatFormer Preprint now available, check it out!
September 2023	SONew and Greedy Pruning accepted at NeurIPS'23. Wohoo!
May 2023	Interning@Google Research India with Prateek Jain. Say hello if you in Bangalore.

Publications

NeurIPS

MatFormer: Nested Transformer for Elastic Inference

Devvrit*, Sneha Kudugunta*, Aditya Kusupati*, Tim Dettmers, Kaifeng Chen, Inderjit Dhillon, Yulia Tsvetkov, Hannaneh Hajishirzi, Sham Kakade, Ali Farhadi, Prateek Jain

NeurIPS, 2024; Also Best Paper@ENLSP, NeurIPS, 2023.

pdf BibTeX

@misc{devvrit2023matformer,
  title={MatFormer: Nested Transformer for Elastic Inference}, 
  author={Devvrit and Sneha Kudugunta and Aditya Kusupati and Tim Dettmers and Kaifeng Chen and Inderjit Dhillon and Yulia Tsvetkov and Hannaneh Hajishirzi and Sham Kakade and Ali Farhadi and Prateek Jain},
  year={2023},
  eprint={2310.07707},
  archivePrefix={arXiv},
  primaryClass={cs.LG}
}

ICLR

Combining Axes Preconditioners through Kronecker Approximation for Deep Learning

Sai Surya Duvvuri, Devvrit, Rohan Anil, Cho-Jui Hsieh, Inderjit S Dhillon

ICLR, 2024

pdf BibTeX

@inproceedings{
  anonymous2024combining,
  title={Combining Axes Preconditioners through Kronecker Approximation for Deep Learning},
  author={Anonymous},
  booktitle={The Twelfth International Conference on Learning Representations},
  year={2024},
  url={https://openreview.net/forum?id=8j9hz8DVi8}
  }

ICLR

Efficacy of Dual-Encoders for Extreme Multi-Label Classification

Nilesh Gupta, Devvrit, Ankit S Rawat, Srinadh Bhojanapalli, Prateek Jain, Inderjit S Dhillon

ICLR, 2024

pdf BibTeX

@misc{gupta2023efficacy,
  title={Efficacy of Dual-Encoders for Extreme Multi-Label Classification}, 
  author={Nilesh Gupta and Devvrit Khatri and Ankit S Rawat and Srinadh Bhojanapalli and Prateek Jain and Inderjit S Dhillon},
  year={2023},
  eprint={2310.10636},
  archivePrefix={arXiv},
  primaryClass={cs.LG}
}

NeurIPS

SONew: A Computationally Efficient Sparsified Online Newton Method

Devvrit*, Sai Surya Duvvuri*, Rohan Anil, Vineet Gupta, Cho-Jui Hsieh, Inderjit S Dhillon

NeurIPS, 2023

pdf BibTeX

@misc{
  devvrit2023a,
  title={A Computationally Efficient Sparsified Online Newton Method},
  author={Fnu Devvrit and Sai Surya Duvvuri and Rohan Anil and Vineet Gupta and Cho-Jui Hsieh and Inderjit S Dhillon},
  year={2023},
  url={https://openreview.net/forum?id=cOOQruYU7Bh}
  }

NeurIPS

Greedy Pruning with Group Lasso Provably Generalizes for Matrix Sensing

Nived Rajaraman, Devvrit, Aryan Mokhtari

NeurIPS, 2023

pdf BibTeX

@inproceedings{
  rajaraman2023greedy,
  title={Greedy Pruning with Group Lasso Provably Generalizes for Matrix Sensing},
  author={Nived Rajaraman and Fnu Devvrit and Aryan Mokhtari and Kannan Ramchandran},
  booktitle={Thirty-seventh Conference on Neural Information Processing Systems},
  year={2023},
  url={https://openreview.net/forum?id=BTRcVP7ZJn}
  }

NeurIPS

S3GC: Scalable Self-Supervised Graph Clustering

Devvrit*, Aditya Sinha, Inderjit Dhillon, Prateek Jain

NeurIPS, 2022

pdf BibTeX

@inproceedings{
  devvrit2022sgc,
  title={S3{GC}: Scalable Self-Supervised Graph Clustering},
  author={Fnu Devvrit and Aditya Sinha and Inderjit S Dhillon and Prateek Jain},
  booktitle={Advances in Neural Information Processing Systems},
  editor={Alice H. Oh and Alekh Agarwal and Danielle Belgrave and Kyunghyun Cho},
  year={2022},
  url={https://openreview.net/forum?id=ldl2V3vLZ5}
  }

NeurIPS

Semi-supervised Active Regression

Devvrit*, Nived Rajaraman*, Pranjal Awasthi

NeurIPS, 2022

pdf BibTeX

@inproceedings{
  rajaraman2022semisupervised,
  title={Semi-supervised Active Linear Regression},
  author={Nived Rajaraman and Fnu Devvrit and Pranjal Awasthi},
  booktitle={Advances in Neural Information Processing Systems},
  editor={Alice H. Oh and Alekh Agarwal and Danielle Belgrave and Kyunghyun Cho},
  year={2022},
  url={https://openreview.net/forum?id=i-UdJ6fWUFc}
  }

arXiv

Voting based ensemble improves robustness of defensive models

Devvrit, Minhao Cheng, Cho-Jui Hsieh, Inderjit Dhillon.

Preprint

pdf BibTeX

@misc{devvrit2020voting,
  title={Voting based ensemble improves robustness of defensive models}, 
  author={Devvrit and Minhao Cheng and Cho-Jui Hsieh and Inderjit Dhillon},
  year={2020},
  eprint={2011.14031},
  archivePrefix={arXiv},
  primaryClass={cs.LG}
}

NeurIPS

DiskANN: Fast Accurate Billion-point Nearest Neighbor Search on a Single Node

Suhas Jayaram Subramanya, Devvrit, Rohan Kadekodi, Ravishankar Krishaswamy, Harsha Vardhan Simhadri

NeurIPS 2019

pdf BibTeX

@inproceedings{NEURIPS2019_09853c7f,
  author = {Jayaram Subramanya, Suhas and Devvrit, Fnu and Simhadri, Harsha Vardhan and Krishnawamy, Ravishankar and Kadekodi, Rohan},
  booktitle = {Advances in Neural Information Processing Systems},
  editor = {H. Wallach and H. Larochelle and A. Beygelzimer and F. d\textquotesingle Alch\'{e}-Buc and E. Fox and R. Garnett},
  pages = {},
  publisher = {Curran Associates, Inc.},
  title = {DiskANN: Fast Accurate Billion-point Nearest Neighbor Search on a Single Node},
  url = {https://proceedings.neurips.cc/paper_files/paper/2019/file/09853c7fb1d3f8ee67a61b6bf4a7f8e6-Paper.pdf},
  volume = {32},
  year = {2019}
  }

APPROX

Robust Correlation Clustering

Devvrit, Nived Rajaraman∗, and Ravishankar Krishnaswamy

APPROX 2019

pdf BibTeX

@InProceedings{devvrit_et_al:LIPIcs.APPROX-RANDOM.2019.33,
  author =	{Devvrit and Krishnaswamy, Ravishankar and Rajaraman, Nived},
  title =	{{Robust Correlation Clustering}},
  booktitle =	{Approximation, Randomization, and Combinatorial Optimization. Algorithms and Techniques (APPROX/RANDOM 2019)},
  pages =	{33:1--33:18},
  series =	{Leibniz International Proceedings in Informatics (LIPIcs)},
  ISBN =	{978-3-95977-125-2},
  ISSN =	{1868-8969},
  year =	{2019},
  volume =	{145},
  editor =	{Achlioptas, Dimitris and V\'{e}gh, L\'{a}szl\'{o} A.},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/entities/document/10.4230/LIPIcs.APPROX-RANDOM.2019.33},
  URN =		{urn:nbn:de:0030-drops-112483},
  doi =		{10.4230/LIPIcs.APPROX-RANDOM.2019.33},
  annote =	{Keywords: Correlation Clustering, Outlier Detection, Clustering, Approximation Algorithms}
}