Following is a list of my favorite papers I have written so far. For a more complete and updated list of papers, see my Google Scholar.

$^*$ indicates equal contributions.

• Exploring Pretraining via Active Forgetting for Improving Cross Lingual Transfer
  Divyanshu Aggarwal$^*$, Ashutosh Sathe$^*$, Sunayana Sitaram
  NAACL 2025
• Improving Self Consistency in LLMs through Probabilistic Tokenization
  Ashutosh Sathe$^*$, Divyanshu Aggarwal$^*$, Sunayana Sitaram
  ICML 2024 Workshop LLMs and Cognition, NAACL 2025
• Efficient Training of Language Models with Compact and Consistent Next Token Distributions
  Ashutosh Sathe, Sunita Sarawagi
  ICML 2024 Workshop on Efficient Systems for Foundation Models (ES-FoMo II), ACL 2024
• Benchmarking and Improving Text-to-SQL Generation under Ambiguity
  Adithya Bhaskar $^*$, Tushar Tomar $^*$, Ashutosh Sathe, Sunita Sarawagi
  EMNLP 2023
• Diverse Parallel Data Synthesis for Cross-Database Adaptation of Text-to-SQL Parsers
  Abhijeet Awasthi, Ashutosh Sathe, Sunita Sarawagi
  EMNLP 2022