Abhishek Divekar

Senior Researcher, Amazon

I research LLM evaluation, synthetic data, red-teaming LLMs and multimodal agents for science, with first-author papers at NeurIPS, ACL, EMNLP, AAAI, and CIKM. I collaborate with researchers at UT Austin, NYU and MBZUAI. At Amazon, I turn that research into products, including leading red-teaming and evals for the India launch of Amazon Rufus, used by 100M+ customers .

My scientific and mathematical contributions have added over USD 550 million to Amazon’s revenue between 2021-2026. I have deep industry experience working across several areas of e-commerce science; this includes building RL environments for LLM post-training, Search and Ads Ranking, Online advertising auction simulators, LLM-as-a-Judge, user-facing chatbot applications (Rufus), and LLM red-teaming & guardrails. I have shipped 650,000 lines of code into production (~500k was written pre-LLMs), including distributed language model training. My current favorite language model is Claude Opus 5.5 (high effort).

I volunteer on the Scientific Committee of the International Olympiad in AI (IOAI 2026 & 2027), where I chaired the inaugural IOAI²: AI Models Track , a first-of-its-kind competition where I recruited 14 AI labs from industry and academia to solve AI Olympiad problems using fully autonomous agentic systems. Previously, I served as India’s Team Lead (AI Olympiad Coach) at IOAI 2025, leading a team of 8 students to win 3 Gold, 2 Silver, 1 Bronze medals, and 1 Honorable Mention.

I hold an M.S. in Computer Science from UT Austin, where I was advised by Greg Durrett .

Portrait of Abhishek Divekar

News

  • VESTA accepted to NeurIPS 2026 (main track)! Read the paper
  • TrojanShot (with Vijit Malik) published at CIKM 2026, Rome! Read the paper
  • Re-elected as a core member of the IOAI 2027 Singapore International Scientific Committee, and of the IOAI 2027 AI Models Track Core Committee. See my AI Olympiad work
  • Released the IOAI² 2026 review, co-authored with IOAI co-founder Elena Marinova. Read the report
  • Chaired the inaugural IOAI² AI Models Track at IOAI 2026, Astana, Kazakhstan, where 14 AI organizations from 5 countries participated to benchmark fully autonomous AI systems at solving IOAI 2026 Tasks. Read the report
  • The International Jury's final report at the IOAI 2026 closing ceremony presented the AI Models Track. Read the report
  • Travelled to Kazakhstan to serve on the IOAI 2026 Jury. See the Jury
  • When Gradients Collide (with Parth Darshan) accepted to the ACL 2026 CustomNLP4U workshop! Read the paper
  • Statistically Reliable LLM-Based Ranking Evaluation via Prediction-Powered Inference, an extended abstract of PRECISE, accepted to the ACL 2026 GEM workshop! Read the paper
  • PRECISE won the IAAI 2026 Deployed Application Award in the AAAI 2026 Innovative Applications of AI (IAAI) track, Singapore! Read the paper
  • Presented PRECISE in an oral session at AAAI 2026 (Innovative Applications of AI track, 19.2% acceptance rate), Singapore. Read the paper
  • Joined the IOAI International Scientific Committee for IOAI 2026. See my AI Olympiad work
  • TrojanShot selected as an oral at the Amazon Machine Learning Conference 2025! Read the paper
  • Led Team India at IOAI 2025, Beijing, China: 3 Gold, 2 Silver, 1 Bronze, and 1 Honorable Mention. See the results
  • Named one of the Top 7 GenAI Scientists in India by Analytics Vidhya at DataHack Summit 2025.
  • Also named one of the Top 7 GenAI Community Contributors at the same DataHack Summit 2025.
  • Invited talk on synthetic data generation at DataHack Summit 2025. See the talk
  • Served on the Technical Committee of the ACM India AI Olympiad (INAIO 2025), Hyderabad, India.
  • Joined the NSF-Simons AI Institute for Cosmic Origins (CosmicAI) as a Research Collaborator.
  • SynthesizRR and CorrSynth accepted to EMNLP 2024 (main conference)! Read the papers
  • SynthesizRR selected as an oral at the Amazon Machine Learning Conference 2024! Read the paper
  • Launched PRECISE in GlowRoad search, measuring search relevance with LLM judgments and few human labels. See the launch
  • My M.S. thesis, "Diverse dataset synthesis using retrieval augmented language models", published by The University of Texas at Austin. Read the thesis
  • Completed my M.S. in Computer Science at UT Austin, advised by Greg Durrett.
  • Presented Flexible AutoML at AIMLSys 2022. See the slides
  • Taught supervised learning at the Amazon ML Summer School to about 3,000 Indian undergraduates. See the lecture
  • Presented DRiP, AutoML for cost-constrained product classification, at Amazon Research Days 2021. See the slides
  • DRiP and the CPP multimodal AutoML benchmark accepted at the Amazon Machine Learning Conference 2021! Read the papers
  • Started my M.S. in Computer Science (thesis track) at UT Austin, part-time alongside Amazon.
  • Moved from software engineering to Applied Science at Amazon Central Machine Learning. Read how
  • First-author paper on intrusion-detection benchmarks presented as an oral at IEEE ICCCS 2018! Read the paper
  • Won the Amazon Machine Learning Challenge in Chennai, out of 300 participants.
  • Joined Amazon as a Software Development Engineer (Digital Payments).
  • Graduated from VJTI, Mumbai with a B.Tech. in Information Technology.

Full-time

Part-time

Academic service

Internships

Education

Opinions on this site are my own and do not reflect the views of my employer.

* equal contribution

Amazon Machine Learning Conference

AMLC is Amazon’s annual internal machine learning conference, with roughly 1,000 submissions a year (announcement). Full texts are internal.

Product launches

AI Olympiad

The International Olympiad in Artificial Intelligence (IOAI) is an annual science olympiad for high-school students. Its third edition, IOAI 2026 in Astana, Kazakhstan, had 108 countries and territories represented, and was the first to include an AI Models Track.

Open source

I led the open-sourcing of FMCore, Bears and Concurry on Amazon Science.

Awards

Abhishek Divekar receiving the Top 7 GenAI Scientists in India award from Manish Gupta, Director at Google DeepMind, at Analytics Vidhya DataHack Summit 2025
Receiving the award from Manish Gupta, Director, Google DeepMind.
Abhishek Divekar with Pratyush Kumar, Co-founder of Sarvam.ai, at the Top 7 GenAI Scientists in India award, Analytics Vidhya DataHack Summit 2025
With Pratyush Kumar, Co-founder, Sarvam.ai.

Top 7 GenAI Scientists in India, Analytics Vidhya DataHack Summit 2025.

Press & Media

Service