Abhishek Divekar
Senior Researcher, Amazon
I research LLM evaluation, synthetic data, red-teaming LLMs and multimodal agents for science, with first-author papers at NeurIPS, ACL, EMNLP, AAAI, and CIKM. I collaborate with researchers at UT Austin, NYU and MBZUAI. At Amazon, I turn that research into products, including leading red-teaming and evals for the India launch of Amazon Rufus, used by 100M+ customers .
My scientific and mathematical contributions have added over USD 550 million to Amazon’s revenue between 2021-2026. I have deep industry experience working across several areas of e-commerce science; this includes building RL environments for LLM post-training, Search and Ads Ranking, Online advertising auction simulators, LLM-as-a-Judge, user-facing chatbot applications (Rufus), and LLM red-teaming & guardrails. I have shipped 650,000 lines of code into production (~500k was written pre-LLMs), including distributed language model training. My current favorite language model is Claude Opus 5.5 (high effort).
I volunteer on the Scientific Committee of the International Olympiad in AI (IOAI 2026 & 2027), where I chaired the inaugural IOAI²: AI Models Track , a first-of-its-kind competition where I recruited 14 AI labs from industry and academia to solve AI Olympiad problems using fully autonomous agentic systems. Previously, I served as India’s Team Lead (AI Olympiad Coach) at IOAI 2025, leading a team of 8 students to win 3 Gold, 2 Silver, 1 Bronze medals, and 1 Honorable Mention.
I hold an M.S. in Computer Science from UT Austin, where I was advised by Greg Durrett .

News
- VESTA accepted to NeurIPS 2026 (main track)! Read the paper
- TrojanShot (with Vijit Malik) published at CIKM 2026, Rome! Read the paper
- Re-elected as a core member of the IOAI 2027 Singapore International Scientific Committee, and of the IOAI 2027 AI Models Track Core Committee. See my AI Olympiad work
- Released the IOAI² 2026 review, co-authored with IOAI co-founder Elena Marinova. Read the report
- Chaired the inaugural IOAI² AI Models Track at IOAI 2026, Astana, Kazakhstan, where 14 AI organizations from 5 countries participated to benchmark fully autonomous AI systems at solving IOAI 2026 Tasks. Read the report
- The International Jury's final report at the IOAI 2026 closing ceremony presented the AI Models Track. Read the report
- Travelled to Kazakhstan to serve on the IOAI 2026 Jury. See the Jury
- When Gradients Collide (with Parth Darshan) accepted to the ACL 2026 CustomNLP4U workshop! Read the paper
- Statistically Reliable LLM-Based Ranking Evaluation via Prediction-Powered Inference, an extended abstract of PRECISE, accepted to the ACL 2026 GEM workshop! Read the paper
- PRECISE won the IAAI 2026 Deployed Application Award in the AAAI 2026 Innovative Applications of AI (IAAI) track, Singapore! Read the paper
- Presented PRECISE in an oral session at AAAI 2026 (Innovative Applications of AI track, 19.2% acceptance rate), Singapore. Read the paper
- Joined the IOAI International Scientific Committee for IOAI 2026. See my AI Olympiad work
- TrojanShot selected as an oral at the Amazon Machine Learning Conference 2025! Read the paper
- Led Team India at IOAI 2025, Beijing, China: 3 Gold, 2 Silver, 1 Bronze, and 1 Honorable Mention. See the results
- Named one of the Top 7 GenAI Scientists in India by Analytics Vidhya at DataHack Summit 2025.
- Also named one of the Top 7 GenAI Community Contributors at the same DataHack Summit 2025.
- Invited talk on synthetic data generation at DataHack Summit 2025. See the talk
- Served on the Technical Committee of the ACM India AI Olympiad (INAIO 2025), Hyderabad, India.
- Joined the NSF-Simons AI Institute for Cosmic Origins (CosmicAI) as a Research Collaborator.
- SynthesizRR and CorrSynth accepted to EMNLP 2024 (main conference)! Read the papers
- SynthesizRR selected as an oral at the Amazon Machine Learning Conference 2024! Read the paper
- Launched PRECISE in GlowRoad search, measuring search relevance with LLM judgments and few human labels. See the launch
- My M.S. thesis, "Diverse dataset synthesis using retrieval augmented language models", published by The University of Texas at Austin. Read the thesis
- Completed my M.S. in Computer Science at UT Austin, advised by Greg Durrett.
- Presented Flexible AutoML at AIMLSys 2022. See the slides
- Taught supervised learning at the Amazon ML Summer School to about 3,000 Indian undergraduates. See the lecture
- Presented DRiP, AutoML for cost-constrained product classification, at Amazon Research Days 2021. See the slides
- DRiP and the CPP multimodal AutoML benchmark accepted at the Amazon Machine Learning Conference 2021! Read the papers
- Started my M.S. in Computer Science (thesis track) at UT Austin, part-time alongside Amazon.
- Moved from software engineering to Applied Science at Amazon Central Machine Learning. Read how
- First-author paper on intrusion-detection benchmarks presented as an oral at IEEE ICCCS 2018! Read the paper
- Won the Amazon Machine Learning Challenge in Chennai, out of 300 participants.
- Joined Amazon as a Software Development Engineer (Digital Payments).
- Graduated from VJTI, Mumbai with a B.Tech. in Information Technology.
Career
View my resumeFull-time
- Dec 2021 to nowSenior Researcher · Amazon
- Oct 2019 to Nov 2021Applied Scientist II, India Machine Learning · Amazon
- Jul 2017 to Sep 2019Software Development Engineer, Digital Payments · Amazon
Part-time
- Feb 2025 to nowResearch Collaborator · NSF-Simons AI Institute for Cosmic Origins (CosmicAI)LLM and vision-language agents for astronomy, with UT Austin, NYU and UCLA.
Academic service
- Nov 2026 to nowMember, International Scientific Committee (IOAI 2027, upcoming) · International Olympiad in Artificial Intelligence
- Dec 2025 to Sep 2026Member of IOAI Scientific Committee, and Chair of IOAI²: AI Models Track (IOAI 2026) · International Olympiad in Artificial IntelligenceDuties: Chair of the IOAI² AI Models Track; member of the IOAI Jury.
- May 2025 to Aug 2025Team Lead, Team India (IOAI 2025) · International Olympiad in Artificial IntelligenceSelected, mentored and coached the 8 olympians: 3 Gold, 2 Silver, 1 Bronze, 1 Honorable Mention.
- Feb 2025 to May 2025Technical Committee, ACM India AI Olympiad (INAIO 2025) · ACM India AI OlympiadSet Stage-2 problems and judged the national selection rounds.
Internships
- May 2016 to Jul 2016Software Development Intern · BarclaysBuilt a prototype that cut foreign-exchange settlement time from T+2 days to T+120 seconds, using Ripple blockchain and Node.js.
Education
- Aug 2020 to May 2024M.S. Computer Science (thesis track) · The University of Texas at AustinAdvised by Greg Durrett. Completed part-time while working full-time at Amazon. My thesis was published at EMNLP 2024 as a first-author main conference paper (SynthesizRR). Read the thesis
- Jul 2013 to Apr 2017B.Tech. Information Technology · Veermata Jijabai Technological Institute (VJTI), MumbaiBachelor’s thesis on machine learning for anomaly-based network intrusion detection, advised by Prof. Mahesh Shirole; I was a Research Assistant in his lab (Apr to Jun 2017) and published the work as a first-author paper at IEEE ICCCS 2018. Read the paper
Opinions on this site are my own and do not reflect the views of my employer.
Publications
Visit my Google Scholar profile* equal contribution
Amazon Machine Learning Conference
AMLC is Amazon’s annual internal machine learning conference, with roughly 1,000 submissions a year (announcement). Full texts are internal.
Product launches
2025 to now
KeywordGym for Amazon advertising
My role Led the science: designed the training environment, reward and guardrails, and launched the keyword models in a live campaign experiment.
A reinforcement-learning environment that post-trains language models to generate advertising keyword sets for an advertiser's primary objective (such as orders or clicks), with a group-relative guardrail that protects secondary metrics such as return on ad spend.
Oct 2024
PRECISE in GlowRoad search
My role Built the statistical method and deployed it to evaluate GlowRoad search; first author of the AAAI 2026 paper.
Measures search relevance from about 100 human-labelled queries plus LLM judgments, correcting for the LLM judge's bias.
2024
Amazon Rufus, India launch
My role Led red-teaming for the India launch, testing Rufus against India-specific compliance policies.
Amazon's LLM-powered shopping assistant, used by 100M+ customers.
2019 to 2023
AutoML platform for product classification
My role Lead science contributor: designed and built its data-processing nodes (160K lines of Python).
Internal AutoML platform that deployed 1,000+ models across 14 Amazon websites and updated 1B+ product attributes.
AI Olympiad
The International Olympiad in Artificial Intelligence (IOAI) is an annual science olympiad for high-school students. Its third edition, IOAI 2026 in Astana, Kazakhstan, had 108 countries and territories represented, and was the first to include an AI Models Track.

INAIO 2025 · Hyderabad, India
Technical Committee, ACM India AI Olympiad (INAIO 2025)
I helped select India’s national team: I curated the Stage-2 problems attempted by 200+ students, and coached and judged the 22 Stage-4 finalists at IIIT Hyderabad.
Open source
I led the open-sourcing of FMCore, Bears and Concurry on Amazon Science.
-
IOAI² AI Models Track
Task adaptations, scoring, competition rules and Jury precedents, for reuse by other olympiads.
-
Concurry
Scaling AI research and production workloads in Python.
-
FMCore
Running GenAI models at every scale and modality.
-
Bears
Dataframe sharding, streaming and processing for ML.
-
AI Learning Gems
Textbook-style AI notes, researched by LLMs and curated by me.
Awards


Top 7 GenAI Scientists in India, Analytics Vidhya DataHack Summit 2025.
- Jan 2026IAAI 2026 Deployed Application Award · AAAI 2026, Innovative Applications of AI (IAAI) track, SingaporeFor PRECISE: Reducing the Bias of LLM Evaluations using Prediction-Powered Ranking Estimation (with Anirban Majumder). See the paper
- 2025Top 7 GenAI Scientists in India · Analytics Vidhya, DataHack Summit 2025Read the announcement
- 2025Top 7 GenAI Community Contributors · Analytics Vidhya, DataHack Summit 2025
- 2025Team Lead, Team India at IOAI 2025 · 3 Gold, 2 Silver, 1 Bronze, 1 Honorable Mention; 3rd of 63 by medal tableSee the official results
- Aug 2017Winner, Amazon Machine Learning Challenge · Chennai, out of 300 participants
Press & Media
- Aug 2025Team India places 3rd at its debut International Olympiad in AICoverage of the team I led at IOAI 2025, Beijing (3 Gold, 2 Silver, 1 Bronze, 1 Honorable Mention).Read the coverage in The Hindu BusinessLine , The Times of India , Navbharat Times , Zee News and India.com
- Aug 2025DataHack Summit 2025, Day 2: talk on synthetic data and Top 7 GenAI Scientists awardAnalytics Vidhya’s Day 2 recap covers my talk, The Promise and Pitfalls of Synthetic Data Generation, and lists me among the AV Luminary Award winners.Read in Analytics Vidhya
- 2022Amazon India announces second edition of Machine Learning Summer SchoolCovers the summer school where I taught.Read in The Times of India
- 2022Being a machine learning scientist at Amazon IndiaVideo interview about my work at Amazon India. Watch the video interview
Service
- 2025Area Chair · Amazon Machine Learning Conference (AMLC)
- 2025Reviewer · ACL
- 2025Reviewer · EMNLP
- 2025Reviewer · ICLR
- 2025Reviewer · AAAI
- 2025Reviewer · COLM
- 2025Reviewer · WSDM
- 2025Reviewer · SIGIR
- 2025Reviewer · WWW
- 2025Proposal reviewer, Amazon Research Awards · AWS Agentic AI call for proposalsSee the call for proposals
- 2022Reviewer · AMLC, NLP and ML Tools tracks
- 2022Reviewer · AIMLSys
- 2022Instructor, Amazon ML Summer School · about 3,000 Indian undergraduatesTaught the supervised-learning module: decision trees, bagging and boosting.
- OngoingHiring and mentoring · Amazon200+ interviews for Applied Scientist roles. I mentor junior scientists and interns.
















