📚 Selected Publications

• ›

  Building Reactive Large Language Model Pipelines with Motion

  To appear at SIGMOD 2024 (Demo)

  Shreya Shankar, Aditya G. Parameswaran
• ›

  Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences

  HEAL Workshop at CHI 2024 (Full paper under submission)

  Shreya Shankar, J.D. Zamfirescu-Pereira, Björn Hartmann, Aditya G. Parameswaran, Ian Arawjo
• ›

  SPADE: Synthesizing Data Quality Assertions for Large Language Model Pipelines

  Under Submission

  Shreya Shankar, Haotian Li, Parth Asawa, Madelon Hulsebos, Yiming Lin, J.D. Zamfirescu-Pereira, Harrison Chase, Will Fu-Hinthorn, Aditya G. Parameswaran, Eugene Wu
• ›

  Operationalizing Machine Learning: An Interview Study

  To appear at CSCW 2024

  Shreya Shankar*, Rolando Garcia*, Joseph M. Hellerstein, Aditya G. Parameswaran
• ›

  Revisiting Prompt Engineering via Declarative Crowdsourcing

  CIDR 2023

  Aditya G. Parameswaran, Shreya Shankar, Parth Asawa, Naman Jain, Yujie Wang
• ›

  Automatic and Precise Data Validation for Machine Learning

  CIKM 2023

  Shreya Shankar, Labib Fawaz, Karl Gyllstrom, Aditya G. Parameswaran
• ›

  Towards Observability for Production Machine Learning Pipelines

  VLDB 2023

  Shreya Shankar, Aditya G. Parameswaran
• ›

  Bolt-on, Compact, and Rapid Program Slicing for Notebooks

  VLDB 2023

  Shreya Shankar*, Stephen Macke*, Sarah Chasins, Andrew Head, Aditya G. Parameswaran
• ›

  Rethinking Streaming Machine Learning Evaluation

  ICLR 2022: Workshop on ML Evaluation Standards

  Shreya Shankar, Bernease Herman, Aditya G. Parameswaran
• ›

  Adversarial examples that fool both computer vision and time-limited humans

  NIPS 2018

  Gamalelden F. Elsayed, Shreya Shankar, Brian Cheung, Nicolas Papernot, Alexey Kurakin, Ian Goodfellow, Jascha Sohl-Dickstein
• ›

  No classification without representation: Assessing geodiversity issues in open data sets for the developing world

  NIPS 2017: Workshop on Machine Learning for the Developing World

  Shreya Shankar, Yoni Halpern, Eric Breck, James Atwood, Jimbo Wilson, D. Sculley