2024

An AI-Resilient Text Rendering Technique for Reading and Skimming Documents
Ziwei Gu, Ian Arawjo, Kenneth Li, Jonathan K. Kummerfeld, Elena L. Glassman
CHI, 2024
Supporting Sensemaking of Large Language Model Outputs at Scale\n
Katy Ilonka Gero, Chelse Swoopes, Ziwei Gu, Jonathan K. Kummerfeld, Elena L. Glassman
CHI, 2024
A Comparative Multidimensional Analysis of Empathetic Systems
Andrew Lee, Jonathan K. Kummerfeld, Lawrence C. An, Rada Mihalcea
EACL, 2024

2023

Interactive Text-to-{SQL} Generation via Editable Step-by-Step Explanations
Yuan Tian, Zheng Zhang, Zheng Ning, Toby Li, Jonathan K. Kummerfeld, Tianyi Zhang
EMNLP, 2023
Empathy Identification Systems are not Accurately Accounting for Context
Andrew Lee, Jonathan K. Kummerfeld, Lawrence C. An, Rada Mihalcea
EACL, 2023
Chat Disentanglement: Data for New Domains and Methods for More Accurate Annotation
Sai R. Gouravajhala, Andrew M. Vernier, Yiming Shi, Zihan Li, Mark Ackerman, Jonathan K. Kummerfeld
ALTA, 2023

2022

Leveraging Similar Users for Personalized Language Modeling with Limited Data
Charles Welch, Chenxi Gu, Jonathan K. Kummerfeld, Veronica Perez-Rosas, Rada Mihalcea
ACL, 2022
Using Paraphrases to Study Properties of Contextual Embeddings
Laura Burdick, Jonathan K. Kummerfeld, Rada Mihalcea
NAACL, 2022
Augmenting Task-Oriented Dialogue Systems with Relation Extraction
Andrew Lee, Zhenguo Chen, Kevin Leach, Jonathan K. Kummerfeld
AAAI Wokshop: Dialogue System Technology Challenges, 2022

2021

Analyzing the Surprising Variability in Word Embedding Stability Across Languages
Laura Burdick, Jonathan K. Kummerfeld, Rada Mihalcea
EMNLP, 2021
Micromodels for Efficient, Explainable, and Reusable Systems: A Case Study on Mental Health
Andrew Lee, Jonathan K. Kummerfeld, Lawrence C. An, Rada Mihalcea
Findings of EMNLP, 2021
Quantifying and Avoiding Unfair Qualification Labour in Crowdsourcing
Jonathan K. Kummerfeld
ACL (short), 2021
Exploring Self-Identified Counseling Expertise in Online Support Forums
Allison Lahnala, Yuntian Zhao, Charles Welch, Jonathan K. Kummerfeld, Lawrence C. An, Kenneth Resnicow, Rada Mihalcea, Verónica Pérez-Rosas
Findings of ACL, 2021
Chord Embeddings: Analyzing What They Capture and Their Role for Next Chord Prediction and Artist Attribute Prediction
Allison Lahnala, Gauri Kambhatla, Jiajun Peng, Matthew Whitehead, Gillian Minnehan, Eric Guldan, Jonathan K. Kummerfeld, Anıl Çamcı, Rada Mihalcea
EvoMusArt, 2021
Overview of the Eighth Dialog System Technology Challenge: DSTC8
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Peng Baolin, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
IEEE: TASLP, 2021
To Batch or Not to Batch? Comparing Batching and Curriculum Learning Strategies across Tasks and Datasets
Laura Burdick, Jonathan K. Kummerfeld, Rada Mihalcea
Mathematics, 2021
Learning to Learn End-to-End Goal-Oriented Dialog From Related Dialog Tasks
Janarthanan Rajendran, Jonathan K. Kummerfeld, Satinder Singh
EMNLP Workshop: NLP4ConvAI, 2021

2020

Compositional Demographic Word Embeddings
Charles Welch, Jonathan K. Kummerfeld, Verónica Pérez-Rosas, Rada Mihalcea
EMNLP, 2020
Improving Low Compute Language Modeling with In-Domain Embedding Initialisation
Charles Welch, Rada Mihalcea, Jonathan K. Kummerfeld
EMNLP (short), 2020
Iterative Feature Mining for Constraint-Based Data Collection to Increase Data Diversity and Model Robustness
Stefan Larson, Anthony Zheng, Anish Mahendran, Rishi Tekriwal, Adrian Cheung, Eric Guldan, Kevin Leach, Jonathan K. Kummerfeld
EMNLP (short), 2020
A Novel Workflow for Accurately and Efficiently Crowdsourcing Predicate Senses and Argument Labels
Youxuan Jiang, Huaiyu Zhu, Jonathan K. Kummerfeld, Yunyao Li, Walter Lasecki
Findings of EMNLP, 2020
Crowdsourced Detection of Emotionally Manipulative Language
Jordan S. Huffaker, Jonathan K. Kummerfeld, Walter S. Lasecki, Mark S. Ackerman
CHI, 2020
Overview of the seventh Dialog System Technology Challenge: DSTC7
Luis Fernando D'Haro, Koichiro Yoshino, Chiori Hori, Tim K. Marks, Lazaros Polymenakos, Jonathan K. Kummerfeld, Michel Galley, Xiang Gao
CSL, 2020
Inconsistencies in Crowdsourced Slot-Filling Annotations: A Typology and Identification Methods
Stefan Larson, Adrian Cheung, Anish Mahendran, Kevin Leach, Jonathan K. Kummerfeld
CoLing, 2020
Exploring the Value of Personalized Word Embeddings
Charles Welch, Jonathan K. Kummerfeld, Verónica Pérez-Rosas, Rada Mihalcea
CoLing (short), 2020

2019

No-Press Diplomacy: Modeling Multi-Agent Gameplay
Philip Paquette, Yuchen Lu, Steven Bocco, Max O. Smith, Satya Ortiz-Gagné, Jonathan K. Kummerfeld, Joelle Pineau, Satinder Singh, Aaron Courville
NeurIPS, 2019
An Evaluation for Intent Classification and Out-of-Scope Prediction
Stefan Larson, Anish Mahendran, Joseph J. Peper, Christopher Clarke, Andrew Lee, Parker Hill, Jonathan K. Kummerfeld, Kevin Leach, Michael A. Laurenzano, Lingjia Tang, Jason Mars
EMNLP (short), 2019
A Large-Scale Corpus for Conversation Disentanglement
Jonathan K. Kummerfeld, Sai R. Gouravajhala, Joseph J. Peper, Vignesh Athreya, Chulaka Gunasekara, Jatin Ganhotra, Siva Sankalp Patel, Lazaros Polymenakos, Walter S. Lasecki
ACL, 2019
SLATE: A Super-Lightweight Annotation Tool for Experts
Jonathan K. Kummerfeld
ACL (demo), 2019
Outlier Detection for Improved Data Quality and Diversity in Dialog Systems
Stefan Larson, Anish Mahendran, Andrew Lee, Jonathan K. Kummerfeld, Parker Hill, Michael Laurenzano, Johann Hauswald, Lingjia Tang, Jason Mars
NAACL, 2019
Look Who’s Talking: Inferring Speaker Attributes from Personal Longitudinal Dialog
Charles Welch, Verónica Pérez-Rosas, Jonathan K. Kummerfeld, Rada Mihalcea
Best Student Paper - CICLing, 2019
Learning from Personal Longitudinal Dialog Data
Charles Welch, Verónica Pérez-Rosas, Jonathan K. Kummerfeld, Rada Mihalcea
IEEE Intelligent Systems, 2019

2018

Improving Text-to-SQL Evaluation Methodology
Catherine Finegan-Dollak*, Jonathan K. Kummerfeld*, Li Zhang, Karthik Ramanathan, Sesh Sadasivam, Rui Zhang, Dragomir Radev
ACL, 2018
Factors Influencing the Surprising Instability of Word Embeddings
Laura Burdick, Jonathan K. Kummerfeld, Rada Mihalcea
NAACL, 2018
Effective Crowdsourcing for a New Type of Summarization Task
Youxuan Jiang, Catherine Finegan-Dollak, Jonathan K. Kummerfeld, Walter Lasecki
NAACL (short), 2018
Data Collection for a Production Dialogue System: A Startup Perspective
Yiping Kang, Yunqi Zhang, Jonathan K. Kummerfeld, Parker Hill, Johann Hauswald, Michael A. Laurenzano, Lingjia Tang, Jason Mars
NAACL (industry), 2018
World Knowledge for Abstract Meaning Representation Parsing
Charles Welch, Jonathan K. Kummerfeld, Song Feng, Rada Mihalcea
LREC, 2018

2017

Parsing with Traces: An O(\(n^4\)) Algorithm and a Structural Representation
Jonathan K. Kummerfeld, Dan Klein
TACL, 2017
Identifying Products in Online Cybercrime Marketplaces: A Dataset for Fine-grained Domain Adaptation
Greg Durrett, Jonathan K. Kummerfeld, Taylor Berg-Kirkpatrick, Rebecca S. Portnoff, Sadia Afroz, Damon McCoy, Kirill Levchenko, Vern Paxson
EMNLP, 2017
Understanding Task Design Trade-offs in Crowdsourced Paraphrase Collection
Youxuan Jiang, Jonathan K. Kummerfeld, Walter S. Lasecki
ACL (short), 2017
Tools for Automated Analysis of Cybercriminal Markets
Rebecca S. Portnoff, Sadia Afroz, Greg Durrett, Jonathan K. Kummerfeld, Taylor Berg-Kirkpatrick, Damon McCoy, Kirill Levchenko, Vern Paxson
WWW, 2017

2016

Algorithms for Identifying Syntactic Errors and Parsing with Graph Structured Output
Jonathan K. Kummerfeld
EECS Department, University of California, Berkeley, 2016

2015

An Empirical Analysis of Optimization for Max-Margin NLP
Jonathan K. Kummerfeld, Taylor Berg-Kirkpatrick, Dan Klein
EMNLP (short), 2015

2013

Error-Driven Analysis of Challenges in Coreference Resolution
Jonathan K. Kummerfeld, Dan Klein
EMNLP, 2013
An Empirical Examination of Challenges in Chinese Parsing
Jonathan K. Kummerfeld, Daniel Tse, James R. Curran, Dan Klein
ACL (short), 2013
High-velocity Clouds in the Galactic All Sky Survey. I. Catalog
Vanessa A. Moss, Naomi M. McClure-Griffiths, Tara Murphy, D. J. Pisano, Jonathan K. Kummerfeld, James R. Curran
The Astrophysical Journal Supplement Series, 2013

2012

Parser Showdown at the Wall Street Corral: An Empirical Investigation of Error Types in Parser Output
Jonathan K. Kummerfeld, David Hall, James R. Curran, Dan Klein
EMNLP, 2012
Robust Conversion of CCG Derivations to Phrase Structure Trees
Jonathan K. Kummerfeld, Dan Klein, James R. Curran
ACL (short), 2012

2011

Mention Detection: Heuristics for the OntoNotes annotations
Jonathan K. Kummerfeld, Mohit Bansal, David Burkett, Dan Klein
CoNLL Shared Task, 2011

2010

Faster Parsing by Supertagger Adaptation
Jonathan K. Kummerfeld, Jessika Roesner, Tim Dawborn, James Haggerty, James R. Curran, Stephen Clark
ACL, 2010
Spatiotemporal Hierarchy of Relaxation Events, Dynamical Heterogeneities, and Structural Reorganization in a Supercooled Liquid
Raphael Candelier, Asaph Widmer-Cooper, Jonathan K. Kummerfeld, Olivier Dauchot, Giulio Biroli, Peter Harrowell, David R. Reichman
Physical Review Letters, 2010
Morphological Analysis Can Improve a CCG Parser for English
Matthew Honnibal, Jonathan K. Kummerfeld, James R. Curran
CoLing, 2010

2009

Adaptive Supertagging for Faster Parsing
Jonathan K. Kummerfeld
The University of Sydney, 2009
Faster parsing and supertagging model estimation
Jonathan K. Kummerfeld, Jessika Roesner, James R. Curran
ALTA, 2009

2008

The densest packing of AB binary hard-sphere homogeneous compounds across all size ratios
Jonathan K. Kummerfeld, Toby S Hudson, Peter Harrowell
The Journal of Physical Chemistry B, 2008
Classification of Verb Particle Constructions with the Google Web1T Corpus
Jonathan K. Kummerfeld, James R. Curran
ALTA, 2008

Non-Archival

2024

A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity
Andrew Lee, Xiaoyan Bai, Itamar Pres, Martin Wattenberg, Jonathan K. Kummerfeld, Rada Mihalcea
arXiv, 2024

2022

Sensemaking Interfaces for Human Evaluation of Language Model Outputs
Katy Gero, Jonathan K. Kummerfeld, Elena Glassman
NeurIPS Workshop: Human Evaluation of Generative Models, 2022

2020

NOESIS II: Predicting Responses, Identifying Success, and Managing Complexity in Task-Oriented Dialogue
Chulaka Gunasekara, Jonathan K. Kummerfeld, Luis Lastras, Walter S. Lasecki
AAAI Wokshop: Dialogue System Technology Challenges, 2020
Qualification Labour: A Fair Wage Isn’t Enough if Workers Need to Do 5,000 Low Paid Tasks to Qualify for Your Task
Jonathan K. Kummerfeld
HComp (Work in Progress), 2020

2019

DSTC7 Task 1: Noetic End-to-End Response Selection
Chulaka Gunasekara, Jonathan K. Kummerfeld, Lazaros Polymenakos, Walter S. Lasecki
AAAI Wokshop: Dialogue System Technology Challenges, 2019
The Eighth Dialog System Technology Challenge
Seokhwan Kim, Michel Galley, Chulaka Gunasekara, Sungjin Lee, Adam Atkinson, Baolin Peng, Hannes Schulz, Jianfeng Gao, Jinchao Li, Mahmoud Adada, Minlie Huang, Luis Lastras, Jonathan K. Kummerfeld, Walter S. Lasecki, Chiori Hori, Anoop Cherian, Tim K. Marks, Abhinav Rastogi, Xiaoxue Zang, Srinivas Sunkara, Raghav Gupta
NeurIPS Workshop: Conversational AI: Today's Practice and Tomorrow's Potential, 2019
Training Data Voids: Novel Attacks Against NLP Content Moderation
Jordan S. Huffaker, Jonathan K. Kummerfeld, Walter S. Lasecki, Mark S. Ackerman
CSCW Workshop: Volunteer Work: Mapping the Future of Moderation Research, 2019
DSTC7 Task 1: Noetic End-to-End Response Selection
Chulaka Gunasekara, Jonathan K. Kummerfeld, Lazaros Polymenakos, Walter S. Lasecki
ACL Workshop: NLP for Conversational AI, 2019

2018

Dialog System Technology Challenge 7
Koichiro Yoshino, Chiori Hori, Julien Perez, Luis Fernando D'Haro, Lazaros Polymenakos, Chulaka Gunasekara, Walter S. Lasecki, Jonathan K. Kummerfeld, Michel Galley, Chris Brockett, Jianfeng Gao, Bill Dolan, Xiang Gao, Huda Alamari, Tim K. Marks, Devi Parikh, Dhruv Batra
NeurIPS Workshop: Conversational AI: Today's Practice and Tomorrow's Potential, 2018

2009

Large-Scale Syntactic Processing: Parsing the Web
Stephen Clark, Ann Copestake, James R. Curran, Yue Zhang, Aurelie Herbelot, James Haggerty, Byung-Gyu Ahn, Curt Van Wyk, Jessika Roesner, Jonathan K. Kummerfeld, Tim Dawborn
Johns Hopkins University, 2009