Singapore

Psychiatrists diagnose mental disorders via the linguistic use of patients. Still, due to data privacy, existing passive mental health monitoring systems use alternative features such as activity, app usage, and location via mobile devices. We propose FedTherapist, a mobile mental health monitoring system that utilizes continuous speech and keyboard input in a privacy-preserving way via federated learning. We explore multiple model designs by comparing their performance and overhead for FedTherapist to overcome the complex nature of on-device language model training on smartphones. We further propose a Context-Aware Language Learning (CALL) methodology to effectively utilize smartphones&#39; large and noisy text for mental health signal sensing. Our IRB-approved evaluation of the prediction of self-reported depression, stress, anxiety, and mood from 46 participants shows higher accuracy of FedTherapist compared with the performance with non-language features, achieving 0.15 AUROC improvement and 8.21% MAE reduction.

EMNLP 2023

FedTherapist: Mental Health Monitoring with User-Generated Linguistic Expressions on Smartphones via Federated Learning

on-device nlp

mental health monitoring

federated learning

Truth and Responsibility
“Truth and Responsibility” is a call to reimagine anthropology to meet the demands of the present moment. The imperative to bear witness, take action, and be held accountable to the truths we write and circulate invites us to reflect on our responsibility in reckoning with disciplinary histories, harms, and possibilities. To whom are we giving evidence and toward what ends? For whom are we writing? To whom are we accountable, and in what ways? We are thrilled to announce the theme of the 2021 AAA Annual Meeting to be held in Baltimore, MD: Truth and Responsibility.

Many consider anthropology to be a holistic social science dedicated to cross-cultural understanding as a way to reduce bigotry and more fully comprehend “what it means to be human.” Others push against this readily circulated origin story, arguing that “human” remains a highly contested, political category—evident as the presumed set of rights and protections associated with the “human” continue to be stripped away violently in the communities in which some of us live and work. Which violent histories and epistemologies must anthropologists take responsibility for in telling truth(s) about the discipline’s development? How do the dual histories of settler colonialism and slavery continue to influence anthropological thought and practices? In these political times, how can anthropologists throughout the globe work to secure a capacious, progressive vision of the human? How might movements for anti-racism, decoloniality, queer liberation, and healing such as #BlackLivesMatter, #ProtectMaunaKea, and #MeToo push a future anthropology out of the ashes of the anthropological past? Finally, what are the limits and possibilities of the anthropological imagination?

Across subfields, we find truths in patterns of human behavior, language, evolution, and cultural worlds. Industry-positioned anthropologists do this by extending the boundaries of the discipline not as an administrative solution to job shortages but as a source of intervention and knowledge production. Increasingly, anthropologists who make use of the scientific method question how status and identity help to decide which facts come to represent truth. How might quantitative researchers use our methods to identify patterned truths, and what responsibility do we hold in challenging conventional wisdom about these patterns? What responsibility do we have to both our colleagues and larger publics, to push toward increased transparency and ethical grounding in our data collection, analysis, and presentation?

Pedagogy is a key medium for the communication of anthropological truths. Which (and whose) truths are foregrounded in our curricula? What are the possibilities for a liberatory pedagogy in a precarious, “post-truth” era? Conferences, museums, organizing spaces, and classrooms are sites where pedagogy and various forms of communication can help us interrogate the performativity of truth. How might anthropologists conceive of truth performances? Might visual, aural, and choreographic performances during AAA sessions offer anthropologists alternative genres for truth-telling and truth-making that provoke discussions about responsibility?

In accordance with the urgency of the year’s theme, the questions posed in this call for papers do not have easy answers. The hope is that those who submit proposals will take up these questions and engage in collective thinking and imagining about the truths we hold, the truths we challenge, and the responsibilities we bear in co-creating a free and more equitable world. All panel proposals should have a statement about how the panel has incorporated the goals of equity, diversity, and inclusion, and/or analysis of power.

Executive Session proposals have already been selected and speak directly to the theme “Truth and Responsibility.” To practice the critical reflexivity this call for papers invites, we asked that Executive Session submissions explicitly address the diversity of session participants, such as organizational/institutional affiliation, career stage, race, ethnicity, disability, sexuality, class, religion, national identity, and gender. Proposals for Executive Sessions that demonstrated a commitment to equity and inclusion and/or a clear analysis of power (i.e. anti-imperialist, anti-white supremacist, decolonial, anti-ableist, feminist, anti-transphobic, anti-xenophobic, etc) were given priority. We are excited to be in conversation with residents of the Baltimore region and look forward to the discussions, performances, and actions generated by the dynamic group of anthropologists attending the 2021 AAA Annual Meeting.

AAA Annual Meeting 2021

“Truth and Responsibility” is a call to reimagine anthropology to meet the demands of the present moment. The imperative to bear witness, take action, and be held accountable to the truths we write and circulate invites us to reflect on our responsibility in reckoning with disciplinary histories, harms, and possibilities. To whom are we giving evidence and toward what ends? For whom are we writing? To whom are we accountable, and in what ways? We are thrilled to announce the theme of the 2021 AAA Annual Meeting to be held in Baltimore, MD: Truth and Responsibility.

Psychiatrists diagnose mental disorders via the linguistic use of patients. Still, due to data privacy, existing passive mental health monitoring systems use alternative features such as activity, app usage, and location via mobile devices. We propose FedTherapist, a mobile mental health monitoring system that utilizes continuous speech and keyboard input in a privacy-preserving way via federated learning. We explore multiple model designs by comparing their performance and overhead for FedTherapist to overcome the complex nature of on-device language model training on smartphones. We further propose a Context-Aware Language Learning (CALL) methodology to effectively utilize smartphones' large and noisy text for mental health signal sensing. Our IRB-approved evaluation of the prediction of self-reported depression, stress, anxiety, and mood from 46 participants shows higher accuracy of FedTherapist compared with the performance with non-language features, achieving 0.15 AUROC improvement and 8.21% MAE reduction.

poster

**Welcome to EMNLP 2023!**

On behalf of the EMNLP 2023 Organizing Committee, I extend a warm and heartfelt welcome to all of you to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP). It is with immense pleasure and excitement that we gather here in Singapore, a vibrant hub of innovation and technological advancement.

The conference program is packed with insightful presentations, thought-provoking workshops, and engaging networking opportunities. In addition to the technical sessions, we have also planned several social events that will provide you with the opportunity to connect with your colleagues.

The conference is held in person at the Resorts World Convention Centre in Singapore, and available on-line with the help of Underline.

For those in Singapore, I hope that you will find time to explore the exciting Sentosa Island, Gardens by the Bay, Singapore Botanic Gardens and the many other attractions unique to Singapore.

Of course, we are grateful to our sponsors and partners for their generous support of EMNLP 2023, whose contributions make it possible for us to host this world-class event.

Yuji Matsumoto (RIKEN AIP) 
EMNLP 2023 General Chair

To access the **EMNLP 2023** event page on Underline, you need to register for the Conference. 
Please follow **[this link](https://2023.emnlp.org/registration/)** for more details.

EMNLP 2023 took place in Singapore from Dec 6th to Dec 10th, 2023.

Software version migration and program translation are an important and costly part of the lifecycle of large codebases. Traditional machine translation relies on parallel corpora for supervised translation, which is not feasible for program translation due to a dearth of aligned data. Recent unsupervised neural machine translation techniques have overcome data limitations by included techniques such as back translation and low level compiler intermediate representations (IR). These methods face significant challenges due to the noise in code snippet alignment and the diversity of IRs respectively. In this paper we propose a novel model called Code Distillation (CoDist) whereby we capture the semantic and structural equivalence of code in a language agnostic intermediate representation. Distilled code serves as a translation pivot for any programming language, leading by construction to parallel corpora which scale to all available source code by simply applying the distillation compiler. We demonstrate that our approach achieves state-of-the-art performance on CodeXGLUE and TransCoder GeeksForGeeks translation benchmarks, with an average absolute increase of 12.7% on the TransCoder GeeksforGeeks translation benchmark compare to TransCoder-ST.

Program Translation via Code Distillation

The knowledge graph is a structure to store and represent knowledge, and recent studies have discussed its capability to assist language models for various applications. Some variations of knowledge graphs aim to record arguments and their relations for computational argumentation tasks. However, many must simplify semantic types to fit specific schemas, thus losing flexibility and expression ability. In this paper, we propose the **Hi**erarchical **Ar**gumentation **G**raph (Hi-ArG), a new structure to organize arguments. We also introduce two approaches to exploit Hi-ArG, including a text-graph multi-modal model GreaseArG and a new pre-training framework augmented with graph information. Experiments on two argumentation tasks have shown that after further pre-training and fine-tuning, GreaseArG supersedes same-scale language models on these tasks, while incorporating graph information during further pre-training can also improve the performance of vanilla language models. Code for this paper is available at <https://github.com/ljcleo/Hi-ArG>.

Hi-ArG: Exploring the Integration of Hierarchical Argumentation Graphs in Language Pretraining

Retrieval-based language models (LMs) have demonstrated improved interpretability, factuality, and adaptability compared to their parametric counterparts by incorporating retrieved text from external datastores. While it is well known that parametric models are prone to leaking private data, it remains unclear how the addition of a retrieval datastore impacts model privacy. In this work, we present the first study of privacy risks in retrieval-based LMs, particularly $k$NN-LMs. Our goal is to explore the optimal design and training procedure in domains where privacy is of concern, aiming to strike a balance between utility and privacy. Crucially, we find that $k$NN-LMs are more susceptible to leaking private information from their private datastore than parametric models. We further explore mitigations of privacy risks: When privacy information is targeted and readily detected in the text, we find that a simple sanitization step would eliminate the risks while decoupling query and key encoders achieves an even better utility-privacy trade-off. Otherwise, we consider strategies of mixing public and private data in both datastore and encoder training. While these methods offer modest improvements, they leave considerable room for future work. Together, our findings provide insights for practitioners to better understand and mitigate privacy risks in retrieval-based LMs.

Privacy Implications of Retrieval-Based Language Models

Real-world named entity recognition (NER) datasets are notorious for their noisy nature, attributed to annotation errors, inconsistencies, and subjective interpretations. Such noises present a substantial challenge for traditional supervised learning methods.
In this paper, we present a new and unified approach to tackle annotation noises for NER. Our method considers NER as a constituency tree parsing problem, utilizing a tree-structured Conditional Random Fields (CRFs) with uncertainty evaluation for integration.
Through extensive experiments conducted on four real-world datasets, we demonstrate the effectiveness of our model in addressing both partial and incorrect annotation errors. Remarkably, our model exhibits superb performance even in extreme scenarios with 90\% annotation noise.

Addressing NER Annotation Noises with Uncertainty-Guided Tree-Structured CRFs | VIDEO

Large language models (LLMs) have demonstrated their potential to refine their generation based on their own feedback. However, the feedback from LLM itself is often inaccurate, thereby limiting its benefits. In this paper, we propose Study Assistant for Large LAnguage Model (SALAM), a novel framework with an auxiliary agent to assist the main LLM in learning from mistakes through interactive cooperation. In the gathering phase, the student assistant agent probes the main LLM, analyzes its errors, and collects the interaction in a mistake memory. During the examination phase, the study assistant provides guidelines by retrieving relevant cases to help the main LLM anticipate and avoid similar errors. We first investigate the effectiveness of a general study assistant and then customize it to provide LLM-specific guidance through imitation learning from successful guidance experiences. Our experiments on three LLMs using two challenging frameworks demonstrate that SALAM can significantly boost LLMs by an accuracy margin of up to 6.6 on BBH and 12.6 on BBQ.

Learning from Mistakes via Cooperative Study Assistant for Large Language Models

Sentiment analysis on user reviews has achieved great success thanks to the rapid growth of deep learning techniques. The large number of online streaming reviews also provides the opportunity to model temporal dynamics for users and products on the timeline. However, existing methods model users and products in the real world based on a static assumption and neglect their time-varying characteristics. In this paper, we present DC-DGNN, a dual-channel framework based on a dynamic graph neural network (DGNN) that models temporal user and product dynamics for sentiment analysis. Specifically, a dual-channel text encoder is employed to extract current local and global contexts from review documents for users and products. Moreover, user review streams are integrated into the dynamic graph neural network by treating users and products as nodes and reviews as new edges. Node representations are dynamically updated along with the evolution of the dynamic graph and used for the final score prediction. Experimental results on five real-world datasets demonstrate the superiority of the proposed method.

Sentiment Analysis on Streaming User Reviews via Dual-Channel Dynamic Graph Neural Network

The cascaded approach continues to be the most popular choice for speech translation (ST). This approach consists of an automatic speech recognition (ASR) model and a machine translation (MT) model that are used in a pipeline to translate speech in one language to text in another language. MT models are often trained on the well-formed text and therefore lack robustness while translating noisy ASR outputs in the cascaded approach, degrading the overall translation quality significantly. We address this robustness problem in downstream MT models by forcing the MT encoder to bring the representations of a noisy input closer to its clean version in the semantic space. This is achieved by introducing a contrastive learning method that leverages adversarial examples in the form of ASR outputs paired with their corresponding human transcripts to optimize the network parameters. In addition, a curriculum learning strategy is then used to stabilize the training by alternating the standard MT log-likelihood loss and the contrastive losses. Our approach achieves significant gains of up to 3 BLEU scores in English-German and English-French speech translation without hurting the translation quality on clean text.

CLAD-ST: Contrastive Learning with Adversarial Data for Robust Speech Translation | VIDEO

Retrieval-Augmented Machine Translation (RAMT) is attracting growing attention. This is because RAMT not only improves translation metrics, but is also assumed to implement some form of domain adaptation. In this contribution, we study another salient trait of RAMT, its ability to make translation decisions more transparent by allowing users to go back to examples that contributed to these decisions.
For this, we propose a novel architecture aiming to increase this transparency. This model adapts a retrieval-augmented version of the Levenshtein Transformer and makes it amenable to simultaneously edit multiple fuzzy matches found in memory. We discuss how to perform training and inference in this model, based on multi-way alignment algorithms and imitation learning. Our experiments show that editing several examples positively impacts translation scores, notably increasing the number of target spans that are copied from existing instances.

Towards Example-Based NMT with Multi-Levenshtein Transformers

Selective rationalizations improve the explainability of neural networks by selecting a subsequence of the input (i.e., rationales) to explain the prediction results. Although existing methods have achieved promising results, they still suffer from adopting the spurious correlations in data (aka., shortcuts) to compose rationales and make predictions. Inspired by the causal theory, in this paper, we develop an interventional rationalization (Inter-RAT) to discover the causal rationales. Specifically, we first analyse the causalities among the input, rationales and results with a structural causal model. Then, we discover spurious correlations between the input and rationales, and between rationales and results, respectively, by identifying the confounder in the causalities. Next, based on the backdoor adjustment, we propose a causal intervention method to remove the spurious correlations between input and rationales. Further, we discuss reasons why spurious correlations between the selected rationales and results exist by analysing the limitations of the sparsity constraint in the rationalization, and employ the causal intervention method to remove these correlations. Extensive experimental results on three real-world datasets clearly validate the effectiveness of our proposed method. The source code of Inter-RAT is available at https://github.com/yuelinan/Codes-of-Inter-RAT.

Interventional Rationalization | VIDEO

Although In-Context Learning has proven effective across a broad array of tasks, its efﬁciency is noticeably inﬂuenced by the selection of demonstrations. Existing methods tend to select different demonstrations for each test instance, which is time-consuming and poses limitations in practical scenarios. Therefore, this study aims to address the challenge of selecting a representative subset of in-context demonstrations that can effectively prompt different test instances in a speciﬁc task. We propose that this representative subset should be of high quality and diversity. Our empirical analyses conﬁrm that demonstrations that meet these criteria can indeed bolster model performance. To satisfy these criteria, this paper further introduces a two-stage Determinantal Point Process (DPP) method designed to incorporate both quality and diversity in the process of demonstration selection, thereby obtaining representative in-context demonstrations. Through comprehensive experimentation, we have conﬁrmed the efﬁcacy of our proposed method, paving the way for more practical and effective In-Context Learning.

Downloads

Next from EMNLP 2023

Program Translation via Code Distillation

Similar lecture

New and Emerging Perspectives in the Anthropology of Mental Health I