Skip to content

This organization hosts my PhD research projects on sarcasm and irony understanding in human-machine interaction.
My work investigates how computers can move beyond literal language processing to recognize intended meaning from context, prosody, multimodal signals, subjectivity, and cultural interpretation.
Xiyuan Gao · University of Groningen · 2021–2026


Research Areas

  • Multimodal computing
  • Computational pragmatics
  • Affective computing
  • Cross-lingual and multilingual transfer
  • Linguistically informed AI
  • Human-centered human--machine interaction

Start Here

  • For datasets: begin with MCSD 1.0
  • For speech-based sarcasm modeling: see Speech-based Sarcasm Detection
  • For multimodal text+audio modeling with synthesized data augmentation: see AMuSeD
  • For an end-to-end sarcasm recognition tool using acoustic, textual, emotional, and sentiment cues: see SarcEmotiq
  • For LLM/MLLM-based sarcasm understanding: see Multimodal LLM Sarcasm Understanding

Projects

🎥 MCSD 1.0 dataset

The first large-scale dataset for sarcasm detection in Mandarin Chinese, combining audio, text, and visual modalities. Built to push sarcasm research beyond English.

🔊 SarcEmotiq

Can a machine hear sarcasm? SarcEmotiq detects sarcasm in English audio by combining what is said, how it sounds, and how it feels. It works out of the box on MUStARD++ and supports retraining on your own data.

🇨🇳 Chinese Multimodal Sarcasm Detection

  • 🔗 Repo: coming soon
  • 🌐 Languages: Chinese

🌍 Multimodal LLM Sarcasm understanding

  • 🔗 Repo: coming soon
  • 🖼️ Slides: 'coming soon'
  • 🌐 Languages: Chinese, English

🎧 AMuSeD

Speech-based Sarcasm Detection

  • 🔗 Repo: coming soon
  • 🖼️ Paper: Interspeech 2022
  • 🌐 Languages: English

Contact

Pinned Loading

  1. MCSD MCSD Public

    4

  2. SarcEmotiq SarcEmotiq Public

    SarcEmotiq is a deep learning-based tool for recognizing sarcasm in English audio. It uses pre-trained models trained on open-sourced datasets MUStARD++ but also allows users to retrain the model w…

    HTML

Repositories

Showing 4 of 4 repositories

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Top languages

Loading…

Most used topics

Loading…