GAIR-Lab - Research

LLM supporting knowledge tracing leveraging global subject and student specific knowledge graphs

Linqing Li, Zhifeng Wang, Joemon M. Jose, Xuri Ge

Information Fusion (Accepted for Publication) · 01 Feb 2026

Multimodal Representation Learning Techniques for Comprehensive Facial State Analysis

Kaiwen Zheng, Xuri Ge, Junchen Fu, Jun Peng, Joemon M. Jose

full research paper ICME25 · 07 Jul 2025

Beyond Accuracy: Decision Transformers for Reward-driven Multi-objective Recommendations

Jie Wang, Alexandros Karatzoglou, Ioannis Arapakis, Joemon M. Jose, Xuri Ge

full research paper TKDE25 · 30 Jun 2025

Frequency-Decoupled Distillation for Efficient Multimodal Recommendation

Ziyi Zhuang, Hongji Li, Junchen Fu, Jiacheng Liu, Joemon M. Jose, Youhua Li, Yongxin Ni

full research paper CIKM 2025 · 10 Nov 2025

A Comparative Study of Conversational and Conventional Search Methods for Image Retrieval

Anastasiia Potiagalova, Joemon M. Jose

IEEE CBMI 2025 · 22 Oct 2025

Unlocking 18th-and 19th-century Playbills with AI: An Experiment in Qualitative Data Categorization

Deven Parker, Kaiwen Zheng, Michael Gamer, Joemon M. Jose

regular research paper Umanistica Digitale · 21 Oct 2025

Beyond Clicks: Eye-Tracking Insights into User Responses to Different Recommendation Types

George Koutroumpas, Matteo Mazzini, Sebastian Idesis, Mireia Masias, Joemon M. Jose, Sergi Abadal, Ioannis Arapakis

RecSys 2025 · 22 Sep 2025

Efficient and Effective Adaptation of Multimodal Foundation Models in Sequential Recommendation

Junchen Fu, Xuri Ge, Xin Xin, Alexandros Karatzoglou, Ioannis Arapakis, Kaiwen Zheng, Yongxin Ni, Joemon M. Jose

regular research paper TKDE 2025 · 10 Sep 2025

An Instruction-Response Perspective on Large Language Models in Information Retrieval Tasks

Hideo Joho, Joemon M. Jose

SIGIR 2025 · 13 Jul 2025

Double-Filter: Efficient Fine-tuning of Pre-trained Vision-Language Models via Patch&Layer Filtering

Yaoqin He, Junchen Fu, Kaiwen Zheng, Songpei Xu, Fuhai Chen, Jie Li, Joemon M. Jose, Xuri Ge

full research paper ICML25 · 13 Jul 2025

PromptAug: Fine-grained Conflict Classification Using Data Augmentation

Oliver Warke, Joemon M. Jose, F. Hasibi, J. Breitsohl

arXiv preprint · 24 Jun 2025

Bridging the Gap: Teacher-Assisted Wasserstein Knowledge Distillation for Efficient Multi-Modal Recommendation

Ziyi Zhuang, Hanwen Du, Hui Han, Youhua Li, Junchen Fu, Joemon M. Jose, Yongxin Ni

Proceedings of the ACM on Web Conference 2025 · 28 Apr 2025

Enhancing Interpretability in Generative AI Through Search-Based Data Influence Analysis

Theodoros Aivalis, Iraklis A. Klampanos, Antonis Troumpoukis, Joemon M. Jose

Arxiv 2025 · 02 Apr 2025

Large Language Model driven Policy Exploration for Recommender Systems

Jie Wang, Alexandros Karatzoglou, Ioannis Arapakis, Joemon M. Jose

WSDM 2025 · 10 Mar 2025

LLMPopcorn: An empirical study of LLMs as assistants for popular micro-video generation

Junchen Fu, Xuri Ge, Kaiwen Zheng, Ioannis Arapakis, Xin Xin, Joemon M. Jose

arXiv preprint · 18 Feb 2025

Towards End-to-End Explainable Facial Action Unit Recognition via Vision-Language Joint Learning

Xuri Ge, Junchen Fu, Fuhai Chen, Shan An, Nicu Sebe, Joemon M. Jose

full research paper MM24 · 29 Oct 2024

Sparks of Surprise: Multi-objective Recommendations with Hierarchical Decision Transformers for Diversity, Novelty, and Serendipity

Jie Wang, Alexandros Karatzoglou, Ioannis Arapakis, Xin Xin, Xuri Ge, Joemon M. Jose

full research paper CIKM24 · 18 Jul 2024

Capturing the Spectrum of Social Media Conflict: A Novel Multi-objective Classification Model

Oliver Warke, Joemon M. Jose, Jan Breitsohl, Jie Wang

ICTIR’24 · 13 Jul 2024

Hire: Hybrid-Modal Interaction with Multiple Relational Enhancements for Image-Text Matching

Xuri Ge, Fuhai Chen, Songpei Xu, Fuxiang Tao, Jie Wang, Joemon M. Jose

ACM Transactions on Intelligent Systems and Technology · 05 Jun 2024

IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT

Junchen Fu, Xuri Ge, Xin Xin, Alexandros Karatzgolou, Ioannis Arapakis, Jie Wang, Joemon M. Jose

Accpeted by SIGIR2024 as a full paper · 02 Apr 2024

Reinforcement Learning-based Recommender Systems with Large Language Models for State Reward and Action Modeling

Jie Wang, Alexandros Karatzoglou, Ioannis Arapakis, Joemon M. Jose

Accpeted by SIGIR2024 as a full paper · 25 Mar 2024

CFIR: Fast and Effective Long-Text To Image Retrieval for Large Corpora

Zijun Long, Xuri Ge, Richard Mccreadie, Joemon M. Jose

Accpeted by SIGIR2024 as a full paper · 23 Mar 2024

3SHNet: Boosting image–sentence retrieval via visual semantic–spatial self-highlighting

Xuri Ge, Songpei Xu, Fuhai Chen, Jie Wang, Guoxin Wang, Shan An, Joemon M. Jose

Information Processing & Management (IP&M) · 22 Mar 2024

MGRR-Net: Multi-level Graph Relational Reasoning Network for Facial Action Unit Detection

Xuri Ge, Joemon M. Jose, Songpei Xu, Xiao Liu, Hu Han

ACM Transactions on Intelligent Systems and Technology (ACM TIST) · 21 Mar 2024

Empowering Legal Citation Recommendation via Efficient Instruction-Tuning of Pre-trained Language Models

Jie Wang, Kanha Bansal, Ioannis Arapakis, Xuri Ge, Joemon M. Jose

European Conference on Information Retrieval (ECIR) · 02 Mar 2024

ALGRNet: Multi-Relational Adaptive Facial Action Unit Modelling for Face Representation and Relevant Recognitions

Xuri Ge, Joemon M. Jose, Pengcheng Wang, Arunachalam Iyer, Xiao Liu, Hu Han

IEEE Transactions on Biometrics, Behavior, and Identity Science (T-BIOM) · 21 Aug 2023

Utilising Twitter Metadata for Hate Classification

Oliver Warke, Joemon M. Jose, Jan Breitsohl

European Conference on Information Retrieval (ECIR) · 27 Mar 2023

Cross-modal semantic enhanced interaction for image-sentence retrieval

Xuri Ge, Fuhai Chen, Songpei Xu, Fuxiang Tao, Joemon M. Jose

Proceedings of the IEEE/CVF winter conference on applications of computer vision (WACV) · 27 Feb 2023

Learning robust recommenders through cross-model agreement

Yu Wang, Xin Xin, Zaiqiang Meng, Joemon M. Jose, Fuli Feng, Xiangnan He

Proceedings of the ACM Web Conference 2022 · 11 Apr 2022

Supervised advantage actor-critic for recommender systems

Xin Xin, Alexandros Karatzoglou, Ioannis Arapakis, Joemon M. Jose

Proceedings of the Fifteenth ACM International Conference on Web Search and Data Mining (WSDM) · 11 Feb 2022

One person, one model, one world: Learning continual user representation without forgetting

Fajie Yuan, Guoxiao Zhang, Alexandros Karatzoglou, Joemon M. Jose, Beibei Kong, Yudong Li

Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval · 15 Jul 2021

Local global relational network for facial action units recognition

Xuri Ge, Pengcheng Wang, Hu Han, Joemon M. Jose, Zhilong Ji, Zhongqin Wu, Xiao Liu

IEEE International Conference on Automatic Face and Gesture Recognition (FG) · 15 Dec 2021

Structured multi-modal feature embedding and alignment for image-sentence retrieval

Xuri Ge, Fuhai Chen, Joemon M. Jose, Zhilong Ji, Zhongqin Wu, Xiao Liu

Proceedings of the 29th ACM International Conference on Multimedia (ACM MM) · 15 Oct 2021

Research

2026

2025

2024

2023

2022

2021

More