Seminar

AI/ML Multimodal Methods for Video Data Analytics

SPEAKER

SPEAKER

Prof. Xueming LUO

Xueming Luo is the Charles Gilliland Distinguished Chair Professor of Marketing, Professor of Strategy, and Professor of MIS, and Founder/ Director of the Global Institute for Artificial Intelligence & Business Analytics in the Fox School of Business at Temple University.  Xueming’s research is quantitative in nature, and he is an interdisciplinary thought-leader in leveraging AI/ML algorithms, text/audio/image/video big data, econometrical methods, and field experiments to model, explain, and optimize digital marketing, customer analytics, mobile commerce, company strategies, platform economy, social media analytics, and social responsibility.  Within marketing, he has been ranked as top 9th worldwide (1st among all Chinese) regarding Author Productivity in the Premier Marketing Journals (JCR, JM, JMR, MKSC) during 2014-2023. Outside of marketing, his research has been featured by premier journals in Information Systems (ISR and MISQ), management, Strategy, and OM (MgSc, POM, SMJ, AMJ).    https://www.fox.temple.edu/directory/xueming-luo-tuf35198

 

ABSTRACT

Video data, comprising interdependent text, image, and audio modalities that collectively characterize the same source, offer a wealth of information for business researchers. However, the challenge is to how to comprehensively account for within- and between-modality interdependencies, when highlighting the vital role of both verbal and nonverbal cues embedded in video data. My talk tackles this challenge by automating video data analytics with advanced deep learning transformers, multimodal data fusion, and explainable Artificial Intelligence (XAI) methods. Through empirical demonstrations of measuring emotion dynamics in entrepreneur pitches and trustworthiness of sellers in live streaming commerce on Tik Tok, we underline the crucial role of interpersonal interactions in the success of startups and microenterprises. By bridging business research with cutting-edge computational AI/ML techniques, we provide practitioners with actionable strategies for enhancing communication effectiveness and fostering trust-based business relationships. We provide access to our data and algorithms to research that leverages video datasets in other contexts.

MODERATOR

Prof. Yipu DENG

Assistant Professor,
Innovation and Information Management,
HKU Business School

HIGHLIGHTS

Shopping Basket