Dr. Janet Hui-wen HSIAO
Head and Associate Professor
Phone: (852) 3917-4874
HKU Researcher Page:
B.Sc. (Computer Science), 1999, National Taiwan University
M.Sc. (Computing Science), 2002, Simon Fraser University
Ph.D. (Cognitive Science), 2006, University of Edinburgh
Postdoctoral researcher, 2005-2008, University of California San Diego
My research interests are in learning and visual cognition. I investigate universal principles and specific factors that modulate development of perceptual representations and information processing strategies during learning and expertise acquisition such as face recognition, reading, and object detection and identification. I adopt an interdisciplinary approach, using a variety of methods and techniques from artificial intelligence, experimental psychology, psycholinguistics, and cognitive neuroscience to study the mind at different levels of analysis and organisation.
I am an elected Fellow of the Cognitive Science Society and currently serve on the Governing Board of the Society. I am also currently Editor-in-Chief of British Journal of Psychology and an Associate Editor of Cognition.
Hsiao, J. H.*, An, J., Hui, V. K. S., Zheng, Y., & Chan, A. B. (in press). Understanding the role of eye movement consistency in face recognition and autism through integrating deep neural networks and hidden Markov models. npj Science of Learning.
Zheng, Y. & Hsiao, J. H.* (in press). Differential audiovisual information processing in emotion recognition: An eye-tracking study. Emotion.
Zheng, Y., Ye, X., & Hsiao, J. H.* (2022). Does adding video and subtitles to an audio lesson facilitate its comprehension? Learning & Instruction, 77, 101542. https://doi.org/10.1016/j.learninstruc.2021.101542
Lan, H., Liu, Z., Hsiao, J. H., Yu, D., & Chan, A. B.* (in press). Clustering Hidden Markov Models with Variational Bayesian Hierarchical EM. IEEE Transactions on Neural Networks and Learning Systems. https://doi.org/10.1109/TNNLS.2021.3105570
Hsiao, J. H.*, Lan, H., Zheng, Y., & Chan, A. B.* (2021). Eye Movement analysis with Hidden Markov Models (EMHMM) with co-clustering. Behavior Research Methods, 53, 2473–2486. https://doi.org/10.3758/s13428-021-01541-5
Liu, Z., Yu, L., Hsiao, J. H., & Chan, A. B.* (2022). PRIMAL-GMM: PaRametrIc MAnifold Learning of Gaussian Mixture Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6), 3197-3211. https://doi.org/10.1109/TPAMI.2020.3048727
An, J., & Hsiao, J. H.* (2021). Modulation of mood on eye movement pattern and performance in face recognition. Emotion, 21(3), 617-630.
Chuk, T., Chan, A. B.*, Shimojo, S., & Hsiao, J. H.* (2020). Eye movement analysis with switching hidden Markov models. Behavior Research Methods, 52(3), 1026-1043. https://doi.org/10.3758/s13428-019-01298-y
Coutrot, A.*, Hsiao, J. H., & Chan, A. B. (2018). Scanpath modeling and classification with Hidden Markov Models. Behavior Research Methods, 50(1), 362-379. https://doi.org/10.3758/s13428-017-0876-8
Tso, R. V. Y.*, Au, T. K., & Hsiao, J. H. (2014). Perceptual expertise: Can sensorimotor experience change holistic processing and left side bias? Psychological Science, 25(9), 1757-1767. https://doi.org/10.1177/0956797614541284
Lam, S. M., & Hsiao, J. H.* (2014). Bilingual experience modulates hemispheric lateralization in visual word processing. Bilingualism: Language and Cognition, 17(30), 589-609. https://doi.org/10.1017/S1366728913000734
Hsiao, J. H.*, & Cottrell, G. W. (2009). Not all expertise is holistic, but it may be leftist: The case of Chinese character recognition. Psychological Science, 20(4), 455-463. https://doi.org/10.1111/j.1467-9280.2009.02315.x
Hsiao, J. H.*, & Cottrell, G. W. (2008). Two fixations suffice in face recognition. Psychological Science, 9(10), 998-1006. https://doi.org/10.1111/j.1467-9280.2008.02191.x
Attention Brain& Cognition Lab (Room 691)
In my lab we study the relationship between brain structure and cognitive processes, using a variety of approaches including computational modeling and cognitive neuroscience (with behavioral, eye movement, and EEG/ERP measures). Current focuses of the lab research include understanding eye movement behavior and underlying cognitive processes through hidden Markov modeling, how different learning experiences influence perceptual expertise acquisition, and how different expertise domains influence each other.
RESEARCH INTERNSHIP OPPORTUNITIES
– Project Title: “Simultaneous EEG & Eye movement recording”
We will conduct simultaneous EEG and eye movement recording studies and relevant data analysis. We will apply this methodology to understand neural mechanisms underlying eye movements in face and facial expression recognition.
Good communication skills in English/Cantonese; experience in conducting psychological experiments; good grades in cognitive science, cognitive psychology, and research method related courses. Preference will be given to those with EEG or eye tracking experiences, or computational background/programming experience in Matlab.
– Project Title: “Evaluating explainable AI methods”
We will conduct user studies to evaluate explainable AI methods (in collaboration with Huawei Research Hong Kong)
Good communication skills in English/Mandarin; experience in conducting psychological experiments; good grades in cognitive science, cognitive psychology, and research method related courses. Preference will be given to those with eye tracking experiences or computational background/programming experience.
– Project Title: “Eye Movement analysis with Hidden Markov Models (EMHMM)”
We will conduct eye tracking studies and analyse eye movement data using the EMHMM methodology, a machine learning based approach for eye movement data analysis (http://visal.cs.cityu.edu.hk/research/emhmm/). We will apply EMHMM to understand eye movement patterns in research on reading and mental health disorders.
Good communication skills in English/Cantonese; experience in conducting psychological experiments; good grades in cognitive science, cognitive psychology, and research method related courses. Preference will be given to those with eye tracking experiences, or computational background/programming experience in Matlab.