Dr Siyuan Chen

Dr Siyuan Chen

Senior Lecturer

Ph.D. - Electrical Engineering (UNSW)

M.E. - Microelectronics (RMIT)

Engineering
Electrical Engineering and Telecommunications

Dr Siyuan Chen is a researcher in the School of Electrical Engineering and Telecommunications at UNSW Sydney. She obtained her PhD degree in Electrical Engineering from UNSW Sydney, worked as a Research Intern at NII Tokyo, Research Fellow in the School of Computing and Information Systems at the University of Melbourne, Visiting Scientist at INRIA, France, then joined UNSW Electrical Engineering and Telecommunications as a Research Fellow. 

Her research lies at the intersection of artificial intelligence, machine learning, signal processing, affective computing and human-centred computing. She develops computational methods to understand human cognitive, emotional and behavioural states from multimodal physiological and behavioural signals, particularly eye activity, speech and head movement captured using wearable technologies.

Her long-term research vision is to develop multimodal wearable AI systems that can understand users continuously and unobtrusively in everyday environments, with applications in digital health, wellbeing and adaptive human–machine interaction. Her expertise spans machine learning, deep learning, computer vision, multimodal signal processing, wearable sensing and psychophysiology. Her research has attracted more than $1 million in competitive funding and has produced high-quality publications, patents and open research datasets.

Her current research expands these capabilities towards multimodal AI for digital health through interdisciplinary collaborations across Engineering, Psychology, Optometry and healthy ageing research. She welcomes students and collaborators interested in AI and machine learning, signal processing, affective computing, eye tracking, multimodal behavioural analysis, wearable sensing and digital health.

Location
Rm 447 Electrical Engineering Building (G17) UNSW, Kensington Campus
  • Journal articles | 2026
    Chen S; Epps J, 2026, 'The eyes show it: Exploring eye behavior and impact on human mental state during task interruption', International Journal of Human Computer Studies, 210, pp. 103772, http://dx.doi.org/10.1016/j.ijhcs.2026.103772
    Journal articles | 2025
    Chen S; Epps J, 2025, 'Eye Action Units as Combinations of Discrete Eye Behaviors for Wearable Mental State Analysis', IEEE Transactions on Affective Computing, 16, pp. 191 - 206, http://dx.doi.org/10.1109/TAFFC.2024.3422448
    Journal articles | 2023
    Chen S; Epps J; Paas F, 2023, 'Pupillometric and blink measures of diverse task loads: Implications for working memory models', British Journal of Educational Psychology, 93, pp. 318 - 338, http://dx.doi.org/10.1111/bjep.12577
    Journal articles | 2023
    Chen S; Epps J, 2023, 'A High-Quality Landmarked Infrared Eye Video Dataset (IREye4Task): Eye Behaviors, Insights and Benchmarks for Wearable Mental State Analysis', IEEE Transactions on Affective Computing, 14, pp. 3078 - 3093, http://dx.doi.org/10.1109/TAFFC.2023.3258915
    Journal articles | 2022
    Chen S; Cho Y; Yu K; Ferrari LM; Bremond F, 2022, 'Editorial: Recognizing the state of emotion, cognition and action from physiological and behavioral signals', Frontiers in Computer Science, 4, http://dx.doi.org/10.3389/fcomp.2022.998416
    Journal articles | 2021
    Chen S; Epps J, 2021, 'Task Load Estimation from Multimodal Head-Worn Sensors Using Event Sequence Features', IEEE Transactions on Affective Computing, 12, pp. 622 - 635, http://dx.doi.org/10.1109/TAFFC.2019.2956135
    Journal articles | 2020
    Chen S; Epps J, 2020, 'Multimodal Coordination Measures to Understand Users and Tasks', ACM Transactions on Computer Human Interaction, 27, pp. 1 - 26, http://dx.doi.org/10.1145/3412365
    Journal articles | 2020
    Li H; Epps J; Chen S, 2020, 'Think before you speak: An investigation of eye activity patterns during conversations using eyewear', International Journal of Human Computer Studies, 143, pp. 102468, http://dx.doi.org/10.1016/j.ijhcs.2020.102468
    Journal articles | 2020
    Wong HK; Epps J; Chen S, 2020, 'A comparison of methods for mitigating within-task luminance change for eyewear-based cognitive load measurement', IEEE Transactions on Cognitive and Developmental Systems, 12, pp. 681 - 694, http://dx.doi.org/10.1109/TCDS.2018.2876348
    Journal articles | 2019
    Chen S; Epps J, 2019, 'Atomic Head Movement Analysis for Wearable Four-Dimensional Task Load Recognition', IEEE Journal of Biomedical and Health Informatics, 23, pp. 2464 - 2474, http://dx.doi.org/10.1109/JBHI.2019.2893945
    Journal articles | 2019
    Chen S; Epps J, 2019, 'Eyelid and Pupil Landmark Detection and Blink Estimation Based on Deformable Shape Models for Near-Field Infrared Video', Frontiers in ICT, 6, pp. 18, http://dx.doi.org/10.3389/fict.2019.00018
    Journal articles | 2019
    Wong HK; Epps J; Chen S, 2019, 'Automatic Pupillary Light Reflex Detection in Eyewear Computing', IEEE Transactions on Cognitive and Developmental Systems, 11, pp. 560 - 572, http://dx.doi.org/10.1109/TCDS.2018.2880664
    Journal articles | 2018
    Epps J; Chen S, 2018, 'Automatic Task Analysis', IEEE Systems Man and Cybernetics Magazine, 4, pp. 15 - 20, http://dx.doi.org/10.1109/msmc.2018.2822846
    Journal articles | 2015
    Chen S; McKendrick AM; Turpin A, 2015, 'Choosing two points to add to the 24-2 pattern to better describe macular visual field damage due to glaucoma', British Journal of Ophthalmology, 99, pp. 1236 - 1239, http://dx.doi.org/10.1136/bjophthalmol-2014-306431
    Journal articles | 2015
    Turpin A; Chen S; Sepulveda JA; McKendrick AM, 2015, 'Customizing structure-function displacements in the macula for individual differences', Investigative Ophthalmology and Visual Science, 56, pp. 5984 - 5989, http://dx.doi.org/10.1167/iovs.15-17384
    Journal articles | 2014
    Chen S; Epps J, 2014, 'Efficient and robust pupil size and blink estimation from near-field video sequences for human-machine interaction', IEEE Transactions on Cybernetics, 44, pp. 2356 - 2367, http://dx.doi.org/10.1109/TCYB.2014.2306916
    Journal articles | 2014
    Chen S; Epps J, 2014, 'Using task-induced pupil diameter and blink rate to infer cognitive load', Human Computer Interaction, 29, pp. 390 - 413, http://dx.doi.org/10.1080/07370024.2014.892428
    Journal articles | 2013
    Chen S; Epps J, 2013, 'Automatic classification of eye activity for cognitive load measurement with emotion interference', Computer Methods and Programs in Biomedicine, 110, pp. 111 - 124, http://dx.doi.org/10.1016/j.cmpb.2012.10.021
    Journal articles | 2013
    Chen S; Epps J, 2013, 'Blinking: Toward wearable computing that understands your current task', IEEE Pervasive Computing, 12, pp. 56 - 65, http://dx.doi.org/10.1109/MPRV.2013.45
  • Conference Papers | 2025
    Chen S, 2025, 'What makes you say yes? An investigation of mental state and personality in persuasion during a dyadic conversation', in Icmi 2025 Proceedings of the 27th International Conference on Multimodal Interaction, Association for Computing Machinery (ACM), pp. 16 - 24, presented at Proceedings of the 27th International Conference on Multimodal Interaction, http://dx.doi.org/10.1145/3716553.3750788
    Conference Papers | 2024
    Li K; Zhang R; Chen B; Chen S; Yin S; Mahmud S; Liang Q; Guimbretière F; Zhang C, 2024, 'GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame', in ACM Mobicom 2024 Proceedings of the 30th International Conference on Mobile Computing and Networking, pp. 497 - 512, http://dx.doi.org/10.1145/3636534.3649376
    Conference Papers | 2024
    Li K; Zhang R; Chen S; Chen B; Sakashita M; Guimbretière F; Zhang C, 2024, 'EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses', in Conference on Human Factors in Computing Systems Proceedings, http://dx.doi.org/10.1145/3613904.3642613
    Conference Abstracts | 2024
    Moustafa RS; Chen S; Nakayama M; Shic F; Dunn MJ, 2024, 'A Brief Introduction to ISCET - The International Society for Clinical Eye Tracking', in Eye Tracking Research and Applications Symposium ETRA, Association for Computing Machinery (ACM), SCOTLAND, Glasgow, pp. 1 - 3, presented at Proceedings of the 2024 Symposium on Eye Tracking Research and Applications, SCOTLAND, Glasgow, 04 June 2024 - 07 June 2024, http://dx.doi.org/10.1145/3649902.3655659
    Conference Papers | 2024
    Moustafa RS; Chen S; Nakayama M; Shic F; Dunn MJ, 2024, 'Introducing ISCET - The International Society for Clinical Eye Tracking', in Eye Tracking Research and Applications Symposium ETRA, Association for Computing Machinery (ACM), SCOTLAND, Glasgow, pp. 1 - 4, presented at Proceedings of the 2024 Symposium on Eye Tracking Research and Applications, SCOTLAND, Glasgow, 04 June 2024 - 07 June 2024, http://dx.doi.org/10.1145/3649902.3656357
    Conference Papers | 2024
    Ouyang A; Chen S; Epps J, 2024, 'Evaluation of Event-Based and Timing Features from Head Movement and Eye Activity for Wearable Task Transition Detection', in 2024 International Conference on Activity and Behavior Computing Abc 2024, Institute of Electrical and Electronics Engineers (IEEE), JAPAN, pp. 1 - 10, presented at 2024 International Conference on Activity and Behavior Computing (ABC), JAPAN, 29 May 2024 - 31 May 2024, http://dx.doi.org/10.1109/ABC61795.2024.10651760
    Conference Papers | 2023
    Chen S; Epps J, 2023, 'Recognizing Conversational State from the Eye Using Wearable Eyewear', in 2023 11th International Conference on Affective Computing and Intelligent Interaction Acii 2023, Institute of Electrical and Electronics Engineers (IEEE), pp. 1 - 8, presented at 2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII), 10 September 2023 - 13 September 2023, http://dx.doi.org/10.1109/ACII59096.2023.10388081
    Conference Papers | 2021
    Chen S; Epps J, 2021, 'What Does the Eye Best Tell? An Investigation of Eye Activity for Emotion, Cognitive load and Task Transition Recognition', in Conference Proceedings IEEE International Conference on Systems Man and Cybernetics, Institute of Electrical and Electronics Engineers (IEEE), pp. 2258 - 2265, presented at 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 17 October 2021 - 20 October 2021, http://dx.doi.org/10.1109/SMC52423.2021.9659188
    Conference Papers | 2021
    Lam C; Epps J; Chen S, 2021, 'Wearable Fatigue Detection Based on Blink-Saccade Synchronisation', in Conference Proceedings IEEE International Conference on Systems Man and Cybernetics, Institute of Electrical and Electronics Engineers (IEEE), pp. 1186 - 1191, presented at 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 17 October 2021 - 20 October 2021, http://dx.doi.org/10.1109/SMC52423.2021.9659006
    Conference Papers | 2021
    Wang Z; Epps J; Chen S, 2021, 'An Investigation of Automatic Saccade and Fixation Detection from Wearable Infrared Cameras', in Conference Proceedings IEEE International Conference on Systems Man and Cybernetics, Institute of Electrical and Electronics Engineers (IEEE), pp. 2250 - 2257, presented at 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 17 October 2021 - 20 October 2021, http://dx.doi.org/10.1109/SMC52423.2021.9658954
    Conference Papers | 2020
    Chen S; Epps J, 2020, 'Multimodal Event-based Task Load Estimation from Wearables', in Proceedings of the International Joint Conference on Neural Networks, Institute of Electrical and Electronics Engineers (IEEE), pp. 1 - 9, presented at 2020 International Joint Conference on Neural Networks (IJCNN), 19 July 2020 - 24 July 2020, http://dx.doi.org/10.1109/IJCNN48605.2020.9206605
    Conference Papers | 2020
    Li H; Chen S; Epps J, 2020, 'Augmenting turn-taking prediction with wearable eye activity during conversation', in Proceedings of the Annual Conference of the International Speech Communication Association Interspeech, International Speech Communication Association, PEOPLES R CHINA, Shanghai, pp. 676 - 680, presented at Interspeech 2020, PEOPLES R CHINA, Shanghai, 25 October 2020 - 29 October 2020, http://dx.doi.org/10.21437/Interspeech.2020-3204
    Conference Papers | 2020
    Liu Z; Osei-Brefo E; Chen S; Liang H, 2020, 'UoR at SemEval-2020 Task 8: Gaussian Mixture Modelling (GMM) Based Sampling Approach for Multi-Modal Memotion Analysis', in 14th International Workshops on Semantic Evaluation Semeval 2020 Co Located 28th International Conference on Computational Linguistics Coling 2020 Proceedings, Association for Computational Linguistics (ACL), pp. 1201 - 1207, presented at Proceedings of the Fourteenth Workshop on Semantic Evaluation, - , http://dx.doi.org/10.18653/v1/2020.semeval-1.159
    Conference Papers | 2019
    Li H; Chen S; Epps J, 2019, 'Wearable Facial Action Unit Classification from Near-field Infrared Eye Images using Deformable Models', in 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos Aciiw 2019, Institute of Electrical and Electronics Engineers (IEEE), ENGLAND, Cambridge, pp. 343 - 349, presented at 2019 8th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), ENGLAND, Cambridge, 03 September 2019 - 06 September 2019, http://dx.doi.org/10.1109/ACIIW.2019.8925131
    Conference Papers | 2017
    Chen S; Epps J; Ambikairajah E; Le PN, 2017, 'An investigation of crowd speech for room occupancy estimation', in Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH, Stockholm, Sweden, pp. 324 - 328, presented at INTERSPEECH 2017, Stockholm, Sweden, 20 August 2017 - 24 August 2017, http://dx.doi.org/10.21437/Interspeech.2017-70
    Conference Papers | 2016
    Chen S; Bremond F; Nguyen H; Thomas H, 2016, 'Exploring depth information for head detection with depth images', in 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance Avss 2016, Institute of Electrical and Electronics Engineers (IEEE), pp. 228 - 234, presented at 2016 13th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), 23 August 2016 - 26 August 2016, http://dx.doi.org/10.1109/AVSS.2016.7738060
    Conference Papers | 2013
    Chen S; Epps J; Chen F, 2013, 'An investigation of pupil-based cognitive load measurement with low cost infrared webcam under light reflex interference', in Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society EMBS, Institute of Electrical and Electronics Engineers (IEEE), JAPAN, Osaka, pp. 3202 - 3205, presented at 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), JAPAN, Osaka, 03 July 2013 - 07 July 2013, http://dx.doi.org/10.1109/EMBC.2013.6610222
    Conference Papers | 2013
    Chen S; Epps JR; Chen F, 2013, 'Automatic and continuous user task analysis via eye activity', in International Conference on Intelligent User Interfaces, Proceedings IUI, Association for Computing Machinery (ACM), Santa Monica, CA, United states, pp. 57 - 66, presented at 18th International Conference on Intelligent User Interfaces, IUI 2013, Santa Monica, CA, United states, 19 March 2013 - 22 March 2013, http://dx.doi.org/10.1145/2449396.2449406
    Conference Papers | 2011
    Chen S; Epps JR; Chen F, 2011, 'A Comparison of Four Methods for Cognitive Load Measurement', in Proceeding OzCHI '11 Proceedings of the 23rd Australian Computer-Human Interaction Conference, ACM, New York, USA, pp. 76 - 79, presented at Proc. Aust. Int. Conf. on Computer-Human Interaction (Canberra, Australia), 2011., Canberra, Australia, 28 November 2011 - 02 December 2011, http://dx.doi.org/10.1145/2071536.2071547
    Conference Papers | 2011
    Chen S; Epps JR; Ruiz N; Chen F, 2011, 'Eye activity as a measure of human mental effort in HCI', in Proceedings of the 15th International Conference on Intelligent User Interfaces, IUI'11, Association for Computing Machinery, New York, NY, United States, pp. 315 - 318, presented at 2011 15th ACM International Conference on Intelligent User Interfaces, IUI'11, Palo Alto, CA, United States, 13 February 2011 - 16 February 2011, http://dx.doi.org/10.1145/1943403.1943454
    Conference Papers | 2011
    Xu J; Li G; Wang Y; Chen S; Chen F; Hussain S; Ho C, 2011, 'Pupillary response based cognitive workload index under luminance and emotional changes', in Conference on Human Factors in Computing Systems - Proceedings, ACM, New York, NY, USA, pp. 1627 - 1632, presented at 29th Annual CHI Conference on Human Factors in Computing Systems, Vancouver, BC, 07 May 2011 - 12 May 2011, http://dx.doi.org/10.1145/1979742.1979819
    Preprints |
    Mulvey FB; Amiebenomo OM-A; Atan D; Chen S; Douglass A; Dunn MJ; Goldstone D; Moustafa RS; Shic F; Arblaster G, A survey and review of eye-tracking in clinical practice, http://dx.doi.org/10.64898/2026.09.07.26361936

$365K National Intelligence Post-Doctoral Grant (NIPG) Fellowship, 2024

$711K of US Army for the research on wearable multimodal behavioural signal modelling for longitudinal automatic task performing as joint CI, 2019

$23K Australia Endeavor Fellowship, 2015

2015, Australia Endeavor Fellowship

2013, NII Internship program, NII Tokyo

2012, The Commercialization Training Scheme Scholarship, UNSW

2011, The NICTA Postgraduate Award Scholarship

2011, The NICTA Research Project Award Scholarship, NICTA 

My research focuses on developing AI and machine learning methods for understanding human cognitive, emotional and behavioural states from multimodal physiological and behavioural signals.

I have particular expertise in eye behaviour computing, where I develop computer vision, signal processing and machine learning approaches to extract and model information from eye activity captured by head-mounted devices.

My research extends to multimodal AI, integrating eye activity with speech, head movement and other sensing modalities to develop more robust and interpretable representations of human states and performance.

Current research is expanding towards multimodal wearable AI for digital health, including the identification of behavioural and physiological markers associated with cognitive functioning, ageing and mental health, through interdisciplinary collaborations across Engineering, Psychology, Optometry and healthy ageing research. My long-term goal is to develop intelligent wearable and adaptive systems that can continuously and unobtrusively understand users in everyday environments, enabling applications in health monitoring, wellbeing and adaptive human–machine interaction. 

Research interests: Artificial Intelligence and Machine Learning · Signal Processing · Multimodal AI · Affective Computing · Eye Tracking and Eye Behaviour Computing · Computer Vision · Wearable Sensing · Human-Centred Computing · Psychophysiology · Digital health · AI in clinical applications 

My engagement activities focus on building interdisciplinary and international research communities, translating research into practice, supporting colleagues and students, and promoting broader participation in engineering. I actively collaborate with researchers, clinicians and industry partners across Engineering, Psychology, Optometry and health-related disciplines, as well as with international research organisations, to connect advances in artificial intelligence and wearable sensing with real-world needs and applications. 

I contribute actively to the international research community. I have served on the committee of the International Society of Clinical Eye Tracking (ISCET), contributed to major international conferences, including serving as Publication Co-Chair for INTERSPEECH 2026 and Social Media Co-Chair for ICMI 2026, and have organised invited tutorials and a journal special issue in my research field. 

Research translation and external engagement are also important components of my work. I have engaged with industry partners to explore the translation of AI and behavioural sensing research into healthcare applications, contributed to patent development and commercialisation activities. These experiences help connect fundamental research with practical needs and create opportunities for interdisciplinary and industry collaboration. 

I welcome opportunities to connect with researchers, clinicians, industry partners and other organisations interested in AI, multimodal sensing, wearable technologies and digital health. Please feel free to contact me to discuss potential research collaborations, interdisciplinary projects, research translation or other opportunities.

My Teaching

My teaching philosophy is centred on engaging, challenging and inspiring students to become independent learners and capable engineers. I believe students learn most effectively when they actively apply theoretical knowledge to authentic engineering problems, critically evaluate existing solutions, collaborate with others, and develop their own ideas. My role as an educator is therefore not only to explain technical concepts, but also to create an environment in which students are encouraged to question, explore, experiment and learn from both successes and failures. 

I teach across undergraduate and postgraduate Electrical Engineering programs, with experience in circuits and signals, signal processing, engineering design, capstone projects, and engineering ethics. My teaching connects engineering fundamentals with contemporary technologies and real-world applications. In project-based courses, I encourage students to investigate emerging methods, including machine learning and computer vision, and to develop solutions to open-ended engineering problems through independent learning, teamwork and critical analysis. 

Ultimately, I aim to help students develop the curiosity, confidence, critical thinking and lifelong learning skills needed to address complex engineering challenges and adapt to a rapidly changing technological landscape.

Lectured and tutored courses:

-First year: Engineering Design and Innovation course (ENGG1000) and Electrical Engineering course (ELEC1111)

-Second year: Circuits and Signals course (ELEC2134) and Modelling and Simulation course (ELEC2146)

-Third year: Signal Processing course (ELEC3104)

-Fourth year: Strategic Leadership and Ethics course (ELEC4622)

-Postgraduate: Electrical Engineering Capstone Course (ELEC9773) and Strategic Leadership and Ethics course (GSOE9510)