CV

Education

B.S. in Electrical Engineering, National Tsing Hua University, 2017
Ph.D in Electrical Engineering, National Tsing Hua University, 2023

Work experience

May 2024 ‑ March 2025
- National Tsing‑Hua University, BIIC lab
- Postdoctoral Researcher
- Research topics include: Audio Signal Processing, Diffusion‑based emotional TTS for robust SER, LLM‑based SER
Aug. 2023 - Nov. 2023
- Amazon Web Service (AWS)
- Applied Scientist
- Audio Signal Processing and E2E ASR model development
- Fairness issue across accents: reduce a relative 3% WER gap between different accents in English of an E2E ASR model.
Jun. 2022 - Sep. 2022
- Disney Research (LA)
- Research Associate
- ASR Metric Understanding by Graph‑based Model Development.
- Designing the heuristic data collection process in website.
- Build a Graph‑based model to recognize the acoustic‑related metrics while considering the ambient sound condition.

Research Project experience

Jan. 2021 - present: Emotion AI
- National Tsing Hua University, BIIC lab
- Duties included: Chinese MSP-Podcast Database Collection (collaborate with U.S. MSP Lab, Dallas)
- Supervisor: Chi-Chun Lee, Carlos Busso
2020 - present: Cloud-based AI service
- National Tsing Hua University, BIIC lab
- Duties included: ASR model developer – Website of Emotion AI Life [Link]
- Supervisor: Chi-Chun Lee
2018: Emotion AI
- National Tsing Hua University, BIIC lab
- Duties included: Personalized Emotion Sensing through Conversation (FutureTech 2018, Taiwan) [Link]
- Supervisor: Chi-Chun Lee

Industry Project experience

March. 2019 - present: Research & Development
- E.SUN BANK (Taiwan)
- Duties included: Automated Video Interview, Speech to Text (STT), and Text to Speech (TTS) projects
- Supervisor: Chi-Chun Lee
Jan. 2020 - present: Research & Development
- Sin-Dong BIOTECH (Taiwan)
- Duties included: Agent and Customer Conversation Analysis for Call Center
- Supervisor: Chi-Chun Lee
Jan. 2020 - present: Research & Development
- Qualcomm (Taiwan)
- Duties included: Machine Learning on Edge Computing Platforms
- Supervisor: Chi-Chun Lee
Sep. 2017 - 2020: Research & Development
- Gamania (Taiwan)
- Duties included: Group Performance Prediction through Group Interaction & Personality for Human Resource (HR)
- Supervisor: Chi-Chun Lee

Skills

Deep Learning - Pytorch, Kaldi AST Tool, Espnet End2End ASR Tool, Keras, Tensorflow
Programing - Python, C/C++, Shell, Matlab
System-Related - Docker, GCP, AWS
Language - Native in Mandarin, Advanced in English

Publications

Bootstrapped Multi-View Weighted Kernel Fusion Framework for Cross-Corpus Integration of Multimodal Emotion Recognition

Chang, C. M., Su, B. H., Lin, S. C., Li, J. L., & Lee, C. C. (2017, October). "Bootstrapped Multi-View Weighted Kernel Fusion Framework for Cross-Corpus Integration of Multimodal Emotion Recognition." In 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 377-382). IEEE. 1(1).

Self-Assessed Affect Recognition Using Fusion of Attentional BLSTM and Static Acoustic Features

Su, B. H., Yeh, S. L., Ko, M. Y., Chen, H. Y., Zhong, S. C., Li, J. L., & Lee, C. C. (2018). "Self-Assessed Affect Recognition Using Fusion of Attentional BLSTM and Static Acoustic Features." In Interspeech (pp. 536-540). 1(1).

Using Attention Networks and Adversarial Augmentation for Styrian Dialect Continuous Sleepiness and Baby Sound Recognition

S.-L. Yeh, G.-Y. Chao, B.-H. Su, Y.-L. Huang, M.-H. Lin, C.-K. Lee, and C.-C. Lee (2019). "Using Attention Networks and Adversarial Augmentation for Styrian Dialect Continuous Sleepiness and Baby Sound Recognition." In Interspeech (pp. 2398-2402). 1(1).

Attentive Convolutional Recurrent Neural Network Using Phoneme-Level Acoustic Representation for Rare Sound Event Detection

Upadhyay, S. G., Su, B. H., & Lee, C. C. (2020). "Attentive Convolutional Recurrent Neural Network Using Phoneme-Level Acoustic Representation for Rare Sound Event Detection." In INTERSPEECH (pp. 3102-3106). 1(1).

Improving Speech Emotion Recognition Using Graph Attentive Bi-directional Gated Recurrent Unit Network

Su, B. H., Chang, C. M., Lin, Y. S., & Lee, C. C. (2020). "Improving Speech Emotion Recognition Using Graph Attentive Bi-directional Gated Recurrent Unit Network." In INTERSPEECH (pp. 506-510). 1(1).

Predicting Collaborative Task Performance using Graph Interlocutor Acoustic Network in Small Group Interaction

Zhong, S. C., Su, B. H., Huang, W., Liu, Y. C., & Lee, C. C. (2020). "Predicting Collaborative Task Performance using Graph Interlocutor Acoustic Network in Small Group Interaction." In INTERSPEECH (pp. 3122-3126). IEEE. 1(1).

A Conditional Cycle Emotion Gan for Cross Corpus Speech Emotion Recognition

Su, B. H., & Lee, C. C. (2021, January). "A Conditional Cycle Emotion Gan for Cross Corpus Speech Emotion Recognition." In 2021 IEEE Spoken Language Technology Workshop (SLT) (pp. 351-357). IEEE. 1(1).

An Attribute-Aligned Strategy for Learning Speech Representation

Huang, Y. L., Su, B. H., Hong, Y. W. P., & Lee, C. C. (2021). "An Attribute-Aligned Strategy for Learning Speech Representation." arXiv preprint arXiv:2106.02810. 1(1).

Deep Representation Learning for Affective Speech Signal Analysis and Processing: Preventing unwanted signal disparities

Lee, C. C., Sridhar, K., Li, J. L., Lin, W. C., Su, B. H., & Busso, C. (2021). "Deep Representation Learning for Affective Speech Signal Analysis and Processing: Preventing unwanted signal disparities." IEEE Signal Processing Magazine, 38(6), 22-38. 1(1).

SELF-SUPERVISED AUGMENTATION DEFENSE MODEL AGAINST ADVERSARIAL ATTACKS FOR SPEECH EMOTION RECOGNITION

Under Review." IEEE ICASSP2022.. 1(1).

Improving Induced Valence Recognition by Integrating Acoustic Sound Semantics in Movies