Global Site

Breadcrumb navigation

Our Researchers

September 3, 2024

Terumi Umematsu

Terumi Umematsu

Principal Researcher

Research area

  • Affective computing
  • Signal processing

Papers

Peer Reviewed International Conference Papers

  • Terumi Umematsu, Akito Tsugawa, Naoto Takenoshita, Tomohiko Sato, Soichiro Shimizu, "Correlation between Cognitive Function and Time-Series Variation in Eyelid Opening and Closing from Facial Videos during Neuropsychological Tests," Alzheimer's Association International Conference (AAIC), July 2024.
  • Terumi Umematsu, Masanori Tsujikawa, Kazuki Inagaki, Yuta Shimizu, Koyo Shibata, Kohei Hijikata, Hiroshi Nakano, and Takeshi Tanigawa, "Evaluation of Correlation between Psychomotor Vigilance Task Scores and Drowsiness Estimation Levels Obtained from Facial Videos," The 45 International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), July 2023.
  • Terumi Umematsu, Masanori Tsujikawa, Hideyuki Sawada, "Evaluation of Cognitive Test Results Using Concentration Estimation from Facial Videos," Asia-Pacific Signal and Information Processing Association Annual Summit and Conference(APSIPA), pp.261-266, November 2022.
  • Terumi Umematsu, Masanori Tsujikawa, Hideyuki Sawada, "Simultaneous Estimation of Drowsiness, Focus and Stress from Facial Videos Captured by Smartphones," The 43rd International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), October 2021.
  • Terumi Umematsu, Akane Sano, Sara Taylor, Masanori Tsujikawa, and Rosalind Picard, "Forecasting stress, mood, and health from daytime physiology in office workers and students,” Proceedings of the 42nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), p.5953-5957, July 2020.
  • Terumi Umematsu, Akane Sano., and Rosalind Picard, "Daytime Data and LSTM can Forecast Tomorrow's Stress, Health, and Happiness," Proceedings of the 41st International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), p. 2186-2190, July 2019.
  • Terumi Umematsu, Akane Sano, Sara Taylor, and Rosalind Picard, "Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks." IEEE International Conference on Biomedical and Health Informatics (BHI), pp. 1-4, May 2019. (BEST PAPER AWARD - 1st Prize)
  • Yoshiki Nakashima, Terumi Umematsu, Masanori Tsujikawa, and Yoshifumi Onishi, "An Effectiveness Comparison between the Use of Activity State Data and That of Activity Magnitude Data in Chronic Stress Recognition," Workshops of 8th Intl. Conference on Affective Computing & Intelligent Interaction (ACII 2019), pp. 239-243, September 2019.
  • Terumi Umematsu and Masanori Tsujikawa, "Head-Motion Robust Video-Based Heart Rate Estimation Using Facial Feature Point Fluctuations" Proceedings of the 40th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp. 5199-5202, July 2018.
  • Terumi Umematsu, Akane Sano, Sara Taylor and Rosalind Picard, "Improving Stress Forecasting using LSTM Neural Networks" The 40th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), July 2018.
  • Akane Sano, Sara Taylor, Natasha Jaques, Weixuan Chen, Daniel Lopez-Martinez, Ehimwenma Nosakhare, Ognjen Rudovic, Terumi Umematsu and Rosalind Picard, "Mood, Stress and Sleep Sensing with Wearable Sensors and Mobile Phone," The 40th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), July 2018.
  • Utkarsh Sharma, Terumi Umematsu, Masanori Tsujikawa and Yoshifumi Onishi,"Adaptive Heart Rate Estimation from Face Videos," The 40th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), July 2018.
  • Terumi Umematsu and Masanori Tsujikawa, "Heart rate estimation from facial videos based on ICA with reference," The 39th International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), July 2017.
  • Terumi Umematsu, Shuji Komeiji, Masanori Tsujikawa and Ryosuke Isotani, "Sudden-noise suppression with strike-portion detection based on phase linearity for speech recognition," Signal and Information Processing Association Annual Summit and Conference (APSIPA), pp. 1-4, December 2016.
  • Terumi Umematsu, Guillermo Enriquez, Tomomi Matsumoto, Mitsuharu Matsumoto and Shuji Hashimoto, "Monaural Blind Source Separation based on Frequency Spectrum Peak Shift and Power Fluctuation," 2013 RISP International Workshop on Nonlinear Circuits, Communications and Signal Processing (NCSP), pp. 528-531, March 2013.

Domestic Conferences Proceedings

  • Hideo Tsurushima, Yusuke Akamatsu, Terumi Umematsu, Hiroshi Imaoka, "Estimate changes in bosy fluids from facial images using AI processing," The 38th Annual Conference of the Japanese Society for Artificial Intelligence, pp.1-2, 2024. (in Japanese)
  • Terumi Umematsu, Akane Sano, Sara Taylor, Masanori Tsujikawa, and Rosalind Picard, "Forecasting stress, mood, and health from daytime physiology data in office workers and students,” Japanese Society for Medical and Biological Engineering Symposium 2020, September 2020. (in Japanese)
  • Terumi Umematsu, Akane Sano, Sara Taylor, and Rosalind Picard, "Improving Students' Daily Life Stress Forecasting using LSTM Neural Networks," the 2019 IEICE Society Conference, p.371, September 2019. (in Japanese)
  • Yoshiki Nakashima, Terumi Umematsu, Masanori Tsujikawa, and Yoshifumi Onishi, "An Effectiveness Comparison between the Use of Activity State Data and That of Activity Magnitude Data in Chronic Stress Recognition," the 2019 IEICE Society Conference, p.372, September 2019. (in Japanese)
  • Sharma Utkarsh, Terumi Umematsu, Masanori Tsujikawa, and Yoshifumi Onishi, "Adaptive Heart Rate Estimation from Face Videos," IEICE the Eighth Symposium on Biometrics, Recognition and Authentication, November 2018.
  • Terumi Umematsu and Masanori Tsujikawa，"High-accurate heart rate estimation from facial videos based on ICA-R," IEICE Technical .Rep., vol.117, no.47，pp.101-106, May 2017. (in Japanese)
  • Terumi Umematsu and Masanori Tsujikawa，"Verification of the effectiveness of "Power nap" in office work using biological information，" Human Interface Society Symposium 2016，pp.69-72，September 2016. (in Japanese)
  • Terumi Umematsu, Shuji Komeiji, Masanori Tsujikawa and Ryosuke Isotani，"Sudden Noise Suppression with Striking Part Detection Based on Phase Linearity and Its Evaluation in Keyword Spotting, " 30th SIP symposium, pp.103-104, November 2015. (in Japanese)
  • Terumi Umematsu, Shuji Komeiji, Masanori Tsujikawa and Ryosuke Isotani，"Sudden noise suppression with striking part detection based on phase linearity，" Acoustical society of Japan 2015 Autumn Meeting, pp.63-64, September 2015. (in Japanese)
  • Terumi Umematsu, Guillermo Enriquez, Tomomi Matsumoto, Mitsuharu Matsumoto and Shuji Hashimoto, "Monaural blind source separation based on the similarity of frequency spectrum peak shift and power fluctuation and its separation performance improvement," Acoustical society of Japan 2013 Spring Meeting, pp.721-724, March 2013.(in Japanese)
  • Terumi Umematsu, Tomomi Abe, Mitsuharu Matsumoto and Shuji Hashimoto, "Performance evaluation using correlation coefficient between sounds separated by a single-channel blind separation," Acoustical society of Japan 2012 Spring Meeting, pp.717-720, March 2012.(in Japanese)
  • Terumi Umematsu, Tomomi Abe, Mitsuharu Matsumoto and Shuji Hashimoto, "Performance evaluation of a single-channel blind separation based on peak tracking of frequency spectra," Acoustical society of Japan 2011 Autumn Meeting, pp.665-668, September 2011.(in Japanese)

Journals

  • Terumi Umematsu, Masanori Tsujikawa, Hideyuki Sawada, “Real-time Stress Estimation Using Contactless Heart Rate Measurement Robust to Facial Movements,” Information Processing Society of Japan(IPSJ) Journal, Vol.65, No.7, pp. 1150 – 1161, July 2024. (Specially Selected Paper) (in Japanese)
  • Terumi Umematsu, Hideyuki Sawada, “Evaluation of Correlation between Cognitive Task Scores and Mental State Changes under Uncontrolled Environment,” The Transaction of Human Interface Society, Vol.26, No.1, pp.159-168, February 2024. (in Japanese)
  • Yusuke Akamatsu, Terumi Umematsu, Hitoshi Imaoka, “CalibrationPhys: Self-supervised Video-based Heart and Respiratory Rate Measurements by Calibrating Between Multiple Cameras”, IEEE Journal of Biomedical and Health Informatics, pp. 1460 - 1471, December 2023.
  • Kei Shibuya, Terumi Umematsu, Keisuke Suzuki, Tasuku Kitade, and Masanori Tsujikawa, “Verification of the Stress Process: Stressor Leading Chronic Stress in Working Time,” The Transaction of Human Interface Society, Vol.24, No.4, pp.205-214, November 2022. (in Japanese)

Awards/Prizes

  • Information Processing Society of Japan(IPSJ) Journal, Specially Selected Paper, 2024.
  • IEEE-EMBS International Conference on Biomedical and Health Informatics 2019 Best Paper Award - 1st Prize, 2019.
  • 125th Memorial Scholarship, Waseda University, 2009-2013.
  • Okuma Memorial Scholarship, Waseda University, 2008.

Academic society, communicty, etc.

Conference Committee

Program Committee

  • UBICOMP workshop, 2018.

Session Chair

  • IEEE International Conference on Biomedical and Health Informatics (BHI), 2019.

Poster Co-chair

  • International Conference on Multimedia Information Processing and Retrieval (MIPR), 2021.

Committee Member

  • Institute of Electronics, Information and Communication Engineers(IEICE) Technical Group on Signal Processing, Committee Member, 2022-
  • IEEE Women in Engineering Tokyo/Shinetsu-Section, Committee Member, 2022 -
  • IEEE Women in Engineering Region10, Committee Member, 2023 - 2024.

Reviewers

  • UBICOMP workshop: MENTAL HEALTH : SENSING & INTERVENTION, 2018.
  • International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2019 - 2023.
  • IEEE International Conference on Biomedical and Health Informatics (BHI), 2019 - 2024.
  • IEEE International Workshop on Machine Learning for Signal Processing(MLSP), 2019 - 2023.
  • International Conference on Human System Interaction (HSI), 2020.
  • International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2020.
  • International Conference on Affective Computing & Intelligent Interaction (ACII), 2021.
  • Asia Pacific Signal and Information Processing Association(APSIPA) Annual Summit and Conference, 2023 - 2024.

Patents (Issued ones only)

  • WO2016/088369　INFORMATION PROCESSING DEVICE, CONDUCT EVALUATION METHOD, AND PROGRAM STORAGE MEDIUM
  • WO2016/203753　NOISE DETECTION DEVICE, NOISE SUPPRESSION DEVICE, NOISE DETECTION METHOD, NOISE SUPPRESSION METHOD, AND RECORDING MEDIUM
  • WO2018/016459　 MIND/BODY STATE MEASUREMENT DEVICE, MIND/BODY STATE MEASUREMENT METHOD, MIND/BODY STATE MEASUREMENT PROGRAM, AND STORAGE MEDIUM
  • WO2018/179150　HEART RATE ESTIMATION APPARATUS
  • WO2019/012597 IDENTIFICATION DEVICE, IDENTIFICATION METHOD, AND RECORDING MEDIUM WITH RECORDED IDENTIFICATION PROGRAM
  • WO2019/012598 IDENTIFICATION DEVICE, IDENTIFICATION METHOD, AND RECORDING MEDIUM WITH RECORDED IDENTIFICATION PROGRAM
  • WO2019/102535 PULSE WAVE DETECTION DEVICE, PULSE WAVE DETECTION METHOD, AND STORAGE MEDIUM
  • WO2019/102966 PULSE WAVE DETECTION DEVICE, PULSE WAVE DETECTION METHOD, AND STORAGE MEDIUM
  • WO2019/159352 PSYCHOSOMATIC STATE ESTIMATION DEVICE, PSYCHOSOMATIC STATE ESTIMATION METHOD, AND COMPUTER-READABLE RECORDING MEDIUM
  • WO2019/186955 BIOLOGICAL INFORMATION ESTIMATION DEVICE, BIOLOGICAL INFORMATION ESTIMATION METHOD, AND BIOLOGICAL INFORMATION ESTIMATION PROGRAM
  • WO2019/203106 PULSE RATE ESTIMATION APPARATUS, PULSE RATE ESTIMATION METHOD, AND COMPUTER-READABLE STORAGE MEDIUM
  • WO2021/161525 STRESS ESTIMATION DEVICE, STRESS ESTIMATION METHOD, AND COMPUTER-READABLE RECORDING MEDIUM
  • WO2021/199270 STRESS MANAGEMENT DEVICE, STRESS MANAGEMENT METHOD, AND COMPUTER-READABLE RECORDING MEDIUM
  • WO2021/199271 STRESS RELEASE DEGREE CALCULATION DEVICE, STRESS RELEASE DEGREE CALCULATION METHOD, AND COMPUTER-READABLE RECORDING MEDIUM
  • WO2021/199272 STRESS TOLERANCE CALCULATOR, STRESS TOLERANCE CALCULATING METHOD, AND COMPUTER-READABLE RECORDING MEDIUM
  • WO2021/255899 INFORMATION PROCESSING DEVICE, CONTROL METHOD, AND STORAGE MEDIUM
  • WO2022/034682 INFORMATION PROCESSING DEVICE, CONTROL METHOD, AND STORAGE MEDIUM
  • WO2022/038776 STRESS INFERENCE DEVICE, INFERENCE METHOD, PROGRAM, AND STORAGE MEDIUM
  • WO2022/208874 LEARNING DEVICE, STRESS ESTIMATION DEVICE, LEARNING METHOD, STRESS ESTIMATION METHOD, AND STORAGEMEDIUM
  • WO2022/249330 PRICE DETERMINATION DEVICE, PRICE DETERMINATION METHOD, AND STORAGE MEDIUM
  • WO2022/259464 INFORMATION PROCESSING DEVICE, CONTROL METHOD, AND STORAGE MEDIUM
  • WO2023/199422 INNER STATE INFERENCE DEVICE, INNER STATE INFERENCE METHOD, AND STORAGE MEDIUM
  • WO2023/199839 INTERNAL STATE ESTIMATION DEVICE, INTERNAL STATE ESTIMATION METHOD, AND STORAGE MEDIUM
  • WO2023/275975 COGNITIVE FUNCTION ESTIMATION DEVICE, COGNITIVE FUNCTION ESTIMATION METHOD, AND RECORDING MEDIUM
  • WO2024/116280 INFORMATION PROCESSING DEVICE, DETERMINATION METHOD, AND STORAGE MEDIUM

Lectures

Invited Talks

  • Terumi Umematsu, “Learnings and Insights from My Journey: Through My Experiences in Industry, Academia, and Research Society”, IEEE R10 SYWL Congress 2024, August 2024.
  • Terumi Umematsu, “[Invited Talk] Mental states estimation using physiological signals,” The Institute of Electronics, Information and Communication Engineers (IEICE) Technical Group on Signal Processing, August 2022.
  • Terumi Umematsu, Rosalind Picard, Szymon Fedor, “Improving Well-Being - Predicting Tomorrow's Stress, Health, and Happiness,” MIT Media Lab Summer Camp, June 2021.

Other Invited talks: 8 talks (in Japanese)

Academic Lecture

  • Tokyo Institute of Technology, "Advanced Communication System Engineering",2019 - 2024

Organizing Workshops

  • Masanori Tsujikawa, Tasuku Kitade, Kei Shibuya, Keisuke Suzuki, Yoshiki Nakashima, Terumi Umematsu, Azusa Frukawa, and Yoshifumi Onishi, “NEC’s Chronic Stress Estimation System for Corporate Health,” Workshop in IEEE Engineering in Medicine and Biology Society(EMBC) 2022, July 2022.
  • Terumi Umematsu, “Improving Your Employees' Wellbeing”, 2018 MIT Media Lab Member Event, Tokyo, Japan, December 2018.
  • Terumi Umematsu, "Workplace Interventions to Reduce Stress, and Improve Mood and Wellbeing”, MIT Media Lab Fall member meeting, Massachusetts Institute of Technology, USA, November 2018.

Poster presentations

  • “Improving Well-being Forecasting using LSTM Neural Networks”, MIT Media Lab Spring member meeting, Massachusetts Institute of Technology, USA, April 2019.
  • “Improving Daily Life Stress Forecasting Based on LSTM Neural Networks”, MIT Media Lab Fall member meeting, Massachusetts Institute of Technology, USA, November 2018.
  • “Improving Stress Forecasting using LSTM Neural Networks”, MIT Media Lab Spring member meeting, Massachusetts Institute of Technology, USA, May 2018.

Newspaper, magazine articles

Book chapter

  • “Non-Contact Vital Signs Monitoring―Applications for Innovative Health, Medical and Long-Term Care―,” CMC Publishing Co.,Ltd., p.134-143. (Published in May 2021)

Academic/professional career summary

March 2011
Bachelor of engineering, School of advanced science and engineering, Department of Applied Physics, Waseda University, Tokyo, Japan
March 2013
Master of engineering, Graduate School of advanced science and engineering, Department of Pure and Applied Physics, Waseda University, Tokyo, Japan
April 2013
Researcher at Central Research Laboratories, NEC Corporation, Kanagawa, Japan
October 2017 - April 2019
Visiting Researcher, MIT Media Lab, Cambridge MA, USA
April 2018 – March 2023
Senior Researcher at Biometrics Research Laboratories, NEC Corporation, Kanagawa, Japan
April 2023 – present
Principal Researcher at Biometrics Research Laboratories, NEC Corporation, Kanagawa, Japan

Go back to Researchers at NEC