Find Us On:

Twitter
Facebook
RSS
YouTube
Linked In

 

Join Our Mailing List

 

We won't spam you or ever share your information.

Shengkui Zhao

Shengkui Zhao
Shengkui Zhao
Research Scientist
 

Shengkui Zhao is a research scientist at ADSC. He received his B.Eng. (Honors) degree and Ph.D. degree both from the School of Computer Engineering, Nanyang Technological University (NTU) Singapore in 2004 and 2009, respectively. From July 2004 to March 2005, he worked as a software developer at Radix Pte Ltd, Singapore. From November 2008 to October 2010, he worked as a project officer and then a research fellow in the School of Computer Engineering at NTU, Singapore. Since November 2010, he has been working with ADSC as a post-doctoral follow and then a research scientist.

Research Interests: 3D audio & 3D sound recording and reproduction, sound source localization and direction finding, noise cancellation and speech enhancement, acoustic event detection & classification & analysis, microphone array signal processing.

ADSC Project:

Industrial Project:

  • SSIPO Safe City Test Bed: Acoustic Fighting Incident Detection System
  • Abating Track Noise Through a Holistic Approach of Noise Monitoring, Analytics and Control (MAC)

Education:

  • April 2005 - Nov. 2008: Ph.D., School of Computer Engineering, Nanyang Technological University (NTU), Singapore.
  • July 2000 - May 2004: B.Eng. (First-Class Honors), School of Computer Engineering, Nanyang Technological University (NTU), Singapore.
  • Dec. 1999 - June 2000: Pre-college English course, National Institute of Education (NIE), Singapore.

Work Experience:

  • Nov. 2013 – Present: Research scientist, ADSC of the University of Illinois at Urbana-Champaign, Singapore.
  • Nov. 2010 - Oct. 2013: Post-doctoral Fellowship, ADSC of the University of Illinois at Urbana-Champaign, Singapore.
  • Nov. 2009 - Oct. 2010: Post-doctoral Research Fellow, Emerging Research Lab, Nanyang Technological University (NTU), Singapore.
  • Dec. 2008 - Oct. 2009: Project officer, Emerging Research Lab, Nanyang Technological University (NTU), Singapore.
  • Apr. 2005 - Nov. 2008: Part-time lab supervisor for Data Structure and Object-oriented Programming and Digital Systems in NTU.
  • July 2004 - Mar. 2005: Software developer, Radixs Pte. Ltd., Singapore.

Project Experience:

  • Ph.D. Research, Topic: Performance Analysis and Enhancements of Adaptive Algorithms and Their Applications
    • Problem: Adaptive filters are widely used in the fields of communications, radar, sonar, seismology, navigation systems, and biomedical engineering. The adaptive algorithms, e.g., the least mean squares (LMS) algorithm and the recursive least square (RLS) algorithm, deal with adaptation of adaptive filters. The adaptive algorithms are expected to be computationally simple, numerically robust, fast convergent, and low fluctuant. Unfortunately, none of the adaptive algorithms developed so far perfectly fulfils these requirements. The stability and convergence performance of the widely used adaptive algorithms also haven't been fully explored.
    • Approach: Under supervision of Prof Man Zhihong and Prof Cai Jianfei, Zhao focused on the performance analysis and enhancements for the adaptive algorithms, which include the stability and convergence performance analysis for the transform-domain LMS algorithms with second-order Autoregressive process, the design of variable step-size schemes for the LMS and normalized LMS algorithms, and the design of data windowing schemes for the conjugate gradient (CG) adaptive algorithms. Based on the new developments and analysis for the adaptive algorithms, many applications, such as system identification, adaptive noise cancellation, and channel equalization, were studied.
  • Project #1: This project was about the development of the "Who Spoke When" Diarization System with the Institute for Infocomm Research (I2R) for the NIST Rich Transcription 2009 (RT-09) evaluation task. The objectives were to reduce the diarization error rate based on multiple microphone recorded speeches and to increase the accuracy of the Speech-To-Text (STT) transcription. (In the RT-09 evaluation task, our submitted systems were proved to give the best performance among all the competitors). Under supervision of Prof Chng Eng Siong, Zhao worked on classification of the speakers’ speeches by computing the direction of arrival (DOA) of the speakers using microphone array signal processing approach.
  • Project #2: In this project, a smart robot (Olivia 2.1) capable of interacting and communicating with visitors was developed in the Social Robotics Laboratory of the Institute for Infocomm Research (I2R). The objective was to design a smart robot to function as reception personnel. Under supervision of Prof Chng Eng Siong, Zhao worked on the following tasks: localizing speakers based on their voices using a multiple-microphone array and enhancing the speech signals coming from the front direction by attenuating interference and noise from other directions. The techniques that were applied include time-delay estimation for microphone array, noise power estimation and reduction, adaptive beamforming for speech enhancement. A real-time speaker localization system with high accuracy was successfully applied to Olivia 2.1.
  • Project #3: The objective of the Realistic Audio Telepresence for Entertainment and Meetings (RATEM) research project with ADSC is to develop realistic audio technologies for low-cost, high-quality and real-time Audio-Visual (AV) telepresence. Under supervision of Prof Douglas Jones, Zhao worked on 3D audio direction finding, speech enhancement and 3D audio reproduction. Several research findings with Acoustic Vector Sensor (AVS) array and MEMS array were obtained and three prototyped demonstrating systems for real-time 3D audio direction finding, real-time speech enhancement and real-time 3D audio recording and reproduction were developed.
  • Project #4: The objective of SSIPO Safe City Test Bed project is to evaluate research solutions for safe city concept in Singapore. ADSC audio team was collaborated with NEC and ZWEEC for developing and evaluating an acoustic fighting incident detection system. Zhao supervised and worked on the system development.
  • Project #5: The objective of the Acoustic Analytics: Acoustic Event Detection, Classification and Analysis research project is to develop the key signal processing and analytical tools to extract timely, useful, and actionable information from real-world acoustic data on a large scale. Under supervision of Prof Douglas Jones, Zhao and ADSC audio team are working on the following major tasks: (1) Acoustic event detection, (2) Acoustic event classification, (3) Anomaly detection, (4) Acoustic energy-density mapping, (5) Real-time analytics, and (6) Sonification.
  • Project #6: Entitled Abating track noise through a holistic approach of noise monitoring, analytics and control (MAC) and funded by Land and Liveability National Innovation Challenge (L2 NIC). The objective is to combine different enabling technologies developed by ADSC, I2R, and NTU to continuously monitor, analyse, and perform active noise control on aircraft, rail, and road traffic noise affecting residential houses in Singapore in order to create a conducive and liveable residential environment. Zhao and the audio team of ADSC work on technologies for large scale noise monitoring and mapping.

Publications and Patents:

  • Journal Papers
    •   S. Zhao and D. L. Jones, Z. Man, and S. Khoo, “Frequency-domain beamformers using conjugate gradient techniques for speech enhancement,” Journal of Acoustical Society of America 136(3):1160, doi: 10.1121/1.4892780, Sep 2014.
    • V. Nguyen, J. Lu, S. Zhao, D. L. Jones, and M. N. Do “Tele-immersive audio-visual communication using commodity hardware,” IEEE Signal Processing Magazine, IEEE 31(6), pp. 118-136, Nov 2014.
    • V. Nguyen, J. Lu, S. Zhao, T. Vu, H. Yang, D. L. Jones, and M. N. Do, “ITEM: immersive telepresence for entertainment and meetings - A practical approach”, IEEE Journal of Selected Topics in Signal Processing, Issue 99, Dec 2014.
    • S Zhao, T Saluev, and D L. Jones, “Underdetermined direction of arrival estimation using acoustic vector sensor,” Elsevier Journal of Signal Processing, vol. 100, pp. 160-168, Jul 2014.
    • S Zhao, D L. Jones, S Khoo, and Z Man, “New variable step-sizes minimizing mean-square deviation for the LMS-type algorithms,” Circuits, Systems and Signal Processing, Feb 2014.
    • S Khoo, L Xie, S Zhao, and Z Man, “Multi-surface sliding control for fast finite-time leader-follower consensus with high order SISO uncertain nonlinear agents,” International Journal of Robust and Nonlineaer Control, online view in April 2013.
    • S. Khoo, S. Zhao, and Z. Man, "Adaptive Fast Finite-Time Multiple-Surface Sliding Control for a Class of Uncertain Nonlinear Systems," International Journal of Modelling, Identification and Control, vol. 16(4), pp. 392-400. Aug. 2012.
    • S. Zhao and D. L. Jones, "Enhanced Frequency-Domain Frost Algorithm Using Conjugate Gradient Techniques for Speech Enhancement," International Journal of Electronic Science and Technology, Special Issue on Signal and Image Processing, vol. 10(2), pp. 158-162. Jun. 2012.
    • S. Khoo, L. Xie, S. Zhao, and Z. Man, “Multi-Surface Sliding Control for Fast Finite-Time Leader-Follower Consensus,” submitted for publication.
    • S. Zhao, D. L. Jones, S. Khoo, and Z. Man, "New Variable Step-Size Minimizing Mean-Square Deviation for the LMS-Type Algorithms," submitted for publication.
    • S. Zhao, Z. Man, and S. Khoo, "A Generalized Data Windowing Scheme for Adaptive Conjugate Gradient Algorithms," Signal Processing, vol. 89(5), pp. 894-900, May 2009.
    • S. Zhao, Z. Man, S. Khoo, and H. R. Wu, "Stability and Convergence Analysis of Transform-Domain LMS Adaptive Filters with Second-order Autoregressive Process," IEEE Trans. on Signal Processing, vol. 57(1), pp. 119-130, Jan. 2009.
    • S. Zhao, Z. Man, S. Khoo, and H. R. Wu, "Variable Step-size LMS Algorithm with a Quotient Form," Signal Processing, vol. 89(1), pp. 67-76, Jan. 2009.
    • S. Khoo, Z. Man, and S. Zhao, "Comments on 'Adaptive Multiple-Surface Sliding Control for Non-autonomous Systems with Mismatched Uncertainties'," Automatica, 44(11), pp. 2995-2998, Nov. 2008.
  • Conference Papers
    • Shengkui Zhao, Nguyen Thi Ngoc Tho and Douglas L. Jones, “Large region acoustic source mapping using movable arrays,” the 40th IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP 2015), Brisbane, Australia, 19-24 April, 2015. (Accepted)
    • Xiong Xiao, Shengkui Zhao, Xionghu Zhong, Douglas L. Jones, Eng Siong Chng and Haizhou Li, “A learning-based approach to direction of arrival estimation in noisy and reverberant environments,” the 40th IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP 2015), Brisbane, Australia, 19-24 April, 2015. (Accepted)
    • Shengkui Zhao and Douglas L Jones, “A new auxiliary-vector algorithm with conjugate orthogonality for speech enhancement”, the 15th Annual Conference of the International Speech Communication Association, (Interspeech 2014), Singapore, 14-18 Sep 2014.
    • Xiao Xiong, Shengkui Zhao, Duc Hong Ha Nguyen, Xiong Hu Zhong, Douglas L. Jones, Eng Siong Chng, and Haizhou Li, “The NTU-ADSC systems for reverberation challenge 2014”, the REVERB Challenge Workshop 2014, Florence Italy, 11 May 2014.
    • Nguyen Thi Ngoc Tho, Shengkui Zhao, and Douglas L. Jones, “Robust DOA estimation of multiple speech sources,” Proceedings of the IEEE International Conference on Acoustic, Speech, and Signal Processing (ICASSP 2014), Florence Italy, 4-11 May 2014.
    • Shengkui Zhao and Douglas L. Jones, “Underdetermined 2D DOA estimation using Acoustic Vector Sensor,” the 9th IEEE Conference on Industrial Electronics and Applications (ICIEA’14), Huangzhou, China, 9-11 Jun 2014.
    • Viet-Anh Nguyen, Shengkui Zhao, Johan Vu, Deming Chen, and Douglas Jones “Spatialized Audio Multiparty Teleconferencing with Commodity Miniature Microphone Array,” the 21st ACM International Conference on Multimedia (ACM MM 2013), Barcelona, Catalunya, Spain, 21-25 Oct, 2013.
    • Shengkui Zhao and Douglas L. Jones, “A Variable step-size transform-domain LMS algorithm based on minimum mean-square deviation for autoregressive process,” the 8th IEEE Conference on Industrial Electronics and Applications (ICIEA 2013), Melbourne Australia, 19-21 Jun, 2013.
    • Shengkui Zhao and Douglas L. Jones, "A Fast-Converging Adaptive Frequency-Domain MVDR Beamformer for Speech Enhancement," Proceedings of the 13th Annual Conference of the International Speech Communications Association (InterSpeech’ 12), 9-13 Sep, 2012, Portland, Oregon, USA, to appear.
    • Shengkui Zhao, Ryan Rogowski, Reece Johnson, and Douglas L. Jones, "3D Binaural Audio Capture and Reproduction Using a Miniature Microphone Array," Proceedings of the 15th International Conference on Digital Audio Effects (DAFx’ 12), 17-21 Sep, 2012, York, UK, to appear.
    • Shengkui Zhao and Douglas L. Jones, "Enhanced Frequency-Domain Frost Algorithm Using Conjugate Gradient Techniques for Speech Enhancement," Proceedings of the 2nd International Conference on Signal, Image Processing and Applications (ICSIA '12), August 2012, Hong Kong, China, to appear.
    • Shengkui Zhao, Saima Ahmed, Yun Liang, Kyle Rupnow, Deming Chen, and Douglas L. Jones, "A Real-Time 3D Sound Localization System with Miniature Microphone Array for Virtual Reality," Proceedings of the 7th IEEE Conference on Industrial Electronics and Applications (ICIEA '12), July 2012, Singapore, to appear.
    • Yun Liang, Zheng Cui, Shengkui Zhao, Kyle Rupnow, Yihao Zhang, Douglas L. Jones, and Deming Chen, "Real-Time Implementation and Performance Optimization of 3D Sound Localization on GPUs," Proceedings of Design, Automation & Test in Europe (DATE '12), March 2012, Dresden, Germany.
    • Suiyang Khoo, Juliang Yin, Bin Wang, Shengkui Zhao and Zhihong Man, "Adaptive Data Based Neural Network Leader-Follower Control of Multi-Agent Networks," Proceedings of the 37th Annual Conference on IEEE Industrial Electronics Society (IECON'11), 2011, Piscataway, N.J.
    • Shengkui Zhao, Eng Siong Chng, Nguyen Trung Hieu, and Haizhou Li, "A Robust Real-time Sound Source Localization System for Olivia Robot," 2010 APSIPA Annual Summit and Conference, Dec. 2010, Singapore.
    • Shengkui Zhao, Jianfei Cai, and Zhihong Man, "Nonlinear Image Restoration Using Recurrent Radial Basis Function Network," 2010 IEEE International Symposium on Circuits and Systems, June 2010, Paris, France.
    • T Nguyen, H Sun, S Zhao, SZK Khine, HD Tran, TLN Ma, B Ma, ES Chng, H Li, “The IIR-NTU speaker diarization systems for RT 2009,” RT-09 evaluation task, 2009.
    • Shengkui Zhao, Zhihong Man, and Suiyang Khoo, "A Class of Modified Variable Step Size NLMS Algorithms for System Identification," 4th IEEE Conference on Industrial Electronics and Applications (ICIEA' 09), 2009, Xi'an, China.
    • Suiyang Khoo, Lihua Xie, Zhihong Man, and Shengkui Zhao, "Observer-based Robust Finite-time Cooperative Consensus Control for Multi-agent Networks," 4th IEEE Conference on Industrial Electronics and Applications (ICIEA' 09), 2009, Xi'an, China.
    • Shengkui Zhao, Zhihong Man, and Suiyang Khoo, "On Performance of Transform Domain Adaptive Filters with Markov-2 Inputs," Proceedings of IEEE 3rd International Conference on Industrial Electronics and Applications (ICIEA '08), June 2008, Singapore (selected as session chairs).
    • Suiyang Khoo, Zhihong Man, and Shengkui Zhao, "Adaptive Fast Finite Time Control of A Class of Nonlinear Uncertain Systems," Proceedings of IEEE 3rd International Conference on Industrial Electronics and Applications (ICIEA '08), June 2008, Singapore.
    • Suiyang Khoo, Zhihong Man, and Shengkui Zhao, "Terminal Sliding Mode Control for MIMO T-S Fuzzy Systems,"Proceedings of the 6th International Conference on Information, Communications, Signal Processing (ICICS '07), Dec. 2007, Singapore.
    • Suiyang Khoo, Zhihong Man, and Shengkui Zhao, "Adaptive Fuzzy Multi-surface Sliding Mode Control for a Class of Nonlinear Systems," Proceedings of the 2nd IEEE Conference on Industrial Electronics and Applications (ICIEA '07), pp. 2340-2345, May 2007, Harbin, China.
    • Shengkui Zhao, Zhihong Man, and Suiyang Khoo, "Conjugate Gradient Algorithm Design with RLS Normal Equation,"Proceedings of the 6th International Conference on Information, Communications, Signal Processing (ICICS '07), Dec. 2007, Singapore.
    • Shengkui Zhao, Zhihong Man, and Suiyang Khoo, "A Fast Variable Step-Size LMS Algorithm with System Identification," Proceedings of the 2nd IEEE International Conference on Industrial Electronics and Applications (ICIEA '07), pp. 2340-2345, May 2007, Harbin, China.
    • Shengkui Zhao, Zhihong Man, and Suiyang Khoo, "A New Variable Step-Size Transform Domain LMS Algorithm with System Identification," Proceedings of the IEEE International Conference on Control and Automation (ICCA '07), pp. 2721-2724, May 2007, Guangzhou, China.
    • Shengkui Zhao, Zhihong Man, and Suiyang Khoo, "Modified LMS and NLMS Algorithms with a New Variable Step Size," Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision (ICARV '06), Dec. 2006, Singapore.
    • Suiyang Khoo, Zhihong Man, and Shengkui Zhao, "Sliding Mode Control of Fuzzy Dynamic Systems," Proceedings of the 9th International Conference on Control, Automation, Robotics and Vision (ICARV '06), Dec. 2006, Singapore.
  • Presentations:
    • "Performance Analysis and Enhancements of Adaptive Algorithms and Their Applications,"
    • Ph.D. oral defense, Singapore, August 2009.
    • Job talk at ADSC/I2R, Singapore, July 2010.
    • "On Performance of Transform Domain Adaptive Filters with Markov-2 Inputs," IEEE ICIEA 2008, Singapore.
    • "Conjugate Gradient Algorithm Design with RLS Normal Equation," IEEE ICICS 2007, Singapore.
    • "A Fast Variable Step-Size LMS Algorithm with System Identification," IEEE ICIEA 2007, Harbin, China.
    • "A New Variable Step-Size Transform Domain LMS Algorithm with System Identification," IEEE ICCA 2007, Guangzhou, China.
    • "Modified LMS and NLMS Algorithms with a New Variable Step Size," IEEE ICARV 2006, Singapore.

Awards:

  • Undergraduate scholarship, Ministry of Education, Singapore, 2000-2004.
  • Graduate scholarship, NTU, Singapore, 2005-2009.