Jiangbo Lu

Jiangbo Lu is an Adjunct Senior Research Scientist with the Advanced Digital Sciences Center (ADSC). He also holds a joint appointment with the Coordinated Science Laboratory (CSL) of the University of Illinois. At ADSC, he is leading and working on a few use-inspired research projects that involve basic research, applied research, as well as commercialization of technology. He served and is serving as the PI and Co-PI for several research or technology commercialization projects. Some of his research work jointly with his colleagues and project students has led to a few Best Paper Awards (or nominations), as well as ICT awards, such as the AIT Best Paper Award in the IEEE ICCV 2009 Workshop on Embedded Computer Vision together with K. Zhang. Three of his technologies developed at ADSC have been licensed to a few Singaporean companies. In March 2012, the live video cutout project demoed on-stage at the inaugural DEMO Asia 2012 conference won him and his team a prestigious DEMOguru award, which was also nominated for a few awards later in TechVenture 2012. Two of his recent projects (Magic Touch and Social AR) have been covered by the largest newspapers based in Singapore. Before joining ADSC in September 2009 as the first technical staff, he had experience working with IMEC (Leuven), Microsoft Research Asia (Beijing), and VIA-S3 Graphics (Shanghai). He is an Associate Editor for IEEE Transactions on Circuits and Systems for Video Technology (T-CSVT). In this capacity, he received the 2012 TCSVT Best Associate Editor Award. He holds a few U.S. patents, international patents and trade secrets as the single inventor, and contributes to a few more. He is a Senior Member of IEEE.

Research Interests:

Computer vision, visual computing, image processing, video communication, interactive multimedia applications and systems, and efficient algorithms for various architectures

ADSC Project:

Education:

Ph.D. from the Department of Electrical Engineering, Katholieke Universiteit Leuven, Leuven, Belgium, Oct. 2004-Aug. 2009
M.S. from the Dept. of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, Sept. 2000-Mar. 2003
B.S. (honorable program) from the Dept. of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, Sept. 1996-June 2000

Experience:

Ph.D Researcher, Multimedia Group, IMEC, Leuven, Belgium, Oct. 2004-Aug. 2009
Research Intern, Media Communication Group, Microsoft Research Asia, Beijing, China, Oct. 2005-Jan. 2006
Architecture Design Engineer, Algorithm and Architecture Group, VIA-S3 Graphics, Shanghai, China, Apr. 2003-Aug. 2004
Research Intern, Internet Media Group, Microsoft Research Asia, Beijing, China, May 2002-Sept. 2002
Research Assistant, Dept. of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, Aug. 2001-Mar. 2003
Research Assistant, Dept. of Information Science and Electronic Engineering, Zhejiang University, Hangzhou, China, Sept. 1999-July 2001

Selected Recent Publications

Y. Li, R. T. Tan, X. Guo, J. Lu, and M. S. Brown, "Single Image Rain Streak Separation Using Layer Priors," IEEE Trans. on Image Processing (TIP), 2017.
K. Lin, N. Jiang, S. Liu, L.-F. Cheong, M. N. Do, and J. Lu, “Direct Photometric Alignment by Mesh Deformation,” IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, Jul. 2017.
K. R. Jerripothula, J. Cai, J. Lu, and J. Yuan, “Object Co-skeletonization with Co-segmentation,” in Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, Jul. 2017.
W.-Y. Lin, F. Wang, M. Cheng, S.-K. Yeung, P. Torr, M. N. Do, and J. Lu, “CODE: Coherence Based Decision Boundaries for Feature Correspondence,”IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016.
J. Lu, Y. Li, H. Yang, D. Min, W. Eng, and M. N. Do, “PatchMatch Filter: Edge-Aware Filtering Meets Randomized Search for Correspondence Field Estimation,” IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), 2016.
R. Pahwa, J. Lu, N. Jiang, T.-T. Ng, and M. N. Do, “Locating 3D Object Proposals: A Depth-Based Online Approach,” IEEE Trans. on Circuits and Systems for Video Technology (TCSVT), 2016.
Y. Zhang, L. Cheng, J. Wu, J. Cai, M. N. Do, and J. Lu, "Action Recognition in Still Images with Minimum Annotation Efforts," IEEE Trans. on Image Processing (TIP), vol. 25, no. 11, pp. 5479-5490, Nov. 2016.
Y. Li, D. Min, M. N. Do, and J. Lu, “Fast Guided Global Interpolation for Depth and Motion,” European Conf. Computer Vision (ECCV), Amsterdam, Netherlands, Oct. 2016. (Spotlight presentation)
W.-Y. Lin, S. Liu, N. Jiang, M. N. Do, P. Tan, and J. Lu, “RepMatch: Robust Feature Matching and Pose for Reconstructing Modern Cities,” European Conf. Computer Vision (ECCV), Amsterdam, Netherlands, Oct. 2016.
K. Lin, N. Jiang, L.-F. Cheong, M. N. Do, and J. Lu, “SEAGULL: Seam-Guided Local Alignment for Parallax-Tolerant Image Stitching,” European Conf. Computer Vision (ECCV), Amsterdam, Netherlands, Oct. 2016.
H. Zhu, J. Lu, J. Cai, J. Zheng, S. Lu, and N. Thalmann, "Multiple Human Identification and Cosegmentation: A Human-Oriented CRF Approach with Poselets," IEEE Trans. on Multimedia (TMM), vol. 18, no. 8, pp. 1516-1530, Aug. 2016.
Y. Li, R. Tan, X. Guo, J. Lu, and M. S. Brown, “Rain Streak Removal Using Layer Priors,” IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, Jun. 2016.
Y. Zhang, X. Wei, J. Wu, J. Cai, J. Lu, V. Nguyen, and M. N. Do, “Weakly Supervised Fine-Grained Categorization with Part-Based Image Representation,” IEEE Trans. on Image Processing (TIP), vol. 25, no. 4, pp. 1713-1725, Apr. 2016.
Y. Li, D. Min, M. S. Brown, M. N. Do, and J. Lu, “SPM-BP: Sped-up PatchMatch Belief Propagation for Continuous MRFs,” IEEE Int. Conf. Computer Vision (ICCV), Chile, Dec. 2015. (Oral presentation, acceptance rate ∼3.3%)
K. Wang, L. Lin, J. Lu, C. Li, and K. Shi, “PISA: Pixelwise Image Saliency by Aggregating Complementary Appearance Contrast Measures with Edge-Preserving Coherence,” IEEE Trans. on Image Processing (TIP), vol. 24, no. 10, pp. 3019-3033, Oct. 2015.
N.-J. Jiang, W.-Y. Lin, M. N. Do, and J. Lu, “Direct Structure Estimation for 3D Reconstruction,” IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Boston, MA, Jun. 2015.
V. Nguyen, J. Lu, S. Zhao, D. Vu, H. Yang, D. Jones, and M. N. Do, “ITEM: Immersive Telepresence for Entertainment and Meetings - A Practical Approach,” IEEE Journal on Selected Topics in Signal Processing (JSTSP), Special Issue on Interactive Media Processing for Immersive Communication, vol. 9, no. 3, pp. 546-561, Apr. 2015. (Featured in cover page)
D. Min, S. Choi, J. Lu, B. Ham, K. Sohn, and M. N. Do, “Fast Global Image Smoothing Based on Weighted Least Squares,” IEEE Trans. on Image Processing (TIP), vol. 23, no. 12, pp. 5638-5653, Dec. 2014. (Included in official OpenCV 3.1 release in Dec. 2015)
V. Nguyen, J. Lu, S. Zhao, D. Jones, and M. N. Do, “Tele-immersive Audio-Visual Communication Using Commodity Hardware,” IEEE Signal Processing Magazine (SPM), vol. 31, no. 6, pp. 118-136, Nov. 2014.
W.-Y. Lin, M. Cheng, J. Lu, H. Yang, M. N. Do, and P. H. S. Torr, “Bilateral Functions for Global Motion Modeling,” Eur. Conf. Computer Vision (ECCV), Zurich, Switzerland, Sep. 2014.
D. Vu, B. Chidester, H. Yang, M. N. Do, and J. Lu, “Efficient Hybrid Tree-Based Stereo Matching with Applications to Post-Capture Image Refocusing,” IEEE Trans. on Image Processing (TIP), vol. 23, no. 8, pp. 3428-3442, Aug. 2014.
H. Yang, W.-Y. Lin, and J. Lu, “DAISY Filter Flow: A Generalized Discrete Approach to Dense  Correspondences,” IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR),  Columbus, Ohio, Jun. 2014.
W.-Y. Lin, M. Cheng, K. Zheng, J. Lu, and C. Nigel, “Robust Non-parametric Data Fitting for  Correspondence Modeling,” IEEE Int. Conf. Computer Vision (ICCV), Sydney, Australia,  Dec. 2013.
D. Min, J. Lu, and M. N. Do, “Joint histogram based cost aggregation for stereo matching,” IEEE Trans. on Pattern Analysis and Machine Intelligence (TPAMI), vol. 35, no. 10, pp. 2539-2545, Oct. 2013.
J. Lu, H. Yang, D. Min, and M. N. Do, “PatchMatch Filter: Efficient Edge-Aware Filtering Meets  Randomized Search for Fast Correspondence Field Estimation,” IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Portland, Oregon, Jun. 2013. (Oral presentation, acceptance rate ~3.3%)
K. Shi, K. Wang, J. Lu, and L. Lin, “PISA: Pixelwise Image Saliency by Aggregating Complementary Appearance Contrast Measures with Spatial Priors”, IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Portland, Oregon, Jun. 2013.
J. Lu, K. Shi, D. Min, L. Lin, and Minh N. Do, “Cross-based local multipoint filtering”, IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Providence, Rhode Island, Jun. 2012.
V. Nguyen, J. Vu, H. Yang, J. Lu, and Minh N. Do, “ITEM: Immersive telepresence for entertainment  and meeting with commodity setup,” ACM Int. Conf. Multimedia (MM), Nara, Japan,  Oct. 2012.
D. Min, J. Lu, and M. N. Do, “Depth video enhancement based on joint global model filtering,” IEEE Trans. on Image Processing (TIP), vol. 21, no. 3, pp. 1176-1190, Mar. 2012.
D. Min, J. Lu, and M. N. Do, “A Revisit to Cost Aggregation in Stereo Matching: How Far Can  We Reduce Its Computational Redundancy?” IEEE Int. Conf. Computer Vision (ICCV), Barcelona,  Spain, Nov. 2011. (Oral presentation, acceptance rate ∼3.5%)
J. Lu, V. Nguyen, Z. Niu, B. Singh, Z. Luo, and Minh N. Do, “CuteChat: A Lightweight Tele-immersive  Video Chat System,” ACM Int. Conf. Multimedia (MM), Scottsdale, Arizona, Nov. 2011.

Recent Conference Tutorials

J. Lu, D. Min, and M. N. Do, “Discontinuities-Preserving Image and Motion Coherence: Computa- tional Models and Applications,” Half-day tutorial in IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), Shanghai, China, Mar. 2016.
D. Min, W.-Y. Lin, J. Lu, and M. N. Do, “Visual Correspondences: Taxonomy, Modern Approaches and Ubiquitous Applications,” Half-day tutorial in IEEE Int. Conf. Multimedia and Expo (ICME), Torino, Italy, Jun. 2015. (Tutorial site)
J. Lu, D. Min, and M. N. Do, “Image Filtering 2.0: Efficient Edge-Aware Filtering and Their Ap- plications,” Half-day tutorial in IEEE Int. Conf. Image Processing (ICIP), Melbourne, Australia, Sep. 2013. (Tutorial site)