Xiaojun Bi's Research Homepage

Xiaojun Bi

Associate Professor
Department of Computer Science
Stony Brook University

Email: xiaojun at cs.stonybrook.edu
Office: NCS 161
Phone: (631) 632-2506

News

2/2024: Received a $1.3 million NIH R01 grant as PI, to research intelligent writing systems on smartphones for blind users!

2/2024: Papers accepted to CHI 2024 and UbiComp/IMWUT 2024.

8/2023: One paper accepted to UIST 2023 and one to MobiCom 2023.

1/2023: Three papers accepted to CHI 2023.

08/2022: I have been officially promoted to associate professor with tenure. I am truly grateful for the continuous support from my family and collaborators, and would like to express great thanks to my hard-working students!

08/2022: Two papers accepted to UIST 2022.

02/2022: Two papers accepted to CHI'22 and one accepted to IUI'22. What a start for 2022!

06/2021: Won a regular NSF grant as PI. Thank you NSF!

06/2021: Three papers accepted to UIST 2021!

12/2020: One paper accepted to CHI 2021. Congratulations to Wenzhe for his third 1st-author CHI/UIST paper!

08/2020: Won a Best Paper Honorable Mention Award at UIST 2020.

07/2020: Recently received an NIH-R01 grant, an ALS grant, and an OVPR seed grant with my colleagues.

06/2020: Two papers accepted to UIST 2020.

12/2019: Received a Research Excellence Award in the department.

12/2019: Two papers accepted to CHI 2020.

8/2019: Our UIST'19 paper won a best paper award!

7/2019: Hosted the 5th Summer School on Computational Interaction with Brian Smith at Columbia University in July 2019.

12/2018: 6 papers accepted to CHI 2019; won a Best Paper Honorable Mention Award (top 5%)!

10/2018: Our ACM ISS'18 paper won a Best Paper Honorable Mention Award (top 5%)!

8/2018: Won a regular NSF grant as a sole PI. Thank you NSF!

6/2018: One paper accepted to UIST 2018; one accepted to ASSETS 2018.

2/21/2018: Won a Google Faculty Research Award (2018). Thanks Google!

1/2018: Three papers accepted to CHI 2018. One won a Best Paper Honorable Mention Award (top 5%)!

7/2017: One paper accepted to UIST 2017.

5/2017: I will serve on the CHI 2018 Program Committee in Dec. 2017.

2/18/2017: Our CHI 2017 paper "COMPASS" won a Best Paper Honorable Mention Award (top 5%)!

2/16/2017: Won a Google Faculty Research Award (2017). Thanks Google!

1/2017: Two papers accepted to CHI 2017.

1/23/2017: Officially started my appointment at Stony Brook University.

I am currently looking for highly motivated students to join my research lab.

| Brief Biography | Curriculum Vitae | Selected Awards and Honors | Publications | Patents | Students | Professional Services | Teaching |

Selected Awards and Honors

2011 CHI Best Paper Honorable Mention Award

2013 Google Influential Paper Award

2015 CHI Best Paper Honorable Mention Award

2017 CHI Best Paper Honorable Mention Award

2018 ISS Best Paper Honorable Mention Award

2018 CHI Best Paper Honorable Mention Award

2019 CHI Best Paper Honorable Mention Award

2019 UIST Best Paper Award

2020 UIST Best Paper Honorable Mention Award

2021 Chinese CHI Best Paper Honorable Mention Award

2023 CHI Best Paper Honorable Mention Award

2017 Google Faculty Research Award

2018 Google Faculty Research Award

2018 Outstanding Young Leader in HCI (ICACHI)

2019 Research Excellence Award in the Department of Computer Science

2023 Google Award for Inclusion Research

Selected Publications

Number of publications in top venues for Human Computer Interaction (up to 11/2024): CHI (35), UIST (16).
DBLP | Google Scholar

2024

UIST 2024

[60]. Dan Zhang, Zhi Li, Vikas Ashok, William H. Seiple, IV Ramakrishnan, Xiaojun Bi (2024), "Accessible Gesture Typing on Smartphones for People with Low Vision". In Proceedings of UIST 2024 - The ACM Symposium on User Interface Software and Technology. Article No.: 86. Pages 1-11. [Acceptance Rate: 22%]

UbiComp/IMWUT 2024

[59]. Kaiyan Ling, Hang Zhao, Xiangmin Fan, Xiaohui Niu, Wenchao Yin, Yue Liu, Cui Wang, Xiaojun Bi (2024) " Model Touch Pointing and Detect Parkinson's Disease via a Mobile Game ". In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT'24). Article No.: 74. Pages 1-24.

ASSETS 2024

[58]. Satwik Ram Kodandaram, Utku Uckun, Xiaojun Bi, IV Ramakrishnan, Vikas Ashok(2024) "Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models". In Proceedings of ASSETS 2024 - The 26th International ACM SIGACCESS Conference on Computers and Accessibility. Article No.: 73. Pages 1-14. [Acceptance Rate: 29.7%]

ASSETS 2024

[57]. Anujay Ghosh, Monalika Padma Reddy, Satwik Ram Kodandaram, Utku Uckun, Vikas Ashok, Xiaojun Bi , I. V. Ramakrishnan(2024) "Screen Reading Enabled by Large Language Models.". In Proceedings of ASSETS 2024 - The 26th International ACM SIGACCESS Conference on Computers and Accessibility. Article No.: 125. Pages 1-5. [Acceptance Rate: 29.7%]

CHI 2024

[56]. Prerna Khanna, IV Ramakrishnan, Shubham Jain, Xiaojun Bi, Aruna Balasubramanian (2024) " Hand Gesture Recognition for Blind Users by Tracking 3D Gesture Trajectory ". In Proceedings of CHI 2024 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 405. Pages 1-15. [Acceptance Rate: 26.4%]

2023

UIST 2023

[55]. Jeremy Chu, Yan Ma, Shumin Zhai, Xianfeng David Gu, Xiaojun Bi (2023) " TouchType-GAN: Modeling Touch Typing with Generative Adversarial Network ". In Proceedings of UIST 2023 - The ACM Symposium on User Interface Software and Technology. Article No.: 29. Pages 1-13 [Acceptance Rate: 25.05%]

Paper | Live demo of WordGesture-GAN and TouchType-GAN

MobiCom 2023

[54]. Prerna Khanna, Shirin Feiz, Jian Xu, IV Ramakrishnan, Shubham Jain, Xiaojun Bi, Aruna Balasubramanian. (2023) " AccessWear: Making Smartphone Applications Accessible to Blind Users ". In Proceedings of MobiCom'23 - the 29th Annual International Conference on Mobile Computing and Networking. Article No.: 32. Pages 1-16.

CHI 2023

[53]. Jeremy Chu, Dongsheng An, Yan Ma, Wenzhe Cui, Shumin Zhai, Xianfeng David Gu, Xiaojun Bi (2023) " WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial Network ". In Proceedings of CHI 2023 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 287. Pages 1-15. [Acceptance Rate: 28.4%]

Best Paper Honorable Mention Award | Paper | Live demo of WordGesture-GAN and TouchType-GAN

CHI 2023

[52]. Zhi Li, Yu-Jung Ko, Aini Putkonen, Shirin Feiz, Vikas Ashok, IV Ramakrishnan, Antti Oulasvirta, Xiaojun Bi (2023) " Modeling Touch-based Menu Selection for Blind Users ". In Proceedings of CHI 2023 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 357. Pages 1-18. [Acceptance Rate: 28.4%]

CHI 2023

[51]. Wenzhe Cui*, Rui Liu*, Zhi Li, Yifan Wang, Andrew Wang, Xia Zhao, Sina Rashidian, Furqan Baig, IV Ramakrishnan, Fusheng Wang, Xiaojun Bi (2023) "GlanceWriter: Writing Text by Glancing Over Letters with Gaze". In Proceedings of CHI 2023 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 719. Pages 1-13. *Co-First authors ordered alphabetically. [Acceptance Rate: 28.4%]

2022

UIST 2022

[50]. Hang Zhao, Sophia Gu, Chun Yu, Xiaojun Bi (2022), "Bayesian Hierarchical Pointing Models". In Proceedings of UIST 2022 - The ACM Symposium on User Interface Software and Technology. Article No.: 87. Pages 1-13. [Acceptance Rate: 26.3%]

UIST 2022

[49]. Zheer Xu, Yankang Meng, Xiaojun Bi, Xing-Dong Yang (2022), "Phrase-Gesture Typing on Smartphones". In Proceedings of UIST 2022 - The ACM Symposium on User Interface Software and Technology. Article No.: 55. Pages 1-11. [Acceptance Rate: 26.3%]

CHI 2022

[48]. Zhi Li, Maozheng Zhao, Dibyendu Das, Hang Zhao, Yan Ma, Wanyu Liu, Michel Beaudouin-Lafon, Fusheng Wang, IV Ramakrishnan Xiaojun Bi (2022) "Select or Suggest? Reinforcement Learning-based Method for High-Accuracy Target Selection on Touchscreens". In Proceedings of CHI 2022 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 494. Pages 1 - 15. [Acceptance Rate: 24.8%]

CHI 2022

[47]. Lihang Pan, Chun Yu, JiaHui Li, Tian Huang, Xiaojun Bi, Yuanchun Shi. (2022) "Automatically Generating and Improving Voice Command Interface from Operation Sequences on Smartphones". In Proceedings of CHI 2022 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 208. Pages 1 - 21. [Acceptance Rate: 24.8%]

IUI 2022

[46]. Maozheng Zhao, Henry Huang, Zhi Li, Rui Liu, Wenzhe Cui, Kajal Toshniwal, Ananya Goel, Andrew Wang, Xia Zhao, Sina Rashidian, Furqan Baig, Khiem Phi, Shumin Zhai, I.V. Ramakrishnan, Fusheng Wang, and Xiaojun Bi (2022) "EyeSayCorrect: Eye Gaze and Voice Based Hands-free Text Correction for Mobile Devices". In Proceedings of IUI 2022 - 27th Annual Conference on Intelligent User Interfaces. Pages 470 - 482. [Acceptance Rate: 24.5%]

2021

UIST 2021

[45]. Maozheng Zhao, Wenzhe Cui, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2021) "Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for Smartphones". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. pp 162 - 178. [Acceptance Rate: 25.9%]

UIST 2021

[44]. Michael Wang*, Hang Zhao*, Xiaolei Zhou, Xiangshi Ren, Xiaojun Bi (2021) "Variance and Distribution Models for Steering Tasks". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. pp 1122 - 1143. [Acceptance Rate: 25.9%] (*Co-first authors.)

UIST 2021

[43]. Yan Ma, Shumin Zhai, IV Ramakrishnan, Xiaojun Bi (2021) "Modeling Touch Point Distribution with Rotational Dual Gaussian Model". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. pp 1197 - 1209. [Acceptance Rate: 25.9%]

CHI 2021

[42]. Wenzhe Cui, Suwen Zhu, Zhi Li, Zheer Xu, Xing-Dong Yang, IV Ramakrishnan, Xiaojun Bi (2021) "BackSwipe: Back-of-device Word-Gesture Interaction on Smartphones". In Proceedings of CHI 2021 - the SIGCHI Conference on Human Factors in Computing Systems. Article 196, 1-12. [Acceptance Rate: 26.3%]

Chinese CHI 2021

[41]. Yu-Jung Ko, Hang Zhao, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2021) "Issues Related to Using Finger-Fitts law to Model One-Dimensional Touch Pointing Tasks". In The Ninth International Symposium of Chinese CHI (Chinese CHI 2021). Pages 41 - 49.

Best Paper Honorable Mention Award | Paper

2020

UIST 2020

[40]. Wenzhe Cui, Suwen Zhu, Mingrui Ray Zhang, H. Andrew Schwartz, Jacob O. Wobbrock, Xiaojun Bi (2020) "JustCorrect: Intelligent Post Hoc Text Correction Techniques on Smartphones". In Proceedings of UIST 2020 - The ACM Symposium on User Interface Software and Technology. Pages 487-499 [Acceptance Rate: 21.56%]

UIST 2020

[39]. Yu-Jung Ko, Hang Zhao, Yoonsang Kim, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2020) "Modeling Two Dimensional Touch Pointing". In Proceedings of UIST 2020 - The ACM Symposium on User Interface Software and Technology. Pages 858-868 [Acceptance Rate: 21.56%]

Best Paper Honorable Mention Award | Paper

CHI 2020

[38]. Suwen Zhu, Yoonsang Kim, Jingjie Zheng, Jennifer Yi Luo, Ryan Qin, Liuping Wang, Xiangmin Fan, Feng Tian, Xiaojun Bi (2020) "Using Bayes' Theorem for Command Input: Principle, Models, and Applications". In Proceedings of CHI 2020 - the SIGCHI Conference on Human Factors in Computing Systems. Pages 1-15 [Acceptance Rate: 24.31%]

CHI 2020

[37]. Xin Yi, Chen Wang, Xiaojun Bi, Yuanchun Shi (2020) "PalmBoard: Leveraging Implicit Touch Pressure in Statistical Decoding for Indirect Text Entry". In Proceedings of CHI 2020 - the SIGCHI Conference on Human Factors in Computing Systems. Pages 1-13. [Acceptance Rate: 24.31%]

2019

UIST 2019

[36]. Zheer Xu*, Pui Chung Wong*, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jurgen Steimle, Hongbo Fu, Kening Zhu, Xing-Dong Yang (*co-primary) (2019) "TipText: Eyes-Free Text Entry on a Fingertip Keyboard.". In Proceedings of UIST 2019 - The ACM Symposium on User Interface Software and Technology. 883-899. [Acceptance Rate: 24.4%]

Best Paper Award | Paper

CHI 2019

[35]. Suwen Zhu, Jingjie Zheng, Shumin Zhai, Xiaojun Bi (2019) "i'sFree: Eyes-Free Gesture Typing via a Touch-Enabled Remote Control". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 448, 12 pages. [Acceptance Rate: 23.8%]

CHI 2019

[34]. Wenzhe Cui, Jingjie Zheng, Blaine Lewis, Daniel Vogel, Xiaojun Bi (2019) "HotStrokes: Word-Gesture Shortcuts on a Trackpad". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 165, 13 pages. [Acceptance Rate: 23.8%]

CHI 2019

[33]. Syed Masum Billah, Yu-Jung Ko, Vikas Ashok, Xiaojun Bi, IV Ramakrishnan (2019) "Accessible Gesture Typing for Non-Visual Text Entry on Smartphones". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 376, 12 pages. [Acceptance Rate: 23.8%]

CHI 2019

[32]. Weinan Shi, Chun Yu, Shuyi Fan, Feng Wang, Tong Wang, Xin Yi, Xiaojun Bi, Yuanchun Shi (2019) "VIPBoard: Improving Screen-Reader Keyboard for Visually Impaired People with Character-Level Auto Correction". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 517, 12 pages. [Acceptance Rate: 23.8%]

Best Paper Honorable Mention Award Paper

CHI 2019

[31]. Feng Tian, Xiangmin Fan, Junjun Fan, Yicheng Zhu, Jing Gao, Dakuo Wang, Xiaojun Bi, Hongan Wang (2019) "What Can Gestures Tell? Detecting Motor Impairment in Early Parkinson's from Common Touch Gestural Interactions". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 83, 14 pages. [Acceptance Rate: 23.8%]

CHI 2019

[30]. Yiqin Lu, Chun Yu, Shuyi Fan, Xiaojun Bi, Yuanchun Shi (2019) "Typing on Split Keyboards with Peripheral Vision". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 200, 12 pages. [Acceptance Rate: 23.8%]

2018

UIST 2018

[29]. Jian Xu, Suwen Zhu, Aruna Balasubramanian*, Xiaojun Bi*, Roy Shilkrot* (2018) "Ultra-Low-Power Mode for Screenless Mobile Interaction". In Proceedings of UIST 2018 - The ACM Symposium on User Interface Software and Technology. 557 - 568. [Acceptance Rate: 21.3%] (* alphabetical order)

ISS 2018

[28]. Ryan Qin, Suwen Zhu, Yu-Hao Lin, Yu-Jung Ko, and Xiaojun Bi. (2018) "Optimal-T9: An Optimized T9-like Keyboard for Small Touchscreen Devices ". In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). 137-146. [Acceptance Rate: 26.7%]

Best Paper Honorable Mention Award Paper

ASSETS 2018

[27]. Yu-Hao Lin, Suwen Zhu, Yu-Jung Ko, Wenzhe Cui, Xiaojun Bi (2018) "Why Is Gesture Typing Promising for Older Adults? Comparing Gesture and Tap Typing Behavior of Older with Young Adults". In Proceedings of ASSETS 2018 - The 20th International ACM SIGACCESS Conference on Computers and Accessibility. 271 - 281. [Acceptance Rate: 26%]

CHI 2018

[26]. Suwen Zhu, Tianyao Luo, Xiaojun Bi, Shumin Zhai (2018) "Typing on an Invisible Keyboard". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 439, 13 pages. [Acceptance Rate: 25.7%]

CHI 2018

[25]. Jun Gong, Zheer Xu, Qifan Guo, Xiang 'Anthony' Chen, Teddy Seyed, Xiaojun Bi, Xing-Dong Yang (2018) "WrisText: One-handed Text Entry on Smartwatch using Wrist Gestures". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 181, 14 pages. [Acceptance Rate: 25.7%]

Best Paper Honorable Mention Award Paper

CHI 2018

[24]. Jingjie Zheng, Xiaojun Bi, Kun Li, Yang Li, Shumin Zhai (2018) "M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 249, 14 pages. [Acceptance Rate: 25.7%]

2017

UIST 2017

[23]. Jessalyn Alvina, Carla Griggio, Xiaojun Bi, Wendy Mackay (2017) "CommandBoard: Creating a General-purpose Command Gesture Input Space for Soft Keyboards". In Proceedings of UIST 2017 - The ACM Symposium on User Interface Software and Technology. 17 - 28. [Acceptance Rate: 22.5%]

CHI 2017

[22]. Xin Yi, Weijie Xu, Chun Yu, Xiaojun Bi, Yuanchun Shi (2017) "COMPASS: Rotational Keyboard on Non-Touch Smartwatches". In Proceedings of CHI 2017 - the SIGCHI Conference on Human Factors in Computing Systems. 705 - 715. [Acceptance Rate: 25%]

Best Paper Honorable Mention Award | Paper | Video

CHI 2017

[21]. Xin Yi, Chun Yu, Weinan Shi, Xiaojun Bi, Yuanchun Shi (2017) "Word Clarity as a Metric in Sampling Keyboard Test Sets". In Proceedings of CHI 2017 - the SIGCHI Conference on Human Factors in Computing Systems. 4216 - 4228 [Acceptance Rate: 25%]

2016

UIST 2016

[20]. Xiaojun Bi, Shumin Zhai (2016) "Predicting Finger-Touch Accuracy Based on the Dual Gaussian Distribution Model". In Proceedings of UIST 2016 - The ACM Symposium on User Interface Software and Technology. 313 - 319. [Acceptance Rate: 20.6%]

CHI 2016

[19]. Xiaojun Bi, Shumin Zhai (2016) "IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty". In Proceedings of CHI 2016 - the SIGCHI Conference on Human Factors in Computing Systems. 49 - 58. [Acceptance Rate: 23.4%]

CHI 2016

[18]. Chun Yu, Hongyi Wen, Wei Xiong, Xiaojun Bi, Yuanchun Shi (2016) "Investigating Effects of Post-selection Feedback for Acquiring Ultra-Small Targets on Touchscreen". In Proceedings of CHI 2016 - the SIGCHI Conference on Human Factors in Computing Systems. 4699 - 4710 [Acceptance Rate: 23.4%]

2015

CHI 2015

[17]. Brian Smith*, Xiaojun Bi, Shumin Zhai (2015) "Optimizing Touchscreen Keyboards for Gesture Typing". In Proceedings of CHI 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 3365-3374 [Acceptance Rate: 23%]

*Brian Smith was a research intern supervised by Xiaojun Bi at Google. | Paper

CHI 2015

[16]. Andrew Fowler, Kurt Partridge, Ciprian Chelba, Xiaojun Bi, Tom Ouyang, Shumin Zhai (2015) "Effects of Language Modeling and its Personalization on Touchscreen Typing Performance". In Proceedings of CHI 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 649-658 [Acceptance Rate: 23%]

Best Paper Honorable Mention Award | Paper

2014

CHI 2014

[15]. Xiaojun Bi, Tom Ouyang, Shumin Zhai (2014) "Both Complete and Correct? Multi-Objective Optimization of Touchscreen Keyboard". In Proceedings of CHI 2014 - the SIGCHI Conference on Human Factors in Computing Systems. 2297-2306 [Acceptance Rate: 22.8%]

Human-Computer Interaction 2014, Volume 29

[14]. Xiaojun Bi, Seok-Hyung Bae, Ravin Balakrishnan.(2014) "WallTop: Manage Overflowing Windows on a Large Display", Human-Computer Interaction. Volume 29, Issue 2, 153-203. [2014 Impact Factor: 3.143]

Author's Accepted Manuscript, Version of Record at Taylor and Francis| Video

2013

CHI 2013

[13]. Xiaojun Bi, Yang Li, Shumin Zhai (2013) "FFitts Law: Modeling Finger Touch with Fitts' Law". In Proceedings of CHI 2013 - the SIGCHI Conference on Human Factors in Computing Systems. 1363-1372 [Acceptance Rate: 20%]

Google 2013 Influential Paper Award | Paper

CHI 2013

[12]. Xiaojun Bi, Shiri Azenkot, Kurt Partridge, Shumin Zhai (2013) "Octopus: Evaluating Touchscreen Keyboard Correction and Recognition Algorithms via Remulation ". In Proceedings of CHI 2013 - the SIGCHI Conference on Human Factors in Computing Systems. 543-552 [Acceptance Rate: 20%]

UIST 2013

[11]. Xiaojun Bi, Shumin Zhai (2013) "Bayesian Touch - A Statistic Criterion of Target Selection with Finger Touch". In Proceedings of UIST 2013 - The ACM Symposium on User Interface Software and Technology. 51-60 [Acceptance Rate: 20%]

2012

UIST 2012

[10]. Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge, Shumin Zhai. (2012) "Bimanual Gesture Keyboard", In Proceedings of UIST 2012 - The ACM Symposium on User Interface Software and Technology. 137-146 [Acceptance Rate 21.5%]

Paper | Video
Mobile interaction research at Google (An article on the Google Research Blog introduces the successful technology transfer)

Human-Computer Interaction 2012, Volume 27

[9]. Xiaojun Bi, Barton A. Smith, Shumin Zhai. (2012) "Multilingual Touchscreen Keyboard Design and Optimization", Human-Computer Interaction, Volume 27, Issue 4, 352-382. [2014 Impact Factor: 3.143]

Author's Accepted Manuscript, Version of Record at Taylor and Francis

CHI 2012

[8]. Ken Hinckley, Xiaojun Bi, Michel Pahud, Bill Buxton. (2012) "Informal Information Gathering Techniques for Active Reading ". In Proceedings of CHI 2012 - the SIGCHI Conference on Human Factors in Computing Systems. 1893-1896. [Acceptance Rate: 23%]

CHI 2012

[7]. Yizhong Xin, Xiaojun Bi, Xiangshi Ren. (2012) "Natural Use Profiles for the Pen: An Empirical Exploration of Pressure, Tilt, and Azimuth ". In Proceedings of CHI 2012 - the SIGCHI Conference on Human Factors in Computing Systems. 801-804. [Acceptance Rate: 23%].

2011

CHI 2011

[6]. Xiaojun Bi , Tovi Grossman, Justin Matejka, George Fitzmaurice. (2011) "Magic Desk: Bringing Multi-Touch Surfaces into Desktop Work", In Proceedings of CHI 2011 - the SIGCHI Conference on Human Factors in Computing Systems. 2511-2520. [Acceptance Rate: 26%]

Best Paper Honorable Mention Award | Paper | Video

CHI 2011

[5]. Yizhong Xin, Xiaojun Bi , Xiangshi Ren. (2011) "Acquiring and Pointing: An Empirical Study of Pen Tilt-Based Interaction.". In Proceedings of CHI 2011 - the SIGCHI Conference on Human Factors in Computing Systems. 849-858. [Acceptance Rate: 26%].

2010

CHI 2010

[4]. Xiaojun Bi , Seok-Hyung Bae, Ravin Balakrishnan. (2010) "Effects of Interior Bezels of Tiled-Monitor Large Displays on Visual Search, Tunnel Steering, and Target Selection.". In Proceedings of CHI 2010 - the SIGCHI Conference on Human Factors in Computing Systems. 65-74. [Acceptance Rate: 22%]

CHI 2010

[3]. Xiaojun Bi, Barton A. Smith, Shumin Zhai. (2010) "Quasi-Qwerty Soft Keyboard Optimization". In Proceedings of CHI 2010 - the SIGCHI Conference on Human Factors in Computing Systems. 283-286. [Acceptance Rate: 22%]

2009

CHI 2009

[2]. Xiaojun Bi, Ravin Balakrishnan. (2009) "Comparing Usage of a Large High-Resolution Display to Single or Dual Desktop Displays for Daily Work". In Proceedings of CHI 2009 - the SIGCHI Conference on Human Factors in Computing Systems. 1005-1014. [Acceptance Rate: 25%]

2008

UIST 2008

[1]. Xiaojun Bi, Tomer Moscovich, Gonzalo Ramos, Ravin Balakrishnan, Ken Hinckley. (2008) "An Exploration of Pen Rolling for Pen-based Interaction". In Proceedings of UIST 2008 - The ACM Symposium on User Interface Software and Technology. 191-200. [Acceptance Rate: 18%]

Workshop Papers

[4]. Xiaojun Bi, Brian A. Smith and Shumin Zhai (2015) Keboard Layout Optimization. In CHI 2015 Workshop on Principles, Techniques and Perspectives on Optimization and HCI..

[3]. Per Ola Kristensson, Xiaojun Bi, Andrew Howes, Antti Oulasvirta, Roderick Murray-Smith, Harold Thimbleby, John Williamson, Shumin Zhai (2015) Principles, Techniques and Perspectives on Optimization and HCI. In CHI EA 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 2441-2444.

[2]. Hao-Chuan Wang, Gary Hsieh, Xiaojun Bi, Henry B. L. Duh, Yihsiu Chen (2015) Chinese CHI Symposium in CHI 2015. In CHI EA 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 2313-2315.

[1]. Shumin Zhai, Xiaojun Bi, Shiri Azenkot, Kurt Partridge (2013) "The Grand Challenge of Automated Evaluation of Text Input Systems". In CHI 2013 Workshop on Grand Challenges in Text Entry.

Book Chapters and Edited Books

[4] Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, Andrew Howes, editors. Computational interaction. Oxford University Press; 2018 Jan 10.

[3] Xiaojun Bi, Brian Smith, Tom Ouyang, Shumin Zhai. Soft Keyboard Performance Optimization. Chapter 5 in Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, Andrew Howes, (eds.), Computational Interaction. Oxford: Oxford University Press, 121 - 152.

[2] Suwen Zhu, Xiangmin Fan, Feng Tian, Xiaojun Bi. Bayesian Command Selection. Chapter 4 In John Williamson, Antti Oulasvirta, Per Ola Kristensson, Nikola Banovic (eds.), Bayesian Methods for Interaction and Design. Cambridge: Cambridge University Press, 129 - 156. (In press)

[1] Mingrui "Ray" Zhang, He Wen, Wenzhe Cui, Suwen Zhu, H.Andrew Schwartz, Xiaojun Bi and Jacob O. Wobbrock. (2021). AI-driven Intelligent Text Correction Techniques for Mobile Text Entry. Chapter 6 in Yang Li & Otmar Hilliges (eds.), Artificial Intelligence for Human Computer Interaction: A Modern Approach. Switzerland: Springer. (In press)

Brief Biography

Xiaojun Bi is an Associate Professor in the Department of Computer Science at Stony Brook University. Prior to joining Stony Brook, he was a Research Scientist at Google LLC. in California. Xiaojun Bi's research in Human Computer Interaction focuses on input modeling and AI-powered input technologies. His major research directions include (1) probabilistic modeling for touch, gaze, and voice based unimodal and multimodal input, (2) model-based intelligent text and command input technologies, and (3) model-based accessible input technologies for people with disabilities such as blind users and people with motor impairments. His innovations such as keyboard correction & completion algorithm (CHI 2013) , bimanual gesture typing (UIST 2012), personalizing language models for text entry (CHI 2015) have been integrated into the stock Google keyboard, used by Android users worldwide. This Google AI blog article introduces the successful technology transfer of some of his inventions.

Xiaojun Bi has authored over 40 publications in the premier Human Computer Interaction publication venues such as CHI and UIST, and has received 11 Best Paper or Honorable Mention awards. He is a two-time Google Faculty Research Award winner and inventor of 33 US patents. Xiaojun Bi earned his Ph.D. from the Department of Computer Science at the University of Toronto, working with Ravin Balakrishnan. He received his Master's degree in Computer Science, and Bachelor's degree in Automation both from Tsinghua University. He won the first place in the National Mathematical Olympiad (China) in his home province when he was a high school student, recruited by Tsinghua University with National College Entrance Examination (Gaokao) waived. Despite of an early offer from his dream school, Xiaojun Bi participated in Gaokao and ranked in the top 5 in his home province.

Please refer to his full CV for detailed information about his research, teaching, and professional service.

Patents (33 issued)

[P33]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 10,140,284. Filed: 4/4/2017. Issued: 11/27/2018

[P32]. Shumin Zhai, Xiaojun Bi, Yu Ouyang. Incremental multi-touch gesture recognition. US Patent: 9,021,380. Filed: 10/5/2012. Issued: 4/28/2015

[P31]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 8,806,384. Filed: 7/2/2014. Issued: 4/14/2015.

[P30]. Xiaojun Bi, Kurt Partridge, Yu Ouyang, Shumin Zhai. Character deletion during keyboard gesture. US Patent: 8,914,751. Filed: 1/14/2013. Issued: 12/16/2014

[P29]. Xiaojun Bi, Shumin Zhai and Michael Andrew Cleron. Dynamically-positioned character string suggestions for gesture typing. US Patent: 8,887,103. Filed: 1/20/2013. Issued: 11/11/2014

[P28]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 8,850,350. Filed: 10/16/2013. Issued: 9/30/2014

[P27]. Yu Ouyang, Shumin Zhai, Xiaojun Bi. Multi-gesture text input prediction. US Patent: 8,843,845. Filed: 4/8/2013. Issued: 9/23/2014

[P26]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 8,806,384. Filed: 10/24/2013. Issued: 8/12/2014

[P25]. Tom Ouyang, Shumin Zhai, Ciprian Chelba, Xiaojun Bi, Satoshi Kataoka, Ken Wakasa, Keisuke Kuroyanagi. Incremental feature-based gesture-keyboard decoding. US Patent: 8,782,549. Filed: 10/5/2012. Issued: 7/15/2014

[P24]. Shumin Zhai, Kurt Partridge, Xiaojun Bi, Tom Ouyang. Visual feedback deletion. US Patent: 8,584,049. Filed: 3/14/2013. Issued: 11/12/2013

[P23]. Xiaojun Bi, Barton Smith, Shumin Zhai. Method for optimization of soft keyboards for multiple languages. US Patent: 8,542,195. Filed: 3/30/2010. Issued: 9/24/2013

[P22]. Xiaojun Bi, Shumin Zhai. Touchscreen text input. US Patent: 8,405,630. Filed: 04/30/2012. Issued: 3/26/2013.

[P21]. Xiaojun Bi. Suggestion selection during continuous gesture input. US Patent: 9,996,258. Filed: 3/12/2015. Issued: 6/12/2018.

[P20]. Xiaojun Bi. Alternative gesture mapping for a graphical keyboard. US Patent: 9,952,763. Filed: 2/16/2015. Issued: 4/14/2018.

[P19]. Xiaojun Bi, Shumin Zhai. Thumb typing keyboard. US Patent: 9,262,075. Filed: 7/3/2014. Issued: 2/16/2016.

[P18]. Xiaojun Bi. Word prediction for numbers and symbols. US Patent:9,298,276. Filed: 12/31/2013. Issued: 3/29/2016.

[P17]. Shumin Zhai, Kurt Edward Partridge, Xiaojun Bi, Yu Ouyang. Gesture keyboard with gesture cancellation. US Patent: 9,569,107. Filed: 4/19/2013. Issued: 2/14/2017.

[P16]. Shumin Zhai, Kurt Edward Partridge, Xiaojun Bi, Yu Ouyang. Contextually-specific automatic separators. US Patent: 9,557,818 Filed: 3/4/2013. Issued: 1/31/2017

[P15]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,612,743. Filed:1/5/2011. Issued: 4/4/2017

[P14]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,600,090. Filed:1/5/2011. Issued: 3/21/2017

[P13]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,262,005 Filed:1/5/2011. Issued: 2/16/2016

[P12]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 8,988,366 Filed:1/5/2011. Issued: 3/24/2015

P11]. Xiaojun Bi. Dynamic key mapping of a graphical keyboard. US Patent: 10,146,764. Filed: 4/4/2016. Issued: 12/4/2018.

[P10]. Xiaojun Bi. Apparatus and method for touchscreen keyboard suggestion word generation and display. US Patent: 9,952,764. Filed: 7638/20/2015. Issued: 4/24/2018.

[P9]. Yu Ouyang, Shumin Zhai, Xiaojun Bi. Multi-gesture text input prediction. US Patent: 9,710,453. Filed: 9/4/2014. Issued: 7/18/2017

[P8]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 9,678,943. Filed: 9/24/2014. Issued: 6/13/2017

[P7]. Xiaojun Bi, Kurt Partridge, Yu Ouyang, Shumin Zhai. Character deletion during keyboard gesture. US Patent: 9,665,276. Filed: 11/19/2014. Issued: 5/30/2017

[P6]. Xiaojun Bi. Display screen with animated graphical user interface. US Patent: D780,800. Filed: 11/19/2015. Issued: 3/7/2017.

[P5]. Xiaojun Bi. Display screen with animated graphical user interface. US Patent: D785,037. Filed: 7/3/2014. Issued: 4/25/2017.

[P4]. Tom Ouyang, Shumin Zhai, Ciprian Chelba, Xiaojun Bi, Satoshi Kataoka, Ken Wakasa, Keisuke Kuroyanagi. Incremental feature-based gesture-keyboard decoding. US Patent: 9,552,080 Filed: 7/14/2014. Issued: 1/24/2017

[P3]. Xiaojun Bi, Shumin Zhai and Michael Andrew Cleron. Dynamically-positioned character string suggestions for gesture typing. US Patent: 9,543,439. Filed: 11/10/2014. Issued: 1/17/2017

[P2]. Xiaojun Bi. Portion of a display panel with a computer icon. US Patent: D770,492. Filed: 8/22/2014. Issued: 11/1/2016.

[P1]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 9,009,624. Filed: 7/2/2014. Issued: 4/14/2015.

Supervised Students

Current Ph.D. Students:
Yu-Jung Ko
Zhi Li
Maozheng Zhao
Yan Ma
Hang Zhao
Dan Zhang
Jeremy Chu

Graduated Students
Suwen Zhu, Ph.D. (2020)
Wenzhe Cui, Ph.D. (2022)

Past Interns:
Suwen Zhu, Stony Brook University, Summer 2016 at Google
Brian Smith , Columbia University, Summer 2014 at Google

Professional Services

Co-host. The 5th Summer School on Computational Interaction (July 2019 at Columbia University)

Subcommittee Chair (Computational Interaction). ACM Conference on Human Factors in Computing Systems (CHI) 2023, 2022

Program Committee Member. ACM Conference on Human Factors in Computing Systems (CHI) 2021, 2020, 2019, 2018, 2017, 2016, 2015.

Program Committee Member. ACM Symposium on User Interface Software and Technology (UIST) 2016, 2013.

Co-organizer. CHI 2015 Workshop on Principles, Techniques and Perspectives on Optimization and HCI.

Teaching

CSE 594 Advanced Topics in Human Computer Interaction (Spring 2018)

CSE 591 Advanced Topics in Mobile Human Computer Interaction (Fall 2018)

CSE 518 Foundations of Human Computer Interaction (Fall 2019)

CSE/ISE/EST 323 Human Computer Interaction (Spring 2020)

CSE 518 Foundations of Human Computer Interaction (Fall 2020)

CSE/ISE/EST 323 Human Computer Interaction (Spring 2021)

CSE 518 Foundations of Human Computer Interaction (Fall 2021)

CSE/ISE/EST 323 Human Computer Interaction (Spring 2022)

CSE 518 Foundations of Human Computer Interaction (Fall 2022)

CSE/ISE/EST 323 Human Computer Interaction (Spring 2023)

CSE 518 Foundations of Human Computer Interaction (Fall 2024)

Last modified 5/8/2024