Xiaojun Bi

Assistant Professor
Department of Computer Science
Stony Brook University

Email: xiaojun at cs.stonybrook.edu
Office: NCS 161
Phone: (631) 632-2506

News

06/2021: Won a regular NSF grant as PI. Thank you NSF!

06/2021: Three papers accepted to UIST 2021!

12/2020: One paper accepted to CHI 2021. Congratulations to Wenzhe for his third 1st-author CHI/UIST paper!

08/2020: Won a Best Paper Honorable Mention Award at UIST 2020.

07/2020: Recently received an NIH-R01 grant, an ALS grant, and an OVPR seed grant with my colleagues.

06/2020: Two papers accepted to UIST 2020.

12/2019: Received a Research Excellence Award in the department.

12/2019: Two papers accepted to CHI 2020.

8/2019: Our UIST'19 paper won a best paper award!

7/2019: Hosted the 5th Summer School on Computational Interaction with Brian Smith at Columbia University in July 2019.

12/2018: 6 papers accepted to CHI 2019; won a Best Paper Honorable Mention Award (top 5%)!

10/2018: Our ACM ISS'18 paper won a Best Paper Honorable Mention Award (top 5%)!

8/2018: Won a regular NSF grant as a sole PI. Thank you NSF!

6/2018: One paper accepted to UIST 2018; one accepted to ASSETS 2018.

2/21/2018: Won a Google Faculty Research Award (2018). Thanks Google!

1/2018: Three papers accepted to CHI 2018. One won a Best Paper Honorable Mention Award (top 5%)!

7/2017: One paper accepted to UIST 2017.

5/2017: I will serve on the CHI 2018 Program Committee in Dec. 2017.

2/18/2017: Our CHI 2017 paper "COMPASS" won a Best Paper Honorable Mention Award (top 5%)!

2/16/2017: Won a Google Faculty Research Award (2017). Thanks Google!

1/2017: Two papers accepted to CHI 2017.

1/23/2017: Officially started my appointment at Stony Brook University.

I am currently looking for highly motivated students to join my research lab.

| Brief Biography | Curriculum Vitae | Selected Awards and Honors | Publications | Grants | Patents | Students | Professional Services | Teaching |


Selected Awards and Honors (10 Paper Awards)

  • 2020 UIST Best Paper Honorable Mention Award

  • 2019 UIST Best Paper Award
  • 2019 CHI Best Paper Honorable Mention Award
  • 2019 Research Excellence Award (Department of Computer Science, Stony Brook University)

  • 2018 CHI Best Paper Honorable Mention Award
  • 2018 ISS Best Paper Honorable Mention Award
  • 2018 Google Faculty Research Award
  • 2018 Outstanding Young Leader in HCI (ICACHI)

  • 2017 CHI Best Paper Honorable Mention Award
  • 2017 Google Faculty Research Award

  • 2021 Chinese CHI Best Paper Honorable Mention Award
  • 2015 CHI Best Paper Honorable Mention Award
  • 2013 Google Influential Paper Award
  • 2011 CHI Best Paper Honorable Mention Award
  • Top


    Selected Publications

    Summary statistics of publications in top venues for Human Computer Interaction: CHI (28), UIST (12).
    DBLP | Google Scholar

      2021

    UIST 2021

    [51]. Maozheng Zhao, Wenzhe Cui, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2021) "Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for Smartphones". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. 17 pages. Accepted. [Acceptance Rate: 25.9%]

    Paper


    UIST 2021

    [50]. Michael Wang*, Hang Zhao*, Xiaolei Zhou, Xiangshi Ren, Xiaojun Bi (2021) "Variance and Distribution Models for Steering Tasks". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. 22 pages. Accepted. [Acceptance Rate: 25.9%] (*Co-first authors.)

    Paper


    UIST 2021

    [49]. Yan Ma, Shumin Zhai, IV Ramakrishnan, Xiaojun Bi (2021) "Modeling Touch Point Distribution with Rotational Dual Gaussian Model". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. 13 pages. Accepted. [Acceptance Rate: 25.9%]

    Paper


    CHI 2021

    [48]. Wenzhe Cui, Suwen Zhu, Zhi Li, Zheer Xu, Xing-Dong Yang, IV Ramakrishnan, Xiaojun Bi (2021) "BackSwipe: Back-of-device Word-Gesture Interaction on Smartphones". In Proceedings of CHI 2021 - the SIGCHI Conference on Human Factors in Computing Systems. Article 196, 1-12. [Acceptance Rate: 26.3%]

    Paper


    GI 2021

    [47]. Zhi Li, Maozheng Zhao, Yifan Wang, Sina Rashidian, Furqan Baig, Rui Liu, Wanyu Liu, Michel Beaudouin-Lafon, Brooke Ellison, Fusheng Wang, IV. Ramakrishnan, Xiaojun Bi (2021) "BayesGaze: A Bayesian Approach to Eye-Gaze Based Target Selection". In Proceedings of Graphics Interface 2021. 231 - 240.

    Paper


    MobileHCI 2021

    [46]. Yu-Jung Ko, Aini Putkonen, Ali Selman Aydin, Shirin Feiz, Yuheng Wang, Vikas Ashok, IV Ramakrishnan, Antti Oulasvirta, Xiaojun Bi (2021) "Modeling Gliding-based Target Selection for Blind Touchscreen Users". In Proceedings of MobileHCI 2021- The ACM Conference on Human computer interaction with Mobile Devices and Services Article No. 29 pp 1- 14.

    Paper


    Chinese CHI 2021

    [45]. Yu-Jung Ko, Hang Zhao, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2021) "Issues Related to Using Finger-Fitts law to Model One-Dimensional Touch Pointing Tasks". In The Ninth International Symposium of Chinese CHI (Chinese CHI 2021). Accepted. 10 pages.

    Best Paper Honorable Mention Award | Paper



      2020

    UIST 2020

    [44]. Wenzhe Cui, Suwen Zhu, Mingrui Ray Zhang, H. Andrew Schwartz, Jacob O. Wobbrock, Xiaojun Bi (2020) "JustCorrect: Intelligent Post Hoc Text Correction Techniques on Smartphones". In Proceedings of UIST 2020 - The ACM Symposium on User Interface Software and Technology. Pages 487-499 [Acceptance Rate: 21.56%]

    Paper


    UIST 2020

    [43]. Yu-Jung Ko, Hang Zhao, Yoonsang Kim, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2020) "Modeling Two Dimensional Touch Pointing". In Proceedings of UIST 2020 - The ACM Symposium on User Interface Software and Technology. Pages 858-868 [Acceptance Rate: 21.56%]

    Best Paper Honorable Mention Award | Paper


    CHI 2020

    [42]. Suwen Zhu, Yoonsang Kim, Jingjie Zheng, Jennifer Yi Luo, Ryan Qin, Liuping Wang, Xiangmin Fan, Feng Tian, Xiaojun Bi (2020) "Using Bayes' Theorem for Command Input: Principle, Models, and Applications". In Proceedings of CHI 2020 - the SIGCHI Conference on Human Factors in Computing Systems. Pages 1-15 [Acceptance Rate: 24.31%]

    Paper


    CHI 2020

    [41]. Xin Yi, Chen Wang, Xiaojun Bi, Yuanchun Shi (2020) "PalmBoard: Leveraging Implicit Touch Pressure in Statistical Decoding for Indirect Text Entry". In Proceedings of CHI 2020 - the SIGCHI Conference on Human Factors in Computing Systems. Pages 1-13. [Acceptance Rate: 24.31%]

    Paper


    MobileHCI 2021

    [40]. Conor Kelton, Jihoon Ryoo, Aruna Balasubramanian, Xiaojun Bi, Samir R Das (2020) "Modeling User-Centered Page Load Time for Smartphones". In Proceedings of MobileHCI 2020- The ACM Conference on Human computer interaction with Mobile Devices and Services Article No. 1 pp 1- 12.

    Paper



      2019

    UIST 2019

    [39]. Zheer Xu*, Pui Chung Wong*, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jurgen Steimle, Hongbo Fu, Kening Zhu, Xing-Dong Yang (*co-primary) (2019) "TipText: Eyes-Free Text Entry on a Fingertip Keyboard.". In Proceedings of UIST 2019 - The ACM Symposium on User Interface Software and Technology. 883-899. [Acceptance Rate: 24.4%]

    Best Paper Award | Paper


    CHI 2019

    [38]. Suwen Zhu, Jingjie Zheng, Shumin Zhai, Xiaojun Bi (2019) "i'sFree: Eyes-Free Gesture Typing via a Touch-Enabled Remote Control". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 448, 12 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [37]. Wenzhe Cui, Jingjie Zheng, Blaine Lewis, Daniel Vogel, Xiaojun Bi (2019) "HotStrokes: Word-Gesture Shortcuts on a Trackpad". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 165, 13 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [36]. Syed Masum Billah, Yu-Jung Ko, Vikas Ashok, Xiaojun Bi, IV Ramakrishnan (2019) "Accessible Gesture Typing for Non-Visual Text Entry on Smartphones". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 376, 12 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [35]. Weinan Shi, Chun Yu, Shuyi Fan, Feng Wang, Tong Wang, Xin Yi, Xiaojun Bi, Yuanchun Shi (2019) "VIPBoard: Improving Screen-Reader Keyboard for Visually Impaired People with Character-Level Auto Correction". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 517, 12 pages. [Acceptance Rate: 23.8%]

    Best Paper Honorable Mention Award Paper


    CHI 2019

    [34]. Feng Tian, Xiangmin Fan, Junjun Fan, Yicheng Zhu, Jing Gao, Dakuo Wang, Xiaojun Bi, Hongan Wang (2019) "What Can Gestures Tell? Detecting Motor Impairment in Early Parkinson's from Common Touch Gestural Interactions". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 83, 14 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [33]. Yiqin Lu, Chun Yu, Shuyi Fan, Xiaojun Bi, Yuanchun Shi (2019) "Typing on Split Keyboards with Peripheral Vision". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 200, 12 pages. [Acceptance Rate: 23.8%]

    Paper



      2018

    UIST 2018

    [32]. Jian Xu, Suwen Zhu, Aruna Balasubramanian*, Xiaojun Bi*, Roy Shilkrot* (2018) "Ultra-Low-Power Mode for Screenless Mobile Interaction". In Proceedings of UIST 2018 - The ACM Symposium on User Interface Software and Technology. 557 - 568. [Acceptance Rate: 21.3%] (* alphabetical order)

    Paper


    ISS 2018

    [31]. Ryan Qin, Suwen Zhu, Yu-Hao Lin, Yu-Jung Ko, and Xiaojun Bi. (2018) "Optimal-T9: An Optimized T9-like Keyboard for Small Touchscreen Devices ". In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). 137-146. [Acceptance Rate: 26.7%]

    Best Paper Honorable Mention Award Paper


    ASSETS 2018

    [30]. Yu-Hao Lin, Suwen Zhu, Yu-Jung Ko, Wenzhe Cui, Xiaojun Bi (2018) "Why Is Gesture Typing Promising for Older Adults? Comparing Gesture and Tap Typing Behavior of Older with Young Adults". In Proceedings of ASSETS 2018 - The 20th International ACM SIGACCESS Conference on Computers and Accessibility. 271 - 281. [Acceptance Rate: 26%]

    Paper


    CHI 2018

    [29]. Suwen Zhu, Tianyao Luo, Xiaojun Bi, Shumin Zhai (2018) "Typing on an Invisible Keyboard". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 439, 13 pages. [Acceptance Rate: 25.7%]

    Paper


    CHI 2018

    [28]. Jun Gong, Zheer Xu, Qifan Guo, Xiang 'Anthony' Chen, Teddy Seyed, Xiaojun Bi, Xing-Dong Yang (2018) "WrisText: One-handed Text Entry on Smartwatch using Wrist Gestures". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 181, 14 pages. [Acceptance Rate: 25.7%]

    Best Paper Honorable Mention Award Paper


    CHI 2018

    [27]. Jingjie Zheng, Xiaojun Bi, Kun Li, Yang Li, Shumin Zhai (2018) "M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 249, 14 pages. [Acceptance Rate: 25.7%]

    Paper



      2017

    UIST 2017

    [26]. Jessalyn Alvina, Carla Griggio, Xiaojun Bi, Wendy Mackay (2017) "CommandBoard: Creating a General-purpose Command Gesture Input Space for Soft Keyboards". In Proceedings of UIST 2017 - The ACM Symposium on User Interface Software and Technology. 17 - 28. [Acceptance Rate: 22.5%]

    Paper


    CHI 2017

    [25]. Xin Yi, Weijie Xu, Chun Yu, Xiaojun Bi, Yuanchun Shi (2017) "COMPASS: Rotational Keyboard on Non-Touch Smartwatches". In Proceedings of CHI 2017 - the SIGCHI Conference on Human Factors in Computing Systems. 705 - 715. [Acceptance Rate: 25%]

    Best Paper Honorable Mention Award | Paper | Video


    CHI 2017

    [24]. Xin Yi, Chun Yu, Weinan Shi, Xiaojun Bi, Yuanchun Shi (2017) "Word Clarity as a Metric in Sampling Keyboard Test Sets". In Proceedings of CHI 2017 - the SIGCHI Conference on Human Factors in Computing Systems. 4216 - 4228 [Acceptance Rate: 25%]

    Paper



      2016

    UIST 2016

    [23]. Xiaojun Bi, Shumin Zhai (2016) "Predicting Finger-Touch Accuracy Based on the Dual Gaussian Distribution Model". In Proceedings of UIST 2016 - The ACM Symposium on User Interface Software and Technology. 313 - 319. [Acceptance Rate: 20.6%]

    Paper


    CHI 2016

    [22]. Xiaojun Bi, Shumin Zhai (2016) "IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty". In Proceedings of CHI 2016 - the SIGCHI Conference on Human Factors in Computing Systems. 49 - 58. [Acceptance Rate: 23.4%]

    Paper


    CHI 2016

    [21]. Chun Yu, Hongyi Wen, Wei Xiong, Xiaojun Bi, Yuanchun Shi (2016) "Investigating Effects of Post-selection Feedback for Acquiring Ultra-Small Targets on Touchscreen". In Proceedings of CHI 2016 - the SIGCHI Conference on Human Factors in Computing Systems. 4699 - 4710 [Acceptance Rate: 23.4%]

    Paper



      2015

    CHI 2015

    [20]. Brian Smith*, Xiaojun Bi, Shumin Zhai (2015) "Optimizing Touchscreen Keyboards for Gesture Typing". In Proceedings of CHI 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 3365-3374 [Acceptance Rate: 23%]

    *Brian Smith was a research intern supervised by Xiaojun Bi at Google. | Paper


    CHI 2015

    [19]. Andrew Fowler, Kurt Partridge, Ciprian Chelba, Xiaojun Bi, Tom Ouyang, Shumin Zhai (2015) "Effects of Language Modeling and its Personalization on Touchscreen Typing Performance". In Proceedings of CHI 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 649-658 [Acceptance Rate: 23%]

    Best Paper Honorable Mention Award | Paper



      2014

    CHI 2014

    [18]. Xiaojun Bi, Tom Ouyang, Shumin Zhai (2014) "Both Complete and Correct? Multi-Objective Optimization of Touchscreen Keyboard". In Proceedings of CHI 2014 - the SIGCHI Conference on Human Factors in Computing Systems. 2297-2306 [Acceptance Rate: 22.8%]

    Paper


    Human-Computer Interaction 2014, Volume 29

    [17]. Xiaojun Bi, Seok-Hyung Bae, Ravin Balakrishnan.(2014) "WallTop: Manage Overflowing Windows on a Large Display", Human-Computer Interaction. Volume 29, Issue 2, 153-203. [2014 Impact Factor: 3.143]

    Author's Accepted Manuscript, Version of Record at Taylor and Francis| Video



      2013

    CHI 2013

    [16]. Xiaojun Bi, Yang Li, Shumin Zhai (2013) "FFitts Law: Modeling Finger Touch with Fitts' Law". In Proceedings of CHI 2013 - the SIGCHI Conference on Human Factors in Computing Systems. 1363-1372 [Acceptance Rate: 20%]

    Google 2013 Influential Paper Award | Paper



    CHI 2013

    [15]. Xiaojun Bi, Shiri Azenkot, Kurt Partridge, Shumin Zhai (2013) "Octopus: Evaluating Touchscreen Keyboard Correction and Recognition Algorithms via Remulation ". In Proceedings of CHI 2013 - the SIGCHI Conference on Human Factors in Computing Systems. 543-552 [Acceptance Rate: 20%]

    Paper | Video



    UIST 2013

    [14]. Xiaojun Bi, Shumin Zhai (2013) "Bayesian Touch - A Statistic Criterion of Target Selection with Finger Touch". In Proceedings of UIST 2013 - The ACM Symposium on User Interface Software and Technology. 51-60 [Acceptance Rate: 20%]

    Paper



      2012

    UIST 2012

    [13]. Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge, Shumin Zhai. (2012) "Bimanual Gesture Keyboard", In Proceedings of UIST 2012 - The ACM Symposium on User Interface Software and Technology. 137-146 [Acceptance Rate 21.5%]

    Paper | Video
    Mobile interaction research at Google (An article on the Google Research Blog introduces the successful technology transfer)



    Human-Computer Interaction 2012, Volume 27

    [12]. Xiaojun Bi, Barton A. Smith, Shumin Zhai. (2012) "Multilingual Touchscreen Keyboard Design and Optimization", Human-Computer Interaction, Volume 27, Issue 4, 352-382. [2014 Impact Factor: 3.143]

    Author's Accepted Manuscript, Version of Record at Taylor and Francis



    CHI 2012

    [11]. Ken Hinckley, Xiaojun Bi, Michel Pahud, Bill Buxton. (2012) "Informal Information Gathering Techniques for Active Reading ". In Proceedings of CHI 2012 - the SIGCHI Conference on Human Factors in Computing Systems. 1893-1896. [Acceptance Rate: 23%]

    Paper | Video



    CHI 2012

    [10]. Yizhong Xin, Xiaojun Bi, Xiangshi Ren. (2012) "Natural Use Profiles for the Pen: An Empirical Exploration of Pressure, Tilt, and Azimuth ". In Proceedings of CHI 2012 - the SIGCHI Conference on Human Factors in Computing Systems. 801-804. [Acceptance Rate: 23%].

    Paper



      2011

    CHI 2011

    [9]. Xiaojun Bi , Tovi Grossman, Justin Matejka, George Fitzmaurice. (2011) "Magic Desk: Bringing Multi-Touch Surfaces into Desktop Work", In Proceedings of CHI 2011 - the SIGCHI Conference on Human Factors in Computing Systems. 2511-2520. [Acceptance Rate: 26%]

    Best Paper Honorable Mention Award | Paper | Video



    CHI 2011

    [8]. Yizhong Xin, Xiaojun Bi , Xiangshi Ren. (2011) "Acquiring and Pointing: An Empirical Study of Pen Tilt-Based Interaction.". In Proceedings of CHI 2011 - the SIGCHI Conference on Human Factors in Computing Systems. 849-858. [Acceptance Rate: 26%].

    Paper



      2010

    CHI 2010

    [7]. Xiaojun Bi , Seok-Hyung Bae, Ravin Balakrishnan. (2010) "Effects of Interior Bezels of Tiled-Monitor Large Displays on Visual Search, Tunnel Steering, and Target Selection.". In Proceedings of CHI 2010 - the SIGCHI Conference on Human Factors in Computing Systems. 65-74. [Acceptance Rate: 22%]

    Paper



    CHI 2010

    [6]. Xiaojun Bi, Barton A. Smith, Shumin Zhai. (2010) "Quasi-Qwerty Soft Keyboard Optimization". In Proceedings of CHI 2010 - the SIGCHI Conference on Human Factors in Computing Systems. 283-286. [Acceptance Rate: 22%]

    Paper



      Before 2010

    CHI 2009

    [5]. Xiaojun Bi, Ravin Balakrishnan. (2009) "Comparing Usage of a Large High-Resolution Display to Single or Dual Desktop Displays for Daily Work". In Proceedings of CHI 2009 - the SIGCHI Conference on Human Factors in Computing Systems. 1005-1014. [Acceptance Rate: 25%]

    Paper



    UIST 2008

    [4]. Xiaojun Bi, Tomer Moscovich, Gonzalo Ramos, Ravin Balakrishnan, Ken Hinckley. (2008) "An Exploration of Pen Rolling for Pen-based Interaction". In Proceedings of UIST 2008 - The ACM Symposium on User Interface Software and Technology. 191-200. [Acceptance Rate: 18%]

    Paper | Video



    Mobile HCI 2010

    [3]. James Scott, Shahram Izadi, Leila Sadat Rezai, Dominika Ruszkowski, Xiaojun Bi, Ravin Balakrishnan, (2010) "RearType: Text Entry Using Keys on the Back of a Device". In Proceedings of MobileHCI - The ACM Conference on Human computer interaction with Mobile Devices and Services. 171-180. [Acceptance Rate: 23%]

    Paper



    TableTop 2006

    [2]. Xiaojun Bi, Yuanchun Shi, Xiaojie Chen (2006) "uPen: A Smart Pen-liked Device for Facilitating Interaction on Large Displays". In Proceedings of IEEE TableTop Conference on Horizontal Interactive Human-Computer Systems 2006, Australia, January, 160-168.

    Paper


    EUSAI 2005

    [1]. Xiaojun Bi, Yuanchun Shi, Xiaojie Chen, Peifeng Xiang (2005) "Facilitating Interaction with Large Displays in Smart Spaces". In Soc-EUSAI, Smart Objects and Ambient Intelligence Conference. France, October, 2005, 105-110.

    Paper


    Top


    Workshop Papers

    [4]. Xiaojun Bi, Brian A. Smith and Shumin Zhai (2015) Keboard Layout Optimization. In CHI 2015 Workshop on Principles, Techniques and Perspectives on Optimization and HCI..

    [3]. Per Ola Kristensson, Xiaojun Bi, Andrew Howes, Antti Oulasvirta, Roderick Murray-Smith, Harold Thimbleby, John Williamson, Shumin Zhai (2015) Principles, Techniques and Perspectives on Optimization and HCI. In CHI EA 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 2441-2444.

    [2]. Hao-Chuan Wang, Gary Hsieh, Xiaojun Bi, Henry B. L. Duh, Yihsiu Chen (2015) Chinese CHI Symposium in CHI 2015. In CHI EA 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 2313-2315.

    [1]. Shumin Zhai, Xiaojun Bi, Shiri Azenkot, Kurt Partridge (2013) "The Grand Challenge of Automated Evaluation of Text Input Systems". In CHI 2013 Workshop on Grand Challenges in Text Entry.

    Top


    Book Chapters and Edited Books

    [4] Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, Andrew Howes, editors. Computational interaction. Oxford University Press; 2018 Jan 10.

    [3] Xiaojun Bi, Brian Smith, Tom Ouyang, Shumin Zhai. Soft Keyboard Performance Optimization. Chapter 5 in Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, Andrew Howes, (eds.), Computational Interaction. Oxford: Oxford University Press, 121 - 152.

    [2] Suwen Zhu, Xiangmin Fan, Feng Tian, Xiaojun Bi. Bayesian Command Selection. Chapter 4 In John Williamson, Antti Oulasvirta, Per Ola Kristensson, Nikola Banovic (eds.), Bayesian Methods for Interaction and Design. Cambridge: Cambridge University Press, 129 - 156. (In press)

    [1] Mingrui "Ray" Zhang, He Wen, Wenzhe Cui, Suwen Zhu, H.Andrew Schwartz, Xiaojun Bi and Jacob O. Wobbrock. (2021). AI-driven Intelligent Text Correction Techniques for Mobile Text Entry. Chapter 6 in Yang Li & Otmar Hilliges (eds.), Artificial Intelligence for Human Computer Interaction: A Modern Approach. Switzerland: Springer. (In press)

    Top


    Brief Biography

    Xiaojun Bi is an Assistant Professor (2017 - present) in the Department of Computer Science at Stony Brook University. Prior to joining Stony Brook (2011 - 2016), he was a Research Scientist at Google LLC. in California. Xiaojun Bi's research lies at the intersection of Artificial Intelligence (AI) and Human Computer Interaction (HCI), with a primary focus on AI-powered Interaction. His research directions include (1) creating mathematical models to understand, explain, and predict users' interaction with computers, and (2) leveraging these models to research and develop intelligent input technologies. His innovations in mobile interaction such as keyboard correction & completion algorithm (CHI 2013) , bimanual gesture typing (UIST 2012), personalizing language models for text entry (CHI 2015) have been integrated into the stock Google keyboard, used by Android users worldwide. This Google AI blog article introduces the successful technology transfer of some of his inventions.

    Xiaojun Bi has authored over 40 publications in the premier HCI publication venues such as CHI and UIST, and has received 10 Best Paper or Honorable Mention awards. He is a two-time Google Faculty Research Award winner and inventor of 33 US patents. Xiaojun Bi earned his Ph.D. from the Department of Computer Science at the University of Toronto, working with Ravin Balakrishnan. He received his Master's degree in Computer Science, and Bachelor's degree in Automation both from Tsinghua University. He won the first place in the National Mathematical Olympiad (China) in his home province when he was a high school student, recruited by Tsinghua University with National College Entrance Examination (Gaokao) waived. Despite of an early offer from his dream school, Xiaojun Bi participated in Gaokao and ranked in the top 5 in his home province.

    Please refer to his full CV for detailed information about his research, teaching, and professional service.

    Top                                                                                          


    Grants (11 Awarded)

    Total for Stony Brook University: $3,320,137. My Share: $1,729,779

  • 11. NSF Standard Grant (2021)
  • 08/2021-07/2024
    Title: Bayesian-centric Multimodal Hands-free Computer Interaction Technologies for People with Quadriplegia
    PI: Xiaojun Bi, Co-PIs: IV Ramakrishnan, Brooke Ellison
    Total Amount: $399,869
    My Share: $199,945 (50%)

  • 10. NSF Standard Grant (2018)
  • 09/2018-08/2022
    Title: IIS:CHS: Establishing Action Laws for Touch Interaction
    Sole-PI: Xiaojun Bi
    Total Amount: $315,478
    My Share: $315,478 (100%)

  • 9. NIH R01 (2020)
  • 03/2020-02/2023
    Title: Space-Compacting Magnification Augmented with Natural Gestures and Keyboardless Text Entry for Low Vision Smartphone Interaction
    PI: IV Ramakrishnan, Co-PI: Xiaojun Bi, Christian Luhmann
    Total Amount: $1,178,970
    My Share: $500,000 (40%)

  • 8. Medical Research Program, Department of Defense (2021)
  • 1/2022-1/2024
    Title: Integrative Multimodal Communication for ALS Patients Using iPad
    PI: Fusheng Wang, Co-PI: Xiaojun Bi, Nurcan Gursory.
    Total Amount: $777, 322
    My Share: $259,307 (33%)

  • 7. ALS Association 20-MALS-538 (2020)
  • 1/31/2020-1/30/2022
    Title: Eye Gaze-Based Technology Using Apple Truth Depth Camera to Enable Communication for ALS Patients
    PI: Fusheng Wang, Co-PI: Xiaojun Bi.
    Total Amount: $199,998
    My Share: $99,999 (50%)

  • 6. Google Faculty Research Award (2018)
  • 04/2018-04/2019
    Title: Gesture Typing Based Authentication Methods on Smartphones.
    Sole-PI: Xiaojun Bi
    Total Amount: $50,000
    My Share: $50,000 (100%)

  • 5. Google Faculty Research Award (2017)
  • 04/2017-04/2018
    Title: Improving Touchscreen UI Design with Touch Modeling
    Sole-PI: Xiaojun Bi
    Total Amount: $38,500
    My Share: $38,500 (100%)

  • 4. SBU Office of the Vice President for Research Seed Grant (2021)
  • 4/2021-1/2022
    Title: Robotic Arm Augmented Wheelchair for Enabling Independent Living of People with Quadriplegia
    PI: Nilanjan Chakraborty, Co-PI: Xiaojun Bi, Haibin Ling, IV Ramakrishnan, Brooke Ellison
    Total Amount: $ 65,000
    My Share: $13,000 (20%)

  • 3. SBU Office of the Vice President for Research Seed Grant (2020)
  • 8/2020-1/2021
    Title: Next Generation Orally-Activated Multi-Modal Assistive Technologies for People with Severe Disabilities
    PI: Brooke Ellison, Co-PI: Xiaojun Bi, Mikhail Gouzman, Kimberly Noel
    Total Amount: $ 55,000
    My Share: $13,750 (25%)

  • 2. Google Research Gift Fund (2021)
  • 2021 - 2022
    Title: Voice and Touch Based Multimodal Text Editing and Correction Techniques on Mobile Devices
    Sole-PI: Xiaojun Bi
    Total Amount: $120,000
    My Share: $120,000 (100%)

  • 1. Google Research Gift Fund (2020)
  • 1/2020 - 1/2021
    Title: Probabilistic Modeling of Touch Input in Human Computer Interaction
    Sole-PI: Xiaojun Bi
    Total Amount: $120,000
    My Share: $120,000 (100%)

  • Under review: CAREER proposal (submitted in July 2021)
  • Top


    Patents (33 issued)

  • [P33]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 10,140,284. Filed: 4/4/2017. Issued: 11/27/2018

  • [P32]. Shumin Zhai, Xiaojun Bi, Yu Ouyang. Incremental multi-touch gesture recognition. US Patent: 9,021,380. Filed: 10/5/2012. Issued: 4/28/2015

  • [P31]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 8,806,384. Filed: 7/2/2014. Issued: 4/14/2015.

  • [P30]. Xiaojun Bi, Kurt Partridge, Yu Ouyang, Shumin Zhai. Character deletion during keyboard gesture. US Patent: 8,914,751. Filed: 1/14/2013. Issued: 12/16/2014

  • [P29]. Xiaojun Bi, Shumin Zhai and Michael Andrew Cleron. Dynamically-positioned character string suggestions for gesture typing. US Patent: 8,887,103. Filed: 1/20/2013. Issued: 11/11/2014

  • [P28]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 8,850,350. Filed: 10/16/2013. Issued: 9/30/2014

  • [P27]. Yu Ouyang, Shumin Zhai, Xiaojun Bi. Multi-gesture text input prediction. US Patent: 8,843,845. Filed: 4/8/2013. Issued: 9/23/2014

  • [P26]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 8,806,384. Filed: 10/24/2013. Issued: 8/12/2014

  • [P25]. Tom Ouyang, Shumin Zhai, Ciprian Chelba, Xiaojun Bi, Satoshi Kataoka, Ken Wakasa, Keisuke Kuroyanagi. Incremental feature-based gesture-keyboard decoding. US Patent: 8,782,549. Filed: 10/5/2012. Issued: 7/15/2014

  • [P24]. Shumin Zhai, Kurt Partridge, Xiaojun Bi, Tom Ouyang. Visual feedback deletion. US Patent: 8,584,049. Filed: 3/14/2013. Issued: 11/12/2013

  • [P23]. Xiaojun Bi, Barton Smith, Shumin Zhai. Method for optimization of soft keyboards for multiple languages. US Patent: 8,542,195. Filed: 3/30/2010. Issued: 9/24/2013

  • [P22]. Xiaojun Bi, Shumin Zhai. Touchscreen text input. US Patent: 8,405,630. Filed: 04/30/2012. Issued: 3/26/2013.

  • [P21]. Xiaojun Bi. Suggestion selection during continuous gesture input. US Patent: 9,996,258. Filed: 3/12/2015. Issued: 6/12/2018.

  • [P20]. Xiaojun Bi. Alternative gesture mapping for a graphical keyboard. US Patent: 9,952,763. Filed: 2/16/2015. Issued: 4/14/2018.

  • [P19]. Xiaojun Bi, Shumin Zhai. Thumb typing keyboard. US Patent: 9,262,075. Filed: 7/3/2014. Issued: 2/16/2016.

  • [P18]. Xiaojun Bi. Word prediction for numbers and symbols. US Patent:9,298,276. Filed: 12/31/2013. Issued: 3/29/2016.

  • [P17]. Shumin Zhai, Kurt Edward Partridge, Xiaojun Bi, Yu Ouyang. Gesture keyboard with gesture cancellation. US Patent: 9,569,107. Filed: 4/19/2013. Issued: 2/14/2017.

  • [P16]. Shumin Zhai, Kurt Edward Partridge, Xiaojun Bi, Yu Ouyang. Contextually-specific automatic separators. US Patent: 9,557,818 Filed: 3/4/2013. Issued: 1/31/2017

  • [P15]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,612,743. Filed:1/5/2011. Issued: 4/4/2017

  • [P14]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,600,090. Filed:1/5/2011. Issued: 3/21/2017

  • [P13]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,262,005 Filed:1/5/2011. Issued: 2/16/2016

  • [P12]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 8,988,366 Filed:1/5/2011. Issued: 3/24/2015

  • P11]. Xiaojun Bi. Dynamic key mapping of a graphical keyboard. US Patent: 10,146,764. Filed: 4/4/2016. Issued: 12/4/2018.

  • [P10]. Xiaojun Bi. Apparatus and method for touchscreen keyboard suggestion word generation and display. US Patent: 9,952,764. Filed: 7638/20/2015. Issued: 4/24/2018.

  • [P9]. Yu Ouyang, Shumin Zhai, Xiaojun Bi. Multi-gesture text input prediction. US Patent: 9,710,453. Filed: 9/4/2014. Issued: 7/18/2017

  • [P8]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 9,678,943. Filed: 9/24/2014. Issued: 6/13/2017

  • [P7]. Xiaojun Bi, Kurt Partridge, Yu Ouyang, Shumin Zhai. Character deletion during keyboard gesture. US Patent: 9,665,276. Filed: 11/19/2014. Issued: 5/30/2017

  • [P6]. Xiaojun Bi. Display screen with animated graphical user interface. US Patent: D780,800. Filed: 11/19/2015. Issued: 3/7/2017.

  • [P5]. Xiaojun Bi. Display screen with animated graphical user interface. US Patent: D785,037. Filed: 7/3/2014. Issued: 4/25/2017.

  • [P4]. Tom Ouyang, Shumin Zhai, Ciprian Chelba, Xiaojun Bi, Satoshi Kataoka, Ken Wakasa, Keisuke Kuroyanagi. Incremental feature-based gesture-keyboard decoding. US Patent: 9,552,080 Filed: 7/14/2014. Issued: 1/24/2017

  • [P3]. Xiaojun Bi, Shumin Zhai and Michael Andrew Cleron. Dynamically-positioned character string suggestions for gesture typing. US Patent: 9,543,439. Filed: 11/10/2014. Issued: 1/17/2017

  • [P2]. Xiaojun Bi. Portion of a display panel with a computer icon. US Patent: D770,492. Filed: 8/22/2014. Issued: 11/1/2016.

  • [P1]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 9,009,624. Filed: 7/2/2014. Issued: 4/14/2015.

  •  Top


    Supervised Students

    Current Ph.D. Students:
    Wenzhe Cui
    Yu-Jung Ko
    Zhi Li
    Maozheng Zhao
    Yan Ma
    Hang Zhao
    Dan Zhang
    Jeremy Chu

    Graduated Students
    Suwen Zhu, Ph.D. (2020). First job at Grammarly Inc. in San Francisco.

    Past Interns:
    Suwen Zhu, Stony Brook University, Summer 2016 at Google
    Brian Smith , Columbia University, Summer 2014 at Google

     Top


    Professional Services

  • Co-host.  The 5th Summer School on Computational Interaction (July 2019 at Columbia University)
  • Subcommittee Chair (Computational Interaction).  ACM Conference on Human Factors in Computing Systems (CHI) 2022.
  • Program Committee Member.  ACM Conference on Human Factors in Computing Systems (CHI) 2021, 2020, 2019, 2018, 2017, 2016, 2015.
  • Program Committee Member.  ACM Symposium on User Interface Software and Technology (UIST) 2016, 2013.
  • Co-organizer.  CHI 2015 Workshop on Principles, Techniques and Perspectives on Optimization and HCI.

  •  Top


    Teaching

  • CSE 594 Advanced Topics in Human Computer Interaction (Spring 2018)
  • CSE 591 Advanced Topics in Mobile Human Computer Interaction (Fall 2018)
  • CSE 518 Foundations of Human Computer Interaction (Fall 2019)
  • CSE/ISE/EST 323 Human Computer Interaction (Spring 2020)
  • CSE 518 Foundations of Human Computer Interaction (Fall 2020)
  • CSE/ISE/EST 323 Human Computer Interaction (Spring 2021)
  • CSE 518 Foundations of Human Computer Interaction (Fall 2021)

  •  Top


    Last modified 1/27/2021