Xiaojun Bi

Xiaojun Bi

Associate Professor
Department of Computer Science
Stony Brook University
Email: xiaojun at cs.stonybrook.edu
Office: NCS 161
Phone: (631) 632-2506

Research-to-Product Successes

ClearFlow phone layout

You can try it by installing Google’s Gboard on Android and enabling the ClearFlow layout.

WordGesture-GAN

Here is a Grammarly Engineering Blog article describing the integration of our model. The research paper introducing WordGesture-GAN won a Best Paper Honorable Mention Award at CHI 2023.

Top

Selected Awards and Honors

  • 2011 CHI Best Paper Honorable Mention Award
  • 2013 Google Influential Paper Award
  • 2015 CHI Best Paper Honorable Mention Award
  • 2017 CHI Best Paper Honorable Mention Award
  • 2018 ISS Best Paper Honorable Mention Award
  • 2018 CHI Best Paper Honorable Mention Award
  • 2019 CHI Best Paper Honorable Mention Award
  • 2019 UIST Best Paper Award
  • 2020 UIST Best Paper Honorable Mention Award
  • 2023 CHI Best Paper Honorable Mention Award

  • 2017 Google Faculty Research Award
  • 2018 Google Faculty Research Award
  • 2018 Outstanding Young Leader in HCI (ICACHI)
  • 2019 Research Excellence Award in the Department of Computer Science
  • 2023 Google Award for Inclusion Research
    •

    Top

    Selected Publications

    Number of publications in top venues for Human Computer Interaction (56 in total): CHI (37), UIST (17), UbiComp/IMWUT (2)
    DBLP | Google Scholar

      2025

    UIST 2025

    [65]. Dan Zhang, Yan Ma, Glenn Dausch, William H Seiple, David Xianfeng Gu, IV Ramakrishnan, Xiaojun Bi (2025) "Enabling Auto-Correction on Soft Braille Keyboard". In Proceedings of UIST 2025 - The ACM Symposium on User Interface Software and Technology. Article No.: 68, Pages 1–15. [Acceptance Rate: 22.2%]

    PDF icon Paper


    CHI 2025

    [64]. Yan Ma, Dan Zhang, IV Ramakrishnan, Xiaojun Bi (2025) "LLM Powered Text Entry Decoding and Flexible Typing on Smartphones". In Proceedings of CHI 2025 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 728, Pages 1 - 14. [Acceptance Rate: 25.1%]

    Paper


    CHI 2025

    [63]. Maozheng Zhao, Michael Xuelin Huang, Nathan G Huang, Henry Huang, Henry Huang, Shanqing Cai, Shumin Zhai, IV Ramakrishnan, Xiaojun Bi (2025) "Tap&Say: Touch Location-Informed Large Language Model for Multimodal Text Correction on Smartphones". In Proceedings of CHI 2025 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 649, Pages 1 - 17. [Acceptance Rate: 25.1%]

    Paper | Live demo of Tap&Say


    CHI 2025

    [62]. Hyunchul Lim, Nam Anh Dang, Dylan Lee, Tianhong Catherine Yu, Jane Lu, Franklin Mingzhe Li, Yiqi Jin, Yan Ma, Xiaojun Bi, Francois Guimbretiere, Cheng Zhang (2025) "SpellRing: Recognizing Continuous Fingerspelling in American Sign Language using a Ring". In Proceedings of CHI 2025 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 67, Pages 1 - 17. [Acceptance Rate: 25.1%]

    Paper


    UbiComp/IMWUT 2025

    [61]. Hang Zhao, Kaiyan Ling, IV Ramakrishnan, Guy J. Schwartz, Xiaojun Bi (2025) "Modeling Mouse-based Pointing and Steering Tasks for People with Parkinson's Disease". In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT'25). Article No.: 26, Pages 1 - 24

    Paper


      2024

    UIST 2024

    [60]. Dan Zhang, Zhi Li, Vikas Ashok, William H. Seiple, IV Ramakrishnan, Xiaojun Bi (2024), "Accessible Gesture Typing on Smartphones for People with Low Vision". In Proceedings of UIST 2024 - The ACM Symposium on User Interface Software and Technology. Article No.: 86. Pages 1-11. [Acceptance Rate: 22%]

    Paper


    UbiComp/IMWUT 2024

    [59]. Kaiyan Ling, Hang Zhao, Xiangmin Fan, Xiaohui Niu, Wenchao Yin, Yue Liu, Cui Wang, Xiaojun Bi (2024) " Model Touch Pointing and Detect Parkinson's Disease via a Mobile Game ". In Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT'24). Article No.: 74. Pages 1-24.

    Paper


    ASSETS 2024

    [58]. Satwik Ram Kodandaram, Utku Uckun, Xiaojun Bi, IV Ramakrishnan, Vikas Ashok(2024) "Enabling Uniform Computer Interaction Experience for Blind Users through Large Language Models". In Proceedings of ASSETS 2024 - The 26th International ACM SIGACCESS Conference on Computers and Accessibility. Article No.: 73. Pages 1-14. [Acceptance Rate: 29.7%]

    Paper


    ASSETS 2024

    [57]. Anujay Ghosh, Monalika Padma Reddy, Satwik Ram Kodandaram, Utku Uckun, Vikas Ashok, Xiaojun Bi , I. V. Ramakrishnan(2024) "Screen Reading Enabled by Large Language Models.". In Proceedings of ASSETS 2024 - The 26th International ACM SIGACCESS Conference on Computers and Accessibility. Article No.: 125. Pages 1-5. [Acceptance Rate: 29.7%]

    Paper


    CHI 2024

    [56]. Prerna Khanna, IV Ramakrishnan, Shubham Jain, Xiaojun Bi, Aruna Balasubramanian (2024) " Hand Gesture Recognition for Blind Users by Tracking 3D Gesture Trajectory ". In Proceedings of CHI 2024 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 405. Pages 1-15. [Acceptance Rate: 26.4%]

    Paper


      2023

    UIST 2023

    [55]. Jeremy Chu, Yan Ma, Shumin Zhai, Xianfeng David Gu, Xiaojun Bi (2023) " TouchType-GAN: Modeling Touch Typing with Generative Adversarial Network ". In Proceedings of UIST 2023 - The ACM Symposium on User Interface Software and Technology. Article No.: 29. Pages 1-13 [Acceptance Rate: 25.05%]

    Paper | Live demo of WordGesture-GAN and TouchType-GAN


    MobiCom 2023

    [54]. Prerna Khanna, Shirin Feiz, Jian Xu, IV Ramakrishnan, Shubham Jain, Xiaojun Bi, Aruna Balasubramanian. (2023) " AccessWear: Making Smartphone Applications Accessible to Blind Users ". In Proceedings of MobiCom'23 - the 29th Annual International Conference on Mobile Computing and Networking. Article No.: 32. Pages 1-16.

    Paper


    CHI 2023

    [53]. Jeremy Chu, Dongsheng An, Yan Ma, Wenzhe Cui, Shumin Zhai, Xianfeng David Gu, Xiaojun Bi (2023) " WordGesture-GAN: Modeling Word-Gesture Movement with Generative Adversarial Network ". In Proceedings of CHI 2023 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 287. Pages 1-15. [Acceptance Rate: 28.4%]

    Best Paper Honorable Mention Award | Paper | Live demo of WordGesture-GAN and TouchType-GAN


    CHI 2023

    [52]. Zhi Li, Yu-Jung Ko, Aini Putkonen, Shirin Feiz, Vikas Ashok, IV Ramakrishnan, Antti Oulasvirta, Xiaojun Bi (2023) " Modeling Touch-based Menu Selection for Blind Users ". In Proceedings of CHI 2023 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 357. Pages 1-18. [Acceptance Rate: 28.4%]

    Paper


    CHI 2023

    [51]. Wenzhe Cui*, Rui Liu*, Zhi Li, Yifan Wang, Andrew Wang, Xia Zhao, Sina Rashidian, Furqan Baig, IV Ramakrishnan, Fusheng Wang, Xiaojun Bi (2023) "GlanceWriter: Writing Text by Glancing Over Letters with Gaze". In Proceedings of CHI 2023 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 719. Pages 1-13. *Co-First authors ordered alphabetically. [Acceptance Rate: 28.4%]

    Paper


      2022

    UIST 2022

    [50]. Hang Zhao, Sophia Gu, Chun Yu, Xiaojun Bi (2022), "Bayesian Hierarchical Pointing Models". In Proceedings of UIST 2022 - The ACM Symposium on User Interface Software and Technology. Article No.: 87. Pages 1-13. [Acceptance Rate: 26.3%]

    Paper


    UIST 2022

    [49]. Zheer Xu, Yankang Meng, Xiaojun Bi, Xing-Dong Yang (2022), "Phrase-Gesture Typing on Smartphones". In Proceedings of UIST 2022 - The ACM Symposium on User Interface Software and Technology. Article No.: 55. Pages 1-11. [Acceptance Rate: 26.3%]

    Paper


    CHI 2022

    [48]. Zhi Li, Maozheng Zhao, Dibyendu Das, Hang Zhao, Yan Ma, Wanyu Liu, Michel Beaudouin-Lafon, Fusheng Wang, IV Ramakrishnan, Xiaojun Bi (2022) "Select or Suggest? Reinforcement Learning-based Method for High-Accuracy Target Selection on Touchscreens". In Proceedings of CHI 2022 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 494. Pages 1 - 15. [Acceptance Rate: 24.8%]

    Paper


    CHI 2022

    [47]. Lihang Pan, Chun Yu, JiaHui Li, Tian Huang, Xiaojun Bi, Yuanchun Shi. (2022) "Automatically Generating and Improving Voice Command Interface from Operation Sequences on Smartphones". In Proceedings of CHI 2022 - the SIGCHI Conference on Human Factors in Computing Systems. Article No.: 208. Pages 1 - 21. [Acceptance Rate: 24.8%]

    Paper


    IUI 2022

    [46]. Maozheng Zhao, Henry Huang, Zhi Li, Rui Liu, Wenzhe Cui, Kajal Toshniwal, Ananya Goel, Andrew Wang, Xia Zhao, Sina Rashidian, Furqan Baig, Khiem Phi, Shumin Zhai, I.V. Ramakrishnan, Fusheng Wang, and Xiaojun Bi (2022) "EyeSayCorrect: Eye Gaze and Voice Based Hands-free Text Correction for Mobile Devices". In Proceedings of IUI 2022 - 27th Annual Conference on Intelligent User Interfaces. Pages 470 - 482. [Acceptance Rate: 24.5%]

    Paper


      2021

    UIST 2021

    [45]. Maozheng Zhao, Wenzhe Cui, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2021) "Voice and Touch Based Error-tolerant Multimodal Text Editing and Correction for Smartphones". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. pp 162 - 178. [Acceptance Rate: 25.9%]

    Paper


    UIST 2021

    [44]. Michael Wang*, Hang Zhao*, Xiaolei Zhou, Xiangshi Ren, Xiaojun Bi (2021) "Variance and Distribution Models for Steering Tasks". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. pp 1122 - 1143. [Acceptance Rate: 25.9%] (*Co-first authors.)

    Paper


    UIST 2021

    [43]. Yan Ma, Shumin Zhai, IV Ramakrishnan, Xiaojun Bi (2021) "Modeling Touch Point Distribution with Rotational Dual Gaussian Model". In Proceedings of UIST 2021 - The ACM Symposium on User Interface Software and Technology. pp 1197 - 1209. [Acceptance Rate: 25.9%]

    Paper


    CHI 2021

    [42]. Wenzhe Cui, Suwen Zhu, Zhi Li, Zheer Xu, Xing-Dong Yang, IV Ramakrishnan, Xiaojun Bi (2021) "BackSwipe: Back-of-device Word-Gesture Interaction on Smartphones". In Proceedings of CHI 2021 - the SIGCHI Conference on Human Factors in Computing Systems. Article 196, 1-12. [Acceptance Rate: 26.3%]

    Paper


    Chinese CHI 2021

    [41]. Yu-Jung Ko, Hang Zhao, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2021) "Issues Related to Using Finger-Fitts law to Model One-Dimensional Touch Pointing Tasks". In The Ninth International Symposium of Chinese CHI (Chinese CHI 2021). Pages 41 - 49.

    Best Paper Honorable Mention Award | Paper


      2020

    UIST 2020

    [40]. Wenzhe Cui, Suwen Zhu, Mingrui Ray Zhang, H. Andrew Schwartz, Jacob O. Wobbrock, Xiaojun Bi (2020) "JustCorrect: Intelligent Post Hoc Text Correction Techniques on Smartphones". In Proceedings of UIST 2020 - The ACM Symposium on User Interface Software and Technology. Pages 487-499 [Acceptance Rate: 21.56%]

    Paper


    UIST 2020

    [39]. Yu-Jung Ko, Hang Zhao, Yoonsang Kim, IV Ramakrishnan, Shumin Zhai, Xiaojun Bi (2020) "Modeling Two Dimensional Touch Pointing". In Proceedings of UIST 2020 - The ACM Symposium on User Interface Software and Technology. Pages 858-868 [Acceptance Rate: 21.56%]

    Best Paper Honorable Mention Award | Paper


    CHI 2020

    [38]. Suwen Zhu, Yoonsang Kim, Jingjie Zheng, Jennifer Yi Luo, Ryan Qin, Liuping Wang, Xiangmin Fan, Feng Tian, Xiaojun Bi (2020) "Using Bayes' Theorem for Command Input: Principle, Models, and Applications". In Proceedings of CHI 2020 - the SIGCHI Conference on Human Factors in Computing Systems. Pages 1-15 [Acceptance Rate: 24.31%]

    Paper


    CHI 2020

    [37]. Xin Yi, Chen Wang, Xiaojun Bi, Yuanchun Shi (2020) "PalmBoard: Leveraging Implicit Touch Pressure in Statistical Decoding for Indirect Text Entry". In Proceedings of CHI 2020 - the SIGCHI Conference on Human Factors in Computing Systems. Pages 1-13. [Acceptance Rate: 24.31%]

    Paper



      2019

    UIST 2019

    [36]. Zheer Xu*, Pui Chung Wong*, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jurgen Steimle, Hongbo Fu, Kening Zhu, Xing-Dong Yang (*co-primary) (2019) "TipText: Eyes-Free Text Entry on a Fingertip Keyboard.". In Proceedings of UIST 2019 - The ACM Symposium on User Interface Software and Technology. 883-899. [Acceptance Rate: 24.4%]

    Best Paper Award | Paper


    CHI 2019

    [35]. Suwen Zhu, Jingjie Zheng, Shumin Zhai, Xiaojun Bi (2019) "i'sFree: Eyes-Free Gesture Typing via a Touch-Enabled Remote Control". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 448, 12 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [34]. Wenzhe Cui, Jingjie Zheng, Blaine Lewis, Daniel Vogel, Xiaojun Bi (2019) "HotStrokes: Word-Gesture Shortcuts on a Trackpad". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 165, 13 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [33]. Syed Masum Billah, Yu-Jung Ko, Vikas Ashok, Xiaojun Bi, IV Ramakrishnan (2019) "Accessible Gesture Typing for Non-Visual Text Entry on Smartphones". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 376, 12 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [32]. Weinan Shi, Chun Yu, Shuyi Fan, Feng Wang, Tong Wang, Xin Yi, Xiaojun Bi, Yuanchun Shi (2019) "VIPBoard: Improving Screen-Reader Keyboard for Visually Impaired People with Character-Level Auto Correction". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 517, 12 pages. [Acceptance Rate: 23.8%]

    Best Paper Honorable Mention Award Paper


    CHI 2019

    [31]. Feng Tian, Xiangmin Fan, Junjun Fan, Yicheng Zhu, Jing Gao, Dakuo Wang, Xiaojun Bi, Hongan Wang (2019) "What Can Gestures Tell? Detecting Motor Impairment in Early Parkinson's from Common Touch Gestural Interactions". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 83, 14 pages. [Acceptance Rate: 23.8%]

    Paper


    CHI 2019

    [30]. Yiqin Lu, Chun Yu, Shuyi Fan, Xiaojun Bi, Yuanchun Shi (2019) "Typing on Split Keyboards with Peripheral Vision". In Proceedings of CHI 2019 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 200, 12 pages. [Acceptance Rate: 23.8%]

    Paper



      2018

    UIST 2018

    [29]. Jian Xu, Suwen Zhu, Aruna Balasubramanian*, Xiaojun Bi*, Roy Shilkrot* (2018) "Ultra-Low-Power Mode for Screenless Mobile Interaction". In Proceedings of UIST 2018 - The ACM Symposium on User Interface Software and Technology. 557 - 568. [Acceptance Rate: 21.3%] (* alphabetical order)

    Paper


    ISS 2018

    [28]. Ryan Qin, Suwen Zhu, Yu-Hao Lin, Yu-Jung Ko, and Xiaojun Bi. (2018) "Optimal-T9: An Optimized T9-like Keyboard for Small Touchscreen Devices ". In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (ISS '18). 137-146. [Acceptance Rate: 26.7%]

    Best Paper Honorable Mention Award Paper


    ASSETS 2018

    [27]. Yu-Hao Lin, Suwen Zhu, Yu-Jung Ko, Wenzhe Cui, Xiaojun Bi (2018) "Why Is Gesture Typing Promising for Older Adults? Comparing Gesture and Tap Typing Behavior of Older with Young Adults". In Proceedings of ASSETS 2018 - The 20th International ACM SIGACCESS Conference on Computers and Accessibility. 271 - 281. [Acceptance Rate: 26%]

    Paper


    CHI 2018

    [26]. Suwen Zhu, Tianyao Luo, Xiaojun Bi, Shumin Zhai (2018) "Typing on an Invisible Keyboard". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 439, 13 pages. [Acceptance Rate: 25.7%]

    Paper


    CHI 2018

    [25]. Jun Gong, Zheer Xu, Qifan Guo, Xiang 'Anthony' Chen, Teddy Seyed, Xiaojun Bi, Xing-Dong Yang (2018) "WrisText: One-handed Text Entry on Smartwatch using Wrist Gestures". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 181, 14 pages. [Acceptance Rate: 25.7%]

    Best Paper Honorable Mention Award Paper


    CHI 2018

    [24]. Jingjie Zheng, Xiaojun Bi, Kun Li, Yang Li, Shumin Zhai (2018) "M3 Gesture Menu: Design and Experimental Analyses of Marking Menus for Touchscreen Mobile Interaction". In Proceedings of CHI 2018 - the SIGCHI Conference on Human Factors in Computing Systems. Paper 249, 14 pages. [Acceptance Rate: 25.7%]

    Paper



      2017

    UIST 2017

    [23]. Jessalyn Alvina, Carla Griggio, Xiaojun Bi, Wendy Mackay (2017) "CommandBoard: Creating a General-purpose Command Gesture Input Space for Soft Keyboards". In Proceedings of UIST 2017 - The ACM Symposium on User Interface Software and Technology. 17 - 28. [Acceptance Rate: 22.5%]

    Paper


    CHI 2017

    [22]. Xin Yi, Weijie Xu, Chun Yu, Xiaojun Bi, Yuanchun Shi (2017) "COMPASS: Rotational Keyboard on Non-Touch Smartwatches". In Proceedings of CHI 2017 - the SIGCHI Conference on Human Factors in Computing Systems. 705 - 715. [Acceptance Rate: 25%]

    Best Paper Honorable Mention Award | Paper | Video


    CHI 2017

    [21]. Xin Yi, Chun Yu, Weinan Shi, Xiaojun Bi, Yuanchun Shi (2017) "Word Clarity as a Metric in Sampling Keyboard Test Sets". In Proceedings of CHI 2017 - the SIGCHI Conference on Human Factors in Computing Systems. 4216 - 4228 [Acceptance Rate: 25%]

    Paper



      2016

    UIST 2016

    [20]. Xiaojun Bi, Shumin Zhai (2016) "Predicting Finger-Touch Accuracy Based on the Dual Gaussian Distribution Model". In Proceedings of UIST 2016 - The ACM Symposium on User Interface Software and Technology. 313 - 319. [Acceptance Rate: 20.6%]

    Paper


    CHI 2016

    [19]. Xiaojun Bi, Shumin Zhai (2016) "IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty". In Proceedings of CHI 2016 - the SIGCHI Conference on Human Factors in Computing Systems. 49 - 58. [Acceptance Rate: 23.4%]

    Paper


    CHI 2016

    [18]. Chun Yu, Hongyi Wen, Wei Xiong, Xiaojun Bi, Yuanchun Shi (2016) "Investigating Effects of Post-selection Feedback for Acquiring Ultra-Small Targets on Touchscreen". In Proceedings of CHI 2016 - the SIGCHI Conference on Human Factors in Computing Systems. 4699 - 4710 [Acceptance Rate: 23.4%]

    Paper



      2015

    CHI 2015

    [17]. Brian Smith*, Xiaojun Bi, Shumin Zhai (2015) "Optimizing Touchscreen Keyboards for Gesture Typing". In Proceedings of CHI 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 3365-3374 [Acceptance Rate: 23%]

    *Brian Smith was a research intern supervised by Xiaojun Bi at Google. | Paper


    CHI 2015

    [16]. Andrew Fowler, Kurt Partridge, Ciprian Chelba, Xiaojun Bi, Tom Ouyang, Shumin Zhai (2015) "Effects of Language Modeling and its Personalization on Touchscreen Typing Performance". In Proceedings of CHI 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 649-658 [Acceptance Rate: 23%]

    Best Paper Honorable Mention Award | Paper



      2014

    CHI 2014

    [15]. Xiaojun Bi, Tom Ouyang, Shumin Zhai (2014) "Both Complete and Correct? Multi-Objective Optimization of Touchscreen Keyboard". In Proceedings of CHI 2014 - the SIGCHI Conference on Human Factors in Computing Systems. 2297-2306 [Acceptance Rate: 22.8%]

    Paper


    Human-Computer Interaction 2014, Volume 29

    [14]. Xiaojun Bi, Seok-Hyung Bae, Ravin Balakrishnan.(2014) "WallTop: Manage Overflowing Windows on a Large Display", Human-Computer Interaction. Volume 29, Issue 2, 153-203. [2014 Impact Factor: 3.143]

    Author's Accepted Manuscript, Version of Record at Taylor and Francis| Video



      2013

    CHI 2013

    [13]. Xiaojun Bi, Yang Li, Shumin Zhai (2013) "FFitts Law: Modeling Finger Touch with Fitts' Law". In Proceedings of CHI 2013 - the SIGCHI Conference on Human Factors in Computing Systems. 1363-1372 [Acceptance Rate: 20%]

    Google 2013 Influential Paper Award | Paper



    CHI 2013

    [12]. Xiaojun Bi, Shiri Azenkot, Kurt Partridge, Shumin Zhai (2013) "Octopus: Evaluating Touchscreen Keyboard Correction and Recognition Algorithms via Remulation ". In Proceedings of CHI 2013 - the SIGCHI Conference on Human Factors in Computing Systems. 543-552 [Acceptance Rate: 20%]

    Paper | Video



    UIST 2013

    [11]. Xiaojun Bi, Shumin Zhai (2013) "Bayesian Touch - A Statistic Criterion of Target Selection with Finger Touch". In Proceedings of UIST 2013 - The ACM Symposium on User Interface Software and Technology. 51-60 [Acceptance Rate: 20%]

    Paper



      2012

    UIST 2012

    [10]. Xiaojun Bi, Ciprian Chelba, Tom Ouyang, Kurt Partridge, Shumin Zhai. (2012) "Bimanual Gesture Keyboard", In Proceedings of UIST 2012 - The ACM Symposium on User Interface Software and Technology. 137-146 [Acceptance Rate 21.5%]

    Paper | Video
    Mobile interaction research at Google (An article on the Google Research Blog introduces the successful technology transfer)



    Human-Computer Interaction 2012, Volume 27

    [9]. Xiaojun Bi, Barton A. Smith, Shumin Zhai. (2012) "Multilingual Touchscreen Keyboard Design and Optimization", Human-Computer Interaction, Volume 27, Issue 4, 352-382. [2014 Impact Factor: 3.143]

    Author's Accepted Manuscript, Version of Record at Taylor and Francis



    CHI 2012

    [8]. Ken Hinckley, Xiaojun Bi, Michel Pahud, Bill Buxton. (2012) "Informal Information Gathering Techniques for Active Reading ". In Proceedings of CHI 2012 - the SIGCHI Conference on Human Factors in Computing Systems. 1893-1896. [Acceptance Rate: 23%]

    Paper | Video



    CHI 2012

    [7]. Yizhong Xin, Xiaojun Bi, Xiangshi Ren. (2012) "Natural Use Profiles for the Pen: An Empirical Exploration of Pressure, Tilt, and Azimuth ". In Proceedings of CHI 2012 - the SIGCHI Conference on Human Factors in Computing Systems. 801-804. [Acceptance Rate: 23%].

    Paper



      2011

    CHI 2011

    [6]. Xiaojun Bi , Tovi Grossman, Justin Matejka, George Fitzmaurice. (2011) "Magic Desk: Bringing Multi-Touch Surfaces into Desktop Work", In Proceedings of CHI 2011 - the SIGCHI Conference on Human Factors in Computing Systems. 2511-2520. [Acceptance Rate: 26%]

    Best Paper Honorable Mention Award | Paper | Video



    CHI 2011

    [5]. Yizhong Xin, Xiaojun Bi , Xiangshi Ren. (2011) "Acquiring and Pointing: An Empirical Study of Pen Tilt-Based Interaction.". In Proceedings of CHI 2011 - the SIGCHI Conference on Human Factors in Computing Systems. 849-858. [Acceptance Rate: 26%].

    Paper



      2010

    CHI 2010

    [4]. Xiaojun Bi , Seok-Hyung Bae, Ravin Balakrishnan. (2010) "Effects of Interior Bezels of Tiled-Monitor Large Displays on Visual Search, Tunnel Steering, and Target Selection.". In Proceedings of CHI 2010 - the SIGCHI Conference on Human Factors in Computing Systems. 65-74. [Acceptance Rate: 22%]

    Paper



    CHI 2010

    [3]. Xiaojun Bi, Barton A. Smith, Shumin Zhai. (2010) "Quasi-Qwerty Soft Keyboard Optimization". In Proceedings of CHI 2010 - the SIGCHI Conference on Human Factors in Computing Systems. 283-286. [Acceptance Rate: 22%]

    Paper



      2009

    CHI 2009

    [2]. Xiaojun Bi, Ravin Balakrishnan. (2009) "Comparing Usage of a Large High-Resolution Display to Single or Dual Desktop Displays for Daily Work". In Proceedings of CHI 2009 - the SIGCHI Conference on Human Factors in Computing Systems. 1005-1014. [Acceptance Rate: 25%]

    Paper



      2008

    UIST 2008

    [1]. Xiaojun Bi, Tomer Moscovich, Gonzalo Ramos, Ravin Balakrishnan, Ken Hinckley. (2008) "An Exploration of Pen Rolling for Pen-based Interaction". In Proceedings of UIST 2008 - The ACM Symposium on User Interface Software and Technology. 191-200. [Acceptance Rate: 18%]

    Paper | Video



    Top

    Workshop Papers

    [4]. Xiaojun Bi, Brian A. Smith and Shumin Zhai (2015) Keboard Layout Optimization. In CHI 2015 Workshop on Principles, Techniques and Perspectives on Optimization and HCI..

    [3]. Per Ola Kristensson, Xiaojun Bi, Andrew Howes, Antti Oulasvirta, Roderick Murray-Smith, Harold Thimbleby, John Williamson, Shumin Zhai (2015) Principles, Techniques and Perspectives on Optimization and HCI. In CHI EA 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 2441-2444.

    [2]. Hao-Chuan Wang, Gary Hsieh, Xiaojun Bi, Henry B. L. Duh, Yihsiu Chen (2015) Chinese CHI Symposium in CHI 2015. In CHI EA 2015 - the SIGCHI Conference on Human Factors in Computing Systems. 2313-2315.

    [1]. Shumin Zhai, Xiaojun Bi, Shiri Azenkot, Kurt Partridge (2013) "The Grand Challenge of Automated Evaluation of Text Input Systems". In CHI 2013 Workshop on Grand Challenges in Text Entry.

    Top

    Book Chapters and Edited Books

    [4] Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, Andrew Howes, editors. Computational interaction. Oxford University Press; 2018 Jan 10.

    [3] Xiaojun Bi, Brian Smith, Tom Ouyang, Shumin Zhai. Soft Keyboard Performance Optimization. Chapter 5 in Antti Oulasvirta, Per Ola Kristensson, Xiaojun Bi, Andrew Howes, (eds.), Computational Interaction. Oxford: Oxford University Press, 121 - 152.

    [2] Suwen Zhu, Xiangmin Fan, Feng Tian, Xiaojun Bi. Bayesian Command Selection. Chapter 4 In John Williamson, Antti Oulasvirta, Per Ola Kristensson, Nikola Banovic (eds.), Bayesian Methods for Interaction and Design. Cambridge: Cambridge University Press, 129 - 156. (In press)

    [1] Mingrui "Ray" Zhang, He Wen, Wenzhe Cui, Suwen Zhu, H.Andrew Schwartz, Xiaojun Bi and Jacob O. Wobbrock. (2021). AI-driven Intelligent Text Correction Techniques for Mobile Text Entry. Chapter 6 in Yang Li & Otmar Hilliges (eds.), Artificial Intelligence for Human Computer Interaction: A Modern Approach. Switzerland: Springer. (In press)

    Top

    Brief Biography

    Xiaojun Bi is an Associate Professor in the Department of Computer Science at Stony Brook University. Prior to joining Stony Brook, he was a Research Scientist at Google LLC. in California. Xiaojun Bi's research focuses on Human-AI interaction, AI-powered input technologies, multimodal interaction, probabilistic modeling of user interaction, and accessible input technologies. His innovations such as keyboard decoding algorithm (CHI 2014), bimanual gesture typing (UIST 2012), personalized language models(CHI 2015), and optimized keyboard layout have been commercialized in Google’s Android keyboard and adopted by billions of users worldwide. A Google AI blog article introduces the successful technology transfer of several of his inventions.

    Xiaojun Bi has authored over 50 publications in the premier Human Computer Interaction publication venues such as CHI and UIST, and has received 10 Best Paper or Honorable Mention awards. He is a two-time Google Faculty Research Award winner, a recipient of Google Award for Inclusion Research, and inventor of 33 US patents. Xiaojun Bi earned his Ph.D. from the Department of Computer Science at the University of Toronto, working with Ravin Balakrishnan. He received his Master's degree in Computer Science, and Bachelor's degree in Automation both from Tsinghua University. He won the first place in the National Mathematical Olympiad (China) in his home province when he was a high school student, recruited by Tsinghua University with National College Entrance Examination (Gaokao) waived. Despite an early offer from his dream school, Xiaojun Bi participated in Gaokao and ranked in the top 5 in his home province.

    Please refer to his full CV for detailed information about his research, teaching, and professional service.

    Top

    Patents (33 issued)

  • [P33]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 10,140,284. Filed: 4/4/2017. Issued: 11/27/2018

  • [P32]. Shumin Zhai, Xiaojun Bi, Yu Ouyang. Incremental multi-touch gesture recognition. US Patent: 9,021,380. Filed: 10/5/2012. Issued: 4/28/2015

  • [P31]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 8,806,384. Filed: 7/2/2014. Issued: 4/14/2015.

  • [P30]. Xiaojun Bi, Kurt Partridge, Yu Ouyang, Shumin Zhai. Character deletion during keyboard gesture. US Patent: 8,914,751. Filed: 1/14/2013. Issued: 12/16/2014

  • [P29]. Xiaojun Bi, Shumin Zhai and Michael Andrew Cleron. Dynamically-positioned character string suggestions for gesture typing. US Patent: 8,887,103. Filed: 1/20/2013. Issued: 11/11/2014

  • [P28]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 8,850,350. Filed: 10/16/2013. Issued: 9/30/2014

  • [P27]. Yu Ouyang, Shumin Zhai, Xiaojun Bi. Multi-gesture text input prediction. US Patent: 8,843,845. Filed: 4/8/2013. Issued: 9/23/2014

  • [P26]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 8,806,384. Filed: 10/24/2013. Issued: 8/12/2014

  • [P25]. Tom Ouyang, Shumin Zhai, Ciprian Chelba, Xiaojun Bi, Satoshi Kataoka, Ken Wakasa, Keisuke Kuroyanagi. Incremental feature-based gesture-keyboard decoding. US Patent: 8,782,549. Filed: 10/5/2012. Issued: 7/15/2014

  • [P24]. Shumin Zhai, Kurt Partridge, Xiaojun Bi, Tom Ouyang. Visual feedback deletion. US Patent: 8,584,049. Filed: 3/14/2013. Issued: 11/12/2013

  • [P23]. Xiaojun Bi, Barton Smith, Shumin Zhai. Method for optimization of soft keyboards for multiple languages. US Patent: 8,542,195. Filed: 3/30/2010. Issued: 9/24/2013

  • [P22]. Xiaojun Bi, Shumin Zhai. Touchscreen text input. US Patent: 8,405,630. Filed: 04/30/2012. Issued: 3/26/2013.

  • [P21]. Xiaojun Bi. Suggestion selection during continuous gesture input. US Patent: 9,996,258. Filed: 3/12/2015. Issued: 6/12/2018.

  • [P20]. Xiaojun Bi. Alternative gesture mapping for a graphical keyboard. US Patent: 9,952,763. Filed: 2/16/2015. Issued: 4/14/2018.

  • [P19]. Xiaojun Bi, Shumin Zhai. Thumb typing keyboard. US Patent: 9,262,075. Filed: 7/3/2014. Issued: 2/16/2016.

  • [P18]. Xiaojun Bi. Word prediction for numbers and symbols. US Patent:9,298,276. Filed: 12/31/2013. Issued: 3/29/2016.

  • [P17]. Shumin Zhai, Kurt Edward Partridge, Xiaojun Bi, Yu Ouyang. Gesture keyboard with gesture cancellation. US Patent: 9,569,107. Filed: 4/19/2013. Issued: 2/14/2017.

  • [P16]. Shumin Zhai, Kurt Edward Partridge, Xiaojun Bi, Yu Ouyang. Contextually-specific automatic separators. US Patent: 9,557,818 Filed: 3/4/2013. Issued: 1/31/2017

  • [P15]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,612,743. Filed:1/5/2011. Issued: 4/4/2017

  • [P14]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,600,090. Filed:1/5/2011. Issued: 3/21/2017

  • [P13]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 9,262,005 Filed:1/5/2011. Issued: 2/16/2016

  • [P12]. Tovi Grossman, Justin Frank Matejka,George Fitzmaurice, Xiaojun Bi. Multi-Touch Integrated Desktop Environment. US Patent: 8,988,366 Filed:1/5/2011. Issued: 3/24/2015

  • [P11]. Xiaojun Bi. Dynamic key mapping of a graphical keyboard. US Patent: 10,146,764. Filed: 4/4/2016. Issued: 12/4/2018.

  • [P10]. Xiaojun Bi. Apparatus and method for touchscreen keyboard suggestion word generation and display. US Patent: 9,952,764. Filed: 8/20/2015. Issued: 4/24/2018.

  • [P9]. Yu Ouyang, Shumin Zhai, Xiaojun Bi. Multi-gesture text input prediction. US Patent: 9,710,453. Filed: 9/4/2014. Issued: 7/18/2017

  • [P8]. Xiaojun Bi, Yu Ouyang, Shumin Zhai. Partial gesture text entry. US Patent: 9,678,943. Filed: 9/24/2014. Issued: 6/13/2017

  • [P7]. Xiaojun Bi, Kurt Partridge, Yu Ouyang, Shumin Zhai. Character deletion during keyboard gesture. US Patent: 9,665,276. Filed: 11/19/2014. Issued: 5/30/2017

  • [P6]. Xiaojun Bi. Display screen with animated graphical user interface. US Patent: D780,800. Filed: 11/19/2015. Issued: 3/7/2017.

  • [P5]. Xiaojun Bi. Display screen with animated graphical user interface. US Patent: D785,037. Filed: 7/3/2014. Issued: 4/25/2017.

  • [P4]. Tom Ouyang, Shumin Zhai, Ciprian Chelba, Xiaojun Bi, Satoshi Kataoka, Ken Wakasa, Keisuke Kuroyanagi. Incremental feature-based gesture-keyboard decoding. US Patent: 9,552,080 Filed: 7/14/2014. Issued: 1/24/2017

  • [P3]. Xiaojun Bi, Shumin Zhai and Michael Andrew Cleron. Dynamically-positioned character string suggestions for gesture typing. US Patent: 9,543,439. Filed: 11/10/2014. Issued: 1/17/2017

  • [P2]. Xiaojun Bi. Portion of a display panel with a computer icon. US Patent: D770,492. Filed: 8/22/2014. Issued: 11/1/2016.

  • [P1]. Xiaojun Bi. Keyboard gestures for character string replacement. US Patent: 9,009,624. Filed: 7/2/2014. Issued: 4/14/2015.

    •  Top

    Supervised Students

    Current Ph.D. Students:
    Yu-Jung Ko
    Dan Zhang
    Jeremy Chu
    Tony Li
    Ziang Chen
    Paul Zhu

    Graduated Students
    Suwen Zhu, Ph.D. (2020)
    Wenzhe Cui, Ph.D. (2022)
    Maozheng Zhao, Ph.D. (2023)
    Zhi Li, Ph.D. (2024)
    Yan Ma, Ph.D. (2025)
    Hang Zhao, Ph.D. (2025)

    Past Interns:
    Suwen Zhu, Stony Brook University, Summer 2016 at Google
    Brian Smith , Columbia University, Summer 2014 at Google

     Top

    Professional Services

  • Co-host.  The 5th Summer School on Computational Interaction (July 2019 at Columbia University)
  • Subcommittee Chair (Computational Interaction).  ACM Conference on Human Factors in Computing Systems (CHI) 2023, 2022
  • Program Committee Member.  ACM Conference on Human Factors in Computing Systems (CHI) 2021, 2020, 2019, 2018, 2017, 2016, 2015.
  • Program Committee Member.  ACM Symposium on User Interface Software and Technology (UIST) 2016, 2013.
  • Co-organizer.  CHI 2015 Workshop on Principles, Techniques and Perspectives on Optimization and HCI.
    •

     Top

    Teaching

  • CSE 594 Advanced Topics in Human Computer Interaction (Spring 2018)
  • CSE 591 Advanced Topics in Mobile Human Computer Interaction (Fall 2018)
  • CSE 518 Foundations of Human Computer Interaction (Fall 2019)
  • CSE/ISE/EST 323 Human Computer Interaction (Spring 2020)
  • CSE 518 Foundations of Human Computer Interaction (Fall 2020)
  • CSE/ISE/EST 323 Human Computer Interaction (Spring 2021)
  • CSE 518 Foundations of Human Computer Interaction (Fall 2021)
  • CSE/ISE/EST 323 Human Computer Interaction (Spring 2022)
  • CSE 518 Foundations of Human Computer Interaction (Fall 2022)
  • CSE/ISE/EST 323 Human Computer Interaction (Spring 2023)
  • CSE 518 Foundations of Human Computerputer Interaction (Fall 2024)
  • CSE/ISE/EST 323 Human Computer Interaction (Spring 2025)
  • CSE 518 Human Computer Interaction (Fall 2025)

    •  Top

    Last modified 11/20/2025