Welcome to Yafeng Yin's Homepage



Short Biography

I am an associate researcher of Department of Computer Science and Technology at Nanjing University. I received my Ph.D. degree from Nanjing University in 2017 under the supervision of Prof. Sanglu Lu and Prof. Lei Xie, and received my BE degree from Nanjing University of Science and Technology in 2011. From Sep. 2014 to Sep. 2015, I was a visiting research scholar in Department of Computer Science at the College of William and Mary, supervised by Prof. Qun Li and sponsored in part by China Scholarship Council (CSC).

Please move to my new homepage!


Research Interest

My research interests focus on camera/computer vision based human activity recognition, intelligent sensing with mobile devices, augmented reality, etc., including algorithm design and system implementation.


I am recruiting motivated Ph.D. or master students who would like to work on the above-mentioned areas. Undergraduate students who are interested in the related topics are also encouraged to contact me.


Projects

2022/01-2025/12: “Multi-modal Sensing based Activity Recognition on Mobile Devices”, sponsored by the National Natural Science Foundation of China, No. 62172208. (Principle Investigator)

2019/01-2021/12: “Efficient Activity Sensing and Recognition based on Mobile Devices”, sponsored by the National Natural Science Foundation of China, No. 61802169. (Principle Investigator)

2018/07-2021/06: “Multimodal Sensing and Activity Recognition based on Mobile Devices”, sponsored by the JiangSu Natural Science Foundation, No. BK20180325. (Principle Investigator)


Teaching

Data Communication

Distributed System


Publications

2023

  • Yafeng Yin, Zheng Wang, Kang Xia, Lei Xie, and Sanglu Lu. Acoustic-Based Lip Reading for Mobile Devices: Dataset, Benchmark and A Self Distillation-Based Approach. Accepted to appear in IEEE Transactions on Mobile Computing, 2023.

  • Shiwei Gan, Yafeng Yin*, Zhiwei Jiang, Lei Xie, and Sanglu Lu. Towards Real-Time Sign Language Recognition and Translation on Edge Devices. Accepted to appear in ACM International Conference on Multimedia (ACM MM), 2023.

  • Shiwei Gan, Yafeng Yin*, Zhiwei Jiang, Kang Xia, Lei Xie, and Sanglu Lu. Contrastive Learning for Sign Language Recognition and Translation. Accepted to appear in International Joint Conference on Artificial Intelligence (IJCAI), 2023.

  • Shiping Ge, Zhiwei Jiang, Yafeng Yin, Cong Wang, Zifeng Cheng and Qing Gu. Learning Event-Specific Localization Preferences for Audio-Visual Event Localization. Accepted to appear in ACM International Conference on Multimedia (ACM MM), 2023.

  • Zhiwei Jiang, Tianyi Gao, Yafeng Yin, Meng Liu, Hua Yu, Zifeng Cheng, and Qing Gu. Improving Domain Generalization for Prompt-Aware Essay Scoring via Disentangled Representation Learning. Accepted to appear in Annual Meeting of the Association for Computational Linguistics (ACL), 2023.

  • Cong Wang, Zhiwei Jiang, Yafeng Yin, Zifeng Cheng, Shiping Ge, and Qing Gu. Aggregating Multiple Heuristic Signals as Supervision for Unsupervised Automated Essay Scoring. Accepted to appear in Annual Meeting of the Association for Computational Linguistics (ACL), 2023.

  • Yuliang Liu, Zhiwei Jiang, Yafeng Yin, Cong Wang, Sheng Chen, Zhaoling Chen, and Qing Gu. Accepted to appear in International Conference on Research and Development in Information Retrieval (SIGIR), 2023.

  • Cong Wang, Zhiwei Jiang, Yafeng Yin, Zifeng Cheng, Shiping Ge, and Qing Gu. Controlling Class Layout for Deep Ordinal Classification via Constrained Proxies Learning. AAAI Conference on Artificial Intelligence (AAAI), 2023.

  • Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Cong Wang, Shiping Ge, and Qing Gu. A Consistent Dual-MRC Framework for Emotion-Cause Pair Extraction. ACM Transactions on Information Systems (TOIS), vol. 41, no. 4, article 105, 2023.

  • Shiping Ge, Zhiwei Jiang, Zifeng Cheng, Cong Wang, Yafeng Yin, and Qing Gu. Learning Robust Multi-Modal Representation for Multi-Label Emotion Recognition via Adversarial Masking and Perturbation. The Web Conference (WWW), 2023.

  • 2022

  • Hao Zhang, Yafeng Yin*, Lei Xie, Tao Gu, Minghui You and Sanglu Lu. DynaKey: Dynamic Keystroke Tracking using a Head-Mounted Camera Device. IEEE Internet of Things Journal, vol. 9, no. 9, pp. 6563-6577, 2022.

  • Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Cong Wang, and Qing Gu. Learning to Classify Open Intent via Soft Labeling and Manifold Mixup. IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 30:635-645, 2022.

  • 2021

  • Shiwei Gan, Yafeng Yin*, Zhiwei Jiang, Lei Xie, and Sanglu Lu. Skeleton-Aware Neural Sign Language Translation. ACM International Conference on Multimedia (ACM MM), 2021.

  • Yanling Bu, Lei Xie, Yafeng Yin, Chuyu Wang, Jingyi Ning, Jiannong Cao, and Sanglu Lu. Handwriting-Assistant: Reconstructing Continuous Strokes with Millimeter-level Accuracy via A!achable Inertial Sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), vol. 5, no. 4, article 146, 2021. (UbiComp 2022)

  • Zhiwei Jiang, Meng Liu, Yafeng Yin, Hua Yu, Zifeng Cheng, and Qing Gu. Learning from Graph Propagation via Ordinal Distillation for One-Shot Automated Essay Scoring. The Web Conference (WWW), 2021.

  • Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Na Li, and Qing Gu. A Unified Target-Oriented Sequence-to-Sequence Model for Emotion-Cause Pair Extraction. IEEE/ACM Transactions on Audio, Speech, and Language Processing (TASLP), 29:2779-2791, 2021.

  • 2020

  • Xinchen Zhang, Yafeng Yin*, Lei Xie, Hao Zhang, Zefan Ge, and Sanglu Lu. TouchID: User Authentication on Mobile Devices via Inertial-Touch Gesture Analysis. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), vol. 4, no. 4, article 162, 2020. (UbiComp 2021).

  • Hao Zhang, Yafeng Yin*, Lei Xie, and Sanglu Lu. AirTyping: A Mid-Air Typing Scheme based on Leap Motion. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers, pp. 168-171. 2020.

  • Lingyu Zhang, Yafeng Yin*, Lei Xie, and Sanglu Lu. HmwkCheck: A Homework Auto-Checking System based on Arithmetic Operation Recognition using Smartphones. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers, pp. 172-175. 2020.

  • Xinran Lu, Lei Xie, Yafeng Yin, Wei Wang, Yanling Bu, Qing Guo, and Sanglu Lu. SpeedTalker: Automobile Speed Estimation via Mobile Phones. Accepted to appear in IEEE Transactions on Mobile Computing, 2020. DOI: 10.1109/TMC.2020.3034354.

  • Fei Han, Lei Xie, Yafeng Yin, Hao Zhang, Guihai Chen, and Sanglu Lu. Video Stabilization for Camera Shoot in Mobile Devices via Inertial-Visual State Tracking. Accepted to appear in IEEE Transactions on Mobile Computing, 2020. DOI: 10.1109/TMC.2019.2961313.

  • Zifeng Cheng, Zhiwei Jiang, Yafeng Yin, Hua Yu, and Qing Gu. A Symmetric Local Search Network for Emotion-Cause Pair Extraction. Proceedings of the 28th International Conference on Computational Linguistics (COLING), 139–149, 2020.

  • 2019

  • Yafeng Yin, Lei Xie, Tao Gu, Yijia Lu and Sanglu Lu. AirContour: Building Contour-based Model for in-Air Writing Gesture Recognition. ACM Transactions on Sensor Networks, vol. 15, no. 4, No. 44, 2019.

  • Zhiwei Jiang, Qing Gu, Yafeng Yin, Jiangxiang Wang, and Daoxu Chen. GRAW+: A Two-View Graph Propagation Method with Word Coupling for Readability Assessment. Journal of the Association for Information Science and Technology, vol. 70, no. 5, pp.433-447, 2019.

  • 2018

  • Yafeng Yin, Qun Li, Lei Xie, Shanhe Yi, Ed Novak, and Sanglu Lu. CamK: Camera-based Keystroke Detection and Localization for Small Mobile Devices. IEEE Transactions on Mobile Computing, vol. 17, no. 10, pp. 2236-2251, 2018.

  • Zhiwei Jiang, Qing Gu, Yafeng Yin, and Daoxu Chen. Enriching Word Embedding with Domain Knowledge for Readability Assessment. International Conference on Computational Linguistics (COLING), 2018.

  • Lei Xie, Qingliang Cai, Alex X. Liu, Wei Wang, Yafeng Yin, and Sanglu Lu. Synchronize Inertial Readings from Multiple Mobile Devices in Spatial Dimension. IEEE/ACM Transactions on Networking, vol. 26, no. 5, pp. 2146-2159, 2018.

  • 2017

  • Yafeng Yin, Lei Xie, Yuanyuan Fan, and Sanglu Lu. Tracking Human Motions in Photographing: A Context-Aware Energy-Saving Scheme for Smart Phones. ACM Transactions on Sensor Networks, vol. 13, no. 4, pp. 29, 2017.

  • Yijia Lu, Fei Han, Lei Xie, Yafeng Yin, Congcong Shi, and Sanglu Lu. I am the UAV: A Wearable Approach for Manipulations of Unmanned Aerial Vehicle. IEEE SmartComp [WIP/Demo Paper], 2017.

  • 2016

  • Yafeng Yin, Lei Xie, Jie Wu, and Sanglu Lu. Focus and Shoot: Exploring Auto-Focus in RFID Tag Identification Towards a Specified Area. IEEE Transactions on Computers, vol. 65, no. 3, pp. 888-901, 2016.

  • Yafeng Yin, Qun Li, Lei Xie, Shanhe Yi, Edmund Novak, and Sanglu Lu. CamK: a Camera-based Keyboard for Small Mobile Devices. Proc. of IEEE INFOCOM, 2016. (Best-in-Session Presentation Award)

  • Shanhe Yi, Zhengrui Qin, Ed Novak, Yafeng Yin, and Qun Li. GlassGesture: Exploring Head Gesture Interface of Smart Glasses. Proc. of IEEE INFOCOM, 2016.

  • 2015

  • Yuanyuan Fan, Lei Xie, Yafeng Yin, and Sanglu Lu. A Context Aware Energy-Saving Scheme for Smart Camera Phones based on Activity Sensing. Proc. of IEEE MASS, 2015.

  • Hao Ji, Lei Xie, Chuyu Wang, Yafeng Yin and Sanglu Lu. CrowdSensing: a Crowd-Sourcing based Indoor Navigation using RFID-based Delay Tolerant Network. Journal of Network and Computer Applications, vol. 52, pp. 79-89, 2015.

  • 2014

  • Yafeng Yin, Lei Xie, Sanglu Lu, and Daoxu Chen. Check out the Rules: towards Time-Efficient Rule Checking over RFID Tags. Mobile Networks and Applications, vol. 19, no. 4, pp. 524-533, 2014.

  • Lei Xie, Yafeng Yin, Athanasios V. Vasilakos, and Sanglu Lu. Managing RFID Data: Challenges, Opportunities and Solutions. IEEE Communications Surveys and Tutorials, vol. 16, no.3, pp. 1294-1311, 2014.

  • Xiang Lu, Lei Xie, Yafeng Yin, Wei Wang, Baoliu Ye, and Sanglu Lu. Efficient Localization based on Imprecise Anchors in RFID System. Proc. of IEEE ICC, 2014.

  • 2013

  • Yafeng Yin, Lei Xie, Jie Wu, Athanasios V. Vasilakos, and Sanglu Lu. Focus and Shoot: Efficient Identification over RFID Tags in the Specified Area. Proc. of MobiQuitous, 2013. (Best Paper Award)

  • Yafeng Yin, Lei Xie, Sanglu Lu, and Daoxu Chen. Efficient Protocols for Rule Checking in RFID Systems. Proc. of IEEE ICCCN, 2013.

  • Lei Xie, Yafeng Yin, Xiang Lu, Bo Sheng and Sanglu Lu. iFridge: An Intelligent Fridge for Food Management based on RFID Technology. Proc. of ACM UbiComp, 2013. [Video Paper]

  • Lei Xie, Yafeng Yin, Xi Chen, Sanglu Lu, and Daoxu Chen. RFID Data Management: Algorithms, Protocols and Performance Evaluation. Chinese Journal of Computers, vol. 36, no. 3, pp. 457-470, 2013.

  • Hao Ji, Lei Xie, Yafeng Yin, and Sanglu Lu. An Efficient Indoor Navigation Scheme Using RFID-based Delay Tolerant Network. Proc. of IEEE GLOBECOM, 2013.

  • Selected Awards

  • 2018 ACM Nanjing Rising Star Award

  • 2018 Jiangsu Computer Society Outstanding Doctoral Dissertation Award

  • 2018 Outstanding Doctoral Dissertation Award at Nanjing University

  • 2017 Six Talent Peaks Project in Jiangsu Province

  • 2017 ACM Nanjing Doctoral Dissertation Award (Ranking first)

  • 2016 Program A for outstanding PhD candidate of Nanjing University (Only 9 students at Nanjing University)

  • 2016 Best-in-Session Presentation Award in IEEE INFOCOM 2016

  • 2015 National Scholarship for doctoral students

  • 2015 Google Anita Borg Memorial Scholarship Asia Pacific (Only 9 winners from China Mainland)

  • 2015 President Special Scholarship for Doctoral Student at Nanjing University (Only two CS Ph.D. students)

  • 2014 Joint-PhD Student Scholarship of China Scholarship Council

  • 2013 Best Paper Award in MobiQuitous 2013 (Only one paper won the award)

  • 2013 National Grand Prize for the Third National Contest of Innovative Application Design

  • 2011 Excellence plan at Nanjing University

  • Students

  • PhD Students
  • Shiwei Gan (2019-present)

  • Master Students
  • Zhong Liu (2020-present)
    Minghui You (2020-present)

  • Alumni
  • Hao Zhang (Master 2018, Microsoft)
    Xinchen Zhang (Master 2018, Alibaba)
    Zheng Wang (Master 2019, ByteDance)


    Contact

    Room 901, Department of Computer Science and Technology,
    Nanjing University, Xianlin Campus,
    163 Xianlin Avenue, Qixia District,
    Nanjing 210023, China