- Browse by Author
Browsing by Author "Guo, Xiaonan"
Now showing 1 - 9 of 9
Results Per Page
Sort Options
Item Environment-independent In-baggage Object Identification Using WiFi Signals(IEEE Xplore, 2021-10) Shi, Cong; Zhao, Tianming; Xie, Yucheng; Zhang, Tianfang; Wang, Yan; Guo, Xiaonan; Chen, Yingying; Engineering Technology, School of Engineering and TechnologyLow-cost in-baggage object identification is highly demanded in enhancing public safety and smart manufacturing. Existing approaches usually require specialized equipment and heavy deployment overhead, making them hard to scale for wide deployment. The recent WiFi-based approach is unsuitable for practical deployment as it did not address dynamic environmental impacts. In this work, we propose an environment-independent in-baggage object identification system by leveraging low-cost WiFi. We exploit the channel state information (CSI) to capture material and shape characteristics to facilitate fine-grained inbaggage object identification. A major challenge of building such a system is that CSI measurements are sensitive to real-world dynamics, such as different types of baggage, time-varying ambient noises and interferences, and different deployment environments. To tackle these problems, we develop WiFi features based on polarized directional antennas that can capture objects’ material and shape characteristics. A convolutional neural network-based model is developed to constructively integrate the WiFi features and perform accurate in-baggage object identification. We also develop a material-based domain adaptation using adversarial learning to facilitate fast deployments in different environments. We conduct extensive experiments involving 14 representation objects, 4 types of bags in 3 different room environments. The results show that our system can achieve over 97% in the same environment, and our domain adaptation method can improve the object identification accuracy by 42% when the system is deployed in a new environment with little training.Item Inferring Mobile Payment Passcodes Leveraging Wearable Devices(ACM, 2018-10) Wang, Chen; Liu, Jian; Guo, Xiaonan; Wang, Yan; Chen, Yingying; Computer and Information Science, School of ScienceMobile payment has drawn considerable attention due to its convenience of paying via personal mobile devices at anytime and anywhere, and passcodes (i.e., PINs) are the first choice of most consumers to authorize the payment. This work demonstrates a serious security breach and aims to raise the awareness of the public that the passcodes for authorizing transactions in mobile payments can be leaked by exploiting the embedded sensors in wearable devices (e.g., smartwatches). We present a passcode inference system, which examines to what extent the user's PIN during mobile payment could be revealed from a single wrist-worn wearable device under different input scenarios involving either two hands or a single hand. Extensive experiments with 15 volunteers demonstrate that an adversary is able to recover a user's PIN with high success rate within 5 tries under various input scenarios.Item A Machine Learning Based Visible Light Communication Model Leveraging Complementary Color Channel(2020-08) Jiang, Ruizhe; King, Brian; Guo, Xiaonan; Xiao, LuoRecently witnessed a great popularity of unobtrusive Visible Light Communication (VLC) using screen-camera channels. They overcomes the inherent drawbacks of traditional approaches based on coded images like bar codes. One popular unobtrusive method is the utilizing of alpha channel or color channels to encode bits into the pixel translucency or color intensity changes with over-the-shelf smart devices. Specifically, Uber-in-light proves to be an successful model encoding data into the color intensity changes that only requires over-the-shelf devices. However, Uber-in-light only exploit Multi Frequency Shift Keying (MFSK), which limits the overall throughput of the system since each data segment is only 3-digit long. Motivated by some previous works like Inframe++ or Uber-in-light, in this thesis, we proposes a new VLC model encoding data into color intensity changes on red and blue channels of video frames. Multi-Phase-Shift-Keying (MPSK) along with MFSK are used to match 4-digit and 5-digit long data segments to specific transmission frequencies and phases. To ensure the transmission accuracy, a modified correlation-based demodulation method and two learning-based methods using SVM and Random Forest are also developed.Item mmFit: Low-Effort Personalized Fitness Monitoring Using Millimeter Wave(IEEE, 2022) Xie, Yucheng; Jiang, Ruizhe; Guo, Xiaonan; Wang, Yan; Cheng, Jerry; Chen, Yingying; Electrical and Computer Engineering, Purdue School of Engineering and TechnologyThere is a growing trend for people to perform work-outs at home due to the global pandemic of COVID-19 and the stay-at-home policy of many countries. Since a self-designed fitness plan often lacks professional guidance to achieve ideal outcomes, it is important to have an in-home fitness monitoring system that can track the exercise process of users. Traditional camera-based fitness monitoring may raise serious privacy concerns, while sensor-based methods require users to wear dedicated devices. Recently, researchers propose to utilize RF signals to enable non-intrusive fitness monitoring, but these approaches all require huge training efforts from users to achieve a satisfactory performance, especially when the system is used by multiple users (e.g., family members). In this work, we design and implement a fitness monitoring system using a single COTS mm Wave device. The proposed system integrates workout recognition, user identification, multi-user monitoring, and training effort reduction modules and makes them work together in a single system. In particular, we develop a domain adaptation framework to reduce the amount of training data collected from different domains via mitigating impacts caused by domain characteristics embedded in mm Wave signals. We also develop a GAN-assisted method to achieve better user identification and workout recognition when only limited training data from the same domain is available. We propose a unique spatialtemporal heatmap feature to achieve personalized workout recognition and develop a clustering-based method for concurrent workout monitoring. Extensive experiments with 14 typical workouts involving 11 participants demonstrate that our system can achieve 97% average workout recognition accuracy and 91% user identification accuracy.Item Non-intrusive Wireless Sensing with Machine Learning(2023-08) Xie, Yucheng; Li, Lingxi; Li, Feng; Guo, Xiaonan; King, BrianThis dissertation explores the world of non-intrusive wireless sensing for diet and fitness activity monitoring, in addition to assessing security risks in human activity recognition (HAR). It delves into the use of WiFi and millimeter wave (mmWave) signals for monitoring eating behaviors, discerning intricate eating activities, and observing fitness movements. The proposed systems harness variations in wireless signal propagation to record human behavior while providing exhaustive details on dietary and exercise habits. Significant contributions encompass unsupervised learning methodologies for detecting dietary and fitness activities, implementing soft-decision and deep neural networks for assorted activity recognition, constructing tiny motion mechanisms for subtle mouth muscle movement recovery, employing space-time-velocity features for multi-person tracking, as well as utilizing generative adversarial networks and domain adaptation structures to enable less cumbersome training efforts and cross-domain deployments. A series of comprehensive tests validate the efficacy and precision of the proposed non-intrusive wireless sensing systems. Additionally, the dissertation probes the security vulnerabilities in mmWave-based HAR systems and puts forth various sophisticated adversarial attacks - targeted, untargeted, universal, and black-box. It designs adversarial perturbations aiming to deceive the HAR models whilst striving to minimize detectability. The research offers powerful insights into issues and efficient solutions relative to non-intrusive sensing tasks and security challenges linked with wireless sensing technologies.Item When Your Wearables Become Your Fitness Mate(Elsevier, 2020-05) Guo, Xiaonan; Liu, Jian; Chen, Yingying; Computer Information and Graphics Technology, School of Engineering and TechnologyAcknowledging the powerful sensors on wearables and smartphones enabling various applications to improve users' life styles and qualities (e.g., sleep monitoring and running rhythm tracking), this paper takes one step forward developing FitCoach, a virtual fitness coach leveraging users' wearable mobile devices (including wrist-worn wearables and arm-mounted smartphones) to assess dynamic postures (movement patterns & positions) in workouts. FitCoach aims to help the user to achieve effective workout and prevent injury by dynamically depicting the short-term and long-term picture of a user's workout based on various sensors in wearable mobile devices. In particular, FitCoach recognizes different types of exercises and interprets fine-grained fitness data (i.e., motion strength and speed) to an easy-to-understand exercise review score, which provides a comprehensive workout performance evaluation and recommendation. Our system further enables contactless device control during workouts (e.g., gesture to pick up an incoming call) through distinguishing customized gestures from regular exercise movement. In addition, FitCoach has the ability to align the sensor readings from wearable devices to the human coordinate system, ensuring the accuracy and robustness of the system. Extensive experiments with over 5000 repetitions of 12 types of exercises involve 12 participants doing both anaerobic and aerobic exercises in indoors as well as outdoors. Our results demonstrate that FitCoach can provide meaningful review and recommendations to users by accurately measure their workout performance and achieve and accuracy for workout analysis and customized control gesture recognition, respectively.Item Wi-Fi-Enabled Automatic Eating Moment Monitoring Using Smartphones(Springer, 2020) Lin, Zhenzhe; Xie, Yucheng; Guo, Xiaonan; Wang, Chen; Ren, Yanzhi; Chen, Yingying; Computer Information and Graphics Technology, School of Engineering and TechnologyDietary habits are closely correlated with people’s health. Study reveals that unhealthy eating habits may cause various diseases such as obesity, diabetes and anemia. To help users create good eating habits, eating moment monitoring plays a significant role. However, traditional methods mainly rely on manual self-report or wearable devices, which either require much user efforts or intrusive dedicated hardware. In this work, we propose a user effort-free eating moment monitoring system by leveraging the WiFi signals extracted from the commercial off-the-shelf (COTS) smartphones. In particular, our system captures the eating activities of users to determine the eating moments. The proposed system can further identify the fine-grained food intake gestures (e.g., eating with fork, knife, spoon, chopsticks and bard hand) to estimate the detailed eating episode for each food intake gesture. Utilizing the dietary information, our system shows the potential to infer the food category and food amount. Extensive experiments with 10 subjects over 400-min eating show that our system can recognize a user’s food intake gestures with up to 97.8% accuracy and estimate the dietary moment within 1.1-s error.Item WiFi-Enabled Smart Human Dynamics Monitoring(ACM, 2017-11) Guo, Xiaonan; Liu, Bo; Shi, Cong; Liu, Hongbo; Chen, Yingying; Chuah, Mooi Choo; Computer and Information Science, School of ScienceThe rapid pace of urbanization and socioeconomic development encourage people to spend more time together and therefore monitoring of human dynamics is of great importance, especially for facilities of elder care and involving multiple activities. Traditional approaches are limited due to their high deployment costs and privacy concerns (e.g., camera-based surveillance or sensor-attachment-based solutions). In this work, we propose to provide a fine-grained comprehensive view of human dynamics using existing WiFi infrastructures often available in many indoor venues. Our approach is low-cost and device-free, which does not require any active human participation. Our system aims to provide smart human dynamics monitoring through participant number estimation, human density estimation and walking speed and direction derivation. A semi-supervised learning approach leveraging the non-linear regression model is developed to significantly reduce training efforts and accommodate different monitoring environments. We further derive participant number and density estimation based on the statistical distribution of Channel State Information (CSI) measurements. In addition, people's walking speed and direction are estimated by using a frequency-based mechanism. Extensive experiments over 12 months demonstrate that our system can perform fine-grained effective human dynamic monitoring with over 90% accuracy in estimating participants number, density, and walking speed and direction at various indoor environments.Item WristSpy: Snooping Passcodes in Mobile Payment Using Wrist-worn Wearables(IEEE, 2019-04) Wang, Chen; Liu, Jian; Guo, Xiaonan; Wang, Yan; Chen, Yingying; Computer Information and Graphics Technology, School of Engineering and TechnologyMobile payment has drawn considerable attention due to its convenience of paying via personal mobile devices at anytime and anywhere, and passcodes (i.e., PINs or patterns) are the first choice of most consumers to authorize the payment. This paper demonstrates a serious security breach and aims to raise the awareness of the public that the passcodes for authorizing transactions in mobile payments can be leaked by exploiting the embedded sensors in wearable devices (e.g., smartwatches). We present a passcode inference system, WristSpy, which examines to what extent the user's PIN/pattern during the mobile payment could be revealed from a single wrist-worn wearable device under different passcode input scenarios involving either two hands or a single hand. In particular, WristSpy has the capability to accurately reconstruct fine-grained hand movement trajectories and infer PINs/patterns when mobile and wearable devices are on two hands through building a Euclidean distance-based model and developing a training-free parallel PIN/pattern inference algorithm. When both devices are on the same single hand, a highly challenging case, WristSpy extracts multi-dimensional features by capturing the dynamics of minute hand vibrations and performs machine-learning based classification to identify PIN entries. Extensive experiments with 15 volunteers and 1600 passcode inputs demonstrate that an adversary is able to recover a user's PIN/pattern with up to 92% success rate within 5 tries under various input scenarios.