Home Activity Recognition for Rural Elderly Based on Deep Learning and Smartphone Sensors

Human Behavior Data Acquisition Technology

Human behavior data acquisition technology involves various methods and tools to capture and record individual behaviors, interactions, and responses. The following are six common categories of human behavior data acquisition technologies.

• 1.

  Sensor technology (Arshad et al., 2022)

  • a.

    Accelerometers and gyroscopes: Measure and record body movement and orientation

  • b.

    Heart rate monitors: Measure heart rate through sensors, providing data on physiological activation levels

  • c.

    GPS (Global Positioning System): Tracks and records individuals’ locations and movement trajectories (Wang et al., 2022)

  • d.

    Electronic skin sensors ( Zarei et al., 2023 ): Monitor skin physiological indicators, such as conductivity and temperature

• 2.

  Wearable devices (Gu et al., 2021)

  • a.

    Smartwatches and health trackers ( Lateef & Abbas, 2022 ): Continuously monitor physiological indicators like movement, sleep, and heart rate

  • b.

    Smart glasses ( Mekruksavanich & Jitpattanakul, 2022 ): Record visual information and user perspectives through embedded cameras

  • c.

    Smart clothing ( Q. Li et al., 2022 ): Includes integrated sensors to monitor physiological data and movement

• 3.

  Cameras and computer vision technology (Host & Ivašić-Kos, 2022)

  • a.

    Behavioral analysis: Uses cameras and computer vision algorithms to analyze human movements, expressions, and postures

  • b.

    Emotion recognition: Infers emotion states through the analysis of facial expressions and body language

• 4.

  Speech and audio analysis

  • a.

    Speech recognition: Used to transcribe and analyze speech data, understanding spoken content

  • b.

    Affective acoustic analysis: Inference of the speaker’s emotional state through the analysis of audio features

• 5.

  Internet of things (IoT) and environmental sensors (Al-Shabi & Abuhamdah, 2022)

  • a.

    Smart home sensors: Monitor environmental conditions such as temperature, humidity, and light

  • b.

    Environmental sound sensors: Detect sounds in the environment, providing background information

• 6.

  Virtual reality (VR) and augmented reality (AR) technology

  • a.

    Eye tracking ( Holmqvist et al., 2023 ): Measures user gaze points and attention in virtual or augmented reality environments

  • b.

    Gesture recognition ( Mahmoud et al., 2022 ): Interprets user interactions with virtual objects by tracking gestures

These technologies are often combined to obtain more comprehensive human behavior data, providing in-depth insights for research and applications in various fields.