Human Imitation Manipulator System Based on 2D Image Recognition 


Vol. 49,  No. 5, pp. 773-781, May  2024
10.7840/kics.2024.49.5.773


PDF
  Abstract

This paper proposes a control system that uses deep learning to extract the positions of joints from shoulder to hand from 2D images, enabling a manipulator to mimic human movements. The proposed system utilizes a 2D camera to capture the appearance of a person as an image, and employs deep learning-based object recognition techniques to extract 3D coordinates of joints from the images. The extracted coordinates are then converted into vectors to obtain joint-specific rotation angles, which are subsequently used as input for controlling the manipulator. The simulation environment is implemented using ROS Gazebo and Moveit packages, while the actual robot control is conducted using Python and C++ for improved response speed. The functionality of the proposed system is validated through simulations and by employing a manipulator.

  Statistics
Cumulative Counts from November, 2022
Multiple requests among the same browser session are counted as one view. If you mouse over a chart, the values of data points will be shown.


  Related Articles
  Cite this article

[IEEE Style]

J. S. Park and S. Y. Shin, "Human Imitation Manipulator System Based on 2D Image Recognition," The Journal of Korean Institute of Communications and Information Sciences, vol. 49, no. 5, pp. 773-781, 2024. DOI: 10.7840/kics.2024.49.5.773.

[ACM Style]

Jin Su Park and Soo Young Shin. 2024. Human Imitation Manipulator System Based on 2D Image Recognition. The Journal of Korean Institute of Communications and Information Sciences, 49, 5, (2024), 773-781. DOI: 10.7840/kics.2024.49.5.773.

[KICS Style]

Jin Su Park and Soo Young Shin, "Human Imitation Manipulator System Based on 2D Image Recognition," The Journal of Korean Institute of Communications and Information Sciences, vol. 49, no. 5, pp. 773-781, 5. 2024. (https://doi.org/10.7840/kics.2024.49.5.773)
Vol. 49, No. 5 Index

Search
(IN TITLE, AUTHOR, ABSTRACT,KEYWORDS)

Advanced Search ▼

POPULAR KEYWORDS
(TOP 10 KEYWORDS)

Recent Publications
(LAST 3 YEARS)






pISSN : 1226 - 4717
eISSN : 2287 - 3880