Osaka City University, Japan
* Corresponding author
The University of Tokyo, Japan

Article Main Content

In this study, we extract agricultural (agri-) workers’ physical acceleration timeline data and execute quantum neural network-based deep learning for data classification. Although various approaches have been implemented globally for indoor and outdoor agri-working sites, there is still scope for improvement. Therefore, in this study, we adapt these approaches mainly for automated, high-tech agri-sites and apply the quantum convolutional neural network (QCNN) deep learning-based method to qualitatively demonstrate the classification of physical workers’ timeline datasets. For our dataset, our subjects were six experienced and six completely inexperienced male agri-manual workers. The target task was to cultivate a farmland using a simple traditional Japanese hoe in a semi-crouching position. We captured the subjects’ acceleration data using an integrated multi-sensor module mounted on a wooden lilt 150 mm from the gripping position of the dominant hand. We developed and used Python (ver. 3.9) and recent distributed libraries for quantum computation and distributed concerned libraries. For data classification, we successively executed three patterns using QCNN, a category of quantum deep learning (QDL)-based deep learning, and evaluated the systems by obtaining loss, validation accuracy, and final epochs’ elapsed time data. These methods of analyzing digital data are expected to find practical applications and provide key suggestions for improving daily task efficiency.

References

  1. S. Zhao, Z. Zhang, D. Xiao, and K. Xiao, “A Turning Model of Agricultural Robot Based on Acceleration Sensor,” IFAC-PapersOnLine, vol. 49, no.16, pp. 445-450, August 2016.
     Google Scholar
  2. T. Duckett, S. Pearson, S. Blackmore, B. Grieve, W. H. G. Chen, P. F. Cielniak, “The future of robotic agriculture,” Agricultural robotics, arXiv preprint arXiv:1806.06762, August 2018.
     Google Scholar
  3. S. Kawakura, and R. Shibasaki, “Statistical Analysis of Index Values Extracted from Outdoor Agricultural Workers Motion Data,” Journal of Advanced Agricultural Technologies, vol. 1, no. 1, pp. 69-74, Jan. 2014.
     Google Scholar
  4. H. Orii, S. Tsuji, T. Kouda, and T. Kohama, “Tactile texture recognition using convolutional neural networks for time-series data of pressure and 6-axis acceleration sensor,” Proceedings of 2017 IEEE International Conference on Industrial Technology (ICIT), pp. 1076-1080, March 2017.
     Google Scholar
  5. N. Dawar, and N. Kehtarnavaz, “Action detection and recognition in continuous action streams by deep learning-based sensing fusion,” IEEE Sensors Journal, vol. 18, no. 23, pp. 9660-9668, Sep. 2018.
     Google Scholar
  6. W. Jiang, and Z. Yin, “Human activity recognition using wearable sensors by deep convolutional neural networks,” Proceedings of the 23rd ACM international conference on Multimedia, pp.1307-1310, Oct. 2015.
     Google Scholar
  7. J. Jang, A. Ankit, J. Kim, Y. Jang, H. Kim, J. Kim, and S. Xiong, “A unified deep-learning model for classifying the cross-country skiing techniques using wearable gyroscope sensors,” Sensors, vol. 18, no. 11, 3819, Nov. 2018.
     Google Scholar
  8. M. M. Hassan, M. Z. Uddin, A. Mohamed, and A. Almogren, “A robust human activity recognition system using smartphone sensors and deep learning,” Future Generation Computer Systems, vol. 81, 307-313, April 2018.
     Google Scholar
  9. Y. Du, M. H. Hsieh, T. Liu, S. You, and D. Tao, “On the learnability of quantum neural networks,” arXiv preprint arXiv:2007.12369, July 2020.
     Google Scholar
  10. A. Gulli, and S. Pal, Chokkan Deep Learning ―Python×Keras De Aidea Wo Katachi Nisuru Recipe; Tokyo, Japan: Ohmesha Inc, 2018.
     Google Scholar
  11. T. Niimura, TensorFlow De Hajimeru DeepLearning Jissou Nyuumon; Tokyo, Japan: Impress Inc., 2018.
     Google Scholar
  12. Y. Ogawa, PyTorch Ni Yoru Hatten Deep Deep Learning; Tokyo, Japan: Mainavi Publishing Inc., 2019.
     Google Scholar
  13. Tangent, Jisedai Jinkou Chinou Syori: Neural Network No Ryoushika; Tokyo, Japan: Amazon Services International, Inc., 2020.
     Google Scholar
  14. I. Cong, S. Choi, and M. D. Lukin, “Quantum convolutional neural networks,” Nature Physics, vol. 15, no. 12, pp. 1273-1278, Sep. 2019.
     Google Scholar
  15. Z. Zhang, D. Chen, J. Wang, L. Bai, and E. R. Hancock, “Quantum-based subgraph convolutional neural networks,” Pattern Recognition, vol. 88, pp. 38-49, Nov. 2018.
     Google Scholar
  16. J. Liu, K. H. Lim, K. L. Wood, W. Huang, C. Guo, and H. L. Huang, “Hybrid Quantum-Classical Convolutional Neural Networks,” arXiv preprint arXiv:1911.02998, Nov. 2019.
     Google Scholar
  17. N. Killoran, T. R. Bromley, J. M. Arrazola, M. Schuld, N. Quesada, and S. Lloyd, “Continuous-variable quantum neural networks,” Physical Review Research, vol. 1, no. 3, pp. 033063-1-033063-22, Jan. 2018.
     Google Scholar
  18. A. Kamruzzaman, Y. Alhwaiti, A. Leider, and C. C. Tappert, “Quantum deep learning neural networks,” Proceedings of Future of Information and Communication Conference, Springer, Cham, pp. 311, Feb. 2019.
     Google Scholar
  19. S. Oh, J. Choi, and J. Kim, “A Tutorial on Quantum Convolutional Neural Networks (QCNN),” arXiv preprint arXiv:2009.09423, Sep. 2020.
     Google Scholar
  20. Z. A. Jia, B. Yi, R. Zhai, Y. C. Wu, G. C. Guo, and G. P. Guo, “Quantum neural network states: A brief review of methods and applications,” Advanced Quantum Technologies, vol. 2, no. 7-8, pp. 1800077-1-1800077-8, August 2019.
     Google Scholar
  21. T. Du, X. Ren, and H. Li, “Gesture recognition method based on deep learning,” Proceedings of IEEE 2018 33rd Youth Academic Annual Conference of Chinese Association of Automation (YAC), pp. 782-787, May 2018.
     Google Scholar
  22. S. Garg and G. Ramakrishnan, “Advances in Quantum Deep Learning: An Overview,” arXiv preprint arXiv:2005. pp. 04316-1-04316-17, August 2020.
     Google Scholar
  23. R. J. Eric, H. Nic, and G. Mercedes, “Ugokashite Manabu Ryoshi Computer Programing,” Tokyo, Japan: Reilly Japan, Inc., August 2020.
     Google Scholar
  24. TensorFlow Community, Official Website of Tensorflow Org, Guide & Tutorials of "Quantum Convolutional Neural Network", Available: https://www.tensorflow.org/quantum/tutorials/qcnn?hl=en.
     Google Scholar