Quantum Neural Network-Based Deep Learning System to Classify Physical Timeline Acceleration Data of Agricultural Workers
Article Main Content
In this study, we extract agricultural (agri-) workers’ physical acceleration timeline data and execute quantum neural network-based deep learning for data classification. Although various approaches have been implemented globally for indoor and outdoor agri-working sites, there is still scope for improvement. Therefore, in this study, we adapt these approaches mainly for automated, high-tech agri-sites and apply the quantum convolutional neural network (QCNN) deep learning-based method to qualitatively demonstrate the classification of physical workers’ timeline datasets. For our dataset, our subjects were six experienced and six completely inexperienced male agri-manual workers. The target task was to cultivate a farmland using a simple traditional Japanese hoe in a semi-crouching position. We captured the subjects’ acceleration data using an integrated multi-sensor module mounted on a wooden lilt 150 mm from the gripping position of the dominant hand. We developed and used Python (ver. 3.9) and recent distributed libraries for quantum computation and distributed concerned libraries. For data classification, we successively executed three patterns using QCNN, a category of quantum deep learning (QDL)-based deep learning, and evaluated the systems by obtaining loss, validation accuracy, and final epochs’ elapsed time data. These methods of analyzing digital data are expected to find practical applications and provide key suggestions for improving daily task efficiency.
References
-
S. Zhao, Z. Zhang, D. Xiao, and K. Xiao, “A Turning Model of Agricultural Robot Based on Acceleration Sensor,” IFAC-PapersOnLine, vol. 49, no.16, pp. 445-450, August 2016.
Google Scholar
1
-
T. Duckett, S. Pearson, S. Blackmore, B. Grieve, W. H. G. Chen, P. F. Cielniak, “The future of robotic agriculture,” Agricultural robotics, arXiv preprint arXiv:1806.06762, August 2018.
Google Scholar
2
-
S. Kawakura, and R. Shibasaki, “Statistical Analysis of Index Values Extracted from Outdoor Agricultural Workers Motion Data,” Journal of Advanced Agricultural Technologies, vol. 1, no. 1, pp. 69-74, Jan. 2014.
Google Scholar
3
-
H. Orii, S. Tsuji, T. Kouda, and T. Kohama, “Tactile texture recognition using convolutional neural networks for time-series data of pressure and 6-axis acceleration sensor,” Proceedings of 2017 IEEE International Conference on Industrial Technology (ICIT), pp. 1076-1080, March 2017.
Google Scholar
4
-
N. Dawar, and N. Kehtarnavaz, “Action detection and recognition in continuous action streams by deep learning-based sensing fusion,” IEEE Sensors Journal, vol. 18, no. 23, pp. 9660-9668, Sep. 2018.
Google Scholar
5
-
W. Jiang, and Z. Yin, “Human activity recognition using wearable sensors by deep convolutional neural networks,” Proceedings of the 23rd ACM international conference on Multimedia, pp.1307-1310, Oct. 2015.
Google Scholar
6
-
J. Jang, A. Ankit, J. Kim, Y. Jang, H. Kim, J. Kim, and S. Xiong, “A unified deep-learning model for classifying the cross-country skiing techniques using wearable gyroscope sensors,” Sensors, vol. 18, no. 11, 3819, Nov. 2018.
Google Scholar
7
-
M. M. Hassan, M. Z. Uddin, A. Mohamed, and A. Almogren, “A robust human activity recognition system using smartphone sensors and deep learning,” Future Generation Computer Systems, vol. 81, 307-313, April 2018.
Google Scholar
8
-
Y. Du, M. H. Hsieh, T. Liu, S. You, and D. Tao, “On the learnability of quantum neural networks,” arXiv preprint arXiv:2007.12369, July 2020.
Google Scholar
9
-
A. Gulli, and S. Pal, Chokkan Deep Learning ―Python×Keras De Aidea Wo Katachi Nisuru Recipe; Tokyo, Japan: Ohmesha Inc, 2018.
Google Scholar
10
-
T. Niimura, TensorFlow De Hajimeru DeepLearning Jissou Nyuumon; Tokyo, Japan: Impress Inc., 2018.
Google Scholar
11
-
Y. Ogawa, PyTorch Ni Yoru Hatten Deep Deep Learning; Tokyo, Japan: Mainavi Publishing Inc., 2019.
Google Scholar
12
-
Tangent, Jisedai Jinkou Chinou Syori: Neural Network No Ryoushika; Tokyo, Japan: Amazon Services International, Inc., 2020.
Google Scholar
13
-
I. Cong, S. Choi, and M. D. Lukin, “Quantum convolutional neural networks,” Nature Physics, vol. 15, no. 12, pp. 1273-1278, Sep. 2019.
Google Scholar
14
-
Z. Zhang, D. Chen, J. Wang, L. Bai, and E. R. Hancock, “Quantum-based subgraph convolutional neural networks,” Pattern Recognition, vol. 88, pp. 38-49, Nov. 2018.
Google Scholar
15
-
J. Liu, K. H. Lim, K. L. Wood, W. Huang, C. Guo, and H. L. Huang, “Hybrid Quantum-Classical Convolutional Neural Networks,” arXiv preprint arXiv:1911.02998, Nov. 2019.
Google Scholar
16
-
N. Killoran, T. R. Bromley, J. M. Arrazola, M. Schuld, N. Quesada, and S. Lloyd, “Continuous-variable quantum neural networks,” Physical Review Research, vol. 1, no. 3, pp. 033063-1-033063-22, Jan. 2018.
Google Scholar
17
-
A. Kamruzzaman, Y. Alhwaiti, A. Leider, and C. C. Tappert, “Quantum deep learning neural networks,” Proceedings of Future of Information and Communication Conference, Springer, Cham, pp. 311, Feb. 2019.
Google Scholar
18
-
S. Oh, J. Choi, and J. Kim, “A Tutorial on Quantum Convolutional Neural Networks (QCNN),” arXiv preprint arXiv:2009.09423, Sep. 2020.
Google Scholar
19
-
Z. A. Jia, B. Yi, R. Zhai, Y. C. Wu, G. C. Guo, and G. P. Guo, “Quantum neural network states: A brief review of methods and applications,” Advanced Quantum Technologies, vol. 2, no. 7-8, pp. 1800077-1-1800077-8, August 2019.
Google Scholar
20
-
T. Du, X. Ren, and H. Li, “Gesture recognition method based on deep learning,” Proceedings of IEEE 2018 33rd Youth Academic Annual Conference of Chinese Association of Automation (YAC), pp. 782-787, May 2018.
Google Scholar
21
-
S. Garg and G. Ramakrishnan, “Advances in Quantum Deep Learning: An Overview,” arXiv preprint arXiv:2005. pp. 04316-1-04316-17, August 2020.
Google Scholar
22
-
R. J. Eric, H. Nic, and G. Mercedes, “Ugokashite Manabu Ryoshi Computer Programing,” Tokyo, Japan: Reilly Japan, Inc., August 2020.
Google Scholar
23
-
TensorFlow Community, Official Website of Tensorflow Org, Guide & Tutorials of "Quantum Convolutional Neural Network", Available: https://www.tensorflow.org/quantum/tutorials/qcnn?hl=en.
Google Scholar
24
Most read articles by the same author(s)
-
Shinji Kawakura,
Ryosuke Shibasaki,
Deep Learning-Based Self-Driving Car: JetBot with NVIDIA AI Board to Deliver Items at Agricultural Workplace with Object-Finding and Avoidance Functions , European Journal of Agriculture and Food Sciences: Vol. 2 No. 3 (2020) -
Shinji Kawakura,
Masayuki Hirafuji,
Seishi Ninomiya,
Ryosuke Shibasaki,
Analyses of Diverse Agricultural Worker Data with Explainable Artificial Intelligence: XAI based on SHAP, LIME, and LightGBM , European Journal of Agriculture and Food Sciences: Vol. 4 No. 6 (2022) -
Yuki Funami,
Shinji Kawakura,
Kotaro Tadano,
Development of a Robotic Arm for Automated Harvesting of Asparagus , European Journal of Agriculture and Food Sciences: Vol. 2 No. 1 (2020) -
Shinji Kawakura,
Ryosuke Shibasaki,
Agricultural Training System with Gazing-Point Detection Function using Head-Mounted Display: HTC Vive Pro Eye and Virtual Reality–based Unity System , European Journal of Agriculture and Food Sciences: Vol. 3 No. 3 (2021) -
Shinji Kawakura,
Ryosuke Shibasaki,
Blockchain Corda-based IoT-Oriented Information-Sharing System for Agricultural Worker Physical Movement Data with Multiple Sensor Unit , European Journal of Agriculture and Food Sciences: Vol. 1 No. 2 (2019)





