Streamlining Deep Learning Network for Real-time Sea Turtle Detection

Muhamad Dwisnanto Putro, Yuliana Mose, Alex Copernikus Andaria, Jane Litouw, Vecky Canisius Poekoel, Xaverius Najoan

Abstract


Monitoring turtle behavior is a conservation effort to preserve its habitat, and the detection process is a vital initial stage. On the other hand, robotics demands a deep learning network to automatically detect the presence of sea turtles that can operate in real-time. The need for increased model speed in the inference stage has led to many lightweight vision-based detectors. This work proposes a novel turtle detection to localize multiple sea turtles using a deep learning method. A lightweight primary extractor is applied to distinguish crucial features without producing a huge computational. An excited group attention is offered as an enhancement module that can capture essential turtle components in multi-level convolutional patches. A new turtle dataset is proposed that contains lighting, blur, occlusion, and complex background challenges. The evaluation results show that the proposed model performs higher accuracy than other lightweight object detection models. High-efficiency benefits models that can be implemented on low-end devices in terms of real-time data processing speed.

Keywords


Sea turtle detection; deep learning; vision system; efficient model; underwater robot

Full Text:

PDF

References


H. Y. Lin, S. L. Tseng, and J. Y. Li, “SUR-Net: A deep network for fish detection and segmentation with limited training data,” IEEE Sens J, vol. 22, no. 18, pp. 18035–18044, Sep. 2022.

Z. Zhou, J. Liu, and J. Yu, “A survey of underwater multi-robot systems,” IEEE/CAA Journal of Automatica Sinica, vol. 9, no. 1, pp. 1–8, Jan. 2022.

F. Han, J. Yao, H. Zhu, and C. Wang, “Marine organism detection and classification from underwater vision based on the deep CNN method,” Math Probl Eng, vol. 2020, no. 3937580, pp. 1–11, Feb. 2020.

E. M. Ditria, S. Lopez-Marcano, M. Sievers, E. L. Jinks, C. J. Brown, and R. M. Connolly, “Automating the analysis of fish abundance using object detection: optimizing animal ecology with deep learning,” Front Mar Sci, vol. 7, no. 429, pp. 1–9, Jun. 2020.

H. Leo, F. Arnia, and K. Munadi, “Fine tuning CNN pre-trained model based on thermal imaging for obesity early detection,” Jurnal Rekayasa Elektrika, vol. 18, no. 1, pp. 1–9, Apr. 2022.

A. Sani and S. Rahmadinni, “Deteksi gestur tangan berbasis pengolahan citra,” Jurnal Rekayasa Elektrika, vol. 18, no. 2, pp. 115–124, Jun. 2022.

H. Leo, F. Arnia and K. Munadi, “Fine tuning CNN pre-trained model based on thermal imaging for obesity early detection,” Jurnal Rekayasa Elektrika, vol. 18, no. 1, pp. 53–60, Mar. 2022.

M. Pedersen, J. B. Haurum, R. Gade, and T. B. Moeslund, “Detection of marine animals in a new underwater dataset with varying visibility,” in Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition, Apr. 2020, pp. 18–26.

K. Ali, M. Moetesum, I. Siddiqi, and N. Mahmood, “Marine object detection using transformers,” in Proc. IEEE 19th International Bhurban Conference on Applied Sciences and Technology, Aug. 2022, pp. 951–957.

Hu, L. Shen, S. Albanie, G. Sun, and E. Wu, “Squeeze-and-Excitation Networks,” IEEE Trans Pattern Anal Mach Intell, vol. 42, no. 8, pp. 2011–2023, Aug. 2020.

F. Wang, H. Wang, Z. Qin, and J. Tang, “UAV target detection algorithm based on improved YOLOv8,” IEEE Access, vol. 11, pp. 116534–116544, Oct. 2023.

A. J. Paul, “The need and status of sea turtle conservation and survey of associated computer vision advances,” in Proc. IEEE 8th Uttar Pradesh Section International Conference on Electrical, Electronics and Computer Engineering, Jan. 2021, pp. 1–8.

P. C. Gray, A. B. Fleishman, D. J. Klein, M. W. McKwon, V. S. Bézy, K. J. Lohmann, and D. W. Johnston, “A convolutional neural network for detecting sea turtles in drone imagery,” Methods Ecology and Evolution, vol. 10, no. 3, pp. 345–355, Mar. 2019.

J. Lu and J. Wei, “Turtle species identification design based on CNN,” Journal of Physics: Conference Series, vol. 1345, no. 2, pp. 022067, Nov. 2019.

T. Maki, H. Horimoto, T. Ishihara, and K. Kofuji, “Autonomous tracking of sea turtles based on multibeam imaging sonar: toward robotic observation of marine life,” IFAC-PapersOnLine, vol. 52, no. 21, pp. 86–90, Dec. 2019.

S. Woo, J. Park, J. Y. Lee, and I. S. Kweon, “CBAM: Convolutional block attention module,” in Proc. of the European Conference on Computer Vision, Sept. 2018, pp. 3–19.

Q. Hou, D. Zhou, and J. Feng, “Coordinate attention for efficient mobile network design,” in Proc. IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nov. 2021, pp. 13708–13717.

A. M. Malik. (View Mar. 2021). YOLO annotation tool. GitHub. [Online]. Available:

https://github.com/ManzarIMalik/YOLO-Annotation-Tool.

T. Shi, Y. Ding and W. Zhu, “YOLOv5s-2E: Improved YOLOv5s for aerial small target detection,” IEEE Access, vol. 11, pp. 80479–80490, Aug. 2023.

Y. Liu, H. Chu, L. Song, Z. Zhang, X. Wei, M. Chen, and J. Shen, “An improved tuna-YOLO model based on YOLO v3 for real-time tuna detection considering lightweight deployment,” Journal of Marine Science and Engineering, vol. 11, no. 3, pp. 542–558, Mar. 2023.

L. Zhao, Q. Yun, F. Yuan, X. Ren, J. Jin, and X. Zhu, “YOLOv7-CHS: An emerging model for underwater object detection,” Journal of Marine Science and Engineering, vol. 11, no. 10, pp. 1949–1969, Oct. 2023.

R. Shankar and M. Muthulakshmi, “Comparing YOLOv3, YOLOv5 & YOLOv7 architectures for underwater marine creature detection,” in Proc. IEEE International Conference on Computational Intelligence and Knowledge Economy, May 2023, pp. 25–30.

A. Nazir and M. A. Wani, “You Only Look Once - object detection models: A review,” in Proc. IEEE 10th International Conference on Computing for Sustainable Global Development, May 2023, pp. 1088–1095.

M. B. Muhammad and M. Yeasin, “Eigen-CAM: Class activation map using principal components,” in Proc. IEEE International Joint Conference on Neural Networks, July 2020, pp. 1–7.

N. Hnoohom, P. Chotivatunyu, S. Yuenyong, K. Wongpatikaseree, S. Mekruksavanich, and A. Jitpattanakul, “Object identification and localization of visual explanation for weapon detection,” in Proc. Research, Invention, and Innovation Congress: Innovative Electricals and Electronics, Oct. 2022, pp. 144–147.

M. D. Putro, L. Kurnianggoro, and K. H. Jo, “High performance and efficient real-time face detector on central processing unit based on convolutional neural network,” IEEE Transactions on Industrial Informatics, vol. 17, no. 7, pp. 4449–4457, July 2021.




DOI: https://doi.org/10.17529/jre.v20i3.35236

Article Metrics

Abstract view : 0 times
PDF - 0 times

Refbacks

  • There are currently no refbacks.


View My Stats

 

Creative Commons License

Jurnal Rekayasa Elektrika (JRE) is published under license of Creative Commons Attribution-ShareAlike 4.0 International License.