A Novel Integrated Control Strategy for a Cost-effective Inverted Pendulum System with Camera-based Observation
Received: 14 February 2025 | Revised: 10 March 2025 | Accepted: 19 March 2025 | Online: 28 March 2024
Corresponding author: Ngoc-Khoat Nguyen
Abstract
To improve the ability to control the balance of an inverted pendulum on a cart system, a refined fuzzy logic inference approach using the Sugeno model is introduced. This new approach leverages the capabilities of the ESP32 CAM and YOLO v3. The ESP32 CAM provides real-time image and video capture, whereas YOLO v3, operating on a more robust processing platform, performs object detection within the captured data. This integration of image processing and object recognition necessitates a complex experimental setup, requiring further refinement of the adaptable robotic model and integration of various techniques. A WinForms interface has been developed for the control and monitoring of the camera-equipped inverted pendulum system. This interface allows the users to monitor and adjust the system parameters, as well as to visualize the surrounding environment. This design significantly enhances the sophistication of the control and monitoring system while maintaining cost-effectiveness. Numerical simulations and experimental results demonstrate markedly improved control performance, validating the novel integrated control methodology.
Keywords:
inverted pendulum system, observation, image processing, YOLOv3, integrated control methodologyDownloads
References
T.-M.-P Dao, V.-H. Pham, N.-K. Nguyen, and V.-M. Pham, "Balancing a Practical Inverted Pendulum Model Employing Novel Meta-Heuristic Optimization-based Fuzzy Logic Controllers," International Journal of Advanced Computer Science and Applications, vol. 13, no. 4, pp. 547–553, 2022.
T.-N. Ho and V.-D.-H. Nguyen, "Model-Free Swing-Up and Balance Control of a Rotary Inverted Pendulum using the TD3 Algorithm: Simulation and Experiments," Engineering, Technology & Applied Science Research, vol. 15, no. 1, pp. 19316–19323, Feb. 2025.
A. K. Yadav, P. Gaur, A. P. Mittal, and M. Anzar, "Comparative analysis of various control techniques for inverted pendulum," in India International Conference on Power Electronics 2010, New Delhi, India, 2011, pp. 1–6.
M. Rabah, A. Rohan, and S.-H. Kim, "Comparison of Position Control of a Gyroscopic Inverted Pendulum Using PID, Fuzzy Logic and Fuzzy PID controllers," International Journal of Fuzzy Logic and Intelligent Systems, vol. 18, no. 2, pp. 103–110, Jun. 2018.
C. A. Ibañez, O. G. Frias, and M. S. Castañón, "Lyapunov-Based Controller for the Inverted Pendulum Cart System," Nonlinear Dynamics, vol. 40, no. 4, pp. 367–374, Jun. 2005.
T. Paryono, A. Fauzi, R. A. Nanda, S. Aripiyanto, and M. Khaerudin, "Detecting Vehicle Numbers Using Google Lens-Based ESP32CAM to Read Number Characters," MATRIK : Jurnal Manajemen, Teknik Informatika dan Rekayasa Komputer, vol. 22, no. 3, pp. 469–480, Jul. 2023.
K. C. Gupta, G. Kaur, and A. Chaudhary, "Drowsiness Detection Using ESP32CAM," in 2023 3rd Asian Conference on Innovation in Technology, Ravet IN, India, 2023, pp. 1–4.
A. Okubanjo and O. Oyetola, "Dynamic Mathematical Modeling and Control Algorithms Design of an Inverted Pendulum System," Turkish Journal of Engineering, vol. 3, no. 1, pp. 14–24, Jan. 2019.
S. P. Dharshini D., R. Saranya, and S. Sneha, "Esp32 cam based object detection & Identification with opencv," Data Analytics and Artificial Intelligence, vol. 2, no. 4, pp. 166–171, Dec. 2022.
S. Jana, R. Biswas, T. Das, K. Pal, A. Banerjee, and A. Majumdar, "Exploring Image Processing with Python," International Research Journal of Engineering and Technology, vol. 11, no. 02, pp. 294–297, Feb. 2024.
M. Arora, P. Mangipudi, M. K. Dutta, and R. Burget, "Image Processing Based Automatic Identification of Freshness in Fish Gill Tissues," in 2018 International Conference on Advances in Computing, Communication Control and Networking, Greater Noida, India, 2018, pp. 1011–1015.
L. B. Prasad, B. Tyagi, and H. O. Gupta, "Modelling and Simulation for Optimal Control of Nonlinear Inverted Pendulum Dynamical System Using PID Controller and LQR," in 2012 Sixth Asia Modelling Symposium, Bali, Indonesia, 2012, pp. 138–143.
K. Srikanth and G. V. N. Kumar, "Novel Fuzzy Preview Controller for Rotary Inverted Pendulum under Time Delays," International Journal of Fuzzy Logic and Intelligent Systems, vol. 17, no. 4, pp. 257–263, Dec. 2017.
L. B. Prasad, B. Tyagi, and H. O. Gupta, "Optimal Control of Nonlinear Inverted Pendulum System Using PID Controller and LQR: Performance Analysis Without and With Disturbance Input," International Journal of Automation and Computing, vol. 11, no. 6, pp. 661–670, Dec. 2014.
J. C. Cortes-Rios, E. Gomez-Ramirez, H. A. Ortiz-De-La-Vega, O. Castillo, and P. Melin, "Optimal design of interval type 2 fuzzy controllers based on a simple tuning algorithm," Applied Soft Computing, vol. 23, pp. 270–285, Oct. 2014.
A. Ahmadi, H. Abdul Rahim, and R. Abdul Rahim, "Optimization of a self-tuning PID type fuzzy controller and a PID controller for an inverted pendulum," Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology, vol. 26, no. 4, pp. 1987–1999, Jul. 2014.
V. Kumar and A. P. Mittal, "Parallel fuzzy P+fuzzy I+fuzzy D controller: Design and performance evaluation," International Journal of Automation and Computing, vol. 7, no. 4, pp. 463–471, Nov. 2010.
A. N. K. Nasir, M. A. Ahmad, and M. F. Rahmat, "Performance Comparison Between LQR And PID Controllers For An Inverted Pendulum System," AIP Conference Proceedings, vol. 1052, no. 1, pp. 124–128, Oct. 2008.
Y. Liu, Z. Chen, D. Xue, and X. Xu, "Real-time controlling of inverted pendulum by fuzzy logic," in 2009 IEEE International Conference on Automation and Logistics, Shenyang, China, 2009, pp. 1180–1183.
R. D. Luca, M. D. Mauro, and A. Naddeo, "The inverted pendulum," European Journal of Physics, vol. 39, no. 5, Aug. 2018, Art. no. 055008.
G. S. Maraslidis, T. L. Kottas, M. G. Tsipouras, and G. F. Fragulis, "A Fuzzy Logic Controller for Double Inverted Pendulum on a Cart," in 2021 6th South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference, Preveza, Greece, 2021, pp. 1–8.
A. T. Karasahin and M. Karali, "Performance Comparison of Different Fuzzy Logic Controllers on Vehicle-Caravan Systems," Engineering, Technology & Applied Science Research, vol. 13, no. 4, pp. 11271–11276, Aug. 2023.
R. Jayanth, A. M. Kumar, C. H. K. Ram, A. Manoj, G. Pavithra, and T. C. Manjunath, "Ball Detection and Tracking through Image Processing using Python," International Journal of Engineering Technology and Management Sciences, vol. 7, no. 4, pp. 6–10, Aug. 2023.
Downloads
How to Cite
License
Copyright (c) 2025 Ngoc-Khoat Nguyen, Thi-Mai-Phuong Dao, Van-Hung Pham, Tien-Dung Nguyen, Thi-Kim-Thanh Tran, Van-Tien Nguyen

This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.