*1 Muhammad Ahmad Baballe, 2 Abdu Ibrahim Adamu, 3 Abdulkadir Shehu Bari, 4 Amina Ibrahim
*1 Department of Computer Engineering Technology, School of Technology, Kano State Polytechnic, Kano, Nigeria
2 Department of Computer Science, Audu Bako College of Agriculture Danbatta, Kano, Nigeria, 3 Department of Computer Science, Audu Bako College of Agriculture Danbatta, Kano, Nigeria, 4 Department of Computer Science, School of Technology, Kano State Polytechnic, Nigeria.
Corresponding Author: Muhammad Ahmad Baballe, Department of Computer Engineering Technology, School of Technology, Kano State Polytechnic, Kano, Nigeria
A rudimentary autonomously guided robot called a "Line Follower Robot" (LFR) follows a line written on the ground to either find a white line on a dark surface or a dark line on a white surface. Working on the LFR is quite interesting. We will discover how to construct a black line follower robot in this study utilizing an Arduino Uno and a few readily available parts.
Mobile robots have drawn the attention of many academics in recent years because to their agility, adaptability, and capacity to be used in a variety of challenging missions, particularly in regards to autonomous navigation in the warehouse or restricted region [1–10]. There is a rising demand for complicated applications nowadays, when the working environment includes humans [67], moving robots, or unexpected impediments [68, 69]. At this point, robots and people are regarded as mobile impediments that make up the dynamic environment. Since then, the camera application-based "Navigation" approach [11–16] has generated a lot of interest since it overcomes the drawbacks of the conventional line-detection method while also enabling path optimization. Furthermore, because the working space is typically a warehouse or small space, the robot's capacity to operate must be adaptable and able to follow a predefined trajectory while avoiding moving impediments that may occur without deviating from a safe planning trajectory [17–20]. Since the environment is static and mapped, and
obstacle locations are assumed to be known in advance, there are currently many traditional researches and approaches, such as RRT* [21-22], A* [23–24], Visibility Graph, and Fast Marching Tree, that are primarily focused on autonomous path planning for mobile robots. In addition, [25-34] used complex algorithms to prevent collisions, including Adaptive Genetic, Bacterial Evolutionary Algorithm, Predictive Behavior, and Partial Swarm. The dynamic environment map must be built and updated manually using those approaches, which results in low forecast accuracy. The obstacle avoidance approach based on fuzzy logic control develops specific rules in accordance with the prior information. Recently, intelligent control algorithms have also been applied to obstacle avoidance. The method to fuzzy logic control has strong robustness, real-time performance, and less reliance on the environment. However, there is a symmetry phenomenon that cannot be explained. The neural network-based obstacle avoidance technique creates controllers based on the location of obstacles. However, gathering data and teaching the network to discover a path take a lot of effort. When an obstacle's knowledge is lacking or unknowable, conventional obstacle avoidance algorithms are useless. Designing an intelligent control requires knowledge or experience [51–52]. Contrary to other artificial intelligence algorithms, reinforcement learning (RL) is a learning technique that doesn't need any rules [53–56]. RL is a machine learning technique that modifies the environment by using the environment's feedback as an input. One of the most widely used RL algorithms is Q-learning. With the help of the Q-value function, the environment is examined by the algorithm, which focuses on value-based reinforcement learning that is updated over time [57–60]. Recently, it has also been used to combine intelligent control and Q-learning [61–65]. These research, however, are limited to simulations and trials using straightforward static objects. Additionally, there isn't a clear discussion of how to construct the controller for a robot to follow a processed path (virtual). As is well known, Q-learning relies on a trial-and-error learning process where the agent experiences several failures before finally succeeding. Both money and time are very much in short supply. This indicates that the training is challenging to carry out in a real environment and is frequently done in simulation. From [61-65], it is clear that robot applications using Q-learning can be trained in virtual environments before being applied in the actual world. The training environment for the RL agent in a virtual environment is established in this research to overcome these issues. The user can gather numerous responses in diverse locations while the virtual environment simulates the actual scenario.
The contribution of this study is that:
Unlike other traditional, artificial and intelligence algorithms, the obstacle avoidance methodology for moving obstacle in this paper does not use any prior dataset for training or experience for design the controller.
The training data are transferred to robot and work real time in the real application.
From the experiment the RL proved to have better performance than intelligent control algorithm in terms of total time and errors [66].
How a Line Follower Robot Works
Line follower robots (LFRs), as previously mentioned, follow lines, and in order to do so, they must first be detected by the robot. The LFR's line detecting technique must now be implemented, which is the question at hand. We all understand that a black surface absorbs the most light, resulting in a maximum reflection on a white surface and a minimum reflection on a black surface. So, in order to find the line, we will exploit this quality of light. An IR sensor or an LDR (light-dependent resistor) can be used to detect light. We chose the IR sensor for our project because of its superior precision. Two IR sensors are placed on the left and right sides of the robot, respectively, in order to detect the line. The robot is then positioned on the line so that it is directly between the two sensors. A transmitter and a receiver are the two components that make up infrared sensors. The IR receiver is a photodiode, which detects the signal produced by the transmitter. The transmitter is just an IR LED that produces the signal. When an object is exposed to infrared light from an IR sensor, the light reaching the black part of the object absorbs it, producing a low output, while the light striking the white part of the object reflects back to the transmitter, being picked up by the infrared receiver, producing an analog signal. Using the aforementioned technique, we move the robot by operating the wheels that are connected to the motors,
which are managed by a microprocessor. Let's call the left motor and right motor the two sets of motors that are typically seen in line-following robots. Based on the signals from the left and right sensors, respectively, both motors rotate. The robot must execute four sets of motions, including forward motion, left turn, right turn, and stopping.
Moving forward: In this scenario, the robot should advance, i.e., both motors should rotate so that the robot goes forward, when both sensors are on a white surface and the line is between the two sensors. Actually, due to the arrangement of the motors in our configuration, each should rotate in the opposite direction. But for ease of use, we'll refer to the motors as rotating forward.
Turning left: The left sensor in this instance detects the black line and sends a signal to the microcontroller since it is on top of the dark line whereas the right sensor is on the white portion. The robot should turn to the left because the left sensor is sending a signal. As a result, the right motor rotates forward while the left motor rotates backward. The robot then pivots to the left.
Turning right: Although this circumstance is identical to the left case in that just the right sensor is present, the robot should nevertheless turn to the right in this instance. The left motor rotates forward to move the robot in the correct direction, while the right motor rotates backward to turn the robot in the opposite direction.
Stopping : In this instance, the black line may be simultaneously detected by both sensors because they are on top of the line. The microcontroller is programmed to think of this as a reason to stop. As a result, both motors are turned off, which stops the robot from moving [70].
I've evaluated a lot of articles on line-moving robots and obstacle detection in this paper. Its basic operation and execution strategy are also addressed.
A. Mora, A. Prados, A. Mendez, R. Barber, and S. Garrido, “Sensor Fusion for Social Navigation on a Mobile Robot Based on Fast Marching Square and Gaussian Mixture Model,” Sensors, vol. 22, no. 22, p. 8728, 2022.
R. M. Sousa, D. B-. Aranibar, J. D-. Amado, R.E. P-. Escarcina, and R. M. P Trindade, “A New Approach for Including Social Conventions into Social Robots Navigation by Using Polygonal Triangulation and Group Asymmetric Gaussian Functions,” Sensors, vol. 22, no. 12, p. 4602, 2022.
L. C. Santos, A. S. Aguiar, F. N. Santos, A. Valente, and M. Petry, “Occupancy Grid and Topological Maps Extraction from Satellite Images for Path Planning in Agricultural Robots,” Robotics, vol. 9, no. 4, p. 77, 2020.
Y. Gao, C. Bai, R. Fu, and Q. Quan, “A non-potential orthogonal vector field method for more efficient robot navigation and control,” Robotics and Autonomous Systems, vol. 159, p. 104291, 2023.
M. Santilli, P. Mukherjee, R. K. Williams, and A. Gasparri, “Multirobot Field of View Control with Adaptive Decentralization,” IEEE Transactions on Robotics, vol. 38, no. 4, pp. 2131-2150, 2022.
Y. Zhao, T. Wang and W. Bi, “Consensus Protocol for Multiagent Systems with Undirected Topologies and Binary-Valued Communications,” in IEEE Transactions on Automatic Control, vol. 64, no. 1, pp. 206-221, 2019.
D. Gadjov and L. Pavel, “A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks,” in IEEE Transactions on Automatic Control, vol. 64, no. 3, pp. 1077-1092, 2019.
Y. Hua, X. Dong, Q. Li, and Z. Ren, “Distributed Fault-Tolerant TimeVarying Formation Control
for Second-Order Multi-Agent Systems with Actuator Failures and Directed Topologies,” in IEEE
Transactions on Circuits and Systems II: Express Briefs, vol. 65, no. 6, pp. 774-778, 2018.
Carrio, J. Tordesillas, S. Vemprala, S. Saripalli, P. Campoy and J. P. How, “Onboard Detection and Localization of Drones Using Depth Maps,” in IEEE Access, vol. 8, pp. 30480-30490, 2020.
H. Seo, G. Cho, S. -J. Kim, J. -H. Chun, and J. Choi, “Multievent Histogramming TDC With Pre– Post Weighted Histogramming Filter for CMOS LiDAR Sensors,” in IEEE Sensors Journal, vol. 22, no. 23, pp. 22785-22798, 2022.
Z. Tahir, A. H. Qureshi, Y. Ayaz, and R. Nawaz, “Potentially guided bidirectionalized RRT* for fast optimal path planning in cluttered environments,” Robotics and Autonomous Systems, vol. 108, pp. 13– 27, 2018.
K. M. I. Khalilullah, S. Ota, T. Yasuda, and M. Jindai, “Road area detection method based on DBNN for robot navigation using single camera in outdoor environments,” Industrial Robot, vol. 45, no. 2, pp. 275-286, 2018.
G. Lei, R. Yao, Y. Zhao, and Y. Zheng, “Detection and Modeling of Unstructured Roads in Forest Areas Based on Visual-2D Lidar Data Fusion,” Forests, vol. 12, no. 7, p. 820, 2021.
F. Amorós, L. Payá, W. Mayol-Cuevas, L. M. Jiménez, and O. Reinoso, “Holistic Descriptors of Omnidirectional Color Images and Their Performance in Estimation of Position and Orientation,” in IEEE Access, vol. 8, pp. 81822-81848, 2020.
W. L. Yao and H. C. Chen, “An Intelligent Color Image Recognition and Mobile Control System for Robotic Arm,” International Journal of Robotics and Control Systems, vol. 2, no. 1, pp. 97- 104, 2022.
Hassani, I. Ergui, and C. Rekik, “Turning Point and Free Segments Strategies for Navigation of Wheeled Mobile Robot,” International Journal of Robotics and Control Systems, vol. 2, no. 1, pp. 172-186, 2022.
G. Farid et al., “Modified A-Star (A*) Approach to Plan the Motion of a Quadrotor UAV in Three-Dimensional Obstacle-Cluttered Environment,” Appl. Sci., vol. 12, no. 12, p. 5791, 2022.
T. -Y. Lin, K. -R. Wu, Y. -S. Chen, and Y. -S. Shen, “Collision-Free Motion Algorithms for Sensors Automated Deployment to Enable a Smart Environmental Sensing-Net,” in IEEE Transactions on Automation Science and Engineering, vol. 19, no. 4, pp. 3853-3870, 2022.
Li, Q. Hu, and J. Liu, “Path planning of mobile robot based on improved multiobjective genetic algorithm,” Wireless Communications and Mobile Computing, vol. 2021, pp. 1-12, 2021.
Hao, J. Zhao, B. Wang, Y. Liu, and C. Wang, “The application of an adaptive genetic algorithm based on collision detection in path planning of mobile robots,” Computational Intelligence and Neuroscience, vol. 2021, pp. 1-20, 2021.
Noreen, A. Khan, K. Asghar, and Z. Habib, “A path-planning performance comparison of RRT*- AB with MEA* in a 2-dimensional environment,” Symmetry, vol. 11, no. 7, pp. 945-960, 2019.
Wang, W. Chi, C. Li, C. Wang, and M. Q. -H. Meng, “Neural RRT*: Learning-Based Optimal Path Planning,” in IEEE Transactions on Automation Science and Engineering, vol. 17, no. 4, pp. 1748-1758, 2020.
Y. Bai, G. Li, and N. Li, “Motion Planning and Tracking Control of Autonomous Vehicle Based on Improved A ∗ Algorithm,” Journal of Advanced Transportation, vol. 2022, pp.1-14, 2022.
H. Min, X. Xiong, P. Wang, and Y. Yu, “Autonomous driving path planning algorithm based on improved algorithm in unstructured environment,” Proceedings of the Institution of Mechanical Engineers - Part D: Journal of Automobile Engineering, vol. 235, no. 2-3, pp. 513–526, 2021.
Fu et al., “An improved A* algorithm for the industrial robot path planning with high success rate and short length,” Robotics and Autonomous Systems, vol. 106, pp. 26–37, 2018.
N. B. A. Latip, R. Omar, and S. K. Debnath, “Optimal path planning using equilateral spaces- oriented visibility graph method,” Intl. J. Electr. Comput. Eng., vol. 7, no. 6, pp. 3046–3051, 2017.
Janson, E. Schmerling, A. Clark, and M. Pavone, “Fast marching tree: A fast marching sampling- based method for optimal motion planning in many dimensions,” The International journal of robotics research, vol. 34, no. 7, pp. 883–921, 2015.
O. Montiel, U. Orozco-Rosas, and R. Seplveda, “Path planning for mobile robots using bacterial potential field for avoiding static and dynamic obstacles,” Expert Syst. Appl., vol. 42, no.12, pp. 5177–5191, 2015.
A.H. Karami and M. Hasanzadeh, “An adaptive genetic algorithm for robot motion planning in
2D complex environments,” Computers & Electrical Engineering, vol. 43, pp. 317-329, 2015.
F. Kamil, T.S. Hong, W. Khaksar, M.Y. Moghrabiah, N. Zulkifli, and S.A. Ahmad, “New robot navigation algorithm for arbitrary unknown dynamic environments based on future prediction and priority behavior,” Expert Syst. Appl., vol. 86, pp. 274–291, 2017.
Alajlan, I. Chaari, A. Koubaa, H. Bennaceur, A. Ammar, and H. Youssef, “Global robot path planning using GA for large grid maps: Modelling performance and experimentation,” International Journal of Robotics and Automation, vol. 31, no. 6, pp. 484-495, 2016.
Y. Zhao, X. Liu, G. Wang, S. Wu, and S. Han, “Dynamic Resource Reservation Based Collision and Deadlock Prevention for MultiAGVs,” IEEE Access, vol. 8, pp. 82120-82130, 2020.
Yue and H. Fan, “Dynamic Scheduling and Path Planning of Automated Guided Vehicles in Automatic Container Terminal,” in IEEE/CAA Journal of Automatica Sinica, vol. 9, no. 11, pp. 2005- 2019, 2022.
H. Xiao, X. Wu, D. Qin, and J. Zhai, “A Collision and Deadlock Prevention Method with Traffic Sequence Optimization Strategy for UGN-Based AGVS,” in IEEE Access, vol. 8, pp. 209452- 209470, 2020.
Faisal, R. Hedjar, M. Al-Sulaiman, and K. Al-Mutib, “Fuzzy Logic Navigation and Obstacle Avoidance by a Mobile Robot in an Unknown Dynamic Environment,” International Journal of Advanced Robotic Systems, vol. 10, no. 1, 2013.
A. Shitsukane, W. Cheruiyot, C. Otieno and M. Mvurya, “Fuzzy Logic Sensor Fusion for Obstacle Avoidance Mobile Robot,” 2018 IST-Africa Week Conference (IST-Africa), pp. 1-8, 2018.
S. -Y. Chiang, “Vision-based obstacle avoidance system with fuzzy logic for humanoid robots,” The Knowledge Engineering Review, vol. 32, no. E9, 2017.
S. Ayub, N. Singh, M. Z. Hussain, M. Ashraf, D. K. Singh, and A. Haldorai, “Hybrid approach to implement multi-robotic navigation system using neural network, fuzzy logic, and bio-inspired optimization methodologies,” Computational Intelligence, pp. 1- 15, 2022.
Farah and M. Y. Mohammed, “Multilayer Decision-Based Fuzzy Logic Model to Navigate Mobile Robot in Unknown Dynamic Environments”, Fuzzy Information and Engineering, vol. 14, no. 1, pp. 51-73, 2021.
H. Muhammad et al., “Robust mobile robot navigation in cluttered environments based on hybrid adaptive neuro-fuzzy inference and sensor fusion,” Journal of King Saud University - Computer and Information Sciences, vol. 34, no. 10, pp. 9060-9070, 2022.
F. Á. Szili, J. Botzheim, and B. Nagy, “Bacterial Evolutionary Algorithm-Trained Interpolative Fuzzy System for Mobile Robot Navigation”, Electronics, vol. 11, no. 11, p. 1734, 2022.
S. Zubair, S. ABU, R. Ruzairi, A. Andi, and H. Mohd, “Non-Verbal Human-Robot Interaction Using Neural Network for The Application of Service Robot,” IIUM Engineering Journal, vol. 24, no. 1, pp. 301- 318, 2023.
U.A. Syed, F. Kunwar, and M. Iqbal, “Guided autowave pulse coupled neural network (GAPCNN) based real time path planning and an obstacle avoidance scheme for mobile robots,” Robotics and Autonomous Systems, vol. 62, no. 4, pp. 474-486, 2014.
K. -H. Chi and M. -F. R. Lee, “Obstacle avoidance in mobile robot using Neural Network,” 2011 International Conference on Consumer Electronics, Communications and Networks (CECNet),
pp. 5082-5085, 2011.
Medina-Santiago, J. L. Camas-Anzueto, J. A. Vazquez-Feijoo, H. R. Hernández-de León, R. Mota-Grajales, “Neural Control System in Obstacle Avoidance in Mobile Robots Using Ultrasonic Sensors,” Journal of Applied Research and Technology, vol. 12, no. 1, pp. 104- 110, 2014.
N. A. Rafai, N. Adzhar, and N. I. Jaini, “A Review on Path Planning and Obstacle Avoidance Algorithms for Autonomous Mobile Robots,” Journal of Robotics, vol. 2022, pp. 1-14, 2022.
F. Qu, W. Yu, K. Xiao, C. Liu, and W. Liu, “Trajectory Generation and Optimization Using the Mutual Learning and Adaptive Ant Colony Algorithm in Uneven Environments”, Applied Sciences, vol. 12, no. 9, p. 4629, 2022. Doi: 10.3390/app12094629.
Muhammad, M. A. H. Ali, and I. H. Shanono, “Path Planning Methods for Mobile Robots: A systematic and Bibliometric Review”, ELEKTRIKA- Journal of Electrical Engineering, vol. 19, no. 3, pp. 14- 34, 2020.
Zhu, C. Tian, B. Sun, and C. Luo, “Complete Coverage Path Planning of Autonomous Underwater Vehicle Based on GBNN Algorithm,” Journal of Intelligent & Robotic Systems, vol. 94, no. 237– 249, 2019.
Sun, W. He, and J. Hong, “Neural Network Control of a Flexible Robotic Manipulator Using the Lumped Spring-Mass Model,” in IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 47, no. 8, pp. 1863-1874, 2017.
Kumar, P. B. Kumar, and D. R. Parhi, “Intelligent Navigation of Humanoids in Cluttered Environments Using Regression Analysis and Genetic Algorithm,” Arabian Journal for Science and Engineering, vol. 43, pp. 7655–7678, 2018.
K. Abbas, Y. A. Mashhadany, M. J. Hameed, and S. Algburi, “Review of Intelligent Control Systems with Robotics,” Indonesian Journal of Electrical Engineering and Informatics (IJEEI), vol. 10, no. 4, pp. 734-753, 2022.
Naeem, S. T. H. Rizvi, and A. Coronato, “A Gentle Introduction to Reinforcement Learning and its Application in Different Fields,” in IEEE Access, vol. 8, pp. 209320-209344, 2020.
Naeem, A. Coronato, Z. Ullah, S. Bashir, and G. Paragliola, “Optimal User Scheduling in Multi Antenna System Using Multi Agent Reinforcement Learning,” Sensors, vol. 22, no. 21, p. 8278, 2022.
W. Kumwilaisak, S. Phikulngoen, J. Piriyataravet, N. Thatphithakkul, and C. Hansakunbuntheung, “Adaptive Call Center Workforce Management with Deep Neural Network and Reinforcement Learning,” in IEEE Access, vol. 10, pp. 35712-35724, 2022.
A. Alwarafy, M. Abdallah, B. S. Çiftler, A. Al-Fuqaha, and M. Hamdi, “The Frontiers of Deep Reinforcement Learning for Resource Management in Future Wireless HetNets: Techniques, Challenges, and Research Directions,” in IEEE Open Journal of the Communications Society, vol. 3, pp. 322-365, 2022.
Jang, M. Kim, G. Harerimana, and J. W. Kim, “Q-Learning Algorithms: A Comprehensive Classification and Applications,” in IEEE Access, vol. 7, pp. 133653-133667, 2019.
Sutisna, A. M. R. Ilmy, I. Syafalni, R. Mulyawan, and T. Adiono, “FARANE-Q: Fast Parallel and Pipeline Q-Learning Accelerator for Configurable Reinforcement Learning SoC,” in IEEE Access, vol. 11, pp. 144-161, 2023.
Sutisna, Z. N. Arifuzzaki, I. Syafalni, R. Mulyawan, and T. Adiono, “Architecture Design of Q- Learning Accelerator for Intelligent Traffic Control System,” 2022 International Symposium on Electronics and Smart Devices (ISESD), pp. 1-6, 2022.
Chandrakar and P. Paliwal, “An Intelligent Mechanism for Utility and Active Customers in Demand Response Using Single and Double Q Learning Approach,” Smart Energy and Advancement in Power Technologies, vol. 926, pp. 397-413, 2023.
J. Raajan, P.V. Srihari, J. P. Satya, B. Bhikkaji, and R. Pasumarthy, “Real Time Path Planning of Robot using Deep Reinforcement Learning,” IFAC-PapersOnLine, vol. 53, no. 2, pp. 15602- 15607, 2020.
R. Cimurs, J. H. Lee, and I. H. Suh, “Goal-Oriented Obstacle Avoidance with Deep Reinforcement Learning in Continuous Action Space,” Electronics, vol. 9, no. 3, p. 411, 2020.
L. Huang, H. Qu, M. Fu, and W. Deng, “Reinforcement Learning for Mobile Robot Obstacle Avoidance Under Dynamic Environments,” PRICAI 2018: Trends in Artificial Intelligence, vol. 11012, 2018.
D. Pambudi, T. Agustinah, and R. Effendi, “Reinforcement Point and Fuzzy Input Design of Fuzzy Q-Learning for Mobile Robot Navigation System,” 2019 International Conference of Artificial Intelligence and Information Technology (ICAIIT), pp. 186-191, 2019.
S. Wen, X. Hu, Z. Li, H.K. Lam, F. Sun, and B. Fang, “NAO robot obstacle avoidance based on fuzzy Q-learning,” Industrial Robot, vol. 47, no. 6, pp. 801-811, 2020.
M. Çavaş, and M. B. Ahmad, “A REVIEW ON SPIDER ROBOTIC SYSTEM”, International Journal of New Computer Architectures and their Applications (IJNCAA) vol. 9, no. 1 pp. 19-24, The Society of Digital Information and Wireless Communications, 2019.
M. B. Ahmad, and A. S. Muhammad,” A general review on advancement in the robotic system”,
Artificial & Computational Intelligence, pp. 1-7, Mar 2020, http://acors.org/ijacoi/VOL1_ISSUE2_04.pdf .
M. A. Baballe, M. I. Bello, A. Hussaini, U. S. Musa, “Pipeline Inspection Robot Monitoring System”, Journal of Advancement in Robotics, Volume 9, Issue 2, 2022, DOI (Journal): 10.37591/JoARB.
https://circuitdigest.com/microcontroller-projects/arduino-uno-line-follower-robot .