An empirical investigation into the effectiveness of a robot simulator as a tool to support the learning of introductory programming

Abstract

Background: Robots have been used in the past as tools to aid the teaching of programming. There
\nis limited evidence, however, about the effectiveness of simulated robots for this purpose.
\n
\nAim: To investigate the effectiveness of a robot simulator, as a tool to support the learning of
\nintroductory programming, by undertaking empirical research involving a range of participants.
\n
\nMethod: After the completion of a Systematic Literature Review, and exploratory research
\ninvolving 33 participants, a multi-case case study was undertaken. A robot simulator was
\ndeveloped and it was subsequently used to run four 10-hour programming workshops. Participants
\nincluded students aged 16 to 18 years old (n. 23) and trainee teachers (n. 23). Three in-service
\nteachers (n. 3) also took part. Effectiveness was determined by considering participants’ opinions,
\nattitudes and motivation using the simulator in addition to an analysis of the students’ programming
\nperformance. Pre- and post-questionnaires, in- and post-workshop programming exercises,
\ninterviews and observations were used to collect data.
\n
\nResults: Participants enjoyed learning using the simulator and believed the approach to be valuable
\nand engaging. Whilst several factors must be taken into consideration, the programming
\nperformance of students indicates that the simulator aids learning as most completed tasks to a
\nsatisfactory standard. The majority of trainee teachers, who had learned programming beforehand,
\nbelieved that the simulator offered a more effective means of introducing the subject compared to
\ntheir previous experience. In-service teachers were of the opinion that a simulator offers a valuable
\nmeans for supporting the teaching of programming.
\n
\nConclusion: Evidence suggests that a robot simulator can offer an effective means of introducing
\nprogramming concepts to novices. Recommendations and suggestions for future research are
\npresented based on the lessons learned. It is intended that these will help to guide the development
\nand use of robot simulators in order to teach programming.