Practical lab exercises and haptic games are often used to create understanding and awareness of how technologies can support the quality of warehouse operations. However, not all students have access to a suitable physical lab or game environment. To make this possible, a team in gaming lab BIBA is working on a  mixed reality game, a mode of free form that emphasizes freedom of movement and offers the player a lot of flexibility and ingenuity in completing tasks and coming up with solutions to the objectives of learning(focusing mainly on exploring benefits and limitations of using sensors in warehouse operations) with a combination of Augmented Reality and physical tools. The purpose of playing this is to promote the importance of using sensors to increase the efficiency of logistics operations.

In the Process of Investigating and Selecting Sensors

Player control forklift with controllers on tablet and when scanning QR codes on forklift it pop up AR interactions providing information about sensors used. This would be helpful for technical learning in logistic operations and IoT in the learning environment to have more practical knowledge about different sensors in an immersive manner.

In Decision Making Operations – Instructional

The player controlling forklift with tablet and with sensors information application giving player instructional information in order to avoid collisions and hit by any obstacle. Three Ultrasonic sensors are mainly used for this purpose, which is measuring the distance of the forklift with any coming obstacles.

PBL and Sensor Selection

List of sensors used for the Forklift

  • Ultrasonic sensors (used)(HC-SR04)
  • RFID sensor (used)(RC-522)
  • Camera (used)
  • Time of flight sensors (used)(VL53IOX)
  • Gyroscope (used)(GY-521)
  • Proximity sensors
  • Pressure sensors
  • Vibration sensors
  • Accelerometer sensors.
  • Touch sensors

Actuator used

  • L298 H-Bridge

For more detailed information, images and video demo of the MR prototype, Please Click here.