As our main technology for the project is AR, various modalities are utilized to enhance user engagement and facilitate the gaming experience. Here's how the system supports different modalities:
The primary modality used in the interaction is vision, facilitated through the mobile phone's screen. Users engage with the AR animals displayed on their device's screen as they explore the museum's dioramas. The AR technology overlays digital representations of animals onto the real-world environment captured by the device's camera, creating an immersive visual experience for users.
While exploring the AR environment, users interact with the game interface using touchscreen controls on their mobile devices. Touchscreen gestures such as tapping, swiping, and pinching may be employed to navigate menus, collect AR animals, and access game features.
Motion sensors in the mobile device are utilized to enhance the gameplay experience. Users need to physically move around the museum space to discover different AR animals hidden within the dioramas, encouraging physical activity and exploration.
Although less common in digital interactions, the sense of balance or equilibrium could potentially be engaged through the use of motion-based gameplay. For instance, users may need to maintain balance while moving around the museum space to avoid obstacles or navigate through virtual environments.
While primarily a visual experience, the game incorporate sound effects or auditory cues to enhance immersion. For example, users can hear animal sounds or background music while interacting with the AR environment, adding another layer of engagement to the experience.
One of the critical use cases involves a user discovering and collecting AR animals within a designated diorama. Here are the steps involved in this user task:
The user opens the AR game app on their mobile device upon entering the museum premises. They ensure that the device's camera and location services are enabled for optimal AR functionality.
The user navigates through the app's interface to choose a specific diorama within the museum where they want to explore and find AR animals.