Frank the Talking Bench

Introduction

Technology and public spaces are merging in innovative ways, and our latest project, Frank the Talking Bench, is a prime example of this transformation. Developed in collaboration with Rurant as part of our Project 4.0 course at Thomas More, this AI-powered bench redefines urban interactions by allowing users to engage in natural conversations.

By integrating state-of-the-art Artificial Intelligence (AI), speech recognition, and smart user interaction technologies, Frank is designed to create an interactive and engaging experience for individuals in public spaces, offering entertainment, education, and insightful discussions.

---

Project Objectives

The primary goal of Frank the Talking Bench is to create a smart, conversational bench that engages with users through voice interactions. The core features include:

• Voice Activation: Detecting users and initiating conversations.
• Speech-to-Text (STT): Understanding spoken input for meaningful dialogue.
• Text-to-Speech (TTS): Providing clear, human-like responses.
• Person Detection: Activating or deactivating based on user presence.
• Smart Resource Management: Optimizing energy consumption when idle.

Additionally, a robust React-based frontend dashboard allows administrators to manage interactions, analyze data, and configure conversation settings dynamically.

---

System Architecture

Hardware Components

• Sensors: Motion and proximity sensors to detect user presence.
• Microphone & Speaker: High-quality audio components for voice interaction.
• Processing Unit: A central computing system to handle AI functionalities and data processing.

AI Integration

• Voice Detection: Ensures efficient activation and interaction handling.
• Speech-to-Text (STT): Converts user speech into text for processing.
• Text-to-Speech (TTS): Transforms AI-generated responses into audible replies.

React Frontend Dashboard

• User Management: Admins can configure dialogues and manage conversations.
• Analytics & Insights: Provides data on user engagement and conversation trends.
• Real-Time Control: Allows modifications to AI responses and interaction logic dynamically.

---

Functional Flow

1. User Detection: Sensors identify when a person approaches or sits on the bench.
2. Voice Activation: The system listens for voice input and processes speech.
3. AI Response: Based on user input, the AI generates and delivers an appropriate response.
4. Energy Efficiency: The bench enters idle mode when not in use to optimize resources.

---

Challenges & Solutions

• Voice Recognition Accuracy: Implemented noise-canceling microphones and improved speech models.
• User Engagement: Designed a conversational structure that keeps interactions natural and engaging.
• Hardware & Software Integration: Conducted extensive testing to ensure seamless interaction between components.

---

Future Enhancements

• Expanded AI Capabilities: Integration of more advanced NLP models for deeper conversations.
• Multilingual Support: Adding multiple language options for broader accessibility.
• IoT Integration: Connecting with smart city infrastructures for an enhanced user experience.

---

Conclusion

Frank the Talking Bench is an innovative blend of AI and urban design, showcasing how interactive technology can enrich public spaces. By merging hardware and software, we have created a seamless, engaging, and informative experience that fosters interaction and engagement in an entirely new way. With potential future upgrades, Frank can evolve into a key component of smart urban environments, making public spaces more interactive and inviting.

This project exemplifies our expertise in AI, software development, and user experience design, demonstrating our ability to bridge the gap between technology and real-world applications. Frank is not just a bench; it’s a conversation starter, a storyteller, and a glimpse into the future of interactive public spaces.

Our promotional video: https://youtu.be/zBHCjNPxpvg?si=SiA4QNrWDkzSOobe