S&BOX is a multiplayer first-person shooter game developed as part of the CSE396 Computer Engineering Project course at Gebze Technical University.
The game blends the physical and digital worlds by using an Xbox Kinect sensor to scan a real sandbox and transform it into a dynamic, deformable game map. As players physically reshape the sand or place objects (like gum boxes and marbles), the game terrain and environment update in real time.
This project is a fusion of image processing, computer vision, depth sensing, and multiplayer game design, offering an immersive hands-on gameplay experience where the physical sandbox directly shapes the virtual battlefield.
S&BOX transforms real-world sandbox changes into digital gameplay in real time. Below are some snapshots from key moments in the system:
(Illustrates how the terrain changes in the sandbox are reflected live in the game.)
-
Real-Time Terrain Transformation: Kinect sensor continuously scans a physical sandbox and reflects height changes in-game with dynamic terrain deformation.
-
Image Processing with OpenCV: Physical objects like gum boxes and marbles are detected using real-time RGB image analysis and converted into interactive game elements (e.g., cars and mines).
-
Multiplayer FPS Gameplay: Players compete in a real-time first-person shooter environment with support for combat, movement, looting, and XP scoring.
-
Cross-Platform LAN Play: Fully synchronized multiplayer experience over local network, playable on both PC and Android without cloud streaming.
-
Game Mechanics: Drive vehicles or place traps by physically adding objects into the sandbox — creating a unique bridge between real-world actions and virtual gameplay.
-
Modular Architecture: System divided into Kinect Module (data capture), Game Module (Unreal gameplay), and Server Module (multiplayer backend) for scalability and clarity.
-
Loot System & Weapon Variety: Players can find crates containing rifles, shotguns, grenade launchers, health packs, and armor — all dynamically distributed.
-
Perspective Switching: Switch between first- and third-person view for tactical advantage using a single key.
| Component | Technology / Tool | Purpose |
|---|---|---|
| Game Engine | Unreal Engine 4.27.2 | Core FPS gameplay, multiplayer logic, terrain rendering |
| Image Processing | OpenCV (C++) | Detect gum boxes and marbles in real-time from Kinect RGB stream |
| Depth Sensing | Xbox Kinect v2 + SDK | Capture real-time depth and RGB data from the physical sandbox |
| Backend / Sync | Unreal Dedicated Server | LAN multiplayer server: synchronization, replication, reconnection |
| Packaging | Android SDK / NDK | Mobile version build and deployment |
| Version Control | Git | Team collaboration and version tracking |
| Name | Role | Modules Involved | GitHub Username |
|---|---|---|---|
| Muhammet Talha Memişoğlu | Team Lead & Developer | Game Module | TalhaMemisoglu |
| Musab Kardeş | Developer | Kinect Module - Server Module | MKardes |
| Mehmet Emin Baytekin | Developer | Game Module | mehme2 |
| Ahmet Hakan Demir | Developer | Server Module - Kinect Module | ahmethakandemir |
| Beyzanur Yılmaz | Developer | Kinect Module - Server Module | beyzayilmaz9 |
| Mert Uğur | Developer | Server Module - Game Module | mertugr |
| Bekir Sadık Altunkaya | Developer | Game Module | bsaltunkaya |
| Ahmet Eren Arslan | Developer | Kinect Module - Game Module | AhmetErenArslan |
S&BOX successfully achieved its goals of combining real-time depth sensing, image processing, and multiplayer game development into an immersive and innovative experience. The project was developed as part of the CSE396 Computer Engineering Project course at Gebze Technical University, and was recognized as one of the top 2 most successful projects out of 16 groups.
Our system demonstrates seamless interaction between the physical and digital worlds, allowing players to manipulate a real sandbox and instantly affect the game environment. The integration of Kinect, OpenCV, and Unreal Engine was fully implemented across PC and Android platforms with reliable multiplayer support.
📄 Detailed technical documentations can be found in Project Reports
🌐 Our Web Site: sandbox.musabkardes.com.tr
We are proud to have completed this project with excellence and invite you to explore it further through the resources above.