The Caribbean Trapezoid:
Wangling 3D Sea Turtle Graphics with UnityLink

Ashwin Ganapathiraju, Graduate Student, Interactive Games and Media
Jay Alan Jackson, Associate Professor,  Interactive Games and Media
Rochester Institute of Technology

Join the Conversation #WolframTechConf

The Carribean Trapezoid

Building a comprehensive learning experience using both Mathematica and Unity.

Go beyond the classic 2D Turtle Graphics

Utilize the UnityLink Library.

UnityLink

Bridges the gap between the popular Unity Game Engine and Mathematica.

An unreleased technology, which posed its own challenges.

What do you do when you can’t google?

Functions (Problem)

Can’t be invoked directly from Mathematica.

Caused us quite a bit of stress!

Functions (Solution)

What did we actually need?

To send and recieve data of some fashion to Unity.

{{0,0,1,0,0,0} ,{1, 0, 0, 0, 0, 0}, {0,0, 0, 0, 0, 1} }

Functions (Implementation)

Set the value of Component properties

Pass in an array of data, flip a boolean to let the engine know

The boolean is only ever flipped by Mathematica

Scene Synchronization

UnityLink requires a project, not a build

We need to find game objects to set properties

How do we sync to the start scene?

Multiple Modes

We had two modes for students to use - LINK / CINEMATIC

How did we keep track of that across both programs?

Controller Support

Mathematica and Unity both support Controllers

How do we design controller input for student learning?

Wiimote Support

We' re working on developing Wiimote controller support!

Windows doesn’t understand Wiimote input natively

Utilizes WSTPLink and the WiiYourself! library

Finicky Bluetooth Connection, based on the remote

Provides support for all official extensions

Can pick up / use: Accelerometers, Speakers, Input, and more...

Going Forwards

Fully integrate Wiimote into the MR platform

Generative Content in the level

Increase the command library as per student request

Implement Story Mode

Thank you!

We learnt a lot working on this over the summer, and we hope to continue developing the wonderful world of the Caribbean Trapezoid with UnityLink! 
		~The RiffRaft Team

Any Questions?

Contact : axg3886@rit.edu