Stills from my applications
Object Detection
The object detection for this project was made with a data model called TACO (trash in context) and I am still working on training this model to be perfect, but as of now, it is able to detect over 50 common trash items in many different forms. The data that is stored in the Python model is put into the software Touchdesigner, where I am making the functionality of the app. I set up some logic so that the application would shuffle through the different objects detected and ask the user if he had scanned the object with the highest confidence score. This information is spread throughout all areas of the application to give the most accurate information and use AI to come up with new and create results for each new object scanned.
Application Development in Touchdesigner
TouchDesigner is a visual programming platform designed for creating interactive multimedia applications. It integrates real-time graphics, audio, video, and data inputs, allowing users to build immersive and responsive projects. With its node-based workflow, developers can prototype and design applications quickly, such as interactive installations, UI interfaces, and live performances. It supports integration with external hardware and software, making it a versatile tool for application development in creative fields.
I chose to use TouchDesigner to integrate all of the aspects of my project after prototyping the application in Figma, and then bringing in the code and necessary information from other software running in real time.
Touchdesigner takes info from scanning code and sorting through which had the highest confidence score, then confirming with the user.
All of the possible screens and the "active" screen or the screen that is being shown to the user
Detailed view inside one of the containers with working buttons
a look inside each of the button containers. Hover changes color.
slider in touchdesigner showing different parts of the page.