Special Topics Module 1
Research & Activity Documentation
Wanqing Li
Project 1
Module 1
During module 1, I explored the wide range of possibilities of Touch Designer (TD) in the field of interactive visualization.TD, as a node-based real-time visualization tool, provides a flexible authoring platform that is capable of integrating multiple modes of interaction and adapting to different visual design needs. By analyzing these capabilities, I ultimately chose Leap Motion for gesture-controlled imagery and Kinect for human generation, as they both provide an intuitive and immersive way to interact with digital content in real time.
Activity 1
I'd like to explore this three paths :VR, 3D interactive/game experience and Touch Designer, which also represent immersive experience, interactive creativity and artistic spatial presentation respectively. My initial plan is to use either Unreal Engine or TouchDesigner. I will do further research and make a final choice.
Activity 2
I chose TouchDesigner as the software to continue exploring because it supports real-time interaction and generative design through node-based programming, connecting to data sources and APIs to create highly immersive and dynamic visual experiences. Live interactive visualization, naked-eye 3D video for extreme visual impact, and immersive audiovisual performances Deeply interactive and driven by real-time data, TouchDesigner is widely used in scenarios such as installation art, architectural projection, and stage performances, and brings innovative sensory experiences to users thanks to its smooth performance and high scalability.
Workshop 1
GIF in zip, Explained part in PDF
Action Research
Goals:
1.Leap Motion: exploring how gestures can control images, adjusting form, color, and movement.
2.Kinect/Camera: investigate how to generate dynamic human figures and apply different materials and visual effects.
Workshop 2
GIF in zip, Explained part in PDF
Executive Function
Time line
Week 9 Leap motion
Week 13 Kinect/Camera
Project 1
Project Concept
This project explores the use of Leap Motion and Kinect in Touch Designer interactive visualization to create real-time interactive visual experiences. Leap Motion is responsible for gesture-controlled imagery, where different gestures trigger material changes in the visual effects; Kinect is responsible for humanoid generation, where dynamic materials are given to the human body to create morphing or environmental light changes based on human movement. Kinect is responsible for humanoid generation, giving dynamic materials, and generating morphing or environmental light and shadow changes according to human movements. The goal of the research was to improve the naturalness and visual presentation of the interactions, while ensuring smooth rendering of the Touch Designer and exploring more impactful visualizations. Research methods include testing Leap Motion's gesture mapping and particle representation, as well as investigating Kinect's use of 3D morphing, material changes, and light and shadow rendering. In addition, Python may be used for data generation, processing, and visualization, and Blender may be used for 3D asset creation. The end result is a real-time interactive visualization that allows the user to intuitively control visuals through Leap Motion and generate dynamic 3D figures with Kinect.
Testing Action Research
In the process of organizing the content of this research, I have gained a deeper understanding of the wide range of applications of Touch Designer (TD) in the field of interaction visualization.TD provides a wealth of functionality as a node-based real-time visualization tool. This software, enables different interaction methods to be integrated and adapted to different visual design needs.
In this research, I focus on Leap Motion's gesture control and Kinect's human morphogenesis and analyze their feasibility and implementation in TD.
Research Reflection
This research has deepened my understanding of Touch Designer in real-time interaction design.TD allows projection mapping by mapping visualizations onto the surface of real-world objects. This technique enables the integration of digital vision with physical space, bringing richer possibilities for interactive visualization. And I will learn and explor Touch Designer more.
Next Steps
I will try to explore Projection Mapping, experimenting with dynamically projecting Kinect-generated human figures in different physical spaces to merge digital visuals with real-world surfaces. Kinect-generated human figures can also be dynamically projected in different physical spaces.
Powered by w3.css