[Archive] Wise23-24 Seminars, Workshops and Lectures

Foundations of Virtual Reality provides a broad overview of the foundational theories, concepts and technologies involved in virtual reality. Topics covered include:

• Definitions and history of immersive media
• Active and spatial perception - vision, hearing, touch, somatic senses
• Stereo, head-tracked images and head-mounted visual displays
• 3D tracking technologies - noise, filtering, drift
• Sonic and haptic displays
• Interaction, locomotion and navigation in virtual spaces
• Software and application design for real-time VR
• Embodiment, social presence, measuring immersion

Tutorials will provide hands-on introduction to these topics using WebGL, Threejs and Unity.

© ixlab@TUD

XR for Robotics

Extended Reality (XR) interfaces for controlling, interacting and communicating with robots.

In this project we explore the union of immersive media and robotics, asking how immersive interfaces might be used to support human robot communication and interaction.
We will examine the use of multi-user mixed reality (MR) in the testing and training of robots and other autonomous machines, with a particular focus on contexts that involve human-robot interaction and cooperation. We will explore how MR can be used to display, in situ, what a robot "sees" and "thinks"; how it perceives and understands its environment and to communicate its reasoning, goals and plans. We will also explore how MR can be used to interact and communicate with a robot, and approach the problem of "explainability" in AI and robotics from the perspective of human-computer interface design.

Students will use Unity and video-passthrough head-mounted displays (Oculus Quest). We will build on the multi-user mixed-reality platform developed within IXLAB (https://doi.org/10.1109/TVCG.2023.3299781).

Prequisites: Knowledge of computer graphics and object-oriented programming required. Experience with Unity and 3D modelling software is beneficial.

© ixlab@TUD

Data Art

Das Supercomputer-Cluster des ZIH der TU Dresden wird für Datenanalysen, maschinelles Lernen und die Verarbeitung großer Datensätze eingesetzt. All diese Prozesse finden unbemerkt in einem riesigen, fensterlosen Betonkubus statt.  

In dem Komplexpraktikum erforschen wir Möglichkeiten zur Visualisierung der Prozesse und Berechnungen, die im Supercomputer ablaufen. Inspiriert von "Datenkünstlern" wie Ryoji Ikeda, Nathalie Miebach oder Refik Anadol konzipieren und entwickeln wir Visualisierungen, die erklären, inspirieren oder provozieren können. Dabei transformieren wir abstrakte Daten in räumliche oder greifbare Formen und Strukturen. 

Dabei reicht die Bandbreite möglicher Darstellungsformen von Bildschirmbasiert, über interaktive Projektionen bis hin zu VR-Erfahrungen.

Die Studierenden arbeiten in kleinen Gruppen und haben eine gleichmäßige Mischung aus theoretischer Arbeit (Hintergrundforschung), Ideenfindung (Prototyping und Mockups) und praktischer Arbeit (Softwareentwicklung). 

Kenntnisse in Computergrafik und Programmierung sind erforderlich. Erfahrung mit visueller Software (2D oder 3D) ist von Vorteil (z.Bsp. Unity, Unreal, WebGL, Cinder, Openframeworks, Blender, Houdini, Maya etc.etc...).

© ixlab@TUD

This seminar has three major components. The first is an introduction to academic research methodologies and tools, such as search strategies and tools, managing a bibliography, academic writing styles, ciations and avoiding plagiarism. In short, you will learn how to find, read, analyse and write academic texts.

The second component is a discussion of philosophical, historical, ethical, social and political implications of media technologies, and computing technology in general. We will discuss selected writings and films from such authors as Alan Turing, Norbert Wiener, John Searle, Nic Bostrom, Stanislav Lem, Jaron Lanier, Hubert Dreyfus and E.M. Forster.

The third component is an introduction to current research frontiers in the field of immersive technologies. This includes such topics as perceptual theory, real-time rendering and simulation, embodied virtual agents and AI, world capture and virtual world building, 3D user interfaces and emerging applications, such as psychiatry, education and journalism. Students will perform their own literature review on a topic of their choice and present their results to their fellow students in class.

This semester we will be using science fiction for inspiration. Students will select a fictional computing technology or interface from film or literature, and then perform an analysis and review of the relevant science needed to make it a reality.

This seminar is well suited for students intending to write a bachelor or master thesis in the field of immersive media. Students will be given the opportunity to select and refine a thesis topic, familiarise themselves with the relevant technologies, and then prepare extensively the theoretical and technical components of the thesis. However, it can also be taken by students not in this category.

Seminar structure:

• Weekly meetings
• Student presentation, student-led discussions and close readings of research papers
• Student-led "reading group"

Tasks and assesment:

• Write literature review paper on a specific research topic.
• Class presentation.

© ixlab@TUD

A particular challenge in the world of museums is the archiving, documentation and presentation of artefacts and objects whose value and purpose is only revealed when they are performed or used. For example, the purpose of a scientific instrument or a craftmans tool may only be apparent when it is in motion. The value and use of toys, ritual objects or kinetic works of art can often only be understood in terms of their dynamics and interactivity. This is particularly true for artefacts that involve artistic or playful performance, such as musical instruments, tools for artmaking, toys or puppets. Moreover, it may be that only when we use something ourselves, with our own hands, do we truly understand it.

© SKD

However, for conversation reasons, such objects are typically exhibited "dead", completely inert and beyond the audiences grasp. Like this, they often lose all meaning.

In this seminar, we will investigate methods for capturing, documenting and presenting dynamic and mobile artefacts. We will examine the state-of-the-art in museology, and then ask how emerging immersive and interactive technologies might be used to bring museum artefacts back to life. How can the performance of an artefact be captured for future generations, and how might we recreate long lost performances of historical artefacts? How might we let people use virtual replica of such artefacts?

In this seminar you will perform a design analysis of the challenges involved in mobile museum artefacts and propose creative solutions based on emerging technologies.

Students will work in small teams.

The seminar includes guest lectures from partners at the Staatliche Kunstsammlungen Dresden and the Dresden Puppentheatersammlung and field trips to collections of the Dresden museums.
 

IXLAB is offering a range of individual and group Research Projects in the field of immersive media. Topics include theoretical and perceptual factors, technical challenges, design and interaction issues and novel applications of different manifestations of virtual and augmented reality. Application fields include archaeology, architecture, data visualisation, geospatial science, physiotherapy or psychotherapy, museums and libraries, music and film production, journalism or education and training.

Projects are available for all levels: Bachelor and Master Theses, Gross Beleg and individual and team research projects INF-PM-FPA, INF-PM-FPG, CMS-PROJ, CMS-VC-TEA

See here for example Research Projects