1221302945

[1221302945]

A3: LIVE PERFORMANCE PROJECT

Live Performance Project: Final Stage

Live Performance Project: Final Stage

Introduction

initial exploration: examined the works of Daito Manabe and Jwohan Lim.

noted how new media technologies could enhance audience engagement.

developed the final project "Eternal Echoes: A Journey Through Time" using AR technology and digital elements.

Final Project Overview

"Eternal Echoes: A Journey Through Time" symbolizes the fluidity of time and its impact on human identity.

features a time-traveling car to illustrate the concept.

dynamic visuals transform static pieces into evolving digital art, reflecting the passage of time.

interactive layers allow viewers to engage deeply with the artwork and its themes of clarity, doubt, introspection, and the search for meaning.

Improvements and Enhancements

integrated QR code directs viewers to a dedicated WordPress website.

website displays a digital copy of the artwork and artist statement.

provides a link to download the Artivive app for easy AR access.

viewers use their phones to scan the artwork with the Artivive AR app- reveals multiple digital layers and animations.

combines dynamic graphics and high-quality audio for an immersive experience.

Limitations and Solutions

platform constraints: faced limitations with video and image file sizes on Artivive.

initial plan to use Adobe After Effects or Processing for animations was restricted due to large file size.

solutions: utilized tools and animations provided by the Artivive platform which aligned with the concept and maintained quality.

streamlined the production process for a cohesive and impactful final product.

Viewer Interaction Experience

AR technology significantly boosts viewer interaction.

integrated Adobe Photoshop, Illustrator, and 3D models into the Artivive app.

created dynamic, evolving visuals that illustrate concept of time.

multi-sensory experience: high-quality ambient soundscapes enrich the overall experience.

viewers use their devices to interact with various artwork layers.

interactivity invites reflection on time and identity, making the experience impactful and intimate.

Conclusion

The project's evolution from A1 to A2 to A3 showcases the potential for integrating current technology to create innovative and captivating art experiences. Despite challenges, such as the limitations of the Artivive platform, the final product is engaging and thought-provoking, providing a comprehensive exploration of time and identity.

[1221302945]

A2: DESIGNING SENSORIAL EXPERIENCE

Designing Sensorial Experience

Introduction

A1 Exploration

studied innovative works of Daito Manabe and Jwohan Lim.

identified areas for improvement with new media technology.

suggested for improvement by incorporating augmented reality (AR) to enhance audience engagement.

A2 Implementation

integrated AR elements into my artwork for a dynamic, interactive experience.

used the Artivive AR app to add digital layers to physical work, enhancing interactivity through audience devices.

New Conceptual Approach

viewers interact with AR different layers of the artwork using their phones- creates a deeper, more engaging experience.

used Photoshop and Illustrator to create dynamic visuals.

transformed static pieces into evolving digital art, representing the passage of time.

incorporated moving images, 3D models, and music for emotional and contextual depth.

added a QR code for viewers to access my artistic statement and download the AR app.

Technical Setup Improvements

User-friendly Technology: created on Artivive Bridge website for easy AR integration without extensive coding.

used Adobe Photoshop for physical artwork and Illustrator for layered designs.

imported layers into Artivive, integrating 3D models, moving images, and audio.

seamless Physical-Digital Blend: a QR code for smooth transitions between physical and digital elements.

Performance Concept and Stage Plan

"Eternal Echoes: A Journey Through Time" explores the fluidity of time and its impact on human identity.

centers around a time-traveling car, symbolizing our desire to connect with past and future.

invites viewers to reflect on time's influence on our identities and experiences.

Performance Tech Rider

requires AR devices (tablets or phones with Artivive app) to scan and view artwork layers.

high-quality audio enhances the multi-sensory experience.

transforms physical artwork into an interactive digital format for immersive engagement.

Stage Floor Plan

central display features the time-traveling car model.

physical work is surrounded by interactive zones for AR engagement.

strategically placed speakers create immersive sound zones.

New Media Technology

using AR technology increases engagement with artwork.

Adobe photoshop, illustrator and 3D models in Artivive create dynamic, evolving visuals.

high-quality audio and ambient soundscapes add depth and context.

Conclusion

The combination of AR with traditional art forms significantly enhances audience engagement and interactivity. Using dynamic visuals and soundscapes makes the concept of time more tangible and immersive. "Eternal Echoes: A Journey Through Time" exemplifies the potential of integrating new media technology to create innovative and captivating art experiences, offering a comprehensive exploration of time and identity.

[1221302945]

W9 Lecture- BODY IN TIME AND SPACE

Week 9 was focused on the topic of Body in Time and Space. Below is my takeaway and my understanding of the topic.

Week 9 Takeaway: Body in Time and Space

What is Body in Time and Space?

Definition

the concept of "Body in Time and Space" explores the relationship between the human body, architecture, and dance.

tt focuses on the sensual experience of architecture and dance, highlighting how both disciplines use space as a medium for creative expression.

How Does It Work?

Dance

dance involves the movement of the human body through space over time, creating a dynamic interaction with the environment.

Architecture

architecture is experienced by the human body through movement over time, emphasizing spatial qualities and design.

Commonality

both dance and architecture utilize space as a canvas, with the human body acting as a bridge between the two disciplines.

space is created for and influenced by the body, forming a unique connection between these art forms.

Video Examples

Example 1: This video illustrates how dance can be choreographed to interact with architectural spaces, showcasing the fluid relationship between movement and environment. YouTube Link

Example 2: This video demonstrates the interplay between architectural design and human movement, further emphasizing the sensory experience of space. YouTube Link

This week's lecture on "Body in Time and Space" has provided a fascinating insight into how dance and architecture are interconnected through their use of space. Understanding this relationship has deepened my appreciation for how movement and design can create immersive experiences. The concept of space being both a canvas and a medium for creative interpretation.

The Chemical Brothers - Wide Open ft. Beck (click here)

[1221302945]

W7/8 Lecture- SENSORIAL DESIGN & SYNESTHESIA

Sensorial Design and Synesthesia

For these two weeks, we were briefly introduced to sensorial design and synesthesia, mainly looking at videos explanations and examples in our own time, before continuing with our individual final project for this subject.

What is Sensorial Design and Synesthesia?

I learnt that Sensorial Design and Synesthesia is when you hear music, but you see shapes. Or you hear a word or a name and instantly see a color.

e.g. you might hear the name "Alex" and see green. Or you might read the word "street" and taste citrus fruit.

it is the neurological phenomenon that couples two or more senses in 4% of the population.

sharing the same root with anesthesia, meaning no sensation, synesthesia means joined sensation.

Implications for Design:

Understanding synesthesia can enhance sensorial design, which aims to create experiences that engage multiple senses simultaneously. This can lead to more immersive and impactful designs.

Applications:

Sensorial design can be applied in various fields such as art, music, marketing, and user experience design to create unique and memorable experiences.

These insights have provided a foundation for exploring how synesthetic experiences can inform and inspire innovative design solutions in my final project.

[1221302945]

W6 Lecture- THEATRE AND HYBRID

Theatre and Hybrid

For this week's lecture, we were introduced to what is Theatre and Hybrid alongside its benefits. Here is the recap of what I learned:

Appeal to a Younger, Digital Native Audience

Younger audiences are used to screens.

Live social media interactions make virtual theatre attendance natural.

Critical to make theatre accessible to young audiences for future growth.

Streaming options meet young people in their comfort zone.

Sell Unlimited Tickets, More than Theatre Capacity Allows

Streaming removes audience size limits.

Sold-out shows can still be attended virtually.

Expands theatre's reach and profitability.

Offer Better Value to Families

Parents can watch from home without needing a babysitter.

Young children can enjoy the show at home.

Streaming makes theatre more accessible to families.

Protect the Safety of Vulnerable Patrons

Covid is still a concern for many.

Streaming allows immunocompromised, elderly, and unvaccinated children to attend safely.

Provides greater access for those uncomfortable with large crowds.

Allow People to Attend from Anywhere in the World

Streaming transcends geographical limits.

Performances can be viewed globally.

Investing in online quality captures a global audience.

Democratizing Access to the Arts

Hybrid productions require effort but lead to success.

Increases audience growth and access to the arts for all.

Live theatre performances are about to re-open, which might suggest that streaming productions will soon be unnecessary. However, continuing to provide streaming services alongside live performances offers significant benefits to both theatres and their audiences. While a virtual performance can never fully replace the experience of live theatre, it remains a valuable complement.

RevoEvo – Live Audio Visual Performance (click here)

[1221302945]

W5 Lecture - MEDIATING PERFORMANCE

Mediating Performance

This week was a short lecture. We learned the definition of mediating performance and also got to see Sir Fauzi's own works called Satu Hari: Penang, showing the behind-the-scenes of what goes on and the process for such performances.

Definition of Mediation:

A structured, interactive process.

An impartial third party assists disputing parties in resolving conflict.

This is done through the use of specialized communication and negotiation techniques.

Satu Hari: Penang

Collaborative work.

An artistic audio visual poetry of George Town.

It is in conjunction with DA+C Festival 2011.

A visual mapping for Suffolk House: bustling street scenes, traditional trades and heritage architecture within George Town.

The energy of the tradition burst onto Suffolk House facade to conjure a sense of familiarity yet with a new spin.

Traditional music inspired beats are juxtaposed with image composite of the old and new to create an unmistakably Penang flavour.

I gained valuable insights into the intricacies of creating these types of performances and the thought processes involved. Delving into the behind-the-scenes aspects was both enlightening and enjoyable as we get to see how the polished final version came to be. Understanding how individual shots are meticulously edited and integrated into these performances shed light on the craftsmanship behind them. the level which I aspire to achieve in my works.

Satu Hari: Penang by EFOZY (click here)

[1221302945]

W4 Lecture - MULTIMEDIA PERFORMANCE

Multimedia Performance - A New Media Approach

On week 4 we focused on multimedia performance and the concept of live cinema with an example case study, SuperEverything.

Here is the recap for this week:

Multimedia is a form of communication.

It combines different content forms such as text, audio, images, animations, or video into a single interactive presentation.

This makes it different from the traditional mass media that featured little to no interaction from the audience e.g. printed material and audio recordings

Multimedia presentations can be viewed by person on stage, projected, transmitted or played locally with a media player.

A broadcast may be a live or recorded multimedia presentation.

One of the few types of multimedia performance is live cinema.

Live Cinema

The concept of live cinema is still a fairly new and developing genre within media art

It brings together experimental approaches to narrative and non-narrative film making, with live music and the performing arts

Live cinema offers a unique experience, merging the spontaneity of live performance with the visual language of film.

This freedom allows the artist to present their work as a fully live and interactive performance, adding different audio and visual effects to their material on-the-fly.

These different feeds of video can be distributed across multiple screens, layered, looped and edited to create immersive, 3d works that are very different to a traditional cinema experience.

SuperEverything

SuperEverything is an example of live cinema multimedia performance, a cross disciplinary performing arts project.

It was created by leading audio-visual artists The Light Surgeons in collaboration with a group of Malaysian artists.

Explores the relationship between identity, ritual and place in relation to Malaysia’s past, present and future.

Exploded across multiple projections and different media, this live cinema performance layers together documentary footage and motion graphics with an original musical score.

Reflecting on this week's topic, I learned that multimedia isn't just about mixing different types of media; it's about creating interactive experiences. Live cinema stood out to me as a fascinating blend of storytelling, live music, and performance art. SuperEverything, the case study we explored, was a prime example of how this art form can be used to delve into intricate themes like identity and culture. The way it combined documentary footage, motion graphics, and music was truly captivating. What struck me most was the immersive nature of live cinema and the ability to manipulate visuals and sound in real-time, creating a dynamic and engaging experience for the audience.

SuperEverything live cinema (click here)

[1221302945]

A1: PERFORMANCE ART WITH NEW MEDIA TECHNOLOGY

Case Study 2: Local Artist

For the second case study, I did my research on Jwohan Lim and his work Motion Type Experiments.

About the Artist

born in 1995

multimedia artist known for his innovative approach to typography and motion graphics

has a background in graphic design and digital media

graduated with a degree in Visual Communication Design

his artistic techniques often involve experimenting with new media technologies to push the boundaries of traditional typography

explores the combination of design, typgraphy and motion graphics

Deconstructing the Storyline

showcase was held at the Digital Art Gallery (DAG) in Muzium Telekom, Kuala Lumpur (2023)

explores the fusion of typography and motion graphics, aiming to redefine how viewers interact with and perceive written language

the storyline revolves around the evolution of typography from a static medium to a dynamic and interactive art form, inviting viewers to explore the intersection of design and technology

Performance Tech Rider

audiovisual equipment

projection mapping

interactive interfaces

projectors

New Media Technology Applied

multiple screens or projection surfaces strategically positioned around the space to provide viewers with immersive experiences

synthesizing motion, sound design, graphic design and typography, seeks to re-explore the act of reading, through a variety of visual perspectives

digital projection mapping to project dynamic typography animations onto various surfaces in the exhibition space

augmented reality (AR) to create immersive experiences

How does the new media technology improve the concept and stage performance?

new media technology enhances the concept and stage performance by offering innovative ways to engage viewers and bring typography to life

digital projection mapping and augmented reality (AR) create dynamic and immersive experiences that go beyond traditional static displays, allowing typography to be transformed into dynamic canvases

How can current case studies be innovative in the future?

incorporating artificial intelligence (AI) to dynamically generate typography animations based on viewer input or real-time data feeds

experimenting with immersive technologies such as mixed reality (MR) or Kinect motion sensing device to create even more immersive and interactive environments

Motion Type Experiments by Jwohan Lim

[1221302945]

A1: PERFORMANCE ART WITH NEW MEDIA TECHNOLOGY

Case Study 1: International Artist

For the first case study, I chose Daito Manabe, with a focus on his work named Face Visualizer.

About the Artist

born in 1976

an internationally acclaimed Japanese media artist and programmer

has a background in mathematics and computer science

studied at the Tokyo University of the Arts, developing his skills in interactive art and digital media

his works involve merging technology with various art forms: music, dance, and visual art

known for facial tracking, projection mapping, and custom software development

Deconstructing the Storyline

collaborates with musicians using facial tracking technology

explores the mix of music, visual art and technology, transforming the human face into a canvas to express emotions digitally

fuses electronic music with real-time visualizations generated from facial movements

Performance Tech Rider

facial tracking cameras

projection mapping

custom software interfaces

screen displays

electromyography sensor + electrical stimulation device

New Media Technology Applied

cameras are strategically positioned around the stage to capture the facial expressions from various angles

uses facial tracking technology to capture movements and expressions of the performer’s faces in real-time

uses an electromyography sensor and an electrical stimulation device to copy facial expressions

data is then processed and translated into animations and effects using custom software algorithms

projection mapping techniques are used to project these visualizations onto screens and synchronized with the music in real-time

How does the new media technology improve the concept and stage performance?

new media technology enhances the concept of merging music, visual art, and technology by transforming the human face into a canvas for digital expression

real-time facial tracking technology allows performers to create dynamic visualizations that synchronize with the music, blurring the lines between performer and spectator

How can current case studies be innovative in the future?

incorporating machine learning algorithms could enable more precise tracking of facial movements, allowing for more intricate and responsive visualizations

integrating augmented reality (AR) elements could offer new possibilities for audience interaction, allowing viewers to participate in the performance using their own devices or wearable technology

Face Visualizer by Daito Manabe (click here)

[1221302945]

W3 Lecture - MEDIA COMMUNICATION 3

Media Communication 3 - Scene

The topic for week 3 is about scenes, with a particular focus on Sir Fauzi's past works in relation to it. We were introduced to this concept through his experience rather than given a theoretical explanation.

The featured work is Thaipusam (2011) by EFOZY, where he was commissioned by the British Council Arts Malaysia to shoot an experimental video about Thaipusam ceremony in Batu Caves.

The creative direction was to focus on the emotion of the prayers

This A/V clips had been screening in various international festivals

gained popularity for its uniqueness of style

possible the only black & white video of the colorful Thaipusam during that era

The main reflection I got after diving into Sir Fauzi's Thaipusam work was the contrast between the vibrant use of color seen during the festival and his artistic choice of purposely creating a black and white video. This enhanced the emotions of the people seen in the video and showed more vulnerability of the prayers, in my opinion. The absence of color allows for a heightened focus on the interplay of light and shadow, emphasizing the contours of faces and the subtleties of expression, thus again, the focus shifts entirely onto the raw emotions and spiritual connection of the people.

a video clip from Thaipusam by EFOZY (click here)

[1221302945]

W2 Lecture - MEDIA COMMUNICATION 2

Media Communication 2 - Perceptions

For week 2, the topic was focused on the definition of perceptions, its history as well as going through what makes a constructive workflow. Understanding perceptions offers valuable insights into the workings of our brain, shedding light on which side we predominantly utilize or find dominant. It also provides a deeper understanding of cognitive processes and human behavior. We were then also briefed on assignment 1 which focuses on performance art with new media technology.

To recap,

Perception is the way our brain processes and notices things about the world through our senses. It's how we make sense of what we see, hear, taste, smell, and touch.

This ability to perceive shapes our understanding of the environment around us and can affect how we interpret information from mass media.

There are three main steps in the process of perception: organization, identification, and interpretation.

Our brain automatically takes in sensory information to give us a complete picture of our surroundings, which can influence how we perceive reality.

For us to notice something, it needs to be accessible to our senses, like seeing, smelling, hearing, tasting, or touching it.

The concept of visual perception has been explored for centuries, with philosophers and psychologists trying to understand how we experience the world around us.

In the 19th century, psychologists began using psychophysics to study perception more scientifically through experiments and techniques. This has helped us gain a better understanding of how the human brain processes information.

5 tips for a constructive workflow

Understand the question

Construct a strategic plan

Fill in the blank

Get some ideas and inspiration

Set a perimeter

Reflecting on the topic of perceptions, it's intriguing to consider how our brains process and interpret the world around us through our senses. It's fascinating to realize that our perceptions are influenced by various factors, including our senses, past experiences, and cultural backgrounds.

In the context where technology and media play significant roles, the understanding of perceptions becomes even more relevant. Our perceptions of digital content, whether it's through images, videos, or text, are shaped by the way our brains process information and the cultural contexts in which we exist.

Overall, exploring perceptions offers valuable insights into the workings of the human mind and how we make sense of the world. It underscores the importance of critical thinking and self-awareness in navigating the vast landscape of information and media that surrounds us.

Painting by Oleg Shupliak

[1221302945]

W1 Lecture - MEDIA COMMUNICATION 1

Media Communication 1 - Performance Art For the first lecture, we were briefly introduced to the course lecture and our instructor Mr. Fauzi Yusoff (a director and design consultant). The main topic that was touched upon in week 1 was regarding media communication with a focus on what is performing art, and in this post, I would like to express my understanding of it.

My initial understanding of performing art was quite surface level such as involving live performances in front of an audience. These include performances like theatre, music, dance, and opera. Based on this understanding, I have experienced elements of performing art in my life via online and in-person. For in-person, I am most familiar with theater as I've taken part in various theatre productions and for online, it would be music of course.

However, after this lecture, I am aware that performing art covers more than what I knew. So here is the recap of what I understand now from week 1:

Performance art emerged as a prominent form of artistic expression in the 1970s, though its roots can be traced back to earlier movements such as Futurism.

It is characterized by conveying conceptual and content-based meanings through actions performed by artists or participants.

Unlike traditional entertainment-focused performances, performance art aims to provoke reactions and often incorporates elements of improvisation and aesthetics.

It typically takes place in various settings, including galleries, museums, streets, and other spaces, and may be witnessed live or through documentation.

Key elements of performance art include time, space, the artist's body, and their presence, as well as the relationship between the artist and the audience.

Themes often revolve around the artist's life experiences, social criticism, or a desire for transformation.

Performance art breaks away from traditional theater by not following scripted stories or set characters. It focuses on direct communication with the audience or ignores their expectations altogether.

Reflecting on the topic of performance art, it's fascinating to explore how this form of expression challenges traditional boundaries and pushes the limits of what we consider art. Performance art isn't just about entertaining an audience; it's about provoking thought, eliciting emotions, and sparking conversations. By using actions and live experiences, performance artists create a direct connection with their audience, inviting them to participate in the artistic process.

One aspect that stands out to me is the way performance art blurs the lines between different art forms. It combines elements of theater, visual art, music, and dance, creating a multidimensional experience that can be both powerful and thought-provoking. This interdisciplinary approach allows artists to explore complex themes and concepts in innovative ways, inviting the audience to engage with art on a deeper level.

Another intriguing aspect is the emphasis on spontaneity and improvisation in performance art. Unlike scripted theater or rehearsed musical performances, performance art often unfolds in real-time, with the artist responding to the energy of the moment and the reactions of the audience. This element of unpredictability adds a sense of immediacy and authenticity to the experience, making each performance unique and memorable.

From my now understanding, a significant example art I am very familiar with which falls under performance art is "Rhythm 10" by Marina Abramović. In this performance art piece, Abramović used a series of 20 knives to create a rhythmic pattern on a wooden table. She would then quickly and deliberately stab the spaces between her fingers, moving the knives around in a predetermined sequence. Each time she cuts herself, she would pick up a new knife, continuing the pattern. The performance engages viewers by exploring themes of pain, endurance, and the relationship between the artist and the tools she uses. Through her actions and the reactions they provoke, Abramović challenges conventional notions of art and the boundaries between the artist's body and the artistic medium. Overall, "Rhythm 10" fits well within the definition and characteristics of performance art.

Rhythm 10 by Marina Abramović, 1973