Week1 Journal

For week 1 I mainly focused on making my plan more detailed and started to test the technology & devices that I plan to use in my project.

Week Brief

Progress
What worked:
Using p5js and arduino (button) to control basic interactions
Code for basic interactions
Starting to work on the "smell" interaction
Project Website set up
More detailed plan
Tested the projecter I am going to use
Research potential sensor
What didn't work:
Try to use touch designer for my project
Challenges
New challenge:
Instant semll interaction
How to call back the idea of decolonization through the installation
Solved challenge:
Use p5js & button to power interaction
Pending challenge:
Art-style specific
Storyline
Next Steps
Next week:
Testing different sensors (maybe)
Adding relay to the circuit
Start to work on story board?
Long term:
Complete rough prototype (Use ideal sensor to trigger digital interaction & smell)
Might need some form of testing for interaction?
Start to work on animation

Project Background Recap

Brief

This project was inspired by research on the colonialization of American museums. Through my research, I discovered that revealing the cultural background of historical artifacts is an effective approach to museum decolonization. As a result, my research also covers strategies for informal learning in museums, as well as users' needs and interests within museum spaces. This semester, I will build upon the findings from my previous research to address the identified questions and needs.

Research Process from Last Semester

During the research process, I primarily used secondary research to supplement my project with conceptual information and references to relevant projects. For primary research, I used shadowing to understand existing museum curation methods, user interviews to explore user characteristics and needs, expert interviews to validate information obtained from secondary research, and co-design sessions for brainstorming.

Clarity of Purpose

How might we build an on-site installation (or curation) that focus on reveal the cultural context rather than just the artifact for a specific Chinese historical artifact (Chinese Cloisonné Enamel Incense Burner) that provide young visitors of universal museums in America with a fictional, drama-like interactive experience to achieve the goal of decolonizing museums through informal learning?

  • Formal Vs. Informal Learning: Provide just enough information to trigger interests in the complex museum environment
  • Incorporate Multiple Senses: Incorporate multiple senses like smell and touching
  • Fiction Based on Fact: Reach a balance between authenticity and fiction in storytelling

Target Users

Young visitors with no deep knowledge (of the selected artifact)

Creative Relaxers
Come for relaxing and inspirations
Focus on visual aspects of artifacts
Social Adventurers
Come for social activities (friends, partners)
Enjoy the environment & sense of adventure

Planning

Initial Sketch of the Installation

Conditional Plans

North Star Plan
Using Touch Designer + Arduino to power interactions
Using hands touching to trigger interactions or different interaction s for different items
Smell is interactive
Project on a “scroll”
Colored 3D printing props
Conservative Plan
Using P5JS + Arduino to power interactions
Using buttons to trigger interactions
Smell is not interactive
Project on wall or other ready-made surfaces
Props colored by hand
Fallback Plan
No interactions (animation played in sequence)
Additional physical and digital Souvenirs (Perfume of packaging with AR, tote bags…)

Plan for this Semester

The main milestone is to establish the concept and complete technical testing before the fourth week to finalize the project details. Since the physical components and storyline influence each other, I will begin designing and creating both the physical elements and animation simultaneously after this stage. The goal for the midterm demo is to complete just one scene of the animation along with the physical component. After that, the target is to complete the thesis writing and project production by the eleventh week. The remaining time will be mainly dedicated to documentation and as a buffer.

Needed Resources

Material & Devices
Projecter - Bought
Arduino kit (basic) - owned
Arduino kit (extra) - Amazon
Extra materials for making physical props - Buy online, 3D printed...
People & Service
Colored 3D printing service - https://i.materialise.com/
Participates for testing - class or friends

Basic Interaction Tech Testing

Testing Touchdesigner

Testing P5js

I started experimenting with the combination of p5.js and Arduino to achieve the interactivity I envisioned. First, I aimed to implement a simplified version of the interaction, where multiple physical buttons on the Arduino would each control the playback of different videos on the screen.

Rough Prototyping

In this test, I built a simple circuit and used an image writing "S" as a placeholder for the untriggered state, while videos counting from 1 to 15 seconds served as placeholders for the triggered state. The test was successful.

Testing: Smell

Step1: Testing with Light First

I first tried adding interaction in the code: the light turns on for 5 seconds after the last video plays for 8 seconds.

Step2: Add atomizer in

To achieve instant scent dispersion, the best method I came up with is using an atomizer. So, I added a modified atomizer module to my circuit. However, I found that the Arduino pin's current was insufficient, so I bought a relay. I will continue testing next week.

Potential Sensor Consideration

Realizing the "touch" interation

This exploration is for brainstorming how to realize the touch interaction as the physical interface for my installation.

Capacitive Sensor

To achieve fully touchable interaction with objects, using a capacitive sensor would undoubtedly be the best option. However, the main issue with capacitive sensors is that they either need to be attached to the object, which essentially makes them no different from buttons, or the object's surface must be covered with conductive materials or conductive paint. This approach not only limits the object's appearance but also presents challenges—conductive paint, in particular, is highly toxic and unsuitable for experimentation.From a UX perspective, designing an object to be fully interactive across its entire surface might encourage users to pick it up, which is not the kind of behavior I want to promote in a museum environment. For these reasons, capacitive sensors are not among my top choices.

Pressure Sensor

Similarly, its issue is that it can only function within a relatively small area.

Distance Sensor

This type of sensor has a larger touch range and can be triggered without requiring highly precise touch. However, the issue is that I am not sure whether nearby sensors will interfere with each other, which requires further testing.

Another Possibility: Different Sensors for Different Interactions

Another possibility is to transform this interactive process into four different interactive toy-like triggers rather than repeating touch interactions. For example, one object could be a box, where opening and closing the lid triggers the interaction, in which case a light sensor could be used. However, this approach would require determining the storyline first.

Device Setup

Set up Projector

I set up the projector for my project and tested its keystone correction for diagonal projection, as this feature is crucial for my project.