henryiswhy

[henryiswhy]

Measurement project -- Water station at ITP floor

Since March 1st, I was doing daily measurement about the two water stations at ITP floor.

During the past 50 days, we helped eliminate waste from disposable plastic bottles arounnd 3607 at station 1, and 911 at station 2.

Here is the graph about the data process.

While I am doing the project, it become a daily ritual for myself. Everyday first thing when I came to ITP, take photos about the water stations.

Here is a EPA website on Plastics Table and Graph:

And here are all the photos I took, since tumblr only can post 10 images, I upload them to Google Drive.

Day 1 stations 1:

Day 1 stations 2:

Day 50 stations 1:

Day 50 stations 2:

Here is the google drive link:

[henryiswhy]

Solar powered website — the updated final project idea.

I was think about building a solar power website since working on the solar project for energy class. I was give up on this idea because I don’t know what kind of content I want to put into the site. I would like back to this idea because I would like have the basic functionality running before graduation. So I can keep working on the digital content part later after my ITP study.

I knew the idea of solar powered website since one of the reading week at Tech&Society club.

I also found https://wp.nyu.edu/solarpoweredmedia/ that semester. I think build a server with Raspberry Pi, and use solar panel to power the server.

This github page seems have a good documentationo and interaction about how to setup the solar server.

[henryiswhy]

Connect devices final project plan

What: I want to make a wearable device (solar wing) that other people can control part of it though log in to the website. The wearable will have feedback based on the solar power, and the data received from the viewers. And the viewers will each act as a digital moths/butterflies on their device.

Why: During school times, I spent so much time neither at ITP, or at home. I haven’t experience outside environment that much. I want to use this device let me go outside and enjoy the sun. And since anyone can join the website, this can be a way I talk with strangers.

How: I will use solar panel to power the speaker and the GPS Module Receiver, and send those data to the webhost. And the gps data will be how the moths/butterflies flys in the website, and the viewer can control the moth by ”wasd” or drag their phone. And those drags will sent back to the solar wing, and the speaker will tell me how to move.

I ‘m create two dynamic maps for both the physical and digital devices.

Question I have: Because it’s live experience, it seems like I should websocket for the experience ? I still not sure what data I should send and receive for both object...

[henryiswhy]

Solar project -- solar bugs

So The inspiration of this project is from Kelly Heaton's Circuit Garden project, which I saw and really loved during Spring break.

Artworks by Kelly Heaton

At the beginning, I just want to use the two large solar panel I got from Lulu and Jason, and make two solar bugs.

Showing here.

But Jason found the solar bug toolkit.

I think I should add this into the project, so I have group of bugs.

Here is the video documentation of all the solar bugs displayed under solar light.

Here is some documentation about my making process.

Here are photos of the final outlook:

The things I learned from this project. It's really hard to get direct high power from solar. With solar project, have some kind of energy storage is super necessary.

And I should keep measure all those power sources. So I know how many power I need to running them.

[henryiswhy]

Connected Devices midterm recap

For the midterm, I only knew I want to do something with privacy and control, after having office hour with Tom. I decided just make a camera pan/tilt that can control by my phone as an exercise.

I ordered this pan-tilt from adafruit.

And started from here.

I used the basic motor example from Arduino website

And than, I added buttons to test if the motors can be controled with serial communication. There are the code and the demo video:

int button = 2; //pin of the first button

int button1 = 3; //pin of the second button

#include<Servo.h> //include the servo library

Servo servo1; //create a servo object

Servo servo2;

int pos = 0; //initial position of the servo

void setup() {

// put your setup code here, to run once:

//servo1.attach(7); //pin used by the servo

servo2.attach(9);

pinMode(button, INPUT_PULLUP); //define first button as input pullup

pinMode(button1, INPUT_PULLUP); //define second button as input pullup

/*

INPUT_PULLUP send to arduino LOW signal, so, when you press the button, you send a LOW signal to arduino

*/

}

void loop() {

// put your main code here, to run repeatedly:

if (digitalRead(button) == LOW) { //if Value read of the button ==LOW:

pos++; //increases the value of the "pos" variable each time the push button of the left is pressed

delay(15); //5 milliseconds of delay

//servo1.write(pos); //servo goes to variable pos

servo2.write(pos);

}

if (digitalRead(button1) == LOW) { //if Value read of the button ==LOW:

pos--; //decreases the value of the "pos" variable each time the push button of the right is pressed

delay(15); //5 milliseconds of delay

//servo1.write(pos); //servo goes to variable pos

servo2.write(pos);

}

}

After this run of test, I started working with p5ble, And I used the write to one characteristic one becasue I want to send info from p5ble to arduino

On the p5ble side,

I am sending

function downToBle() { myBLE.write(myCharacteristic, 'D'); }

function upToBle() { //const inputValue = input.value(0); // Write the value of the input to the myCharacteristic myBLE.write(myCharacteristic, 'U'); } function leftToBle() { myBLE.write(myCharacteristic, 'L'); } function rightToBle() { myBLE.write(myCharacteristic, 'R'); }

The down, up, left, right to arduino.

if(value == 'U'){

delay(15);

pos+=15;

myservo2.write(pos);

Serial.println("move up");

}

if(value == 'D'){

pos-=15;

delay(15);

myservo2.write(pos);

Serial.println("move down");

}

if(value == 'L'){

pos-=15;

delay(15);

myservo1.write(pos);

Serial.println("move left");

}

if(value == 'R'){

pos+=15;

delay(15);

myservo1.write(pos);

Serial.println("move right");

}

On the arduino side, once the arduino had the valu, than the motor will do those actions.

After I had those working locally, I hosted it on glitch so that I can open it on my phone.

Later I faced the issue that web Bluetooth API can't work with IOS browsers

At the end I found an App named Bluefy that I can connect Bluetooth with the App, than I can control my phone to the motor.

This is the mobile interface, and here is the demo video showing it connect with the website to contrl the motor.

The issue I still facing is that most all cameras are bigger then this tool. So I have to tape it to use it.

I will keep working on the filed of privacy for the final project. But I will to use CCTV cam for it. And think about how viewers can really become performer in the project.

[henryiswhy]

Kinetic Group Project documentation and Measure the power mini hw

The documentation for our project:

And here are some photos for our desgin and fabrication process:

Skeching our ideas & shopping for the music box

Coloring the 3d prints

Fabrication in details

Here is some readings for my HID devices:

I don't see any changes while I am moving the joystick or the button. I think it's becasue the energy we need for this event is very low.

[henryiswhy]

Week 6 Device-to-Device project concept

When I think about the topic we cover in this class, I think about network ecosystems, data, information, interface and surveillance. I am always into those topics. And I think make a device to device project about surveillance and interface sounds cool for myself.

I went office hour with Shawn and we think those words are very big, I need to start with things more detailed. And he said think about recommendation system might be a good start.

Later I was looking at some art projects about surveillance.

I think I would like do something about camera, machine learning(computer vision), and network system.

I am familiar with the computer vision part, but not so sure about how network system will be part of this project.

I know it's still a blurry, and it's due in one week. But I will have a prototype by next week and keep working it after midterm.

Here is a video about the HID device to mobile phone that Yontan and I worked on last week. Yes, it's working now!

Thanks Tom :)

[henryiswhy]

Week 4 HID with mobile phone as Etch A Sketch

Yonatan and I were in the pixel research group. And one practise Pedro said we could do is make a HID device for the phone.

We was thinking about made a bluetood based etch a sketch for the project.

We were Googling about how to use BLE HID for iphones, and it seems like we do need Arduino nano 33 BLE for the project.

https://github.com/tcoppex/mbed-ble-hid

This is the example about how the switch button can work with the computer. By Thursday we would like it work with the mobile phone.

Like this one.

I would prefer use Bluetooth, becasue after office hour with Pedro, we knew that connect Arduino with iphone most likely will not work.

[henryiswhy]

Energy - Measurement project idea

NFTs is so popular nowadays, and as someone have no knowledge about it, I think it would be fun to do a measurement project about it.

I mention it to my friend Lulu, and she said last year Jake did a measurement project on bitcoin too.

I watched this youtube video about the problem with NFTs.

And did find some articles the environmental impact on NFTs

I went to Jeff's office hour just now and had some feedback from him:

1. There are a lot of research paper in this field.

2. Start make your own NFT project and try to sell it, than you can find third party website to track the environmental cost.

3. Think about cost of machine learning locally and in the could.

Than I had some thought about

Maybe start with NFT, it can be the comparison between web 2.0 and web 3.0.

Or like jeff mention, we don't like them both, we should be to web 1.0

[henryiswhy]

Week 3 - HID-based Game Controller

So for this week, I do have a real world setting for the HID device that I'm trying to made.

I submitted a olde artwork to a show. And the curator want to change the mouse based interaction to all the buttons. She was thinking so that user can push those buttons at the wall.

First, I built all 5 buttons to control the top, down, left, right, and left-click for the mouse.

Based on the Button Mouse Control code on arduino's office website (which Tom wrote 10 years ago)

I had the button based mouse working well.

And my friend Jason Gao saw this homework, decide use his solderable perf board make one just for fun.

Later, I found I do have joystick in my toolkit. And I added it to the project. The only problem I had with joystick is that the click is not working well.

I started my jostick with https://itp.nyu.edu/physcomp/labs/lab-mouse-control-with-joystick/ this code. To make sure it's working.

Than, I used this example code

I started with this code, and for the press logic, I used

if (clickState == LOW ) {

// if the mouse is not pressed, press it:

if (!Mouse.isPressed(MOUSE_LEFT)) {

Mouse.press(MOUSE_LEFT);

}

}

// else the mouse button is not pressed:

else {

// if the mouse is pressed, release it:

if (Mouse.isPressed(MOUSE_LEFT)) {

Mouse.release(MOUSE_LEFT);

}

}

if the clickState is High, it will keep pressing, and if the press is LOW, the click will have no behavior .

Another question: based on this video, if I want to add it as each station with one button, so it will have about 18 buttons, how would I do it with those Arduino pins?

Later, I combine the basic button code and the joystick code together. Here is the final demo video.

[henryiswhy]

QR Code Application

For this week, I want to made a AR application based on QR code.

Since I will have to website, one for displace the QR code, one for showing the AR app, I think use glitch will make it easier.

For the QR code part, I started with the code Tom give us:

Than I use qr.addData('https://qr-for-3-d.glitch.me/'); to link it to the AR code.

This is my first time doing web AR and it's easy to start, and hard to made it nice.

There is the final code:

And there is the video demo

I really want to add sound and 3d model, but didn't make it to work.

[henryiswhy]

Energy Week 1

Building a pendulum was very fun!

I think I will enjoy this class!

[henryiswhy]

Serial to Browser Device Assignment

For this week,

I want to try to use Ultrasonic Sensor for my first time, and think about how I can send arduino data to the html page.

The arduino side is very simple:

Than I was reading abbout HTML hardware interfaces and I found the webSerial code on github. And I started my HTML code based on that.

Here is the current stage I am.

The issue I can't figure out. How I can change my distance data into a json file. If I do:

for device, I will keep getting 0..

I want to use the distance to change the color of CSS. Didn't make it that far...

[henryiswhy]

Programming from A to Z - Final Project Proposals

There are two parts of my final project.

Keep working on my Language of Pi project. And have a working in progress showing during final presentation.

I was very inspired by Dan's the book of pi. And it lead me to the direction to the art book.

The first step would be have a clear visualization in Processing as the prototype, than I want to bring it into a web version.

The book would really hope my project -- Morphing: A Guide to Mathematical Transformations for Architects and Designers

How I can bring math into code, and the visualization would be the major challenge for the project.

The second proejct of my I want to try on is, doing a AI based artist statement generator.

Here is the project really inspired me:

I would let people play with this project, and have as many results as I can.

[henryiswhy]

Alter Egos -- Final performance plan

It's a dictionary, a timeline, a biography of myself. But in a design fiction way. There will be a really me, and a egos me, to interact, to have conversations.

When I think about this performance, I was thinking, why this has to be a performance, not a video proejct about myself. Now I think I found the answer, I think there are many elements of exploration in this. In many cases, the whole journey can be changed, just like life. Some parts are fixed (the video at the beginning ); but there may be many parts that are unknown, waiting for everyone to discover the world together.

Film and live move — 1 mins

I wearing my costume walking, the character in the film is walking as well. I am acting to match the vitural character.

Exploring the database — 4 mins

Many motions of me, and VFX keep changes.

Sound

I will have a lot of recording sound. But also, unity is very good for spatial audio, so I will have a lot of sound effects as well.

The software I will be use for sound:

https://blog.audiokinetic.com/zh/using-wwise-for-immersive-arts/

http://sites.music.columbia.edu/brad/uRTcmix/uRTcmix-tutorial.html

Model

https://www.russian3dscanner.com/

https://www.reallusion.com/character-creator/

https://www.unrealengine.com/en-US/metahuman-creator

VFX

https://github.com/keijiro/VfxGraphTestbed

https://kejyunwu.com/Clairvoyance

Mocap

https://www.depthkit.tv/unity-expansion-package

Costume

http://ayo.io/rift.html

https://www.instagram.com/seeyourselfsensing/

Performance inspiration

https://www.yasminehuang.com/genesis

https://www.heesookwon.com/Leymusoom-Ssitgimgut

http://luyang.asia/2021/06/12/doku-digital-alaya/

https://laja.me/Antidote

[henryiswhy]

Biomaterials Class 3 homework

- Think of a project idea involving mycelium or fungus

I will do a final project involving both mycelium and fungus. I had the idea of doing a VR film project about mushroom since multisensory storytelling class for the first half of semester. It's about networks, and hallucinations.

I watched https://www.fungifilmfest.com/ today and will keep watching film for next two days.

And I found this work was interesting.

And I went to a mushroom watch two weeks ago.

I went to office hour with Elaine Gan this week. And she given me a lot of feedback and information about funus. I think I will go to green-wood cemetery this weekend for a field tirp. Since it's where https://gardens.green-wood.com/ happens.

I want to have some physical / biological elements outside of the VR environment. Still need to think more about that.

- Readings

I knew Paul Stamets though watch fantastic fungi. And this is the first time I'm reading his book. And I think this chapter was very interesting. He web and internet as metaphor for mycelium, it's something I'm thinking to. But didn't have In-depth study.

I read The Mushroom at the End of the World, earlier this year. And Lucas and I was talk about it today on why this is a very good book to read. The concept of symbiosis inspired me a lot.

- Class's fungus

The grow fast!

[henryiswhy]

Programming from A to Z Week 9

I think Context Free Grammars is really good for making a Fortune Cookie Generator, so I made one.

Play it here:

But I don't really understand the algorithm itself, so I just changes the text document (cfg_test.txt) file.

I would like make this project better, but for now I would like know more about, how Context Free Grammars works? I watched all these videos, but still can't code it when I started the project. hahah

Here are some inspirations for my fortune cookie generator.

Here are some results for the current version of my generator