WareHouse 08

Late thesis journals.

2010-11-21T08:56:00.000-08:00

Just for keeping tracking my progress.

After thesis 1, I havent done much about developing code.

However, I am in the ending period of thesis 2.

It is time to sack up and get rid of those excuses I made to fool myself.

Enough monologue.

I keep developing the face detection in order to make it more efficient.

And then move on to data analyzation.

| Data table

My ideal goal is using those raw data to generate music chords , notes and beats with my data filter to the music system. Unfortunately, it is way too difficult to really smooth the raw data to be good enough to use as music triggers. Even we look so different. But so far, OpenCV doesnt really make for distinguishing the differences of features. It is more about recognizing the features. I did get some useful variables but not dramatic.

So, after talking with my adviser, I guess I have to give up the thoughts. Instead of generating the pattern by the users face, I will need to have some pre-made patterns, and then use learning system to make it grow. ( too artificial for me tho) I guess this is the compromises I need to make.

| Music table

However, the learning system is more for melody not for beats, bass or drum.

It means I still need to have a solution for other sections. I decide the music system has 6 channels.

1. Lead-Melody

2. Sub-Melody

3. Lead - Beat

4. Sub - Beat

5. Bass

6. Special Effect ( which i dont know what will it be )

| Selector

|| PAUSE

Thesis Document

2010-02-04T14:29:00.000-08:00

Title : F.A.C.E

+ Motivation

I am a person full of curiosity. My interests are varied and may not necessarily relate to each other. However, in some ways, they are all about “people”: how people are affected by the world, how they interact with objects and others in the environment, and how they feel and react. I always try to figure out people’s personalities and what they are thinking through their facial features and expressions.

Facial expression and sound are both non-verbal communication that crosses the barrier of language. Even if we do not speak the same language, we still can sense how others feel. The way we see ourselves may not be equal to the way others see us. People want to convince others that they are who they want to be. Hearing also plays an important role in feelings and memory. When we hear certain sounds we can imagine a scene and feeling based on our common sense and personal experiences. So, what kinds of features shape a person? And, what kinds of expressions do we have? How those result affect people’s behaviors?

+ Thesis Statement

My thesis is an interactive installation about the circulation of communication, which is based on common sense and personal experience. It provides an opportunity for people to use their unique facial features and expressions to create an atmosphere by generating sounds.

+ Technique

Faces have a limited range of movement. Expressions rely on differences in the proportion and the relative position of the facial features. These differences are sometime tricky when the facial expressions are neutral. In addition, we all expect the images to fit what we intend our appearance to look like. We can not change our facial features unless we get plastic surgery. It’s about combining our expressions. The programming will include different stages for each expression. The key point, which determines the sound, is based on the sense of shape. We always see images with sounds. A round shape of stone can be converted into a slow tempo and a smooth cello.

+ Face Recognition : Rectangular Haar Classifer

Faces have a limited range of movement. Expressions rely on differences in the proportion and the relative position of the facial features. On the left, those red arrows separate facial movement to 12 units. It can give the data by calculating the distances and relative positions between each section. The library I am using is Opencv( Open Source Computer Vision). It has particular technique for face detection : haar classifier. A simple rectangular Haar-like feature can be defined as the differences by distinguishing pixels of areas inside the rectangle. For example, inside of those two rectangles, since eyes have more changing pixels than rest of area.

The generating process of the sounds and music

Facial features will generate the basic tunes first. Facial expression will generate new sounds and affect the basic tune such as slow down the tempo, echo and scratch the music. The result will sound like music combines read world sound, instrument, melody and human beat box.

reflection(After)

2009-12-12T07:22:00.000-08:00

I don't know how to start. Anyway.

I am not saying my presentation is great. But I try to make everything clear and understandable.

There is still a problem which bother me after mid - term presentation.

I spent a lot of time thinking about it. I even over analyze my propose.

I also did a lot of research and test and got some progress about face detection.

Most of people tell me, I should stop over analyzing my concept.

Otherwise, I will lost the essence of my project.

" I still can not connect your concept to your project "

I try to figure out the best explanation. But apparently, my efforts are wasted and unavailable.

Because the question has been addressed again in final presentation.

What is the missing part? What's the reason?

I really want to know.

I don't really know what's the answer.

Because my weak artistic mind? Because I don't have lofty concept?

Because what?

reflection(before)

2009-12-09T20:13:00.000-08:00

I think everyone has their influences. I can not distinguish clearly what really affect me deeply.Today, Lo-vid asked me " Why potato?" Seriously, I really don't know why. At that time, it just seemed a decent choice. I mean why not? Anyway, I guess I have to come out a better explanation.

To be honest, I don't care about the line between art and design. Even the definition.When we make a project, apparently, we consider how people think about it.Even we are making art? or digital art. Essentially, they are same things. just different methods to make pieces. Then to me, it's design. We design those tiny details to dragger or evoke people's feelings.

journal

2009-11-14T19:32:00.000-08:00

Okay. It's time to update something about my thesis project.Last post, I was confusing about the propose of interaction.Turn out, I failed to analyze my questions. In order to keep myself on the right track, I just follow my instinct. I list subjects, objects and anything I like. The result is my thesis idea.
So, Music and Face. ( I will skip concept now, and just tell what will happen first.)Simple idea. Your face is an interface to generate music. It depends on your facial features to create basic tune and then your facial expressions changes and add more sounds and effects to the music. It's a installation for everyone. We all have hard time to read people's minds. In this case, facial expressions. Among my classmate, most of them are making something "personal" about their thesis. Then, it makes me think " Why personal ?". I mean I know we all get inspiration form our life and personal experience. Don't get me wrong, I didn't against personal thing into project. But " Why I need to make my project personally". I am not saying personal experience is bad thing. I just wonder. I guess it goes back to the basic question. The distinction of art and design. Anyway, not issue now.

My standard for my each project is unless I want to play it again and again. It has to attract me. Even I want to have it.
I am a international student in U.S. Obviously, I am not good at english. I confuse and misunderstand what people say. I guess it needs more explanation about my Burrito story with my thesis. The point is not about communicate accurately. It's about enjoying the whole experience. I mean, of course, we need to communicate in most time to achieve our goal. But Why "Rush hour" is so popular. Maybe I go too far about motivation.
What's my concept?
my answer never get right point. Maybe because I confuse about the definition of " concept"? I always say something about what my project does. my installation does. but it's not concept for them.. I guess.
So, now my primary mission is " face detection". Unless get some features first. For music part, I need to think better way to generate music. and of course, MAXMSP, face detection, is another key point.

(...read more)

journal

2009-10-07T18:36:00.000-07:00

I know it may not sound real as I describe.

But when I came up my idea about thesis. I didn't think about any installation I sew before.

I have very limited knowledge about interactive installations or projects.

Most of my collections are graphic, motion and product designs and animations.

Anyway, not issue.

So, now is october. It's about time to narrow down ideas I have.

However, unlike other people, I don't really have other ideas except face detection.

I should give my thesis a temporary name because face detection is not accurately at all.

Generally, I would like to use peoples' face to generate sound or music. And then also detect emotion.

I don't know why. In the beginning, I think it will be super interesting. Suddenly, I don't feel same way as before. I can not lose my passion in this very starting point.

Research part:

I got a video from youtube. The creator had fully develop the face detection. It can recognized eyes, eyes brows, nose, face and lip even the shape of lip. The shape of lip will become a point to determine emotion. Actually, he even made a test about emotion. Exactly what I want.

I haven't really think through my project. Maybe I should talk with Liubo face to face again. It will help a lot.

I can not lose my passion in the beginning.

BTW, i ruin my history class midterm exam. SXXX.

OUCH

2009-08-31T15:16:00.000-07:00

Today is my first day for fall semester.

I met Luibo.

He asked me " How's your summer, did you finish anything?"

OUCH!!!!

ha ha.

Even Michi made a web site.

OUCH!!!

and I forget to change my address again.

OUCH!

Confusion

2009-06-03T04:27:00.000-07:00

Well, well. I should think about my thesis now. To be frank, I HAVE NO IDEAS AT ALL.After I start my vacation, I spent a lot of time to browse those web sites which I used to check every day or week. I enjoy watching ,reading and observing any kinds of pieces. But I never particularly pay highly attention on "interaction" Our department uses "Interactive Media" as title. RCA uses "Interaction Design". New department in SVA also uses "Interaction Design". What does that make differences?

I don't really think about this question carefully.

In short, Design usually connects with commercial, and Art connects with uncommercial. Nowadays it's really hard to separate "Design" and "Art". When I start to think about my interactive project, Concept, of course , is primary consideration. Then, "Interface". We never say make, create a interface. We said " design a interface." The basic two factors of interaction are "People" and "Communication." How people communicate with interactive pieces depends on how creators " design their interface of works." ( Titles confuse me all the times. Are we artists, designers, authors or whatever....? in the end, I think " creator" is the best expression) So, We design interfaces to help us express our art concept? I confuse all the time. The boundary is too blur to me. Design an art piece?

Anyway, I still have no ideas about my thesis.

Physical Computing / Interactive Installation

2009-05-28T20:36:00.000-07:00

When I start to think about my own project, the most important consideration for me is " Would I be attract if it is someone's work?" For me, fun and how it interact with visitor are my primary consideration. So, since the beginning of semester, I came out this idea. I want to use gesture to control car and make a game. I even think about building a car ( outlook, of course ). However, writing codes in MAXMSP is already hard enough for me to achieve my aim. ( Thanks Luibo! ) The program has two inputs ( two camera ) for two persons. When one of them wave faster than another, he/she will win the domination which can control car's direction. So, the rule is try to win the control and make ball into your competitor's goal. But seriously, you have no idea how hard to touch the ball! It's interesting to see the car gets crazy all the time!

Here is my transmitter and Arduino. Since the Arduino only accept 5V, transmitter needs 9V as power supply. So, I need Tip120 to adjust the voltage. Each direction needs one chip.

Two cameras on the wall.

This is the Car.

When the car be activated, there are some LED lights.

I will explain MAXMSP later.

After the show.

2009-05-08T21:35:00.001-07:00

(actually, you can tell that i was piss off.)

After the show, all I can feel is " what's wrong with me".

I don't even feel that I finish this project.

I aware that I always didn't finish the project as I wish.

It just gets worst. Even people told me, my project is interesting.

But if the project doesn't finish and well done, it doesn't matter it's interesting or not.

I do like my idea. Just too many but. But I can not solve code problem. But I need more time.

But it doesn't work as I wish..... And it remind me that my previous projects.

What is the right thing to do? How can I complete project? I should work harder.

Those questions stack my mind. I need to figure out.

Still, I would like to thank Nok provided me a box. And Jean tries to solve my problem.

Mao wei looked through my code. And my professor, Mr.Mackey, gave me the direction and advices.

And also thank all that listen me complain everything doesn't work.

I sincerely hope I can improve the way I do my project and make it work.

Thank you all.

potato Project: Peekaboo/ Documentation

2009-05-07T21:29:00.000-07:00

It is documentary for potato project.

More and bigger pictures >> HERE

Potato Project: Peekaboo

2009-05-06T19:13:00.000-07:00

This is the test version of my installation.

I made two pieces to support glass(surface) and box( thank for Nok).

It took a while to find the right position for projector and camera.

The projector and IR camera are inside of pedestal.

Detail:

The IR camera sets above the projector. I also need to find the right position for camera.

Because the IR camera should be able to cover the area which is bottom of box.

The glass surface.

Top view of potatoes ( I know it looks unbelievable, but these are real potatoes)

The inside view of glass surface and potatoes in the box.

After setting up, I used black fabric to cover whole pedestal. It might makes the projector over heat easily.

-------------Dumbo Setting-------------------

The setting in the dumbo is pretty much the same.

Before cover the black fabric.

The inferred light is above the pedestal.

Top view of potatoes.

The actual view. You can see inside the white space, there are some creature(pekaboo).

The actual interaction. When you pick potatoes, you will see the creature.

Potato Project: Peekaboo

2009-04-23T17:57:00.000-07:00

Update

Recently , I am dealing with blob and particle system in processing.

In peekaboo project, I don't need to deal with arduino ,sensor and socket.

So how, I feel bad that I didn't have chance to learn more about it.

However, processing is also hard enough to me for achieving my goal.

Now, I got some progress. Unless it work.

The red area will be the hole when visitor pick up the potato.

And the small black creature will avoid the red area with certain range.

Now, I have some problem about contrast of image. Detection is not really accurately.

I need to modify the Blob and make the system determine the range better.

And how to get more than one blob, attach the mov file without background.

Plus "SOUND". I got some crazy sound. However, playing sound will be too normal.

I need to write a code which can adjust the volume according to whenever the blob showing up.

Damn...

I tested a distance which from project to the surface of pedestal.

Now, I need to build proper height pedestal, surface and clear up my potatoes.

How can I finish this project with good quality?

I hope I can actually finish it. No bug, No error. Make it work.

Potato Project: Peekaboo

2009-04-01T02:20:00.000-07:00

+ Semester Project

Picking Potatoes and Meet Peekaboo.( I know it's a stupid title, but it's fine for now.)

+ Summery Description

The project is a interactive installation which combine the organic material : potatoes and virtual creature : peekaboo to evoke visitors’ curiosity of discovering unknown.

+ What is my subject? and Why? What is my intention and medium?

My subject is about curiosity. Personally, I was that kind of kid who will ask tons of wired questions. And most of these questions make no sense to my parents. Why do you start to walk from your right foot? Why not left foot? Will that cause anything?...etc. Mi intention is simple. When the interface is something we familiar in daily life, it could make installation more friendly and interesting. And it allows everyone can play it without any barrier. The reason I chose interactive installation as my primary medium is I can touch something and meanwhile, I can also create non-existent things in real world.

Subconsciously, I obsess Mr. Potato when I was in university. Another possibility is that I noticed people gesture when I went to supermarket. Customers pick vegetable, fruit, and meat...etc. Then, Why Potato? It’s cheap, And As I said before. Mr. Potato.

+ Similar Artist and Project

I am still looking. Potato is not a popular choice to installation.

+ Typical Visitor:

Anyone has high curiosity and not afraid to touch potatoes. Housewife. (Don’t laugh. They are the expert! ) Framer. Since those potatoes could be grown by them. They may want to take a look?

+ What will you(Visitors) do?

Pick potatoes!

+ Diagram

Bigger Diagram

+ What is Peekaboo?

Peekaboo is a creature who like this!

+ What will happen? Before, during and after the process.

Before: You will just keep hearing some odd sounds. And potatoes in the box.

During: You pick up a potato and then discover that creatures ( Peekaboo ) live under those potatoes.

After : When you are picking up or taking off those potatoes, there is a special potato which can trigger off the projector above. The creature jump to your hand!

After and after : If you took off all potatoes, Peekaboo will be no place to hide! And gradually disappear.........!

+ Technology

Software : Processing, MaxMSP ( if necessary)

Hardware : Pedestal, Projector, Camera, Potatoes

NEW/ Interactive Scenario / Eyeball

2009-02-20T20:14:00.000-08:00

Interactive Scenario / Eyeball

When you walk into the room, you saw there are some still images on the wall. On those images, a lot of people are standing still. You walk around. You notice that something is moving slightly. But you look around. Everything seems the same as few second ago. Then, you found out the differences. Those people on the image are peeking at you. They even keep approaching you slinkingly. They are whispering to each other. When you get closer and try to figure out what are they talking about, they stand back and act like nothing happen. The more you approaching, the more they escape. Finally, you give up. You are going to leave the space. Then, they just dismiss and back to the beginning.

Inside the room, the video will be project on the wall in three different directions. There are some sensors to detect the position of participates. The position will become a reference for those characters’ eyeball. It also triggers different videos which I pre-made.

( However, it brings another question, What if there are more people inside at the same time, which one I should choose?)

Here, I assume it just has one visitor.

Reaction of people inside the video (abbreviation: People) :

When visitor comes to the space, they keep standing still. After 10 seconds, they will start to peek at visitor.
People will gather to the position which visitor stands.
People will approach the visitor, and keep watching visitor.
When visitor approach those people, people will stand back and act like nothing happened before. ( Like they don’t ever look you once)
When visitor stand in front of screen ( same position) over 2 minutes, people will go back to position which they are in the beginning.

Scope of work list

Visual assent : Projector, Video
Sound assent : realistic sound which records form usual life
Physical Component : Projector, sensor for detecting the position of visitor
Special technologies or programming widgets : Flash, Maxmsp . After Effect( for video editing and effects)

Right now, I am not sure about using MaxMSP or not. Apparently , I need to detect the position by camera. Processing might be able to do that. I will try to research more possible ways.

Interactive Scenario

2009-02-11T09:45:00.000-08:00

Interactive Scenario

// Flash-based Game

You see a huge head of person in the middle of computer screen. You only can see that person’s side face(It will be somebody, but right now my choice is Einstein) . He looks pale and seems to lose hie energy. There is a mouse beside the screen. In the beginning, the person is looking somewhere else instead of you. However, when you move you mouse to him, his eyes will look at you. After you click, he will turn and face to you. Then his head will open. You will see there are numerous hardware put in different places. You can see some gears are not working, but some are. You randomly click some hardware. Something happened. Some hardware keep working but some don’t. When you stuck and don’t have any action over 3 minutes , it will show a tip automatically. When you make all gears work, the head will close automatically. Then, the person’s face is not pale anymore. He talks to you. He says” Thank you for fixing my brain”.You will feel release. It just likes you finish a puzzle finally.

( This is general idea. )

I believe that a lot of people want to know what Einstein's brain looks like!

It could be other people. Then it can show what he/she is thinking.

For example, if the interface is Einstein. The result could be relativism.

It’s really difficult to describe each detail now without flow chat. I will focus on flow chat first. I will use flash as my main software. About the images, I will use photos and my drawings. Sound for project will be made by Garage Band.In addition, I will also use free sample music from internet and record voice by microphone.

( Huge Picture )

Moreover, the beta version will be have more people , different construction and results.

// Car

About this idea, I think it will be more suitable to build in the physical computing. In addition, there are some classmates from industrial design. It will be very helpful. Another reason is processing maybe not powerful enough to finish this project. So, eventually, I might need to use MaxMSP.

Exploring ideas / Summary

2009-01-30T07:46:00.000-08:00

About my project, I didn't particularly prefer any genres. This semester I am taking Physical computing, interactive installation and dynamic web studio. Generally, those covers a lot of range of interactive media. Perhaps I can combine those advantages to create bigger project. I have several ideas.

No. 1 /

A small toy car (The devise has 3~4 wheels) which can detect the shadow in different directions. I can create some hand gesture to control the direction and reaction. I just want to create something that I still want to play after the classes. If the idea can be achieved, it will look like "force"( if you ever watch "Star War" , you know what I am talking about ). Without touching the object, I can move the object and do more actions. I feel exciting about the scene if a lot of people play together. ( Maybe this idea is more suitable for physical computing class....)

No. 2 /

I got a inspiration form PS2 ads that I can create a flash-based game. A crazy journey of brain? You have to find the correct order to trigger those events. And get the finial goal. This web site is a example. Same logic.

I also like Yugo Nakamura's works. Using the results of Amazon.com creates fonts or creating a community site let participants can add their information, and then generate a unimaginable creature which belong to themselves.

No.3 /

I put two example about create a instrument. I want to create a small device which can create music. It doesn't have to be a instrument. Like Pacemaker, the small DJ system, it's more easy for everyone. And I also think projecting some marker on the floor or on the wall is a good platform to play with music. Creating different way generates sound. Maybe " a helmet" (ha!) and a glove which can detect the gestures and positions. Like a visible buttons!

No.4 /

I also want to make a device like Tuttuki Bako, but more interactions on the screen. But I have no ideas how this devise work......

Tuttuki Bako

2009-01-28T06:58:00.000-08:00

check the video here

It's a cool product invented by Japan company named Asovision. The product's name is "tuttuki bako". For me, artistic aspect is important but how the piece itself can interactive with viewers profoundly is also a important factor to consider. I love the way this small box provide a lot of possibility. And our finger has to put into the unknown machine. I didn't think it is the best interactive piece ever. But it indeed gives me some interesting thoughts about my own piece.

Vanity Ring

2009-01-27T15:48:00.000-08:00

(photo from Gestalten mit digitalen Medien)

Made by Markus Kison

" The Vanity Ring doesn't have a jewel, instead it shows the number of hits one gets, when he searches Google for the name of the person who wears it, a more adequate value in our time. It is personalized using a custom software, and after the name is typed the ring will change its display to show the personal "attention carats", while every night, when it is inserted into its docking station the ring is reloaded and updated."

The most interesting part is that It's a ring that just shows results when searching on google, but the artist gave those number a new definition. Rings are well known a symbols of rich. People judge its owner by the jewel's weight in carat. Now the searching result of google replace the diamond. Ironic!

Playstation 2 : Head

2009-01-27T15:44:00.000-08:00

(Photo from Ads Of The World)

Agent: TBWA, ParisCreative Director: Erik Vervroegen

Art Director: Sebastien Vacherot, Jessica Gerard-Huet, Loic Cardon, Ingrid Varetz Photographer: Yann Robert

This is a ads of Playstation 2. Although it's not a interactive piece, I love its idea. I always think that inside my brain and body might be have other species live there which human can not see. I would like to turn my imagination into a interactive piece. Like a mysterious flash-based game!

KASHIWA SATO佐藤可士和

2009-01-27T15:23:00.000-08:00

KASHIWA SATO is a famous designer form Japan. His website is interesting. He used simple element which is my favorite " color" to design each piece he has done. I felt near and vivid.The web site shows his characteristic. His works always simple but relish! I think web site for artists or designers is also one of artworks. It should show personality and capability in the same time.

Virtual Piano

2009-01-27T09:14:00.000-08:00

( Photo form TechEblog )

DID's (Digital Information Development) is a product company from Japan. It invented a "Virtual Piano" which can lets viwers turn any surface into a musical keyboard. There is a red semiconductor laser module and holographic optical element" to project "a 25-key 2-octave keyboard onto the surface in front of it." I like the piece because it's small, playful and efficient. As long as you have a surface, then you can play piano anywhere.

Vinyl Workout

2009-01-26T14:22:00.000-08:00

Watch the video here

This installation made by Theodore Watson

A giant record is projected on the floor and it can be played by running around its surface in the direction you want it to go. If viewer run slow the record plays slow, if you run fast the record goes fast etc.

I love this simple idea. Your moving effect the songs immediately. If there is a machine to recored what you remix and then burn into a disc, that will be awesome! In addition, if the artist improve more function, it will also increase more and more fun!