Concept:
Jeremiah Baker, Ben Hoggatt, and I wanted to create our own relief sculpture to map. While brainstorming we thought of making low poly instruments we could light up with music. I remembered I drew some geometric art months ago and showed them it. Ben quickly made a 3d model of it, Jeremiah unfolded it in Pepekura, and then I laser cut it. Jeremiah and I pieced it together and created what we call the Growth Sculpture as it resembles a vine or organic intrusion on a building.
I planned to create one composition with Max MSP and another using more of the Google Deep Dream Processing I found in experimentation last project.
Process:
Within Max I used the previous setup I used for creating the John Conway's Game of Life for the tape mapping. I replaced the images used with video created by Falak Jamma. I utilized a new command called jit.pix where I could pull in files to modify the video. I utilized the brcosa, infinite mirror, twirl, and pinch files. I sent those videos the MadMapper to record them. I found the way of recording through Max to be unreliable as sometimes it would corrupt or not record anything. I applied the Spiral Galaxy looking one to the actual sculpture then made a dim kaleidoscope effect in the background.
For the Google Deep Dream one I took a picture as close to the projector's view as possible and cropped it to just the sculpture in Photoshop. I do not know enough about the technology of Deep Dream to create an animation the correct way. I instead slowly zoomed in through Photoshop and rendering images out as I zoomed in. I sent all of these images to render into the Deep Dream look. I then stacked all these images together and converted them into a .gif file. MadMapper works well with those. I used a different kaleidoscope from Max and shifted to a yellow-black color to better suit the Deep Dream results.
Continuing on the concept of my Room Mapping Project, this composition expresses a different perspective towards my idea of allowing the viewer to step inside my mind and with it, to have a moment in which my memories are seen through space.
The second composition is the successor of a work created in my video production class, the story talks about a hacker who lost his wife due to an automated car accident. He loses his mind throughout the video and creates an Artificial Intelligence that replaces his wife but such becomes a much greater burden than her physical state.
Process
The first composition was created in After Effects and Mad Mapper, I initially exported the line output from MM and used it as a base to create the animation of the videos within AE.
For the relief mapping project I wanted to work with creating content that was simple yet indicative of the chosen theme. After being inspired by a classmates previous "wall washing" assignment I decided to focus on biology and the body in general. With that being said, the heart and molecules came to mind. The mechanical orientation and function of a heart has always intrigued me and I wanted to create a projection that would have the same rhythmic and paced flow of the organ. Inspired by the rhythmic nature and structure of the heart, the speed and somewhat unpredictable nature of molecules and the way they function when heat in introduced was also an appealing element. With these two concepts in mind, together they would be an experimentation with speed and how the speed of particular elements in a composition can effect the audience in different ways. For example a hectic and fast speed for various elements in a composition could disorient the viewer and make them feel uneasy due to the rapid movement and unpredictable nature of the content. On the other hand the slow and structured pace of a beating heart can be more soothing and pleasing to the audience as there is a rhythmic flow to the way the content is utilized.
Preliminary AfterEffects Content
Process:
As usual the theme for my projection started at the content building stage. In After Effects I created a video of blob-like shapes that grow and shrink in a heartbeat like pattern. By using the time remapping tool I was able to repeat the motion for a 30 second piece of repeatable content. The second video was created by using shape layers to imitate molecules moving in three dimensional space on a loop. Each created video had a predetermined color pallet, the first of monochromatic red, and the second of warm colors.
Once I decided on the theme for this project it appeared that the complex mask relief sculpture would be the best canvas. The intricate shapes and surfaces would make a nice space to work with. To start it was important to use spacial scanning and UV mapping to calibrate the sculpture. By using the spacial scanned image of the sculpture in MadMapper I was then able to create lines within the tool for my composition.
After layering the content and line layers on top of each other I began to experiment with different textures and animations within MadMapper. For the heartbeat composition it was important to stick to the internal body theme focusing on fluid motion and the continual contracting and expanding of space. Similarly the molecule composition also used the fluid motion to represent it moving through molecular space. After the solid portions of the compositions were compete it was important to make use the the structure's lines in an effective way to complement the theme.
Initial Molecule Comp
For the molecule composition the mad lines were used to further emphasize the notion of life and motion. Three layers of lines all moving quickly and offset to be at different areas of the relief representing veins and the blood flowing through them. The quick motion of the lines in conjunction with the movement of the molecules are in place to support the idea of uneasiness within one's self.
Initial Heartbeat Comp
For the heartbeat composition, because of the idea of a calming and systematic structure of a beating heart I wanted to ensure that everything was easy on the eyes and that no singular element could be singled out because the entire composition should be a stable and balanced. Similarly the lines animation was used in a subtle way to also indicate blood flowing through veins and the notion of life. With these concepts in mind I further explore possible elements for both the molecule, and heartbeat compositions to further solidify their theme.
In order to utilize the external lite space outside of the sculpture I decided to create variation through extension. For the heartbeat composition I created a smooth fluid shape out of multiple quad layers to place the "heart" in context. The external area was also made up of slow moving designs to emphasize the work being conducted by the heart. The last element that was added to the heart composition was the waveform lines and the heartbeat sound clip. To ensure that the theme would get across to the audience I used three waveform lines to imitate the movement of a heartbeat.
For the molecule composition I decided to use the quads to create an angular shape to play with the already developed notion of hectic-ness and movement. Similarly to the movement pattern of the individual molecule pieces, the lines that create the external space all vary in length and work to further the imbalanced nature of the composition.
Interpretation:
The theme for these compositions really did drive the entire piece from start to finish. By utilizing something in the physical world as a tool of inspiration could I use the content I had to further implement the driving theme for each piece. In addition I liked the way that the external space was used for each composition. Instead of using the entire projection space blindly, specific backgrounds were created to add further meaning and place the sculpture in context for the given idea.
When we where first given this project, the assignment had first asked that we create our own sculpture and have it cut and mounted to be projected on. I had come up with a few ideas for my sculpture such as going back to my lion tap mapping and sculpting just the face. Which would end up being pretty neat, but when I thought about it further it would have been difficult and time consuming. So I was thankful when the professor gave us the choice of either using his sculptures in the class room, or create our own. I opted for the choice of using one of his and ended up picking the largest of the 5.
Process
Once I choose the sculpture I wanted to do I got started with getting the spacial scanner completed first. This would help me in being able to take the project home and not having to be in the lab the entire time. I made sure that the camera was place in the center of the piece and as close to being underneath the projector, mounted on the ceiling, as possible. I ended up using a 1/15 shutter speed to keep from getting any interference and a more clearer picture.
When the spacial scanning was complete I imported the object file of the sculpture into MadMapper and matched the sculpture to the spacial scan. Because a lot of the wireframe wasn't matching up, i decided to take the extra time I had in manually moving the points of the wireframe into the right position so everything lined up cleanly for animated lines. With the lines however there was a small problem. Because their was too many wireframe lines/Geometry, MadMapper couldn't create the lines for me. So I spent about an hour lining everything myself, which wasn't as bad as I thought it would. Plus I didn't line everything on the sculpture, just what I needed and thought would look good.
After the lines where finished I moved on to creating the first composition. I wasn't exactly sure what I wanted my contact to be but I did know that I wanted to incorporate my 'Sun Swirl' i created for this project using After Effects. But when I imported the video files into MadMapper, moved them around I wasn't sure what else to do to go with them.
When I looked at the sculpture with the medallion of a peace sign with the fist at the top I thought about doing a 'peace' related theme. When googling 'peace signs' they all came up with a rainbow tie-dye 70's/80's theme to them and decided to go with that. I first looked online for some animated gifs and found many different once and tried them out on the sculpture but none of the seemed to fit, until I found a rainbow mandala, as well some other rainbow animations that I pieced together and overlapped to create a neat and funky, 70's/80's theme.
The two mandala gif's above where the first two I found, and what I started with, with my first composition. I wanted to use both so played win the settings in MadMapper, put one into the eyes before ultimately decided to put both of them together in an overlap, making a really cool effect. I then added my 'Sun Swirl' I did in After Effects into the eyes and put it as a multiply layer to turn the orange to a blue to match. To add more to the composition I made the lines rainbow colored using another gif image before editing the animation effects to make it look nice. Once the background, eyes, and lines where finished I added a light effects MadMapper has with the object file. I synced it up with an 70's 80's mix I found on Youtube.
For the second composition I added these two gif images and overlaid them onto of each other. Making sure the opacity was correct and they both looked good overlapped. I decided to do something with the main madalion on the forehead of the sculpture and used the lines and animated them in a way so they rotated in different directions and put them in rainbow colors. For the eyes I decided to keep it simple with a rainbow pallet that rotates slowly. I then masked out the peace fist for both and kept the rainbow coloring.
Yoobae Kim Projection mapping strategies for relief objects (Week 9-12)
Concets:
Relief mapping is a texture
mapping technique used to render the surface details of three-dimensional
objects accurately and efficiently. Relief mapping is highly
comparable in both function and approach to another displacement texture
mapping technique.
The model will be tested on UV calibration and line output
In this project, I will explore projection mapping strategies
for relief objects. Reliefs are objects that project from the wall. The ideal
relief objects for projection mapping have large surface areas that do not
occlude/block light of cast shadows.
UV Coordinates
UV mapping refers to the way each 3D surface is mapped to a 2D texture.
Each vertex contains a set of UV coordinates, where (0.0, 0.0) refers to the
lower left corner of the texture and (1.0, 1.0) refers to the upper right
corner of the texture. If the UV coordinates is outside the 0.0 to 1.0 range,
the coordinates are either clamped or the texture is repeated (dependent of the
texture import setting in Unity).
Texture Mapping
To create a surface that resembles real life you need to turn to
texture mapping. This process is similar to adding decorative paper to a white box.
In 3D, texture mapping is the process of adding graphics to a polygon object.
These graphics can be anything from photographs to original designs. Textures
can help age your object and give them more appeal and realism.
UV Mapping
A 3D object has many sides and a computer doesn't know how to
correctly put a 2D texture onto a 3D object. A UV map is basically the 3D model
stretched out into a flat 2D image. Each face on your polygon object is tied to
a face on the UV map. Now placing a 2D texture onto this new 2D representation
of your 3D object is much easier.
base_head UV(1).obj
Spacial Scan Images
Captured Madmapping Sceen
Process:
Spacial Scanning to create an image to align a physical model.
I used the UV space of the 3 D computer model of calibration with Spatial Scan Camera Setting to capture Spacial Scan Images:
1/50 5.6 400.
base_head UV(1).obj
Generated Content
Match the real and virtual objects and Fine Tune
Calibrate Projector
Adjustment working with different lighting and projector brightness
Always be yourself, express yourself, have faith in yourself, do not go out and look for a successfull personality and duplicate it.”― Bruce Lee
Concept:
There is something about wearing a mask that changes you. Because you are more anonymous, you feel a certain sense of freedom. You can express hidden aspects of your personality without fear.
Masking is a process in which an individual changes or "masks" their natural personality to conform to social pressures, abuse, and/or harassment. Some examples of masking are a single overly dominant temperament, or humor, two incongruent temperaments, or displaying three of the four main temperaments within the same individual. Masking can be strongly influenced by environmental factors such as authoritarian parents, rejection, and emotional, physical, or sexual abuse. An individual may not even know he or she is wearing a mask because it is a behavior that can take many forms.
Wearing a mask protects people from vulnerability. I fear that if I stand tall and exposed, I’ll be “weak” in some way. But when you wear a mask you stand in resistance to your true life and end up attracting realities that conflict with who you really are.
So, Take off your mask!
Process:
Special Scan - Capture the real size and ratio into madmapper as a reference to help us for next step: Calibration
note: Camera's iso setting should not be too high or it would catch so much noise to affect the quality of image.
Test 01: 1/40, 5.6, iso 1600 Test 02: 1/15, 5.6, iso 400
Special Scan
Align & Calibration - Import UV file(.obj) to madmapper and roughly position / align it to the model of backdrop image. Then align the 3D file to the real model or the picture which I just special scanned, the calibration process will need at least 6 alignment point to perform this operation. The last but not least, refine the tweaks by moving extra alignment points.
UV file
Calibration
Generate Content - The 3D surface layer in madmapper we just created is very powerful to control lighting resource, add vector lines layer, and put texture materials on it etc.
Here's the Social Mask:
Social Mask
Social Mask in Mad. White point is lighting resource
Social Mask
Another Relief practice:
Relief Mapping Practice
Relief Mapping Practice
Relief Mapping Practice with Marvel Studio Opening
