No Heart Beats the Same
For my final project, I wanted to come up with a project that was ambitious, immersive, and responsive in homage to the accumulation of my past four years at Savannah College of Art & Design. I wondered how impactful it would be for people to visualize their own heartbeats. Would multiple heartbeats end up aligning eventually? Could I make a song out of the heartbeats? To figure these questions out, “No Heart Beats the Same” was created.
The first question
What is the system? I know the input (heartbeats) and I know the output (visuals reacting from audio). So what is the in-between?
System in question: Heart —> rhythm monitor —> audio input —> computer —> speaker to output —> visual representation —> project the results
Let's work this out
Problem: how to record the heartbeat?
Solution: Make a microphone stethoscope.
Updated system:
Heart —> stethoscope —> speaker —> computer —> visual representation —> project the results
I first had to figure out a way to record the heartbeats. I researched multiple heart rate monitors and ordered the Kardia Mobile EKG. It recorded frequency and was also bluetooth, which I figured could send the data to my audio workspace. I was wrong. While the device worked perfectly, it only recorded the frequency as data in the form of a pdf, and I not being a coder was blocked from getting this data converted to audio.
The answer was actually quite simple: cut the end of a stethoscope’s tubing, and tape a microphone to the end of it. From there, connect the mic’s aux cable into a speaker that can pick up the quiet rhythm.
Coming up with a way to visually represent heartbeats was the second task. I was introduced to cymatics, the study of wave phenomena, and decided to pursue this in my experimentation using ferrofluid. Ferrofluid is a magnetic liquid, allowing it be moved and changed in different directions according to the magnet strength and location. Not only did I want to move the ferrofluid with magnets, but I wanted them to move with the rhythm of the heartbeat. This involved using electromagnets that are signaled from the speaker, turning off and on whenever the speaker hits a certain frequency (based on the heartbeat). After lots of trial and error with different magnet’ strengths, speakers, and solution for the ferrofluid to move in, I succeeded.
Updated System:
-
Heart —> stethoscope → speaker
-
electromagnets —> ferrofluid —> livestream footage to projector
-
computer → audio workspace —> background Music
-
Updated system:
Heart —> stethoscope —> speaker —> computer —> audio workspace —> generative visuals —> MadMapper —> projection
Problem: Find a better way to get the audio to the computer.
However, it wasn’t the A-HA moment I wanted. Back to square one. How can I visually represent heartbeats in real time? The answer as of now, is to use generative visuals that I will map out using MadMapper Software and a projector.
Now that I figured out how to amplify the heartbeats and visually represent them, I wanted to shift my focus to the audio. Audio was a driving factor in this experiment as the concept is all about visual representation of sound. I wanted to record the heartbeats, loop them using Abelton Live, and adjust them using different effects. I had never used Abelton Live, or much less any audio software, so this was an exciting challenge to pursue. Using different synths, granulators, and gates, I am able to clean the background noise from the heartbeats, loop them, and overlap different heartbeats that change the visuals live as they are being projected.
Solution: Use a Behringer U-phoria audio interface that allows me to connect the microphone to the input and use loopback to send it out as an output to Abelton Live. It also allows me to have another output so that I can connect a speaker to it for the edited heartbeats.
Heart —> stethoscope —> speaker —> computer —> loopback —> Ableton Live —> MadMapper —> generative visuals —> projection
This has been a long process of research, questions, experimentation, and answers. “No Heart Beats the Same” is still in the works as now I am working to find the best audio loops and synths to edit the heartbeats.
Taking all of these components and linking them together is possible with Loopback. Giving me my most recent system.
Final System:
-
Living heart (obviously)
-
A microphone stethoscope
-
Audio Interface
-
Abelton Live
-
Loopback
-
MadMapper
-
Projector
-
Speaker
Now that all of the behind the scenes work is complete, I wanted to create a projection display that would really elevate the visuals. The most obvious idea that came to mind, was a heart sculpture.
To go away from the obvious heart symbol, I wanted something more strong in ideation. An anatomical heart gave that effect. However, I knew for me to be able to project on, the model would have to be pretty flat in shape and sides.
Heart Sculpture:
-
Model a low-poly anatomical heart in Cinema 4D.
-
Put the model into Pepekura so that I can flatten out for the laser printer.
-
Load Pepekura file into Adobe Illustrator to outline the shapes for the laser cutter to read.
-
Laser cut "1/8" yardstick.
-
Build a 4x5 foot sculpture using duct tape, packing tape, staples, and spray paint.
-
Project the visuals and final project onto the sculpture.
Updated System:
-
Heart —> stethoscope → speaker
-
electromagnets —> ferrofluid —> livestream footage to projector
-
computer → audio workspace —> background Music
-
Updated system:
Heart —> stethoscope —> speaker —> computer —> audio workspace —> generative visuals —> MadMapper —> projection
Problem: Find a better way to get the audio to the computer.
However, it wasn’t the A-HA moment I wanted. Back to square one. How can I visually represent heartbeats in real time? The answer as of now, is to use generative visuals that I will map out using MadMapper Software and a projector.
Now that I figured out how to amplify the heartbeats and visually represent them, I wanted to shift my focus to the audio. Audio was a driving factor in this experiment as the concept is all about visual representation of sound. I wanted to record the heartbeats, loop them using Abelton Live, and adjust them using different effects. I had never used Abelton Live, or much less any audio software, so this was an exciting challenge to pursue. Using different synths, granulators, and gates, I am able to clean the background noise from the heartbeats, loop them, and overlap different heartbeats that change the visuals live as they are being projected.
Solution: Use a Behringer U-phoria audio interface that allows me to connect the microphone to the input and use loopback to send it out as an output to Abelton Live. It also allows me to have another output so that I can connect a speaker to it for the edited heartbeats.
Heart —> stethoscope —> speaker —> computer —> loopback —> Ableton Live —> MadMapper —> generative visuals —> projection
This has been a long process of research, questions, experimentation, and answers. “No Heart Beats the Same” is still in the works as now I am working to find the best audio loops and synths to edit the heartbeats.
Taking all of these components and linking them together is possible with Loopback. Giving me my most recent system.
Final System:
-
Living heart (obviously)
-
A microphone stethoscope
-
Audio Interface
-
Abelton Live
-
Loopback
-
MadMapper
-
Projector
-
Speaker
Now that all of the behind the scenes work is complete, I wanted to create a projection display that would really elevate the visuals. The most obvious idea that came to mind, was a heart sculpture.
To go away from the obvious heart symbol, I wanted something more strong in ideation. An anatomical heart gave that effect. However, I knew for me to be able to project on, the model would have to be low-poly so that it would be easier to map.
Heart Sculpture:
-
Model a low-poly anatomical heart in Cinema 4D.
-
Put the model into Pepekura to flatten out the 3d model for the laser cutter.
-
Open Pepekura file into Adobe Illustrator to outline the shapes for the laser cutter to read.
-
Laser cut "1/8" chipboard.
-
Build a 4x5 foot sculpture using duct tape, packing tape, staples, and spray paint.
-
Project the visuals and final production onto the sculpture.
