Rong Shi

This project begins with the question of what the universe sounds like. By understanding that sound is the combination of vibrations at different frequencies, the project aims to capture the essence of sound in the cosmos. The vibrations of chemical elements create distinct sounds, and by determining the vibration frequencies of each chemical component on different planets, the project seeks to recreate their unique sounds.

The process of data sonification involved collecting data for each chemical component and calculating the frequency of molecular vibrations based on that data. Collaborating with Dr. Wen from Imperial College London, I obtained spectral data pertaining to diverse chemical compositions. With his assistance, I conducted calculations to determine the frequencies of molecular vibrations. However, the vibrations of these molecules occurred at such rapid and high rates that they were imperceptible to the human ear. To overcome this limitation, I scaled down the frequencies to an audible range, enabling me to extract the necessary data.

The project then mapped these molecular vibrations to pitch and volume, converting the data into audible sine waves. The objective was to faithfully represent the true nature of each planet's sound and ensure that the mapping process was devoid of human subjectivity.

To facilitate the mapping process, I employed Pure Data, a visual programming language for generating interactive computer sounds. Taking Mercury as an illustration, I associated its frequency with pitch and its proportion with volume. As an instance, if the molecular frequency of oxygen measures 466.8Hz, with a proportion of 42 percent, the corresponding pitch would be set at 466.8Hz, while the volume would be adjusted to 42 percent. Employing this approach consistently, I created distinct sound channels for each chemical constituent present in Mercury, eventually amalgamating them to unveil the captivating auditory experience termed as the "Sound of Mercury.

I received a gracious invitation from Juice, the Curator of Sound Design at the University of the Arts London, to contribute to the Polyphonic exhibition held at the Crypt Gallery in London. 

Within this space, visitors were treated to a multisensory experience that combined auditory and visual elements. Using my molecular music, I crafted a soundscape that harmoniously blended with visual projections. The result was an immersive environment where sound and visuals seamlessly intertwined, captivating the senses and transporting the audience to a realm where molecular compositions came to life.

By participating in the Polyphonic exhibition, I aimed to enrich the artistic landscape by offering a unique fusion of molecular music and audiovisual projections. The immersive audiovisual projection space provided visitors with an extraordinary opportunity to engage with the interplay of sound and visuals, creating a truly unforgettable experience within the hallowed halls of the Crypt Gallery.

In March 2023, I had the opportunity to showcase my work in a live performance called the Murmation Show, hosted at the Kensington Theatre. My aim was to ensure that the audience truly grasped the essence of my creation, so I integrated the programming aspects directly into the performance itself. By revealing the intricacies of my programming techniques during the show, I provided a glimpse into the inner workings of my artistic process.

To further enhance engagement and foster a sense of participation, I actively encouraged audience involvement throughout the performance. This interactive element allowed attendees to become an integral part of the artistic journey, making the overall experience more immersive and inclusive. By combining the showcase of programming techniques with audience participation, my performance aimed to captivate and enlighten the viewers, leaving them with a deeper understanding and appreciation for my work.

This sound environment comprises two distinct systems that create an immersive experience. The first system is a spatial instrument, consisting of eight physical sculptures, Bela multi-channel output equipment, and eight mini speakers. Within this space, visitors have the freedom to move around and interact with the sculptures by taking down the speakers positioned close to their ears. This allows them to listen to the unique sounds associated with each planet. Additionally, an ensemble of sounds from the eight planets of our solar system is harmoniously blended, creating a captivating auditory experience.

For those intrigued by the specific sound composition of a particular planet, the second system provides an avenue for exploration. By wearing headphones and utilizing Pure Data on their laptops, visitors can engage in real-time interaction with the sounds. This interactive feature allows them to selectively listen to the sound produced by a specific chemical composition within a particular planet or opt for a curated ensemble of sounds.

In essence, this sound space provides a multi-faceted experience, inviting visitors to physically engage with the sculptures, explore individual planet sounds, and actively participate in the composition and arrangement of the auditory elements using Pure Data.