River Concert

名稱：河流演奏會

類型：藝術計畫，影片、音響、手冊、文件、石頭

尺寸：依展場空間而定

影片長度：04:08

年份：2022

Type: Art Project, Video, Manual, Document, Stone

Size: Depends on the exhibition space

Video Length: 04:08

Year: 2022

Exhibition Record：

Yuejin Lantern Festival (2022)、

Siggraph Asia (2022) 、

Kaohsiung Award - Merit Award(2023)、

Arte Laguna Prize - Special Prize Generali (2023)

河流一直支持著人類的發展，然而我們有沒有仔細聽過她的聲音？基於親近河流的初衷，我與鹽水當地團體開始這項計畫。我們在河岸邊進行聲音採集，使用水下麥克風錄製河流裡的聲音。發現不同流域的聲音各有特色，反應了河岸的地理空間型態與周遭環境的生態。我們將採集到的聲音樣本輸入程式當中，透過語音情緒辨識技術進行音訊分析，捕捉河流的「情緒」，並取得人聲頻譜的範圍的聲音再以口語輸入語音辨識系統，透過這種方式我們從河流的聲音當中捕捉到許多「訊息」，讓我們彷彿可以得知河流所要述說的隻字片語。並將河流的情緒資料運算並編程音訊結構，將水聲轉化成音樂讓河流自己演奏，而我們得以聆聽河流的言語與感性。

I started this project with a local group based on the intention of being close to the river. I started sound recording on the banks of rivers in 2020, using hydrophones to go deep into the water to record underwater sounds. We recorded and collected sound samples in different river basins, including upstream and downstream, and found that the sounds of different basins have their own characteristics, reflecting the geographical and spatial patterns of the river banks and the ecology of the surrounding environment.

We develop a set of audio technology, the system refers to the characteristics of emotion recognition and the theory of harmony, and use the data of audio analysis to perform operations, and compile the content of the database into an artificial intelligence music system, output a non-fixed music structure automatically composed instant. So we can hear the underwater sound into a dynamic piece of music and let the river play the music itself. Through the technology of Frequency-modulation we obtain audio content close to the spectrum of the human voice, and input the sound into the speech recognition system. In this way, the system recognizes many unexpected words and sentences, so that we seem to have a chance to know what the river is about to say. These "messages" are a kind of mythology of human beings since ancient times, a world where all things and human beings can coexist harmoniously, so that we have more imagination space for the relationship between nature and human beings.