Moog-Emotion
Moog-Emotion Complete Setup | Algorithmic Workflow |
---|---|
Moog Werkstatt-01 Device | Presentation at Guthman Fair 2021 |
Moog-Emotion is an intelligent music system that utilizes different psychological aspects of music to accompany us in our every mood. In other words, it is a musical instrument that tunes itself according to the user’s current emotions and can also control their moods through generation of suitable music.
Applications: Emotion/Mood control as well as modulation, Instrument for interactively expressing human behaviour, Music system as a tool for psychiatrist therapy to help treat the person, Mental health modulator and Anti-Depression Tool.
Timeline: February, 2021 - May, 2021.
Collaborator(s): Achal Nilhani
Supported by: Georgia Institute of Technology
Awards & Honors:
-
Nominated for presentation at Guthman Musical Instrument Fair 2021.
-
Selected as the Winner for Best Hardware Hack and Best Presentation Award at Syracuse University CuseHacks 2021.
Media Coverage:
Project Website: HERE
Theory behind Working: We know how music modulates our state of mind and controls our emotions, be it happy, sad, or angry. We listen to music for relaxation, pleasure, and our cognitive interest. When we are happy, we tend to listen to music with a fast tempo and complementing harmonies. While in sadness, we like slow music with clashing harmonies. In contrast, the mood “anger” is represented by loud sounds and clashing harmonies. Our proposed musical instrument is capable of producing different music based on the current emotion of the user. The emotion recognition task is carried out in an unsupervised manner using the semantic contents as well as acoustic features of the speech data obtained from the particular user. Our initial hypothesis is that the features automatically learned from speech can be utilised to extract emotion and utilise in suitable music generation, thereof. Our idea was successfully verified through software and then, we worked on its hardware implementation using the Moog device and additional components.