The Nelson-Atkins Museum of Art asked how they might use a touchscreen to emulate the synesthesia of featured painter Wassily Kandinsky. So we invented the Color Composer.
Inspired by his painting "Rose with Gray", Color Composer allows users to construct digital paintings using a distinct color palette and automatically applied Kandinsky-esque effects. Once the user presses play, the composition becomes an animated soundscape, fusing sound and vision. The user can continually edit their sounds by moving and scaling shapes or creating new ones then share their work on social media.
The Color Composer was created from the ground up, starting with understanding how synesthesia manifests in people that experience it. We translated that research into wireframes and prototypes that were then layered with an aesthetic inspired by Kandinsky and the work of his era. The final product included custom interactions, unique sounds for each shape, and its own animated branding.
The experience was revealed at the grand opening of the Bloch galleries where users of all ages and varying levels of artistic backgrounds delighted in their soundscape creations. Eventually the kiosk was translated into a limited web experience which you can try here.
Several additional iPad experiences were concepted to supplement the Color Composer including a vintage photo-taking app to teach users about the influence of photography on Impressionism, a "plein air" painting app where users could reference live streams of the city, a match game experience using paintings and the incredibly bad reviews they received from critics, and a tilt-gesture controlled experience to to navigate the color shifts in series of the same scenes. In the end, Gallery+ was created to connect artists and artworks across time periods and styles.