Alfonso Peduto explores Soli Sheet music prototype with the Soli Sandbox

Рет қаралды 5,685

3 жыл бұрын

As we continue to explore how the Soli interaction language can change our experiences with technology, we created the Soli Sheet music prototype with the Soli Sandbox. The Pixel 4 with Soli is able to understand presence and swipes, and is able to control a secondary screen-the tablet-through websockets.
We collaborated with Alfonso Peduto to refine the experience and bring it to life with one of his original compositions.
@alfonsopedutomusic works at the edge of minimalism and classical forms. His body of work, spanning across 10 albums, includes compositions for solo piano, live looping, choral and orchestral ensembles, and has been performed in concerts and original dance productions in the US and Europe. His music is highly influenced by his formal training in mathematics, physics, classical composition and music technology.
The Soli Sandbox app is available on Pixel 4 and only in the following countries: United States, United Kingdom, Spain, Taiwan, Singapore, Netherlands, Japan, Italy, Ireland, Germany, France, Denmark, Canada and Australia.
#Soli #SoliSandbox #GoogleAtap
Content: drive.google.com/file/d/1tOrj...

Пікірлер: 15

@thepianoaddict 3 жыл бұрын

Cool, but why not just swipe the screen? It would be really cool if the tablet could detect the music and compare it to the sheets so it knew when to go to the next page just by listening.

@sirbughunter 3 жыл бұрын

Swiping takes longer and is less accurate when you do it slightly different.

@EvanVerworn 3 жыл бұрын

@@sirbughunter I don't know, that air swipe was pretty delayed. You could see some spots where he was starting a new bar and the page flip animation hasn't finished yet

@CloroxBleach0 10 ай бұрын

@@EvanVerwornI’d argue that’s not a result of the soli sensor itself being slow though. In the video’s setup, a pixel 4 xl has to transfer the gesture data to the tablet all the time which is likely the reason it’s so delayed in the video…

@dieoskodi 3 жыл бұрын

Does he even look at the sheet music?

@dwightschrutee Жыл бұрын

When you came to that level of playing a particular piece that means you played it million of times so you don't need notes to read them but just to follow the parts of the songs.

@tod4y 3 жыл бұрын

So what is this then?

@asciivision 3 жыл бұрын

Ugh, very high latency. Not a good technology demonstration :/

@CloroxBleach0 10 ай бұрын

The disappointing latency is likely resulting from the time to takes to move the data from the pixel to his tablet - and not an issue with the sensor itself…

@yabdelm 7 ай бұрын

1. Detect the music 2. Auto-swipe Solved it for you

@Voidward 3 жыл бұрын

You can't seriously tell me it isn't simpler to just have a depth camera or simply interpret motion data through an RGB camera to do the same thing with no added useless tech. And honestly, the real solution for this problem is the microphone interpreting the notes he's playing, showing him progress through the sheet music automatically and flipping the page with ZERO interaction. This is a technology in search of a use case, and it's implementation in the pixel phones was a huge disappointment.

@iurysza 2 жыл бұрын

You make it sound like they're not doing it because they didn't think about it. Your idea is an excellent one, no doubt. Problem is its not that simple to pull it off.