Interactive sonification of movement trajectories during motor therapies


Interactive sonification is an effective tool used to guide individuals when practicing movements. Little research has explore the affordances of continous and discrete sound structures in supporting motor therapeutic interventions for children with autism who exhibit motor impairments. The goal of this research is to study if children with autism understand the use of such sounds during motor therapeutic interventions, its potential impact of interactive sonification in the development of motor skills in children with autism, and the feasibility of sonifying an elastic display and a mobile phone to be used in specialized schools for children with autism.

Hypothesis: We hypothesize continuous sounds will provide better guidance for the trajectory of the moment while continuous sounds will encourage repetitions independently of the technology being used including an elastic display and a mobile phone.

Keywords: Elastic display, depth camera, accelerometer, mobile sensing, sensors, interactive sonification, movement, ASD, user studies, children, motor coordination, rehabilitation

Sound structures


Push movement

  • Initial position: The child brings his/her arms to her chest
  • Trajectory: The child stretches an arm forward in a horizontal way (i.e., parallel to the floor)
  • End position: The child has an arm fully extended forward in a horizontal position (i.e., parallel to the floor)

Lateral movement

  • Initial position: The child is standing with his/her arms down
  • Trajectory: The child moves each arm from down to up “swiping” in a lateral movement and drawing a half-circle in a trajectory
  • End position: The child is standing with the arm raised on the same side where the movement began

Cross-lateral movement

  • Initial position: The child is standing with his/her arms down
  • Trajectory: The child moves each arm from up to down up crossing the right arm from right to left and the left arm from left to right
  • End position: The child is standing up raising his/her arm on the opposite side where the movement began
A child with ASD using three sound structures
Push movement using the mobile phone with the three sounds
Lateral and Cross lateral movement using the mobile phone with the three sounds
Push movement using BendableSond with the continuous sounds
Lateral and Cross lateral movement using BendableSound with the discrete sounds

Evaluation methods: We conducted two deployment studies in Mexico using the mobile sensing and the Bendable sound with the designed sounds. In the first study, six children with autism were asked to perform the forward reach and lateral upper-limb exercises while listening to three different sound structures (i.e., one discrete and two continuous sounds). In the next study, nine children with autism were asked to perform upper-limb lateral, cross-lateral, and push movements while listening to five different sound structures (i.e., three discrete and two continues) designed to sonify the movements.

A child with autism using the designed sounds in the mobile phone

Outcomes and results: Results showed that children with autism exhibit awareness about the sonification of their movements and engage with the sonification. In particular, the use of discrete sound structures engage the children in the performance more repetitions while continous sound structures increase their ability to perform the movements correctly. We found out BendableSound better provides support to perform the push movement while the mobile phones outperform in supporting the practicing of lateral movements.

Posts created 15

332 thoughts on “Interactive sonification of movement trajectories during motor therapies

  1. Тут можно получить бесплатное расширение для Google Chrome, которым можно моментально добавить подписчиков Вконтакте так, чтобы избежать блокировки аккаунта:
    [url=] друг добавить[/url]

  2. Продажа формы всех клубов и аксессуаров для мужчин, женщин и детей. Товар в наличии, футбольная форма клубов. Бесплатная доставка по России.
    [url=]футбольная атрибутика[/url]
    интернет магазин футбольной атрибутики – [url=][/url]

  3. смотреть порно фильмы сын порно онлайн бесплатно групповуха

    сексуальные девушки в чулках порно [url=]очень жесткий порно секс издевательства бдсм [/url] порно видео больших дам

    [url=]порно зрелых чужих жен[/url]
    [url=]порно нарезки зрелых[/url]
    [url=]скачать на телефонов порно трахает[/url]
    [url=]смотреть порно самый большой член[/url]
    [url=]девушка изменяет парню порно[/url]
    [url=]порно анал рукой[/url]
    [url=]порно смотреть бесплатно новинки[/url]
    [url=]супер красивое порно видео[/url]
    [url=]скачать порно на планшет бесплатно[/url]
    [url=]порно онлайн против[/url]

  4. May I just say what a comfort to uncover an individual who truly understands what they are talking about on the internet. You definitely realize how to bring an issue to light and make it important. More and more people have to read this and understand this side of the story. I was surprised that you are not more popular since you certainly possess the gift.

  5. First of all I want to say wonderful blog!
    I had a quick question in which I’d like to ask if you do not mind.
    I was interested to find out how you center yourself and clear
    your head before writing. I’ve had a hard time clearing my mind in getting my ideas out.
    I do take pleasure in writing however it just seems like the first 10 to 15 minutes are
    usually wasted just trying to figure out how to begin. Any ideas or hints?


  6. [url=]how to buy cialis online safely[/url] [url=]benicar cheapest[/url] [url=]canadian pharmacy no scripts[/url]

  7. You could definitely see your enthusiasm in the work you
    write. The world hopes for even more passionate writers like you who are not
    afraid to say how they believe. All the time follow your heart.

  8. [url=]generic cialis online europe[/url] [url=]buy tadalafil online no prescription[/url] [url=]generic finasteride nz[/url] [url=]female viagra for sale australia[/url]

  9. Nice post. I was checking continuously this
    blog and I am impressed! Very useful information specifically the
    last part 🙂 I care for such information much.
    I was seeking this certain information for a very long time.

    Thank you and good luck.

  10. Very good blog! Do you have any tips and hints for aspiring writers?
    I’m planning to start my own website soon but I’m a little lost on everything.
    Would you propose starting with a free platform
    like WordPress or go for a paid option? There are so many choices out there that I’m
    completely overwhelmed .. Any tips? Appreciate

  11. Attractive section of content. I just stumbled upon your weblog and in accession capital to assert that I get actually enjoyed account
    your blog posts. Anyway I will be subscribing to your feeds and even I achievement you access
    consistently rapidly.

  12. [url=]how to buy cialis online usa[/url] [url=]cheap baclofen online[/url] [url=]plavix cost[/url] [url=]erectafil canada[/url] [url=]advair diskus 250 mcg 50 mcg[/url]

  13. You really make it seem so easy with your presentation but I find this topic to
    be really something that I think I would never understand.
    It seems too complicated and extremely broad for
    me. I am looking forward for your next post, I’ll try to get the hang of

  14. I have been browsing online more than 2 hours today, yet I never found any interesting article like yours.

    It is pretty worth enough for me. In my opinion, if all webmasters and bloggers made good
    content as you did, the net will be much more useful than ever before.

  15. [url=]price of amoxicillin[/url] [url=]malegra 25[/url] [url=]price for dexamethasone[/url] [url=]aurogra 100[/url] [url=]albendazole[/url] [url=]best price for celebrex[/url]

  16. [url=]cialis drug prices[/url] [url=]kamagra gold[/url] [url=]how to get zoloft prescription online[/url] [url=]keflex antibiotic[/url] [url=]sildenafil 20mg generic cost[/url] [url=]prazosin 4 mg[/url] [url=]hydroxychloroquine virus[/url] [url=]metformin hcl 500 mg[/url]

  17. [url=]can i buy cephalexin online[/url] [url=]cheapest price cymbalta 60 mg[/url] [url=]flomax price uk[/url] [url=]glucophage lowest price[/url] [url=]trental 400 drug[/url] [url=]1000 mg of metformin[/url] [url=]canadian pharmacy tadacip[/url] [url=]bactrim sale online[/url]

  18. Hello there, I do believe your website may be having web browser compatibility problems.
    Whenever I look at your site in Safari, it looks fine however, when opening in IE, it’s got
    some overlapping issues. I merely wanted to give
    you a quick heads up! Aside from that, excellent

  19. Hmm is anyone else having problems with
    the images on this blog loading? I’m trying to find out if its a problem on my end
    or if it’s the blog. Any feedback would be greatly appreciated.

  20. I do believe all of the ideas you’ve offered in your
    post. They’re really convincing and can certainly work.
    Nonetheless, the posts are very quick for beginners. May you please prolong them a bit from subsequent time?
    Thanks for the post.

Leave a Reply

Your email address will not be published.

Related Posts

Begin typing your search term above and press enter to search. Press ESC to cancel.

Back To Top