Presentation of the results of the FAPA project

The FAPA – From Audiovisual Perception to Action: the processing of spatiotemporal components – project was developed by CCG, by its applied research domain PIU, between 2015 and 2017.

The final results of this project were presented at the 12th Bial Foundation Symposium, which took place between April 4 and 7, 2018, at the Casa do Médico in Porto.

The FAPA project aimed at studying the spatial and temporal resolution of the auditory and visual systems individually and collectively in a series of dynamic tasks. The main objective of the project was to see if, with static and moving stimuli, we are able to estimate correctly where the event is located in space and time.


Conclusions of the FAPA project

In short, as conclusions, we found out that we are able to:

  • judge with a high performance the passage of a sound, even if not all the information on its trajectory is available, using different auditory cues depending on the difficulty of the task;
  • locate static sounds in different spatial positions with greater precision in the plane of the ear and in the frontal plane, with a decrease in the magnitude of the error with training.

In a real-time gait synchronization task, it was found that synchronization in the condition where only auditory information was available did not differ from the condition in which auditory and visual information was available.

Scientific publications of the FAPA project

As main outputs, this project contributed to the publication of three papers in international journals and to a chapter in a scientific book:

  • Silva, R. M., Lamas, J., Silva, C. C., Coello, Y., Mouta, S., & Santos, J. A. (2017). Judging time-to-passage of looming sounds: Evidence for the use of distance-based information. PLoS ONE, 12(5): e0177734. doi: 10.1371/journal.pone.0177734
  • Silva, R. M., Sousa, E., Fonseca, P., Pinheiro, A. R., Silva, C., Correia, V. M., & Mouta, S. (2016). Analysis and quantification of upper-limb movement in motor rehabilitation after stroke. Converging Clinical and Engineering Research on Neurorehabilitation II: Proceedings of the 3rd International Conference on NeuroRehabilitation (ICNR2016), October 18-21, 2016, Segovia, Spain (pp. 209-213). doi: 10.1007/978-3-319-46669-9_37
  • Silva, C., Mouta, S., & Santos, J. (2016). Choosing audio devices on the basis of listeners’ spatial perception: A case study of Headphones vs in-Earphones. In Consumer Electronics-Berlin (ICCE-Berlin), 2016 IEEE 6th International Conference on Consumer Electronics (pp. 129-132). IEEE, Berlin, Germany. doi: 10.1109/ICCE-Berlin.2016.7684737
  • Pazhoohi, F., Silva, C., Lamas, J., Mouta, S., Santos, J., & Arantes, J. (2018). The effect of height and shoulder-to-hip ratio on interpersonal space in a virtual environment. Psychological Research. doi: org/10.1007/s00426-017-0968-1

Check out these publications on the FAPA project, as well as all the scientific publications of the PIU applied research domain, on the CCG website.