Commit a8be0cab authored by Massimiliano Todisco's avatar Massimiliano Todisco
Browse files

Update README.md

parent 82cbffe3
......@@ -89,11 +89,11 @@ Students will become experienced with languages dedicated to digital audio proce
- Semester: S5
- Proposer: Chiara and Max
- Description: Navigating an obstacle course blindfolded, guided by audio feedback from video analysis of the scene. The raspberry pi is connected to a camera and stereo headphones. The device is worn around the neck and captures the scene via the camera. The algorithm developed by the students has to detect the perimeter of the path and obstacles and guide the navigation of the blind person. The video input is transformed into audio feedback that changes (e.g. loudness, frequency) in the headphones to indicate the direction in which the person should walk.
- Description: Navigating an obstacle course blindfolded, guided by audio feedback from video analysis of the scene. The raspberry pi is connected to a camera and stereo headphones. The device is worn around the neck and captures the scene via the camera. The algorithm developed by the students has to detect the perimeter of the path and obstacles and guide the navigation of the blind person. The video input is transformed into audio feedback in the headphones to indicate the direction in which the person should walk. Students are free to choose the most appropriate algorithm for this purpose.
- Involved courses/skills/knowledges:
* BasicOS: modify the camera device driver to adapt it to the project
* IntroArchi: optimize the camera device driver with some assembly coding of performance-critical sections
* SoundProc: a stereo audio signal is used to direct the person through the obstacle course. The signal is most intense on the side towards which the person has to turn and is the same on the right and left when going straight.
* SoundProc: a stereo audio signal is used to direct the person through the obstacle course. Directionality exploits the spatial perception of our auditory system. The audio signal might have a higher frequency component or a higher loudness on the side towards which the person has to turn. More refined techniques such as binaural auralisation could be used. In this case, the direction is encoded as a synthesised acoustic event and placed in three-dimensional space.
* ImProc: image processing to detect the perimeter of the course and the obstacles (e.g. cardboard boxes with markers, perimeter indicated by markers)
* ComProg: navigation algorithms, complexity evaluation, programming
* T3E: analysis of environmental, social and ethical dimensions, suggestions of improvement, evaluation plans...
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment