Vision substitution with object detection and vibrotactile stimulus
| dc.contributor.author | Ribani R. | |
| dc.contributor.author | Marengoni M. | |
| dc.date.accessioned | 2024-03-12T23:55:14Z | |
| dc.date.available | 2024-03-12T23:55:14Z | |
| dc.date.issued | 2019 | |
| dc.description.abstract | Copyright © 2019 by SCITEPRESS – Science and Technology Publications, Lda. All rights reservedThe present work proposes the creation of a system that implements sensory substitution of vision through a wearable item with vibration motors positioned on the back of the user. In addition to the developed hardware, the proposal consists in the construction of a system that uses deep learning techniques to detect and classify objects in controlled environments. The hardware comprise of a simple HD camera, a pair of Arduinos, 9 cylindrical DC motors and a Raspberry Pi (responsible for the image processing and to translate the signal to the Arduinos). In the first trial of image classification and localization, the ResNet-50 model pre-trained with the ImageNet database was tried. Then we implemented a Single Shot Detector with a MobileNetV2 to perform real-time detection on the Raspberry Pi, sending the detected object class and location as defined patterns to the motors. | |
| dc.description.firstpage | 584 | |
| dc.description.lastpage | 590 | |
| dc.description.volume | 4 | |
| dc.identifier.doi | 10.5220/0007577205840590 | |
| dc.identifier.uri | https://dspace.mackenzie.br/handle/10899/35380 | |
| dc.relation.ispartof | VISIGRAPP 2019 - Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications | |
| dc.rights | Acesso Aberto | |
| dc.subject.otherlanguage | Deep Learning | |
| dc.subject.otherlanguage | Object Detection | |
| dc.subject.otherlanguage | Vibrotactile | |
| dc.subject.otherlanguage | Vision Substitution | |
| dc.title | Vision substitution with object detection and vibrotactile stimulus | |
| dc.type | Artigo de evento | |
| local.scopus.citations | 2 | |
| local.scopus.eid | 2-s2.0-85068228813 | |
| local.scopus.subject | Controlled environment | |
| local.scopus.subject | Learning techniques | |
| local.scopus.subject | Object class | |
| local.scopus.subject | Real-time detection | |
| local.scopus.subject | Sensory substitution | |
| local.scopus.subject | Single shots | |
| local.scopus.subject | Vibration motor | |
| local.scopus.subject | Vibrotactile | |
| local.scopus.updated | 2024-05-01 | |
| local.scopus.url | https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85068228813&origin=inward |