April 3rd 2020
Founder: “obomprogramador.com”. Full-stack dev/ AI Egineer/ Professional Writer/ M.Sc. Rio de Janeir
For people with vision problems.
Finally I finished the audible object detector proof of concept. The goal is to create something that can be used by people with visual needs. This is a proof of concept, or an MVP.
- Raspberry Pi 3 with Raspbian;
- Ultrasonic detector HC-SR04;
- Raspberry Pi Camera;
- Yolo model;
It is still an unfinished project, but I decided to share it for you to help me and develop your own solutions.
You will need:
- Flat cable to connect Raspberry PI to a protoboard;
- Raspberry PI 3;
- Raspberry Camera;
- Ultrasonic sensor HC-SR04;
- 330 ohm resistor;
- 470 ohm resistor;
I used the GPIOs: 17 (TRIGGER) and 24 (ECHO). In the image, he used: 18 (TRIGGER) and 24 (ECHO).
Connect the switch by connecting the circuit ground (GND) and the GPIO 25. When you press the Switch, this GPIO will change the state and command a photo.
conda env create -f ./env.yml conda activate object
To execute, just run the script simple_detector.py:
If you want, you can pass the path of an image file to test. I attached 2 images for you to test.
Oh, and I created a JSON Dictionary to translate the names of the objects found (to Portuguese), but if you are an english speaker, just use the original names.
Executing on the Raspberry PI
By pressing the switch the device will take a photo and tell you the objects that are in it and the distance to the closest object (see the video).
Previously published at https://github.com/cleuton/audio_object_recognizer/blob/master/english.md