Skip to content

A cross-platform installable web app that uses object detection, speech recognition, and a navigation algorithm to help the visually impaired find objects in their surroundings.

Notifications You must be signed in to change notification settings

mferuscomelo/ai-spy

Repository files navigation

AI Spy

This project was generated with Angular CLI version 12.2.0.

SureStart Create-a-thon

Created as part of the MIT FutureMakers Applied Deep Learning program, developed through a collaboration between SureStart and the MIT RAISE (Responsible AI for Social Empowerment and Education) Initiative. Team name: InnovAIte!

Team

Primary Contributors

Additional Team Members

Mentors

Demo

A demo video of the app can be found here: https://youtu.be/D75U10tBk1E

Run the project

  1. Clone the project onto your hard drive
  2. Execute npm install in your project folder to install all Node modules
  3. Run ng serve for a dev server. Navigate to http://localhost:4200/. The app will automatically reload if you change any of the source files.
  4. Allow access to your camera and microphone
  5. Choose an object to search for
  6. Press and hold the microphone button and say, “Find my _____”
  7. Pan around with your camera until the object is in view
  8. Object should be found!

Object Labels

Our app can identify the following 90 objects:

  • Person
  • Bicycle
  • Car
  • Motorcycle
  • Airplane
  • Bus
  • Train
  • Truck
  • Boat
  • Traffic Light
  • Fire Hydrant
  • Stop Sign
  • Parking Meter
  • Bench
  • Bird
  • Cat
  • Dog
  • Horse
  • Sheep
  • Cow
  • Elephant
  • Bear
  • Zebra
  • Giraffe
  • Backpack
  • Umbrella
  • Handbag
  • Tie
  • Suitcase
  • Frisbee
  • Skis
  • Snowboard
  • Sports Ball
  • Kite
  • Baseball Bat
  • Baseball Glove
  • Skateboard
  • Surfboard
  • Tennis Racket
  • Bottle
  • Wine Glass
  • Cup
  • Fork
  • Knife
  • Spoon
  • Bowl
  • Banana
  • Apple
  • Sandwich
  • Orange
  • Broccoli
  • Carrot
  • Hot Dog
  • Pizza
  • Donut
  • Cake
  • Chair
  • Couch
  • Potted Plant
  • Bed
  • Dining Table
  • Toilet
  • TV
  • Laptop
  • Mouse
  • Remote
  • Keyboard
  • Cell Phone
  • Microwave
  • Oven
  • Toaster
  • Sink
  • Refrigerator
  • Book
  • Clock
  • Vase
  • Scissors
  • Teddy Bear
  • Hair Drier
  • Toothbrush

Code scaffolding

Run ng generate component component-name to generate a new component. You can also use ng generate directive|pipe|service|class|guard|interface|enum|module.

Build

Run npm run build:prod to build the project. The build artifacts will be stored in the dist/ directory.

Further help

To get more help on the Angular CLI use ng help or go check out the Angular CLI Overview and Command Reference page.

About

A cross-platform installable web app that uses object detection, speech recognition, and a navigation algorithm to help the visually impaired find objects in their surroundings.

Topics

Resources

Stars

Watchers

Forks

Contributors 3

  •  
  •  
  •