This demo unveils the capabilities we can provide in assisting visually impaired people to execute simple everyday tasks by bringing sophisticated AI algorithms together with advanced hardware. Upon completion of the pipeline, the core puzzle solving algorithm computes the solution of the puzzle and coordinates the instructions that need to be communicated to the user to successfully complete the puzzle.The core puzzle solving algorithm and the deep learning pipeline are executed in a Nvidia TK1 board and leverage the computational speed of its GPUs. The video input is fed to a deep learning pipeline, which identifies the puzzle pieces in a given scene and matches them to the original image of the puzzle. In the video we also share additional research projects being developed by our team on Indoor Positioning Systems and Visual Recognition Systems.We utilize a head-mounted Intel 3D camera as video input and microphone/speaker to achieve natural human-computer interaction.

With the rapid convergence of hardware equipped with powerful sensors and 3D computer vision algorithms, we are now able to repurpose IoT devices and create AI-powered assistive technologies that naturally interact, using cognitive Watson services, to provide blind and visually impaired people with more independence. However, approximately 285 million visually impaired and 39 million blind people face an enormous challenge in accomplishing these daily tasks. Our research can bring real-time, context-specific cognitive analytics to the edge, in tandem with deep device specialization and sensory augmentation, to transform the human experience.Performing an everyday task such as cooking, navigating an indoor/outdoor environment, or attending a meeting at work is quite simple for most people.

We will continue to enhance our prototypes, combined with the cognitive capabilities of Watson, to bring visually impaired people closer to complete autonomy.

Computer Puzzles Jigsaw