Alexa Modular Adapter

Click here to download alexa modular adapter PDF

Click here to access the project team's poster session (June 12, 2020, 1pm-2pm PDT)

Abstract

As virtual assistant products have developed and are becoming more common, the accommodation for the disabled community using this technology, however, does not grow at the same pace. Building on top of Alexa, the flagship virtual assistance by Amazon, the modular adapter is a device that bridges switch control devices and appliances to Alexa, so that they could be used with ease using voice commands.

Approach

The development of the device was built using two frameworks that had to work congruently with each other. Those would be the Raspberry Pi and Alexa Voice Service SDK (AVS SDK).

Hardware

The General Purpose Input Output pins(GPIO) on the Raspberry Pi connected to relay circuits, which are connected to a part of a switch-enabled device. Changing the voltage of these GPIO pins would change the state of the switch-enabled device.

Software

On the Raspberry Pi, AVS would be running the Alexa Client. There the AVS would take commands from the client that are in line with the AVS Home Kit endpoints (i.e. power, mode, toggle). Using these commands with the devices connected to the Pi, the Raspberry Pi would use its GPIO pins to change the device that it is connected to it.

Overview

The Alexa Modular Adapter is created with the primary goal of improving the quality of life for those with physical disabilities. In general, our product allows user to control common switch control appliances using voice command, in other words, we are the devices more accessible by making them smarter. And because the target consumers are people with disabilities, the adapter can be setup and used within minutes right out of the box with our smart appliance identification method.

Setting up Wi-Fi

One of the most important aspects when designing a product is improving the experience for a user to set up your product. With the modular adapter being catered to people that might have a wide range of disabilities, this takes another level of importance for us. For the modular adapter, the main obstacle to get the product up and running is connecting the device to the WIFI. For the Alexa on the product to function, it needs a constant connection to the Alexa Cloud to process requests.

To deliver this solution, the product comes with a feature to set up the WIFI with only using voice. We the tool SNIPS to make it possible for the user to look through possible WIFI hotspots, select one of those hotspots, and enter in the correct password in order to access that hotspot.

Results

The modular adapter is able to do the following:

It can rise and lower a motorized table in response to voice commands from the User.

It is also can turn on/off a musical toy in response to voice commands from the User.

It can also change WIFI hotspots using only voice commands from the user.

Conclusion

With the progress made with the Modular Adapter as a prototype, we are hoping that this prototype shows that designing a device like this is not only possible but fruitful in the marketplace.