Build your own virtual assistant with NLP and Speech Recognition!

Using Aylien NLP, Google and IBM's Watson speech recognizer and voice to build our University helper virtual assitant.

A virtual assistant, also called AI assistant or digital assistant, is an application program that understands natural language voice commands and completes tasks for the user. Such tasks, historically performed by a personal assistant or secretary, include taking dictation, reading text or email messages aloud, looking up phone numbers, scheduling, placing phone calls and reminding the end user about appointments. Popular virtual assistants currently include Amazon Alexa, Apple's Siri, Google Assistant and Microsoft's Cortana -- the digital assistant built into Windows Phone 8.1 and Windows 10.

In this section we want to make a virtual assistant Rosita that should come in handy for University work. Functionalities include but are not limited to:

1. Save in memos: tell Rosita you have an exam next week, she will save the information in a local database and remind you later
2. Your university schedule in every day of the week
3. Attendance management for each subject
4. Information about who teaches certain optional courses
5. Recommend an optional course based on natural language english text or keywords

Above, we can see how the hardest part of the project works. We first break the text into sentences, then we extract keywords related to course names. Here, we also test for sentiment analysis to get an idea about how the student feels when talking to a certain lecture/course. This is in order to determine whether we should recommend that specific course later. After we divided and conquered, it's time to glue everything together by subtracting the set that the user likes and the subset that the use would not like as a lecture.

#Presentation of the project

Image placeholder

Tidor Pricope

This also started as a University project, but I continued to work on it even after I finished the class and finally developed Rosita, your University virtual assistant !

Leave a comment