JARVIS: Difference between revisions
From ICO wiki
Jump to navigationJump to search
Line 10: | Line 10: | ||
Main goal will be to avoid manual interactions with machine and try to build all possible interfaces through the voice commands (voice recognition + speech synthesizer).<br/> | Main goal will be to avoid manual interactions with machine and try to build all possible interfaces through the voice commands (voice recognition + speech synthesizer).<br/> | ||
Secondary goals: | Secondary goals: | ||
* UI/UX implementation "original J.A.R.V.I.S." alike | * UI/UX implementation "original J.A.R.V.I.S." alike taken from "Iron man" movie: | ||
[[File:IM2_PROLOGUE_VFX_04.jpg|600px]] | |||
* using Rapberry PI (https://www.adafruit.com/product/3055) with installed software to use as controlling device. | * using Rapberry PI (https://www.adafruit.com/product/3055) with installed software to use as controlling device. | ||
* adaptation (library of setting configurations) for the program to work with any type of CNC machine. | * adaptation (library of setting configurations) for the program to work with any type of CNC machine. |
Revision as of 23:01, 15 October 2016
Meeskond ja rollid
- Grigori Palamartšuk - scrum master, product owner and developer
- Andrei Grigorjev - developer and testing
- Artyom Likhachev - developer and UI
- Maksim Tšeljabov - developer and DB
Idee
We will try to create a voice control system to perform basic operations with CNC machine (in our case it will be 3D printer "Prusa i3").
Main goal will be to avoid manual interactions with machine and try to build all possible interfaces through the voice commands (voice recognition + speech synthesizer).
Secondary goals:
- UI/UX implementation "original J.A.R.V.I.S." alike taken from "Iron man" movie:
- using Rapberry PI (https://www.adafruit.com/product/3055) with installed software to use as controlling device.
- adaptation (library of setting configurations) for the program to work with any type of CNC machine.
- ability to perform simultaneous work with multiple devices (print farms).
Rakenduse sisu
Rakenduses on olemas järgmised võimalused (Must have):
- voice recognition implementation (using System.Speech.Recognition library) for understanding commands and translating them to "real actions".
- voice synthesis implementation (using System.Speech.Synthesis library) for retrieving results and statuses.
- API connection with OctoPrint server (based on Raspberry PI) for sending commands to CNC machine (in our case it is 3D printer).
- basic UI for main scenario (log of commands, connectivity to device, possible API calls)
- DB structure/interface implementation to store configurations/auth tokens/commands.
- forms/interactions for adding material/machine settings to DB (filament temperature settings, machine gcode headers/measurements/max-min temperatures).
- basic authentication mechanism.
Rakenduses võiksid olla lisavõimalused (Should have):
- extended UI for all scenarios (authentication/main view and forms/interactions). Usage of "original" J.A.R.V.I.S. UI concept.
- extended authentication with Cognitive Services (https://www.microsoft.com/cognitive-services/en-us/speaker-recognition-api).
- voice commands for form interactions (filling/saving/editing and deleting information from DB by voice commands).
- OctoPrint server basic implementation rewrite to C#.
Andmebaasiskeem
Workload
29.09
Basic idea /sketch implementation (group formation)
10.10
Brainstorm meeting (db structure, UI features, MVP)
11.10
Proof of concept application made (voice recognition/voice synthesis)
15.10
Basic application steps description; roles assignment.