JARVIS: Difference between revisions
From ICO wiki
Jump to navigationJump to search
| (5 intermediate revisions by the same user not shown) | |||
| Line 2: | Line 2: | ||
*'''Grigori Palamartšuk''' - scrum master, product owner and developer | *'''Grigori Palamartšuk''' - scrum master, product owner and developer | ||
*'''Andrei Grigorjev''' - developer | *<del>'''Andrei Grigorjev''' - developer and testing</del> | ||
*'''Artyom Likhachev''' - developer | *'''Artyom Likhachev''' - developer and UI | ||
*'''Maksim Tšeljabov''' - developer | *<del>'''Maksim Tšeljabov''' - developer and DB</del> | ||
== Idee == | == Idee == | ||
| Line 10: | Line 10: | ||
Main goal will be to avoid manual interactions with machine and try to build all possible interfaces through the voice commands (voice recognition + speech synthesizer).<br/> | Main goal will be to avoid manual interactions with machine and try to build all possible interfaces through the voice commands (voice recognition + speech synthesizer).<br/> | ||
Secondary goals: | Secondary goals: | ||
* UI/UX implementation "original J.A.R.V.I.S." alike | * UI/UX implementation "original J.A.R.V.I.S." alike taken from [http://www.imdb.com/title/tt0371746 Iron man] movie: | ||
[[File:IM2_PROLOGUE_VFX_04.jpg|600px]] | |||
* using Rapberry PI (https://www.adafruit.com/product/3055) with installed software to use as controlling device. | * using Rapberry PI (https://www.adafruit.com/product/3055) with installed software to use as controlling device. | ||
* adaptation (library of setting configurations) for the program to work with any type of CNC machine. | * adaptation (library of setting configurations) for the program to work with any type of CNC machine. | ||
| Line 29: | Line 30: | ||
* extended authentication with Cognitive Services (https://www.microsoft.com/cognitive-services/en-us/speaker-recognition-api). | * extended authentication with Cognitive Services (https://www.microsoft.com/cognitive-services/en-us/speaker-recognition-api). | ||
* voice commands for form interactions (filling/saving/editing and deleting information from DB by voice commands). | * voice commands for form interactions (filling/saving/editing and deleting information from DB by voice commands). | ||
* OctoPrint server basic implementation rewrite | * OctoPrint server basic implementation rewrite in C#. | ||
=== Andmebaasiskeem === | === Andmebaasiskeem === | ||
| Line 47: | Line 48: | ||
'''15.10'''<br /> | '''15.10'''<br /> | ||
Basic application steps description; roles assignment. | Basic application steps description; roles assignment. | ||
'''01.11'''<br /> | |||
3d printer (Original Prusa i3) ordered from prusa3d.com | |||
'''10.11'''<br /> | |||
3d printer is assembled to ready to be used. | |||
'''10.12'''<br /> | |||
Basic UI design is mocked. | |||
DB/Services/Models. | |||
'''01.01'''<br /> | |||
First tryouts of speech synthesis and voice recognition services. | |||
'''10.01'''<br /> | |||
OctoPrint service installation for RPi | |||
'''18.01'''<br /> | |||
OctoPrint API services are ready | |||
'''25.01'''<br /> | |||
Final UI is ready | |||
Latest revision as of 00:39, 26 January 2017
Meeskond ja rollid
- Grigori Palamartšuk - scrum master, product owner and developer
Andrei Grigorjev - developer and testing- Artyom Likhachev - developer and UI
Maksim Tšeljabov - developer and DB
Idee
We will try to create a voice control system to perform basic operations with CNC machine (in our case it will be 3D printer "Prusa i3").
Main goal will be to avoid manual interactions with machine and try to build all possible interfaces through the voice commands (voice recognition + speech synthesizer).
Secondary goals:
- UI/UX implementation "original J.A.R.V.I.S." alike taken from Iron man movie:
- using Rapberry PI (https://www.adafruit.com/product/3055) with installed software to use as controlling device.
- adaptation (library of setting configurations) for the program to work with any type of CNC machine.
- ability to perform simultaneous work with multiple devices (print farms).
Rakenduse sisu
Rakenduses on olemas järgmised võimalused (Must have):
- voice recognition implementation (using System.Speech.Recognition library) for understanding commands and translating them to "real actions".
- voice synthesis implementation (using System.Speech.Synthesis library) for retrieving results and statuses.
- API connection with OctoPrint server (based on Raspberry PI) for sending commands to CNC machine (in our case it is 3D printer).
- basic UI for main scenario (log of commands, connectivity to device, possible API calls)
- DB structure/interface implementation to store configurations/auth tokens/commands.
- forms/interactions for adding material/machine settings to DB (filament temperature settings, machine gcode headers/measurements/max-min temperatures).
- basic authentication mechanism.
Rakenduses võiksid olla lisavõimalused (Should have):
- extended UI for all scenarios (authentication/main view and forms/interactions). Usage of "original" J.A.R.V.I.S. UI concept.
- extended authentication with Cognitive Services (https://www.microsoft.com/cognitive-services/en-us/speaker-recognition-api).
- voice commands for form interactions (filling/saving/editing and deleting information from DB by voice commands).
- OctoPrint server basic implementation rewrite in C#.
Andmebaasiskeem
Workload
29.09
Basic idea /sketch implementation (group formation)
10.10
Brainstorm meeting (db structure, UI features, MVP)
11.10
Proof of concept application made (voice recognition/voice synthesis)
15.10
Basic application steps description; roles assignment.
01.11
3d printer (Original Prusa i3) ordered from prusa3d.com
10.11
3d printer is assembled to ready to be used.
10.12
Basic UI design is mocked.
DB/Services/Models.
01.01
First tryouts of speech synthesis and voice recognition services.
10.01
OctoPrint service installation for RPi
18.01
OctoPrint API services are ready
25.01
Final UI is ready
