JARVIS

Meeskond ja rollid

• Grigori Palamartšuk - scrum master, product owner and developer
• Andrei Grigorjev - developer and testing
• Artyom Likhachev - developer and UI
• Maksim Tšeljabov - developer and DB

Idee

We will try to create a voice control system to perform basic operations with CNC machine (in our case it will be 3D printer "Prusa i3").
Main goal will be to avoid manual interactions with machine and try to build all possible interfaces through the voice commands (voice recognition + speech synthesizer).
Secondary goals:

• UI/UX implementation "original J.A.R.V.I.S." alike taken from Iron man movie:

• using Rapberry PI (https://www.adafruit.com/product/3055) with installed software to use as controlling device.
• adaptation (library of setting configurations) for the program to work with any type of CNC machine.
• ability to perform simultaneous work with multiple devices (print farms).

Rakenduse sisu

Rakenduses on olemas järgmised võimalused (Must have):

• voice recognition implementation (using System.Speech.Recognition library) for understanding commands and translating them to "real actions".
• voice synthesis implementation (using System.Speech.Synthesis library) for retrieving results and statuses.
• API connection with OctoPrint server (based on Raspberry PI) for sending commands to CNC machine (in our case it is 3D printer).
• basic UI for main scenario (log of commands, connectivity to device, possible API calls)
• DB structure/interface implementation to store configurations/auth tokens/commands.
• forms/interactions for adding material/machine settings to DB (filament temperature settings, machine gcode headers/measurements/max-min temperatures).
• basic authentication mechanism.

Rakenduses võiksid olla lisavõimalused (Should have):

• extended UI for all scenarios (authentication/main view and forms/interactions). Usage of "original" J.A.R.V.I.S. UI concept.
• extended authentication with Cognitive Services (https://www.microsoft.com/cognitive-services/en-us/speaker-recognition-api).
• voice commands for form interactions (filling/saving/editing and deleting information from DB by voice commands).
• OctoPrint server basic implementation rewrite in C#.

Andmebaasiskeem

Workload

29.09
Basic idea /sketch implementation (group formation)

10.10
Brainstorm meeting (db structure, UI features, MVP)

11.10
Proof of concept application made (voice recognition/voice synthesis)

15.10
Basic application steps description; roles assignment.

01.11
3d printer (Original Prusa i3) ordered from prusa3d.com

10.11
3d printer is assembled to ready to be used.

10.12
Basic UI design is mocked. DB/Services/Models.

01.01
First tryouts of speech synthesis and voice recognition services.

10.01
OctoPrint service installation for RPi

18.01
OctoPrint API services are ready

25.01
Final UI is ready