manualshive.com logo in svg

POCKET VIRTUALITY Fata Morgana Starter Kit, User Manual

Share
Download
POCKET VIRTUALITY Fata Morgana Starter Kit User Manual Download Page 51

4.3 Using of 

Fata Morgana

 Voyager

An essential AR/VR application running on MS HoloLens 2 for the frontline worker giving
them “superpower” to successfully execute difficult tasks with AR guidance.

Pocket Virtuality a.s., Fata Morgana Starter Kit User Manual -  Version: 1.0,  Date: 15.12.2020

                                 

51

Figure 29: Make photo/screenshot from AR enhanced video.

Summary of Contents for Fata Morgana Starter Kit

Page 1: ...Fata Morgana Starter Kit User Manual English version ...

Page 2: ...are HW 19 2 2 Using of HW components 20 2 3 Software SW 20 3 Unpacking connecting and SW installing 20 3 1 What is in the Starter Kit 20 3 2 How to connect components 21 3 3 How to install applications 21 3 4 How to connect to private wireless network 22 4 Starting to use Fata Morgana 22 4 1 Using of Fata Morgana Studio 22 4 1 1 Menus 22 4 1 2 Tools and Buttons overview 27 4 2 Using of Fata Morgan...

Page 3: ...s and Controls 53 4 3 3 Login to the server 58 4 3 4 3D scanning of the enviroment 58 4 3 5 Show checkpoints 59 4 3 6 Navigate to the checkpoint position 59 4 3 7 Place a new checkpoint 60 4 3 8 Change status of selected checkpoint 60 4 3 9 Measure distance 60 4 3 10 Make photo from object of interest 61 4 3 11 Setup and calibration of 3D scene with ArUco marker 61 4 3 12 Show 3D models and their ...

Page 4: ...cumentation Fata Morgana Starter kit consist of 3 software components Fata Morgana Studio Fata Morgana Touch Fata Morgana Voyager Fata Morgana Studio is a powerful tool optimized for specific usage Creating AR scene and maintenance script Supervising and guiding frontline worker trainee to successfully finish his her duty Teleportation into frontliner working place and documentation Fata Morgana T...

Page 5: ... Adaptor 6 USB Flash Drive with SW installation 7 USB License key SG Lock 8 Magnetic Aruco 150 mm and 100 mm Figure 1 Fata Morgana Staret Kit Suite case 1 2 1 AR Glasses Microsoft HoloLens 2 AR Glasses are the key HW component for a frontline worker trainee provide augmented reality and scanning 3D environment AR Glasses are powered by cutting edge software FM Voyager developed in house Pocket Vir...

Page 6: ...uch developed in house 1 2 3 WiFi router Zyxel WiFi router serves to establish local WiFi network to connect MS HoloLens glasses to FM Studio 1 2 4 VR Adaptor VR Adaptor is an adaptor to convert your AR Glasses MS HoloLens 2 into Virtuality Reality device Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 6 ...

Page 7: ...f Fata Morgana Starter Kit FM Studio FM Touch FM Voyager as well as User manual 1 2 7 USB License key SG Lock HW USB license key serves to run license of Fata Morgana Studio application on computer It is essential to have this key plugged in while starting and using Fata Morgana product Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 7 ...

Page 8: ... Fata Morgana Studio is a powerful and essential tool for working with Fata Morgana Starter Kit Studio has 3 modes for optimized for specific usage 1 Editing Mode Creating a mixed reality scene and maintenance script 2 Guided Operation Supervising and guiding frontline worker trainee to successfully finish his her duty 3 Guided Inspection Teleportation into frontliner working place and documenting...

Page 9: ...e and maintenance script FM offers to create complex maintenance script in a very simple way User can manipulate with the objects within the scene while recording maintenance script subsequently editing particular steps of maintenance script Realtime preview of created scene Preview of the scene in AR VR offers checking of the designed scene and its maintenance script in the target device Full fea...

Page 10: ... of maintenance script Create and place marker Acuro at the object within the scene AcUro is a marker that serves for calibration virtual objects in the environment or for scanning calibration It is possible to place it in a scene at the selected object AR VR preview For AR VR preview is essential to connect an AR VR device as a second monitor This preview offers checking of the designed scene and...

Page 11: ...ally reject it from the session Show device information Connected device provides information about the name typ and position within the environment Show live mixed reality AR plus camera of the Frontliner User after connected to the device can see mixed reality from the frontliner Connect VR device as a second monitor for viewing mixed reality FM Studio provides real time view mixed reality of th...

Page 12: ...ed to supervising the Frontliner with the unique realtime 3D reconstruction of the working place and making documentation just by one click Key features of Fata Morgana Studio Guided Inspection Teleportation to the Frontliner working place FM Studio offers unique realtime texture reconstruction of the Frontliner environment in 3D User can virtually teleport in the Frontliner working place See thro...

Page 13: ...ter connected to the device can see mixed reality from the frontliner Show live 3D reconstruction of the Frontliner environment FM Studio offers unique realtime texture reconstruction of the Frontliner environment in 3D Make photo screenshot from live video as well as mixed reality video For documentation proposes FM Touch enables taking photo and comment it from the device camera enhanced by AR v...

Page 14: ...onnect VR device as a second monitor for viewing 3D virtual environment FM Studio provides real time view of scanned environment of the Frontliner 1 3 2 Fata Morgana Touch Fata Morgana Touch is a handy tool for supervising a frontliner worker during his her duty of difficult tasks or trainee while learning new skills Fata Morgana Touch is a simplified version of Fata Morgana Studio optimized to ru...

Page 15: ...see video or AR stream Show information about the connected device 4 2 15 Connected devices provide information about its name type and position in 3D environment Show live stream from the device camera 4 2 16 When the end device is providing a video signal e g AR micro macro Camera Infrared camera etc the user can see the video within the main screen of the Touch or in separate windows Show video...

Page 16: ...kpoint to server User can easily send choicepoint to focus on to other connected devices in session it should be e g VR device FM Studio FM Server Show live top down view and frontliner position within the 3D environment User is able to see the live position of the frontliner to provide more precise command while knowing where s he is located Record video as well as AR enhanced videofrom the devic...

Page 17: ...yager allows the scan of the frontliner working place with detailed mesh end texture Guided operation step by step with navigation to the checkpoints FM Voyager shows step by step operation guidance for the frontliner worker with direction and distance to the checkpoint Documenting with simple gesture FM Voyager enables taking photos from the working place with the hand gesture and automatically s...

Page 18: ...Activate deactivate and Frontliner can change it Measure distance 4 3 9 Frontliner can measure distance between two points selecting by hand gesture Make photo from object of interest 4 3 10 FM Voyager enables taking photos from the working place with the hand gesture and automatically storing them on the server Setup and calibration of 3D scene with AcUro marker 4 3 11 Calibration of the environm...

Page 19: ...Internet access only for updating Minimal system requirements for FM Touch Windows 10 NVIDIA Tegra 4 64 bit x64 processor 2 GB RAM 1 GB of available space Internet access only for updating Minimal system requirements for FM Voyager Windows 10 Holographic Microsoft HoloLens 2 Internet access only for updating Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 19 ...

Page 20: ...ens 2 Microsoft Surface Go 2 User Guide Zyxel User s Guide 2 3 Software SW Windows version Windows 10 NET Core 3 Unpacking connecting and SW installing 3 1 What is in the Starter Kit Fata Morgana Starter kit is plu n play solution and all necessary components are part of delivered suitecase List of HW components are listed in Chaper 1 2 Pocket Virtuality a s Fata Morgana Starter Kit User Manual Ve...

Page 21: ...in Figure 6 More detailed information how to install components are in attached document Fata Morgana Instalation Guide in paper form 3 3 How to install applications Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 21 Figure 6 Fata Morgana Starter Kit Connection schema Figure 5 Fata Morgana Starter Kit Suitecase ...

Page 22: ...e cases Preparation of training or mainenance stript Editing mode Guided Operation and Guided Inspection however we are working on others usecases and extendentions to enhance user experience with product Fata Morgana 4 1 Using of Fata Morgana Studio This chapter is describing how to use the FM Studio application runing on PC Notebook 4 1 1 Menus Editing mode File Open Opens dialog box for opening...

Page 23: ... Shows and process only visible polygons Texture Shows texture of the object s Cube Shows scene in virtual cube with the mesh Grid Shows grid plane Pivots Shows pivot s of the Obejct s Bones Shows bone s of the obeject s Top Camera in scene from top view Bottom Camera in scene from Bottom view Left Camera in scene from Left view Right Camera in scene from Right view Front Camera in scene from Fron...

Page 24: ...t Opens external link to Pocket Virtuality web page Tutorial Opens local web browser to see tutorial Guided Operation Session Open Opens dialog box for open FMO File Export Session Exports session to FMO File Invite Client Opens dialog to invite client e g MS HL 2 Remove Client Removes clinets from the session It has to be selected first View Pocket Virtuality a s Fata Morgana Starter Kit User Man...

Page 25: ...s pivot s of the Obejct s Bones Shows bone s of the obeject s Top Camera in scene from top view Bottom Camera in scene from Bottom view Left Camera in scene from Left view Right Camera in scene from Right view Front Camera in scene from Front view Back Camera in scene from Back view Tools Settings Opens dialog box for FM Studio Settings Help Pocket Virtuality a s Fata Morgana Starter Kit User Manu...

Page 26: ...Opens dialog to invite client e g MS HL 2 Remove Client Removes clinets from the session It has to be selected first Status Open dialog box with information about current Sesison View Wireframe Shows wireframe of the Object s within scene Backface culling Shows and process only visible polygons Texture Shows texture of the object s Cube Shows scene in virtual cube with the mesh Pocket Virtuality a...

Page 27: ...era in scene from Front view Back Camera in scene from Back view Tools Settings Opens dialog box for FM Studio Settings Help About Opens dialog box about FM Studio Support Opens external link to Pocket Virtuality web page Tutorial Opens local web browser to see tutorial 4 1 2 Tools and Buttons overview Overview of all buttons and Tools in FM Studio Select object Pocket Virtuality a s Fata Morgana ...

Page 28: ...add to selected object GUI Graphical User Interface Add arrow Add Arrow object button allows to add selected object Arrow Create primitive Create primitive button opens dialog box for place new primitives to the scene New pivot New pivot button creates new pivot to selected object Create session Create session button will create new session in Guided Operation or Guided Inspection mode Pocket Virt...

Page 29: ... Take picture Record video button allows take photo from video photo capable client typicaly MS HL 2 Show AR mode Show AR mode button shows virtual object in video stream from MS HL2 Synchronize view Synchronize view button synchronize 3D scene with MS HL 2 view Add checkpoint Add checkpoint button allows add new checkpoint into video stream taken photo and or 3D scene Save on local disk Save on l...

Page 30: ...hapter is describing how to use the Fata Morgana Touch application optimized for Tablet using 4 2 1 Menu Login Login information Session Session information and control Device Connected device information and control 4 2 2 Tools and Buttons overview Login Login user to server Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 30 ...

Page 31: ...Record video button allows recording video from video capable client typicaly MS HL 2 Top down view Camera in scene from top view AR view mode Camera in scene from top view Save localy Save picture localy on disk Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 31 ...

Page 32: ... in script Forward and Backward Browse photos and videos Open photos and videos browser 4 2 3 Insert a Server name or IP Address Path Server tab Type Text input Put name of Server or IP Address in the text input Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 32 ...

Page 33: ...cking at the arrow on the right hand side in the text field 4 2 4 Local Machine name Path Server tab Type Read only text field Local machine name is automatically filled in when you insert Server name or IP Address Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 33 ...

Page 34: ...ogin in case if you are on a local trusted network and server allows anonymous login 4 2 6 Login to server Path Server tab Type Function Action 1 Put the Server name or IP Address 4 2 3 2 Press Login button Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 34 ...

Page 35: ...es login to the server created by FM Studio or FM Server for larger projects 4 2 7 Application status bar Path Server tab Session tab Device tab Type Read only text field Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 35 Figure 9 Login to server ...

Page 36: ...b Session tab Device tab Type Function Action 1 Press X button to exit application Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 36 Figure 10 Application status bar Figure 11 Exit of the application ...

Page 37: ...o maximize application 4 2 11 Swiping function Path Server tab Session tab Device tab Type Function Action 1 Swipe with one finger left or right to switch between tabs 4 2 12 About the application Path Server tab Session tab Device tab About and Support About Type Function Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 37 Figure 12 Minimize of the applicatio...

Page 38: ...right bottom corner to release menu 2 Click Tap to About menu button 3 Click Tap to Terms and conditions Tutorial Path Server tab Session tab Device tab About and Support About Tutorial Type Function Action 1 Click Tap to button in right bottom corner to release menu 2 Click Tap to About menu button Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 38 Figure 14...

Page 39: ...ap to button in right bottom corner to release menu 2 Click Tap to About menu button 3 Click Tap to FAQ 4 2 13 Support Path Server tab Session tab Device tab About and Support Support Type Function Action Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 39 Figure 16 Tutorial Figure 17 FAQ ...

Page 40: ...ces in the Session Path Devices tab List of Devices Type Function Action 1 Tap to Device tab Note This function is available only if you are logged in the Server and entered one of the Session where devices are connected Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 40 Figure 18 Support ...

Page 41: ...nfo Path Devices tab Device Tap Type Read only text field Action 1 Tap to Device Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 41 Figure 19 Show all available devices in the Session ...

Page 42: ...b button 2 New Tab of Specific device is being opened When the end device is providing a video signal e g AR micro macro Camera Infrared camera etc the user can see the video within the main screen of the Touch or in separate windows Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 42 Figure 20 Device information 1 ...

Page 43: ...ed device Path Devices tab Device Specific device tab Type Read only text field Action 1 Tap to Specific device tab Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 43 Figure 21 Impersonation into the specific device ...

Page 44: ...Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 44 Figure 22 Name and information about impersonated device ...

Page 45: ...device Path Devices tab Device Specific device tab Type Video stream Action 1 Tap to Specific device tab Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 45 Figure 23 Impersonation into the specific device ...

Page 46: ...Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 46 Figure 24 Show live video from impersonated device ...

Page 47: ...ab Type Video stream Action 1 Tap to Specific device tab 2 Tap to AR button FM Touch provides live video stream from the device s camera enhanced by AR view in case of an AR device connected Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 47 Figure 25 Impersonation into the specific device ...

Page 48: ...Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 48 Figure 26 Show video enhanced by augmented reality Mixed reality from impersonated device ...

Page 49: ... from camera stream 3 Tap to AR button and then tap to Photo button for making photo screenshot from AR video stream For documentation proposes FM Touch enables taking photo and comment it from the device camera enhanced by AR view in case of an AR device connected Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 49 Figure 27 Impersonation into the specific de...

Page 50: ...Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 50 2 Figure 28 Make photo screenshot from live video ...

Page 51: ...ing on MS HoloLens 2 for the frontline worker giving them superpower to successfully execute difficult tasks with AR guidance Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 51 Figure 29 Make photo screenshot from AR enhanced video ...

Page 52: ...teracts with the virtual environment in MS HL with adapter or VR Mixed Reality compatible device AR Operation Mode Devices HoloLens 2 User is a part of the actual environment but does not contribute to environment data MS HL does not scan enviroment Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 52 Figure 30 MS HoloLens 2 with VR Adater ...

Page 53: ...Controls Overview of all buttons and controls in FM Voyager Login Login button provides login to the server for FM Starter Kit established in FM Studio Default settings provide automatic enter into the session Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 53 Figure 31 MS HoloLens 2 Figure 32 MS HoloLens 2 Scaning mode ...

Page 54: ...uremment Measuremment button serves to measure discance between two points in enviroment Photo Photo button serves to make photo form enviroment Calibration Calibration button serves to make recalibrate scene Place virtual model in enviroment at the place of ArUco marker Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 54 ...

Page 55: ...pens the setting of the FM Voyager Camera Settings button opens videostream form device capable of streaming video Create Session Create session button esteablish new session at the server where is FM Voyager connected Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 55 ...

Page 56: ...nd status where is possible to see it and edit GUI of virtual devices GUI opens menu where is possible to control virtual devices if it has this functionlity Logout Logout button providing logout form the Server To logout is neccessary to confirm it with double taping on this button Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 56 ...

Page 57: ...reselected mode in Settings Next and Back Next and Back buttons providing next item or prevvious item in the menu Forward and Backward Forward and Backward buttons providing next step or prevvious step in manufacturing script Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 57 ...

Page 58: ...Frontliner wearing MS HL 2 is automatically scanning the working place In AR Inspection mode and sending mesh and texture to the session Scanned environment is sequentially reconstruction and it is possible to see it in FM Studio Guided Inspection mode 1 Start FM Studio appliaction in Guided Inspection mode 2 Start FM Voyager appliaction from the Main Windows menu 3a After splash screen main menu ...

Page 59: ...it see the comment asociated to it as well as status Default Open In Progress Done which can be changed also by Frontliner 4 3 6 Navigate to the checkpoint position Frontliner can see through AR glasses virtual checkpoint placed in the real environment FM Voyager shows navigation marks and distance to the checkpoint Frontliner can also select a checkpoint from the list and let him navigate to it 1...

Page 60: ...tatus of selected checkpoint Checkpoint shall have different status Change status of selected checkpoint and Frontliner can change it 1 Start FM Studio appliaction in Guided Operation or Guided Inspection mode 2 Tap to the checkpoint which do you want to change status 3 Checkpoint menu will appear where you can change Title and status of it to one of following states Default Open InProgress Done 4...

Page 61: ...udio and or FM Touch Note 2 Photo can by previewed as well as deleted by taping on it 4 3 11 Setup and calibration of 3D scene with ArUco marker Calibration of the environment scene is ensured by the ArUco marker Hololens glasses automatically search for the marker and calibrate position of the scene or virtual object 1 Start FM Studio appliaction in Editing Guided Operation or Guided Inspection m...

Page 62: ...ints Photos sent from FM Studio maintenance script and or sequential steps helps gain necessary information about virtual objects and their relationship in space and time 1 Start FM Studio appliaction in Editing or Guided Operation modes 2 Tap into the virtual 3D object in scene 3 Next of previous step is possible control by taping on Forward or Backward button 4 3 13 Show labels as a part of virt...

Page 63: ...1 Start FM Studio appliaction in Guided Operation or Guided Inspection mode 2 When objects in scene has videostream capabilty tap on it 3 After taping Object menu will be appeared 4 Press Video button to open separate window for videostream 5 Updating of SW Components Updating of FM Studio and FM Touch is provided by FM Updater running on background in PC where FM Studio is instaled Pocket Virtual...

Page 64: ...M Touch update FM Touch update is managed thought the FM Studio updater apliacation 5 3 FM Voyager update Update of the FM Voyager is provided via SpaceDock aplication This application is avaiable on request to Pocket Virtuality support 6 3rd parties libreries used in Fata Morgana Starter Kit FM Studio FBX SDK Autodesk FBX SDK 2019 QRCoder MIT Fluent Ribbon MIT MahApps Metro IconPack MIT Material ...

Page 65: ...2 LibVLCSharp LGPL v2 Newton JSON MIT SharpDX MIT ExifLib Standard The Code Project Open License CPOL 1 02 Tutorial Bootstrap 4 MIT FontAwesome only icons Creative Commons 4 0 jQuery MIT popper MIT solid MIT For more detailed information see attached FM_Starter_Kit License_1512 200 pdf Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 65 ...

Page 66: ...intenance script Supervising and guiding frontline worker trainee to successfully finish his her duty Teleportation into frontliner working place and documentation FM Touch A a handy tool for supervising a frontline worker during his her duty of difficult tasks or trainee while learning new skills for MS touch devices Server Computer or computer program which manages access to a centralized resour...

Page 67: ...nd technical assistance For help and technical assistance please visit our webpage and fill in the form https www pocketvirtuality com sw support contact support 10 Contract Pocket Virtuality a s www pocketvirtuality com E mail info pocketvirtuality com Phone 420 773 623 385 Pocket Virtuality a s Fata Morgana Starter Kit User Manual Version 1 0 Date 15 12 2020 67 ...

Reviews:

No comments

Brands by name

Popular brands

Load more brands