Design of an AR-based solution for innovative distance learning
Stemming from their past experiences and the analysis of the state of the art, proper methods for the realization of 3D models of instruments and devices will be defined and designed. Particular attention will focus on reverse engineering approaches capable of converting point clouds acquired by means of a 3D scanner into the geometrical shape of the object of interest. Solutions capable of assuring light-weight rendering of the desired instrument or device will be preferred due to their greater maneuverability in the extended environment. Moreover, the 3D model has to be functionalized in order to become a digital twin of actual object (either instrument or device); to this aim, proper background algorithm will be defined and designed to make some part of the 3D models (e.g., buttons, knobs or display) interactive with the user as their actual counterparts. Attention will also be paid on aspects such as instrument wiring in the extended environment, to make the remote lab experience as close as possible to that actual one. Only if the user will correctly wire all the instruments required for the specific experiment, he or she will go through the lab activities.
Task 2.2 Definition and design of the control proxy for remote control (Unina/Unical/Unisannio)
Once highlighted the most interesting approaches for long-range communication between user and actual lab instrumentation, the successive step will be focused on the definition and design of a proper HW/SW solution capable of communicating by one side with the user (thanks to communication protocols typical of the IoT) and by the other side with the instrumentation (e.g. IEEE-488, serial, USB or ethernet). Two different approaches will be followed to the purpose. The first approach will mainly rely on a low-cost solution based on network-capable microcontrollers, thus allowing to implement a cost-effective wireless connector that can be installed behind the instruments and make them reachable throughout the world. This solution will be tailored for remote control by means of only one of the above mentioned communication protocols of the instruments, namely the IEEE-488. A second solution will be designed with a more general communication purpose and acting as a control proxy to be connected with instruments or devices. This way, a more complex interface system will be taken into account, acting as a complete protocol adapter among the different requirements. Particular attention will be paid to the hardware/software architecture to assure reliable and synchronized communication among the actual instruments and the user application.
Task 2.3 Definition and design of method for performance assessment of the communication system delay (Unical)
The whole system has to offer an immersive experience for users. In order to guarantee this immersivity, allowing the best educational conditions for students, in this task the performance of the communication system is taken into account in particular as concern with the time delay. Indeed, delay in the data transmission can provoke a non fluid view of the experiment flow, breaks, instability of the measurement system itself with potential damages for the measurement testbed. On the basis of the literature overview performed in Task 1.2, the definition of the parameters determining such a delay will be defined so as the measurement methods for their evaluation. Indeed the delay depends not only on the selected communication protocol and network load, but also on the dealy in the measurement node, i.e. between the node interface (typically a PC) and the measurement instruments. The evaluation of such parameters is fundamental for the design of strategies to maintain such a delay in admissible range that will be evaluated case by case according to the experiment constraints.
Task 2.4 Definition and design of didactic material for AR-based distance learning (Unical)
Distance learning opens unprecedented opportunities for didactic learning, especially with STEM laboratories. The didactic paradigm needs to be updated by following the John Dewey didactic paradigm of “To Do”. The idea remains valid, but need to be supported by suitable didactic experiment design and material. The experiment has to be designed by taking into account the potentiality and the limitations of distance learning such as the communication delay between the student platform and the laboratory equipment and vice-versa. The didactic material has to be designed thinking that the Extended Lab is open 24/24 and a student can perform an experiment by his/her own. This mean that the didactic material must clear explain: (i) the goals of the AR Laboratorial experience, (ii) what are the required competencies and skills, (iii) what are the functional skills the students will achieve/potentiate, (iii) what are the transversal skills the students will achieve/potentiate, (v) what are the steps to be performed, (vi) tips and tricks, (vii) questions for the self evaluation, (viii) what the difference with the "in presence" experience (if any). It is worth noting that from many surveys it is highlighted that transversal skills are what employers and students demand the most.These are the skills that help employees to adapt to change throughout their careers. Indeed, UNESCO go as far as saying: “Transversal skills are increasingly in high demand for learners to successfully adapt to changes and to lead meaningful and productive lives.” (2014). The challenge faced by employers and students is that these skills are often hidden and extremely difficult to capture, and for STEM disciplines laboratory is the elected place where discovery and potentiate them. The transversal skills will be named and referred according to UNESCO classification: Critical and innovative thinking, Interpersonal skills, Intrapersonal skills, problem solving, communication, teamwork, leadership.
The development of the didactic material will be performed with the support of Prof. Giuseppe Spadafora.
Task 2.5 Definition and design of HW/SW solutions for AR-based remote control of reconfigurable circuits (Unina/Unical)
Once the Task 1.4 is terminated, the Research Unit will focus its activities on the definition and design of a suitable HW/SW approach for the realization of reconfigurable circuits by means of devices that should be remotely controlled. Particular attention will be paid on the so-called field programmable analog arrays, that are proving themselves as a feasible way to implement reconfigurable
circuits. To this aim, the research has to take into account the specifications and upgrades required to both connect the considered device inside the lab network and make them controllable in the extended environment.
Task 2.6 Design of the behavior observer (Unisannio)
Based on the analysis carried out in Task 1.3, the behavior observer will be designed and implemented for several categories of physical systems.
