This paper proposes a mechanism to automatically assess the safety of autonomous robots, and in particular autonomous cars. Most methods to assess the safety of autonomous cars generate adver-sary strategies, which will then be used to test whether the car beingassessed can avoid accidents with the adversary. To generate such adversarial strategies, many have proposed learning techniques that requirea large amount of accident data. But, such data are difficult to obtain because accidents are rare. To alleviate this issue, we leverage the observation that when safe and colliding adversary trajectories are closer together, the vehicle is less safe because there is generally less buffer to avoid accidents. Specifically, we generate/utilise data on adversaries’ safe trajectories, which is more abundant than accidents data, and compute colliding adversarial trajectories that are as close as possible to the safe trajectories. The average distance between safe and colliding adversarial trajectories provides an indicator of the vehicles’ safety. To compute colliding adversarial trajectories, we take into account that the driving strategy of the vehicle being assessed is not fully known, and therefore propose a multi-objecive POMDP framing of the problem and an on-line planning method, called Constraint-Aware Tree (CAT), to compute approximate solution to the multi-objective POMDP. Evaluations of four learning-based autonomous driving software on pedestrian crossing and lane merging scenarios, derived from the National Highway Traffic Safety Administration (NHTSA), indicate the viability of the proposed testing mechanism in assessing a variety of autonomy software. Moreover, evaluations of CAT on the nuScenes dataset indicate that CAT generates more colliding adversarial trajectories in less time compared to state-of-the-artlearning-based method, STRIVE.
2020
Multistage Inferencing Approach on Large Datasets in Enhancing STEM Education
Large datasets training with deep learning neural network are often tedious and require significant amount of computational power, memory space and time. This paper presents multistage inferencing approach in deep learning neural network models when training large datasets. Datasets are arranged in heirarchical order. Subsequently, saperate models are trained for each class and subclass. Inferencing is then done in multiple stages whereby the general object class is first determined before moving forward to identify its specific subclass. A recognition rate of 90.68% is obtained after the multistage inferencing approach is applied on large STEM datasets. It was a 3.68% increment as compared to the traditional all-in-one network, which had a recognition rate of 87%. This approach is implemented onto a mobile application named as AUREL (Augmented Reality Learning). AUREL uses image recognition to detect an object and then displays the object in Augmented Reality (AR). This AR visualization is used to improve the understanding of STEM subjects and increases the enthusiasm of students towards STEM subjects.
2019
Enhancing STEM education using augmented reality and machine learning
Ivan
Ang, and King Hann
Lim
In 2019 7th International Conference on Smart Computing & Communications (ICSCC), 2019
Learning Science, Technology, Engineering andMathematics (STEM) in the 21st century has been evolved from the conventional textbook to the interactive platform using electronic devices. This paper presents the implementation of a mobile application system, named AUREL (Augmented Reality Learning) in enhancing the learning experience by projecting Augmented Reality (AR) objects onto 2D images. This AR visualization is used to improve the understanding of STEM subjects and increases the enthusiasm of students towards STEM subjects. In this implementation, Google’s Cloud Tensor Processing Units (TPUs) are used to train specific datasets alongside Cloud Vision API to detect a wide range of objects. MLKit for Firebase is used to host the custom TensorFlow Lite models for specific use cases for better accuracy. On the other hand, Google Cloud Platform (GCP) is used to harvest STEM data, manage STEM 3D information and data processing. Subsequently, the processed information will be displayed in AR in the mobile application using ARCore’s Sceneform SDK. The application of AUREL could be extended to all science subjects so that students can learn using an interactive platform.