- Browse by Author
Browsing by Author "Zheng, Jiang-Yu"
Now showing 1 - 4 of 4
Results Per Page
Sort Options
Item Attribute-Aware Loss Function for Accurate Semantic Segmentation Considering the Pedestrian Orientations(JST, 2020) Sulistiyo, Mahmud Dwi; Kawanishi, Yasutomo; Deguchi, Daisuke; Ide, Ichiro; Hirayama, Takatsugu; Zheng, Jiang-Yu; Murase, Hiroshi; Computer and Information Science, School of ScienceNumerous applications such as autonomous driving, satellite imagery sensing, and biomedical imaging use computer vision as an important tool for perception tasks. For Intelligent Transportation Systems (ITS), it is required to precisely recognize and locate scenes in sensor data. Semantic segmentation is one of computer vision methods intended to perform such tasks. However, the existing semantic segmentation tasks label each pixel with a single object's class. Recognizing object attributes, e.g., pedestrian orientation, will be more informative and help for a better scene understanding. Thus, we propose a method to perform semantic segmentation with pedestrian attribute recognition simultaneously. We introduce an attribute-aware loss function that can be applied to an arbitrary base model. Furthermore, a re-annotation to the existing Cityscapes dataset enriches the ground-truth labels by annotating the attributes of pedestrian orientation. We implement the proposed method and compare the experimental results with others. The attribute-aware semantic segmentation shows the ability to outperform baseline methods both in the traditional object segmentation task and the expanded attribute detection task.Item Attribute-Aware Loss Function for Accurate Semantic Segmentation Considering the Pedestrian Orientations(J-Stage, 2020) Sulistiyo, Mahmud Dwi; Kawanishi, Yasutomo; Deguchi, Daisuke; Ide, Ichiro; Hirayama, Takatsugu; Zheng, Jiang-Yu; Murase, Hiroshi; Computer and Information Science, School of ScienceNumerous applications such as autonomous driving, satellite imagery sensing, and biomedical imaging use computer vision as an important tool for perception tasks. For Intelligent Transportation Systems (ITS), it is required to precisely recognize and locate scenes in sensor data. Semantic segmentation is one of computer vision methods intended to perform such tasks. However, the existing semantic segmentation tasks label each pixel with a single object's class. Recognizing object attributes, e.g., pedestrian orientation, will be more informative and help for a better scene understanding. Thus, we propose a method to perform semantic segmentation with pedestrian attribute recognition simultaneously. We introduce an attribute-aware loss function that can be applied to an arbitrary base model. Furthermore, a re-annotation to the existing Cityscapes dataset enriches the ground-truth labels by annotating the attributes of pedestrian orientation. We implement the proposed method and compare the experimental results with others. The attribute-aware semantic segmentation shows the ability to outperform baseline methods both in the traditional object segmentation task and the expanded attribute detection task.Item Data Driven Dense 3D Facial Reconstruction From 3D Skull Shape(2019-08) Gorrila, Anusha; Tuceryan, Mihran; Fang, Shiaofen; Zheng, Jiang-YuThis thesis explores a data driven machine learning based solution for Facial reconstruction from three dimensional (3D) skull shape for recognizing or identifying unknown subjects during forensic investigation. With over 8000 unidentified bodies during the past 3 decades, facial reconstruction of disintegrated bodies in helping with identification has been a critical issue for forensic practitioners. Historically, clay modelling has been used for facial reconstruction that not only requires an expert in the field but also demands a substantial amount of time for modelling, even after acquiring the skull model. Such manual reconstruction typically takes from a month to over 3 months of time and effort. The solution presented in this thesis uses 3D Cone Beam Computed Tomography (CBCT) data collected from many people to build a model of the relationship of facial skin to skull bone over a dense set of locations on the face. It then uses this skin-to-bone relationship model learned from the data to reconstruct the predicted face model from a skull shape of an unknown subject. The thesis also extends the algorithm in a way that could help modify the reconstructed face model interactively to account for the effects of age or weight. This uses the predicted face model as a starting point and creates different hypotheses of the facial appearances for different physical attributes. Attributes like age and body mass index (BMI) are used to show the physical facial appearance changes with the help of a tool we constructed. This could improve the identification process. The thesis also presents a methods designed for testing and validating the facial reconstruction algorithm.Item Geo-Temporal Visualization for Tourism Data Using Color Curves(2019-05) Choi, In Kwon; Fang, Shiaofen; Xia, Yuni; Zheng, Jiang-YuFor individuals in the tourism industry and other businesses, the department of tourism in the government, or the individuals who are planning a travel, the data of tourist population movement can be a valuable resource that can uncover insights that could bring more profit and more tourists, or make the trip more enjoyable. As visualization is an effective way of conveying information with multiple dimensions, we would like to visualize the geo-temporal floating population data of tourists and residents in Jeju island in the Republic of Korea in two-dimensional space. In this study, we introduce the two methods we have implemented for visualizing the geo-temporal data using color curves as the representation of time dimension. We use the dots as the markers of floating population, and each color of dots represents the 24 hours of a day. In the first method, we plot the colored dots directly on the map, thereby coloring the area the data represents. In the second method, we plot the same dots inside a semi-transparent circle divided into arcs that represent each month of a year. The user can compare the population of tourists and residents between the different times of a day, the different months and the weather conditions to analyze the floating population in the given area.