Point Sampling Net: Revolutionizing Instance Segmentation in Point Cloud Data

摘要

Today, there is a great need for 3D instance segmentation, which has several uses in robotics and augmented reality. Unlike projective observations like 2D photographs, 3D models offer a metric reconstruction of the sceneries without occlusion or scale ambiguity of the environment. In agriculture, understanding Plant growth phenotyping enhances comprehension of complex genetic features and accelerates the advancement of contemporary breeding and smart farming. A reduction in crop production quality is caused by leaf diseases in agriculture. In order to increase productivity in the agricultural industry, it is therefore possible to automate the recognition of leaf diseases. Diverse leaf disease patterns affect the detection’s accuracy in the majority of systems. During phenotyping, 3D PCs (PC) of components of plants like the stems and leaves are segmented in order to follow autonomous growth and estimate the level of stress the crop has experienced. This research proposed a Point Sampling Method with occupancy grid representation for segmenting PCs of different plant species, which was developed. To handle unordered input sets, this approach mainly relies on the application of the single symmetric function max pooling. In reality, a set of optimization functions are used by the network to choose points which is more curious or instructive from the PC and encapsulate the selection reason, and the fully connected layers, used for shape classification or shape segmentation, integrate these learned ideal significances hooked on a global descriptor regarding the overall shape. After being trained on the Point Sampling Network-created plant dataset, the network can simultaneously realize semantic and leaf instance segmentation.