Modified U-Net based 3D reconstruction model to estimate volume from multi-view images of a solid object

Abstract

ABSTRACTThis paper proposes a modified U-Net based reconstruction model to automatically estimate the volume of solid objects. Initially, the captured multi-view images are pre-processed using improved adaptive weighted mean filter (IAWMF). Then, the pre-processed image is segmented using modified U-Net based learning mechanism to determine ROI. After segmentation, the key feature points are extracted using Harris corner detection approach. Further, the extracted feature keypoints are matched using Oriented FAST and Rotated BRIEF (ORB) approach and the similarity among two images is calculated using similarity detection algorithm. Then, the multiple image views from various angles are used to calculate the depth map using VGGNet-16 to attain the appropriate volume of the object. Finally, the 3D point clouds are reconstructed from multiple images using dense point cloud generation algorithm for volumetric analysis. Finally, the result shows that the proposed model provides better accuracy with less error than other 3D CAD model.KEYWORDS: Point cloudmodified U-Netimproved adaptive weighted mean filterHarris Corner DetectionORB-based feature matching3D reconstructionand volume estimationDeep learningMultiple viewsVolumetric data Disclosure statementNo potential conflict of interest was reported by the author(s).Additional informationNotes on contributorsRadhamadhab DalaiRadhamadhab Dalai is a PhD scholar in the department of computer science and engineering in BIT Mesra, Ranchi, India. His interest areas of research are pattern recognition, image analysis, computer vision and robotics, machine learning.Kishore Kumar SenapatiDr. Kishore Kumar Senapati is a professor in the department of comput-er science and engineering in BIT Mesra, Ranchi, India. His interest areas of research are pattern recognition, computer algorithms, Bio-computing.Nibedita DalaiNibedita Dalai is an Assistant Professor in the department of Civil Engineering in PMEC Berhampur, India. Her areas of research interests are Structural engineering, Learning based design and optimization, 3D Architectural Survey.