Application and Performance Optimization of MapReduce Model in Image Segmentation

Abstract

With the increase of glass detection speed, some defects of MapReduce distributed computing framework are exposed, and the processing speed and timeliness cannot meet the requirements of glass-defect detection in industrial technology. Based on the MapReduce distributed computing framework, this paper designs a threshold segmentation method to complete the segmentation of glass-defect images. By improving the replication placement strategy and pipeline scheduling mechanism, the computing and storage are localized, and the timeliness of data processing is accelerated. The experimental results show that the improved MapReduce computing framework has an average increase of 14.8% in processing speed. It can detect the glass ribbon running at 800m/h and also detect the number, position and type of defects on the glass ribbon.