Tianlong ZHANG , Jie GUO , Chenqi XU , Xi ZHANG , Chuanyuan WANG ,Baoquan LI
1 Yantai Institute of Coastal Zone Research (YIC), Chinese Academy of Sciences (CAS), CAS Key Laboratory of Coastal Environmental Processes and Ecological Remediation, Yantai 264003, China
2 Shandong Key Laboratory of Coastal Environmental Processes, Yantai Institute of Coastal Zone Research, Chinese Academy of Sciences, Yantai 264003, China
3 Center for Ocean Mega-Science, Chinese Academy of Sciences, Qingdao 266071, China
4 University of the Chinese Academy of Sciences, Beijing 100049, China
5 Frist Institute of Oceanography (FIO), Ministry of Natural Resources (MNR), Qingdao 266061, China
Abstract Features of oil spills and look-alikes in polarimetric synthetic aperture radar (SAR) images always play an important role in oil spill detection. Many oil spill detection algorithms have been implemented based on these features. Although environmental factors such as wind speed are important to distinguish oil spills and look-alikes, some oil spill detection algorithms do not consider the environmental factors. To distinguish oil spills and look-alikes more accurately based on environmental factors and image features,a new oil spill detection algorithm based on Dempster-Shafer evidence theory was proposed. The process of oil spill detection taking account of environmental factors was modeled using the subjective Bayesian model. The Faster-region convolutional neural networks (RCNN) model was used for oil spill detection based on the convolution features. The detection results of the two models were fused at decision level using Dempster-Shafer evidence theory. The establishment and test of the proposed algorithm were completed based on our oil spill and look-alike sample database that contains 1 798 image samples and environmental information records related to the image samples. The analysis and evaluation of the proposed algorithm shows a good ability to detect oil spills at a higher detection rate, with an identif ication rate greater than 75%and a false alarm rate lower than 19% from experiments. A total of 12 oil spill SAR images were collected for the validation and evaluation of the proposed algorithm. The evaluation result shows that the proposed algorithm has a good performance on detecting oil spills with an overall detection rate greater than 70%.
Keyword: synthetic aperture radar (SAR) data; oil spill detection; subjective Bayesian; Faster-region convolutional neural networks (RCNN); Dempster-Shafer evidence theory
Oil pollution is a serious marine problem worldwide(Zhang et al., 2011). Diff erent types of oil and its ref ined products such as gasoline, kerosene, and diesel oil enter the marine environment during the process of exploitation, ref ining, storage,transportation, and utilization (Li et al., 2013). The pollution caused by these oil spills greatly threatens the ocean f isheries resource, the ecological environment, and human activities (Leifer et al.,2012). Thus, prompt and effi cient oil spill detection is of great signif icance to the protection of coastal resources and the marine ecosystem (Guo et al.,2013).
The oil spill detection for polarimetric synthetic aperture radar (SAR) mainly consists of three parts:dark spot detection, feature extraction, and discrimination between oil spill and the look-alike(Guo et al., 2018). Many studies have focused on the exploration of new features extracted from the polarimetric SAR data and the innovation of oil-spill detection methods in recent years. The related works indicate that polarimetric features or polarimetric feature sets extracted from diff erent channels can help for oil spill detection (Zhang et al., 2011; Guo et al.,2018; Tong et al., 2019). However, SAR sensors work in diff erent observation models and this has limited the application of these features due to a lack of an appropriate channel. With the development of machine learning and deep learning, many classif ication algorithms have been introduced to the f ield of oil spill detection with appropriate adjustments and modif ications. The convolutional neural networks(CNN) and the fully convolutional networks (FCN)have also been successfully applied on the discrimination of oil spills and look-alikes in polarimetric SAR images (Huang et al., 2018).Krestenitis et al. (2019) compared oil-spill detection methods based on diff erent CNNs including U-Net,LinkNet, and other CNNs. The authors indicated that the optimal model for classifying oil spills is the deep convolutional neural network (DCNN). It can be found that the CNNs can be used as a model to extract the image features and they have good performance when distinguishing oil spills and look-alikes.Environmental information is also an important source for distinguishing oil spills and look-alikes(Solberg et al., 2003, 2007). However, these studies or methods have not considered environmental information from dark spots, such as wind speed, etc.
To distinguish oil spills and look-alikes more accurately with environmental factors and image features in a more objective way, a new oil spill detection algorithm based on Dempster-Shafer evidence theory (Dempster, 1967; Shafer, 1976) is proposed in this paper. The discrimination of oil spills and look-alikes can also be regarded as a problem of uncertainty in some cases (Solberg et al., 2003, 2007).Many algorithms including Bayes, neural networks and the Dempster-Shafer theory are employed to solve the uncertainty problems. The Bayesian method can make a scientif ic judgment based on information from multiple sources and it can solve the uncertainty problems successfully (Li et al., 2016). Thus,environmental information including wind speed, the distance from samples to waterways and oil off shore platforms were combined to distinguish oil spills and look-alikes using the subjective Bayesian method(Duda et al., 1976). Because the Faster-region convolutional neural networks (RCNN) (Ren et al.,2017) has been successfully applied to object detection with convolution features (Manana et al.,2018; Han et al., 2019), Faster-RCNN was used as a model to extract the convolution features and to detect oil spills from the images. Features extracted from the single channel intensity image have been more widely and successfully used in many studies and the use of a single channel intensity image can reduce the channel restrictions (Solberg et al., 2003, 2007). Oil spill detection with features extracted from a single channel intensity image will be more conducive to real-time business application (Solberg et al., 2003,2007). The Dempster-Shafer theory also shows a great capability to fuse the multiple observational evidence to solve the uncertainty problems (Zeng et al., 2019; Yang et al., 2020). Furthermore, the Dempster-Shafer theory has the characteristics of strong anti-interference, low sensor dependence, and relatively strong fault tolerance. A more robust result with less uncertainty was provided using the feature level and decision-making level Dempster-Shafer theory. Thus, the Dempster-Shafer evidence theory was selected for the fusion of the output results from the subjective Bayesian method and Faster-RCNN model to give the f inal detection result of oil spills in this paper.
2.1.1 SAR data and preprocessing
A total of 190 SAR images from 2008-2018 acquired from ENVISAT-ASAR, Sentinel-1A/B, and RADARSAT-1/2 were collected for the proposed algorithm experiment. These SAR data mainly recorded oil spills and look-alikes in the Bohai Sea,the South China Sea, and the coastal waters of China.The number of SAR images acquired from ENVISATASAR, Sentinel-1A/B, and RADARSAT-2 is 170.The information of the three main SAR systems is listed in Table 1. The C-band VV and HH polarization data from these SAR images were used to provide oil spill and look-alike image samples for our algorithm experiment due to the limitation of SAR images(Krestenitis et al., 2019). The selected data was processed with Sentinel Application Platform (SNAP)software provided by ESA. The processed data wereresampled at a spatial resolution of 30 m. To reduce the interference of speckle noise, all the data was processed by Ref ined-Lee f ilter (7× 7 window) (Lee et al., 1999).
Table 1 The information of SAR systems
Fig.1 The distribution of waterways (left) and off shore oil platforms (right) along coast of China
2.1.2 Supplementary data and the preprocessing
The TRMM Multi-satellite Precipitation Analysis(TMPA) 3B42 data, the Global Precipitation Measurement (GPM) data and European Centre for Medium-Range Weather Forecasts (ECMWF) ERAinterim re-analysis data for the same period as the SAR data were downloaded to provide rainfall and wind speed data for the interpretation of oil spills and look-alikes. The time step and spatial resolution of the TMPA 3B42 data and GPM data are 3 h, 0.5 h and 0.25°, 0.1° respectively. The time interval of the ECMWF ERA-interim data is 6 h and the data are stored in NetCDF format with a resolution of 0.125°.The TMPA 3B42 data and ECMWF ERA-interim reanalysis data were resampled to 0.125° using bilinear interpolation. In addition, off shore oil platform locations data (Commander Department of the Navy,2005a, b) and waterway data (China Cartographic Publishing House, 2015) over the coastal waters of China were collected to service the interpretation.The two data were vectorized using ESRI ArcGIS vectorization tools and the distribution of waterways and off shore platforms are shown in Fig.1.
Fig.2 Illustrations of labeled simple images (f irst row) and look-alikes (second row)
There are few open-source oil spill and look-alike sample databases and they are diffi cult to obtain.Therefore, an oil spill and look-alike sample database(OSLSD) was established with oil spill and look-alike samples that have been interpreted from SAR images.The actual oil spill and look-alike samples were selected using a visual interpretation method based on the prior knowledge of experts (Solberg et al., 2003,2007; Karathanassi et al., 2006). The visual interpretation followed the rules and descriptions of oil spills with reference to Solberg et al. (2003, 2007)and Karathanassi et al. (2006). The OSLSD is an important basic database for the construction and accurate evaluation of the new proposed algorithm in this paper. It consists of two parts: the f irst part is the Image Samples Database (ISD) and the second part is the Environmental Information Database (EID). The ISD consists of 1 798 image samples including 828 oil spill samples and 970 look-alike samples in GeoTiff format and the corresponding Extensible Markup Language (XML) f iles created by the LabelImg (2018). The XML f iles record the boundary and classif ication of the corresponding image samples(Fig.2). Seven types of look-alikes including oceanic internal waves, upwelling, ship trace, rain cells, wind sheltered by land, biogenic f ilms, and low wind velocity were interpreted based on the above visually interpreted method.
The EID consists of environmental information such as the wind speed related to the image samples.The data in the two databases were matched by the f ilename of the image samples. The EID included the wind speed data and the distance between the position of all samples and off shore oil platforms and waterways. The geometric center of image samples was regarded as the optimal location for collecting wind speed data and distance data. The location data were acquired using a vectorization tool from ESRI ArcGIS software. Using the location data, wind speed data were extracted from the ECMWF ERA-interim data. The distance between the optimal location and the off shore oil platforms or waterways was measured using an ESRI ArcGIS measurement tool. The distance data of oil platforms and waterways are represented by sample-platform data and samplewaterway data for the convenience of writing and expression.
2.3.1 The subjective Bayesian oil spill detection model
The Support Vector Machine (SVM) and Artif icial Neural Networks (ANN) are easy to over-f it if the number of samples is relatively limited when training the classif ication model. Besides, the uncertainty of samples should be considered when using the Dempster-Shafer model to express the uncertainty of the fusion results (Li et al., 2016; Yang et al., 2020).Thus, the subjective Bayesian method is selected to solve the problem that whether a sample is classif ied as an oil spill under the inf luence of single or multiple environmental factors. The environmental information can be regarded as evidenceEand the occurrence of an oil spill can be regarded as eventH(Duda et al.,1976). Because the probabilityP(H|E) and the probabilityP(E) are diffi cult to determine when applying the subjective Bayesian probabilistic reasoning model, the parameters Likelihood of Suffi ciency (LS) and Likelihood of Necessity (LN)were introduced into the subjective Bayesian probabilistic reasoning model to determine the two probabilities (Duda et al., 1976). The LS and LN parameters embody the suffi ciency and the necessity of the reasoning rules respectively (Duda et al., 1976).The values of LS and LN can be acquired using the statistical analysis results of the samples, the two parameters can be described as follows:
Fig.3 The structure diagram of Faster-RCNN
The probabilityP(H),P(E|H), andP(E|~H) can be obtained using the statistical analysis result.P(H|E)andP(H|E1…En) represent the probabilities of a sample if it is an oil spill sample under the inf luence of a single or multiple environmental factors,respectively. In this study, three environmental factors including wind speed and the distances between samples and oil platforms or waterways were extracted from the supplementary data from diff erent sensors, respectively. It is not appropriate to detect whether a dark spot is an oil spill using a single environmental factor due to the complexity of the marine environment. Thus, the subjective Bayesian oil spill detection model was employed to product a detection result with the inf luence of multiple environmental factors.
2.3.2 The Faster-RCNN oil spill detection model
The Faster-RCNN oil spill detection model was established using the sample image features from a diff erent perspective. The Faster-RCNN is a wellknown object detection framework that was proposed by Ren et al. (2017) after the introduction of RCNN and Fast-RCNN in 2016. The Faster-RCNN model combines the feature extraction layer, the proposal layer, the bounding box regression layer, and the classif ication layer into one object detection framework and it is very convenient to complete the process of feature extraction, classif ication, and position correction (Ren et al., 2017). The structure of the Faster-RCNN model is shown in Fig.3. In this study, the detection result can be regarded as the supportive degree for each detected dark spot in SAR images (Yang et al., 2020).
The VGG16 (Simonyan and Zisserman, 2015) pretrained convolution neural network was selected as the convolution feature extraction network in this paper.The convolution kernel of window size 7× 7 is replaced by three convolution kernels in window size 3× 3. The non-maximum suppression (NMS) algorithm is an important part of the Faster-RCNN and is used to remove the duplicate detection box when the intersection over union (IOU) is greater than a certain threshold (Bodla et al., 2017). The Soft-Non-Maximum Suppression (Soft-NMS) algorithm can solve this problem eff ectively by reducing the conf idence of those boxes with IOU greater than the threshold rather than deleting them (Bodla et al., 2017).
2.3.3 The Dempster-Shafer evidence theory
To add the environmental information from dark spots to distinguish oil spills and look-alikes, the information for the above two models should be fused using the information fusion method. The method can be divided into three levels: the data level, the feature level, and the decision-making level. The information fusion on the data level and the feature level requires a high precision matching relationship in time and space of the original information. That means the fault tolerance and anti-interference of the above two types of information fusion are not strong. Because of the limitation mentioned above, the data level and the feature-level information fusion are not suitable for oil spill detection in a complex marine environment.Therefore, the decision-making level-information fusion method named Dempster-Shafer theory was employed in this paper due to the characteristics of strong anti-interference, low sensor dependence, and relatively strong fault tolerance. The detection process and the detection result of the Bayesian model and the Faster-RCNN model are independent, and the detection results of the two models can be regarded as the evidence for the occurrence of an oil spill(Dempster, 1967; Shafer, 1976). In Dempster-Shafer theory, the Basic Probability Assignment (BPA), Brief function (Bel) and Plausibility function (Pls) are three important parts of evidence theory (Dempster, 1967;Shafer, 1976). The Pls establishes a bridge between an abstract mathematical model and the actual proposition and it can transform the original logical reasoning problem into a mathematical aggregation problem. BPA represents the initial allocation of believability. Bel and Pls represent the support and suspicion of a proposition and they can be described and calculated with the mass function. The def inition of Bel and Pls are as follows:
It is necessary to fuse the evidence sources to make more accurate decisions on the proposition supported by multiple sets of evidence sources simultaneously.The fusion must meet the Dempster Shafer rules in reference (Dempster, 1967; Shafer, 1976). Because the result of the orthogonal process for the BPA function is still a BPA function (Dempster, 1967;Shafer, 1976), the new Bel function and Pls function can be updated with the updated BPA. The expression is shown as Eq.8:
The Faster-RCNN for CPU versions based on the Tensorf low framework was used for training the image samples using the Windows 10 operating system in this paper. The CPU was the Intel core i7-6700 and the running memory size was 16 GB. The learning rate and the weight decay were set to 0.005 and 0.000 1. The batch size was set to 256 and the maximum iterations were set to 40 000 during training image samples. The step size for reducing the learning rate was set to 5 000. In addition, the number of top proposals to select was set to 2 000 for oil spill detection with the trained network. 70% of the samples (1 259 samples) including oil spill and lookalike samples from the ISD were selected randomly to train the Faster-RCNN oil spill detection model. The remaining 539 samples were selected for the model test.
Fig.4 The implementation chart
The detection rate (DR), the false alarm rate (FAR)and the identif ication rate (IR) were used to obtain objective and accurate evaluation results of the subjective Bayesian detection model, the Faster-RCNN detection model and the proposed algorithm.The expressions for DR, FAR, and IR are as follows:
where TT represents the number of correctly classif ied oil spill samples and TF represents the number of misclassif ied oil spill samples. FF represents the number of correctly classif ied look-alike samples,and FT represents the number of misclassif ied lookalike samples.
The analysis and evaluation of the subjective Bayesian oil spill detection model was undertaken with data from the EID. All 1 798 records from the database were used to determine the LS value of the environmental factors. The probabilityP(oil spill)was 0.461 in terms of the preliminary statistical result of all the records.
To determine the LS value in an objective way, the samples with diff erent wind speed, sample-platform data, and sample-waterway data were counted (Fig.5).The LS value was determined with the certain interval integral method due to the small number of samples.The step interval of the certain interval integral method was set to 1 m/s, 1 km, and 1 km, respectively.The upper limit of the LS value calculation for wind speed data, sample-waterway data, and sampleplatform data were set to 5 m/s, 80 km, and 300 km respectively.
The co-ordinates of marked points are 3.27, 0.23 in Fig.6a. When the wind speed is greater than 3.27 m/s,the growth of the LS value is accelerated. The curve in Fig.6a shows that the supportiveness of wind speed on samples belonging to oil spill gradually increases as wind speed increases from 3 m/s. This is consistent with the conclusion of Bern et al. (1993). The increase of supportiveness is mainly due to the decrease in the number of look-alike samples with low wind speeds.Thus, the intervals for the calculation of posteriori probabilitiesP(E|H) are 0-3 m/s and >3 m/s.
Fig.5 Histograms of wind speed data (a), the distance to waterways (b), and off shore oil platforms (c)
The curve of the LS values and the samplewaterway data is shown in Fig.6b. The f luctuation of the curve with the sample-waterway data ranges from 0 to 10 km and this is due to the small number of samples and the variation of the proportion of oil spill and look-alike samples. The coordinates of the marked turning point are 19.3 and 1.72. When the distance is greater than 19.3 km, the rate of decreasein the LS value becomes increasingly slow. Although in general the LS decreases in line with the increase of distance, all the LS values are greater than 1. This trend means that the supportiveness of distance of oil spill samples increases with a decreasing distance.This is consistent with the fact that an oil spill from a ship is an important source of marine oil spills. The intervals for the calculation of posteriori probabilitiesP(E|H) are 0-20 km and >20 km.
Table 2 The detailed information and calculation result of posteriori probabilities P( E| H)
The relationship between LS values and sample platform data is shown in Fig.6c. The marked turning point is the peak of the curve, and its coordinates are 32.8, 1.78. In general, the LS value decreases with increasing distance from 32.8 km. The supportiveness of distance on samples belonging to oil spill decreases as distance increases. This trend means that the result of the LS value is consistent with the fact that oil spill from off shore oil platforms is another important source of oil spill. The intervals for the calculation of posteriori probabilitiesP(E|H) are 0-30 km and >30 km.
For the def inition of posteriori probabilitiesP(E|H),the situation whereby a sample belongs to an oil spill can be regarded as eventH. Similarly, the intervals of wind speed data, sample-waterway data and sampleplatform data are regarded as evidenceE. The result of posteriori probabilitiesP(E|H) with diff erent intervals under diff erent environmental factors were calculated and the detailed information and calculated results are shown in Table 2.
Fig.6 The curve of LS with wind speed (a), sample-waterway data (b), and sample-platforms data (c)
Fig.7 The evaluation result of subjective Bayesian oil spill detection model
The posterior probabilityP(H|E1∙∙∙En) can be regarded as the f inal result with the inf luence of multiple environmental factors and it can be obtained with the calculation rules in Section 2.3.1 and the above computation result. The method introduced in Section 3.1 was selected to complete the evaluation.The detection rule is that if the process result for a sample is greater than the threshold value, the sample will be classif ied as oil spill; otherwise, the sample is classif ied as look-alike. Based on the prior knowledge of experts, the above statistical results in Section 3.2 and the suggestion given by Duda et al. (1976), the threshold value is set to 0.5. The evaluation result with 1 798 samples is shown in Fig.7. The evaluation result indicates that the subjective Bayesian oil spill detection model eff ectively distinguished oil spill and look-alike and achieved DR and IR values greater than 60%.
Fig.8 The Faster-RCNN total loss curve during model training (a), the ROC curve of the detection model (b), and the evaluation result of Faster-RCNN oil spill detection model (c)
The Faster-RCNN oil spill detection model was evaluated using the method described in Section 3.1 based on the remaining 539 samples. The total loss curve with iterations is shown in Fig.8a. It can be found that the network converged and the total loss was lower than 0.7 when the iterations reached 40 000. It also can be seen that the total loss curve dropped several times after protrusions in Fig.8a. The reason for this phenomenon is that the larger initial detection box in early iteration gradually returns with the increase of iterations during training. In order to see the sensitivity and the specif icity of the oil-spill detection model, a receiver operating characteristic(ROC) curve was plotted with a true positive rate(TPR) and a false positive rate (FPR). TPR indicates the proportion of TT and the sum of TT and FT. FPR indicates the rate of FT and the sum of FT and TF. The area under the curve (AUC) is also calculated with TPR and FPR using the certain interval integral method. The ROC curve is shown in Fig.8b. The ROC curve and the AUC are helpful to assess the performance of a classif ier. In general, a good classif ier corresponds to a higher AUC value. The closer the ROC curve is to the upper left corner, the better the classif ier is. It can be found that the detection model shows a good performance with AUC rates higher than 0.8. In addition, the ROC curve is relatively close to the upper left corner. The ROC curve and AUC shows that the classif ier can distinguish oil spills and look-alikes eff ectively.According to all of the above, the detection model was used for oil spill detection of the remaining samples. A total of 459 samples randomly selected from the remaining samples were used to build a test set. The above process was repeated three times to build 3 test sets. The evaluation result is shown in Fig.8c.
Fig.9 The evaluation result of the proposed algorithm with the test sets (a) and the comparison result of the subjective Bayesian method, Faster-RCNN method, and the proposed method (b)
According to the principle introduced in Section 2.3.3, the discernment frameAconsists of three elements:A1indicates that the target can be classif ied as oil spill;A2indicates that the target can be classif ied as look-alike; andA3indicates that the target cannot be classif ied as oil spill or look-alike. The detection results of the above two oil spill detection models can be regarded as two independent pieces of evidence in Dempster-Shafer evidence theory (Dempster, 1967;Shafer, 1976). The IR for the two models were 0.70 and 0.78 (average of three test sets), respectively.Thus, the mass function for the two pieces of evidence can be def ined as Eqs.10 & 11 as follows (Dempster,1967; Shafer, 1976):
The evaluation result shows that the proposed algorithm has good ability to classify oil spill and look-alike with DR and IR values greater than 75%and lower FAR values (FAR<19%). Compared with the subjective Bayesian oil spill detection model(Fig.9b), the proposed algorithm shows an improved capacity to distinguish between oil spill and lookalike with increases of 13% and 11% in DR and IR,respectively. Compared with the Faster-RCNN oil spill detection model (Fig.9b), the DR and IR of the proposed algorithm were improved with increases of 3% and 4%, respectively. The FAR of the proposed algorithm was reduced by 10% compared with the subjective Bayesian oil spill detection model and 4%compared with the Faster-RCNN oil spill detection model.
Fig.10 The detection result of the collected data
To evaluate the performance of the proposed algorithm, a total of 12 oil spill images were selected for the oil spill detection experiments. SAR images were related to several real oil spill accidents and some typical areas, such as the Malacca Strait and the Hormuz Strait, which suff er frequent oil spill accidents. The detailed information of these SAR data is shown in Table 3.
There are few open-source SAR images with simultaneous instrumental observations related to oil spill accidents and they are diffi cult to obtain. To complete the validation, the oil spills and the lookalikes in the selected images were labeled using the visual interpretation method in Section 2.2. In Fig.10,the detection result is marked with red rectangles and the interpreted oil spills and look-alikes are markedwith blue and green rectangles, respectively. The complex degree of SAR image background is classif ied by the texture of SAR images and the number and area of oil spills and look-alikes(Karathanassi et al., 2006). The f irst two rows show the detection result when the SAR image background is slightly complicated. Twenty-three out of 31 oil spill dark spots were detected and the detection rate for oil spills was 74.19%. The third row and forth row show the detection result when the SAR image background is relatively complicated. The total number of labeled oil spills was 49 and the detected oil spills was 31. The detection rate for oil spill was 63.26%. Most oil spills in the f irst two rows were detected correctly although a few oil spills with small areas were not detected. The detection result shows that the irregular line-like oil spills PL-08-13 in Fig.10 failed to be detected by the proposed algorithm. In addition, a look-alike dark spot MS-S3(2) in Fig.10 was mistakenly classif ied as oil spill. The oil spill detection result is also aff ected by the diff erence of NRCS between oil and seawater. The diff erence ofNRCS between oil spill dark spots and seawater in the 12 validation SAR images were calculated and the minimum threshold (the diff erence of NRCS) for the oil spill dark spots detected by the proposed method is 4.9 dB. The minimum threshold appears in the lower right corner red rectangle of HS (2) in Fig.10. If the diff erence of NRCS between oil spill dark spots and seawater is lower than the minimum threshold value,the oil spill dark spots will not be detected by the proposed algorithm. The detection result indicates that the proposed method shows good ability to detect oil spills when the SAR image background is not complicated. Meanwhile, the ability and accuracy for detecting oil spills with complicated SAR image background needs to be improved.
Table 3 The validation SAR images in this study
Fig.11 The evaluation result of case 1, case 2, and overall
Table 4 The evaluation result of the proposed method in diff erent cases
Two cases were considered in this paper according to reference Karathanassi et al. (2006), Solberg et al.(2007) and the above analysis in this section. The undetected oil spills were regarded as misclassif ied labeled oil spills. The look-alike unclassif ied as oil spills were regarded as correctly classif ied lookalikes. The evaluation result of oil spill detection at diff erent sea states is shown in Table 4. The DR, FAR,and IR for case 1 and case 2 are shown in Fig.11.Compared with the evaluation results of case 1, the DR and IR of case 2 were reduced by about 10% and 8% and the FAR of case 2 was increased by about 10%. When comprehensively considering case 1 and case 2, the number of labeled oil spills, detected oil spills, undetected oil spills, and look-alikes misclassif ied as oil spills are 104, 74, 30, and 23 respectively. The overall DR, FAR, and IR are calculated by the formula proposed in section 3.1 and their values are 71.15%, 23.71%, and 73.89%respectively, as shown in Fig.11 in Green.
To distinguish oil spills and look-alikes more accurately with environmental factors and image features in a more objective way, a new oil spill detection algorithm based on the Dempster-Shafer evidence theory is proposed to give the optimal detection result of oil spills. The proposed algorithm was applied to the test sets to conduct detection experiments. The evaluation results indicate that the proposed algorithm has good ability to detect oil spills in SAR images showing DR and IR values greater than 75% and lower FAR values (FAR<19%). In addition, a total of 12 SAR oil spill images were selected to validate the eff ectiveness of the proposed algorithm. The evaluation result shows that the proposed algorithm can detect oil spills eff ectively with overall DR greater than 70% and FAR lower than 25%. The subjective Bayesian model is built with environmental information of image samples extracted from multi-source remote sensing data along China’s coastline. This means that the detection results of the model depend partly on the geographical position of samples. This requires us to expand the sample database, add environmental factors and pixel factors of true or suspicious oil spills in diff erent sea areas of the world, to increase the model adaptability.The Dempster-Shafer method and the Faster-RCNN model in the proposed algorithm can also be improved with appropriate adjustment to achieve a higher detection accuracy.
In future work, the ability of oil spill detection shall be enhanced for more complex environments,and more comprehensive and detailed improvement works including the computational analysis for our algorithm will be put forward based on more samples,more features such as the polarimetric features, and more accurate waterway and oil off shore data. In addition, the proposed method should be compared with the previous oil spill detection methods built with machine learning methods (such as ANNs and SVMs), deep-learning methods, or information fusion methods, to evaluate the proposed method in a more objective way.
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
We thank the European Space Agency (ESA) for sharing and providing the Sentinel-1 data, the NASA’s Global Precipitation Measurement Project (GPM) for providing the TRMM and GPM data, the ECMWF(European Centre for Medium-Range Weather Forecasts) for the ERA-interim re-analysis data, and ENVISAT-ASAR, and RADARSAT-2 for agreements or business data. The interpretation data are from the authors.
Journal of Oceanology and Limnology2022年2期