Research on anomaly detection and correction method of atmospheric electric field measurement data
DOI:
Author:
Affiliation:

1.Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Nanjing University of Information Science & Technology,Nanjing 210044, China; 2.Key Laboratory for Aerosol-Cloud-Precipitation of China Meteorological Administration, Nanjing University of Information Science & Technology,Nanjing 210044, China; 3.Yancheng Third People′s Hospital, Yancheng 224000, China; 4.Jiangxi Meteorological Service Center,Nanchang 330096, China

Clc Number:

TM863

Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments
    Abstract:

    The cleaning of the atmospheric electric field is the key step of pretreatment, which is of great significance to the subsequent excavation research. In view of the shortcomings of traditional anomaly detection algorithm, which needs to specify the corresponding parameters and fail to use the relevant information between time series, a new outlier detection and correction method based on the combination of isolation forest and Chen-Liu algorithm is proposed. The method uses ARIMA model to combine the atmospheric electric field to get the fitting residual. The isolation forest model is constructed based on residual sequence to determine the location of the outliers. Finally, the Chen-Liu algorithm is used to correct the outliers. The reliability of the proposed method is verified by simulation series and the atmospheric electric field test. Compared with the original prediction, the results of the prediction of the series of thr atmospheric electric field after cleaning are improved by 27.8% and 34.98% respectively in root mean square error and mean percentage error.

    Reference
    Related
    Cited by
Get Citation
Share
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
History
  • Received:
  • Revised:
  • Adopted:
  • Online: March 11,2024
  • Published: