MVI and Forecast Precision Upgrade of Time Series Precipitation Information for Ubiquitous Computing

Ashok Kumar Tripathi, P K Gupta, Hemraj Saini, Geetanjali Rathee

Abstract


Missing values are the major problem in a time - series dataset that lead to a very typical phenomenon in a dataset analysis. Better analysis of a dataset in ubiquitous computing can only be achieved after efficiently handling the missing values. This paper envisioned to present the missing values imputation (MVI) in the monthly rainfall dataset in India. Generally, the approximation of the missing values was completed using Non-linear principal component analysis, which is having a scope of enhancement. Kalman filter using Arima model to impute missing values is a better way that can be further improved by using Extended Kalman filtering. Further, a rainfall prediction is carried out using LSTM along with three different optimizers including stochastic gradient descent (SGD), RSM-Prop, and ADAM optimizers. In addition, a comparative prediction of rainfall is depicted which shows the combination of Extended Kalman imputation, LSTM, and ADAM optimizer to outperformance in prediction.

Full Text:

PDF

References


Wu, C. L., & Chau, K. W. (2013). Prediction of rainfall time series using modular soft computingmethods. Engineering applications of artificial intelligence, 26(3), 997-1007.

Luengo, J., García, S., & Herrera, F. (2012). On the choice of the best imputation methods for missing values considering three groups of classification methods. Knowledge and information systems, 32(1), 77-108.

Ma, J., Cheng, J. C., Ding, Y., Lin, C., Jiang, F., Wang, M., &Zhai, C. (2020). Transfer learning for long-interval consecutive missing values imputation without external features in air pollution time series. Advanced Engineering Informatics, 44, 101092.

Guo, J., Huang, W., & Williams, B. M. (2014). Adaptive Kalman filter approach for stochastic short-term traffic flow rate prediction and uncertainty quantification. Transportation Research Part C: Emerging Technologies, 43, 50-64.

Greff, K., Srivastava, R. K., Koutník, J., Steunebrink, B. R., &Schmidhuber, J. (2016). LSTM: A search space odyssey. IEEE transactions on neural networks and learning systems, 28(10), 2222-2232.

Rhea, S., Wang, E., Wong, E., Atkins, E., & Storer, N. (2017, May). Littletable: A time-series database and its uses. In Proceedings of the 2017 ACM International Conference on Management of Data (pp. 125-138).

Velasco, Lemuel Clark P., et al. "Week-ahead rainfall forecasting using multilayer perceptron neural network." Procedia Computer Science 161 (2019): 386-397.

Che, Z., Purushotham, S., Cho, K., Sontag, D., Liu, Y., 2018. Recurrent neural networks for multivariate time series with missing values. Scient. Rep. 8, 6085.

Chen, X., He, Z., Sun, L., 2019b. A bayesian tensor decomposition approach for spatiotemporal traffic data imputation. Transport. Res. Part C: Emerg. Technol. 98, 73–84.

Chen, X., He, Z., Chen, Y., Lu, Y., Wang, J., 2019a. Missing traffic data imputation and pattern discovery with a bayesian augmented tensor factorization model. Transport. Res. Part C: Emerg. Technol. 104, 66–77.

Cui, Zhiyong, et al. "Stacked bidirectional and unidirectional LSTM recurrent neural network for forecasting network-wide traffic state with missing values." Transportation Research Part C: Emerging Technologies 118 (2020): 102674.

Che, Z., Purushotham, S., Cho, K., Sontag, D., Liu, Y., 2018. Recurrent neural networks for multivariate time series with missing values. Scient. Rep. 8, 6085.

Chaudhry, Aizaz, et al. "A method for improving imputation and prediction accuracy of highly seasonal univariate data with large periods of missingness." Wireless Communications and Mobile Computing 2019 (2019).

Chen, Lei, et al. "Comparison of the multiple imputation approaches for imputing rainfall data series and their applications to watershed models." Journal of Hydrology 572 (2019): 449-460.

Urrea, Claudio, and RaykoAgramonte. "Kalman Filter: Historical Overview and Review of Its Use in Robotics 60 Years after Its Creation." Journal of Sensors 2021 (2021).

Liu, Lon-Mu, et al. "Data mining on time series: an illustration using fast-food restaurant franchise data." Computational Statistics & Data Analysis 37.4 (2001): 455-476.

Saputra, M. D., et al. "Handling Missing Values and Unusual Observations in Statistical Downscaling Using Kalman Filter." Journal of Physics: Conference Series. Vol. 1863. No. 1. IOP Publishing, 2021.

Anava, Oren, Elad Hazan, and Assaf Zeevi. "Online time series prediction with missing data." International conference on machine learning. PMLR, 2015.

Vijayakumar, N., and Beth Plale. "Prediction of missing events in sensor data streams using kalman filters." Proceedings of the 1st Int’l workshop on knowledge discovery from sensor data, in conjunction with ACM 13th Int’l conference on knowledge discovery and data mining. 2007.

Sharma, Vasker, and Kezang Yuden. "Imputing Missing Data in Hydrology using Machine Learning Models."

Egigu, M. L. "Techniques of Filling Missing Values of Daily and Monthly Rain Fall Data: A Review." SF J Environ Earth Sci. 2020; 3 (1) 1036.

Samal, K. Krishna Rani, et al. "An improved pollution forecasting model with meteorological impact using multiple imputation and fine-tuning approach." Sustainable Cities and Society 70 (2021): 102923.

Jamil, Faisal, and DoHyeun Kim. "Enhanced Kalman filter algorithm using fuzzy inference for improving position estimation in indoor navigation." Journal of Intelligent & Fuzzy Systems Preprint (2021): 1-15.

Afrifa‐Yamoah, Eben, et al. "Missing data imputation of high‐resolution temporal climate time series data." Meteorological Applications 27.1 (2020): e1873.

Cao, Wei, et al. "Brits: Bidirectional recurrent imputation for time series." arXiv preprint arXiv:1805.10572 (2018).

Hassani, Hossein, Mahdi Kalantari, and Zara Ghodsi. "Evaluating the Performance of Multiple Imputation Methods for Handling Missing Values in Time Series Data: A Study Focused on East Africa, Soil-Carbonate-Stable Isotope Data." Stats 2.4 (2019): 457-467.

Rantou, K-E., A. Karagrigoriou, and I. Vonta. "On imputation methods in univariate time series." Mathematics in Engineering, Science & Aerospace (MESA) 8.2 (2017).

Saputra, M. D., et al. "Handling Missing Values and Unusual Observations in Statistical Downscaling Using Kalman Filter." Journal of Physics: Conference Series. Vol. 1863. No. 1. IOP Publishing, 2021.




DOI: https://doi.org/10.31449/inf.v47i5.4152

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.