Robustness Evaluation of ANFIS, Hybrid GA-SVM, and SVM under Controlled Time Series Structures
DOI:
https://doi.org/10.30829/zero.v10i1.29313Keywords:
ANFIS, Factorial Simulation, Hybrid GA-SVM, Robustness Evaluation, Time Series Forecasting.Abstract
This study evaluates the robustness of ANFIS, hybrid GA-SVM, and SVM under synthetic time-series structures using a factorial simulation framework combined with empirical validation. From a practical perspective, robust coal price forecasting is essential for supporting energy planning, trade management, and policy decision-making under uncertain market conditions. Empirical analysis of Indonesian coal prices reveals nonstationary behaviour, high volatility, and nonlinear dynamics. Forecasting performance is assessed using walk-forward validation, where SVM and hybrid GA-SVM demonstrate comparable accuracy and outperform ANFIS on the empirical dataset. To systematically examine model sensitivity to structural variations, a factorial simulation design is implemented by varying seasonality, volatility, and predictor–response structure across 12 scenarios with 100 replications each. The results indicate that volatility is the most dominant factor affecting forecasting error, with significant interaction effects among structural factors. ANOVA and post hoc analysis further confirm that model performance depends more on data characteristics than on algorithmic complexity. These findings demonstrate that factorial simulation provides a systematic and robust framework for evaluating forecasting models beyond conventional empirical comparisons, while offering deeper insight into the relationship between data structure and model performance.References
B. Wu, D. Huang, and M. Chen, “Estimating contagion mechanism in global equity market with time-zone effect,” Financ. Manag., vol. 52, no. 3, pp. 543–572, 2023, doi: 10.1111/fima.12430.
G. Palomba and M. Tedeschi, “Geopolitical Risks’ Spillovers Across Countries and on Commodity Markets: A Dynamic Analysis,” Energy Res. Lett., vol. 6, no. 2, pp. 1–8, 2025, doi: 10.46557/001c.121262.
J. D. Hamilton, Time Series Analysis. Princeton, New Jersey, USA: Princeton University Press, 1994. doi: 10.2307/j.ctv14jx6sm.
A. Almeida, S. Brás, S. Sargento, and F. C. Pinto, “Time series big data: a survey on data stream frameworks, analysis and algorithms,” J. Big Data, vol. 10, no. 1, p. 83, May 2023, doi: 10.1186/s40537-023-00760-1.
B. Nguyen-Thai, V. Le, N. D. T. Tieu, T. Tran, S. Venkatesh, and N. Ramzan, “Learning evolving relations for multivariate time series forecasting,” Appl. Intell., vol. 54, no. 5, pp. 3918–3932, 2024, doi: 10.1007/s10489-023-05220-0.
S. C. Huang and R. S. Tsay, “Time Series Forecasting with Many Predictors,” Mathematics, vol. 12, no. 15, 2024, doi: 10.3390/math12152336.
J. S. R. Jang, “ANFIS: Adaptive-Network-Based Fuzzy Inference System,” IEEE Trans. Syst. Man Cybern., vol. 23, no. 3, pp. 665–685, 1993, doi: 10.1109/21.256541.
V. Vapnik, The Nature of Statistical Learning Theory, Second Edition, 2nd ed. New York Inc: Springer Berlin Heidelberg, 1995.
C. Cortes and V. Vapnik, “Support-Vector Networks,” Mach. Learn., vol. 20, pp. 273–297, 1995, doi: 10.1007/BF00994018.
B. Schölkopf and A. J. Smola, Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. Cambridge, MA, USA: MIT Press, 2002.
D. E. Goldberg, Genetic algorithms in optimization, search and machine learning, 1st editio. Reading, MA, USA: Addison-Wesley Publishing Company, 1989. [Online]. Available: https;//books.google.co.id/books?
R. L. Haupt, S. E. Haupt, and A. J. Wiley, Pratical Genetic Algorithms, 2nd ed. Hoboken New Jersey: John Wiley & Sons, 2004.
Z. Alameer, M. A. Elaziz, A. A. Ewees, H. Ye, and Z. Jianhua, “Forecasting Copper Prices Using Hybrid Adaptive Neuro-Fuzzy Inference System and Genetic Algorithms,” Nat. Resour. Res., vol. 28, no. 4, pp. 1385–1401, 2019, doi: 10.1007/s11053-019-09473-w.
P. Hendikawati, Subanar, Abdurakhman, and Tarno, “ANFIS Performance Evaluation for Predicting Time Series with Calendar Effects,” IAENG Int. J. Appl. Math., vol. 51, no. 3, pp. 1–12, 2021, [Online]. Available: https://www.iaeng.org/IJAM/issues_v51/issue_3/index.html.
M. . Alquraish, K. . Abuhasel, A. . Alqahtani, and M. A. Khadr, “Comparative Analysis of Hidden Markov Model, Hybrid Support Vector Machines, and Hybrid Artificial Neural Fuzzy Inference System in Reservoir Inflow Forecasting (Case Study: The King Fahd Dam, Saudi Arabia).,” Water, vol. 13, no. 1236, 2021, doi: doi.org/10.3390/w13091236.
Ö. Öztunç Kaymak and Y. Kaymak, “Prediction of crude oil prices in COVID-19 outbreak using real data,” Chaos, Solitons and Fractals, vol. 158, 2022, doi: 10.1016/j.chaos.2022.111990.
A. V. Sinaga, N. C. Biutarbutar, T. B. Simamora, and J. Amalia, “Adaptive Neuro Fuzzy Inference System Optimization by Genetic Algorithm pada Time Series,” DoubleClick J. Comput. Inf. Technol., vol. 6, no. 1, pp. 25–31, 2022, doi: 10.25273/doubleclick.v6i1.13368.
S. Oladipo and Y. Sun, “Enhanced adaptive neuro ‑ fuzzy inference system using genetic algorithm : a case study in predicting electricity consumption,” SN Appl. Sci., vol. 5, no. 6, p. 186, 2023, doi: 10.1007/s42452-023-05406-8.
M. S. Bakare, A. Abdulkarim, A. N. Shuaibu, and M. M. Muhamad, “A hybrid long-term industrial electrical load forecasting model using optimized ANFIS with gene expression programming,” Energy Reports, vol. 11, no. May, pp. 5831–5844, 2024, doi: 10.1016/j.egyr.2024.05.045.
K. Drachal and M. Pawłowski, “A Review of the Applications of Genetic Algorithms to Forecasting Prices of Commodities.,” Economies, vol. 9, p. 6, 2021, doi: 10.3390/economies9010006.
R. Nayan, V. Rahul, D. Rakesh, N. Subbarao, and G. Pratap, “A new fuzzy support vector machine with pinball loss,” Discov. Artif. Intell., vol. 3, no. March, p. 14, 2023, doi: 10.1007/s44163-023-00057-5.
D. Ullmann, O. Taran, and S. Voloshynovskiy, “Multivariate Time Series Information Bottleneck,” Entropy, vol. 25, no. 5, p. 831, 2023, doi: 10.3390/e25050831.
M. Cheng, Q. Liu, Z. Liu, Z. Li, Y. Luo, and E. Chen, FormerTime: Hierarchical Multi-Scale Representations for Multivariate Time Series Classification, vol. 1, no. 1. Association for Computing Machinery, 2023. doi: 10.1145/3543507.3583205.
M. Cheng et al., “TimeMAE: Self-Supervised Representations of Time Series with Decoupled Masked Autoencoders,” Proc. Ninet. ACM Int. Conf. Web Search Data Min. (WSDM ’26), Febr. 22-26, 2026, Boise, ID, USA, vol. 1, no. 1, pp. 498–508, 2026, doi: 10.1145/3773966.3778007.
C.-M. Lin and Y.-S. Lin, “TPTM-HANN-GA: A Novel Hyperparameter Optimization Framework Integrating the Taguchi Method, an Artificial Neural Network, and a Genetic Algorithm for the Precise Prediction of Cardiovascular Disease Risk,” Mathematics, vol. 12, no. 1303, p. 9, 2024, doi: 10.3390/math12091303.
M. Hamoudia and S. and E. S. Makridakis, Forecasting with artificial intelligence Theory and Artificial, 1st ed. Switzerland: Palgrave Macmillan Cham, 2023. doi: 10.1007/978-3-031-35879-1.
J. Kim, H. Kim, H. G. Kim, D. Lee, and S. Yoon, “A comprehensive survey of deep learning for time series forecasting: architectural diversity and open challenges,” Artif. Intell. Rev., vol. 58, no. 7, p. 216, 2025, doi: 10.1007/s10462-025-11223-9.
S. S. W. Fatima and A. Rahimi, “A Review of Time-Series Forecasting Algorithms for Industrial Manufacturing Systems,” Machines, vol. 12, no. 6, p. 380, 2024, doi: 10.3390/machines12060380.
M. Bishop,C, Pattern Recognition and Machine Learning. New York, USA: Springer US, 2006. doi: 10.53759/7669/jmc202404020.
C. Bergmeir and J. M. Benítez, “On the use of cross-validation for time series predictor evaluation,” Inf. Sci. (Ny)., vol. 191, pp. 192–213, 2012, doi: 10.1016/j.ins.2011.12.028.
R. J. Hyndman and George Athanasopoulos, Forecasting: Principles and Practice, 2nd ed. Australia: OTexts, 2018.
F. X. Diebold and R. S. Mariano, “Comparing predictive accuracy,” J. Bus. Econ. Stat., vol. 13, no. 3, pp. 253–263, 1995, doi: 10.1080/07350015.1995.10524599.
S. Makridakis, S. C. Wheelwright, and R. J. Hyndman, Forecasting: Methods and Applications, 3rd Editio. New York, NY, USA: John Wiley & Sons, 1998.
R. J. Hyndman and A. B. Koehler, “Another look at measures of forecast accuracy,” Int. J. Forecast., vol. 22, no. 4, pp. 679–688, 2006, doi: 10.1016/j.ijforecast.2006.03.001.
T. Chai and R. R. Draxler, “Root mean square error (RMSE) or mean absolute error (MAE)? -Arguments against avoiding RMSE in the literature,” Geosci. Model Dev., vol. 7, no. 3, pp. 1247–1250, 2014, doi: 10.5194/gmd-7-1247-2014.
D. C. Montgomery, Design and Analysis of Experiment, 9th ed. Hoboken New Jersey: John Wiley & Sons, 2017.
Downloads
Published
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
