Hybridizing grid partitioning, rough set theory, and feature selection for fuzzy rule generation in dataset classification

Authors

  • Ogange Lawrence Science in Computer Science department, Gulu University, Uganda

DOI:

https://doi.org/10.35335/emod.v13i1.20

Keywords:

Feature Selection, Fuzzy Rule Generation, Grid Partitioning, Hybridization, Rough Set Theory

Abstract

This research investigates the hybridization of Grid Partitioning, Rough Set Theory, and Feature Selection for Fuzzy Rule Generation in Dataset Classification. The objective is to improve classification accuracy and interpretability by integrating multiple techniques. Grid partitioning is employed to divide the dataset into regions, allowing localized analysis. Rough set theory is utilized for attribute reduction and feature selection, identifying informative features within each region. Fuzzy rule generation is applied to generate interpretable classification rules using linguistic terms and membership functions. The hybrid model is optimized using metaheuristic algorithms to maximize classification performance. The research demonstrates the potential of the hybrid approach through experiments on the Iris flower dataset. The findings reveal improved classification accuracy, enhanced interpretability, and effective handling of complex datasets. The research contributes to the field by integrating these techniques into a cohesive framework and highlights the importance of parameter settings, computational complexity, and real-world applications. Future work should address these limitations and validate the approach on diverse datasets. The hybridization of Grid Partitioning, Rough Set Theory, and Feature Selection for Fuzzy Rule Generation holds promise for advancing classification models in various domains

References

Albulayhi, K., Abu Al-Haija, Q., Alsuhibany, S. A., Jillepalli, A. A., Ashrafuzzaman, M., & Sheldon, F. T. (2022). IoT intrusion detection using machine learning with a novel high performing feature selection method. Applied Sciences, 12(10), 5015.

Alonso, J. M., & Magdalena, L. (2011). HILK++: an interpretability-guided fuzzy modeling methodology for learning readable and comprehensible fuzzy rule-based classifiers. Soft Computing, 15, 1959–1980.

Ascough Ii, J. C., Maier, H. R., Ravalico, J. K., & Strudley, M. W. (2008). Future research challenges for incorporation of uncertainty in environmental and ecological decision-making. Ecological Modelling, 219(3–4), 383–399.

Bock, F. E., Aydin, R. C., Cyron, C. J., Huber, N., Kalidindi, S. R., & Klusemann, B. (2019). A review of the application of machine learning and data mining approaches in continuum materials mechanics. Frontiers in Materials, 6, 110.

Buabeng, A., Simons, A., Frempong, N. K., & Ziggah, Y. Y. (2022). Predictive Maintenance Model Based on Multisensor Data Fusion of Hybrid Fuzzy Rough Set Theory Feature Selection and Stacked Ensemble for Fault Classification. Mathematical Problems in Engineering, 2022.

Chouchoulas, A. (2001). Incremental feature selection based on rough set theory. PhD Disseration of the University of Edinburgh.

Chua, T., & Tan, W. (2009). A new fuzzy rule-based initialization method for k-nearest neighbor classifier. 2009 IEEE International Conference on Fuzzy Systems, 415–420.

Frank, E., Hall, M., Holmes, G., Kirkby, R., Pfahringer, B., Witten, I. H., & Trigg, L. (2010). Weka-a machine learning workbench for data mining. Data Mining and Knowledge Discovery Handbook, 1269–1277.

Gacto, M. J., Alcalá, R., & Herrera, F. (2011). Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures. Information Sciences, 181(20), 4340–4360.

Gadaras, I., & Mikhailov, L. (2009). An interpretable fuzzy rule-based classification methodology for medical diagnosis. Artificial Intelligence in Medicine, 47(1), 25–41.

Hernández-Blanco, A., Herrera-Flores, B., Tomás, D., & Navarro-Colorado, B. (2019). A systematic review of deep learning approaches to educational data mining. Complexity, 2019.

Houssein, E. H., Hosney, M. E., Mohamed, W. M., Ali, A. A., & Younis, E. M. G. (2023). Fuzzy-based hunger games search algorithm for global optimization and feature selection using medical data. Neural Computing and Applications, 35(7), 5251–5275.

Ismail Fawaz, H., Forestier, G., Weber, J., Idoumghar, L., & Muller, P.-A. (2019). Deep learning for time series classification: a review. Data Mining and Knowledge Discovery, 33(4), 917–963.

Jiménez, F., Martínez, C., Marzano, E., Palma, J. T., Sánchez, G., & Sciavicco, G. (2019). Multiobjective evolutionary feature selection for fuzzy classification. IEEE Transactions on Fuzzy Systems, 27(5), 1085–1099.

Kameshwaran, K., & Malarvizhi, K. (2014). Survey on clustering techniques in data mining. International Journal of Computer Science and Information Technologies, 5(2), 2272–2276.

Khalid, S., Khalil, T., & Nasreen, S. (2014). A survey of feature selection and feature extraction techniques in machine learning. 2014 Science and Information Conference, 372–378.

Kumar, D. S., & Rao, V. M. (2018). Simultaneous feature selection and classification using fuzzy rules. 2018 Second International Conference on Inventive Communication and Computational Technologies (ICICCT), 125–130.

Lampert, C. H., Nickisch, H., & Harmeling, S. (2013). Attribute-based classification for zero-shot visual object categorization. IEEE Transactions on Pattern Analysis and Machine Intelligence, 36(3), 453–465.

Ly, Q. V., He, K., Maqbool, T., Sun, M., & Zhang, Z. (2022). Exploring the potential application of hybrid permonosulfate/reactive electrochemical ceramic membrane on treating humic acid-dominant wastewater. Separation and Purification Technology, 286, 120513.

Masood, F., Masood, J., Zahir, H., Driss, K., Mehmood, N., & Farooq, H. (2023). Novel approach to evaluate classification algorithms and feature selection filter algorithms using medical data. Journal of Computational and Cognitive Engineering, 2(1), 57–67.

Novaković, J. (2016). Toward optimal feature selection using ranking methods and classification algorithms. Yugoslav Journal of Operations Research, 21(1).

Osman, M. S., Lashein, E. F., Youness, E. A., & Atteya, T. E. M. (2011). Mathematical programming in rough environment. Optimisation, 60(5), 603–611.

Patil, N. (n.d.). Automated Laydown Area Configurator: Rapid Generation & Evaluation of Laydown Area Plan Design Options to facilitate decision making.

Petry, F. (2023). Information System Design Using Fuzzy and Rough Set Theory. Granular, Fuzzy, and Soft Computing, 355.

Quaghebeur, W., Torfs, E., De Baets, B., & Nopens, I. (2022). Hybrid differential equations: integrating mechanistic and data-driven techniques for modelling of water systems. Water Research, 213, 118166.

Sahebi, G., Movahedi, P., Ebrahimi, M., Pahikkala, T., Plosila, J., & Tenhunen, H. (2020). GeFeS: A generalized wrapper feature selection approach for optimizing classification performance. Computers in Biology and Medicine, 125, 103974.

Sanz, J. A., Bernardo, D., Herrera, F., Bustince, H., & Hagras, H. (2014). A compact evolutionary interval-valued fuzzy rule-based classification system for the modeling and prediction of real-world financial applications with imbalanced data. IEEE Transactions on Fuzzy Systems, 23(4), 973–990.

Shahid, N., Rappon, T., & Berta, W. (2019). Applications of artificial neural networks in health care organizational decision-making: A scoping review. PloS One, 14(2), e0212356.

Soui, M., Gasmi, I., Smiti, S., & Ghédira, K. (2019). Rule-based credit risk assessment model using multi-objective evolutionary algorithms. Expert Systems with Applications, 126, 144–157.

Sumi, M. S. S., & Narayanan, A. (2019). Improving classification accuracy using combined filter+ wrapper feature selection technique. 2019 IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT), 1–6.

Tabakhi, S., Moradi, P., & Akhlaghian, F. (2014). An unsupervised feature selection algorithm based on ant colony optimization. Engineering Applications of Artificial Intelligence, 32, 112–123.

Talpur, N., Abdulkadir, S. J., Alhussian, H., Hasan, M. H., Aziz, N., & Bamhdi, A. (2023). Deep Neuro-Fuzzy System application trends, challenges, and future perspectives: A systematic survey. Artificial Intelligence Review, 56(2), 865–913.

Thakkar, A., & Lohiya, R. (2023). Fusion of statistical importance for feature selection in Deep Neural Network-based Intrusion Detection System. Information Fusion, 90, 353–363.

Thangavel, K., Shen, Q., & Pethalakshmi, A. (2006). Application of clustering for feature selection based on rough set theory approach. AIML Journal, 6(1), 19–27.

Varchagall, M., & Adaguru Yogegowda, P. (2023). Early detection of liver disorders using hybrid soft computing techniques for optimal feature selection and classification. Concurrency and Computation: Practice and Experience, 35(6), 1.

Varzaneh, Z. A., Hossein, S., Mood, S. E., & Javidi, M. M. (2022). A new hybrid feature selection based on Improved Equilibrium Optimization. Chemometrics and Intelligent Laboratory Systems, 228, 104618.

Wu, S., Xia, S., & Chen, X. (2022). A Novel Space Division Rough Set Model for Feature Selection. In 3D Imaging—Multidimensional Signal Processing and Deep Learning: 3D Images, Graphics and Information Technologies, Volume 1 (pp. 67–75). Springer.

Yao, G., Hu, X., & Wang, G. (2022). A novel ensemble feature selection method by integrating multiple ranking information combined with an SVM ensemble model for enterprise credit risk prediction in the supply chain. Expert Systems with Applications, 200, 117002.

Zhang, J., Wang, Q., Su, Y., Jin, S., Ren, J., Eden, M., & Shen, W. (2022). An accurate and interpretable deep learning model for environmental properties prediction using hybrid molecular representations. AIChE Journal, 68(6), e17634.

Zhu, X., Wang, D., Pedrycz, W., & Li, Z. (2022). Fuzzy Rule-based Local Surrogate Models for Black-box Model Explanation. IEEE Transactions on Fuzzy Systems.

Downloads

Published

2023-05-30

How to Cite

Lawrence, O. (2023). Hybridizing grid partitioning, rough set theory, and feature selection for fuzzy rule generation in dataset classification. International Journal of Enterprise Modelling, 17(2), 79–87. https://doi.org/10.35335/emod.v13i1.20