Hybrid Grid Partitioning and Rough Set-based Fuzzy Rule Generation for Enhanced Accuracy and Interpretability in Dataset Classification

Authors

  • Philip Shukula Murphy University of Kigali, Rwanda

DOI:

https://doi.org/10.35335/emod.v14i1.24

Keywords:

Hybrid approach, Grid partitioning, Rough set-based attribute reduction, Fuzzy rule generation, Dataset classification

Abstract

Achieving a balance between accuracy and interpretability is a critical challenge in dataset classification. Traditional methods often prioritize accuracy but lack interpretability, making it difficult to comprehend and trust the classification decisions. In this research, we propose a hybrid approach that combines grid partitioning, rough set-based attribute reduction, and fuzzy rule generation to enhance both the accuracy and interpretability in dataset classification. The grid partitioning technique discretizes continuous attribute values into intervals, reducing complexity and improving accuracy. The rough set-based attribute reduction identifies the most relevant attributes, reducing noise and irrelevant information. Fuzzy rule generation generates human-understandable rules based on the refined attribute values and rough sets, providing explanations for classification decisions. By integrating these techniques, our approach strikes a balance between accuracy and interpretability. The weight parameter in the objective function allows customization according to specific requirements. Experimental evaluations demonstrate the effectiveness of the proposed approach in achieving enhanced accuracy and interpretability. The hybrid approach has potential applications in domains where transparent and understandable classification models are crucial, such as medical diagnosis or decision support systems. Further research can explore parameter optimization and evaluate the approach on diverse datasets to enhance its applicability and robustness.

References

Ahmed, M. M., & Isa, N. A. M. (2017). Knowledge base to fuzzy information granule: A review from the interpretability-accuracy perspective. Applied Soft Computing, 54, 121-140.

Alcalá, R., Casillas, J., Cordón, O., & Herrera, F. (2001). Building fuzzy graphs: features and taxonomy of learning for non-grid-oriented fuzzy rule-based systems. Journal of Intelligent & Fuzzy Systems, 11(3-4), 99-119.

Ang, K. K., & Quek, C. (2005). RSPOP: Rough set–based pseudo outer-product Fuzzy rule identification algorithm. Neural Computation, 17(1), 205-243.

Ang, K. K., & Quek, C. (2006, July). Rough set-based neuro-fuzzy system. In The 2006 IEEE international joint conference on neural network proceedings (pp. 742-749). IEEE.

Bai, H., Ge, Y., Wang, J., Li, D., Liao, Y., & Zheng, X. (2014). A method for extracting rules from spatial data based on rough fuzzy sets. Knowledge-Based Systems, 57, 28-40.

Bhatt, R., Ramanna, S., & Peters, J. F. (2009). Software defect classification: A comparative study of rough-neuro-fuzzy hybrid approaches with linear and non-linear SVMs. Rough Set Theory: A True Landmark in Data Analysis, 213-231.

Castro, P. A., & Camargo, H. A. (2005, May). Focusing on interpretability and accuracy of a genetic fuzzy system. In The 14th IEEE International Conference on Fuzzy Systems, 2005. FUZZ'05. (pp. 696-701). IEEE.

Chen, H. L., Yang, B., Liu, J., & Liu, D. Y. (2011). A support vector machine classifier with rough set-based feature selection for breast cancer diagnosis. Expert systems with applications, 38(7), 9014-9022.

Chen, T. (2017). Induction of Accurate and Interpretable Fuzzy Rules (Doctoral dissertation, Aberystwyth University).

Cheruku, R., Edla, D. R., Kuppili, V., & Dharavath, R. (2018). Rst-batminer: A fuzzy rule miner integrating rough set feature selection and bat optimization for detection of diabetes disease. Applied Soft Computing, 67, 764-780.

Cheu, E. Y., Ng, S. K., & Quek, C. (2010). Enhancing decision support system with neural fuzzy model and simple model visualizations. Handbook on Decision Making: Vol 1: Techniques and Applications, 85-116.

Coy, C. G. (2010). A hybrid-genetic algorithm for training a Sugeno-type Fuzzy Inference System with a mutable rule base (Doctoral dissertation, University of Toledo).

Das, R. T., Ang, K. K., & Quek, C. (2016). ieRSPOP: A novel incremental rough set-based pseudo outer-product with ensemble learning. Applied Soft Computing, 46, 170-186.

Derrac, J., Cornelis, C., García, S., & Herrera, F. (2012). Enhancing evolutionary instance selection algorithms by means of fuzzy rough set based feature selection. Information Sciences, 186(1), 73-92.

Ganesh Kumar, P., Kavitha, M. S., & Ahn, B. C. (2016). Automated detection of cancer associated genes using a combined fuzzy-rough-set-based f-information and water swirl algorithm of human gene expression data. Plos one, 11(12), e0167504.

Goyal, A., & Chowdhury, R. (2019). Clustering Hybrid Data Using a Neighborhood Rough Set Based Algorithm and Expounding its Application. International Journal of Fuzzy System Applications (IJFSA), 8(4), 84-100.

Huang, H. H., & Kuo, Y. H. (2010). Cross-lingual document representation and semantic similarity measure: A fuzzy set and rough set based approach. IEEE Transactions on Fuzzy Systems, 18(6), 1098-1111.

Huang, X., Shi, F., Gu, W., & Chen, S. (2009). SVM-based fuzzy rules acquisition system for pulsed GTAW process. Engineering Applications of Artificial Intelligence, 22(8), 1245-1255.

Kumar, R., Srivastava, R., & Srivastava, S. (2015). Detection and classification of cancer from microscopic biopsy images using clinically significant and biologically interpretable features. Journal of medical engineering, 2015.

Kumar, S. U., & Inbarani, H. H. (2017). Neighborhood rough set based ECG signal classification for diagnosis of cardiac diseases. Soft Computing, 21, 4721-4733.

Leung, Y., & Leung, Y. (2009). Algorithmic Approach to the Identification of Classification Rules or Separation Surface for Spatial Data. Knowledge Discovery in Spatial Data, 143-221.

Mac Parthaláin, N., & Jensen, R. (2013). Unsupervised fuzzy-rough set-based dimensionality reduction. Information Sciences, 229, 106-121.

Maji, P., & Pal, S. K. (2012). Rough-fuzzy pattern recognition: applications in bioinformatics and medical imaging (Vol. 3). John Wiley & Sons.

Mencar, C., & Fanelli, A. M. (2008). Interpretability constraints for fuzzy information granulation. Information Sciences, 178(24), 4585-4618.

Mitra, S., Mitra, M., & Chaudhuri, B. B. (2006). An approach to a rough set based disease inference engine for ECG classification. In Rough Sets and Current Trends in Computing: 5th International Conference, RSCTC 2006 Kobe, Japan, November 6-8, 2006 Proceedings 5 (pp. 398-407). Springer Berlin Heidelberg.

Mitra, S., Mitra, M., & Chaudhuri, B. B. (2008). A rough set based approach for ecg classification. Transactions on Rough Sets IX, 157-186.

Nguyen, N. N., & Quek, C. (2009, August). RSFCMAC: A novel rough set–based rule reduction approach for fuzzy CMAC architecture with yager-inference-scheme. In 2009 IEEE International Conference on Fuzzy Systems (pp. 13-18). IEEE.

Rajab, S., & Sharma, V. (2019). An interpretable neuro-fuzzy approach to stock price forecasting. Soft Computing, 23, 921-936.

Raza, M. S., & Qamar, U. (2018). Feature selection using rough set-based direct dependency calculation by avoiding the positive region. International Journal of Approximate Reasoning, 92, 175-197.

Salamo, M., & Lopez-Sanchez, M. (2011). Rough set based approaches to feature selection for case-based reasoning classifiers. Pattern Recognition Letters, 32(2), 280-292.

Shen, S., Han, S. X., Aberle, D. R., Bui, A. A., & Hsu, W. (2019). An interpretable deep hierarchical semantic convolutional neural network for lung nodule malignancy classification. Expert systems with applications, 128, 84-95.

Sivakumar, N. R., & Alaraj, A. (2017). Path management strategy to reduce flooding of grid fisheye state routing protocol in mobile ad hoc network using fuzzy and rough set theory. International Journal of Artificial Intelligence and Soft Computing, 6(3), 187-208.

Škrjanc, I., Iglesias, J. A., Sanchis, A., Leite, D., Lughofer, E., & Gomide, F. (2019). Evolving fuzzy and neuro-fuzzy approaches in clustering, regression, identification, and classification: A survey. Information sciences, 490, 344-368.

Suo, M., An, R., Zhou, D., & Li, S. (2018). Grid-clustered rough set model for self-learning and fast reduction. Pattern Recognition Letters, 106, 61-68.

Ustun, B., & Rudin, C. (2014). Methods and models for interpretable linear classification. arXiv preprint arXiv:1405.4047.

Vluymans, S., D'eer, L., Saeys, Y., & Cornelis, C. (2015). Applications of Fuzzy Rough Set Theory in Machine Learning: a Survey. Fundam. Informaticae, 142(1-4), 53-86.

Zhang, J., Deng, Z., Choi, K. S., & Wang, S. (2017). Data-driven elastic fuzzy logic system modeling: Constructing a concise system with human-like inference mechanism. IEEE Transactions on Fuzzy Systems, 26(4), 2160-2173.

Zhou, T., Chung, F. L., & Wang, S. (2016). Deep TSK fuzzy classifier with stacked generalization and triplely concise interpretability guarantee for large data. IEEE Transactions on Fuzzy Systems, 25(5), 1207-1221.

Published

2020-01-30

How to Cite

Murphy, P. S. (2020). Hybrid Grid Partitioning and Rough Set-based Fuzzy Rule Generation for Enhanced Accuracy and Interpretability in Dataset Classification. International Journal of Enterprise Modelling, 14(1), 14–22. https://doi.org/10.35335/emod.v14i1.24