Fuzzy Rules for Data Set Classification: A Hybrid Approach Using Rough Set and Grid Partitioning
DOI:
https://doi.org/10.35335/emod.v13i3.73Keywords:
Classification Accuracy, Fuzzy Rule-Based Classification, Hybrid Grid Partition, Interpretability, Rough SetAbstract
This research aims to address the issue of exponential rule generation in fuzzy rule-based classification systems by developing a hybrid grid partition and rough set method. Fuzzy rule-based classification systems have the potential to construct linguistically understandable models, but a major constraint is the significant increase in the number of rules with a high number of attributes, which can diminish interpretation and classification accuracy. In this study, the grid partition method is utilized to generate fuzzy rules with adaptively adjusted grid structures, thus avoiding exponential rule proliferation. The research encompasses the use of the Iris Flower dataset, rule formation while considering variable precision, and classification accuracy testing. The research findings indicate that the hybrid grid partition and rough set method produces more efficient and accurate fuzzy rules, with a classification accuracy rate of 83.33%. This method also successfully reduces the number of generated rules, making it a promising solution to tackle the issue of exponential rule increase in fuzzy rule-based classification systems. The conclusions of this research can be described based on the findings, discussions and results above are: The application of the rough set method at the beginning of rule formation can reduce the number of condition attributes and the number of redundant objects so that the rule formation process becomes more concise The grid partition method with a grid structure applying adapted techniques produces fuzzy rules that have the potential to be generated. The hybrid grid partition method and rough set method produce classification rules that do not increase exponentially. The number of classification rules generated decreases as the number of condition attributes and the number of objects classified decrease. Fuzzy rules generated by the hybrid method produce a classification accuracy rate of 83.3% with 9 data records and the number of unclassified data is 0.
References
Akhand, M. A. H., & Murase, K. (2015). Optimization of Fuzzy Logic Controllers with Rule Base Size Reduction using Genetic Algorithms Optimization of Fuzzy Logic Controllers with Rule Base Size Reduction using Genetic Algorithms. https://doi.org/10.1142/S0219622015500273
Angelov, P. P., & Zhou, X. (2008). Evolving fuzzy-rule-based classifiers from data streams. IEEE Transactions on Fuzzy Systems, 16(6), 1462–1475. https://doi.org/10.1109/TFUZZ.2008.925904
Anitha, K., & Venkatesan, P. (2014). Rough Set Theory Approach to Generating Classification Rules. 4(3), 229–235.
Antonelli, M., Ducange, P., & Marcelloni, F. (2014). A fast and efficient multi-objective evolutionary learning scheme for fuzzy rule-based classifiers. Information Sciences, 283(June), 36–54. https://doi.org/10.1016/j.ins.2014.06.014
Beynon, M., Curry, B., & Morgan, P. (2000). Classification and rule induction using rough set theory. Expert Systems, 17(3), 136–148.
Borgi, A. (2018). Attributes regrouping in Fuzzy Rule Based Classification Systems : an intra-classes approach. 2018 IEEE/ACS 15th International Conference on Computer Systems and Applications (AICCSA), 1–7. IEEE.
Borzooei, R.A., Estaji, A.A., & Mobini, M. (2017). On the category of rough sets. Soft Computing, 21(9), 2201–2214. https://doi.org/10.1007/s00500-016-2135-9
Chen, R., & Hu, Y. (2003). A Novel Method for Discovering Fuzzy Sequential Patterns Using the Simple Fuzzy Partition Method. 54(7), 660–670.
Chen, T., Shen, Q., Su, P., & Shang, C. (2016). Fuzzy rule weight modification with particle swarm optimization. Soft Computing, 20(8), 2923–2937. https://doi.org/10.1007/s00500-015-1922-z
De Tré, G., & Zadrożny, S. (2015). Soft computing in database and information management. In Springer's Handbook of Computational Intelligence. https://doi.org/10.1007/978-3-662-43505-2
Dehzangi, O., Zolghadri, MJ, Taheri, S., & Fakhrahmad, SM (2007). Efficient fuzzy rule generation: A new approach using data mining principles and rule weighting. Proceedings - Fourth International Conference on Fuzzy Systems and Knowledge Discovery, FSKD 2007, 2(Fskd), 134–139. https://doi.org/10.1109/FSKD.2007.267
Dutu, L., Mauris, G., Bolon, P., Dutu, L., Mauris, G., Fast, PBA, … Du, L. (2018). A Fast and Accurate Rule-Base Generation Method for Mamdani Fuzzy Systems To cite this version : HAL Id : hal-01756513 A Fast and Accurate Rule-Base Generation Method for Mamdani Fuzzy Systems.
Elkano, M., Galar, M., Sanz, J., & Bustince, H. (2016). Fuzzy Rule-Based Classification Systems for multi-class problems using binary decomposition strategies: On the influence of n-dimensional overlapping functions in the Fuzzy Reasoning Method. Information Sciences, 332, 94–114. https://doi.org/10.1016/j.ins.2015.11.006
Feng, H., Chen, Y., Ni, Q., & Huang, J. (2014). A new rough set based classification rule generation algorithm (RGI). Proceedings - 2014 International Conference on Computational Science and Computational Intelligence, CSCI 2014, 1, 380–385. https://doi.org/10.1109/CSCI.2014.71
Fetouh, T., & Zaky, MS (2017). New approach to design SVC-based stabilizers using genetic algorithm and rough set theory. IET Generation, Transmission and Distribution, 11(2), 372–382. https://doi.org/10.1049/iet-gtd.2016.0701
Gacto, M. J., Herrera, F., & A-fdez, J. A. (2007). A multi-objective genetic algorithm for tuning and rule selection to obtain accurate and compact linguistic fuzzy rule-based systems∗´∗,. 15(5), 539–557.
Hefny, H., Ghiduk, A., Wahab, A., & Elashiry, M. (2010). Effective Method for Extracting Rules from Fuzzy Decision Trees based on Ambiguity and Classifiability. Entropy, 3(4), 12.
Herrera, F. (2008). Genetic fuzzy systems: taxonomy, current research trends and prospects. 27–46. https://doi.org/10.1007/s12065-007-0001-5
Hou, T.H., & Huang, C.C. (2004). Application of fuzzy logic and variable precision rough set approach in a remote monitoring manufacturing process for diagnosis rule induction. Journal of Intelligent Manufacturing, 15(3), 395–408. https://doi.org/10.1023/B:JIMS.0000026576.00445.d8
Huang, CC, Tseng, TL, Fan, YN, & Hsu, CH (2013). Alternative rule induction methods based on incremental objects using rough set theory. Applied Soft Computing Journal, 13(1), 372–389. https://doi.org/10.1016/j.asoc.2012.08.042
Inuiguchi, M., & Miyajima, T. (2007). Rough set based rule induction from two decision tables. European Journal of Operational Research, 181(3), 1540–1553. https://doi.org/10.1016/j.ejor.2005.11.054
Ishibuchi, H., & Nakashima, T. (2001). Three-objective genetics-based machine learning for linguistic rule extraction. 136.
Ishibuchi, H., Nakashima, T., & Morisawa, T. (1997). Simple fuzzy rule-based classification systems perform well on commonly used real-world data sets. Annual Conference of the North American Fuzzy Information Processing Society - NAFIPS, 251–256. https://doi.org/10.1109/nafips.1997.624046
Ishibuchi, H., Nakashima, T., & Murata, T. (1999). Performance Evaluation of Fuzzy Classifier Systems for Multidimensional Patterns. 29(5), 601–618.
Ishibuchi, H., & Nojima, Y. (2007). Analysis of interpretability-accuracy tradeoff of fuzzy systems by multiobjective fuzzy genetics-based machine learning. International Journal of Approximate Reasoning, 44(1), 4–31. https://doi.org/10.1016/j.ijar.2006.01.004
Ishibuchi, H., Nozaki, K., & Tanaka, H. (1993). Efficient fuzzy partition of pattern space for classification problems. Fuzzy Sets and Systems, 59(3), 295–304. https://doi.org/10.1016/0165-0114(93)90474-V
Ishibuchi, H., & Yamamoto, T. (2004). Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining. Fuzzy Sets and Systems, 141(1), 59–88. https://doi.org/10.1016/S0165-0114(03)00114-3
Ishibuchi, H., & Yamamoto, T. (2005). Rule weight specification in fuzzy rule-based classification systems. IEEE Transactions on Fuzzy Systems, 13(4), 428–435. https://doi.org/10.1109/TFUZZ.2004.841738
Jia, L., Ding, W., & Jiao, H. (2015). Rough-set belief rule model using multinomial subjective logic. IET Science, Measurement and Technology, 9(3), 362–366. https://doi.org/10.1049/iet-smt.2014.0015
Jin, Y. (2015). Advanced Fuzzy Systems Design and Application (Vol. 3). Retrieved from http://repositorio.unan.edu.ni/2986/1/5624.pdf
Khoo, L. P., & Zhai, L. Y. (2001). A prototype genetic algorithm-enhanced rough set-based rule induction system. Computers in Industry, 46(1), 95–106. https://doi.org/10.1016/S0166-3615(01)00117-8
Kumar, M., & Yadav, N. (2015). Fuzzy Rough Sets and Its Application in Data Mining Field. 2(3), 237–240.
Lin, K. P., Hung, K. C., & Lin, C. L. (2018). Rule Generation Based on Novel Kernel Intuitionistic Fuzzy Rough Set Model. IEEE Access, 6(c), 11953–11958. https://doi.org/10.1109/ACCESS.2018.2809456
Liu, F., Ahmed, A., Chai, S., Geok, Q., Ng, S., & Prasad, DK (2020). RS-HeRR : a rough set-based Hebbian rule reduction neuro-fuzzy system. Neural Computing and Applications, 2. https://doi.org/10.1007/s00521-020-04997-2
Luo, HC, & Zhong, Y. Bin. (2010). Application and design of MEDS based on rough set data mining rules. Advances in Intelligent and Soft Computing, 78, 683–692. https://doi.org/10.1007/978-3-642-14880-4_75
Ma Tinghuai, Leng Jiazhao, Cui Mengmeng, TW (2009). Inducing Positive and Negative Rules Based on Rough Set. Information Technology Journal, 8(7), 1039–1043.
Magdalena, L. (nd). Fuzzy Rule-Based System. In Fuzzy Logic (pp. 203–218).
Mak, B., & Munakata, T. (2002). Rule extraction from expert heuristics: A comparative study of rough sets with neural networks and ID3. European Journal of Operational Research, 136(1), 212–229. https://doi.org/10.1016/S0377-2217(01)00062-5
Mao, L., Chen, Q., & Sun, J. (2020). Construction and Optimization of Fuzzy Rule-Based Classifier with a Swarm Intelligent Algorithm. 2020. https://doi.org/10.1155/2020/9319364
Marín-Blázquez, J. G., & Shen, Q. (2002). From approximative to descriptive fuzzy classifiers. IEEE Transactions on Fuzzy Systems, 10(4), 484–497. https://doi.org/10.1109/TFUZZ.2002.800687
Meng, Z., & Lu, J. (2016). A Rule-based Service Customization Strategy for Smart Home Context-Aware Automation. IEEE Transactions on Mobile Computing, 15(3), 558–571. https://doi.org/10.1109/TMC.2015.2424427
Meng, Zuqiang, & Shi, Z. (2012). Extended rough set-based attribute reduction in inconsistent incomplete decision systems. Information Sciences, 204, 44–69. https://doi.org/10.1016/j.ins.2012.04.004
Nozaki, K., Tanaka, H., & Ishibuchi, H. (1992). Distributed representation of fuzzy rules and its application to pattern classification. Fuzzy Sets and Systems, 52(1), 21–32.
Othman, ML, Aris, I., Othman, MR, & Osman, H. (2011). Rough-Set-and-Genetic-Algorithm based data mining and Rule Quality Measure to hypothesize distance protective relay operation characteristics from relay event report. International Journal of Electrical Power and Energy Systems, 33(8), 1437–1456. https://doi.org/10.1016/j.ijepes.2011.06.024
Pal, S. K., Mitra, S., & Mitra, P. (2003). Rough-fuzzy MLP: Modular evolution, rule generation, and evaluation. IEEE Transactions on Knowledge and Data Engineering, 15(1), 14–25. https://doi.org/10.1109/TKDE.2003.1161579
Pattaraintakorn, P., Cercone, N., & Naruedomkul, K. (2006). Rule learning: Ordinal prediction based on rough sets and soft computing. Applied Mathematics Letters, 19(12), 1300–1307. https://doi.org/10.1016/j.aml.2005.08.004
Pawlak, Zdzislaw. (2004). Some Issues on Rough Sets. 1–2.
Pawlak, Zdzisław. (1982). Rough sets. International Journal of Computer & Information Sciences, 11(5), 341–356. https://doi.org/10.1007/BF01001956
Prefecture, O. (1896). Selecting Fuzzy Rules with Forgetting in Fuzzy Classification Systems. 1–6.
Qian, Y., Liang, J., & Dang, C. (2008). Converse approximation and rule extraction from decision tables in rough set theory. Computers and Mathematics with Applications, 55(8), 1754–1765. https://doi.org/10.1016/j.camwa.2007.08.031
Science, I. (2014). Fuzzy If-Then Rules Classifier on Ensemble Data Author Downloaded from Griffith Research Online.
Shi, F., Sun, S., & Xu, J. (2012). Employing rough sets and association rule mining in KANSEI knowledge extraction. Information Sciences, 196, 118–128. https://doi.org/10.1016/j.ins.2012.02.006
Sitompul, Opim Salim; Nababan, Erna Budhiarti; Alim, Z. (2017). International Conference on Information & Communication Technology and Systems (ICTS). Adaptive Distributed Grid- Partition in Generating Fuzzy Rules, 119–124. IEEE.
Slim, H. (2020). sustainability A Mixed Rough Sets / Fuzzy Logic Approach for Modeling Systemic Performance Variability with FRAM. (Figure 1), 1–21.
Soua, B., Borgi, A., & Tagina, M. (2009). Attributes Regrouping In Fuzzy Rule Based Classification Systems. International Conference on Signals, Circuits and Systems Attributes, 1–6.
Soua, B., Borgi, A., & Tagina, M. (2013). An ensemble method for fuzzy rule-based classification systems. Knowledge and Information Systems, 36(2), 385–410. https://doi.org/10.1007/s10115-012-0532-7
Sumalatha, L., Uma Sankar, P., & Sujatha, B. (2016). Rough set based decision rule generation to find behavioral patterns of customers. Sadhana - Academy Proceedings in Engineering Sciences, 41(9), 985–991. https://doi.org/10.1007/s12046-016-0528-1
Teoh, HJ, Cheng, CH, Chu, HH, & Chen, JS (2008). Fuzzy time series model based on probabilistic approach and rough set rule induction for empirical research in stock markets. Data and Knowledge Engineering, 67(1), 103–117. https://doi.org/10.1016/j.datak.2008.06.002
Vashist, R., & Garg, M. . (2011). Rule Generation based on Reduct and Core: A Rough Set Approach. International Journal of Computer Applications, 29(9), 1–5. https://doi.org/10.5120/3595-4989
Wang, X., Yang, J., Jensen, R., & Liu, X. (2006). Rough set feature selection and rule induction for prediction of malignancy degree in brain glioma. Computer Methods and Programs in Biomedicine, 83(2), 147–156. https://doi.org/10.1016/j.cmpb.2006.06.007
Yang, X. (2012). Indiscernibility Relations, Rough Sets and Information Systems. In Incomplete Information Systems and Rough Set Theory. https://doi.org/10.1007/978-3-642-25935-7_1
Yu-Neng, Chun-Che Huang, C.-CC (2008). Rule Induction Based on an Incremental Rough Set. International Joint Conference on Neural Networks, 5, 1208–1215.
Zhang, C. (2020). Classification Rule Mining Algorithm Combining Intuitionistic Fuzzy Rough Sets and Genetic Algorithm. International Journal of Fuzzy Systems. https://doi.org/10.1007/s40815-020-00849-2
Published
How to Cite
Issue
Section
License
Copyright (c) 2019 Adeola Azy Daniachew, Averey Barack Clevon, Abimelech Keita Avram, Dodavah Tesseman Chislon
This work is licensed under a Creative Commons Attribution 4.0 International License.
