IADIS International Journal on Computer Science and Information Systems

Published by IADIS (International Association for Development of the Information Society) • ISSN (Online): 1646-3692 • ISSN (Print): 1646-3692
100% Open Access
Double-Blind Peer Review
Crossref DOI Persistent IDs
Open Access Peer-Reviewed Original Research

Data Cleaning Using Fd From Data Mining Process

Kollayut Kaewbuadee Department of Computer Science.Thammasat University *
Thailand Researcher *
* Yaowadee Temtanapat Department of Computer and Information Science. King Mongkut’s Institute of Technology North Bangkok, Thailand Ratchata Peachavanish Department of Computer Science. Thammasat University, Thailand (Portugal)
* Yaowadee Temtanapat Department of Computer and Information Science. King Mongkut’s Institute of Technology North Bangkok, Thailand Ratchata Peachavanish Department of Computer Science. Thammasat University, Thailand (Portugal)

Abstract

Functional Dependency (FD) is an important feature for referenc ing to the relationship between attributes and candidate keys in tuples. It also sh ows the relationship between entities in a data model (Calvanese et al. 2001). In research areas of data cleaning (Arenas et al. 1999; Bohannon et al. 2005), the FD is used for improving the data quality. In a data mining research, an FD discovery technique has been studied (Savnik and Flach 1993; Huhtala et al. 1999) . However, an FD discove ry could find too many FDs and, if use directly in a cl eaning process, could cause it to NP time (Bohannon et al. 2005). In this research, we have developed a cleaning engine by combining an FD discovery technique with data cleaning technique and use the feature in query optimization called “Selectivity Value” to decrease the number of discovered FDs. Testing results showed that this work can identi fy duplicates and anomalies with high recall and low false positive.

Keywords

Functional Dependency Data Cleaning Functional Dependency Discovery
Full-Text PDF Available

Read Complete Peer-Reviewed Manuscript

Includes full econometric models, data tables, policy recommendations, declarations, and citations.

Declarations & Ethics

Funding: This research received academic dissemination support through ESCAP / JournalsHub publishing programs.
Conflicts of Interest: The authors declare no competing financial or institutional interests.
Peer Review: Double-blind peer reviewed by international subject specialists.
License: Creative Commons Attribution 4.0 International (CC BY 4.0).
How to Cite This Article
APA / MLA / BibTeX
University, et al. (2006). Data Cleaning Using Fd From Data Mining Process. IADIS International Journal on Computer Science and Information Systems, 1(2). https://doi.org/10.33965/ijcsis_2006_v1i2_10
University, et al. "Data Cleaning Using Fd From Data Mining Process." IADIS International Journal on Computer Science and Information Systems, vol. 1, no. 2, 2006. https://doi.org/10.33965/ijcsis_2006_v1i2_10
University, et al. "Data Cleaning Using Fd From Data Mining Process." IADIS International Journal on Computer Science and Information Systems 1, no. 2 (2006). https://doi.org/10.33965/ijcsis_2006_v1i2_10