An ensemble clustering for mining high-dimensional biological big data

TitleAn ensemble clustering for mining high-dimensional biological big data
Publication TypeConference Paper
Year of Publication2016
AuthorsFarid, DMd.
EditorNowe, A
Tertiary AuthorsManderick, B
Conference NameInternational Conference on Big Data
Date Published05/2016
Conference LocationAlicante, Spain
Abstract

Clustering of high-dimensional biological big data is incredibly difficult and challenging task, as the data space is often too big and too messy. The conventional clustering methods can be inefficient and ineffective on high-dimensional biological big data, because traditional distance measures may be dominated by the noise in many dimensions. An additional challenge in biological big data is that we need to find not only the clusters of instances (genes), but for each cluster a set of features (conditions) that manifest the cluster. In this paper, we propose an ensemble clustering approach with feature selection and grouping for clustering high-dimensional biological big data. It uses two well-approved clustering methods: (a) k-means clustering and (b) similarity-based clustering. This approach selects the most relevant features in the dataset and grouping them into subset of features to overcome the problems associated with the traditional clustering methods. Also, we applied biclustering on each cluster that generated by ensemble clustering to find the sub-matrices in the biological data by the mean squared residue scores. We have applied the proposed clustering method on unlabelled genomic data (148 Exome datasets) of Brugada syndrome, in order to discover previously unknown data patterns. Experiments verify that the proposed clustering method achieved high performance clustering results on high-dimensional biological big data.