Build a Spark Project

Closed Posted 5 years ago Paid on delivery
Closed Paid on delivery

DNA methylation is a well-studied genetic modification crucial to regulate the functioning of the genome. Its alterations play an important role in tumorigenesis and tumor-suppression. Thus, studying DNA methylation data may help biomarker discovery in cancer. Since public data on DNA methylation become abundant, and considering the high number of methylated sites (features) present in the genome, it is important to have a method for efficiently processing such large datasets. Relying on big data technologies, we propose BIGBIOCL an algorithm that can apply supervised classification methods to datasets with hundreds of thousands of features. It is designed for the extraction of alternative and equivalent classification models through iterative deletion of selected features. We run experiments on DNA methylation datasets extracted from The Cancer Genome Atlas, focusing on three tumor types: breast, kidney, and thyroid carcinomas. We perform classifications extracting several methylated sites and their associated genes with accurate performance. Results suggest that BIGBIOCL can perform hundreds of classification iterations on hundreds of thousands of features in few hours. Moreover, we compare the performance of our method with other state-of-the-art classifiers and with a wide-spread DNA methylation analysis method based on network analysis. Finally, we are able to efficiently compute multiple alternative classification models and extract, from DNA-methylation large datasets, a set of candidate genes to be further investigated to determine their active role in cancer. BIGBIOCL, results of experiments, and a guide to carry on new experiments are freely available on GitHub.

This is regarding Cancer related Dataset that is to be used to find cancer drivers

Java Machine Learning (ML) Spark

Project ID: #18739725

About the project

3 proposals Remote project Active 5 years ago

3 freelancers are bidding on average ₹1500 for this job

djadhav16692

I would have 2 years of working experience in Hadoop would, While working as a Hadoop developer I worked on spark performance tuning optimisation. So I can easily complete that project.

₹1300 INR in 10 days
(1 Review)
0.0
Mallikarjun01

I am Bigdata expert with spark and pyspark experience. would like to discuss about this project and deliver my best .

₹950 INR in 15 days
(0 Reviews)
0.0