Did you know ? If you order before Friday 14h we deliver 90PCT of the the time next Tuesday, GENTAUR another in time delivery

Pubmed ID :29887668
Publication Date : //

A Data Colocation Grid Framework for Big Data Medical Image Processing: Backend Design.


When processing large medical imaging studies, adopting high performance grid computing resources rapidly becomes important. We recently presented a "medical image processing-as-a-service" grid framework that offers promise in utilizing the Apache Hadoop ecosystem and HBase for data colocation by moving computation close to medical image storage. However, the framework has not yet proven to be easy to use in a heterogeneous hardware environment. Furthermore, the system has not yet validated when considering variety of multi-level analysis in medical imaging. Our target design criteria are (1) improving the framework's performance in a heterogeneous cluster, (2) performing population based summary statistics on large datasets, and (3) introducing a table design scheme for rapid NoSQL query. In this paper, we present a heuristic backend interface application program interface (API) design for Hadoop & HBase for Medical Image Processing (HadoopBase-MIP). The API includes: Upload, Retrieve, Remove, Load balancer (for heterogeneous cluster) and MapReduce templates. A dataset summary statistic model is discussed and implemented by MapReduce paradigm. We introduce a HBase table scheme for fast data query to better utilize the MapReduce model. Briefly, 5153 T1 images were retrieved from a university secure, shared web database and used to empirically access an in-house grid with 224 heterogeneous CPU cores. Three empirical experiments results are presented and discussed: (1) load balancer wall-time improvement of 1.5-fold compared with a framework with built-in data allocation strategy, (2) a summary statistic model is empirically verified on grid framework and is compared with the cluster when deployed with a standard Sun Grid Engine (SGE), which reduces 8-fold of wall clock time and 14-fold of resource time, and (3) the proposed HBase table scheme improves MapReduce computation with 7 fold reduction of wall time compare with a naïve scheme when datasets are relative small. The source code and interfaces have been made publicly available.

Authors : Bao Shunxing , Huo Yuankai , Parvathaneni Prasanna , Plassard Andrew J , Bermudez Camilo , Yao Yuang , Lyu Ilwoo , Gokhale Aniruddha , Landman Bennett A ,

Related products :

Catalog number Product name Quantity
1601 microRNA profiling analysis full service-RNA labeling and processing, array hybridization assay and process, data output, data analysis and report 1
A29 Chromatography Software, Extension modules, PDA SW module for PDA data processing
A28 Chromatography Software, Extension modules, GPC SW module for GPC_SEC data processing
BBS-ADV1 Biostatistics and Bioinformatics Advanced Analytic Service for 2 groups and more than 25 samples per group. Service includes Data Cluster Analysis, Data Classification Analysis and Assay Performance A 25 samples or more
237327 DATA I_O label _ DATA I_O label AB Labels;Pack-RL; 2 500 Pcs Per Pack
XGC-BiRDS-eQTL Bioinformatics analysis of eQTL data for assembly, for eQTL mapping and SNP data 4 datasets
C59 Chromatography Software, Solutions Clarity Offline Offline version for data processing
C59 Clarity Offline Offline version for data processing
XGC-BiRDS-MiSeq-RNASeq-Ref Bioinformatics of MiSeq data for comprehensive Reference based transcriptomics Bioinformatics of MiSeq data for comprehensive Reference based transcriptomics Bioinformatics of MiSeq data for compre Sample
C860K DATA ACQUISITION SYSTEM 120 VAC
D130 DATA ACQUISITION SYSTEM
D230 DATA ACQUISITION SYSTEM
D230$ DATA ACQUISITION SYSTEM 120 VAC
C860$ DATA ACQUISITION SYSTEM
900-115 Data Capture software with USB cable 1 unit
D230 DATA ACQUISITION SYSTEM
D230 DATA ACQUISITION SYSTEM 120 VAC
No.9061 AdamDU _ Data Collection Program
No.9061 AdamDU _ Data Collection Program
No.9061 AdamDU _ Data Collection Program
26-6400-67 Oligo Query Data CD_Floppy 1Each
26-6400-66 Oligo Order Data CD_Floppy 1Each
BCR100/01 Carbohydrate Data Bank for Microcomputors unit
LYM401 Lymphoma tissue array of 40 cases (1.1mm) with IHC data 39 Cases
15-1000-00 Sequencing Hard Copies & Data files 1Each


 

GENTAUR Belgium BVBA BE0473327336
Voortstraat 49, 1910 Kampenhout BELGIUM
Tel 0032 16 58 90 45

Fax 0032 16 50 90 45
info@gentaur.com | Gentaur





GENTAUR Ltd.
Howard Frank Turnberry House
1404-1410 High Road
Whetstone London N20 9BH
Tel 020 3393 8531 Fax 020 8445 9411
uk@gentaur.com | Gentaur

 

 




GENTAUR France SARL
9, rue Lagrange, 75005 Paris
Tel 01 43 25 01 50

Fax 01 43 25 01 60
RCS Paris B 484 237 888

SIRET 48423788800017

BNP PARIBAS PARIS PL MAUBERT BIC BNPAFRPPPRG

france@gentaur.com | Gentaur

GENTAUR GmbH
Marienbongard 20
52062 Aachen Deutschland
Support Karolina Elandt
Tel: 0035929830070
Fax: (+49) 241 56 00 47 88

Logistic :0241 40 08 90 86
Bankleitzahl 39050000
IBAN lautet DE8839050000107569353
Handelsregister Aachen HR B 16058
Umsatzsteuer-Identifikationsnummer *** DE 815175831
Steuernummer 201/5961/3925
de@gentaur.com | Gentaur

GENTAUR U.S.A
Genprice Inc, Logistics
547, Yurok Circle
San Jose, CA 95123
CA 95123
Tel (408) 780-0908,
Fax (408) 780-0908,
sales@genprice.com

Genprice Inc, Invoices and accounting
6017 Snell Ave, Ste 357
San Jose, CA 95123




GENTAUR Nederland BV
NL850396268B01 KVK nummer 52327027
Kuiper 1
5521 DG Eersel Nederland
Tel:  0208-080893  Fax: 0497-517897
nl@gentaur.com | Gentaur
IBAN: NL04 RABO 0156 9854 62   SWIFT RABONL2U






GENTAUR Spain
tel:0911876558
spain@gentaur.com | Gentaur






ГЕНТАУЪР БЪЛГАРИЯ
ID # 201 358 931 /BULSTAT
София 1000, ул. "Граф Игнатиев" 53 вх. В, ет. 2
Tel 0035924682280 Fax 0035924808322
e-mail: Sofia@gentaur.com | Gentaur
IBAN: BG11FINV91501014771636
BIC: FINVBGSF

GENTAUR Poland Sp. z o.o.


ul. Grunwaldzka 88/A m.2
81-771 Sopot, Poland
TEL Gdansk 058 710 33 44 FAX  058 710 33 48              

poland@gentaur.com | Gentaur

Other countries

Österreich +43720880899

Canada Montreal +15149077481

Ceská republika Praha +420246019719

Danmark +4569918806

Finland Helsset +358942419041

Magyarország Budapest +3619980547

Ireland Dublin+35316526556

Luxembourg+35220880274

Norge Oslo+4721031366

Sverige Stockholm+46852503438

Schweiz Züri+41435006251

US New York+17185132983

GENTAUR Italy
SRL IVA IT03841300167
Piazza Giacomo Matteotti, 6
24122 Bergamo Tel 02 36 00 65 93
Fax 02 36 00 65 94
italia@gentaur.com | Gentaur