Daily moving reliably, accountable, audit-able, re-runnable, correctable and monitored 500K+ files - small to quite large - between places - clouds and other particular servers - using multiple transport and content protocols and loading a majority of the data into a research database. Architected and implemented a meta data and data driven, modular and easy to extend SW apparatus that can run on any number of cores to complete a days data in desired fraction of a day. This data collection and loading phase concluded, but the study and study of the vast amount of data keep going for quite some more time.The apple heart study is a collaboration between Apple and School of Medicine of Stanford University.
Location
US
Collaborators