Formal derivation of distributed MapReduce
Pereverzeva, Inna, Butler, Michael, Salehi Fathabadi, Asieh, Laibinis, Linas and Troubitsyna, Elena (2014) Formal derivation of distributed MapReduce At 4th International ABZ 2014 Conference, France. 02 - 06 Jun 2014. 17 pp.
MapReduce is a powerful distributed data processing model that is currently adopted in a wide range of domains to efficiently handle large volumes of data, i.e., cope with the big data surge. In this paper, we propose an approach to formal derivation of the MapReduce framework. Our approach relies on stepwise refinement in Event-B and, in particu- lar, the event refinement structure approach – a diagrammatic notation facilitating formal development. Our approach allows us to derive the system architecture in a systematic and well-structured way. The main principle of MapReduce is to parallelise processing of data by first map- ping them to multiple processing nodes and then merging the results. To facilitate this, we formally define interdependencies between the map and reduce stages of MapReduce. This formalisation allows us to pro- pose an alternative architectural solution that weakens blocking between the stages and, as a result, achieves a higher degree of parallelisation of MapReduce computations.
|Item Type:||Conference or Workshop Item (Paper)|
|Venue - Dates:||4th International ABZ 2014 Conference, France, 2014-06-02 - 2014-06-06
|Subjects:||Q Science > QA Mathematics > QA75 Electronic computers. Computer science|
|Organisations:||Electronic & Software Systems|
|Date Deposited:||31 Mar 2014 15:20|
|Last Modified:||23 Feb 2017 00:54|
Advanced Design and Verification Environment for Cyber-physical System Engineering (ADVANCE)
Funded by: European Commission - FP7 (287563)
1 October 2011 to 31 March 2014
|Further Information:||Google Scholar|
|RDF:||RDF+N-Triples, RDF+N3, RDF+XML, Browse.|
Actions (login required)