MASSIVE SIMULATIONS USING MAPREDUCE MODEL


Abstract

In the last few years cloud computing is growing as a dominant solution for large scale numerical problems. It is based on MapReduce programming model, which provides high scalability and flexibility, but also optimizes costs of computing infrastructure. This paper studies feasibility of MapReduce model for scientific problems consisting of many independent simulations. Experiment based on variability analysis for simple electro­magnetic problem with over 10,000 scenarios proves that platform has nearly linear scalability with over 80% of theoretical maximum performance.


Keywords

mapreduce; cloud computing; platform performance; hadoop

Barker A., Varghese B., Ward J. S., Sommerville I.: Academic Cloud Computing Research: Five Pitfalls and Five Opportunities, in 6th USENIX Workshop on Hot Topics in Cloud Computing, 2014.

Cunha A. Jr., Nasser R., Sampaio R., Lopes H., Breitman K., Uncertainty quantification through the Monte Carlo method in a cloud computing setting, vol. 185, 2014, 1355–1363.

D’Angelo G., Marzolla M.: New trends in parallel and distributed simulation: From many-cores to Cloud Computing, Simul. Model. Pract. Theory, 2014, 126.

Kim B. S., Lee S. J., Kim T. G.: MapReduce Based Experimental Frame for Parallel and Distributed Simulation Using Hadoop Platform, in Proceedings 28th European Conference on Modelling and Simulation, 2012.

Kondo D., Javadi B., Malecot P., Cappello F., Anderson D. P., Berkeley U. C., Cost-Benefit Analysis of Cloud Computing versus Desktop Grids, 2009.

Sakellari G., Loukas G., A survey of mathematical models, simulation approaches and testbeds used for research in cloud computing, Simul. Model. Pract. Theory, vol. 39, 2013, pp. 92103.

Amazon EC2 Pricing, http://aws.amazon.com/ec2/pricing/, access date: [13.08.2015]

Apache Hadoop project, http://hadoop.apache.org, access date: [21.01.2015]

Google Cloud Platform Pricing, https://cloud.google.com/compute/pricing/, access date: [13.08.2015]

Microsoft Azure Pricing, https://azure.microsoft.com/en-gb/pricing/calculator/, access date: [13.08.2015]

Download

Published : 2015-10-28


Krupa, A., & Sawicki, B. (2015). MASSIVE SIMULATIONS USING MAPREDUCE MODEL. Informatyka, Automatyka, Pomiary W Gospodarce I Ochronie Środowiska, 5(4), 45-47. https://doi.org/10.5604/20830157.1176574

Artur Krupa  artur.krupa@ee.pw.edu.pl
Politechnika Warszawska, Instytut Elektrotechniki Teoretycznej i Systemów Informacyjno-Pomiarowych  Poland
Bartosz Sawicki 
Politechnika Warszawska, Instytut Elektrotechniki Teoretycznej i Systemów Informacyjno-Pomiarowych  Poland