Democratización del Deep Learning: su potencial al alcance de todos

June 2nd, 2017|

Spark Summit: Stories about Spark, HPC and Barcelona

November 25th, 2015|

El maestro (El mestre), nuevo libro de Màrius Mollà

February 25th, 2015|

Apache Spark 1.2 is out!

December 20th, 2014|

Spark 1.2 is out! More than 172 contributions! Check it at Yesterday Databricks announced this new in his blog. Congratulations!  This release contains more than 1000 patches from 172 contributors.  Spark 1.2 introduces many new features along with scalability, usability and performance improvements: Optimizations in Spark’s core engine: Spark 1.2 includes several cross-cutting optimizations focused on performance for large scale workloads. Two new features Databricks developed for their world record petabyte sort with Spark are turned on by default in Spark 1.2. The first is a re-architected network transfer subsystem that exploits Netty 4’s zero-copy IO and off heap buffer management. The second is Spark’s sort based shuffle implementation. They say that these features give as much as 5X performance improvement for workloads with very large shuffles.   Spark SQL [...]

Spark Ecosystem

April 21st, 2014|

In a previous post  we introduced Spark, a framework that will play an important role in the Big Data area.  You can find a good starting point to understand what is Spark following this page from DataBricks, however let me reproduce an overview in this post. Spark runs on top of existing Hadoop clusters to provide enhanced and additional functionality. Although Hadoop is effective for storing vast amounts of data cheaply, the computations it enables with MapReduce are highly limited. MapReduce is only able to execute simple computations and uses a high-latency batch model. Spark provides a more general and powerful alternative to Hadoop's MapReduce, offering rich functionality such as stream processing, machine learning, and graph computations.  Spark provides out of the box support for deploying within an existing Hadoop [...]

Transparencias sobre el Marenostrum 3

March 10th, 2014|

Esta semana he hecho una visita al supercomputador Marenostrum 3 con los estudiantes de uno de los cursos que imparto este cuatrimestre (que actualmente ocupa el lugar 34 del ranquin mundial con 1 Petaflop/s , siendo el más potente de España y el número once de Europa). Cómo se renovó recientemente el supercomputador he tenido que preparar nuevamente mis notas con los datos principales. A veces algunos me piden estos datos, que sinceramente no me los sé de memoria, y por ello he pensado que estaría bien compartir las transparencias que he usado en el curso (que son básicamente las de Javier Bartolomé, BSC system head).

Middleware Research for Green Data Centers

October 28th, 2010|

Invited presentation at e-InfraNet Green ICT Workshop in Helsinki (27th – 28th October 2010). This eInfranet workshop addressed some of the most original EU projects and initiatives in the field and it also reviewed the EU green strategies and policies.   Workshop on Green and Environmental Computing - Helsinki from Barcelona Tech UPC - Barcelona Supercomputer Center BSC

Green Computing @ CampusParty

July 30th, 2010|

Este año me han invitado a dar una conferencia en el Campus Party. Una experiencia fenomenal. Gracias por la invitación. Adjunto pueden encontrar la presentación.

Barcelona and the future for the cloud

June 28th, 2010|

“A converted chapel in Barcelona is the home for a supercomputing centre that is helping to revolutionise the way we will use cloud computing …“  in FUTURES Magazine Issue n.6 June 2010  Read the full article at MicrosoftMagazineFUTURESpp20-22 . (full issue). linkMicrosoftMagazineFUTURESpp20-22-portada

Tecnología “smart” para una Europa sostenible (artículo en La Vanguardia, 18/05/2010)

May 18th, 2010|

(english version) Debate: The ICT, a new opportunity Smart technology for a sustainable Europe Europe  is worried about its sustainable growth. The traffic jams in the principal European cities have an estimated cost of 135 million Euros per year, which means that the car drivers spend a total of five days a year waiting in their cars. Around 40% of energy produced is wasted by the time it arrives to the consumer due to its inefficient management. At the moment, we are wasting energy and emitting carbon dioxide (CO2) into the atmosphere. The difficulty, now, is that if Europe can accomplish its ambitious goals to combat against climate change. The diagnosis is clear and the solution does not mean to increase the infrastructures, but to maintain the [...]