Supercomputing, the heart of Deep Learning

2018-07-02T23:19:51+00:00 July 2nd, 2018|

Introduction of the book  First contact with DEEP LEARNING, Practical introduction with Keras Supercomputing, the heart of Deep Learning   The first GPU in the Imagenet competition An exponential growth of computing capacity Accelerating Deep Learning with parallel systems Accelerating Deep Learning with distributed systems  Will specialized hardware for deep learning be a game changer?  Tapping the Next Generation of Supercomputers  Surely, at this point, some readers have already posed the question: why has a researcher in supercomputing such as me, started to investigate Deep Learning? In fact, many years ago I started to be interested in how supercomputing could contribute to improving Machine Learning methods; Then, in 2006, I started co-directing PhD theses with a great friend, and professor at the Computer Science department of [...]

New Free Deep Learning Book in Spanish

2018-06-13T13:13:15+00:00 June 13th, 2018|

As I already announced, during the free time that my academic and research activity allows me, I have started to write a new book about Deep Learning. The book is in Spanish and it was supposed to come out in September. Much to my regret, I realized that it would be impossible for me to finish the whole book by September, so I took the decision to divide the book into two parts and focus my efforts on finishing the first part. It gives me great pleasure to announce that I finished it and the first free book on Deep Learning in Spanish is available at http://JordiTorres.Barcelona/DeepLearning. I hope to have the second part ready before Christmas. My motivation to work on this huge project [...]

BSC at Sixth International Conference on Learning Representations in Vancouver

2018-04-27T23:13:31+00:00 April 27th, 2018|

If you were given a 10-minute video but only 30 seconds to watch it and understand what it is about, you would be able to skim through it to find the most relevant segments in this short period of time. Artificial Neural Networks are very good at solving cognitive tasks such as image and video understanding, speech recognition or translation, but they are not able to skim through the given data to accelerate their decisions. The Barcelona Supercomputing Center (Víctor Campos, Jordi Torres), in collaboration with Universitat Politècnica de Catalunya (Xavier Giró-i-Nieto, Jordi Torres, Google (Brendan Jou) and Columbia University (Shih-Fu Chang), is presenting a paper at ICLR showing how these neural networks can be enhanced to ignore parts of the input data while preserving the accuracy [...]

Un nou llibre sobre Deep Learning en castellà

2018-04-18T09:24:19+00:00 April 17th, 2018|

Malauradament no arribem per presentar-lo per Sant Jordi. Però em fa il·lusió celebrar aquest Sant Jordi amb vosaltres compartint (en aquest blog) el que tingui ja acabat i maquetat: l'índex de continguts i el primer capítol. I a partir d'aquest dia aniré compartint capítols a mesura que els vagi acabant. I per a setembre, el tindrem sencer a les prestatgeries de casa! Des de fa unes setmanes, he aturat l’activitat del meu blog i la meva presència en events divulgatius. El motiu d’això es deu a que durant les estones que em deixa la meva vida acadèmica i de recerca, he començat des de fa un temps a escriure un nou llibre sobre Deep Learning en castellà, el qual tinc previst que vegi la llum el [...]

A new book about Deep Learning in Spanish

2018-04-17T16:46:24+00:00 April 17th, 2018|

Much to my regret, the book won`t be finished in time for Saint George`s Day (Dia de san Jordi), which we celebrate in Barcelona with the book and the rose. However, it gives me great pleasure to celebrate this Saint George`s Day by sharing with you what we have completed to date; the index and contents of the first chapter. From then on, I will share chapters as and when they are finished. By September, you should have the whole book on your shelves at home! I have partially stopped my blog and my outreach activity since a few weeks ago. The reason is, that during the free time that my academic and research activity allows me, I have started to write a new book about [...]

Open position for a Junior Research Engineer in Deep Learning at BSC

2018-01-28T20:29:26+00:00 January 25th, 2018|

Junior Research Engineer (RE1/RE2) Would you like to join us? Call open for a Junior Research Engineer to work in our research group at BSC-CNS . Our research group is working on Supercomputing for Artificial Intelligence, in particular right now with special focus on Deep Learning. In this context we have some projects with big companies. The open position will be assigned in one of these projects. The candidate will participate in this project and also in other ongoing exploratory research projects related with Deep Learning (and Artificial Intelligence in general) that are going on in our research group. The candidate occasionally will participate in activities around our research/teaching collaboration with UPC groups. Deadline The vacancy will remain open until suitable candidate has been hired. Applications will be [...]

PhD in Cross-modal Deep Learning between Vision, Language, Audio and Speech

2018-01-04T23:48:18+00:00 January 4th, 2018|

Would you like to join us? Call open for the INPhINIT-"la Caixa" Doctoral fellowship programme. under the BSC research center, that offers 20 PhD INPhINIT positions.   INPhINIT is a doctoral fellowship programme devoted to attracting international Early-Stage Researchers to the top Spanish research centres. INPhINIT is promoted by "la Caixa" Foundation with the aim of supporting the best scientific talent and fostering innovative and high-quality research in Spain by recruiting outstanding international students and offering them an attractive and competitive environment for conducting research of excellence. Deep neural networks have boosted the convergence of multimedia data analytics in a unified framework shared by practitioners in natural language, vision, audio and speech. Image captioning, lip reading or video sonorization are some of the first applications of a [...]

BSC-CNS at NIPS2017, a top Machine Learning and Artificial Intelligence conference

2018-01-28T20:31:53+00:00 December 3rd, 2017|

BSC-CNS at NIPS2017, a top Machine Learning and Artificial Intelligence conference BSC-CNS will be present at the 31th Annual Conference on Neural Information Processing Systems (NIPS 2017), a machine learning and computational neuroscience conference that includes invited talks, demonstrations and oral and poster presentations. It covers topics ranging from deep learning and computer vision to cognitive science and reinforcement learning. NIPS is one of the top Machine Learning and Artificial Intelligence conferences in the world and has become the academic and industry AI conference. One paper will be presented at Machine Learning for Health workshop: "Detection-aided liver lesion segmentation using deep learning". In this paper we propose a method to segment the liver and its lesions from Computed Tomography (CT) scans using Convolutional Neural Networks (CNNs), that have proven good results in a variety of computer [...]

Informática, ¿cuál es su futuro?

2017-12-04T19:00:32+00:00 December 2nd, 2017|

Informática, ¿cuál es su futuro? La semana pasada nos visitó Oriol Vinyals  para deleitar a nuestros alumnos del curso Deep Learning for Artificial Intelligence gracias a la complicidad del Barcelona Supercomputing Center (BSC-CNS) al invitarlo a través de su programa Severo Ochoa Research Seminars. Esta vez además propusimos abrirlo a modo de meetup a todos los interesados en el tema.  Pues bien, un éxito, el auditorio de la UPC en el Vertex, acabó abarrotado, con gente en la waiting list que no pudo asistir (nuestras excusas a todos ellos).  En la presentación Oriol nos habló del AlphaGo Zero y cómo se ha convertido en el mejor jugador del mundo usando técnicas de Reinforcement Learning, Deep Learning, etc . A diferencia de sus versiones anteriores de AlphaGo en donde aprendió [...]

Conferencia sobre Deep Learning en Barcelona con la visión de Google DeepMind y Facebook

2017-11-12T15:46:09+00:00 November 12th, 2017|

    A menudo me llegan peticiones de antiguos alumnos o compañeros del sector para poder asistir a alguna de nuestras clases de Deep Learning en la UPC. Por esta razón, junto con Xavier Giró-i-Nieto, y en el marco del curso Deep Learning for Artificial Intelligence del master MET de la escuela de Telecos de la UPC  y de los seminarios Severo Ochoa Research Seminars  del Barcelona Supercomputing Center, hemos creído oportuno realizar una clase abierta  a todos los interesados en el tema, aprovechando que el próximo lunes 20 de Noviembre a las 11:30 tenemos dos participantes de excepción.   En esta clase abierta (en inglés) se presentaran algunos de los últimos avances en el tema desde el punto de vista de dos laboratorios de investigación punteros, como son Google Deepmind y Facebook [...]

Factors that have triggered the potential of Deep Learning

2017-11-11T13:37:43+00:00 September 27th, 2017|

Artificial Intelligence and Neural Networks, are not a new concepts! Why, all of a sudden, have them become the next big thing that is changing our life again during this decade? Deep Learning is changing our life I'm sure you have doubtlessly noticed quantum leaps in the quality of a wide range of everyday technologies.   In Speech Recognition  the transcription of voice to text has experimented amazing advances, and it is already available in different devices. We are increasingly interacting with “our” computers by just talking to them.  Also there have been some spectacular advances in Natural Language Processing, for example, by simply clicking on the micro symbol of Google Translate, the system will transcribe what you are dictating to another language. Google Translate now renders spoken sentences in [...]

Programming Models for Deep Learning

2017-09-27T10:08:29+00:00 September 24th, 2017|

Programming Models for Deep Learning In reality, this post was intended for my DLAI course's students, although I think it may be of interest to other students. I am going to share in this blog the teaching material that I am going to generate for the part of DLAI course that will cover the basic principles of Deep Learning from a computational perspective. Recent years, as a result of the increase of the popularity of Deep Learning, many frameworks have surged in order to ease the task of create and train models. Frameworks use different programing languages, strategies to train the models or compute the data and different characteristics as distribution or GPU acceleration support. Most of these frameworks are open sourced and their popularity can be shown in the following Figure from Francesc [...]