Data research

Distributed ledgers for carbon markets

Author: Adrian Jackson
Posted: 10 Aug 2017 | 20:22

Distributed ledgers, the core technology underlying digital currencies such as BitCoin, offer some interesting functionality for constructing distributed data infrastructures.Ledger

Ledgers can be considered to be simple data stores. They are styled on accounting ledgers, books where transactions are recorded one after the other, and the overall state of the accounts can be evaluated by working through the recorded transactions to calculate how much money has flowed in and out of the accounts.

Demystifying data input to TensorFlow for deep learning

Author: Alan Gray
Posted: 29 Nov 2016 | 10:07

Shape SorterView this post on GitHub

TensorFlow is an incredibly powerful new framework for deep learning. The “MNIST For ML Beginners” and “Deep MNIST for Experts” TensorFlow tutorials give an excellent introduction to the framework. This article acts as a follow-on tutorial which addresses the following issues:

  1. The above tutorials use the MNIST dataset of hand written numbers, which pre-exists in TensorFlow TFRecord format and is loaded automatically. This can be a bit mysterious if you have no experience of data format manipulation in TensorFlow.
  2. Since the MNIST dataset is fixed, there is little scope for experimentation through adjusting the images and network to get a feel for how to deal with particular aspects of real data.

Software Sustainability Institute Fellows 2017: launch webinar on Friday 9 Sep

Author: Selina Aragon
Posted: 7 Sep 2016 | 10:54

The Software Sustainability Institute's Fellowship programme funds researchers in exchange for their expertise and advice.

Find out more about the 2017 programme with the Launch Webinar this Friday 9 Sep at 3pm!

 

Data and Software Carpentry combo at Edinburgh

Author: Mario Antonioletti
Posted: 29 Aug 2016 | 10:35

Software Carpentry attendees during the shell session. Pic Credit: Martin Callaghan.

With my Software Sustainability Institute hat on, I recently participated in a back-to-back Data Carpentry and Software Carpentry course sponsored by the University's Research Data Service here at the University of Edinburgh. The courses were held in the main University library in a gorgeous room with a glass wall, providing a rather distracting view of the Meadows parkland. 

Building a scaleable, extensible data infrastructure

Author: Amy Krause
Posted: 8 Jul 2016 | 14:48

Modern genome-sequencing technologies are easily capable of producing data volumes that can swamp a genetic researcher’s existing computing infrastructure. EPCC is working with the breeding company Aviagen to build a system that allows such researchers to scale up their data infrastructures to handle these increases in volume without compromising their analytical pipelines.

Creating a safe haven for health data

Author: Donald Scobbie
Posted: 6 Jul 2016 | 14:36

Safe havens allow data from electronic records to be used to support research when it is not practicable to obtain individual patient consent while protecting patient identity and privacy. EPCC is now the operator of the new NHS National Services Scotland (NSS) national safe haven in collaboration with the Farr Institute of Health Informatics Research which provides the infrastructure. 

Large Synoptic Survey Telescope: data-intensive research in action

Author: George Beckett
Posted: 24 May 2016 | 09:49

This is an exciting time for astronomy in the UK, a fact that is reflected by our involvement and leadership of some amazingly ambitious new telescopes.

A number of recent, significant discoveries have propelled astronomy research into the spotlight. The discovery of dark matter and dark energy at the beginning of the 21st century over-turned our understanding of how the Universe works. And the first observation of a gravitational wave earlier this year confirmed Albert Einstein’s long-standing hypothesis precisely 100 years after it was first published in his general theory of relativity.

Innovative Learning Week: doing a Kaggle Competition

Author: Marc Sabate
Posted: 3 Mar 2016 | 15:31

The week of the 15-19 February an Innovative Learning Week event was held at the University of Edinburgh, where students and staff are invited to collaborate and explore their teaching and learning experience respectively in a new and creative way.

Big data, big compute

Author: Rob Baxter
Posted: 17 Dec 2015 | 10:46

Gathering data for their own sake is pointless without the analysis techniques and computing power to process them. But what techniques, and what kind of computing power? The differing nature of data-driven analysis in different fields and areas of application demands a variety of computational approaches. 

Through our current activities in big data at EPCC, we’re aiming to understand how big data and big compute can be brought together to create, well, big value.

HPC's role in Data Science

Author: Adam Carter
Posted: 12 Sep 2015 | 10:01

I was among those presenting at EPCC's recent Big Data seminars at Edinburgh BioQuarter and BioDundee. Both events provided a good opportunity for me to talk to people about their Big Data problems and their views on what Big Data means to them.

Pages