Big Data

Investigating high-performance data engineering

Author: Rob Baxter
Posted: 8 Jan 2018 | 16:03

Big data has always been a part of high-performance computing and the science it supports, but new open-source technologies are now being applied to a wider range of scientific and business problems. We’ve spent time recently testing some of the big data toolkits.

Making Scotland's medical images available for research

Author: Ally Hume
Posted: 20 Dec 2017 | 13:37

I've worked on many data analysis projects in my career and two common themes are that obtaining the data can be a  significant challenge and that once you obtain it you’ll notice it is very messy.

More SMEs getting into SHAPE on the French Riviera

Author: Paul Graham
Posted: 7 Dec 2016 | 13:37

SHAPE is a pan-European programme that promotes high performance computing adoption by SMEs (small to medium sized enterprises), and is supported as part of the PRACE initiative. So far SHAPE has helped 29 companies benefit from HPC.

Creating a safe haven for health data

Author: Donald Scobbie
Posted: 6 Jul 2016 | 14:36

Safe havens allow data from electronic records to be used to support research when it is not practicable to obtain individual patient consent while protecting patient identity and privacy. EPCC is now the operator of the new NHS National Services Scotland (NSS) national safe haven in collaboration with the Farr Institute of Health Informatics Research which provides the infrastructure. 

Large Synoptic Survey Telescope: data-intensive research in action

Author: George Beckett
Posted: 24 May 2016 | 09:49

This is an exciting time for astronomy in the UK, a fact that is reflected by our involvement and leadership of some amazingly ambitious new telescopes.

A number of recent, significant discoveries have propelled astronomy research into the spotlight. The discovery of dark matter and dark energy at the beginning of the 21st century over-turned our understanding of how the Universe works. And the first observation of a gravitational wave earlier this year confirmed Albert Einstein’s long-standing hypothesis precisely 100 years after it was first published in his general theory of relativity.

Big data, big compute

Author: Rob Baxter
Posted: 17 Dec 2015 | 10:46

Gathering data for their own sake is pointless without the analysis techniques and computing power to process them. But what techniques, and what kind of computing power? The differing nature of data-driven analysis in different fields and areas of application demands a variety of computational approaches. 

Through our current activities in big data at EPCC, we’re aiming to understand how big data and big compute can be brought together to create, well, big value.

EPCC Roadshow: Big Data and HPC for Life Sciences and Healthcare

Author: George Graham
Posted: 16 Sep 2015 | 15:40

During August and September we ran a series of seminar events across Scotland, in collaboration with three major actors in the Scottish life science sector: BioCity, BioQuarter and BioDundee. 

If you weren’t lucky enough to come to one of our seminars (and the complementary lunch) on the application of HPC and Big Data in life sciences then you might want to catch up by reading the associated case study.

HPC's role in Data Science

Author: Adam Carter
Posted: 12 Sep 2015 | 10:01

I was among those presenting at EPCC's recent Big Data seminars at Edinburgh BioQuarter and BioDundee. Both events provided a good opportunity for me to talk to people about their Big Data problems and their views on what Big Data means to them.

Big Data: What's wrong with HPC?

Author: Adrian Jackson
Posted: 3 Sep 2015 | 17:55

Big Data vs HPC

Whilst I was writing my talk for last week's How to Make Big Data work for your business seminar at Edinburgh BioQuarter, it occurred to me that the way computational simulation codes have evolved over the last 40 years has really been a response to big data issues. 

Software for the Future

Author: Adrian Jackson
Posted: 7 Jan 2015 | 10:18

Reconstructed neuronal connections in the brain Credit: Thomas Schultz - CC BY-SABig-Data compressive sensing: fast, parallelised and distributed algorithms

EPCC is excited to be part of a new project, funded through EPSRC's Software for the Future programme, to develop and exploit compressive-sensing algorithms for large-scale data problems.

Pages