Guest blogger's blog

Accelerating high performance data pipelines using EPCC's supercomputing facilities

Author: Guest blogger
Posted: 15 Jun 2021 | 12:26

illuminate logoIlluminate, a commercial collaborator of EPCC, has a mission to accelerate informed decisions by providing their customers with the means to find specific needle in a haystack data points from the mass of their network traffic. As networks evolve, they are continuously innovating to ensure that their data pipelines operate at maximum efficiency.

Data analytics pipelines have three main functions: data ingestion, processing, and analysis. The data ingestion stage focuses on obtaining or extracting data from a range of data sources and importing it into systems that can enable processing and analysis. This is followed by data processing to validate, transform and enrich it, and load it into some form of queryable data storage, such as a data lake. Finally, we utilise Artificial Intelligence/Machine Learning processes to build models from the data in the lake and use them to gain insight.


Novel ammonia-hydrogen sulphide mixtures under extreme conditions: Implications for Ice-giant planets

Author: Guest blogger
Posted: 12 Feb 2021 | 13:14

Sudip Kumar Mondal from Jadavpur University in Kolkata visited the University of Edinburgh through the HPC-Europa3 Transnational Access programme. Falling from 11 October to 29 January, Sudip's visit was unlike most others because the Covid pandemic was ongoing. In this blog post Sudip describes his experiences in coming to and working in Edinburgh.

My doctoral research focuses on the physical behaviour of naturally occurring mineral phases at high temperature and pressure conditions by employing quantum chemical simulations which are hard to realize through experiments at the laboratory. Dr Andreas Hermann, my supervisor at the University of Edinburgh, was undoubtedly perfect for supervising this project, being an expert on materials at extreme conditions.

EPCC’s Advanced Computing Facility: how it all began

Author: Guest blogger
Posted: 29 Jan 2021 | 11:03

EPCC's Advanced Computing Facility (ACF) was born through necessity – but the opportunity was taken to create an expandable and highly-efficient facility that attracted future business including national computing services. Mike Brown, EPCC’s Director of HPC Operations until 2017, gives an overview of the development of this unique building.

A researcher's perspective on working with the Software Sustainability Institute

Author: Guest blogger
Posted: 11 Dec 2020 | 08:50

By Edward Wallace, School of Biological Sciences, University of Edinburgh.

Why I need sustainable software for my research

I run a lab, or research group, in the School of Biological Sciences at Edinburgh. My group  is funded by the Wellcome Trust, the Royal Society and BBSRC. We're interested in questions about how cells decide which proteins to make and when. Also, how cells change which proteins they make when they learn something from the environment and need to change what they're doing. In the 21st century we collect some very large datasets to measure this. There are datasets based on sequencing the RNA, which encodes protein, and datasets that measure all the proteins in cells at the same time. These datasets are measuring thousands of different things in many samples, often dozens of samples. Each dataset is gigabytes in size, and so it's quite hard work to dig into them and get the simplest and most relevant answers about what cells are doing.

Modelling triple stellar interactions during a pandemic

Author: Guest blogger
Posted: 8 Dec 2020 | 10:46

Alexey Bobrick (Lund UniversitySpirit of 2020. My host and me, on one of the top floors in Birmingham University.(link is external), Sweden) was an HPC-Europa3 visitor hosted by Dr Silvia Toonen (link is external)at the Institute of Gravitational Wave Astronomy(link is external), University of Birmingham, UK. Because of COVID-19 restrictions, Alexey's visit has been split between his time in Birmingham (from 1–23 November), and working remotely from Sweden until 23 December. In this post Alexey tells us about his trip to Birmingham.

I study binary stellar astrophysics at Lund University, Sweden. In Birmingham my host, Dr Silvia Toonen, is one of the leading experts in triple and binary stellar evolution. I arrived at my accommodation in the middle of the autumnal Edgbaston Park area next to Birmingham University, and next morning I met my host. She kindly showed me around the campus and introduced me to her colleagues. The image shows me and my host, on one of the top floors in Birmingham University.  We then launched into many science discussions, which continued in the following weeks, together with meetings, work, calculations and more discussions.

Optimising sparse-matrix vector multiplication on Intel Xeon Gold processors

Author: Guest blogger
Posted: 24 Aug 2020 | 18:11

Edoardo Coronado visited EPCC from 18th May–15th August 2019 under the HPC-Europa3(link is external) programme. Here he gives us an update on his research since his previous blog article.

During my visit to EPCC in 2019 under the auspices of the HPC-Europa3 programme, I worked on optimising routines to perform the Sparse Matrix-Vector (SpMV) product, a common operation in lots of scientific applications, on Intel Xeon Gold processors and Graphics Processing Units (GPUs).

ePython: can we have our cake and eat it?

Author: Guest blogger
Posted: 17 Aug 2020 | 15:02

Maurice Jamieson is a third-year PhD student at the EPCC working on the programmability of micro-core architectures, both in terms of design and implementation, through the development of the ePython programming language.

We recently published a paper at the Scientific Computing with Python (SciPy) 2020 conference that outlined the latest developments to ePython, a version of Python specifically written to leverage micro-core architectures. The paper provides a detailed discussion of the design and implementation of ePython, touching on the latest updates to manage arbitrary large data sets and native code generation. This post will summarise key elements of the paper.

The Global Open Finance Centre of Excellence: delivering innovation and public benefit

Author: Guest blogger
Posted: 5 Aug 2020 | 14:38

In June, a unique collaboration between the University of Edinburgh, the Financial Data and Technology Association, and Fintech Scotland was awarded £22.5m from UK Government to harness financial data for societal and economic benefit. The Global Open Finance Centre of Excellence (GOFCoE) will be an independent collaboration between governments and regulators, the financial services, industry and academia. 

Service Portal for engineering excellence launched

Author: Guest blogger
Posted: 4 Aug 2020 | 16:06

EPCC is a partner in the EXCELLERAT programme, which brings together key players from industry, research and HPC to provide services that will enable the European engineering industry to advance towards Exascale technologies.

There are great opportunities for engineering applications in exploiting Exascale computing. EXCELLERAT brings together expertise in HPC and engineering software to support the development of applications that can exploit computing capability at this level. 

Research Data Scotland's response to COVID-19

Author: Guest blogger
Posted: 2 Jun 2020 | 13:44

The COVID19 research data service, which EPCC helped build, will bring together expertise, resource and capabilities from a range of programmes across the public sector. Roger Halliday, Chief Statistician and Data Officer for the Scottish Government, explains how it will support Scotland's response to the pandemic.

I want to share an update on how Research Data Scotland (RDS) is supporting the national response to COVID-19.

RDS’s mission remains to improve the economic, social and environmental wellbeing in Scotland by enabling access to and linkage of data about people, places and businesses for research in the public good.


Blog Archive