Posted: 27 Jun 2019 | 10:06
The DARE project is addressing the challenges of combining extreme data, extreme computation and extreme complexity in scientific research.
Virtually every scientific domain is experiencing an increase in the volume of data it produces, with growing computational power enabling more complex simulations. Although comparing these simulations with observation can improve models and understanding, it is highly data-intensive.
Posted: 6 Jun 2019 | 14:34
The highly successful NEXTGenIO project is now drawing to a close after nearly four years. EPCC colleagues will be at ISC19 presenting the results of the project at a booth presentation, a BoF, and a workshop presentation. Come along and find out more!
Posted: 28 Apr 2019 | 16:07
One of the benefits of teaching a Carpentry course is that it can increase or deepen your understanding of a subject. A recent instance for me was in using OpenRefine, a tool that runs locally on your machine (you do not have to export your data to a third party service).
OpenRefine can help you:
• Explore and clean/transform your data. You can reconcile your data with other external data sources, i.e. enrich your data using external data
• Create a new dataset. It does not modify your original data and keeps provenance of all the steps. Depending on the capabilities of your local machine it can deal with data sets that are up to about 100k rows.
Watch the videos on the OpenRefine website for a good overview. If you want to know more, follow the Carpentry OpenRefine for Ecologists lesson. In this example, I am going to show how easy is to generate a new dataset from the EPCC website. Follow along after you have installed OpenRefine on your system.
Posted: 4 Mar 2019 | 09:42
In our role as members of the Research Engineering Group of the Alan Turing Institute, Anna Roubickova and I worked with Efi Tsamoura and Benjamin Spencer (Department of Computer Science at the University of Oxford) on PDQ, a proof-driven query planner that has great potential within the realm of data science for medical research.
Posted: 25 Jan 2019 | 13:31
Posted: 13 Dec 2018 | 16:34
EPCC has received funding via the Economic and Social Research Council (ESRC) to continue its work with the Scottish Administrative Data Research Partnership (S-ADRP).
The aim of the partnership is to enable research that leads to policy decisions that will in turn will help Scotland progress towards the vision outlined in the National Performance Framework. This framework helps to shape high level research priorities for Scottish Government, including tackling poverty, providing quality jobs and fair work for all, and ensuring that we live in inclusive, empowered, resilient and safe communities. S-ADRP consists of a number of Strategic Impact Programmes (SIPs) each dealing with a research priority.
Posted: 10 Dec 2018 | 10:59
By Raniere Silva, Community Officer at the Software Sustainability Institute.
The Software Sustainability Institute is pleased to announce applications to our Fellowship Programme 2019 are now open. Below we detail the application process and what to expect from us during the recruitment and post-recruitment stages.
Posted: 6 Dec 2018 | 16:12
In February EPCC will host an event to explain why data driven innovation is important for industry. We will also showcase how companies are already using data technologies to enhance commercial performance.
There is a lot of hype around big data and big computing for business, but it is undeniable that the influence of data-driven innovation will be profound.
The expertise and support available in Scotland has created a massive opportunity for our engineering and manufacturing sectors and, with the launch of the £500m Data-Driven Innovation (DDI) strand of the Edinburgh and South-East Scotland City Region Deal, this is an exciting time for exploring how technology can benefit business.
Posted: 15 Nov 2018 | 16:21
With jobs submitted to a batch system, supercomputing has traditionally been centred around an offline, non-interactive approach to running codes such as simulations. However, it is our belief that there is great potential in fusing HPC with real-time data for use as part of urgent decision-making processes in response to natural disasters and crises.
Posted: 11 Oct 2018 | 14:52
During the last six months, in our role as members of the Research Engineering Group of the Alan Turing Institute, we have been working with Melissa Terras, University of Edinburgh's College of Arts, Humanities and Social Sciences (CAHSS), and Raquel Alegre, Research IT Services, University College London (UCL), to explore text analysis of humanities data. This work was funded by Scottish Enterprise as part of the Alan Turing Institute-Scottish Enterprise Data Engineering Programme.