XDesign/Road Intelligence ltd
Edinburgh mobile app firm XDesign engineer software for the most powerful computing devices people own – their smartphones. Their spinoff Road Intelligence has developed an app to gather and store sensor data from smartphones in moving vehicles. One of the greatest challenges is not in creating an app to record data but in creating an operational back-end that can scale to many data streams from many devices. EPCC worked with XDesign to help design and implement scalable data collection infrastructure on Amazon’s AWS platform. We developed a “two-headed” data workflow, using core building blocks for streaming data applications – AWS Lambda, API Gateway, DynamoDB – and a Spark and HDFS-based Elastic MapReduce platform for onward analysis. While the AWS toolkit is functionally very impressive, effective performance for both data gathering and data analysis still needs careful design and technical finesse.