skip to primary navigationskip to content

Cambridge Service Alliance

developing new understanding and approaches to complex service systems

Studying at Cambridge

 

High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach

last modified Feb 21, 2018 10:36 AM
February Paper on High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach by Tim Pearce, Mohamed Zaki, Alexandra Brintrup, Andy Neely

[Paper]

Deep neural networks (NNs) have caused great excitement due to the step-changes in performance they have delivered in a variety of applications. However, their appeal in industry can be inhibited by an inability to quantify the uncertainty of their predictions. To take a prognostics example, a typical NN might predict that a machine will fail in 60 days. It is unclear from this point prediction whether the machine should be repaired immediately, or whether it can be run for another 59 days. However, if the NN could output a prediction interval (PI) of 45-65 days with 99% probability, timing of a repair could easily be scheduled. In this paper, we develop a method for doing exactly this - the quantification of uncertainty in deep learning using PIs. We derive a method based on the assumption that high-quality PIs should be as narrow as possible, whilst still capturing a given proportion of data. The method is general, applicable to any data-driven task where a continuous value needs to be predicted, and it is important to know the uncertainty of that prediction. Examples include the forecasting of precipitation, energy load, financial metrics, and traffic volume. The method is tested on ten real-world, open-source datasets. The proposed method is shown to outperform current state-of-the-art uncertainty quantification methods, reducing average PI width by around 10%.

RSS Feed Latest news

July Webinar by Christoph Peters on Modular Service Structures for AI Services

Jul 09, 2018

9 July 2018 - Modular Service Structures for the Successful Design of Flexible Customer Journeys for AI Services and Business Models - by Christoph Peters and Mohamed Zaki.

July Community of Interest Meeting

Jul 04, 2018

In collaboration with our Industrial Partners, the July Community of Interest Meeting (CoI) took place at Perkins, in Peterborough. The focus of this year events is on 'How companies can strategically design, pilot and experiment digital services in the new digital age?’

Mohamed Zaki won the Emerald Literati Award

Jul 03, 2018

Mohamed's and co-authors paper "The interplay of customer experience and commitment" published in the Journal of Services Marketing has been selected by the Emerald Editorial Team as Highly Commended in the 2018 Emerald Literati Awards

2nd Customer Management Leadership Group Academic-Practitioner Workshop

Jun 26, 2018

Dr Mohamed Zaki was invited to participate in the 2nd Customer management Leadership Group Academic-Practitioner Workshop on 17-19 June at the University of Manchester.

June paper on 'Modular Service Structures for the Successful Design of Flexible Customer Journeys for AI Services and Business Models – Orchestration and Interplay of Services'

Jun 26, 2018

June paper on 'Modular Service Structures for the Successful Design of Flexible Customer Journeys for AI Services and Business Models – Orchestration and Interplay of Services'

View all news

Upcoming events

Industry Day - 3 October 2018

Oct 03, 2018

Moller Centre, Cambridge

Shift to Services Executive Education Programme

Nov 07, 2018

IfM, Cambridge, UK

Ecosystems Strategy One Day Course

Nov 15, 2018

IfM, Cambridge

Upcoming events