skip to primary navigationskip to content

Cambridge Service Alliance

developing new understanding and approaches to complex service systems

Studying at Cambridge

 

High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach

last modified Feb 21, 2018 10:36 AM
February Paper on High-Quality Prediction Intervals for Deep Learning: A Distribution-Free, Ensembled Approach by Tim Pearce, Mohamed Zaki, Alexandra Brintrup, Andy Neely

[Paper]

Deep neural networks (NNs) have caused great excitement due to the step-changes in performance they have delivered in a variety of applications. However, their appeal in industry can be inhibited by an inability to quantify the uncertainty of their predictions. To take a prognostics example, a typical NN might predict that a machine will fail in 60 days. It is unclear from this point prediction whether the machine should be repaired immediately, or whether it can be run for another 59 days. However, if the NN could output a prediction interval (PI) of 45-65 days with 99% probability, timing of a repair could easily be scheduled. In this paper, we develop a method for doing exactly this - the quantification of uncertainty in deep learning using PIs. We derive a method based on the assumption that high-quality PIs should be as narrow as possible, whilst still capturing a given proportion of data. The method is general, applicable to any data-driven task where a continuous value needs to be predicted, and it is important to know the uncertainty of that prediction. Examples include the forecasting of precipitation, energy load, financial metrics, and traffic volume. The method is tested on ten real-world, open-source datasets. The proposed method is shown to outperform current state-of-the-art uncertainty quantification methods, reducing average PI width by around 10%.

RSS Feed Latest news

Webinar - Service Network and Service Matching

May 14, 2018

Our May Webinar on 'A Service Network Perspective to Evaluate Service Matching in Early Design' by Federico Barravecchia

Caterpillar Parts and Service Operations Summit

Apr 30, 2018

Dr Mohamed Zaki delivered a presentation on ‘Service Innovation in the Digital Era’ in the Caterpillar Parts and Service Operations Summit organised last week in Dubai

Facilitating Co-creation in Living Labs

Apr 27, 2018

On 20th April, Katharina Greve delivered a presentation on ‘Facilitating Co-creation in Living Labs’ at Carlo Cattaneo University (LIUC) in Castellanza, Italy.

Cambridge Service Alliance hosts the Service Community Event

Apr 27, 2018

The Cambridge Service Alliance hosted the 'Service Community Event' on the 19th April, where service professionals shared their experiences on a wide range of service topics.

How Can Hackathons Accelerate Corporate Innovation?

Apr 25, 2018

April paper on 'How Can Hackathons Accelerate Corporate Innovation?' by Myrna Flores, Matic Golob, Doroteja Maklin, Martin Herrera, Christopher Tucci, Ahmed Al-Ashaab, Leon Williams, Adriana Encinas, Veronica Martinez, Mohamed Zaki, Lourdes Sosa & Karina Flores Pineda

View all news

Upcoming events

Shift to Services Executive Education Programme

Nov 07, 2018

IfM, Cambridge, UK

Ecosystems Strategy One Day Course

Nov 15, 2018

IfM, Cambridge

Upcoming events