skip to primary navigationskip to content

Cambridge Service Alliance

At the forefront of service transformation in the digital era

Studying at Cambridge

 

Neural Networks for the quantification of predictive uncertainty

last modified May 30, 2018 07:42 PM
Tim Pearce will be attending the 35th International Conference on Machine Learning (ICML 2018). Tim is also attending a workshop, part of the conference, and presenting his work on 'Bayesian Inference with Anchored Ensembles of Neural Networks, and Application to Reinforcement Learning'.

Tim will be attending the 35th International Conference on Machine Learning (ICML 2018) and presenting his work on 'Bayesian Inference with Anchored Ensembles of Neural Networks, and Application to Reinforcement Learning'. The use of ensembles of neural networks (NNs) for the quantification of predictive uncertainty is widespread. However, the current justification is intuitive rather than analytical. This work proposes one minor modification to the normal ensembling methodology, which we prove allows the ensemble to perform Bayesian inference, hence converging to the corresponding Gaussian Process as both the total number of NNs, and the size of each, tend to infinity. This working paper provides early-stage results in a reinforcement learning setting, analysing the practicality of the technique for an ensemble of small, finite number. Using the uncertainty estimates they produce to govern the exploration-exploitation process results in steadier, more stable learning.

RSS Feed Latest news

Industry Day 2020 | What we learnt

Dec 06, 2020

What is the future of services in the new pandemic-driven era? This was the topic explored at our 2020 Industry Day by senior executives from L'Oréal, Microsoft Research, Manchester United and start-up, Fairjungle.

Understanding business models in the construction sector

Nov 25, 2020

What’s standing in the way of offsite manufacturing? For decades, the construction sector has been hailing it as the next big thing but we have yet to see it really taking off. Why is that, when the technologies and processes already exist? Dr Zakaria Dakhli believes it is due to a fundamental incompatibility between business models and it is only when this has been fully understood that the long-awaited transformation can take place.

A machine learning approach to quality control

Nov 14, 2020

Most of the products we take for granted contain huge numbers of components assembled in multiple stages by different manufacturers. Quality control is vital throughout the assembly process with rigorous testing required at every step.

Digital twins: driving business model innovation

Nov 06, 2020

For B2B firms struggling to reap the rewards of digitalisation, could digital twins be the way forward? In this article, CSA's Dr Erika Pärn and colleagues from the Fraunhofer Institute and Technische Universität in Dortmund, explore the relationship between this emerging technology and business model innovation.

Making business model innovation happen: the Business Model Cohesiveness Scorecard

Oct 30, 2020

Digital transformation is failing to live up to its hype, at least as far as productivity gains are concerned. If, as research suggests, a lack of business model innovation is the main culprit, we need a way of making it happen. Dr Chander Velu thinks a balanced scorecard approach could be the answer.

View all news