skip to primary navigationskip to content

Cambridge Service Alliance

At the forefront of service transformation in the digital era

Studying at Cambridge

 

Webinar 14 January

last modified Jan 21, 2019 11:15 AM
In this webinar, Tim Pearce discusses his paper on Bayesian Neural Network Ensembles

In this webinar, Tim Pearce presents the Alliance December 2018 paper on Bayesian Neural Network Ensembles. Ensembles of neural networks (NN) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble’s predictions is interpreted as its epistemic uncertainty. The appeal of ensembling stems from being a collection of regular NNs - this makes them both scalable and easily implementable. NN ensembles have continued to achieve strong empirical results in recent years. The departure from Bayesian methodology is of concern since the Bayesian framework provides a principled, widely-accepted approach to handling uncertainty. This paper considered a method to produce Bayesian behaviour in neural networks (NN) ensembles by leveraging randomised MAP sampling. It departs only slightly from the usual handling of NNs, with parameters regularised around values drawn from a prior distribution. We showed that for NNs of sufficient width, each produces a sample from the posterior predictive distribution. Qualitative and benchmarking experiments were encouraging. Our ongoing work considers extending the presented theory to classification tasks as well as other architectures such as convolutional NNs.

 

Filed under: ,

RSS Feed Latest news

Understanding business models in the construction sector

Nov 25, 2020

What’s standing in the way of offsite manufacturing? For decades, the construction sector has been hailing it as the next big thing but we have yet to see it really taking off. Why is that, when the technologies and processes already exist? Dr Zakaria Dakhli believes it is due to a fundamental incompatibility between business models and it is only when this has been fully understood that the long-awaited transformation can take place.

A machine learning approach to quality control

Nov 14, 2020

Most of the products we take for granted contain huge numbers of components assembled in multiple stages by different manufacturers. Quality control is vital throughout the assembly process with rigorous testing required at every step.

Digital twins: driving business model innovation

Nov 06, 2020

For B2B firms struggling to reap the rewards of digitalisation, could digital twins be the way forward? In this article, CSA's Dr Erika Pärn and colleagues from the Fraunhofer Institute and Technische Universität in Dortmund, explore the relationship between this emerging technology and business model innovation.

Making business model innovation happen: the Business Model Cohesiveness Scorecard

Oct 30, 2020

Digital transformation is failing to live up to its hype, at least as far as productivity gains are concerned. If, as research suggests, a lack of business model innovation is the main culprit, we need a way of making it happen. Dr Chander Velu thinks a balanced scorecard approach could be the answer.

2020 Annual Review

Oct 23, 2020

Read about our latest research in our tenth anniversary Annual Review.

View all news