skip to primary navigationskip to content

Cambridge Service Alliance

developing new understanding and approaches to complex service systems

Studying at Cambridge

 

Webinar 14 January

last modified Jan 21, 2019 11:15 AM
In this webinar, Tim Pearce discusses his paper on Bayesian Neural Network Ensembles

In this webinar, Tim Pearce presents the Alliance December 2018 paper on Bayesian Neural Network Ensembles. Ensembles of neural networks (NN) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble’s predictions is interpreted as its epistemic uncertainty. The appeal of ensembling stems from being a collection of regular NNs - this makes them both scalable and easily implementable. NN ensembles have continued to achieve strong empirical results in recent years. The departure from Bayesian methodology is of concern since the Bayesian framework provides a principled, widely-accepted approach to handling uncertainty. This paper considered a method to produce Bayesian behaviour in neural networks (NN) ensembles by leveraging randomised MAP sampling. It departs only slightly from the usual handling of NNs, with parameters regularised around values drawn from a prior distribution. We showed that for NNs of sufficient width, each produces a sample from the posterior predictive distribution. Qualitative and benchmarking experiments were encouraging. Our ongoing work considers extending the presented theory to classification tasks as well as other architectures such as convolutional NNs.

 

Filed under: ,

RSS Feed Latest news

February 2019 Webinar - Business Ecosystems Mapping

Feb 12, 2019

In this webinar, Florian presents the Alliance January 2019 paper on Business Ecosystems Mapping.

January 2019 Paper

Jan 21, 2019

January 2019 paper on 'Using Business Ecosystems Mapping to Generate new Competitive Value Propositions'

Webinar 14 January

Jan 16, 2019

In this webinar, Tim Pearce discusses his paper on Bayesian Neural Network Ensembles

December 2018 Paper

Dec 19, 2018

December 2018 Paper on 'Bayesian Neural Network Ensembles'

Webinar 10 December 2018

Dec 14, 2018

Webinar on Service Business Model Innovation: The Digital Twin Technology by Veronica Martinez, Audrey Ouyang, Andy Neely, Caroline Burstall and Dav Bisessar

View all news

Upcoming events

Shift to Services Executive Education Programme

May 14, 2019

IfM, Cambridge, UK

Upcoming events