skip to primary navigationskip to content

Cambridge Service Alliance

At the forefront of service transformation in the digital era

Studying at Cambridge

 

Webinar 14 January

last modified Jan 21, 2019 11:15 AM
In this webinar, Tim Pearce discusses his paper on Bayesian Neural Network Ensembles

In this webinar, Tim Pearce presents the Alliance December 2018 paper on Bayesian Neural Network Ensembles. Ensembles of neural networks (NN) have long been used to estimate predictive uncertainty; a small number of NNs are trained from different initialisations and sometimes on differing versions of the dataset. The variance of the ensemble’s predictions is interpreted as its epistemic uncertainty. The appeal of ensembling stems from being a collection of regular NNs - this makes them both scalable and easily implementable. NN ensembles have continued to achieve strong empirical results in recent years. The departure from Bayesian methodology is of concern since the Bayesian framework provides a principled, widely-accepted approach to handling uncertainty. This paper considered a method to produce Bayesian behaviour in neural networks (NN) ensembles by leveraging randomised MAP sampling. It departs only slightly from the usual handling of NNs, with parameters regularised around values drawn from a prior distribution. We showed that for NNs of sufficient width, each produces a sample from the posterior predictive distribution. Qualitative and benchmarking experiments were encouraging. Our ongoing work considers extending the presented theory to classification tasks as well as other architectures such as convolutional NNs.

 

Filed under: ,

RSS Feed Latest news

Blog | Has COVID-19 Invented the 10X Supply Chain?

Jul 06, 2020

Surendra Kancherla, Principal Architect - Digital Technologies, at CSA partner, HCL, says that COVID-19 is forcing firms to look afresh at their supply chain capabilities.

Insight | Business model innovation for digital twins in the construction sector

May 19, 2020

At the Cambridge Service Alliance's most recent Community of Interest, Dr Erika Pärn considered the development of digital twins in the construction sector: the challenges it faces and whether android operating systems could provide a useful roadmap for business model innovation.

Generate revenue from digital platforms

May 12, 2020

According to Shep Hyken: "Customers are smarter than ever because they're experiencing great service from certain brands, and those rock-star brands are setting the bar higher for everyone else." In this white paper we explore the 'customer experience paradox' and how firms can use digital platforms to overcome it.

Unlocking the secrets of customer loyalty

May 12, 2020

Customer retention plays a critical role in a firm's long-term sustainability. Until recently, however, firms have tended to rely on one-dimensional survey techniques to measure their customers' loyalty. This white paper shows how machine learning can help overcome these limitations.

Driving business model transformation

May 01, 2020

A new white paper from the Cambridge Service Alliance and HCL Technologies considers how the development of a digital thread is vital for business model transformation.

View all news