Learning And Enforcing Diversity With Determinantal Point Processes
Download and Read Learning And Enforcing Diversity With Determinantal Point Processes full books in PDF, ePUB, and Kindle. Read online free Learning And Enforcing Diversity With Determinantal Point Processes ebook anywhere anytime directly on your device. We cannot guarantee that every ebooks is available!
Learning and Enforcing Diversity with Determinantal Point Processes
Author | : Zelda Elaine Mariet |
Publisher | : |
Total Pages | : 66 |
Release | : 2016 |
Genre | : |
ISBN | : |
Download Learning and Enforcing Diversity with Determinantal Point Processes Book in PDF, Epub and Kindle
As machine-learning techniques continue to require more data and become increasingly memory-heavy, being able to choose a subset of relevant, high-quality and diverse elements among large amounts of redundant or noisy data and parameters has become an important concern. Here, we approach this problem using Determinantal Point Processes (DPPs), probabilistic models that provide an intuitive and powerful way of balancing quality and diversity in sets of items. We introduce a novel, fixed-point algorithm for estimating the maximum likelihood parameters of a DPP, provide proof of convergence and discuss generalizations of this technique. We then apply DPPs to the difficult problem of detecting and eliminating redundancy in fully-connected layers of neural networks. By placing a DPP over a layer, we are able to sample a subset of neurons that perform non-overlapping computations and merge all other neurons of the layer into the previous diverse subset. This allows us to significantly reduce the size of the neural network while simultaneously maintaining a good performance.