Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
Last revision Both sides next revision
active_learning [2017/11/15 19:58]
admin
active_learning [2018/03/15 11:26]
admin
Line 41: Line 41:
  
 . In this paper, we present a new online deep learning framework that attempts to tackle the challenges by learning DNN models of adaptive depth from a sequence of training data in an online learning setting. In particular, we propose a novel Hedge Backpropagation (HBP) method for online updating the parameters of DNN effectively,​ and validate the efficacy of our method on large-scale data sets, including both stationary and concept drifting scenarios. . In this paper, we present a new online deep learning framework that attempts to tackle the challenges by learning DNN models of adaptive depth from a sequence of training data in an online learning setting. In particular, we propose a novel Hedge Backpropagation (HBP) method for online updating the parameters of DNN effectively,​ and validate the efficacy of our method on large-scale data sets, including both stationary and concept drifting scenarios.
 +
 +https://​arxiv.org/​abs/​1801.08230 Deep Interactive Evolution
 +
 +https://​arxiv.org/​abs/​1802.04877 Learning via social awareness: improving sketch representations with facial feedback
 +
 +
 + This paper argues that such research has overlooked an important and useful intrinsic motivator: social interaction. We posit that making an AI agent aware of implicit social feedback from humans can allow for faster learning of more generalizable and useful representations,​ and could potentially impact AI safety. We collect social feedback in the form of facial expression reactions to samples from Sketch RNN, an LSTM-based variational autoencoder (VAE) designed to produce sketch drawings. We use a Latent Constraints GAN (LC-GAN) to learn from the facial feedback of a small group of viewers, and then show in an independent evaluation with 76 users that this model produced sketches that lead to significantly more positive facial expressions. Thus, we establish that implicit social feedback can improve the output of a deep learning model.
 +
 +https://​arxiv.org/​pdf/​1802.07427.pdf Active Learning with Partial Feedback
 +
 +https://​arxiv.org/​abs/​1708.00489v3 Active Learning for Convolutional Neural Networks: A Core-Set Approach
 +
 +Our empirical study suggests that many of the active learning heuristics in the literature are not effective when applied to CNNs in batch setting. Inspired by these limitations,​ we define the problem of active learning as core-set selection, ie. choosing set of points such that a model learned over the selected subset is competitive for the remaining data points. We further present a theoretical result characterizing the performance of any selected subset using the geometry of the datapoints. As an active learning algorithm, we choose the subset which is expected to yield best result according to our characterization. Our experiments show that the proposed method significantly outperforms existing approaches in image classification experiments by a large margin.
 +