1

Unbalanced Sobolev Descent

We introduce Unbalanced Sobolev Descent (USD), a particle descent algorithm for transporting a high dimensional source distribution to a target distribution that does not necessarily have the same mass. We define the Sobolev-Fisher discrepancy …

Wasserstein Style Transfer

We propose Gaussian optimal transport for image style transfer in an Encoder/Decoder framework. Optimal transport for Gaussian measures has closed forms Monge mappings from source to target distrib...

Improving Efficiency in Large-Scale Decentralized Distributed Training

Decentralized Parallel SGD (D-PSGD) and its asynchronous variant Asynchronous Parallel SGD (AD-PSGD) is a family of distributed learning algorithms that have been demonstrated to perform well for large-scale deep learning tasks. One drawback of …

Nano-Material Configuration Design with Deep Surrogate Langevin Dynamics

We propose surrogate-based constrained Langevin sampling for nano-material design under constraints specified by differential equations.

Towards Better Understanding of Adaptive Gradient Algorithms in Generative Adversarial Nets

This paper provides novel analysis of adaptive gradient algorithms for solving non-convex non-concave min-max problems as GANs, and explains the reason why adaptive gradient methods outperform its...

Adversarial Semantic Alignment for Improved Image Captions

In this paper we study image captioning as a conditional GAN training, proposing both a context-aware LSTM captioner and co-attentive discriminator, which enforces semantic alignment between images and captions. We empirically focus on the viability …

Sobolev Descent

We study a simplification of GAN training: the problem of transporting particles from a source to a target distribution. Starting from the Sobolev GAN critic, part of the gradient regularized GAN ...

Learning Implicit Generative Models by Matching Perceptual Features

Wasserstein Barycenter Model Ensembling

we propose to use Wasserstein barycenters for semantic model ensembling

Exploring ROI size in deep learning based lipreading

Automatic speechreading systems have increasingly exploited deep learning advances, resulting in dramatic gains over traditional methods. State-of-the-art systems typically employ convolutional neural networks (CNNs), operating on a video …