Home
### Statistical Machine Learning Reading Group

### SML Student Workshop Summer 2016

### Previous Semesters

### SML Student Workshop Summer 2015

### Recently changed pages

Date: Wednesday, June 1

Location: 335 West Hall

Organizing Faculty: Jake Abernethy, Laura Balzano, Long Nguyen, Clay Scott, Ambuj Tewari

Time | Speaker | Title |
---|---|---|

9:15 | Welcome and Coffee | |

Session 1: Convergence and Consistency | ||

9:30 | Nhat Ho | Singularity structures and parameter estimation in finite skew normal mixtures. |

9:45 | Julian Katz-Samuels | A Mutual Contamination Analysis of Mixed Membership and Partial Label Models |

10:00 | Kevin Moon | Improving Convergence of Divergence Functional Ensemble Estimators |

10:15 | Hossein Keshavarz | Fixed domain asymptotic analysis of the inversion-free estimation for Gaussian process models |

10:30 | Break | |

Session 2: Subspace Models | ||

10:45 | David Hong | A weighted PCA method for subspace estimation from heterogeneous data |

11:00 | Kibok Lee | Towards Understanding the Invertibility of Convolutional Neural Networks |

11:15 | John Lipor | Leveraging Union of Subspace Structure to Improve Constrained Clustering |

11:30 | Lunch |

Winter 2016

Time: Mondays 3-4

Location: BBB 2733 (on north campus)

Date | Presenter | Paper | Authors | Appears In |
---|---|---|---|---|

2/1 | ||||

2/8 | Hossein | Stochastic approximation of score functions for Gaussian processes | M.L. Stein, J. Chen, and M. Anitescu | The Annals of Applied Statistics 7.2 (2013) http://arxiv.org/pdf/1312.2687.pdf |

2/15 | Aniket Deshmukh | Permutational Rademacher Complexity | Ilya Tolstikhin, Nikita Zhivotovskiy, and Gilles Blanchard | Algorithmic Learning Theory. Springer International Publishing, 2015 (http://arxiv.org/abs/1505.02910) |

2/22 | ||||

2/29 | WINTER BREAK | |||

3/7 | ||||

3/14 | Julian | ℓ1-regularized Neural Networks are Improperly Learnable in Polynomial Time | Yuchen Zhang, Jason D. Lee, Michael I. Jordan | http://arxiv.org/abs/1510.03528 |

3/21 | Aniket Deshmukh | Finite-Time Analysis of Kernelised Contextual Bandits | Michal Valko, Nathan Korda, Remi Munos, Ilias Flaounas, Nello Cristianini | http://arxiv.org/abs/1309.6869 |

3/28 | Daniel LeJeune | Optimal Rates for Random Fourier Features | Bharath K. Sriperumbudur, Zoltan Szabo | NIPS 2015 (http://arxiv.org/abs/1506.02155) |

4/4 | ||||

4/11 | ||||

4/18 | Hossein | Local likelihood estimation for nonstationary random fields | E.B. Anderes, and M.L. Stein | Journal of Multivariate Analysis (2011) http://www.stat.ucdavis.edu/~anderes/papers/LocLikeWStein.pdf |

Fall 2015

Time: Wednesdays, 12:15-1:15

Location: EECS 2311 (on north campus)

Date | Presenter | Paper | Authors | Appears In | |
---|---|---|---|---|---|

Sept 23 | Clay | The Geometry of Kernelized Spectral Clustering | Schiebinger, Wainwright, Yu | Annals of Statistics, 2015. | |

Sept 30 | Hossein | Covariance functions for mean square differentiable processes on spheres | J. Guinness and M. Fuentes | http://www.stat.ncsu.edu/information/library/papers/mimeo2652_Guinness.pdf | |

Oct 7 | Harish | Consistent Procedures for Cluster Tree Estimation and Pruning | Chaudhuri, Dasgupta, Kpotufe and Von Luxburg | IEEE Info theory, 2014 | |

Oct 14 | Efren | Learning with Algebraic Invariances and the Invariant Kernel Trick | Király, Ziehe, Müller | http://arxiv.org/abs/1411.7817 | |

Oct 21 | Rob | Nonparametric Estimation of Multi-View Latent Variable Models | Le Song, Animashree Anandkumar, Bo Dai, Bo Xie | NIPS 2014 | |

Oct 28 | Julian | Rates of Convergence for Nearest Neighbor Classification | Chaudhuri, Dasgupta | http://cseweb.ucsd.edu/~dasgupta/papers/nn-rates.pdf | |

Nov 4 | Nhat Ho | Mixture models with a prior on the number of components | Jeff Miller, Matthew Harrison | Under revision, Journal of the American Statistical Association, https://stat.duke.edu/~jwm40/publications/MFM.pdf | |

Nov 11 | Akshay Krishnamurthy | Efficient Contextual Semibandits | with Alekh Agarwal and Miro Dudik | http://arxiv.org/pdf/1502.05890.pdf I will describe a variant of the contextual bandit problem, known as contextual semibandits, where in each round the learner receives a context, plays a sequence of actions, observes a feature for each of the played actions, and observes reward that is linearly related to those features. This setting is motivated by problems in personalized search and recommendation, where many common performance metrics are linearly related to observable document-specific click information. I will describe two algorithms for this problem, one for the case where the linear transformation is known and one for the case where it is unknown. Both algorithms have low regret guarantees and can be efficiently implemented with an appropriate optimization oracle. I will present some preliminary empirical findings on these algorithms and discuss some new ongoing progress in this direction. | |

Nov 18 | Aniket | Multiple Operator-valued Kernel Learning | Hachem Kadri, Alain Rakotomamonjy, Philippe Preux, Francis R. Bach | NIPS 2012 - https://papers.nips.cc/paper/4653-multiple-operator-valued-kernel-learning | |

Nov 25 | NO MEETING | ||||

Dec 2 | Kam Chung Wong | Online Time Series Prediction with Missing Data | Oren Anava, Elad Hazan, Assaf Zeevi | http://jmlr.org/proceedings/papers/v37/anava15.html | |

Dec 9 | Mikhail Y. | K-means Clustering via Principal Component Analysis | Chris Ding, Xiaofeng He | ICML 2004 |

Date: Wednesday, June 10

Location: 335 West Hall

Organizing Faculty: Jake Abernethy, Laura Balzano, Long Nguyen, Clay Scott, Ambuj Tewari

Time | Speaker | Title |
---|---|---|

8:45 | Welcome and Coffee | |

9:00 | Faculty | Introductory Remarks |

Session 1: Convergence and Consistency | ||

9:05 | Nhat Ho | Weak identifiability and optimal convergence rate of mixing measures in over-fitted Gaussian mixture models |

9:20 | Efren Cruz Cortes | Consistency of a Fixed Bandwidth Kernel Density Estimator |

9:35 | Hossein Keshavarz | On the consistency of the inversion-free estimation of Gaussian random fields for irregularly spaced spatial data |

9:50 | Dejiao Zhang | Global Convergence of the GROUSE algorithm for subspace estimation from undersampled data |

10:05 | Break + Q&A | |

Session 2: Sparsity and Kernels | ||

10:20 | David Hong | Adaptive Dictionary Learning with Training Images for Image Formation |

10:35 | Aniket Deshmukh | Kernel Approximation for Transfer Learning |

10:50 | Pengyu Xiao | Grassmannian Online Sparse Subspace Estimation |

11:05 | Break + Q&A | |

Session 3: Mixture Models, Meta Learning, and Link Prediction | ||

11:20 | Robert Vandermeulen | Some Results on the Identifiability of Nonparametric Finite Mixture Models with Grouped Samples. |

11:35 | Bopeng Li | Handling Class Imbalance in Link Prediction using Learning to Rank Techniques |

11:50 | Kevin Moon | Meta learning of bounds on the Bayes classifier error |

12:05 | Lunch |

Winter 2015

Time: Wednesdays, 3:00-4:00

Location: 438 West Hall (on central campus)

Date | Presenter | Paper | Authors | Appears In |
---|---|---|---|---|

1/14 | ||||

1/21 | Wendy Shang | Invariant Scattering Convolution Networks | J. Bruna and S. Mallat | |

1/28 | Laura Balzano | Global Convergence of Stochastic Gradient Descent for some Nonconvex Matrix Problems | Chris De Sa, Kunle Olukotun, Chris Re | arxiv http://arxiv.org/pdf/1411.1134v2.pdf |

2/4 | ||||

2/11 | Rob | Tensor Decompositions for Learning Latent Variable Models | Anandkumar et al. | JMLR 2014 |

2/18 | Mikhail Y | Streaming Variational Bayes | Broderick et al. | NIPS 2013 |

2/25 | Sougata | From Bandits to Experts: On the Value of Side-Observations | Shie Mannor and Ohad Shamir | http://papers.nips.cc/paper/4366-from-bandits-to-experts-on-the-value-of-side-observations |

3/4 | NO MEETING | WINTER BREAK | ||

3/11 | Igor Prunster, University of Torino/ U Texas-Austin | Are Gibbs-type priors the most natural generalization of the Dirichlet process? | Joint seminar with Stats Dept | 411 West Hall (Note: non-standard location) 3-4pm |

3/18 | Nhat Ho | Variable selection for k-means quantization | Clément Levrard | Submit to the Annals of Statistics, 2015 http://arxiv.org/pdf/1406.3334v1.pdf |

3/25 | Hossein | On the consistent separation of scale and variance for Gaussian random fields | E. Anderes | Annals of Statistics, 2010, http://projecteuclid.org/euclid.aos/1266586617 |

4/1 | Hossein | Estimating deformations of isotropic Gaussian random fields on the plane | E. Anderes and S. Chatterjee | Annals of Statistics, 2009, http://projecteuclid.org/euclid.aos/1247663757 |

4/8 | Bala Rajaratnam, Standford University | Principled and Scalable Methods for Extracting multivariate dependencies in Big Data | EECS 1200 {red} | |

4/15 | Nhat Ho | Inference for Mixtures of Symmetric Distributions | David R.Hunter, Shaoli Wang, and Thomas P. Hettmansperger | Annals of Statistics, 2006, http://arxiv.org/pdf/0708.0499.pdf |

Fall 2014

Time: Wednesdays, 2:30-4:00

Location: 4246 Randall (on central campus)

Date | Presenter | Paper | Authors | Appears In |
---|---|---|---|---|

9/10 | Matus | Loss minimization and parameter estimation with heavy tails | Daniel Hsu and Sivan Sabato | ICML 2014, http://arxiv.org/abs/1307.1827 |

9/17 | NO MEETING | |||

9/24 | Nick A. | Clustering by fast search and find of density peaks | Alex Rodriguez and Alessandro Laio | Science June 2014, http://www.sciencemag.org/content/344/6191/1492.full.pdf |

10/1 | JJ | Algorithmic connections between active learning and stochastic convex optimization | Aaditya Ramdas and Aarti Singh | http://www.cs.cmu.edu/~aarti/pubs/ALT13_ARamdas.pdf |

10/8 | Sougata | Top Rank Optimization in Linear Time | Nan Li, Rong Jin, Zhi-Hua Zhou | http://nips.cc/Conferences/2014/Program/event.php?ID=4797 |

10/15 | Jun G | Rank-One Matrix Pursuit for Matrix Completion | Zheng Wang,Ming-Jun Lai,Zhaosong Lu,Wei Fan,Hasan Davulcu,Jieping Ye | http://jmlr.org/proceedings/papers/v32/wanga14.pdf#9 |

10/22 | Shivani Agarwal | Statistical Learning in Complex Prediction Spaces: What Do We Know? | 4464 East Hall (Note: non-standard location) | |

10/29 | Hossein | Asymptotic analysis of the role of spatial sampling for covariance parameter estimation of Gaussian processes | François Bachoca | Journal of Multivariate Analysis 2014, http://www.sciencedirect.com/science/article/pii/S0047259X13002571 |

11/5 | ENCC | Density Estimation in Infinite Dimensional Exponential Families | Sriperumbudur et al. | arxiv |

11/12 | Nhat Ho | Rates of convergence for the posterior distributions of mixtures of betas and adaptive nonparametric estimation of the density | Judith Rousseau | Annals of Statistics 2010, http://projecteuclid.org/download/pdfview_1/euclid.aos/1262271612 |

11/19 | Mikhail Y | Hierarchical Dirichlet Scaling Process | Dongwoo Kim, Alice Oh | ICML 2014 |

11/26 | NO MEETING: THANKSGIVING BREAK | |||

12/3 | Kamchung Wong | On Iterative Hard Thresholding Methods for High-dimensional M-Estimation | Prateek Jain, Ambuj Tewari, Purushottam Kar | NIPS2014 http://arxiv.org/pdf/1410.5137.pdf |

12/10 | Bopeng Li | Covariate Assisted Spectral Clustering | Norbert Binkiewicz, Joshua T. Vogelstein, and Karl Rohe | http://arxiv.org/pdf/1411.2158v1.pdf |

SML Student Workshop

Summer 2014

Date: Wednesday, June 25

Location: 335 West Hall

Organizing Faculty: Jake Abernethy, Laura Balzano, Long Nguyen, Clay Scott, Ambuj Tewari

Time | Presenter | Title | Appears In (if published) | Additional comments or notes |
---|---|---|---|---|

9:00 | Faculty | Introduction | ||

Session 1: Identifiability, Estimation, and Convergence | ||||

9:05 | Robert Vandermeulen | Estimation of a Measure Over Densities from Pairs of Samples | abstract | |

9:20 | Kevin Moon | Ensemble estimation of multivariate f-divergence | ISIT 2014 | abstract |

9:35 | Nhat Ho | Identifiability and Convergence Rate of Parameter Estimators in Finite Mixture Models | TBD | abstract |

9:50 | Pradeep Ranganathan | Locally-weighted Homographies for Calibration of Imaging Systems | abstract | |

10:05-10:20 | 15 minute Q&A time and break | |||

Session 2: Health and Markets | ||||

10:20 | Takanori Watanabe | Disease Prediction based on Functional Connectomes using a Scalable and Spatially-Informed Support Vector Machine | NeuroImage | abstract |

10:35 | Dae Jung | Computerized Analysis of the 12-Lead Electrocardiogram to Identify Ventricular Tachycardia Exit Sites | Heart Rhythm | abstract |

10:50 | Huitian Lei | Online Contextual Bandits with Stochastic Policy | TBD | abstract |

11:05 | Sindhu Kutty | Exponential Family Prediction Markets | EC 2014 | abstract |

11:20-11:35 | 15 minute Q&A time and break | |||

11:35-11:55 | Faculty | Discussion Panel | ||

11:55-1:20 | Lunch break | At Silvio's | ||

Session 3: Scalability, High-dimensional Statistics | ||||

1:20 | Efren Cruz | Sparse Approximation of a Kernel Mean | ICASSP 2014 | abstract |

1:35 | Sougata Chaudhuri | Perceptron-like Algorithms and Generalization Bounds in Learning to Rank | Accepted for presentation at IISA | abstract |

1:50 | John Lipor | Robust Blind Calibration via Total Least Squares | ICASSP 2014 | abstract |

2:05 | Kam Chung Wong | Estimation in High-dimensional Vector Autoregressive Models with Noisy Data | TBD | abstract |

2:20 | Yiwei Zhang | High Dimensional Covariance Matrix Estimation via the Barra Model | abstract | |

2:35-2:50 | 15 minutes Q&A time and closing remarks |

Winter 2014

Time: Tuesdays, 12-1

Location: EECS 2311 except on Jan 21 (Beyster 2733) and Feb 18 (Beyster 3725)

Date | Presenter | Paper | Authors | Appears In |
---|---|---|---|---|

1/21 | Clay | Online learning with kernels | J. Kivinen, A. J Smola, and R. C Williamson | Trans. Sig. Proc. 2010 |

1/28 | NO MEETING: INCLEMENT WEATHER | |||

2/04 | Ambuj | Learning from Crowds | Raykar et al. | JMLR 2010 |

2/11 | Nick | Mystery paper. Topic: Cluster and Manifold Regularization | under review | |

2/18 | Prateek Jain (MSR India) | Provable Alternating Minimization methods for Non-convex Optimization | Joint work with several co-authors | Non-standard location: 3725 BBB |

2/25 | Robert | A note on Fermat's problem | Harold Kuhn | Mathematical Programming 4 (1973) |

3/04 | NO MEETING: SPRING BREAK | |||

3/11 | Long | A paper under review. Topic: optimal transport | ||

3/18 | Kam | Estimation in High-dimensional Vector Autoregressive Models | Sumanta Basu and George Michailidis | Under review |

3/25 | Efren BB Cruz | New Perspectives on k-support and Cluster Norms | A. McDonald, M. Pontil and D. Stamos | arXiv (2014) |

4/01 | Tak | Randomized Nonlinear Component Analysis | D. Lopez-Paz, S. Sra, A. Smola, Z. Ghahramani, B. Schölkopf | arXiv (2014) |

4/08 | Nhat | Consistency of a recursive estimate of mixing distribution | Surya T.Todkar, Ryan Martin, and Jayanta K.Ghosh | Annals of Statistics, 2009 |

4/15 | Hossein | A new covariance inequality and applications | J. Dedecker and P. Doukhan | Stochastic Processes and their Applications, 2003 |

Fall 2013

Time: Wednesdays, 11-12

Location: EECS 2311

Date | Presenter | Paper | Authors | Appears In |
---|---|---|---|---|

9/4 | ||||

9/11 | Hossein | Detection of an anomalous cluster in a network | E. Arias-Castro, E.J. Candès and A. Durand | Annals of Statistics, 2011 |

9/18 | Laura | Rank Aggregation via Nuclear Norm Minimization | David F. Gleich, Lek-Heng Lim | ACM SIGKDD 2011 |

9/25 | Tak | Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima | Po-Ling Loh, Martin J. Wainwright | arXiv |

10/2 | Sougata | Classification Calibration Dimension for General Multiclass Losses | Harish Ramaswamy, Shivani Agarwal | NIPS 2012 |

10/9 | Clay | Sparse coding for multitask and transfer learning | Andreas Maurer, Massi Pontil, Bernardino Romera-Paredes | ICML 2013 |

10/16 | Nick | Canonical Coordinates are the Right Coordinates for Low-Rank Gauss-Gauss Detection and Estimation | Ali Pezeshki, Louis L. Scharf, Johnk Thomas, Barry D. Van Veen | Trans. on Sig. Proc. 2006 |

10/23 | Ambuj | Online Learning for Time Series Prediction Full version with proofs | O. Anava, E. Hazan, S. Mannor, O. Shamir | COLT 2013 |

10/30 | Harish | Agnostic Active Learning | M.F. Balcan, A. Beygelzeimer and J. Langford. | ICML 2006 |

11/6 | Clay | Decontamination of Mutually Contaminated Models | Gilles Blanchard and Clayton Scott | AISTATS 2014 |

11/13 | Efren Cruz Cortes | Sampling Methods for the Nystrom Method | S. Kumar, M. Mohri, A. Talwalkar | JMLR 2012 |

11/20 | Nhat Ho | Convergence of Latent Mixing Measures in Finite and Infinite Mixture Models | XuanLong Nguyen | Annals of Statistics 2013 |

11/27 | NO MEETING -- THANKSGIVING | |||

12/4 | Long | Borrowing strength in hierarchical Bayes: convergence of the Dirichlet base measure | X. Nguyen | Arxiv |

12/11 | Rob | RATES OF STRONG UNIFORM CONSISTENCY FOR MULTIVARIATE KERNEL DENSITY ESTIMATORS | Evarist Gine and Armelle Guillou | Ann. Inst. Henri Poincaré (B) |

Link to previous semesters

Changes since Jul 26, 2016 7:36 AM