IDSIA

Academic research and selected publications

A complete collection of my research works is available from Google Scholar, ArXiv and SSRN.

A common thread in my academic research has been the combination of techniques from reproducing kernel and approximation theory to investigate the behavior of large systems. My contributions in this area range from purely mathematical studies in system stability and interpolation theory to applications in numerical analysis, the convergence of quantum algorithms and the stability of quantum memories. In recent years deep reinforcement learning (i.e. the combination of reinforcement learning with flexible function approximators) emerged as a new tenet of my research interest.

Here is a list of selected publications sorted according to their level of application with some descriptions.

Pure Mathematics

The below articles illustrate a typical line of my research in pure mathematics. Targeting the construction of matrices whose inverses grow "as fast as possible" (more precisely Schäffer's conjecture, a problem suggested to R. Zarouf and myself by N. Nikolski), we found that an explicit construction could be achieved using relatively standard tools from reproducing kernel Hilbert space (RKHS) theory. Until then the state-of-the-art method by J. Bourgain has been to relate the problem to power sums, while our method is duality/optimization-based. The implementation of our approach required precise asymptotic expansions for the Taylor coefficients of powers of a Blaschke factor, which we derived using new tools from approximation theory.

The new asymptotic formulas allowed us to identify the lp-norms of their Taylor coefficients and to answer questions about their asymptotic behavior raised by H. Queffelec in 1995 (see page 86, questions 3,4,5 here) in a separate publication. During our work we identified previously unknown forms of asymptotic behavior of Jacobi polynomials and showed that part of the literature on this topic must be revised. Our findings have applications in the study of the Dyson Brownian motion and quantum chaos, see the beautiful article by Peter Forrester, Mario Kieburg, Shi-Hao Li and Jiyuan Zhang.

Applied Mathematics

Quantum Computing

My doctoral studies focused on "numerical aspects" of models for quantum memories and computation. To analyze error stability and convergence of computation models I took inspiration from RKHS techniques in contemporary numerical analysis and transferred them to the area of quantum computation. The following articles illustrate the application of functional calculi (see this work of N. Nikolski) and "analytic programs" (see this work of N. Young) in quantum computing.

Matrix condition numbers and numerical stability

As a byproduct I obtained the strongest spectral resolvent (a key concept in numerical analysis) estimates, improving previous estimates of B.Davies and B.Simon and also the respective estimates by N. Nikolski.

Quantum Information Theory

My work contributed to the introduction of a highly successful entropy measure. My contribution has been to identify the relevant technical framework and to prove data processing inequalities for the new entropy together with F. Dupuis. The form of the new entropic quantity has been the work of M. Tomamichel.

Applied Works

The tremendous success of deep reinforcement learning (deep RL) raised my research interest in learning systems and games. I am leading a research unit at IDSIA that focuses on reinforcement learning and games/ game theory. Currently we are mostly interested in the analysis and implementation of modern deep RL systems, particularly Deepmind's AlphaZero, AlphaStar, MuZero, etc. systems. Developed to tackle combinatorial games likes Chess and Go (AlphaZero) and real-time games like Starcraft (AlphaStar), those algorithms proved successful in a wide variety of planning problems.

It is a common interpretation (originating from a seminal book of G. Shafer and V. Vovk) to view Finance as a "game with the world". Following this interpretation we are particularly interested in the application of game-playing AI in finance.

Machine Learning in Finance

Computer games and bots