My research efforts are directed towards a blend of both applied and pure functional analysis with an emphasis on operator theory and function spaces. My work is often cross disciplinary in nature and overlaps heavily with physics and engineering. In addition to my ongoing work in operator theory, I am focused on the development of novel and robust approaches to learning theory in dynamical systems and applications of category theory to quantum probability theory.

Recent Talks


Occupation Kernels and Densely Defined Liouville Operators for System Identification

Joel A. Rosenfeld; Rushikesh Kamalapurkar; Benjamin Russo; Taylor T. Johnson

2019 IEEE 58th Conference on Decision and Control (CDC)

This manuscript introduces the concept of Liouville operators and occupation kernels over reproducing kernel Hilbert spaces (RKHSs). The combination of these two concepts allow for the embedding of a dynamical system into a RKHS, where function theoretic tools may be leveraged for the examination of such systems. These tools are then turned toward the problem of system identification where an inner product formula is developed to provide constraints on the parameters in a system identification setting. This system identification routine is validated through several numerical experiments, where each experiment examines various contributions to the parameter identification error via numerical integration methods and parameters for the kernel functions themselves.

The Mittag Leffler Reproducing Kernel Hilbert Spaces of Entire and Analytic Functions

Joel Rosenfeld, Benjamin Russo, and Warren E. Dixon

Published in Journal of Mathematical Analysis and Applications, Volume 463, Issue 2, 15 July 2018, Pages 576-592

This paper investigates the function theoretic properties of two reproducing kernel functions based on the Mittag-Leffler function that are related through a composition. Both spaces provide one parameter generalizations of the traditional Bargmann-Fock space. In particular, the Mittag-Leffler space of entire functions yields many similar properties to the Bargmann-Fock space, and several results are demonstrated involving zero sets and growth rates. The second generalization, the Mittag-Leffler space of the slitted plane, is a reproducing kernel Hilbert space (RKHS) of functions for which Caputo fractional differentiation and multiplication by $z^q$ (for $q>0$) are densely defined adjoints of one another.

Lifting Commuting 3-Isometric Tuples

Published in Operators and Matrices, 2017, Volume 11, Number 2, pp 397–433

An operator $T$ is called a $3$-isometry if there exist operators $B_1(T^*,T)$ and $B_2(T^*,T)$ such that $$Q(n) = T^{*n}T^{n} = 1 + nB_1(T^*,T)+n^2B_2(T^*,T)$$ for all natural numbers $n$. An operator $J$ is a Jordan operator of order $2$ if $J=U+N$ where $U$ is unitary, $N$ is nilpotent order $2$, and $U$ and $N$ commute. An easy computation shows that $J$ is a $3$-isometry and that the restrictions of $J$ to an invariant subspace is also a $3$-isometry. Those $3$-isometries which are the restriction of a Jordan operator to an invariant subspace can be identified, using the theory of completely positive maps, in terms of a positivity condition on the operator pencil $Q(s)$. In this article, we establish the analogous result in the multi-variable setting and show, by modifying an example of Choi, that an additional hypothesis is necessary. Lastly we discuss the joint spectrum of sub-Jordan tuples and derive the results of $3$-symmetric operators as a corrolary.

A Lifting Theorem for 3-Isometries

Scott McCullough and Ben Russo

Published in Integral Equations and Operator Theory, January 2016, Volume 84, Issue 1, pp 69–87

An operator $T$ on Hilbert space is a $3$-isometry if there exist operators $B_1$ and $B_2$ such that $$T^{*n}T^n = I+nB_1 +n^2 B_2.$$ An operator $J$ is a Jordan operator if it the sum of a unitary $U$ and nilpotent $N$ of order two which commute. If $T$ is a $3$-isometry and $c>0$, then $I-c^{-2} B_2 + sB_1 + s^2B_2$ is positive semidefinite for all real $s$ if and only if it is the restriction of a Jordan operator $J = U + N$ with the norm of $N$ at most $c$. As a corollary, an analogous result for $3$-symmetric operators, due to Helton and Agler, is recovered.

In Submission

Motion Tomography via Occupation Kernels

Benjamin P. Russo, Rushikesh Kamalapurkar, Dongsik Chang, and Joel A. Rosenfeld

The goal of motion tomography is to recover a description of a vector flow field using information on the trajectory of a sensing unit. In this paper, we develop a predictor corrector algorithm designed to recover vector flow fields from trajectory data with the use of occupation kernels developed by Rosenfeld et al.. Specifically, we use the occupation kernels as an adaptive basis; that is, the trajectories defining our occupation kernels are iteratively updated to improve the estimation on the next stage. Initial estimates are established, then under mild assumptions, such as relatively straight trajectories, convergence is proven using the Contraction Mapping Theorem. We then compare to the established method by Chang et al. by defining a set of error metrics. We found that for simulated data, which provides a ground truth, our method offers a marked improvement and that for a real-world example we have similar results to the established method.

Occupation Kernel Hilbert Spaces and the Spectral Analysis of Nonlocal Operators

Joel A. Rosenfeld, Benjamin Russo, and Xiuling Li

This manuscript introduces a space of functions, termed occupation kernel Hilbertspace (OKHS), that operate on collections of signals ratherthan real or complex functions. Tosupport this new definition, an explicit class of OKHSs is given through the consideration of a repro-ducing kernel Hilbert space (RKHS). This space enables the definition of nonlocal operators, suchas fractional order Liouville operators, as well as spectral decomposition methods for correspondingfractional order dynamical systems. In this manuscript, a fractional order DMD routine is presented,and the details of the finite rank representations are given.Significantly, despite the added theoreti-cal content through the OKHS formulation, the resultant computations only differ slightly from thatof occupation kernel DMD methods for integer order systems posed over RKHSs.

Theoretical Foundations for Higher Order Dynamic Mode Decompositions

Joel A. Rosenfeld, Rushikesh Kamalapurkar, and Benjamin P. Russo

Conventionally, data driven identification and control problems for higher order dynamical systems are solved by augmenting the system state by the derivatives of the output to formulate first order dynamical systems in higher dimensions. However, solution of the augmented problem typically requires knowledge of the full augmented state, which requires numerical differentiation of the original output, frequently resulting in noisy signals. This manuscript develops the theory necessary for a direct analysis of higher order dynamical systems using higher order Liouville operators. Fundamental to this theoretical development is the introduction of signal valued RKHSs. Ultimately, it is observed that despite the added abstractions, the necessary computations are remarkably similar to that of first order DMD methods using occupation kernels.

The Occupation Kernel Method for Nonlinear System Identification

Joel A. Rosenfeld, Benjamin Russo, Rushikesh Kamalapurkar, Taylor T. Johnson

This manuscript presents a novel approach to nonlinear system identification leveraging densely defined Liouville operators and a new "kernel" function that represents an integration functional over a reproducing kernel Hilbert space (RKHS) dubbed an occupation kernel. The manuscript thoroughly explores the concept of occupation kernels in the contexts of RKHSs of continuous functions, and establishes Liouville operators over RKHS where several dense domains are found for specific examples of this unbounded operator. The combination of these two concepts allow for the embedding of a dynamical system into a RKHS, where function theoretic tools may be leveraged for the examination of such systems. This framework allows for trajectories of a nonlinear dynamical system to be treated as a fundamental unit of data for nonlinear system identification routine. The approach to nonlinear system identification is demonstrated to identify parameters of a dynamical system accurately, while also exhibiting a certain robustness to noise.

Non-commutative disintegrations: existence and uniqueness in finite dimensions

Arthur J. Parzygnat, Benjamin P. Russo

We utilize category theory to define non-commutative disintegrations, regular conditional probabilities, and optimal hypotheses for finite-dimensional $C^*$-algebras. In the process, we introduce a notion of a.e. equivalence for positive maps and show that the category of $C^*$-algebras and a.e. equivalence classes of 2-positive unital maps forms a category. A related result holds for positive unital maps on von Neumann algebras. In the special case of a finite-dimensional commutative $C^*$-algebra, this reproduces the usual notions of a.e. equivalence and a disintegration of a probability measure over another measure consistent with a probability-preserving function. Similar to the commutative (measure-theoretic) case, disintegrations are unique almost everywhere whenever they exist. However, in contrast to the commutative case, there are many instances where such disintegrations do not exist. We show a certain separability condition on the density matrices representing the states is necessary and sufficient for the existence and uniqueness of such disintegration on finite-dimensional $C^*$-algebras. Physically, tracing out degrees of freedom from the environment of a quantum system is one example of a state-preserving *-homomorphism and the disintegration is the optimal reversal of this procedure. Finally, we discuss some implications for quantum measurement.

A non-commutative Bayes' theorems

Arthur J. Parzygnat, Benjamin P. Russo

Using a diagrammatic reformulation of Bayes' theorem, we provide a necessary and sufficient condition for the existence of Bayesian inference in the setting of finite-dimensional $C^∗$-algebras. In other words, we prove an analogue of Bayes' theorem in the joint classical and quantum context. Our analogue is justified by recent advances in categorical probability theory, which have provided an abstract formulation of the classical Bayes' theorem. In the process, we further develop non-commutative almost everywhere equivalence and illustrate its important role in non-commutative Bayesian inversion. The construction of such Bayesian inverses, when they exist, involves solving a positive semidefinite matrix completion problem for the Choi matrix. This gives a solution to the open problem of constructing Bayesian inversion for completely positive unital maps acting on density matrices that do not have full support. We illustrate how the procedure works for several examples relevant to quantum information theory.