title: Learning in Multi-Player Stochastic Games

abstract: We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We instead focus on variants of {\it correlated equilibria}, such as those studied for extensive-form games. We begin with a hardness result for the adversarial MDP problem: even for a horizon of 3, obtaining sublinear regret against the best non-stationary policy is \textsf{NP}-hard when both rewards and transitions are adversarial. This implies that convergence to even the weakest natural solution concept -- normal-form coarse correlated equilbrium -- is not possible via black-box reduction to a no-regret algorithm even in stochastic games with constant horizon (unless $\textsf{NP}\subseteq\textsf{BPP}$). Instead, we turn to a different target: algorithms which {\it generate} an equilibrium when they are used by all players. Our main result is algorithm which generates an {\it extensive-form} correlated equilibrium, whose runtime is exponential in the horizon but polynomial in all other parameters. We give a similar algorithm which is polynomial in all parameters for "fast-mixing" stochastic games. We also show a method for efficiently reaching normal-form coarse correlated equilibria in "single-controller" stochastic games which follows the traditional no-regret approach. When shared randomness is available, the two generative algorithms can be extended to give simultaneous regret bounds and converge in the traditional sense.


title: Kinetic coefficients in the formalism of time-dependent Green's functions at finite temperature

abstract: We discuss the microscopical justification of dissipation in the model nonrelativistic Fermi and Bose systems with weak local interactions above phase transitions. The dynamics of equilibrium fluctuations are considered in Keldysh - Schwinger framework. We show that the dissipation is related to pinch singularities of the diagram technique. Using Dyson - Schwinger equation and the two-loop approximation we define and calculate the attenuation parameter which is related to exponentiality of Green's functions decay. We show that the attenuation parameter is the microscopic analogue of the Onsager kinetic coefficient and it is related to attenuation in the excitation spectrum.


title: Existence of ground state solutions for a Choquard double phase problem

abstract: In this paper we study quasilinear elliptic equations driven by the double phase operator involving a Choquard term of the form \begin{align*} -\mathcal{L}_{p,q}^{a}(u) + |u|^{p-2}u+ a(x) |u|^{q-2}u = \left( \int_{\mathbb{R}^N} \frac{F(y, u)}{|x-y|^\mu}\,\mathrm{d} y\right)f(x,u) \quad\text{in } \mathbb{R}^N, \end{align*} where $\mathcal{L}_{p,q}^{a}$ is the double phase operator given by \begin{align*} \mathcal{L}_{p,q}^{a}(u):= \operatorname{div}\big(|\nabla u|^{p-2}\nabla u + a(x) |\nabla u|^{q-2}\nabla u \big), \quad u\in W^{1,\mathcal{H}}(\mathbb{R}^N), \end{align*} $0<\mu<N$, $1<p<N$, $p<q<p+ \frac{\alpha p}{N}$, $0 \leq a(\cdot)\in C^{0,\alpha}(\mathbb{R}^N)$ with $\alpha \in (0,1]$ and $f\colon\mathbb{R}^N\times\mathbb{R}\to\mathbb{R}$ is a continuous function that satisfies a subcritical growth. Based on the Hardy-Littlewood-Sobolev inequality, the Nehari manifold and variational tools, we prove the existence of ground state solutions of such problems under different assumptions on the data.


title: Accelerating Certified Robustness Training via Knowledge Transfer

abstract: Training deep neural network classifiers that are certifiably robust against adversarial attacks is critical to ensuring the security and reliability of AI-controlled systems. Although numerous state-of-the-art certified training methods have been developed, they are computationally expensive and scale poorly with respect to both dataset and network complexity. Widespread usage of certified training is further hindered by the fact that periodic retraining is necessary to incorporate new data and network improvements. In this paper, we propose Certified Robustness Transfer (CRT), a general-purpose framework for reducing the computational overhead of any certifiably robust training method through knowledge transfer. Given a robust teacher, our framework uses a novel training loss to transfer the teacher's robustness to the student. We provide theoretical and empirical validation of CRT. Our experiments on CIFAR-10 show that CRT speeds up certified robustness training by $8 \times$ on average across three different architecture generations while achieving comparable robustness to state-of-the-art methods. We also show that CRT can scale to large-scale datasets like ImageNet.


title: Refining Action Boundaries for One-stage Detection

abstract: Current one-stage action detection methods, which simultaneously predict action boundaries and the corresponding class, do not estimate or use a measure of confidence in their boundary predictions, which can lead to inaccurate boundaries. We incorporate the estimation of boundary confidence into one-stage anchor-free detection, through an additional prediction head that predicts the refined boundaries with higher confidence. We obtain state-of-the-art performance on the challenging EPIC-KITCHENS-100 action detection as well as the standard THUMOS14 action detection benchmarks, and achieve improvement on the ActivityNet-1.3 benchmark.


title: Bulk and decay properties of neutron-deficient odd-mass Hg isotopes around A = 185

abstract: Ground and isomeric states of the neutron-deficient odd-$A$ isotopes $^{183}$Hg, $^{185}$Hg, and $^{187}$Hg are described from a microscopic calculation based on a self-consistent, axially-deformed Hartree-Fock mean field with the Skyrme functional and pairing within BCS approximation. For each equilibrium shape and different odd-neutron states, results on mean square charge radii and magnetic dipole moments are given and analyzed in the context of their sensitivity to the nuclear deformation and to the spin and parity. Spin-isospin correlations within proton-neutron quasiparticle random phase approximation are then introduced in the nuclear states to obtain the distributions of Gamow-Teller strength and the $\beta^+/EC$ half-lives of these isotopes, whose measurements are planned at ISOLDE-CERN using total absorption gamma-ray spectroscopy techniques.


title: Parabolic frequency for the mean curvature flow

abstract: This paper defines a parabolic frequency for solutions of the heat equation along homothetically shrinking mean curvature flows and proves its monotonicity along such flows. As a corollary, frequency monotonicity provides a proof of backwards uniqueness. Additionally, for solutions of more general parabolic equations on mean curvature flow shrinkers, this paper provides bounds on the derivative of the frequency, which similarly imply backwards uniqueness.


title: Combined Data and Deep Learning Model Uncertainties: An Application to the Measurement of Solid Fuel Regression Rate

abstract: In complex physical process characterization, such as the measurement of the regression rate for solid hybrid rocket fuels, where both the observation data and the model used have uncertainties originating from multiple sources, combining these in a systematic way for quantities of interest(QoI) remains a challenge. In this paper, we present a forward propagation uncertainty quantification (UQ) process to produce a probabilistic distribution for the observed regression rate $\dot{r}$. We characterized two input data uncertainty sources from the experiment (the distortion from the camera $U_c$ and the non-zero angle fuel placement $U_\gamma$), the prediction and model form uncertainty from the deep neural network ($U_m$), as well as the variability from the manually segmented images used for training it ($U_s$). We conducted seven case studies on combinations of these uncertainty sources with the model form uncertainty. The main contribution of this paper is the investigation and inclusion of the experimental image data uncertainties involved, and how to include them in a workflow when the QoI is the result of multiple sequential processes.


title: Radiant gravitational collapse with anisotropy in pressures and bulk viscosity

abstract: We model a compact radiant star that undergoes gravitational collapse from a certain initial static configuration until it becomes a black hole. The star consists of a fluid with anisotropy in pressures, bulk viscosity, in addition to the radial heat flow. A solution of Einstein's field equations with temporal dependence was presented to study the dynamic evolution of physical quantities, such as the mass-energy function, the luminosity seen by an observer at infinity and the heat flow. We checked the acceptability conditions of the initial static configuration to obtain a range of mass-to-radius ratio in which the presented star model is physically reasonable. The energy conditions were analyzed for the dynamic case, in order to guarantee that the model is composed of a physically acceptable fluid within the range of the mass-to-radius ratio obtained for the static configuration or if they will be modified during the collapse


title: Classification of degenerate non-homogeneous Hamiltonian operators

abstract: In this paper, the authors investigate non-homogeneous Hamiltonian operators composed of a first-order Dubrovin-Novikov operator and an ultralocal one. The study of such operators turns out to be fundamental for the inverted system of equations associated with a class of Hamiltonian scalar equations. Often, the involved operators are degenerate in the first-order term. For this reason, a complete classification of the operators with degenerate leading coefficient in systems of 2 and 3 components is presented.


title: Parallel Order-Based Core Maintenance in Dynamic Graphs

abstract: The core numbers of vertices in a graph are one of the most well-studied cohesive subgraph models because of the linear running time. In practice, many data graphs are dynamic graphs that are continuously changing by inserting or removing edges. The core numbers are updated in dynamic graphs with edge insertions and deletions, which is called core maintenance. When a burst of a large number of inserted or removed edges come in, we have to handle these edges on time to keep up with the data stream. There are two main sequential algorithms for core maintenance, \textsc{Traversal} and \textsc{Order}. It is proved that the \textsc{Order} algorithm significantly outperforms the \alg{Traversal} algorithm over all tested graphs with up to 2,083 times speedups. To the best of our knowledge, all existing parallel approaches are based on the \alg{Traversal} algorithm; also, their parallelism exists only for affected vertices with different core numbers, which will reduce to sequential when all vertices have the same core numbers. In this paper, we propose a new parallel core maintenance algorithm based on the \alg{Order} algorithm. Importantly, our new approach always has parallelism, even for the graphs where all vertices have the same core numbers. Extensive experiments are conducted over real-world, temporal, and synthetic graphs on a 64-core machine. The results show that for inserting and removing 100,000 edges using 16-worker, our method achieves up to 289x and 10x times speedups compared with the most efficient existing method, respectively.


title: Topological phase transitions and Berry-phase hysteresis in exchange-coupled nanomagnets

abstract: Topological phase in magnetic materials yields a quantized contribution to the Hall effect known as the topological Hall effect, which is often caused by skyrmions, with each skyrmion creating a magnetic flux quantum h/e. The control and understanding of topological properties in nanostructured materials is the subject of immense interest for both fundamental science and technological applications, especially in spintronics. In this work, the electron-transport properties and spin structure of exchange-coupled cobalt nanoparticles with an average particle size of 13.7 nm are studied experimentally and theoretically. Magnetic and Hall-effect measurements identify topological phase transitions in the exchange-coupled cobalt nanoparticles and were used to discover a qualitatively new type of hysteresis in the topological Hall effect namely, Berry-phase hysteresis. Micromagnetic simulations reveal the origin of the topological Hall effect namely, the chiral domains, with domain-wall chirality quantified by an integer skyrmion number. These spin structures are different from the skyrmions formed due to Dzyaloshinskii Moriya interactions in B20 crystals and multilayered thin films, and caused by cooperative magnetization reversal in the exchange-coupled cobalt nanoparticles. An analytical model is developed to explain the underlying physics of Berry-phase hysteresis, which is strikingly different from the iconic magnetic hysteresis and constitutes one aspect of 21st-century reshaping of our view on nature at the borderline of physics, chemistry, mathematics, and materials science.


title: Statistical Inference for H\"usler-Reiss Graphical Models Through Matrix Completions

abstract: The severity of multivariate extreme events is driven by the dependence between the largest marginal observations. The H\"usler-Reiss distribution is a versatile model for this extremal dependence, and it is usually parameterized by a variogram matrix. In order to represent conditional independence relations and obtain sparse parameterizations, we introduce the novel H\"usler-Reiss precision matrix. Similarly to the Gaussian case, this matrix appears naturally in density representations of the H\"usler-Reiss Pareto distribution and encodes the extremal graphical structure through its zero pattern. For a given, arbitrary graph we prove the existence and uniqueness of the completion of a partially specified H\"usler-Reiss variogram matrix so that its precision matrix has zeros on non-edges in the graph. Using suitable estimators for the parameters on the edges, our theory provides the first consistent estimator of graph structured H\"usler-Reiss distributions. If the graph is unknown, our method can be combined with recent structure learning algorithms to jointly infer the graph and the corresponding parameter matrix. Based on our methodology, we propose new tools for statistical inference of sparse H\"usler-Reiss models and illustrate them on large flight delay data in the U.S., as well as Danube river flow data.


title: Community Report from the Biosignatures Standards of Evidence Workshop

abstract: The search for life beyond the Earth is the overarching goal of the NASA Astrobiology Program, and it underpins the science of missions that explore the environments of Solar System planets and exoplanets. However, the detection of extraterrestrial life, in our Solar System and beyond, is sufficiently challenging that it is likely that multiple measurements and approaches, spanning disciplines and missions, will be needed to make a convincing claim. Life detection will therefore not be an instantaneous process, and it is unlikely to be unambiguous-yet it is a high-stakes scientific achievement that will garner an enormous amount of public interest. Current and upcoming research efforts and missions aimed at detecting past and extant life could be supported by a consensus framework to plan for, assess and discuss life detection claims (c.f. Green et al., 2021). Such a framework could help increase the robustness of biosignature detection and interpretation, and improve communication with the scientific community and the public. In response to this need, and the call to the community to develop a confidence scale for standards of evidence for biosignature detection (Green et al., 2021), a community-organized workshop was held on July 19-22, 2021. The meeting was designed in a fully virtual (flipped) format. Preparatory materials including readings, instructional videos and activities were made available prior to the workshop, allowing the workshop schedule to be fully dedicated to active community discussion and prompted writing sessions. To maximize global interaction, the discussion components of the workshop were held during business hours in three different time zones, Asia/Pacific, European and US, with daily information hand-off between group organizers.


title: Partial sums of generalized Rabotnov function

abstract: Let $(\mathbb{R}_{\alpha ,\beta ,\gamma }(z))_{m}(z)=z+\sum_{n=1}^{m}A_{n}z^{n+1}$ be the sequence of partial sums of the normalized Rabotnov functions $\mathbb{R}_{\alpha ,\beta ,\gamma }(z)=z+\sum_{n=1}^{\infty }A_{n}z^{n+1}$ where $A_{n}=\frac{\beta ^{n}\Gamma \left( \gamma +\alpha \right) }{\Gamma \left( \left( \gamma +\alpha \right) (n+1)\right) }.$ The purpose of the present paper is to determine lower bounds for $\mathfrak{R}\left \{ \frac{\mathbb{R}_{\alpha ,\beta ,\gamma }(z)% }{(\mathbb{R}_{\alpha ,\beta ,\gamma })_{m}(z)}\right \} ,\mathfrak{R}% \left \{ \frac{(\mathbb{R}_{\alpha ,\beta ,\gamma })_{m}(z)}{\mathbb{R}% _{\alpha ,\beta ,\gamma }(z)}\right \} ,$ $\mathfrak{R}\left \{ \frac{\mathbb{R}_{\alpha ,\beta ,\gamma }(z)}{(\mathbb{% R}_{\alpha ,\beta ,\gamma })_{m}^{\prime }(z)}\right \} ,\mathfrak{R}% \left \{ \frac{(\mathbb{R}_{\alpha ,\beta ,\gamma })_{m}^{\prime }(z)}{% \mathbb{R}_{\alpha ,\beta ,\gamma }(z)}\right \} .$ Furthermore, we give lower bounds for $\mathfrak{R}\left \{ \frac{\mathbb{I}\left[ \mathbb{R}% _{\alpha ,\beta ,\gamma }\right] (z)}{(\mathbb{I}\left[ \mathbb{R}_{\alpha ,\beta ,\gamma }\right] )_{m}(z)}\right \} $ and $\mathfrak{R}\left \{ \frac{% (\mathbb{I}\left[ \mathbb{R}_{\alpha ,\beta ,\gamma }\right] )_{m}(z)}{% \mathbb{I}\left[ \mathbb{R}_{\alpha ,\beta ,\gamma }\right] (z)}\right \} $ where $\mathbb{I}\left[ \mathbb{R}_{\alpha ,\beta ,\gamma }\right] $ is the Alexander transform of $\mathbb{R}_{\alpha ,\beta ,\gamma }$. Several examples of the main results are also considered.


title: Cross-View Image Sequence Geo-localization

abstract: Cross-view geo-localization aims to estimate the GPS location of a query ground-view image by matching it to images from a reference database of geo-tagged aerial images. To address this challenging problem, recent approaches use panoramic ground-view images to increase the range of visibility. Although appealing, panoramic images are not readily available compared to the videos of limited Field-Of-View (FOV) images. In this paper, we present the first cross-view geo-localization method that works on a sequence of limited FOV images. Our model is trained end-to-end to capture the temporal structure that lies within the frames using the attention-based temporal feature aggregation module. To robustly tackle different sequences length and GPS noises during inference, we propose to use a sequential dropout scheme to simulate variant length sequences. To evaluate the proposed approach in realistic settings, we present a new large-scale dataset containing ground-view sequences along with the corresponding aerial-view images. Extensive experiments and comparisons demonstrate the superiority of the proposed approach compared to several competitive baselines.


title: An Improved Correction Term for Dimension Reduction in Quantum Key Distribution

abstract: The dimension reduction method enables security proofs of quantum key distribution (QKD) protocols that are originally formulated in infinite dimensions via reduction to a tractable finite-dimensional optimization. The reduction of dimensions is associated with a correction term in the secret key rate calculation. The previously derived correction term is loose when the protocol measurements are nearly block-diagonal with respect to the projection onto the reduced finite-dimensional subspace. Here, we provide a tighter correction term. It interpolates between the two extreme cases where all measurement operators are block-diagonal, and where at least one has maximally large off-diagonal blocks. This new correction term can reduce the computational overhead of applying the dimension reduction method by reducing the required dimension of the chosen subspace.


title: Progressively refined deep joint registration segmentation (ProRSeg) of gastrointestinal organs at risk: Application to MRI and cone-beam CT

abstract: Method: ProRSeg was trained using 5-fold cross-validation with 110 T2-weighted MRI acquired at 5 treatment fractions from 10 different patients, taking care that same patient scans were not placed in training and testing folds. Segmentation accuracy was measured using Dice similarity coefficient (DSC) and Hausdorff distance at 95th percentile (HD95). Registration consistency was measured using coefficient of variation (CV) in displacement of OARs. Ablation tests and accuracy comparisons against multiple methods were done. Finally, applicability of ProRSeg to segment cone-beam CT (CBCT) scans was evaluated on 80 scans using 5-fold cross-validation. Results: ProRSeg processed 3D volumes (128 $\times$ 192 $\times$ 128) in 3 secs on a NVIDIA Tesla V100 GPU. It's segmentations were significantly more accurate ($p<0.001$) than compared methods, achieving a DSC of 0.94 $\pm$0.02 for liver, 0.88$\pm$0.04 for large bowel, 0.78$\pm$0.03 for small bowel and 0.82$\pm$0.04 for stomach-duodenum from MRI. ProRSeg achieved a DSC of 0.72$\pm$0.01 for small bowel and 0.76$\pm$0.03 for stomach-duodenum from CBCT. ProRSeg registrations resulted in the lowest CV in displacement (stomach-duodenum $CV_{x}$: 0.75\%, $CV_{y}$: 0.73\%, and $CV_{z}$: 0.81\%; small bowel $CV_{x}$: 0.80\%, $CV_{y}$: 0.80\%, and $CV_{z}$: 0.68\%; large bowel $CV_{x}$: 0.71\%, $CV_{y}$ : 0.81\%, and $CV_{z}$: 0.75\%). ProRSeg based dose accumulation accounting for intra-fraction (pre-treatment to post-treatment MRI scan) and inter-fraction motion showed that the organ dose constraints were violated in 4 patients for stomach-duodenum and for 3 patients for small bowel. Study limitations include lack of independent testing and ground truth phantom datasets to measure dose accumulation accuracy.


title: Wasserstein Archetypal Analysis

abstract: Archetypal analysis is an unsupervised machine learning method that summarizes data using a convex polytope. In its original formulation, for fixed k, the method finds a convex polytope with k vertices, called archetype points, such that the polytope is contained in the convex hull of the data and the mean squared Euclidean distance between the data and the polytope is minimal. In the present work, we consider an alternative formulation of archetypal analysis based on the Wasserstein metric, which we call Wasserstein archetypal analysis (WAA). In one dimension, there exists a unique solution of WAA and, in two dimensions, we prove existence of a solution, as long as the data distribution is absolutely continuous with respect to Lebesgue measure. We discuss obstacles to extending our result to higher dimensions and general data distributions. We then introduce an appropriate regularization of the problem, via a Renyi entropy, which allows us to obtain existence of solutions of the regularized problem for general data distributions, in arbitrary dimensions. We prove a consistency result for the regularized problem, ensuring that if the data are iid samples from a probability measure, then as the number of samples is increased, a subsequence of the archetype points converges to the archetype points for the limiting data distribution, almost surely. Finally, we develop and implement a gradient-based computational approach for the two-dimensional problem, based on the semi-discrete formulation of the Wasserstein metric. Our analysis is supported by detailed computational experiments.


title: OpenStance: Real-world Zero-shot Stance Detection

abstract: Prior studies of zero-shot stance detection identify the attitude of texts towards unseen topics occurring in the same document corpus. Such task formulation has three limitations: (i) Single domain/dataset. A system is optimized on a particular dataset from a single domain; therefore, the resulting system cannot work well on other datasets; (ii) the model is evaluated on a limited number of unseen topics; (iii) it is assumed that part of the topics has rich annotations, which might be impossible in real-world applications. These drawbacks will lead to an impractical stance detection system that fails to generalize to open domains and open-form topics. This work defines OpenStance: open-domain zero-shot stance detection, aiming to handle stance detection in an open world with neither domain constraints nor topic-specific annotations. The key challenge of OpenStance lies in the open-domain generalization: learning a system with fully unspecific supervision but capable of generalizing to any dataset. To solve OpenStance, we propose to combine indirect supervision, from textual entailment datasets, and weak supervision, from data generated automatically by pre-trained Language Models. Our single system, without any topic-specific supervision, outperforms the supervised method on three popular datasets. To our knowledge, this is the first work that studies stance detection under the open-domain zero-shot setting. All data and code are publicly released.


title: One-ended spanning trees and definable combinatorics

abstract: Let $(X,\tau)$ be a Polish space with Borel probability measure $\mu,$ and $G$ a locally finite one-ended Borel graph on $X.$ We show that $G$ admits a Borel one-ended spanning tree generically. If $G$ is induced by a free Borel action of an amenable (resp., polynomial growth) group then we show the same result $\mu$-a.e. (resp., everywhere). Our results generalize recent work of Tim\'ar, as well as of Conley, Gaboriau, Marks, and Tucker-Drob, who proved this in the probability measure preserving setting. We apply our theorem to find Borel orientations in even degree graphs and measurable and Baire measurable perfect matchings in regular bipartite graphs, refining theorems that were previously only known to hold for measure preserving graphs. In particular, we prove that bipartite one-ended $d$-regular Borel graphs admit Baire measurable perfect matchings.


title: Some complementary Gray codes

abstract: A complementary Gray code for binary n-tuples is one that, when all the tuples are complemented, is identical to itself; this is equivalent to the complement of the first half of the code being identical to the second half. We generalize the notion of complementary to q-ary n-tuples, fixed size combinations of an n-set and permutations and, in each case, construct complementary Gray codes. We relax, as weakly as possible, the notions of complementary to cases where necessary conditions for existence are violated and construct Gray codes within the weakened definitions: these include binary n-tuples when n is odd and Lee metric q-ary n-tuples when n is odd and q is even. Finally a lemma used in the construction for permutations offers the first known cyclic Gray code for the permutations of a particular family of multisets.


title: An adaptive method to solve multilevel multiobjective linear programming problems

abstract: This paper is a follow-up to a previous work where we defined and generated the set of all possible compromises of multilevel multiobjective linear programming problems (ML-MOLPP). In this paper, we introduce a new algorithm to solve ML-MOLPP in which the adaptive method of linear programming is nested. First, we start by generating the set of all possible compromises (set of all non-dominated solutions). After that, an algorithm based on the adaptive method of linear programming is developed to select the best compromise among all the possible compromises achieved. This method will allow us to transform the initial multilevel problem into an ML-MOLPP with bounded variables. Then, apply the adaptive method which is the most efficient to solve all the multiobjective linear programming problems involved in the resolution process instead of the simplex method (It should be noted that the adaptive method is more efficient than the simplex method). Finally, all the construction stages are carefully checked and illustrated with a numerical example.


title: WaveBound: Dynamic Error Bounds for Stable Time Series Forecasting

abstract: Time series forecasting has become a critical task due to its high practicality in real-world applications such as traffic, energy consumption, economics and finance, and disease analysis. Recent deep-learning-based approaches have shown remarkable success in time series forecasting. Nonetheless, due to the dynamics of time series data, deep networks still suffer from unstable training and overfitting. Inconsistent patterns appearing in real-world data lead the model to be biased to a particular pattern, thus limiting the generalization. In this work, we introduce the dynamic error bounds on training loss to address the overfitting issue in time series forecasting. Consequently, we propose a regularization method called WaveBound which estimates the adequate error bounds of training loss for each time step and feature at each iteration. By allowing the model to focus less on unpredictable data, WaveBound stabilizes the training process, thus significantly improving generalization. With the extensive experiments, we show that WaveBound consistently improves upon the existing models in large margins, including the state-of-the-art model.


title: Learning Better Intent Representations for Financial Open Intent Classification

abstract: With the recent surge of NLP technologies in the financial domain, banks and other financial entities have adopted virtual agents (VA) to assist customers. A challenging problem for VAs in this domain is determining a user's reason or intent for contacting the VA, especially when the intent was unseen or open during the VA's training. One method for handling open intents is adaptive decision boundary (ADB) post-processing, which learns tight decision boundaries from intent representations to separate known and open intents. We propose incorporating two methods for supervised pre-training of intent representations: prefix-tuning and fine-tuning just the last layer of a large language model (LLM). With this proposal, our accuracy is 1.63% - 2.07% higher than the prior state-of-the-art ADB method for open intent classification on the banking77 benchmark amongst others. Notably, we only supplement the original ADB model with 0.1% additional trainable parameters. Ablation studies also determine that our method yields better results than full fine-tuning the entire model. We hypothesize that our findings could stimulate a new optimal method of downstream tuning that combines parameter efficient tuning modules with fine-tuning a subset of the base model's layers.


title: Parabolic Components in Cubic Polynomial Slice $Per_1(1)$

abstract: We prove that the boundary of every parabolic component in the cubic polynomial slice $Per_1(1)$ is a Jordan curve by adapting the technique of para-puzzles presented in \cite{Roesch1}. We also give a global description of the connected locus $\mathcal{C}_1$: it is the union of two main parabolic components and the limbs attached on their boundaries.


title: Reading Between the Lines: Modeling User Behavior and Costs in AI-Assisted Programming

abstract: Code-recommendation systems, such as Copilot and CodeWhisperer, have the potential to improve programmer productivity by suggesting and auto-completing code. However, to fully realize their potential, we must understand how programmers interact with these systems and identify ways to improve that interaction. To seek insights about human-AI collaboration with code recommendations systems, we studied GitHub Copilot, a code-recommendation system used by millions of programmers daily. We developed CUPS, a taxonomy of common programmer activities when interacting with Copilot. Our study of 21 programmers, who completed coding tasks and retrospectively labeled their sessions with CUPS, showed that CUPS can help us understand how programmers interact with code-recommendation systems, revealing inefficiencies and time costs. Our insights reveal how programmers interact with Copilot and motivate new interface designs and metrics.


title: On Robust Incremental Learning over Many Multilingual Steps

abstract: Recent work in incremental learning has introduced diverse approaches to tackle catastrophic forgetting from data augmentation to optimized training regimes. However, most of them focus on very few training steps. We propose a method for robust incremental learning over dozens of fine-tuning steps using data from a variety of languages. We show that a combination of data-augmentation and an optimized training regime allows us to continue improving the model even for as many as fifty training steps. Crucially, our augmentation strategy does not require retaining access to previous training data and is suitable in scenarios with privacy constraints.


title: Multi-rate adaptive transform coding for video compression

abstract: Contemporary lossy image and video coding standards rely on transform coding, the process through which pixels are mapped to an alternative representation to facilitate efficient data compression. Despite impressive performance of end-to-end optimized compression with deep neural networks, the high computational and space demands of these models has prevented them from superseding the relatively simple transform coding found in conventional video codecs. In this study, we propose learned transforms and entropy coding that may either serve as (non)linear drop-in replacements, or enhancements for linear transforms in existing codecs. These transforms can be multi-rate, allowing a single model to operate along the entire rate-distortion curve. To demonstrate the utility of our framework, we augmented the DCT with learned quantization matrices and adaptive entropy coding to compress intra-frame AV1 block prediction residuals. We report substantial BD-rate and perceptual quality improvements over more complex nonlinear transforms at a fraction of the computational cost.


title: Empowering Long-tail Item Recommendation through Cross Decoupling Network (CDN)

abstract: Industry recommender systems usually suffer from highly-skewed long-tail item distributions where a small fraction of the items receives most of the user feedback. This skew hurts recommender quality especially for the item slices without much user feedback. While there have been many research advances made in academia, deploying these methods in production is very difficult and very few improvements have been made in industry. One challenge is that these methods often hurt overall performance; additionally, they could be complex and expensive to train and serve. In this work, we aim to improve tail item recommendations while maintaining the overall performance with less training and serving cost. We first find that the predictions of user preferences are biased under long-tail distributions. The bias comes from the differences between training and serving data in two perspectives: 1) the item distributions, and 2) user's preference given an item. Most existing methods mainly attempt to reduce the bias from the item distribution perspective, ignoring the discrepancy from user preference given an item. This leads to a severe forgetting issue and results in sub-optimal performance. To address the problem, we design a novel Cross Decoupling Network (CDN) (i) decouples the learning process of memorization and generalization on the item side through a mixture-of-expert architecture; (ii) decouples the user samples from different distributions through a regularized bilateral branch network. Finally, a new adapter is introduced to aggregate the decoupled vectors, and softly shift the training attention to tail items. Extensive experimental results show that CDN significantly outperforms state-of-the-art approaches on benchmark datasets. We also demonstrate its effectiveness by a case study of CDN in a large-scale recommendation system at Google.


title: Galois closures and elementary components of Hilbert schemes of points

abstract: Bhargava and the first-named author of this paper introduced a functorial Galois closure operation for finite-rank ring extensions, generalizing constructions of Grothendieck and Katz--Mazur. In this paper, we generalize Galois closures and apply them to construct a new infinite family of irreducible components of Hilbert schemes of points. We show that these components are elementary, in the sense that they parametrize algebras supported at a point. Furthermore, we produce secondary families of elementary components obtained from Galois closures by modding out by suitable socle elements.


title: Composite Ramsey theorems via trees

abstract: We prove a theorem ensuring that the compositions of certain Ramsey families are still Ramsey. As an application, we show that in any finite coloring of $\mathbb{N}$ there is an infinite set $A$ and an as large as desired finite set $B$ with $(A+B)\cup (AB)$ monochromatic, answering a question from a recent paper of Kra, Moreira, Richter, and Robertson. In fact, we prove an iterated version of this result that also generalizes a Ramsey theorem of Bergelson and Moreira that was previously only known to hold for fields. Our main new technique is an extension of the color focusing method that involves trees rather than sequences.


title: JAX-DIPS: Neural bootstrapping of finite discretization methods and application to elliptic problems with discontinuities

abstract: We present a scalable strategy for development of mesh-free hybrid neuro-symbolic partial differential equation solvers based on existing mesh-based numerical discretization methods. Particularly, this strategy can be used to efficiently train neural network surrogate models of partial differential equations by (i) leveraging the accuracy and convergence properties of advanced numerical methods, solvers, and preconditioners, as well as (ii) better scalability to higher order PDEs by strictly limiting optimization to first order automatic differentiation. The presented neural bootstrapping method (hereby dubbed NBM) is based on evaluation of the finite discretization residuals of the PDE system obtained on implicit Cartesian cells centered on a set of random collocation points with respect to trainable parameters of the neural network. Importantly, the conservation laws and symmetries present in the bootstrapped finite discretization equations inform the neural network about solution regularities within local neighborhoods of training points. We apply NBM to the important class of elliptic problems with jump conditions across irregular interfaces in three spatial dimensions. We show the method is convergent such that model accuracy improves by increasing number of collocation points in the domain and predonditioning the residuals. We show NBM is competitive in terms of memory and training speed with other PINN-type frameworks. The algorithms presented here are implemented using \texttt{JAX} in a software package named \texttt{JAX-DIPS} (https://github.com/JAX-DIPS/JAX-DIPS), standing for differentiable interfacial PDE solver. We open sourced \texttt{JAX-DIPS} to facilitate research into use of differentiable algorithms for developing hybrid PDE solvers.


title: An efficient and fast sparse grid algorithm for high-dimensional numerical integration

abstract: This paper is concerned with developing an efficient numerical algorithm for fast implementation of the sparse grid method for computing the $d$-dimensional integral of a given function. The new algorithm, called the MDI-SG ({\em multilevel dimension iteration sparse grid}) method, implements the sparse grid method based on a dimension iteration/reduction procedure, it does not need to store the integration points, neither does it compute the function values independently at each integration point, instead, it re-uses the computation for function evaluations as much as possible by performing the function evaluations at all integration points in a cluster and iteratively along coordinate directions. It is shown numerically that the computational complexity (in terms of CPU time) of the proposed MDI-SG method is of polynomial order $O(Nd^3 )$ or better, compared to the exponential order $O(N(\log N)^{d-1})$ for the standard sparse grid method, where $N$ denotes the maximum number of integration points in each coordinate direction. As a result, the proposed MDI-SG method effectively circumvents the curse of dimensionality suffered by the standard sparse grid method for high-dimensional numerical integration.


title: Staircase formation in unstably stratified double diffusive finger convection

abstract: Double diffusive staircases are investigated experimentally in a fluid layer with a stabilizing temperature gradient and a destabilizing gradient of ion concentration. Gradients of temperature and ion concentration are maintained in a steady state within an electrochemical system. Staircases are observed even if the density stratification is unstable. None of the previously proposed mechanisms for staircase formation can be recognized in the experiments. Ion transport through fingers which are part of a staircase is not the same as transport through fingers extending through the entire cell. Fingers cease to exist if the diffusive heat transport between neighboring fingers is insufficient.


title: Streaming Submodular Maximization with Differential Privacy

abstract: In this work, we study the problem of privately maximizing a submodular function in the streaming setting. Extensive work has been done on privately maximizing submodular functions in the general case when the function depends upon the private data of individuals. However, when the size of the data stream drawn from the domain of the objective function is large or arrives very fast, one must privately optimize the objective within the constraints of the streaming setting. We establish fundamental differentially private baselines for this problem and then derive better trade-offs between privacy and utility for the special case of decomposable submodular functions. A submodular function is decomposable when it can be written as a sum of submodular functions; this structure arises naturally when each summand function models the utility of an individual and the goal is to study the total utility of the whole population as in the well-known Combinatorial Public Projects Problem. Finally, we complement our theoretical analysis with experimental corroboration.


title: Neutral-current neutrino cross section and expected supernova signals for $^{40}$Ar from a three-fold increase in the magnetic dipole strength

abstract: In view of the great interest in liquid argon neutrino detectors, the $^{40}$Ar($\gamma,\gamma'$)$^{40}$Ar$^{*}$ reaction was revisited to guide a calculation of the neutral current neutrino cross section at supernova energies. Using the nuclear resonance fluorescence technique with a monoenergetic, 99% linearly polarized photon beam, we report a three-fold increase in magnetic dipole strength at around 10 MeV in $^{40}$Ar. Based on shell-model calculations, and using the experimentally identified transitions, the neutral current neutrino cross sections for low-energy reactions on $^{40}$Ar are calculated.


title: The Mu2e Experiment -- Searching for Charged Lepton Flavor Violation

abstract: The Mu2e experiment will search for a Standard Model violating rate of neutrinoless conversion of a muon into an electron in the presence of an aluminum nucleus. Observation of this charged lepton flavor violating process would be an unambiguous sign of new physics. Mu2e will improve upon previous searches for this process by four orders of magnitude. This requires the world's highest-intensity muon beam, a detector system capable of efficiently reconstructing the 105 MeV/c conversion electron signal, and minimizing sensitivity to background events. A pulsed 8 GeV proton beam strikes a target, producing pions that decay into muons. Beam outside the pulse must be suppressed to $< 10^{-10}$ to reduce beam-related backgrounds. The muon beam is guided from the production target along the transport system and onto the aluminum stopping target. Conversion electrons leave the stopping target and propagate inside a solenoidal magnetic field to the tracker and electromagnetic calorimeter. The tracker is a system of straw tube panels filled with Ar/CO$_2$ at 1 atm that tracks particles inside of a solenoidal B-field and measures their momenta with $\sim100$ keV/$c$ resolution to resolve signal events from decay-in-orbit backgrounds. The CsI calorimeter provides $E/p$ and is used to seed the track reconstruction algorithm with $\sigma_E /E \sim{}10\%$ and $\sigma_t<500~\rm{ps}$. Additionally, a novel cosmic ray veto with greater than 99.99\% efficiency brings the expected number of background events to fewer than one over three years of running. To normalize the experiment, the stopping target monitor measures the rate of capture photons from muons incident on the stopping target by using a system of high-purity germanium and lanthanum bromide scintillators.


title: Object recognition in atmospheric turbulence scenes

abstract: The influence of atmospheric turbulence on acquired surveillance imagery poses significant challenges in image interpretation and scene analysis. Conventional approaches for target classification and tracking are less effective under such conditions. While deep-learning-based object detection methods have shown great success in normal conditions, they cannot be directly applied to atmospheric turbulence sequences. In this paper, we propose a novel framework that learns distorted features to detect and classify object types in turbulent environments. Specifically, we utilise deformable convolutions to handle spatial turbulent displacement. Features are extracted using a feature pyramid network, and Faster R-CNN is employed as the object detector. Experimental results on a synthetic VOC dataset demonstrate that the proposed framework outperforms the benchmark with a mean Average Precision (mAP) score exceeding 30%. Additionally, subjective results on real data show significant improvement in performance.


title: Explicitly Increasing Input Information Density for Vision Transformers on Small Datasets

abstract: Vision Transformers have attracted a lot of attention recently since the successful implementation of Vision Transformer (ViT) on vision tasks. With vision Transformers, specifically the multi-head self-attention modules, networks can capture long-term dependencies inherently. However, these attention modules normally need to be trained on large datasets, and vision Transformers show inferior performance on small datasets when training from scratch compared with widely dominant backbones like ResNets. Note that the Transformer model was first proposed for natural language processing, which carries denser information than natural images. To boost the performance of vision Transformers on small datasets, this paper proposes to explicitly increase the input information density in the frequency domain. Specifically, we introduce selecting channels by calculating the channel-wise heatmaps in the frequency domain using Discrete Cosine Transform (DCT), reducing the size of input while keeping most information and hence increasing the information density. As a result, 25% fewer channels are kept while better performance is achieved compared with previous work. Extensive experiments demonstrate the effectiveness of the proposed approach on five small-scale datasets, including CIFAR-10/100, SVHN, Flowers-102, and Tiny ImageNet. The accuracy has been boosted up to 17.05% with Swin and Focal Transformers. Codes are available at https://github.com/xiangyu8/DenseVT.


title: FO-PINNs: A First-Order formulation for Physics Informed Neural Networks

abstract: Physics-Informed Neural Networks (PINNs) are a class of deep learning neural networks that learn the response of a physical system without any simulation data, and only by incorporating the governing partial differential equations (PDEs) in their loss function. While PINNs are successfully used for solving forward and inverse problems, their accuracy decreases significantly for parameterized systems. PINNs also have a soft implementation of boundary conditions resulting in boundary conditions not being exactly imposed everywhere on the boundary. With these challenges at hand, we present first-order physics-informed neural networks (FO-PINNs). These are PINNs that are trained using a first-order formulation of the PDE loss function. We show that, compared to standard PINNs, FO-PINNs offer significantly higher accuracy in solving parameterized systems, and reduce time-per-iteration by removing the extra backpropagations needed to compute the second or higher-order derivatives. Additionally, FO-PINNs can enable exact imposition of boundary conditions using approximate distance functions, which pose challenges when applied on high-order PDEs. Through three examples, we demonstrate the advantages of FO-PINNs over standard PINNs in terms of accuracy and training speedup.


title: Artificial ASMR: A Cyber-Psychological Approach

abstract: The popularity of Autonomous Sensory Meridian Response (ASMR) has skyrockted over the past decade, but scientific studies on what exactly triggered ASMR effect remain few and immature, one most commonly acknowledged trigger is that ASMR clips typically provide rich semantic information. With our attention caught by the common acoustic patterns in ASMR audios, we investigate the correlation between the cyclic features of audio signals and their effectiveness in triggering ASMR effects. A cyber-psychological approach that combines signal processing, artificial intelligence, and experimental psychology is taken, with which we are able to quantize ASMR-related acoustic features, and therewith synthesize ASMR clips with random cyclic patterns but not delivering identifiably scenarios to the audience, which were proven to be effective in triggering ASMR effects.


title: ANACONDA: An Improved Dynamic Regret Algorithm for Adaptive Non-Stationary Dueling Bandits

abstract: We study the problem of non-stationary dueling bandits and provide the first adaptive dynamic regret algorithm for this problem. The only two existing attempts in this line of work fall short across multiple dimensions, including pessimistic measures of non-stationary complexity and non-adaptive parameter tuning that requires knowledge of the number of preference changes. We develop an elimination-based rescheduling algorithm to overcome these shortcomings and show a near-optimal $\tilde{O}(\sqrt{S^{\texttt{CW}} T})$ dynamic regret bound, where $S^{\texttt{CW}}$ is the number of times the Condorcet winner changes in $T$ rounds. This yields the first near-optimal dynamic regret algorithm for unknown $S^{\texttt{CW}}$. We further study other related notions of non-stationarity for which we also prove near-optimal dynamic regret guarantees under additional assumptions on the underlying preference model.


title: Field-induced spin level crossings within a quasi-XY antiferromagnetic state in Ba$_{2}$FeSi$_{2}$O$_{7}$

abstract: We present a high-field study of the strongly anisotropic easy-plane square lattice $S$ = 2 quantum magnet Ba$_{2}$FeSi$_{2}$O$_{7}$. This compound is a rare high-spin antiferromagnetic system with very strong easy-plane anisotropy, such that the interplay between spin level crossings and antiferromagnetic order can be studied. We observe a magnetic field-induced spin level crossing occurring within an ordered state. This spin level crossing appears to preserve the magnetic symmetry while producing a non-monotonic dependence the order parameter magnitude. The resulting temperature-magnetic field phase diagram exhibits two dome-shaped regions of magnetic order overlapping around 30 T. The ground state of the lower-field dome is predominantly a linear combination of $| S^{z} = 0 \rangle$ and $ |S^{z} = 1 \rangle$ states, while the ground state of the higher-field dome can be approximated by a linear combination of $| S^{z} = 1 \rangle $ and $ | S^{z} = 2\rangle$ states. At 30 T, where the spin levels cross, the magnetization exhibits a slanted plateau, {\color {black}the magnetocaloric effect shows a broad hump, and the electric polarization shows a weak slope change}. We determined the detailed magnetic phase boundaries and the spin level crossings using measurements of magnetization, electric polarization, and the magnetocaloric effect in pulsed magnetic fields to 60 T. We calculate these properties using a mean field theory based on direct products of SU(5) coherent states and find good agreement. Finally, we measure and calculate the magnetically-induced electric polarization that reflects magnetic ordering and spin level crossings. This multiferroic behavior provides another avenue for detecting phase boundaries and symmetry changes.


title: The Championship Simulator: Architectural Simulation for Education and Competition

abstract: Recent years have seen a dramatic increase in the microarchitectural complexity of processors. This increase in complexity presents a twofold challenge for the field of computer architecture. First, no individual architect can fully comprehend the complexity of the entire microarchitecture of the core. This leads to increasingly specialized architects, who treat parts of the core outside their particular expertise as black boxes. Second, with increasing complexity, the field becomes decreasingly accessible to new students of the field. When learning core microarchitecture, new students must first learn the big picture of how the system works in order to understand how the pieces all fit together. The tools used to study microarchitecture experience a similar struggle. As with the microarchitectures they simulate, an increase in complexity reduces accessibility to new users. In this work, we present ChampSim. ChampSim uses a modular design and configurable structure to achieve a low barrier to entry into the field of microarchitecural simulation. ChampSim has shown itself to be useful in multiple areas of research, competition, and education. In this way, we seek to promote access and inclusion despite the increasing complexity of the field of computer architecture.


title: Obtrusive Subtleness and Why We Should Focus on Meaning, not Form, in Social Acceptability Studies

abstract: Nowadays, interactive technologies are used almost everywhere. As a result, designers need to increasingly make them "socially acceptable". Previous work recommends "subtle" forms of interaction to increase social acceptability and avoid negative experiences. Although often appropriate, such uniform recommendations neglect the variety of social situations. We demonstrate this limitation in an experiment (N=35), by comparing the observer experience of different forms of interaction in "face-to-face conversations", a social situation rarely studied. Here, the typically recommended form of interaction ("subtle") led to a more negative observer experience than the usually deprecated form ("suspenseful"), in terms of affective experience and product perception. It also made the user appear less extraverted. We conclude by positioning interactions with technology not as separate from the social situation in which they are performed, but as a constitutive part of it that meaningfully relates to other situated activities.


title: Band selection and classification of hyperspectral images by minimizing normalized mutual information

abstract: Hyperspectral images (HSI) classification is a high technical remote sensing tool. The main goal is to classify the point of a region. The HIS contains more than a hundred bidirectional measures, called bands (or simply images), of the same region called Ground Truth Map (GT). Unfortunately, some bands contain redundant information, others are affected by the noise, and the high dimensionalities of features make the accuracy of classification lower. All these bands can be important for some applications, but for the classification a small subset of these is relevant. In this paper we use mutual information (MI) to select the relevant bands; and the Normalized Mutual Information coefficient to avoid and control redundant ones. This is a feature selection scheme and a Filter strategy. We establish this study on HSI AVIRIS 92AV3C. This is effectiveness, and fast scheme to control redundancy. Index Terms: Hyperspectral images, Classification, Feature Selection, Normalized Mutual Information, Redundancy.


title: Smart cloud collocation: geometry-aware adaptivity directly from CAD

abstract: Computer Aided Design (CAD) is widely used in the creation and optimization of various industrial systems and processes. Transforming a CAD geometry into a computational discretization that be used to solve PDEs requires care and a deep knowledge of the selected computational method. In this article, we present a novel integrated collocation scheme based on smart clouds. It allows us to transform a CAD geometry into a complete point collocation model, aware of the base geometry, with minimum effort. For this process, only the geometry of the domain, in the form of a STEP file, and the boundary conditions are needed. We also introduce an adaptive refinement process for the resultant smart cloud using an \textit{a posteriori} error indication. The scheme can be applied to any 2D or 3D geometry, to any PDE and can be applied to most point collocation approaches. We illustrate this with the meshfree Generalized Finite Difference (GFD) method applied to steady linear elasticity problems. We further show that each step of this process, from the initial discretization to the refinement strategy, is connected and is affected by the approach selected in the previous step, thus requiring an integrated scheme where the whole solution process should be considered at once.


title: Causal Analysis of Syntactic Agreement Neurons in Multilingual Language Models

abstract: Structural probing work has found evidence for latent syntactic information in pre-trained language models. However, much of this analysis has focused on monolingual models, and analyses of multilingual models have employed correlational methods that are confounded by the choice of probing tasks. In this study, we causally probe multilingual language models (XGLM and multilingual BERT) as well as monolingual BERT-based models across various languages; we do this by performing counterfactual perturbations on neuron activations and observing the effect on models' subject-verb agreement probabilities. We observe where in the model and to what extent syntactic agreement is encoded in each language. We find significant neuron overlap across languages in autoregressive multilingual language models, but not masked language models. We also find two distinct layer-wise effect patterns and two distinct sets of neurons used for syntactic agreement, depending on whether the subject and verb are separated by other tokens. Finally, we find that behavioral analyses of language models are likely underestimating how sensitive masked language models are to syntactic information.


title: Electric field-induced interfacial instability in a ferroelectric nematic liquid crystal

abstract: Studies of sessile droplets and fluid bridges of a ferroelectric nematic liquid crystal in externally applied electric fields are presented. It is found that above a threshold, the interface of the fluid with air undergoes a fingering instability or ramification, resembling to Rayleigh-type instability observed in charged droplets in electric fields or circular drop-type instabilities observed in ferromagnetic liquids in magnetic field. The frequency dependence of the threshold voltage was determined in various geometries. The nematic director and ferroelectric polarization direction was found to point along the tip of the fingers that appear to repel each other, indicating that the ferroelectric polarization is essentially parallel to the director. The results are interpreted in connection to the Rayleigh and circular drop-type instabilities.


title: A single-cell gene expression language model

abstract: Gene regulation is a dynamic process that connects genotype and phenotype. Given the difficulty of physically mapping mammalian gene circuitry, we require new computational methods to learn regulatory rules. Natural language is a valuable analogy to the communication of regulatory control. Machine learning systems model natural language by explicitly learning context dependencies between words. We propose a similar system applied to single-cell RNA expression profiles to learn context dependencies between genes. Our model, Exceiver, is trained across a diversity of cell types using a self-supervised task formulated for discrete count data, accounting for feature sparsity. We found agreement between the similarity profiles of latent sample representations and learned gene embeddings with respect to biological annotations. We evaluated Exceiver on a new dataset and a downstream prediction task and found that pretraining supports transfer learning. Our work provides a framework to model gene regulation on a single-cell level and transfer knowledge to downstream tasks.


title: Microcavity phonoritons -- a coherent optical-to-microwave interface

abstract: Optomechanical systems provide a pathway for the bidirectional optical-to-microwave interconversion in (quantum) networks. We demonstrate the implementation of this functionality and non-adiabatic optomechanical control in a single, $\mu$m-sized potential trap for phonons and exciton-polariton condensates in a structured semiconductor microcavity. The exciton-enhanced optomechanical coupling leads to self-oscillations (phonon lasing) -- thus proving reversible photon-to-phonon conversion. We show that these oscillations are a signature of the optomechanical strong coupling signalizing the emergence of elusive phonon-exciton-photon quasiparticles -- the phonoritons. We then demonstrate full control of the phonoriton spectrum as well as coherent microwave-to-photon interconversion using electrically generated GHz-vibrations and a resonant optical laser beam. These findings establish the zero-dimensional polariton condensates as a scalable coherent interface between microwave and optical domains with enhanced microwave-to-mechanical and mechanical-to-optical coupling rates.


title: On lax protomodularity of Ord-enriched categories

abstract: Our main focus concerns a possible lax version of the algebraic property of protomodularity for Ord-enriched categories. Our motivating example is the category OrdAb of preordered abelian groups; indeed, while abelian groups form a protomodular category, OrdAb does not. Having in mind the role of comma objects in the enriched context, we consider some of the characteristic properties of protomodularity with respect to comma objects instead of pullbacks. We show that the equivalence between protomodularity and certain properties on pullbacks also holds when replacing conveniently pullbacks by comma objects in any finitely complete category enriched in Ord, and propose to call lax protomodular such Ord-enriched categories. We conclude by studying this sort of lax protomodularity for OrdAb, equipped with a suitable Ord-enrichment, and show that OrdAb fulfills the equivalent lax protomodular properties with respect to the weaker notion of precomma object; we call such categories lax preprotomodular.


title: On multiscale quasi-interpolation of scattered scalar- and manifold-valued functions

abstract: We address the problem of approximating an unknown function from its discrete samples given at arbitrarily scattered sites. This problem is essential in numerical sciences, where modern applications also highlight the need for a solution to the case of functions with manifold values. In this paper, we introduce and analyze a combination of kernel-based quasi-interpolation and multiscale approximations for both scalar- and manifold-valued functions. While quasi-interpolation provides a powerful tool for approximation problems if the data is defined on infinite grids, the situation is more complicated when it comes to scattered data. Here, higher-order quasi-interpolation schemes either require derivative information or become numerically unstable. Hence, this paper principally studies the improvement achieved by combining quasi-interpolation with a multiscale technique. The main contributions of this paper are as follows. First, we introduce the multiscale quasi-interpolation technique for scalar-valued functions. Second, we show how this technique can be carried over using moving least-squares operators to the manifold-valued setting. Third, we give a mathematical proof that converging quasi-interpolation will also lead to converging multiscale quasi-interpolation. Fourth, we provide ample numerical evidence that multiscale quasi-interpolation has superior convergence to quasi-interpolation. In addition, we will provide examples showing that the multiscale quasi-interpolation approach offers a powerful tool for many data analysis tasks, such as denoising and anomaly detection. It is especially attractive for cases of massive data points and high dimensionality.


title: Numerical study of the twist-3 asymmetry $A_{LT}$ in single-inclusive electron-nucleon and proton-proton collisions

abstract: We provide the first rigorous numerical analysis of the longitudinal-transverse double-spin asymmetry $A_{LT}$ in electron-nucleon and proton-proton collisions for the case where only a single pion, jet, or photon is detected in the final state. Given recent extractions of certain, previously unknown, non-perturbative functions, we are able to compute contributions from all terms relevant for $A_{LT}$ and make realistic predictions for the observable at Jefferson Lab (JLab) 12 GeV, COMPASS, the future Electron-Ion Collider, and the Relativistic Heavy Ion Collider. We also compare our results to a JLab 6 GeV measurement, which are the only data available for this type of reaction. The twist-3 nature of $A_{LT}$ makes it a potentially fruitful avenue to probe quark-gluon-quark correlations in hadrons as well as provide insights into dynamical quark mass generation in QCD.


title: A Depolarizing Noise-aware Transpiler for Optimal Amplitude Amplification

abstract: Amplitude amplification provides a quadratic speed-up for an array of quantum algorithms when run on a quantum machine perfectly isolated from its environment. However, the advantage is substantially diminished as the NISQ-era quantum machines lack the large number of qubits necessary to provide error correction. Noise in the computation grows with the number of gate counts in the circuit with each iteration of amplitude amplification. After a certain number of amplifications, the loss in accuracy from the gate noise starts to overshadow the gain in accuracy due to amplification, forming an inflection point. Beyond this point, accuracy continues to deteriorate until the machine reaches a maximally mixed state where the result is uniformly random. Hence, quantum transpilers should take the noise parameters of the underlying quantum machine into consideration such that the circuit can be optimized to attain the maximal accuracy possible for that machine. In this work, we propose an extension to the transpiler that predicts the accuracy of the result at every amplification with high fidelity by applying pure Bayesian analysis to individual gate noise rates. Using this information, it finds the inflection point and optimizes the circuit by halting amplification at that point. The prediction is made without needing to execute the circuit either on a quantum simulator or an actual quantum machine.


title: Understanding the cosmic abundance of $^{22}$Na: lifetime measurements in $^{23}$Mg

abstract: Simulations of explosive nucleosynthesis in novae predict the production of $^{22}$Na, a key astronomical observable to constrain nova models. Its gamma-ray line at 1.275 MeV has not yet been observed by the gamma-ray space telescopes. The $^{20}$Ne/$^{22}$Ne ratio in presolar grains, a possible tool to identify nova grains, also depends on $^{22}$Na produced. Uncertainties on its yield in classical novae currently originate from the rate of the $^{22}$Na(p, $\gamma$)$^{23}$Mg reaction. At peak novae temperatures, this reaction is dominated by a resonance at E$_{\text{R}}$=0.204 MeV, corresponding to the $E_x$=7.785 MeV excited state in $^{23}$Mg. The resonance strengths measured so far disagree by one order of magnitude. An experiment has been performed at GANIL to measure the lifetime and the proton branching ratio of this key state, with a femtosecond resolution for the former. The reactions populating states in $^{23}$Mg have been studied with a high resolution detection set-up, i.e. the particle VAMOS, SPIDER and gamma tracking AGATA spectrometers, allowing the measurements of lifetimes and proton branchings. We present here a comparison between experimental results and shell-model calculations, that allowed us to assign the spin and parity of the key state. Rather small values obtained for reduced $M1$ matrix elements, $|M(M1)|\lesssim 0.5$ $\mu_N$, and proton spectroscopic factors, $C^{2}S_{\text{p}}$<10$^{-2}$, seem to be beyond the accuracy of the shell model. With the reevaluated $^{22}$Na(p, $\gamma$)$^{23}$Mg rate, the $^{22}$Na detectability limit and its observation frequency from novae are found promising for the future space telescopes.


title: On coherent systems of subobjects with application to torsion theory

abstract: In a coherent category, the posets of subobjects have very strong properties. We emphasize the validity of these properties, in general categories, for well-behaved classes of subobjects. As an example of application, we investigate the problem of the various torsion theories which can be universally associated with a pretorsion one.


title: Proton-neutron entanglement in the nuclear shell model

abstract: We compute the proton-neutron entanglement entropy in the interacting nuclear shell model for a variety of nuclides and interactions. Some results make intuitive sense, for example that the shell structure, as governed by single-particle and monopole energies, strongly affects the energetically available space and thus the entanglement entropy. We also find a surprising result: that the entanglement entropy at low excitation energy tends to decrease for nuclides when $N \neq Z$. While we provide evidence this arises from the physical nuclear force by contrasting with random two-body interactions which shows no such decrease, the exact mechanism is unclear. Nonetheless, the low entanglement suggests that in models of neutron-rich nuclides, the coupling between protons and neutrons may be less computationally demanding than one might otherwise expect.


title: Converting dark matter to dark radiation does not solve cosmological tensions

abstract: Tensions between cosmological parameters (in particular the local expansion rate $H_0$ and the amplitude of matter clustering $S_8$) inferred from low-redshift data and data from the cosmic microwave background (CMB) and large-scale structure (LSS) experiments have inspired many extensions to the standard cosmological model, $\Lambda$CDM. Models which simultaneously lessen both tensions are of particular interest. We consider one scenario with the potential for such a resolution, in which some fraction of the dark matter has converted into dark radiation since the release of the CMB. Such a scenario encompasses and generalizes the more standard "decaying dark matter" model, allowing additional flexibility in the rate and time at which the dark matter converts into dark radiation. In this paper, we constrain this scenario with a focus on exploring whether it can solve (or reduce) these tensions. We find that such a model is effectively ruled out by low-$\ell$ CMB data, in particular by the reduced peak-smearing due to CMB lensing and the excess Integrated Sachs--Wolfe (ISW) signal caused by the additional dark energy density required to preserve flatness after dark matter conversion into dark radiation. Thus, such a model does not have the power to reduce these tensions without further modifications. This conclusion extends and generalizes related conclusions derived for the standard decaying dark matter model.


title: A parametric approach to the estimation of convex risk functionals based on Wasserstein distance

abstract: In this paper, we explore a static setting for the assessment of risk in the context of mathematical finance and actuarial science that takes into account model uncertainty in the distribution of a possibly infinite-dimensional risk factor. We allow for perturbations around a baseline model, measured via Wasserstein distance, and we investigate to which extent this form of probabilistic imprecision can be parametrized. The aim is to come up with a convex risk functional that incorporates a sefety margin with respect to nonparametric uncertainty and still can be approximated through parametrized models. The particular form of the parametrization allows us to develop a numerical method, based on neural networks, which gives both the value of the risk functional and the optimal perturbation of the reference measure. Moreover, we study the problem under additional constraints on the perturbations, namely, a mean and a martingale constraint. We show that, in both cases, under suitable conditions on the loss function, it is still possible to estimate the risk functional by passing to a parametric family of perturbed models, which again allows for a numerical approximation via neural networks.


title: Modular Software for Real-Time Quantum Control Systems

abstract: Real-time control software and hardware is essential for operating quantum computers. In particular, the software plays a crucial role in bridging the gap between quantum programs and the quantum system. Unfortunately, current control software is often optimized for a specific system at the cost of flexibility and portability. We propose a systematic design strategy for modular real-time quantum control software and demonstrate that modular control software can reduce the execution time overhead of kernels by 63.3% on average while not increasing the binary size. Our analysis shows that modular control software for two distinctly different systems can share between 49.8% and 91.0% of covered code statements. To demonstrate the modularity and portability of our software architecture, we run a portable randomized benchmarking experiment on two different ion-trap quantum systems.


title: Constant-adiabaticity ultralow magnetic field manipulations of parahydrogen-induced polarization: application to an AA'X spin system

abstract: The field of magnetic resonance imaging with hyperpolarized contrast agents is rapidly expanding, and parahydrogen-induced polarization (PHIP) is emerging as an inexpensive and easy-to-implement method for generating the required hyperpolarized biomolecules. Hydrogenative PHIP delivers hyperpolarized proton spin order to a substrate via chemical addition of H2 in the spin-singlet state, but prior to imaging it is typically necessary to transfer the proton polarization to a heteronucleus (usually 13C) in the molecule. Adiabatic ultralow magnetic field manipulations can be used to induce the polarization transfer, but this is necessarily a slow process, which is undesirable since the spins continually relax back to thermal equilibrium. Here we demonstrate constant-adiabaticity field cycling and field sweeping for optimal polarization transfer on a model AA$'$X spin system, [1-13C]fumarate. We introduce a method for calculating constant-adiabaticity magnetic field ramps and demonstrate that they enable much faster spin-order conversion as compared to linear ramps used before. The present method can thus be utilized to manipulate nonthermal order in heteronuclear spin systems.


title: Enhanced mobility of dislocation network nodes and its effect on dislocation multiplication and strain hardening

abstract: Understanding plastic deformation of crystals in terms of the fundamental physics of dislocations has remained a grand challenge in materials science for decades. To overcome this, the Discrete Dislocation Dynamics (DDD) method has been developed, but its lack of atomistic resolution leaves open the possibility that certain key mechanisms may be overlooked. By comparing large-scale Molecular Dynamics (MD) with DDD simulations performed under identical conditions we uncover significant discrepancies in the predicted strength and microstructure evolution in BCC crytals under high-strain rate conditions. These are traced to unexpected behaviors of dislocation network nodes forming at dislocation intersections, that can move in ways not previously anticipated as revealed by MD. Once these newfound freedoms of nodal motion are incorporated, DDD simulations begin to closely match plastic evolution observed in MD. This additional mechanism of motion whereby non-screw dislocations can change their glide plane profoundly affects fundamental processes of dislocation multiplication, recovery and storage that define strength of metals.


title: A Prym Hypergeometric

abstract: We study a hypergeometric local system that arises from the quantum Chen-Ruan cohomology of a family of weighted del Pezzo hypersurfaces. We prove that it is the anti-invariant variation of a pencil of genus-7 curves with respect to an involution having 4 fixed points.


title: Dissipation wavenumber and regularity for electron magnetohydrodynamics

abstract: We consider the electron magnetohydrodynamics (MHD) with static background ion flow. A special situation of $B(x,y,t)=\nabla\times (a\vec e_z)+b \vec e_z$ with scalar-valued functions $a(x,y,t)$ and $b(x,y,t)$ was studied numerically in the physics paper [7]. The authors concluded from numerical simulations that there is no evidence of dissipation cutoff for the electron MHD. In this paper we show the existence of determining wavenumber for the electron MHD, and establish a regularity condition only on the low modes of the solution. Our results suggest that the conclusion of the physics paper on the dissipation cutoff for the electron MHD is debatable.


title: New wrapper method based on normalized mutual information for dimension reduction and classification of hyperspectral images

abstract: Feature selection is one of the most important problems in hyperspectral images classification. It consists to choose the most informative bands from the entire set of input datasets and discard the noisy, redundant and irrelevant ones. In this context, we propose a new wrapper method based on normalized mutual information (NMI) and error probability (PE) using support vector machine (SVM) to reduce the dimensionality of the used hyperspectral images and increase the classification efficiency. The experiments have been performed on two challenging hyperspectral benchmarks datasets captured by the NASA's Airborne Visible/Infrared Imaging Spectrometer Sensor (AVIRIS). Several metrics had been calculated to evaluate the performance of the proposed algorithm. The obtained results prove that our method can increase the classification performance and provide an accurate thematic map in comparison with other reproduced algorithms. This method may be improved for more classification efficiency. Keywords-Feature selection, hyperspectral images, classification, wrapper, normalized mutual information, support vector machine.


title: Interpolating Discriminant Functions in High-Dimensional Gaussian Latent Mixtures

abstract: This paper considers binary classification of high-dimensional features under a postulated model with a low-dimensional latent Gaussian mixture structure and non-vanishing noise. A generalized least squares estimator is used to estimate the direction of the optimal separating hyperplane. The estimated hyperplane is shown to interpolate on the training data. While the direction vector can be consistently estimated as could be expected from recent results in linear regression, a naive plug-in estimate fails to consistently estimate the intercept. A simple correction, that requires an independent hold-out sample, renders the procedure minimax optimal in many scenarios. The interpolation property of the latter procedure can be retained, but surprisingly depends on the way the labels are encoded.


title: Synthetic Text Generation with Differential Privacy: A Simple and Practical Recipe

abstract: Privacy concerns have attracted increasing attention in data-driven products due to the tendency of machine learning models to memorize sensitive training data. Generating synthetic versions of such data with a formal privacy guarantee, such as differential privacy (DP), provides a promising path to mitigating these privacy concerns, but previous approaches in this direction have typically failed to produce synthetic data of high quality. In this work, we show that a simple and practical recipe in the text domain is effective: simply fine-tuning a pretrained generative language model with DP enables the model to generate useful synthetic text with strong privacy protection. Through extensive empirical analyses on both benchmark and private customer data, we demonstrate that our method produces synthetic text that is competitive in terms of utility with its non-private counterpart, meanwhile providing strong protection against potential privacy leakages.


title: A DirectX-Based DICOM Viewer for Multi-User Surgical Planning in Augmented Reality

abstract: Preoperative medical imaging is an essential part of surgical planning. The data from medical imaging devices, such as CT and MRI scanners, consist of stacks of 2D images in DICOM format. Conversely, advances in 3D data visualization provide further information by assembling cross-sections into 3D volumetric datasets. As Microsoft unveiled the HoloLens 2 (HL2), which is considered one of the best Mixed Reality (XR) headsets in the market, it promised to enhance visualization in 3D by providing an immersive experience to users. This paper introduces a prototype holographic XR DICOM Viewer for the 3D visualization of DICOM image sets on HL2 for surgical planning. We first developed a standalone graphical C++ engine using the native DirectX11 API and HLSL shaders. Based on that, the prototype further applies the OpenXR API for potential deployment on a wide range of devices from vendors across the XR spectrum. With native access to the device, our prototype unravels the limitation of hardware capabilities on HL2 for 3D volume rendering and interaction. Moreover, smartphones can act as input devices to provide another user interaction method by connecting to our server. In this paper, we present a holographic DICOM viewer for the HoloLens 2 and contribute (i) a prototype that renders the DICOM image stacks in real-time on HL2, (ii) three types of user interactions in XR, and (iii) a preliminary qualitative evaluation of our prototype.


title: Detection and estimation of spacecraft maneuvers for catalog maintenance

abstract: Building and maintaining a catalog of resident space objects involves several tasks, ranging from observations to data analysis. Once acquired, the knowledge of a space object needs to be updated following a dedicated observing schedule. Dynamics mismodeling and unknown maneuvers can alter the catalog's accuracy, resulting in uncorrelated observations originating from the same object. Starting from two independent orbits, this work presents a novel approach to detect and estimate maneuvers of resident space objects, which allows for correlation recovery. The estimation is performed with successive convex optimization without a-priori assumption on the thrust arcs structure and thrust direction.


title: Arc travel time and path choice model estimation subsumed

abstract: We propose a method for maximum likelihood estimation of path choice model parameters and arc travel time using data of different levels of granularity. Hitherto these two tasks have been tackled separately under strong assumptions. Using a small example, we illustrate that this can lead to biased results. Results on both real (New York yellow cab) and simulated data show strong performance of our method compared to existing baselines.


title: Anatomy of the Electroweak Phase Transition for Dark Sector induced Baryogenesis

abstract: We investigate the electroweak phase transition patterns for a recently proposed baryogenesis model with CP violation originated in the dark sector. The model includes a complex scalar singlet-Higgs boson portal, a $U(1)_l$ gauge lepton symmetry with a $Z^\prime$ gauge boson portal and a fermionic dark matter particle. We find a novel thermal history of the scalar sector, featuring a $Z_2$ breaking singlet vacuum in the early Universe driven by a dark Yukawa coupling, that induces a one-step strongly first order electroweak phase transition. We explore the parameter space that generates the observed matter-antimatter asymmetry and dark matter relic abundance, while being consistent with constraints from electric dipole moment and collider searches, and dark matter direct detection bounds. The complex singlet can be produced via the Higgs portal and decays into Standard Model particles after traveling a certain distance. We explore the reach for long-lived singlet scalars at the {\unit[13]{TeV}} Large Hadron Collider with $\mathcal{L}=\unit[139]{fb^{-1}}$ and show its impact on the parameter space of the model. Setting aside currently unresolved theoretical uncertainties, we estimate the gravitational wave signatures detectable at future observatories.


title: RoMQA: A Benchmark for Robust, Multi-evidence, Multi-answer Question Answering

abstract: We introduce RoMQA, the first benchmark for robust, multi-evidence, multi-answer question answering (QA). RoMQA contains clusters of questions that are derived from related constraints mined from the Wikidata knowledge graph. RoMQA evaluates robustness of QA models to varying constraints by measuring worst-case performance within each question cluster. Compared to prior QA datasets, RoMQA has more human-written questions that require reasoning over more evidence text and have, on average, many more correct answers. In addition, human annotators rate RoMQA questions as more natural or likely to be asked by people. We evaluate state-of-the-art large language models in zero-shot, few-shot, and fine-tuning settings, and find that RoMQA is challenging: zero-shot and few-shot models perform similarly to naive baselines, while supervised retrieval methods perform well below gold evidence upper bounds. Moreover, existing models are not robust to variations in question constraints, but can be made more robust by tuning on clusters of related questions. Our results show that RoMQA is a challenging benchmark for large language models, and provides a quantifiable test to build more robust QA methods.


title: Bayesian Estimation of the $S$ Factor and Thermonuclear Reaction Rate for $^{16}$O(p,$\gamma$)$^{17}$F

abstract: The $^{16}$O(p,$\gamma$)$^{17}$F reaction is the slowest hydrogen-burning process in the CNO mass region. Its thermonuclear rate sensitively impacts predictions of oxygen isotopic ratios in a number of astrophysical sites, including AGB stars. The reaction has been measured several times at low bombarding energies using a variety of techniques. The most recent evaluated experimental rates have a reported uncertainty of about 7.5\% below $1$~GK. However, the previous rate estimate represents a best guess only and was not based on rigorous statistical methods. We apply a Bayesian model to fit all reliable $^{16}$O(p,$\gamma$)$^{17}$F cross section data, and take into account independent contributions of statistical and systematic uncertainties. The nuclear reaction model employed is a single-particle potential model involving a Woods-Saxon potential for generating the radial bound state wave function. The model has three physical parameters, the radius and diffuseness of the Woods-Saxon potential, and the asymptotic normalization coefficients (ANCs) of the final bound state in $^{17}$F. We find that performing the Bayesian $S$ factor fit using ANCs as scaling parameters has a distinct advantage over adopting spectroscopic factors instead. Based on these results, we present the first statistically rigorous estimation of experimental $^{16}$O(p,$\gamma$)$^{17}$F reaction rates, with uncertainties ($\pm 4.2$\%) of about half the previously reported values.


title: Parameter-free Regret in High Probability with Heavy Tails

abstract: We present new algorithms for online convex optimization over unbounded domains that obtain parameter-free regret in high-probability given access only to potentially heavy-tailed subgradient estimates. Previous work in unbounded domains considers only in-expectation results for sub-exponential subgradients. Unlike in the bounded domain case, we cannot rely on straight-forward martingale concentration due to exponentially large iterates produced by the algorithm. We develop new regularization techniques to overcome these problems. Overall, with probability at most $\delta$, for all comparators $\mathbf{u}$ our algorithm achieves regret $\tilde{O}(\| \mathbf{u} \| T^{1/\mathfrak{p}} \log (1/\delta))$ for subgradients with bounded $\mathfrak{p}^{th}$ moments for some $\mathfrak{p} \in (1, 2]$.


title: New regularity and uniqueness results in the multidimensional Calculus of Variations

abstract: In the first part of this doctoral thesis we develop a regularity theory for a polyconvex functional in compressible elasticity. In the second part, we will concentrate on uniqueness questions in various situations of finite elasticity. Here it is our main objective to establish uniqueness criteria, which when present, guarantee the uniqueness of the corresponding global minimizer. Then various applications and generalisations are discussed one of which is the construction of a counterexample to regularity.


title: Diffusive Exit Rates Through Pores in Membrane-Enclosed Structures

abstract: The function of many membrane-enclosed intracellular structures relies on release of diffusing particles that exit through narrow pores or channels in the membrane. The rate of release varies with pore size, density, and length of the channel. We propose a simple approximate model, validated with stochastic simulations, for estimating the effective release rate from cylinders, and other simple-shaped domains, as a function of channel parameters. The results demonstrate that, for very small pores, a low density of channels scattered over the boundary is sufficient to achieve substantial rates of particle release. Furthermore, we show that increasing the length of passive channels will both reduce release rates and lead to a less steep dependence on channel density. Our results are compared to previously-measured local calcium release rates from tubules of the endoplasmic reticulum, providing an estimate of the relevant channel density responsible for the observed calcium efflux.


title: Multi-Domain Long-Tailed Learning by Augmenting Disentangled Representations

abstract: There is an inescapable long-tailed class-imbalance issue in many real-world classification problems. Current methods for addressing this problem only consider scenarios where all examples come from the same distribution. However, in many cases, there are multiple domains with distinct class imbalance. We study this multi-domain long-tailed learning problem and aim to produce a model that generalizes well across all classes and domains. Towards that goal, we introduce TALLY, a method that addresses this multi-domain long-tailed learning problem. Built upon a proposed selective balanced sampling strategy, TALLY achieves this by mixing the semantic representation of one example with the domain-associated nuisances of another, producing a new representation for use as data augmentation. To improve the disentanglement of semantic representations, TALLY further utilizes a domain-invariant class prototype that averages out domain-specific effects. We evaluate TALLY on several benchmarks and real-world datasets and find that it consistently outperforms other state-of-the-art methods in both subpopulation and domain shift. Our code and data have been released at https://github.com/huaxiuyao/TALLY.


title: Deformation Spaces, Rescaled Bundles and the Kirillov Character Formula

abstract: In this paper, we construct a smooth vector bundle over the deformation to the normal cone $\text{DNC}(V,M)$ through a rescaling of a vector bundle $E\to V$, which generalizes the construction of the spinor rescaled bundle over the tangent groupoid by Nigel Higson and Zelin Yi. We also provide an equivariant version of their construction. As the main application, we recover the Kirillov character formula for the equivariant index of Dirac-type operators. As another application, we get an equivariant generalization of the description of the Witten and the Novikov deformations of the de Rham-Dirac operator using the deformation to the normal cone obtained recently by O. Mohsen.


title: LaundroGraph: Self-Supervised Graph Representation Learning for Anti-Money Laundering

abstract: Anti-money laundering (AML) regulations mandate financial institutions to deploy AML systems based on a set of rules that, when triggered, form the basis of a suspicious alert to be assessed by human analysts. Reviewing these cases is a cumbersome and complex task that requires analysts to navigate a large network of financial interactions to validate suspicious movements. Furthermore, these systems have very high false positive rates (estimated to be over 95\%). The scarcity of labels hinders the use of alternative systems based on supervised learning, reducing their applicability in real-world applications. In this work we present LaundroGraph, a novel self-supervised graph representation learning approach to encode banking customers and financial transactions into meaningful representations. These representations are used to provide insights to assist the AML reviewing process, such as identifying anomalous movements for a given customer. LaundroGraph represents the underlying network of financial interactions as a customer-transaction bipartite graph and trains a graph neural network on a fully self-supervised link prediction task. We empirically demonstrate that our approach outperforms other strong baselines on self-supervised link prediction using a real-world dataset, improving the best non-graph baseline by $12$ p.p. of AUC. The goal is to increase the efficiency of the reviewing process by supplying these AI-powered insights to the analysts upon review. To the best of our knowledge, this is the first fully self-supervised system within the context of AML detection.


title: Auxiliary task discovery through generate-and-test

abstract: In this paper, we explore an approach to auxiliary task discovery in reinforcement learning based on ideas from representation learning. Auxiliary tasks tend to improve data efficiency by forcing the agent to learn auxiliary prediction and control objectives in addition to the main task of maximizing reward, and thus producing better representations. Typically these tasks are designed by people. Meta-learning offers a promising avenue for automatic task discovery; however, these methods are computationally expensive and challenging to tune in practice. In this paper, we explore a complementary approach to the auxiliary task discovery: continually generating new auxiliary tasks and preserving only those with high utility. We also introduce a new measure of auxiliary tasks usefulness based on how useful the features induced by them are for the main task. Our discovery algorithm significantly outperforms random tasks, hand-designed tasks, and learning without auxiliary tasks across a suite of environments.


title: Federated Learning Using Variance Reduced Stochastic Gradient for Probabilistically Activated Agents

abstract: This paper proposes an algorithm for Federated Learning (FL) with a two-layer structure that achieves both variance reduction and a faster convergence rate to an optimal solution in the setting where each agent has an arbitrary probability of selection in each iteration. In distributed machine learning, when privacy matters, FL is a functional tool. Placing FL in an environment where it has some irregular connections of agents (devices), reaching a trained model in both an economical and quick way can be a demanding job. The first layer of our algorithm corresponds to the model parameter propagation across agents done by the server. In the second layer, each agent does its local update with a stochastic and variance-reduced technique called Stochastic Variance Reduced Gradient (SVRG). We leverage the concept of variance reduction from stochastic optimization when the agents want to do their local update step to reduce the variance caused by stochastic gradient descent (SGD). We provide a convergence bound for our algorithm which improves the rate from $O(\frac{1}{\sqrt{K}})$ to $O(\frac{1}{K})$ by using a constant step-size. We demonstrate the performance of our algorithm using numerical examples.


title: Enhancing Product Safety in E-Commerce with NLP

abstract: Ensuring safety of the products offered to the customers is of paramount importance to any e- commerce platform. Despite stringent quality and safety checking of products listed on these platforms, occasionally customers might receive a product that can pose a safety issue arising out of its use. In this paper, we present an innovative mechanism of how a large scale multinational e-commerce platform, Zalando, uses Natural Language Processing techniques to assist timely investigation of the potentially unsafe products mined directly from customer written claims in unstructured plain text. We systematically describe the types of safety issues that concern Zalando customers. We demonstrate how we map this core business problem into a supervised text classification problem with highly imbalanced, noisy, multilingual data in a AI-in-the-loop setup with a focus on Key Performance Indicator (KPI) driven evaluation. Finally, we present detailed ablation studies to show a comprehensive comparison between different classification techniques. We conclude the work with how this NLP model was deployed.