title: Exact mobility edges in Aubry-Andr\'{e}-Harper models with relative phases

abstract: Mobility edge (ME), a critical energy separating localized and extended states in spectrum, is a central concept in understanding the localization physics. However, there are few models with exact MEs. In the paper, we generalize the Aubry-Andr\'{e}-Harper model proposed in [Phys. Rev. Lett. 114, 146601 (2015)] and recently realized in [Phys. Rev. Lett. 126, 040603 (2021)], by introducing a relative phase in the quasiperiodic potential. Applying Avila's global theory we analytically compute localization lengths of all single-particle states and determine the exact expression of ME, which both significantly depend on the relative phase. They are verified by numerical simulations, and a physical perception of the exact expression is also provided. We further demonstrate that the exact expression of ME works for an even broad class of generalized Aubry-Andr\'{e}-Harper models. Moreover, we show that the exact ME is related to the one in the dual model which has long-range hoppings.


title: Numerically "exact" simulations of a quantum Carnot cycle: Analysis using thermodynamic work diagrams

abstract: We investigate the efficiency of a quantum Carnot engine based on open quantum dynamics theory. The model includes time-dependent external fields for the subsystems controlling the isothermal and isentropic processes and for the system--bath (SB) interactions controlling the transition between these processes. Numerical simulations are conducted in a nonperturbative and non-Markovian SB coupling regime using the hierarchical equations of motion under these fields at different cycle frequencies. The work applied to the total system and the heat exchanged with the baths are rigorously evaluated. In addition, by regarding quasi-static work as free energy, we compute the quantum thermodynamic variables and analyze the simulation results using thermodynamic work diagrams for the first time. Analysis of these diagrams indicates that, in the strong SB coupling region, the fields for the SB interactions are major sources of work, while in other regions, the field for the subsystem is a source of work. We find that the maximum efficiency is achieved in the quasi-static case and is determined solely by the bath temperatures, regardless of the SB coupling strength, which is a numerical manifestation of Carnot's theorem.


title: PSI Draft Specification

abstract: This document presents the draft specification for delivering machine learning services over HTTP, developed as part of the Protocols and Structures for Inference project, which concluded in 2013. It presents the motivation for providing machine learning as a service, followed by a description of the essential and optional components of such a service.


title: Spatial Autoregressive Coding for Graph Neural Recommendation

abstract: Graph embedding methods including traditional shallow models and deep Graph Neural Networks (GNNs) have led to promising applications in recommendation. Nevertheless, shallow models especially random-walk-based algorithms fail to adequately exploit neighbor proximity in sampled subgraphs or sequences due to their optimization paradigm. GNN-based algorithms suffer from the insufficient utilization of high-order information and easily cause over-smoothing problems when stacking too much layers, which may deteriorate the recommendations of low-degree (long-tail) items, limiting the expressiveness and scalability. In this paper, we propose a novel framework SAC, namely Spatial Autoregressive Coding, to solve the above problems in a unified way. To adequately leverage neighbor proximity and high-order information, we design a novel spatial autoregressive paradigm. Specifically, we first randomly mask multi-hop neighbors and embed the target node by integrating all other surrounding neighbors with an explicit multi-hop attention. Then we reinforce the model to learn a neighbor-predictive coding for the target node by contrasting the coding and the masked neighbors' embedding, equipped with a new hard negative sampling strategy. To learn the minimal sufficient representation for the target-to-neighbor prediction task and remove the redundancy of neighbors, we devise Neighbor Information Bottleneck by maximizing the mutual information between target predictive coding and the masked neighbors' embedding, and simultaneously constraining those between the coding and surrounding neighbors' embedding. Experimental results on both public recommendation datasets and a real scenario web-scale dataset Douyin-Friend-Recommendation demonstrate the superiority of SAC compared with state-of-the-art methods.


title: Operator estimates for non-periodically perforated domains with Dirichlet and nonlinear Robin conditions: strange term

abstract: We consider a boundary value problem for a general second order linear equation in a domain with a fine perforation. The latter is made by small cavities; both the shapes of the cavities and their distribution are arbitrary. The boundaries of the cavities are subject either to a Dirichlet or a nonlinear Robin condition. On the perforation, certain rather weak conditions are imposed to ensure that under the homogenization we obtain a similar problem in a non-perforated domain with an additional potential in the equation usually called a strange term. Our main results state the convergence of the solution of the perturbed problem to that of the homogenized one in $W_2^1$- and $L_2$-norms uniformly in $L_2$-norm of the right hand side in the equation. The estimates for the convergence rates are established and their order sharpness is discussed.


title: Quantum associative memory with a single driven-dissipative nonlinear oscillator

abstract: Algorithms for associative memory typically rely on a network of many connected units. The prototypical example is the Hopfield model, whose generalizations to the quantum realm are mainly based on open quantum Ising models. We propose a realization of associative memory with a single driven-dissipative quantum oscillator exploiting its infinite degrees of freedom in phase space. The model can improve the storage capacity of discrete neuron-based systems in a large regime and we prove successful state discrimination between $n$ coherent states, which represent the stored patterns of the system. These can be tuned continuously by modifying the driving strength, constituting a modified learning rule. We show that the associative-memory capacity is inherently related to the existence of a spectral gap in the Liouvillian superoperator, which results in a large timescale separation in the dynamics corresponding to a metastable phase.


title: H\"older and Kurokawa meet Borwein--Dykshoorn and Adamchik

abstract: Following our discovery of a nice identity in a recent preprint of Hu and Kim, we show a link between the Kurokawa multiple trigonometric functions and two functions introduced respectively by Borwein-Dykshoorn and by Adamchik. In particular several identities involving $\zeta(3)$, $\pi$ and the Catalan constant $G$ that are proved in these three papers are related.


title: Dockerized Android: a container-based platform to build mobile Android scenarios for Cyber Ranges

abstract: The best way to train people about security is through Cyber Ranges, i.e., the virtual platform used by cyber-security experts to learn new skills and attack vectors. In order to realize such virtual scenarios, container-based virtualization is commonly adopted, as it provides several benefits in terms of performance, resource usage, and portability. Unfortunately, the current generation of Cyber Ranges does not consider mobile devices, which nowadays are ubiquitous in our daily lives. Such devices do often represent the very first entry point for hackers into target networks. It is thus important to make available tools allowing to emulate mobile devices in a safe environment without incurring the risk of causing any damage in the real world. This work aims to propose Dockerized Android, i.e., a framework that addresses the problem of realizing vulnerable environments for mobile devices in the next generation of Cyber Ranges. We show the platform's design and implementation and show how it is possible to use the implemented features to realize complex virtual mobile kill-chains scenarios.


title: Differentially private Riemannian optimization

abstract: In this paper, we study the differentially private empirical risk minimization problem where the parameter is constrained to a Riemannian manifold. We introduce a framework of differentially private Riemannian optimization by adding noise to the Riemannian gradient on the tangent space. The noise follows a Gaussian distribution intrinsically defined with respect to the Riemannian metric. We adapt the Gaussian mechanism from the Euclidean space to the tangent space compatible to such generalized Gaussian distribution. We show that this strategy presents a simple analysis as compared to directly adding noise on the manifold. We further show privacy guarantees of the proposed differentially private Riemannian (stochastic) gradient descent using an extension of the moments accountant technique. Additionally, we prove utility guarantees under geodesic (strongly) convex, general nonconvex objectives as well as under the Riemannian Polyak-{\L}ojasiewicz condition. We show the efficacy of the proposed framework in several applications.


title: Learning Feature Fusion for Unsupervised Domain Adaptive Person Re-identification

abstract: Unsupervised domain adaptive (UDA) person re-identification (ReID) has gained increasing attention for its effectiveness on the target domain without manual annotations. Most fine-tuning based UDA person ReID methods focus on encoding global features for pseudo labels generation, neglecting the local feature that can provide for the fine-grained information. To handle this issue, we propose a Learning Feature Fusion (LF2) framework for adaptively learning to fuse global and local features to obtain a more comprehensive fusion feature representation. Specifically, we first pre-train our model within a source domain, then fine-tune the model on unlabeled target domain based on the teacher-student training strategy. The average weighting teacher network is designed to encode global features, while the student network updating at each iteration is responsible for fine-grained local features. By fusing these multi-view features, multi-level clustering is adopted to generate diverse pseudo labels. In particular, a learnable Fusion Module (FM) for giving prominence to fine-grained local information within the global feature is also proposed to avoid obscure learning of multiple pseudo labels. Experiments show that our proposed LF2 framework outperforms the state-of-the-art with 73.5% mAP and 83.7% Rank1 on Market1501 to DukeMTMC-ReID, and achieves 83.2% mAP and 92.8% Rank1 on DukeMTMC-ReID to Market1501.


title: Exponential convergence of weighted Birkhoff average

abstract: In this paper, we consider the polynomial and exponential convergence rate of weighted Birkhoff averages of irrational rotations on tori. It is shown that these can be achieved for finite and infinite dimensional tori which correspond to the quasiperiodic and almost periodic dynamical systems respectively, under certain balance between the nonresonant condition and the decay rate of the Fourier coefficients. Diophantine rotations with finite and infinite dimensions are provided as examples. For the first time, we prove the universality of exponential convergence and arbitrary polynomial convergence in the quasiperiodic case and almost periodic case under analyticity respectively.


title: Psychiatric Scale Guided Risky Post Screening for Early Detection of Depression

abstract: Depression is a prominent health challenge to the world, and early risk detection (ERD) of depression from online posts can be a promising technique for combating the threat. Early depression detection faces the challenge of efficiently tackling streaming data, balancing the tradeoff between timeliness, accuracy and explainability. To tackle these challenges, we propose a psychiatric scale guided risky post screening method that can capture risky posts related to the dimensions defined in clinical depression scales, and providing interpretable diagnostic basis. A Hierarchical Attentional Network equipped with BERT (HAN-BERT) is proposed to further advance explainable predictions. For ERD, we propose an online algorithm based on an evolving queue of risky posts that can significantly reduce the number of model inferences to boost efficiency. Experiments show that our method outperforms the competitive feature-based and neural models under conventional depression detection settings, and achieves simultaneous improvement in both efficacy and efficiency for ERD.


title: Demonstration of fully integrated parity-time-symmetric electronics

abstract: Harnessing parity-time (PT) symmetry with balanced gain and loss profiles has created a variety of opportunities in electronics from wireless energy transfer to telemetry sensing and topological defect engineering. However, existing implementations often employ ad-hoc approaches at low operating frequencies and are unable to accommodate large-scale integration. Here, we report a fully integrated realization of PT-symmetry in a standard complementary metal-oxide-semiconductor technology. Our work demonstrates salient PT-symmetry features such as phase transition as well as the ability to manipulate broadband microwave generation and propagation beyond the limitations encountered by exiting schemes. The system shows 2.1 times bandwidth and 30 percentage noise reduction compared to conventional microwave generation in oscillatory mode and displays large non-reciprocal microwave transport from 2.75 to 3.10 gigahertz in non-oscillatory mode due to enhanced nonlinearities. This approach could enrich integrated circuit (IC) design methodology beyond well-established performance limits and enable the use of scalable IC technology to study topological effects in high-dimensional non-Hermitian systems.


title: Static Output Feedback Synthesis of Time-Delay Linear Systems via Deep Unfolding

abstract: We propose a deep unfolding-based approach for stabilization of time-delay linear systems. Deep unfolding is an emerging framework for design and improvement of iterative algorithms and attracting significant attentions in signal processing. In this paper, we propose an algorithm to design a static output feedback gain for stabilizing time-delay linear systems via deep unfolding. Within the algorithm, the learning part is driven by NeuralODE developed in the community of machine learning, while the gain verification is performed with linear matrix inequalities developed in the systems and control theory. The effectiveness of the proposed algorithm is illustrated with numerical simulations.


title: Role of hidden spin polarization in non-reciprocal transport of antiferromagnets

abstract: The discovery of hidden spin polarization (HSP) in centrosymmetric nonmagnetic crystals, i.e., spatially distributed spin polarization originated from local symmetry breaking, has promised an expanded material pool for future spintronics. However, the measurements of such exotic effects have been limited to subtle space- and momentum-resolved techniques, unfortunately hindering their applications. Here, we theoretically predict macroscopic non-reciprocal transports induced by HSP when coupling another spatially distributed quantity, such as staggered local moments in a PT-symmetric anti-ferromagnet. By using a four-band model Hamiltonian, we demonstrate that HSP plays a crucial role in determining the asymmetric bands with respect to opposite momenta. Such band asymmetry leads to non-reciprocal nonlinear conductivity, exemplified by tetragonal CuMnAs via first-principles calculations. We further provide the material design principles for large nonlinear conductivity, including two-dimensional nature, multiple band crossings near the Fermi level, and symmetry protected HSP. Our work not only reveals direct spintronic applications of HSP (such as N\'eel order detection), but also sheds light on finding observables of other ''hidden effects'', such as hidden optical polarization and hidden Berry curvature.


title: SDS-200: A Swiss German Speech to Standard German Text Corpus

abstract: We present SDS-200, a corpus of Swiss German dialectal speech with Standard German text translations, annotated with dialect, age, and gender information of the speakers. The dataset allows for training speech translation, dialect recognition, and speech synthesis systems, among others. The data was collected using a web recording tool that is open to the public. Each participant was given a text in Standard German and asked to translate it to their Swiss German dialect before recording it. To increase the corpus quality, recordings were validated by other participants. The data consists of 200 hours of speech by around 4000 different speakers and covers a large part of the Swiss-German dialect landscape. We release SDS-200 alongside a baseline speech translation model, which achieves a word error rate (WER) of 30.3 and a BLEU score of 53.1 on the SDS-200 test set. Furthermore, we use SDS-200 to fine-tune a pre-trained XLS-R model, achieving 21.6 WER and 64.0 BLEU.


title: The Compton/Schwarzschild duality, black hole entropy and quantum information

abstract: A new kind of duality has been proposed by Carr related to the quantum description of black holes, the so-called Compton/Schwarzschild duality \cite{Carr:2015nqa}. In this context, a new form for a Generalized Uncertainty Principle has arisen, which must bring us an interesting new route to a quantum description of spacetime. In the present paper, we shall investigate the consequences of the Compton/Schwarzschild duality to black hole entropy. The results found out reinforce an interesting perspective on the relationship between black holes and quantum information theory that has been recently proposed in the literature: that black hole entropy can assume negative values at the final stage of black hole evaporation. Consequently, in the context of the quantum corrections to gravity proposed by the Compton/Schwarschild duality, the final state of a black hole might correspond to a quantum entangled state, in the place of a remnant.


title: On the Gross-Prasad conjecture with its refinement for $\left(\mathrm{SO}\left(5\right),\mathrm{SO}\left(2\right)\right)$ and the generalized B\"ocherer conjecture

abstract: We investigate the Gross-Prasad conjecture and its refinement for the Bessel periods in the case of $\left(\mathrm{SO}\left(5\right),\mathrm{SO}\left(2\right)\right)$. In particular, by combining several theta correspondences, we prove the Ichino-Ikeda type formula for any tempered irreducible cuspidal automorphic representations. As a corollary of our formula, we prove an explicit formula relating certain weighted averages of Fourier coefficients of holomorphic Siegel cusp forms of degree two which are Hecke eigenforms to central special values of $L$-functions. The formula is regarded as a natural generalization of the B\"ocherer conjecture to the non-trivial toroidal character case.


title: Automatic Generation of Complete Polynomial Interpolation Hardware Design Space

abstract: Hardware implementations of complex functions regularly deploy piecewise polynomial approximations. This work determines the complete design space of piecewise polynomial approximations meeting a given accuracy specification. Knowledge of this design space determines the minimum number of regions required to approximate the function accurately enough and facilitates the generation of optimized hardware which is competitive against the state of the art. Targeting alternative hardware technologies simply requires a modified decision procedure to explore the space.


title: Universal Parity Quantum Computing

abstract: We propose a universal gate set for quantum computing with all-to-all connectivity and intrinsic robustness to bit-flip errors based on parity encoding. We show that logical controlled phase gate and $R_z$ rotations can be implemented in parity encoding with single-qubit operations. Together with logical $R_x$ rotations, implemented via nearest-neighbor controlled-NOT gates and an $R_x$ rotation, these form a universal gate set. As the controlled phase gate requires only single-qubit rotations, the proposed scheme has advantages for several cornerstone quantum algorithms, e.g., the quantum Fourier transform. We present a method to switch between different encoding variants via partial on-the-fly encoding and decoding.


title: Holographic Amplitude-Modulated (AM) Leaky-Wave Antennas for Near-Field and Far-Field Applications

abstract: Amplitude-modulated (AM) leaky-wave antenna (LWA), a concept following amplitude modulation technique from classical communications theory, is a promising structure that enables transforming traveling wave into the radiating wave. In this paper, we provide a different perspective based on the classical holographic theory to gain insight into the physical mechanism of AM LWA and design novel LWAs. In analogy to the classical optical Gabor hologram, we demonstrate that only the amplitude variation of the traveling wave is needed to record both the amplitude and phase information of the object wave. The consistency between the holography theory and previous spatial spectrum approach for explaining AM LWA operating mechanism is also demonstrated. For validation purpose, two novel millimeter-wave (mmW) holographic AM LWAs based on the substrate integrated inset dielectric waveguide (IDW) are designed. The first one is for far-field high-gain applications while the second is for near-field focusing (NFF) applications. Both simulated and measured results demonstrate the effectiveness of the AM holography theory for AM LWAs analysis and design.


title: Single Crystalline 2D Material Nanoribbon Networks for Nanoelectronics

abstract: The last decade has seen a flurry of studies related to graphene nanoribbons owing to their potential applications in the quantum realm. However, little experimental work has been reported towards nanoribbons of other 2D materials due to the absence of synthesis routes. Here, we propose a universal approach to synthesize high-quality networks of nanoribbons from arbitrary 2D materials while maintaining high crystallinity, sufficient yield, narrow size distribution, and straight-forward device integrability. The wide applicability of this technique is demonstrated by fabricating MoS2, WS2, WSe2, and graphene nanoribbon field effect transistors that inherently do not suffer from interconnection resistances. By relying on self-assembled and self-aligned organic nanostructures as masks, we demonstrate the possibility of controlling the predominant crystallographic direction of the nanoribbon's edges. Electrical characterization shows record mobilities and very high ON currents for various TMDCs despite extreme width scaling. Lastly, we explore decoration of nanoribbon edges with plasmonic particles paving the way towards the development of nanoribbon-based plasmonic sensing and opto-electronic devices.


title: Practical Skills Demand Forecasting via Representation Learning of Temporal Dynamics

abstract: Rapid technological innovation threatens to leave much of the global workforce behind. Today's economy juxtaposes white-hot demand for skilled labor against stagnant employment prospects for workers unprepared to participate in a digital economy. It is a moment of peril and opportunity for every country, with outcomes measured in long-term capital allocation and the life satisfaction of billions of workers. To meet the moment, governments and markets must find ways to quicken the rate at which the supply of skills reacts to changes in demand. More fully and quickly understanding labor market intelligence is one route. In this work, we explore the utility of time series forecasts to enhance the value of skill demand data gathered from online job advertisements. This paper presents a pipeline which makes one-shot multi-step forecasts into the future using a decade of monthly skill demand observations based on a set of recurrent neural network methods. We compare the performance of a multivariate model versus a univariate one, analyze how correlation between skills can influence multivariate model results, and present predictions of demand for a selection of skills practiced by workers in the information technology industry.


title: Lecture note on Clifford algebra

abstract: This lecture note surveys the gamma matrices in general dimensions with arbitrary signatures, the study of which is essential to understand the supersymmetry in the corresponding spacetime. The contents supplement the lecture presented by the author at Modave Summer School in Mathematical Physics, Belgium, June, 2005.


title: An Introduction to Quantum Machine Learning for Engineers

abstract: In the current noisy intermediate-scale quantum (NISQ) era, quantum machine learning is emerging as a dominant paradigm to program gate-based quantum computers. In quantum machine learning, the gates of a quantum circuit are parametrized, and the parameters are tuned via classical optimization based on data and on measurements of the outputs of the circuit. Parametrized quantum circuits (PQCs) can efficiently address combinatorial optimization problems, implement probabilistic generative models, and carry out inference (classification and regression). This monograph provides a self-contained introduction to quantum machine learning for an audience of engineers with a background in probability and linear algebra. It first describes the necessary background, concepts, and tools necessary to describe quantum operations and measurements. Then, it covers parametrized quantum circuits, the variational quantum eigensolver, as well as unsupervised and supervised quantum machine learning formulations.


title: Minority Stress Experienced by LGBTQ Online Communities during the COVID-19 Pandemic

abstract: The COVID-19 pandemic has disproportionately impacted the lives of minorities, such as members of the LGBTQ community (lesbian, gay, bisexual, transgender, and queer) due to pre-existing social disadvantages and health disparities. Although extensive research has been carried out on the impact of the COVID-19 pandemic on different aspects of the general population's lives, few studies are focused on the LGBTQ population. In this paper, we develop and evaluate two sets of machine learning classifiers using a pre-pandemic and a during-pandemic dataset to identify Twitter posts exhibiting minority stress, which is a unique pressure faced by the members of the LGBTQ population due to their sexual and gender identities. We demonstrate that our best pre- and during-pandemic models show strong and stable performance for detecting posts that contain minority stress. We investigate the linguistic differences in minority stress posts across pre- and during-pandemic periods. We find that anger words are strongly associated with minority stress during the COVID-19 pandemic. We explore the impact of the pandemic on the emotional states of the LGBTQ population by adopting propensity score-based matching to perform a causal analysis. The results show that the LGBTQ population have a greater increase in the usage of cognitive words and worsened observable attribute in the usage of positive emotion words than the group of the general population with similar pre-pandemic behavioral attributes. Our findings have implications for the public health domain and policy-makers to provide adequate support, especially with respect to mental health, to the LGBTQ population during future crises.


title: Thermodynamics of the metal-insulator transition in the extended Hubbard model from determinantal quantum Monte Carlo

abstract: Using finite-temperature determinantal quantum Monte Carlo simulations, we examine the thermodynamic properties of the extended Hubbard model on the half-filled square lattice in the Slater regime at intermediate coupling. We consider both the case of nearest-neighbor interactions and long-range Coulomb interactions, for coupling strengths in which the presence of non-local interactions still allows us to perform sign-problem free quantum Monte Carlo simulations. In particular, we assess a recently proposed scenario from variational calculations in terms of a first-order metal-insulator transition in this interaction regime.


title: Federated learning: Applications, challenges and future directions

abstract: Federated learning (FL) is a system in which a central aggregator coordinates the efforts of multiple clients to solve machine learning problems. This setting allows training data to be dispersed in order to protect privacy. The purpose of this paper is to provide an overview of FL systems with a focus on healthcare. FL is evaluated here based on its frameworks, architectures, and applications. It is shown here that FL solves the preceding issues with a shared global deep learning (DL) model via a central aggregator server. This paper examines recent developments and provides a comprehensive list of unresolved issues, inspired by the rapid growth of FL research. In the context of FL, several privacy methods are described, including secure multiparty computation, homomorphic encryption, differential privacy, and stochastic gradient descent. Furthermore, a review of various FL classes, such as horizontal and vertical FL and federated transfer learning, is provided. FL has applications in wireless communication, service recommendation, intelligent medical diagnosis systems, and healthcare, all of which are discussed in this paper. We also present a thorough review of existing FL challenges, such as privacy protection, communication cost, system heterogeneity, and unreliable model upload, followed by future research directions.


title: Inferring exemplar discriminability in brain representations

abstract: Representational distinctions within categories are important in all perceptual modalities and also in cognitive and motor representations. Recent pattern-information studies of brain activity have used condition-rich designs to sample the stimulus space more densely. To test whether brain response patterns discriminate among a set of stimuli (e.g. exemplars within a category) with good sensitivity, we can pool statistical evidence over all pairwise comparisons. Here we describe a wide range of statistical tests of exemplar discriminability and assess the validity (specificity) and power (sensitivity) of each test. The tests include previously used and novel, parametric and nonparametric tests, which treat subject as a random or fixed effect, and are based on different dissimilarity measures, different test statistics, and different inference procedures. We use simulated and real data to determine which tests are valid and which are most sensitive. A popular test statistic reflecting exemplar information is the exemplar discriminability index (EDI), which is defined as the average of the pattern dissimilarity estimates between different exemplars minus the average of the pattern dissimilarity estimates between repetitions of identical exemplars. The popular across-subject t test of the EDI (typically using correlation distance as the pattern dissimilarity measure) requires the assumption that the EDI is 0-mean normal under H0. Although this assumption is not strictly true, our simulations suggest that the test controls the false-positives rate at the nominal level, and is thus valid, in practice. However, test statistics based on average Mahalanobis distances or average linear-discriminant t values (both accounting for the multivariate error covariance among responses) are substantially more powerful for both random- and fixed-effects inference.


title: Variational Inference for Bayesian Bridge Regression

abstract: We study the implementation of Automatic Differentiation Variational inference (ADVI) for Bayesian inference on regression models with bridge penalization. The bridge approach uses $\ell_{\alpha}$ norm, with $\alpha \in (0, +\infty)$ to define a penalization on large values of the regression coefficients, which includes the Lasso ($\alpha = 1$) and ridge $(\alpha = 2)$ penalizations as special cases. Full Bayesian inference seamlessly provides joint uncertainty estimates for all model parameters. Although MCMC aproaches are available for bridge regression, it can be slow for large dataset, specially in high dimensions. The ADVI implementation allows the use of small batches of data at each iteration (due to stochastic gradient based algorithms), therefore speeding up computational time in comparison with MCMC. We illustrate the approach on non-parametric regression models with B-splines, although the method works seamlessly for other choices of basis functions. A simulation study shows the main properties of the proposed method.


title: Asymptotic accuracy in estimation of a fractional signal in a small white noise

abstract: This paper revisits the problem of estimating the fractional Ornstein - Uhlenbeck process observed in a linear channel with white noise of small intensity. We drive the exact asymptotic formulas for the mean square errors of the filtering and interpolation estimators. The asymptotic analysis is based on approximations of the eigenvalues and eigenfunctions of the signal's covariance operator.


title: Applications of Universal Parity Quantum Computation

abstract: We demonstrate the applicability of a universal gate set in the parity encoding, which is a dual to the standard gate model, by exploring several quantum gate algorithms such as the quantum Fourier transform and quantum addition. Embedding these algorithms in the parity encoding reduces the circuit depth compared to conventional gate-based implementations while keeping the multiqubit gate counts comparable. We further propose simple implementations of multiqubit gates in tailored encodings and an efficient strategy to prepare graph states.


title: Gradient Aligned Attacks via a Few Queries

abstract: Black-box query attacks, which rely only on the output of the victim model, have proven to be effective in attacking deep learning models. However, existing black-box query attacks show low performance in a novel scenario where only a few queries are allowed. To address this issue, we propose gradient aligned attacks (GAA), which use the gradient aligned losses (GAL) we designed on the surrogate model to estimate the accurate gradient to improve the attack performance on the victim model. Specifically, we propose a gradient aligned mechanism to ensure that the derivatives of the loss function with respect to the logit vector have the same weight coefficients between the surrogate and victim models. Using this mechanism, we transform the cross-entropy (CE) loss and margin loss into gradient aligned forms, i.e. the gradient aligned CE or margin losses. These losses not only improve the attack performance of our gradient aligned attacks in the novel scenario but also increase the query efficiency of existing black-box query attacks. Through theoretical and empirical analysis on the ImageNet database, we demonstrate that our gradient aligned mechanism is effective, and that our gradient aligned attacks can improve the attack performance in the novel scenario by 16.1\% and 31.3\% on the $l_2$ and $l_{\infty}$ norms of the box constraint, respectively, compared to four latest transferable prior-based query attacks. Additionally, the gradient aligned losses also significantly reduce the number of queries required in these transferable prior-based query attacks by a maximum factor of 2.9 times. Overall, our proposed gradient aligned attacks and losses show significant improvements in the attack performance and query efficiency of black-box query attacks, particularly in scenarios where only a few queries are allowed.


title: Design and Mathematical Modelling of Inter Spike Interval of Temporal Neuromorphic Encoder for Image Recognition

abstract: Neuromorphic computing systems emulate the electrophysiological behavior of the biological nervous system using mixed-mode analog or digital VLSI circuits. These systems show superior accuracy and power efficiency in carrying out cognitive tasks. The neural network architecture used in neuromorphic computing systems is spiking neural networks (SNNs) analogous to the biological nervous system. SNN operates on spike trains as a function of time. A neuromorphic encoder converts sensory data into spike trains. In this paper, a low-power neuromorphic encoder for image processing is implemented. A mathematical model between pixels of an image and the inter-spike intervals is also formulated. Wherein an exponential relationship between pixels and inter-spike intervals is obtained. Finally, the mathematical equation is validated with circuit simulation.


title: Dynamic SAFFRON: Disease Control Over Time Via Group Testing

abstract: We consider the dynamic infection spread model that is based on the discrete SIR model which assumes infections to be spread over time via infected and non-isolated individuals. In our system, the main objective is not to minimize the number of required tests to identify every infection, but instead, to utilize the available, given testing capacity $T$ at each time instance to efficiently control the infection spread. We introduce and study a novel performance metric, which we coin as $\epsilon$-disease control time. This metric can be used to measure how fast a given algorithm can control the spread of a disease. We characterize the performance of dynamic individual testing algorithm and introduce a novel dynamic SAFFRON based group testing algorithm. We present theoretical results and implement the proposed algorithms to compare their performances.

categories: eess.SY cs.DS cs.IT cs.SY math.IT q-bio.PE


title: Alpha magnitude

abstract: Magnitude is an isometric invariant for metric spaces that was introduced by Leinster around 2010, and is currently the object of intense research, since it has been shown to encode many known invariants of metric spaces. In recent work, Govc and Hepworth introduced persistent magnitude, a numerical invariant of a filtered simplicial complex associated to a metric space. Inspired by Govc and Hepworth's definition, we introduce alpha magnitude and investigate some of its key properties. Heuristic observations lead us to conjecture a relationship with the Minkowski dimension of compact subspaces of Euclidean space. Finally, alpha magnitude presents computational advantages over both magnitude as well as Rips magnitude, and we thus propose it as a new measure for the estimation of fractal dimensions of real-world data sets that is easily computable.


title: Defending Against Adversarial Attacks by Energy Storage Facility

abstract: Adversarial attacks on data-driven algorithms applied in the power system will be a new type of threat to grid security. Literature has demonstrated that the adversarial attack on the deep-neural network can significantly mislead the load fore-cast of a power system. However, it is unclear how the new type of attack impacts the operation of the grid system. In this research, we manifest that the adversarial algorithm attack induces a significant cost-increase risk which will be exacerbated by the growing penetration of intermittent renewable energy. In Texas, a 5% adversarial attack can increase the total generation cost by 17% in a quarter, which accounts for around $20 million. When wind-energy penetration increases to over 40%, the 5% adversarial attack will inflate the genera-tion cost by 23%. Our research discovers a novel approach to defending against the adversarial attack: investing in the energy-storage system. All current literature focuses on developing algorithms to defend against adversarial attacks. We are the first research revealing the capability of using the facility in a physical system to defend against the adversarial algorithm attack in a system of the Internet of Things, such as a smart grid system.


title: scICML: Information-theoretic Co-clustering-based Multi-view Learning for the Integrative Analysis of Single-cell Multi-omics data

abstract: Modern high-throughput sequencing technologies have enabled us to profile multiple molecular modalities from the same single cell, providing unprecedented opportunities to assay celluar heterogeneity from multiple biological layers. However, the datasets generated from these technologies tend to have high level of noise and are highly sparse, bringing challenges to data analysis. In this paper, we develop a novel information-theoretic co-clustering-based multi-view learning (scICML) method for multi-omics single-cell data integration. scICML utilizes co-clusterings to aggregate similar features for each view of data and uncover the common clustering pattern for cells. In addition, scICML automatically matches the clusters of the linked features across different data types for considering the biological dependency structure across different types of genomic features. Our experiments on four real-world datasets demonstrate that scICML improves the overall clustering performance and provides biological insights into the data analysis of peripheral blood mononuclear cells.


title: Security Analysis of DeFi: Vulnerabilities, Attacks and Advances

abstract: Decentralized finance (DeFi) in Ethereum is a financial ecosystem built on the blockchain that has locked over 200 billion USD until April 2022. All transaction information is transparent and open when transacting through the DeFi protocol, which has led to a series of attacks. Several studies have attempted to optimize it from both economic and technical perspectives. However, few works analyze the vulnerabilities and optimizations of the entire DeFi system. In this paper, we first systematically analyze vulnerabilities related to DeFi in Ethereum at several levels, then we investigate real-world attacks. Finally, we summarize the achievements of DeFi optimization and provide some future directions.


title: On the large-Weissenberg-number scaling laws in viscoelastic pipe flows

abstract: This work explains a scaling law of the first Landau coefficient of the derived Ginzburg-Landau equation (GLE) in the weakly nonlinear analysis of axisymmetric viscoelastic pipe flows in the large-Weissenberg-number ($Wi$) limit, recently reported in Wan et al. J. Fluid Mech. (2021), vol. 929, A16. Using an asymptotic method, we derive a reduced system, which captures the characteristics of the linear centre-mode instability near the critical condition in the large-$Wi$ limit. Based on the reduced system we then conduct a weakly nonlinear analysis using a multiple-scale expansion method, which readily explains the aforementioned scaling law of the Landau coefficient and some other scaling laws. Particularly, the equilibrium amplitude of disturbance near linear critical conditions is found to scale as $Wi^{-1/2}$, which may be of interest to experimentalists. The current analysis reduces the numbers of parameters and unknowns and exemplifies an approach to studying the viscoelastic flow at large $Wi$, which could shed new light on the understanding of its nonlinear dynamics.


title: Simple Regularisation for Uncertainty-Aware Knowledge Distillation

abstract: Considering uncertainty estimation of modern neural networks (NNs) is one of the most important steps towards deploying machine learning systems to meaningful real-world applications such as in medicine, finance or autonomous systems. At the moment, ensembles of different NNs constitute the state-of-the-art in both accuracy and uncertainty estimation in different tasks. However, ensembles of NNs are unpractical under real-world constraints, since their computation and memory consumption scale linearly with the size of the ensemble, which increase their latency and deployment cost. In this work, we examine a simple regularisation approach for distribution-free knowledge distillation of ensemble of machine learning models into a single NN. The aim of the regularisation is to preserve the diversity, accuracy and uncertainty estimation characteristics of the original ensemble without any intricacies, such as fine-tuning. We demonstrate the generality of the approach on combinations of toy data, SVHN/CIFAR-10, simple to complex NN architectures and different tasks.


title: Average analytic ranks of elliptic curves over number fields

abstract: We give a conditional bound for the average analytic rank of elliptic curves over an arbitrary number field. In particular, under the assumptions that all elliptic curves over a number field $K$ are modular and have $L$-functions which satisfy the Generalized Riemann Hypothesis, we show that the average analytic rank of isomorphism classes of elliptic curves over $K$ is bounded above by $3\text{deg}(K)+1/2$. A key ingredient in the proof of this result is to give asymptotics for the number of elliptic curves over an arbitrary number field with a prescribed local condition; these results will follow from general results for counting points of bounded height on weighted projective spaces with a prescribed local condition.


title: The Ising critical quantum Otto engine

abstract: We study a four-stroke Otto engine whose working fluid is a quantum Ising chain. The thermodynamic cycle consists in sweeps of the transverse magnetic field occurring in thermal isolation, alternated by thermalisation strokes with reservoirs at different temperatures. The system-environment coupling is modelled in a thermodynamically consistent way by means of a nonlocal Lindblad master equation. We show that the engine may operate in four different operation modes, depending on the various parameters, in particular it can act as a heat engine and as a refrigerator. We detect an enhancement of the thermodynamic performance as the critical point is crossed, and investigate it in detail.


title: Mobility, Communication and Computation Aware Federated Learning for Internet of Vehicles

abstract: While privacy concerns entice connected and automated vehicles to incorporate on-board federated learning (FL) solutions, an integrated vehicle-to-everything communication with heterogeneous computation power aware learning platform is urgently necessary to make it a reality. Motivated by this, we propose a novel mobility, communication and computation aware online FL platform that uses on-road vehicles as learning agents. Thanks to the advanced features of modern vehicles, the on-board sensors can collect data as vehicles travel along their trajectories, while the on-board processors can train machine learning models using the collected data. To take the high mobility of vehicles into account, we consider the delay as a learning parameter and restrict it to be less than a tolerable threshold. To satisfy this threshold, the central server accepts partially trained models, the distributed roadside units (a) perform downlink multicast beamforming to minimize global model distribution delay and (b) allocate optimal uplink radio resources to minimize local model offloading delay, and the vehicle agents conduct heterogeneous local model training. Using real-world vehicle trace datasets, we validate our FL solutions. Simulation shows that the proposed integrated FL platform is robust and outperforms baseline models. With reasonable local training episodes, it can effectively satisfy all constraints and deliver near ground truth multi-horizon velocity and vehicle-specific power predictions.


title: Evidence for distortion-induced local electric polarization in $\alpha$-RuCl$_3$

abstract: The spin-orbit assisted Mott insulator $\alpha$-RuCl$_3$ is a prime candidate for material realization of the Kitaev quantum spin liquid. While little attention has been paid to charge degrees of freedom, charge effects, such as electric polarization, may arise in this system. Here, we report distortion-induced local electric polarization in $\alpha$-RuCl$_3$ as evidenced by single-crystal X-ray diffraction, second harmonic generation (SHG) and dielectric measurements. The SHG signal appears at room temperature and develops substantially in the Kitaev paramagnetic state when short-range spin correlations come into play. Despite sizable pyroelectric currents in the Kitaev paramagnetic state, the absence of hysteresis in electric field-dependent polariza-tion (P-E) points to the short-range nature of electric polarization. This localized electric polarization is likely the result of distortion-induced charge dimerization, achieved through virtual hopping-induced charge redistribution. In addition, the electric polarization is boosted by short-range spin correlations via spin-phonon coupling in the Kitaev paramagnetic state. Our results emphasize the importance of charge degrees of freedom in $\alpha$-RuCl$_3$, which establish a novel platform to investi-gate charge effects in Kitaev materials.


title: Hydrogen-like ions in plasma environment

abstract: The behavior of H-like ions embedded in astrophysical plasmas in the form of \emph{dense, strongly and weakly coupled} plasmas are investigated. In these, the increase and decrease in temperature is impacted with a change in confinement radius $(r_{c})$. Two independent and generalized scaling ideas have been applied to modulate the effect of plasma screening constant ($\lambda$) and charge of ion ($Z$) on such systems. Several new relations are derived to interconnect the original Hamiltonian and two scaled Hamiltonians. In exponential cosine screened Coulomb potential (ECSCP) (dense) and weakly coupled plasma (WCP) these scaling relations have provided a linear equation connecting the critical screening constant $(\lambda^{(c)})$ and $Z$. Their ratio offers a state-dependent constant, beyond which, a particular state vanishes. Shannon entropy has been employed to understand the plasma effect on the ion. With increase in $\lambda$, the accumulation of opposite charge surrounding the ion increases leading to a reduction in number of bound states. However, with rise in ionic charge $Z$, this effect can be delayed. The competing effect of plasma charge density ($n_e$) and temperature in WCP and ECSCP is investigated. A recently proposed simple virial-like theorem has been established for these systems. Multipole ($k=1-4$) oscillator strength (OS) and polarizabilities for these are studied considering $1s, 2s$ states. As a bonus, analytical closed-form expressions are derived for $f^{(k)}$ and $\alpha^{(k)} (k=1-4)$ involving $1s$ and $2s$ state, for \emph{free H-like ion}.


title: Dynamics of charge imbalance resolved negativity after a global quench in free scalar field theory

abstract: In this paper, we consider the time evolution of charge imbalance resolved negativity after a global quench in the 1+1 dimensional complex Klein-Gordon theory. We focus on two types of global quenches which are called boundary state quench and mass quench respectively. We first study the boundary state quench where the post-quench dynamic is governed by a massless Hamiltonian. In this case, the temporal evolution of charged imbalance resolved negativity can be obtained first by evaluating the correlators of the fluxed twist field in the upper half plane and then applying Fourier transformation. We numerical test our analytical formulas in the underlying lattice model. We also study the mass quench in the complex harmonic chain where the system is evolved according to a massive Hamiltonian after the quench. We argue that our results can be understood in the framework of quasi-particle picture.


title: Estimating the ultrasound attenuation coefficient using convolutional neural networks -- a feasibility study

abstract: Attenuation coefficient (AC) is a fundamental measure of tissue acoustical properties, which can be used in medical diagnostics. In this work, we investigate the feasibility of using convolutional neural networks (CNNs) to directly estimate AC from radio-frequency (RF) ultrasound signals. To develop the CNNs we used RF signals collected from tissue mimicking numerical phantoms for the AC values in a range from 0.1 to 1.5 dB/(MHz*cm). The models were trained based on 1-D patches of RF data. We obtained mean absolute AC estimation errors of 0.08, 0.12, 0.20, 0.25 for the patch lengths: 10 mm, 5 mm, 2 mm and 1 mm, respectively. We explain the performance of the model by visualizing the frequency content associated with convolutional filters. Our study presents that the AC can be calculated using deep learning, and the weights of the CNNs can have physical interpretation.


title: IFTT-PIN: A PIN-Entry Method Leveraging the Self-Calibration Paradigm

abstract: IFTT-PIN is a self-calibrating version of the PIN-entry method introduced in Roth et al. (2004) [1]. In [1], digits are split into two sets and assigned a color respectively. To communicate their digit, users press the button with the same color that is assigned to their digit, which can thus be identified by elimination after a few iterations. IFTT-PIN uses the same principle but does not pre-assign colors to each button. Instead, users are free to choose which button to use for each color. The button-to-color mapping only exists in the user's mind and is never directly communicated to the interface. In other words, IFTT-PIN infers both the user's PIN and their preferred button-to-color mapping at the same time, a process called self-calibration. In this paper, we present online interactive demonstrations of IFTT-PIN with and without self-calibration and introduce the key concepts and assumptions making self-calibration possible. IFTT-PIN can be tested at https://jgrizou.github.io/IFTT-PIN/ with a video introduction available at https://youtu.be/5I1ibPJdLHM. We review related work in the field of brain-computer interface and further propose self-calibration as a novel approach to protect users against shoulder surfing attacks. Finally, we introduce a vault cracking challenge as a test of usability and security that was informally tested at our institute. With IFTT-PIN, we wish to demonstrate a new interactive experience where users can decide actively and on-the-fly how to use an interface. The self-calibration paradigm might lead to novel opportunities for interaction in other applications or domains. We hope this work will inspire the community to invent them.


title: Anisotropic singular Neumann equations with unbalanced growth

abstract: We consider a nonlinear parametric Neumann problem driven by the anisotropic $(p,q)$-Laplacian and a reaction which exhibits the combined effects of a singular term and of a parametric superlinear perturbation. We are looking for positive solutions. Using a combination of topological and variational tools together with suitable truncation and comparison techniques, we prove a bifurcation-type result describing the set of positive solutions as the positive parameter $\lambda$ varies. We also show the existence of minimal positive solutions $u_\lambda^*$ and determine the monotonicity and continuity properties of the map $\lambda\mapsto u_\lambda^*$.


title: A Simple yet Effective Relation Information Guided Approach for Few-Shot Relation Extraction

abstract: Few-Shot Relation Extraction aims at predicting the relation for a pair of entities in a sentence by training with a few labelled examples in each relation. Some recent works have introduced relation information (i.e., relation labels or descriptions) to assist model learning based on Prototype Network. However, most of them constrain the prototypes of each relation class implicitly with relation information, generally through designing complex network structures, like generating hybrid features, combining with contrastive learning or attention networks. We argue that relation information can be introduced more explicitly and effectively into the model. Thus, this paper proposes a direct addition approach to introduce relation information. Specifically, for each relation class, the relation representation is first generated by concatenating two views of relations (i.e., [CLS] token embedding and the mean value of embeddings of all tokens) and then directly added to the original prototype for both train and prediction. Experimental results on the benchmark dataset FewRel 1.0 show significant improvements and achieve comparable results to the state-of-the-art, which demonstrates the effectiveness of our proposed approach. Besides, further analyses verify that the direct addition is a much more effective way to integrate the relation representations and the original prototypes.


title: Integral relations for the skin-friction coefficient of canonical flows

abstract: We show that the Fukagata et al. (2002)'s identity for free-stream boundary layers simplifies to the von Karman momentum integral equation relating the skin-friction coefficient and the momentum thickness when the upper bound in the integrals used to obtain the identity is taken to be asymptotically large. If a finite upper bound is used, the terms of the identity depend spuriously on the bound itself. Differently from channel and pipe flows, the impact of the Reynolds stresses on the wall-shear stress cannot be quantified in the case of free-stream boundary layers because the Reynolds stresses disappear from the identity. The infinite number of alternative identities obtained by performing additional integrations on the streamwise momentum equation also all simplify to the von Karman equation. Analogous identities are found for channel flows, where the relative influence of the physical terms on the wall-shear stress depends on the number of successive integrations, demonstrating that the laminar and turbulent contributions to the skin-friction coefficient is only distinguished in the original identity discovered by Fukagata et al. (2002). In the limit of large number of integrations, these identities degenerate to the definition of skin-friction coefficient and a novel two-fold integration identity is found for channel and pipe flows. In addition, we decompose the skin-friction coefficient as the sum of the change of integral thicknesses with the streamwise direction, following the study of Renard & Deck (2016). We utilize an energy thickness and an inertia thickness, which is composed of a thickness related to the mean-flow wall-normal convection and a thickness linked to the streamwise inhomogeneity of the mean streamwise velocity. The contributions of the different terms of the streamwise momentum equation on the friction drag is thus quantified by these integral thicknesses.


title: On integrability of a third-order complex nonlinear wave equation

abstract: We show that the new third-order complex nonlinear wave equation, introduced recently by M\"{u}ller-Hoissen [arXiv:2202.04512], does not pass the Painlev\'{e} test for integrability. We find two reductions of this equation, one integrable and one non-integrable, whose solutions jointly cover all solutions of the original equation.


title: Data-driven prediction of Air Traffic Controllers reactions to resolving conflicts

abstract: With the aim to enhance automation in conflict detection and resolution (CD&R) tasks in the Air Traffic Management domain, in this paper we propose deep learning techniques (DL) that can learn models of Air Traffic Controllers' (ATCO) reactions in resolving conflicts that can violate separation minimum constraints among aircraft trajectories: This implies learning when the ATCO will react towards resolving a conflict, and how he/she will react. Timely reactions, to which this paper aims, focus on when do reactions happen, aiming to predict the trajectory points, as the trajectory evolves, that the ATCO issues a conflict resolution action, while also predicting the type of resolution action (if any). Towards this goal, the paper formulates the ATCO reactions prediction problem for CD&R, and presents DL methods that can model ATCO timely reactions and evaluates these methods in real-world data sets, showing their efficacy in prediction with very high accuracy.


title: On the spectrum of twisted Laplacians and the Teichm\"uller representation

abstract: We consider Laplacians with non unitary twists acting on sections of flat vector bundles over compact hyperbolic surfaces. These non self-adjoint Laplacians have discrete spectrum inside a parabola in the complex plane. For representations of the fundamental group of the base surface which are of Teichm\"uller type, we investigate the high energy limit and give a precise description of the bulk of the spectrum where Weyl's law is satisfied in terms of critical exponents of the representations which are completely determined by the Manhattan curve associated to the Teichm\"uller deformation. Our main result provides a counting estimate for the eigenvalues outside the bulk with a polynomial improvement over Weyl's law.


title: On $P$-algebras and their duals

abstract: The notion of $P$-algebra due to Margolis, building on work of Moore and Peterson, was motivated by the case of the Steenrod algebra at a prime and its modules. We develop aspects of this theory further, focusing especially on coherent modules and finite dimensional modules. We also discuss the dual Hopf algebra of $P$-algebra and its comodules. One of our aims is provide a collection of techniques for calculating cohomology groups over $P$-algebras and their duals, in particular giving vanishing results. Much of our work is implicit in that of Margolis and others but we are unaware of systematic discussions in the literature. We give some examples illustrating topological applications which follow easily from our results.


title: Domain Enhanced Arbitrary Image Style Transfer via Contrastive Learning

abstract: In this work, we tackle the challenging problem of arbitrary image style transfer using a novel style feature representation learning method. A suitable style representation, as a key component in image stylization tasks, is essential to achieve satisfactory results. Existing deep neural network based approaches achieve reasonable results with the guidance from second-order statistics such as Gram matrix of content features. However, they do not leverage sufficient style information, which results in artifacts such as local distortions and style inconsistency. To address these issues, we propose to learn style representation directly from image features instead of their second-order statistics, by analyzing the similarities and differences between multiple styles and considering the style distribution. Specifically, we present Contrastive Arbitrary Style Transfer (CAST), which is a new style representation learning and style transfer method via contrastive learning. Our framework consists of three key components, i.e., a multi-layer style projector for style code encoding, a domain enhancement module for effective learning of style distribution, and a generative network for image style transfer. We conduct qualitative and quantitative evaluations comprehensively to demonstrate that our approach achieves significantly better results compared to those obtained via state-of-the-art methods. Code and models are available at https://github.com/zyxElsa/CAST_pytorch


title: Parallel bandit architecture based on laser chaos for reinforcement learning

abstract: Accelerating artificial intelligence by photonics is an active field of study aiming to exploit the unique properties of photons. Reinforcement learning is an important branch of machine learning, and photonic decision-making principles have been demonstrated with respect to the multi-armed bandit problems. However, reinforcement learning could involve a massive number of states, unlike previously demonstrated bandit problems where the number of states is only one. Q-learning is a well-known approach in reinforcement learning that can deal with many states. The architecture of Q-learning, however, does not fit well photonic implementations due to its separation of update rule and the action selection. In this study, we organize a new architecture for multi-state reinforcement learning as a parallel array of bandit problems in order to benefit from photonic decision-makers, which we call parallel bandit architecture for reinforcement learning or PBRL in short. Taking a cart-pole balancing problem as an instance, we demonstrate that PBRL adapts to the environment in fewer time steps than Q-learning. Furthermore, PBRL yields faster adaptation when operated with a chaotic laser time series than the case with uniformly distributed pseudorandom numbers where the autocorrelation inherent in the laser chaos provides a positive effect. We also find that the variety of states that the system undergoes during the learning phase exhibits completely different properties between PBRL and Q-learning. The insights obtained through the present study are also beneficial for existing computing platforms, not just photonic realizations, in accelerating performances by the PBRL algorithms and correlated random sequences.


title: On harmonic and biharmonic maps from gradient Ricci solitons

abstract: We study harmonic and biharmonic maps from gradient Ricci solitons. We derive a number of analytic and geometric conditions under which harmonic maps are constant and which force biharmonic maps to be harmonic. In particular, we show that biharmonic maps of finite energy from the two-dimensional cigar soliton must be harmonic.


title: Snowmass White Paper: Generalized Symmetries in Quantum Field Theory and Beyond

abstract: Symmetry plays a central role in quantum field theory. Recent developments include symmetries that act on defects and other subsystems, and symmetries that are categorical rather than group-like. These generalized notions of symmetry allow for new kinds of anomalies that constrain dynamics. We review some transformative instances of these novel aspects of symmetry in quantum field theory, and give a broad-brush overview of recent applications.


title: Deterministic training of generative autoencoders using invertible layers

abstract: In this work, we provide a deterministic alternative to the stochastic variational training of generative autoencoders. We refer to these new generative autoencoders as AutoEncoders within Flows (AEF), since the encoder and decoder are defined as affine layers of an overall invertible architecture. This results in a deterministic encoding of the data, as opposed to the stochastic encoding of VAEs. The paper introduces two related families of AEFs. The first family relies on a partition of the ambient space and is trained by exact maximum-likelihood. The second family exploits a deterministic expansion of the ambient space and is trained by maximizing the log-probability in this extended space. This latter case leaves complete freedom in the choice of encoder, decoder and prior architectures, making it a drop-in replacement for the training of existing VAEs and VAE-style models. We show that these AEFs can have strikingly higher performance than architecturally identical VAEs in terms of log-likelihood and sample quality, especially for low dimensional latent spaces. Importantly, we show that AEF samples are substantially sharper than VAE samples.


title: Classifying one-dimensional discrete models with maximum likelihood degree one

abstract: We propose a classification of all one-dimensional discrete statistical models with maximum likelihood degree one based on their rational parametrization. We show how all such models can be constructed from members of a smaller class of 'fundamental models' using a finite number of simple operations. We introduce 'chipsplitting games', a class of combinatorial games on a grid which we use to represent fundamental models. This combinatorial perspective enables us to show that there are only finitely many fundamental models in the probability simplex $\Delta_n$ for $n\leq 4$.


title: ODBO: Bayesian Optimization with Search Space Prescreening for Directed Protein Evolution

abstract: Directed evolution is a versatile technique in protein engineering that mimics the process of natural selection by iteratively alternating between mutagenesis and screening in order to search for sequences that optimize a given property of interest, such as catalytic activity and binding affinity to a specified target. However, the space of possible proteins is too large to search exhaustively in the laboratory, and functional proteins are scarce in the vast sequence space. Machine learning (ML) approaches can accelerate directed evolution by learning to map protein sequences to functions without building a detailed model of the underlying physics, chemistry and biological pathways. Despite the great potentials held by these ML methods, they encounter severe challenges in identifying the most suitable sequences for a targeted function. These failures can be attributed to the common practice of adopting a high-dimensional feature representation for protein sequences and inefficient search methods. To address these issues, we propose an efficient, experimental design-oriented closed-loop optimization framework for protein directed evolution, termed ODBO, which employs a combination of novel low-dimensional protein encoding strategy and Bayesian optimization enhanced with search space prescreening via outlier detection. We further design an initial sample selection strategy to minimize the number of experimental samples for training ML models. We conduct and report four protein directed evolution experiments that substantiate the capability of the proposed framework for finding of the variants with properties of interest. We expect the ODBO framework to greatly reduce the experimental cost and time cost of directed evolution, and can be further generalized as a powerful tool for adaptive experimental design in a broader context.


title: Politeness Counts: Perceptions of Peacekeeping Robots

abstract: The 'intuitive' trust people feel when encountering robots in public spaces is a key determinant of their willingness to cooperate with these robots. We conducted four experiments to study this topic in the context of peacekeeping robots. Participants viewed scenarios, presented as static images or animations, involving a robot or a human guard performing an access-control task. The guards interacted more or less politely with younger and older male and female people. Our results show strong effects of the guard's politeness. Age and sex of the people interacting with the guard had no significant effect on participants' impressions of its attributes. There were no differences between responses to robot and human guards. This study advances the notion that politeness is a crucial determinant of people's perception of peacekeeping robots.


title: Data Valuation for Offline Reinforcement Learning

abstract: The success of deep reinforcement learning (DRL) hinges on the availability of training data, which is typically obtained via a large number of environment interactions. In many real-world scenarios, costs and risks are associated with gathering these data. The field of offline reinforcement learning addresses these issues through outsourcing the collection of data to a domain expert or a carefully monitored program and subsequently searching for a batch-constrained optimal policy. With the emergence of data markets, an alternative to constructing a dataset in-house is to purchase external data. However, while state-of-the-art offline reinforcement learning approaches have shown a lot of promise, they currently rely on carefully constructed datasets that are well aligned with the intended target domains. This raises questions regarding the transferability and robustness of an offline reinforcement learning agent trained on externally acquired data. In this paper, we empirically evaluate the ability of the current state-of-the-art offline reinforcement learning approaches to coping with the source-target domain mismatch within two MuJoCo environments, finding that current state-of-the-art offline reinforcement learning algorithms underperform in the target domain. To address this, we propose data valuation for offline reinforcement learning (DVORL), which allows us to identify relevant and high-quality transitions, improving the performance and transferability of policies learned by offline reinforcement learning algorithms. The results show that our method outperforms offline reinforcement learning baselines on two MuJoCo environments.


title: Comparison on the criticality parameters for two supercritical branching processes in random environments

abstract: Let $\{Z_{1,n} , n\geq 0\}$ and $\{Z_{2,n}, n\geq 0\}$ be two supercritical branching processes in different random environments, with criticality parameters $\mu_1$ and $\mu_2$ respectively. It is known that $\frac{1}{n} \ln Z_{1,n} \rightarrow \mu_1$ and $\frac{1}{m} \ln Z_{2,m} \rightarrow \mu_2$ in probability as $m, n \rightarrow \infty.$ In this paper, we are interested in the comparison on the two criticality parameters. To this end, we prove a non-uniform Berry-Esseen's bound and Cram\'{e}r's moderate deviations for $\frac{1}{n} \ln Z_{1,n} - \frac{1}{m} \ln Z_{2,m}$ as $m, n \rightarrow \infty.$ An application is also given for constructing confidence interval for $\mu_1-\mu_2$.


title: Hybrid Intelligent Testing in Simulation-Based Verification

abstract: Efficient and effective testing for simulation-based hardware verification is challenging. Using constrained random test generation, several millions of tests may be required to achieve coverage goals. The vast majority of tests do not contribute to coverage progress, yet they consume verification resources. In this paper, we propose a hybrid intelligent testing approach combining two methods that have previously been treated separately, namely Coverage-Directed Test Selection and Novelty-Driven Verification. Coverage-Directed Test Selection learns from coverage feedback to bias testing toward the most effective tests. Novelty-Driven Verification learns to identify and simulate stimuli that differ from previous stimuli, thereby reducing the number of simulations and increasing testing efficiency. We discuss the strengths and limitations of each method, and we show how our approach addresses each method's limitations, leading to hardware testing that is both efficient and effective.


title: Triangulations of Grassmannians and flag manifolds

abstract: MacPherson conjectured that the Grassmannian $\mathrm{Gr}(2, \mathbb{R}^n)$ has the same homeomorphism type as the combinatorial Grassmannian $\|\mbox{MacP}(2,n)\|$, while Babson proved that the spaces $\mathrm{Gr}(2,\mathbb{R}^n)$ and $\mathrm{Gr}(1,2,\mathbb{R}^n)$ are homotopy equivalent to their combinatorial analogs $\|\mathrm{MacP}(2,n)\|$ and $\|\mbox{MacP}(1,2,n)\|$ respectively. We will prove that $\mathrm{Gr}(2, \mathbb{R}^n)$ and $\mathrm{Gr}(1,2, \mathbb{R}^n)$ are homeomorphic to $\|\mbox{MacP}(2,n)\|$ and $\|\mbox{MacP}(1,2,n)\|$ respectively.


title: Modelling the Daily Electricity Demand of Electric Vessels in Plymouth

abstract: The international Maritime Organization (IMO) has set the target of reducing the emissions from the shipping sector to at least 50% of the 2008 levels. One potential method to cut emissions is to convert vessels to battery powered propulsion in a similar manner to that which has been adopted for motor vehicles. Although, battery powered propulsion will not be suitable for all vessels, the conversion of those that are will lead to an increase in the energy demand from the national grid. This study uses historic port call data is used to model the timings of arrivals and the number of vessels in the port of Plymouth to predict the increase in additional energy demand required for battery powered vessels through a period of 24 hours as a greater proportion of the fleet move to battery powered propulsion.


title: LPV Modeling of the Atmospheric Flight Dynamics of a Generic Parafoil Return Vehicle

abstract: Obtaining models that can be used for control is of utmost importance to ensure the guidance and navigation of spacecraft, like a Generic Parafoil Return Vehicle (GPRV). In this paper, we convert a nonlinear model of the atmospheric flight dynamics of an GPRV to a Linear Parameter-Varying (LPV) description, such that the LPV model is suitable for navigation control design. Automated conversion methods for nonlinear models can result in complex LPV representation, which are not suitable for controller synthesis. We apply several state-of-the-art techniques, including learning based approaches, to optimize the complexity and conservatism of the LPV embedding for an GPRV. The results show that we can obtain an LPV embedding that approximates the complex nonlinear dynamics sufficiently well, where the balance between complexity, conservatism and model performance is optimal.


title: Neural Networks in Imandra: Matrix Representation as a Verification Choice

abstract: The demand for formal verification tools for neural networks has increased as neural networks have been deployed in a growing number of safety-critical applications. Matrices are a data structure essential to formalising neural networks. Functional programming languages encourage diverse approaches to matrix definitions. This feature has already been successfully exploited in different applications. The question we ask is whether, and how, these ideas can be applied in neural network verification. A functional programming language Imandra combines the syntax of a functional programming language and the power of an automated theorem prover. Using these two key features of Imandra, we explore how different implementations of matrices can influence automation of neural network verification.


title: In-Gap Band Formation in a Periodically Driven Charge Density Wave Insulator

abstract: Periodically driven quantum many-body systems host unconventional behavior not realized at equilibrium. Here we investigate such a setup for strongly interacting spinless fermions on a chain, which at zero temperature and strong interactions form a charge density wave insulator. Using unbiased numerical matrix product state methods for time-dependent spectral functions, we find that driving of the correlated charge-density wave insulator leads not only to a renormalization of the excitation spectrum as predicted by an effective Floquet Hamiltonian, but also to a cosine-like in-gap feature. This is not obtained for a charge density wave model without interactions. A mean-field treatment provides a partial explanation in terms of doublon excitations. However, the full picture needs to take into account strong correlation effects.


title: Live load matrix recovery from scattering data in linear elasticity

abstract: We study the numerical approximation of the inverse scattering problem in the two-dimensional homogeneous isotropic linear elasticity with an unknown linear load given by a square matrix. For both backscattering data and fixed-angle scattering data, we show how to obtain numerical approximations of the so-called Born approximations and propose new iterative algorithms that provide sequences of approximations to the unknown load. Numerical evidences of the convergence for not too large loads are also given.


title: Continuously-Tempered PDMP Samplers

abstract: New sampling algorithms based on simulating continuous-time stochastic processes called piece-wise deterministic Markov processes (PDMPs) have shown considerable promise. However, these methods can struggle to sample from multi-modal or heavy-tailed distributions. We show how tempering ideas can improve the mixing of PDMPs in such cases. We introduce an extended distribution defined over the state of the posterior distribution and an inverse temperature, which interpolates between a tractable distribution when the inverse temperature is 0 and the posterior when the inverse temperature is 1. The marginal distribution of the inverse temperature is a mixture of a continuous distribution on [0,1) and a point mass at 1: which means that we obtain samples when the inverse temperature is 1, and these are draws from the posterior, but sampling algorithms will also explore distributions at lower temperatures which will improve mixing. We show how PDMPs, and particularly the Zig-Zag sampler, can be implemented to sample from such an extended distribution. The resulting algorithm is easy to implement and we show empirically that it can outperform existing PDMP-based samplers on challenging multimodal posteriors.


title: Powering luminous core collapse supernovae with jets

abstract: I examine recent fittings of luminous supernovae (LSNe) with extra energy sources of magnetar and helium burning and find that in about half of these LSNe the fitting parameters have some problems. In some LSNe the total energy of these two energy sources is larger than the kinetic energy of the ejecta that the fitting yields. In some others LSNe the total energy of the delayed neutrino explosion mechanism and these two extra sources combined is smaller than the kinetic energy that the fitting yields. These difficulties suggest that, like earlier claims that jets power superluminous supernovae (SLSNe), jets also power the less luminous LSNe. A magnetar might also supply energy. However, in most cases jets supply more energy than the magnetar, during the explosion and possibly at late times. I strengthen an earlier claim that jets launched at magnetar birth cannot be ignored. I explain the trend of maximum rise time for a given luminosity of hydrogen deficient core collapse supernovae (CCSNe), in particular LSNe and SLSNe, with a toy model of jets that are active for a long time after explosion.


title: On the lower semicontinuity and subdifferentiability of the value function for conic linear programming problems

abstract: Lemma 1 from the paper [N.E. Gretsky, J.M. Ostroy, W.R. Zame, Subdifferentiability and the duality gap, Positivity 6: 261--274, 2002] asserts that the value function $v$ of an infinite dimensional linear programming problem in standard form is lower semicontinuous whenever $v$ is proper and the involved spaces are normed vector spaces. In this note one shows that this statement is false even in finite-dimensional spaces, one provides an example of linear programming problem in Hilbert spaces whose (proper) value function is not lower semicontinuous (hence it is not subdifferentiable) at any point in its domain, one shows that the restriction of the value function to its domain in Kretschmer's gap example is not bounded on any neighborhood of any point of the domain, and discuss other assertions done in the same paper.


title: Topology on diffeological vector spaces

abstract: It is expected that the $D$-topology makes every diffeological vector space into a topological vector space. We show that it is the case for a large class of diffeological vector spaces via $k_\omega$-space theory, but not so in general. The paper also proposes the study of a class of almost topological vector spaces.


title: Geodesics of norms on the contactomorphisms group of $\mathbb{R}^{2n} \times S^1$

abstract: We prove that some paths of contactomorphisms of $\mathbb{R}^{2n} \times S^1$ endowed with its standard contact structure are geodesics for different norms defined on the identity component of the group of compactly supported contactomorphisms and its universal cover. We characterize these geodesics by giving conditions on the Hamiltonian functions that generate them. For every norm considered we show that the norm of a contactomorphism that is the time-one of such a geodesic can be expressed in terms of the maximum of the absolute value of the corresponding Hamiltonian function. In particular we recover the fact that these norms are unbounded


title: Automatic Spoken Language Identification using a Time-Delay Neural Network

abstract: Closed-set spoken language identification is the task of recognizing the language being spoken in a recorded audio clip from a set of known languages. In this study, a language identification system was built and trained to distinguish between Arabic, Spanish, French, and Turkish based on nothing more than recorded speech. A pre-existing multilingual dataset was used to train a series of acoustic models based on the Tedlium TDNN model to perform automatic speech recognition. The system was provided with a custom multilingual language model and a specialized pronunciation lexicon with language names prepended to phones. The trained model was used to generate phone alignments to test data from all four languages, and languages were predicted based on a voting scheme choosing the most common language prepend in an utterance. Accuracy was measured by comparing predicted languages to known languages, and was determined to be very high in identifying Spanish and Arabic, and somewhat lower in identifying Turkish and French.


title: High-energy Gamma-rays from Magnetically Arrested Disks in Nearby Radio Galaxies

abstract: The origins of the GeV gamma-rays from nearby radio galaxies are unknown. Hadronic emission from magnetically arrested disks (MADs) around central black holes (BHs) is proposed as a possible scenario. Particles are accelerated in the MAD by magnetic reconnection and stochastic turbulence acceleration. We pick out the fifteen brightest radio galaxies in the GeV band from the Fermi 4LAC-DR2 catalog and apply the MAD model. We find that we can explain the data in the GeV bands by the MAD model if the accretion rate is lower than 0.1% of the Eddington rate. For a higher accretion rate, GeV gamma-rays are absorbed by two-photon interaction due to copious low-energy photons. If we assume another proposed prescription of the electron heating rate by magnetic reconnection, the MAD model fails to reproduce the GeV data for the majority of our sample. This indicates that the electron heating rate is crucial. We also apply the MAD model to Sgr A* and find that GeV gamma-rays observed at the Galactic center do not come from the MAD of Sgr A*. We estimate the cosmic ray intensity from Sgr A*, but it is too low to explain the high-energy cosmic ray intensity on Earth.


title: Weingarten Flows in Riemannian Manifolds

abstract: Given orientable Riemannian manifolds $M^n$ and $\bar M^{n+1},$ we study flows $F_t:M^n\rightarrow\bar M^{n+1},$ called Weingarten flows,in which the hypersurfaces $F_t(M)$ evolve in the direction of their normal vectors with speed given by a function $W$ of their principal curvatures,called a Weingarten function, which is homogeneous, monotonic increasing with respect to any of its variables, and positive on the positive cone. We obtain existence results for flows with isoparametric initial data, in which the hypersurfaces $F_t:M^n\rightarrow\bar M^{n+1}$ are all parallel, and $\bar M^{n+1}$ is either a simply connected space form or a rank-one symmetric space of noncompact type. We prove that the avoidance principle holds for Weingarten flows defined by odd Weingarten functions, and also that such flows are embedding preserving.


title: Efficient and robust estimation of many-qubit Hamiltonians

abstract: Characterizing the interactions and dynamics of quantum mechanical systems is an essential task in the development of quantum technologies. We propose an efficient protocol based on the estimation of the time derivatives of few qubit observables using polynomial interpolation for characterizing the underlying Hamiltonian dynamics and Markovian noise of a multi-qubit device. For finite range dynamics, our protocol exponentially relaxes the necessary time resolution of the measurements and quadratically reduces the overall sample complexity compared to previous approaches. Furthermore, we show that our protocol can characterize the dynamics of systems with algebraically decaying interactions. The implementation of the protocol requires only the preparation of product states and single-qubit measurements. Furthermore, we develop a shadow tomography method for quantum channels that is of independent interest. This protocol can be used to parallelize to learn the Hamiltonian, rendering it applicable for the characterization of both current and future quantum devices.


title: Orbital-slective behaviour in cubanite CuFe2S3

abstract: Using {\it ab initio} band structure calculations we show that mineral cubanite, CuFe$_2$S$_3$, demonstrates an orbital-selective behavior with some of the electrons occupying molecular orbitals of $x^2-y^2$ symmetry and others localized at atomic orbitals. This is a rare situation for $3d$ transition metal compounds explains experimentally observed absence of charge disproportionation, anomalous M\"ossbauer data, and ferromagnetic ordering in between nearest neighbor Fe ions.


title: Provably Precise, Succinct and Efficient Explanations for Decision Trees

abstract: Decision trees (DTs) embody interpretable classifiers. DTs have been advocated for deployment in high-risk applications, but also for explaining other complex classifiers. Nevertheless, recent work has demonstrated that predictions in DTs ought to be explained with rigorous approaches. Although rigorous explanations can be computed in polynomial time for DTs, their size may be beyond the cognitive limits of human decision makers. This paper investigates the computation of {\delta}-relevant sets for DTs. {\delta}-relevant sets denote explanations that are succinct and provably precise. These sets represent generalizations of rigorous explanations, which are precise with probability one, and so they enable trading off explanation size for precision. The paper proposes two logic encodings for computing smallest {\delta}-relevant sets for DTs. The paper further devises a polynomial-time algorithm for computing {\delta}-relevant sets which are not guaranteed to be subset-minimal, but for which the experiments show to be most often subset-minimal in practice. The experimental results also demonstrate the practical efficiency of computing smallest {\delta}-relevant sets.


title: Approaching Reflex Predictions as a Classification Problem Using Extended Phonological Alignments

abstract: This work describes an implementation of the "extended alignment" (or "multitiers") approach for cognate reflex prediction, submitted to "Prediction of Cognate Reflexes" shared task. Similarly to List2022d, the technique involves an automatic extension of sequence alignments with multilayered vectors that encode informational tiers on both site-specific traits, such as sound classes and distinctive features, as well as contextual and suprasegmental ones, conveyed by cross-site referrals and replication. The method allows to generalize the problem of cognate reflex prediction as a classification problem, with models trained using a parallel corpus of cognate sets. A model using random forests is trained and evaluated on the shared task for reflex prediction, and the experimental results are presented and discussed along with some differences to other implementations.


title: Augmented Lagrangian Methods for Time-varying Constrained Online Convex Optimization

abstract: In this paper, we consider online convex optimization (OCO) with time-varying loss and constraint functions. Specifically, the decision maker chooses sequential decisions based only on past information, meantime the loss and constraint functions are revealed over time. We first develop a class of model-based augmented Lagrangian methods (MALM) for time-varying functional constrained OCO (without feedback delay). Under standard assumptions, we establish sublinear regret and sublinear constraint violation of MALM. Furthermore, we extend MALM to deal with time-varying functional constrained OCO with delayed feedback, in which the feedback information of loss and constraint functions is revealed to decision maker with delays. Without additional assumptions, we also establish sublinear regret and sublinear constraint violation for the delayed version of MALM. Finally, numerical results for several examples of constrained OCO including online network resource allocation, online logistic regression and online quadratically constrained quadratical program are presented to demonstrate the efficiency of the proposed algorithms.


title: Supersymmetric minimal $U(1)_X$ model at the TeV scale with right-handed Majorana neutrino dark matter

abstract: We propose a supersymmetric extension of the minimal $U(1)_X$ model, along with a new $Z_2$-parity. One of the salient features of this model relates to how both the $U(1)_X$ gauge symmetry and R-parity are broken radiatively at the TeV scale by the VEV of a $Z_2$-even right handed neutrino. By assigning one right-handed neutrino $Z_2$-odd parity, it can remain a viable dark matter (DM) candidate, despite R-parity being broken. Furthermore, the DM relic abundance receives an enhanced annihilation cross section due to the $U(1)_X$ gauge boson ($Z'$) resonance and is in agreement with the current observations. We have also found a complementarity that exists between the observed DM relic abundance and search results for the $Z^\prime$ boson resonance at the Large Hadron Collider (LHC), which further constrains the parameter space of our $U(1)_X$ model. Lastly, we consider a $SU(5)\times U(1)_x$ GUT extension and investigate the complementarities mentioned previously.


title: Jacobian Granger Causal Neural Networks for Analysis of Stationary and Nonstationary Data

abstract: Granger causality is a commonly used method for uncovering information flow and dependencies in a time series. Here we introduce JGC (Jacobian Granger Causality), a neural network-based approach to Granger causality using the Jacobian as a measure of variable importance, and propose a thresholding procedure for inferring Granger causal variables using this measure. The resulting approach performs consistently well compared to other approaches in identifying Granger causal variables, the associated time lags, as well as interaction signs. Lastly, through the inclusion of a time variable, we show that this approach is able to learn the temporal dependencies for nonstationary systems whose Granger causal structures change in time.


title: Online Optimization of Dynamical Systems with Deep Learning Perception

abstract: This paper considers the problem of controlling a dynamical system when the state cannot be directly measured and the control performance metrics are unknown or partially known. In particular, we focus on the design of data-driven controllers to regulate a dynamical system to the solution of a constrained convex optimization problem where: i) the state must be estimated from nonlinear and possibly high-dimensional data; and, ii) the cost of the optimization problem -- which models control objectives associated with inputs and states of the system -- is not available and must be learned from data. We propose a data-driven feedback controller that is based on adaptations of a projected gradient-flow method; the controller includes neural networks as integral components for the estimation of the unknown functions. Leveraging stability theory for perturbed systems, we derive sufficient conditions to guarantee exponential input-to-state stability (ISS) of the control loop. In particular, we show that the interconnected system is ISS with respect to the approximation errors of the neural network and unknown disturbances affecting the system. The transient bounds combine the universal approximation property of deep neural networks with the ISS characterization. Illustrative numerical results are presented in the context of control of robotics and epidemics.


title: Learning Graph Structure from Convolutional Mixtures

abstract: Machine learning frameworks such as graph neural networks typically rely on a given, fixed graph to exploit relational inductive biases and thus effectively learn from network data. However, when said graphs are (partially) unobserved, noisy, or dynamic, the problem of inferring graph structure from data becomes relevant. In this paper, we postulate a graph convolutional relationship between the observed and latent graphs, and formulate the graph learning task as a network inverse (deconvolution) problem. In lieu of eigendecomposition-based spectral methods or iterative optimization solutions, we unroll and truncate proximal gradient iterations to arrive at a parameterized neural network architecture that we call a Graph Deconvolution Network (GDN). GDNs can learn a distribution of graphs in a supervised fashion, perform link prediction or edge-weight regression tasks by adapting the loss function, and they are inherently inductive. We corroborate GDN's superior graph recovery performance and its generalization to larger graphs using synthetic data in supervised settings. Furthermore, we demonstrate the robustness and representation power of GDNs on real world neuroimaging and social network datasets.


title: Discovering Dynamic Functional Brain Networks via Spatial and Channel-wise Attention

abstract: Using deep learning models to recognize functional brain networks (FBNs) in functional magnetic resonance imaging (fMRI) has been attracting increasing interest recently. However, most existing work focuses on detecting static FBNs from entire fMRI signals, such as correlation-based functional connectivity. Sliding-window is a widely used strategy to capture the dynamics of FBNs, but it is still limited in representing intrinsic functional interactive dynamics at each time step. And the number of FBNs usually need to be set manually. More over, due to the complexity of dynamic interactions in brain, traditional linear and shallow models are insufficient in identifying complex and spatially overlapped FBNs across each time step. In this paper, we propose a novel Spatial and Channel-wise Attention Autoencoder (SCAAE) for discovering FBNs dynamically. The core idea of SCAAE is to apply attention mechanism to FBNs construction. Specifically, we designed two attention modules: 1) spatial-wise attention (SA) module to discover FBNs in the spatial domain and 2) a channel-wise attention (CA) module to weigh the channels for selecting the FBNs automatically. We evaluated our approach on ADHD200 dataset and our results indicate that the proposed SCAAE method can effectively recover the dynamic changes of the FBNs at each fMRI time step, without using sliding windows. More importantly, our proposed hybrid attention modules (SA and CA) do not enforce assumptions of linearity and independence as previous methods, and thus provide a novel approach to better understanding dynamic functional brain networks.