title: On the Emerging Potential of Quantum Annealing Hardware for Combinatorial Optimization

abstract: Over the past decade, the usefulness of quantum annealing hardware for combinatorial optimization has been the subject of much debate. Thus far, experimental benchmarking studies have indicated that quantum annealing hardware does not provide an irrefutable performance gain over state-of-the-art optimization methods. However, as this hardware continues to evolve, each new iteration brings improved performance and warrants further benchmarking. To that end, this work conducts an optimization performance assessment of D-Wave Systems' most recent Advantage Performance Update computer, which can natively solve sparse unconstrained quadratic optimization problems with over 5,000 binary decision variables and 40,000 quadratic terms. We demonstrate that classes of contrived problems exist where this quantum annealer can provide run time benefits over a collection of established classical solution methods that represent the current state-of-the-art for benchmarking quantum annealing hardware. Although this work does not present strong evidence of an irrefutable performance benefit for this emerging optimization technology, it does exhibit encouraging progress, signaling the potential impacts on practical optimization tasks in the future.


title: Transverse tori in Engel manifolds

abstract: We show that tori in Engel 4-manifolds behave analogously to knots in contact 3-manifolds: Every torus with trivial normal bundle is isotopic to infinitely many distinct transverse tori, distinguished locally (and globally in the nullhomologous case) by their formal invariants. (Few examples of transverse tori were previously known.) We classify the formal invariants, which are richer than for transverse knots, and show that these can all be realized by any torus in an overtwisted Engel manifold, up to homotopy through Engel structures. Fixing Engel structures not known to be overtwisted, we explore the range of the primary invariants of given tori. A sample application is that many Engel manifolds admit infinitely many transverse homotopy classes of unknotted transverse tori such that each class contains infinitely many transverse isotopy classes.


title: Design of Ultrafast All-Optical Pseudo Binary Random Sequence Generator, 4-bit Multiplier and Divider using 2 x 2 Silicon Micro-ring Resonators

abstract: All-optical devices are essential for next generation ultrafast, ultralow-power and ultrahigh bandwidth information processing systems. Silicon microring resonators (SiMRR) provide a versatile platform for all-optical switching and CMOS-compatible computing, with added advantages of high Q-factor, tunability, compactness, cascadability and scalability. A detailed theoretical analysis of ultrafast all-optical switching 2 x 2 SiMRRs has been carried out incorporating the effects of two photon absorption induced free-carrier injection and thermo optic effect. The results have been used to design simple and compact all-optical 3-bit and 4-bit pseudo-random binary sequence generators and the first reported designs of all-optical 4 x 4-bit multiplier and divider. The designs have been optimized for low-power, ultrafast operation with high modulation depth, enabling logic operations at 45 Gbps.


title: Skeleton2Humanoid: Animating Simulated Characters for Physically-plausible Motion In-betweening

abstract: Human motion synthesis is a long-standing problem with various applications in digital twins and the Metaverse. However, modern deep learning based motion synthesis approaches barely consider the physical plausibility of synthesized motions and consequently they usually produce unrealistic human motions. In order to solve this problem, we propose a system ``Skeleton2Humanoid'' which performs physics-oriented motion correction at test time by regularizing synthesized skeleton motions in a physics simulator. Concretely, our system consists of three sequential stages: (I) test time motion synthesis network adaptation, (II) skeleton to humanoid matching and (III) motion imitation based on reinforcement learning (RL). Stage I introduces a test time adaptation strategy, which improves the physical plausibility of synthesized human skeleton motions by optimizing skeleton joint locations. Stage II performs an analytical inverse kinematics strategy, which converts the optimized human skeleton motions to humanoid robot motions in a physics simulator, then the converted humanoid robot motions can be served as reference motions for the RL policy to imitate. Stage III introduces a curriculum residual force control policy, which drives the humanoid robot to mimic complex converted reference motions in accordance with the physical law. We verify our system on a typical human motion synthesis task, motion-in-betweening. Experiments on the challenging LaFAN1 dataset show our system can outperform prior methods significantly in terms of both physical plausibility and accuracy. Code will be released for research purposes at: https://github.com/michaelliyunhao/Skeleton2Humanoid


title: Absolute Minima of Potentials of Certain Regular Spherical Configurations

abstract: We use methods of approximation theory to find the absolute minima on the sphere of the potential of spherical $(2m-3)$-designs with a non-trivial index $2m$ that are contained in a union of $m$ parallel hyperplanes, $m\geq 2$, whose locations satisfy certain additional assumptions. The interaction between points is described by a function of the dot product, which has positive derivatives of orders $2m-2$, $2m-1$, and $2m$. This includes the case of the classical Coulomb, Riesz, and logarithmic potentials as well as a completely monotone potential of the distance squared. We illustrate this result by showing that the absolute minimum of the potential of the set of vertices of the icosahedron on the unit sphere $S^2$ in $\mathbb R^3$ is attained at the vertices of the dual dodecahedron and the one for the set of vertices of the dodecahedron is attained at the vertices of the dual icosahedron. The absolute minimum of the potential of the configuration of $240$ minimal vectors of $E_8$ root lattice normalized to lie on the unit sphere $S^7$ in $\mathbb R^8$ is attained at a set of $2160$ points on $S^7$ which we describe.


title: FP-Diffusion: Improving Score-based Diffusion Models by Enforcing the Underlying Score Fokker-Planck Equation

abstract: Score-based generative models (SGMs) learn a family of noise-conditional score functions corresponding to the data density perturbed with increasingly large amounts of noise. These perturbed data densities are linked together by the Fokker-Planck equation (FPE), a partial differential equation (PDE) governing the spatial-temporal evolution of a density undergoing a diffusion process. In this work, we derive a corresponding equation called the score FPE that characterizes the noise-conditional scores of the perturbed data densities (i.e., their gradients). Surprisingly, despite the impressive empirical performance, we observe that scores learned through denoising score matching (DSM) fail to fulfill the underlying score FPE, which is an inherent self-consistency property of the ground truth score. We prove that satisfying the score FPE is desirable as it improves the likelihood and the degree of conservativity. Hence, we propose to regularize the DSM objective to enforce satisfaction of the score FPE, and we show the effectiveness of this approach across various datasets.


title: Optimal Control for Platooning in Vehicular Networks

abstract: As the automotive industry is developing autonomous driving systems and vehicular networks, attention to truck platooning has increased as a way to reduce costs (fuel consumption) and improve efficiency in the highway. Recent research in this area has focused mainly on the aerodynamics, network stability, and longitudinal control of platoons. However, the system aspects (e.g., platoon coordination) are still not well explored. In this paper, we formulate a platooning coordination problem and study whether trucks waiting at an initial location (station) should wait for a platoon to arrive in order to leave. Arrivals of trucks at the station and platoons by the station are modelled by independent Bernoulli distributions. Next we use the theory of Markov Decision Processes to formulate the dispatching control problem and derive the optimal policy governing the dispatching of trucks with platoons. We show that the policy that minimizes an average cost function at the station is of threshold type. Numerical results for the average cost case are presented. They are consistent with the optimal ones.


title: A HARPS radial velocity search for planets in the Scorpius-Centaurus association. And its combination with the HARPS and SOPHIE young nearby stars (YNS) surveys

abstract: The Scorpius-Centaurus (Sco-Cen) young and nearby massive star-forming region is particularly well suited for extrasolar planet searches with both direct imaging and radial velocity (RV) techniques. The RV search, however, is challenging, as the stars are faster rotators on average than their older stellar counterparts of similar spectral types. Moreover, the RV time series show strong signatures of stellar variability (spots and faculae) and/or stellar pulsations. Our aim is to search for giant planets (GPs) and brown dwarfs at short orbital distances around star members of the Sco-Cen association. We also aim at using these data together with others available on young stars to estimate the GP occurrence rate for young stars for periods of up to 1000 days. We used the HARPS spectrograph on the 3.6m telescope at the La Silla Observatory to monitor 88 A-F Sco-Cen stars. To improve our statistics and analysis, we combined this survey with two previous surveys that focused on young nearby stars (YNS) to compute companion occurrence rates from a sample of 176 young A-M stars. We report the discovery of a massive hot-Jupiter candidate around HD 145467, together with the discovery of one probable short-period (P < 10 days) brown dwarf around HD 149790. In addition, we confirm the binary nature of eight single-line binaries: HD 108857, HD 108904, HD 111102, HD 114319, HD 121176, HD 126488, HD 126838, and HD 133574. From our sample, we obtain a GP ($m_c\in[1;13] M_{Jup}$) occurrence rate of $0.7_{-0.2}^{+1.6} \ \%$ for periods between 1 and 1000 days and a brown dwarf ($m_c\in[13;80] M_{Jup}$) occurrence rate of $0.6_{-0.2}^{+1.4} \ \%$, in the same period range. In addition, we report a possible lack of close ($P\in[1;1000] days$) GPs around young F-K stars compared to their older counterparts, with a confidence level of 95%.


title: Speed of convergence of time Euler schemes for a stochastic 2D Boussinesq model

abstract: We prove that an implicit time Euler scheme for the 2D-Boussinesq model on the torus $D$ converges. Various moment of the $W^{1,2}$-norms of the velocity and temperature, as well as their discretizations, are computed. We obtain the optimal speed of convergence in probability, and a logarithmic speed of convergence in $L^2(\Omega)$. These results are deduced from a time regularity of the solution both in $L^2(D)$ and $W^{1,2}(D)$, and from an $L^2(\Omega)$ convergence restricted to a subset where the $W^{1,2}$-noms of the solutions are bounded.


title: Neural networks for first order HJB equations and application to front propagation with obstacle terms

abstract: We consider a deterministic optimal control problem with a maximum running cost functional, in a finite horizon context, and propose deep neural network approximations for Bellman's dynamic programming principle, corresponding also to some first-order Hamilton-Jacobi-Bellman equations. This work follows the lines of Hur\'e et al. (SIAM J. Numer. Anal., vol. 59 (1), 2021, pp. 525-557) where algorithms are proposed in a stochastic context. However, we need to develop a completely new approach in order to deal with the propagation of errors in the deterministic setting, where no diffusion is present in the dynamics. Our analysis gives precise error estimates in an average norm. The study is then illustrated on several academic numerical examples related to front propagations models in the presence of obstacle constraints, showing the relevance of the approach for average dimensions (e.g. from $2$ to $8$), even for non-smooth value functions.


title: Visibility of capillaries in turbid tissues: an analytical approach

abstract: Purpose: Visualization and monitoring of capillary loops in dermis and mucosa are interesting for various clinical applications, including rheumatology, early cancer, and shock detection. However, the limitations of existing imaging technologies are not well understood. Therefore, this study aimed to elucidate peculiarities of the subsurface defect visualization in realistic skin imaging geometries. Methods: We used a perturbation approach for the light propagation in turbid tissues with mismatched boundaries. Defects were considered as negative light sources immersed in homogeneous media, which was described using diffuse approximation. The contrast ratio was used as an image quality metric. Results: We have developed the single point subsurface defect model and extended it to horizontally- and vertically-arranged linear inhomogeneities. In particular, we have obtained explicit analytical expressions for the single point defect and the infinite linear defect buried at a certain depth (horizontally-arranged), which allows direct experimental verification. Conclusions: The developed approach can be used for quick rough estimates while designing and optimizing imaging systems.


title: Equivalence of Optimality Criteria for Markov Decision Process and Model Predictive Control

abstract: This paper shows that the optimal policy and value functions of a Markov Decision Process (MDP), either discounted or not, can be captured by a finite-horizon undiscounted Optimal Control Problem (OCP), even if based on an inexact model. This can be achieved by selecting a proper stage cost and terminal cost for the OCP. A very useful particular case of OCP is a Model Predictive Control (MPC) scheme where a deterministic (possibly nonlinear) model is used to reduce the computational complexity. This observation leads us to parameterize an MPC scheme fully, including the cost function. In practice, Reinforcement Learning algorithms can then be used to tune the parameterized MPC scheme. We verify the developed theorems analytically in an LQR case and we investigate some other nonlinear examples in simulations.


title: Are All Vision Models Created Equal? A Study of the Open-Loop to Closed-Loop Causality Gap

abstract: There is an ever-growing zoo of modern neural network models that can efficiently learn end-to-end control from visual observations. These advanced deep models, ranging from convolutional to patch-based networks, have been extensively tested on offline image classification and regression tasks. In this paper, we study these vision architectures with respect to the open-loop to closed-loop causality gap, i.e., offline training followed by an online closed-loop deployment. This causality gap typically emerges in robotics applications such as autonomous driving, where a network is trained to imitate the control commands of a human. In this setting, two situations arise: 1) Closed-loop testing in-distribution, where the test environment shares properties with those of offline training data. 2) Closed-loop testing under distribution shifts and out-of-distribution. Contrary to recently reported results, we show that under proper training guidelines, all vision models perform indistinguishably well on in-distribution deployment, resolving the causality gap. In situation 2, We observe that the causality gap disrupts performance regardless of the choice of the model architecture. Our results imply that the causality gap can be solved in situation one with our proposed training guideline with any modern network architecture, whereas achieving out-of-distribution generalization (situation two) requires further investigations, for instance, on data diversity rather than the model architecture.


title: On Rigidity for the Four-Well Problem Arising in the Cubic-to-Trigonal Phase Transformation

abstract: We classify all exactly stress-free solutions to the cubic-to-trigonal phase transformation within the geometrically linearized theory of elasticity, showing that only simple laminates and crossing-twin structures can occur. In particular, we prove that although this transformation is closely related to the cubic-to-orthorhombic phase transformation, all its solutions are rigid. The argument relies on a combination of the Saint-Venant compatibility conditions together with the underlying nonlinear relations and non-convexity conditions satisfied by the strain components.


title: Stochastic Precipitation Generation for the Chesapeake Bay Watershed using Hidden Markov Models with Variational Bayes Parameter Estimation

abstract: Stochastic precipitation generators (SPGs) are a class of statistical models which generate synthetic data that can simulate dry and wet rainfall stretches for long durations. Generated precipitation time series data are used in climate projections, impact assessment of extreme weather events, and water resource and agricultural management. We construct an SPG for daily precipitation data that is specified as a semi-continuous distribution at every location, with a point mass at zero for no precipitation and a mixture of two exponential distributions for positive precipitation. Our generators are obtained as hidden Markov models (HMMs) where the underlying climate conditions form the states. We fit a 3-state HMM to daily precipitation data for the Chesapeake Bay watershed in the Eastern coast of the USA for the wet season months of July to September from 2000--2019. Data is obtained from the GPM-IMERG remote sensing dataset, and existing work on variational HMMs is extended to incorporate semi-continuous emission distributions. In light of the high spatial dimension of the data, a stochastic optimization implementation allows for computational speedup. The most likely sequence of underlying states is estimated using the Viterbi algorithm, and we identify the differences in the weather regimes associated with the states of the proposed model. Synthetic data generated from the HMM can reproduce monthly precipitation statistics as well as spatial dependency present in the historical GPM-IMERG data.


title: Quantifying Quantum Causal Influences

abstract: Causal influences are at the core of any empirical science, the reason why its quantification is of paramount relevance for the mathematical theory of causality and applications. Quantum correlations, however, challenge our notion of cause and effect, implying that tools and concepts developed over the years having in mind a classical world, have to be reevaluated in the presence of quantum effects. Here, we propose the quantum version of the most common causality quantifier, the average causal effect (ACE), measuring how much a target quantum system is changed by interventions on its presumed cause. Not only it offers an innate manner to quantify causation in two-qubit gates but also in alternative quantum computation models such as the measurement-based version, suggesting that causality can be used as a proxy for optimizing quantum algorithms. Considering quantum teleportation, we show that any pure entangled state offers an advantage in terms of causal effects as compared to separable states. This broadness of different uses showcases that, just as in the classical case, the quantification of causal influence has foundational and applied consequences and can lead to a yet totally unexplored tool for quantum information science.


title: KSAT: Knowledge-infused Self Attention Transformer -- Integrating Multiple Domain-Specific Contexts

abstract: Domain-specific language understanding requires integrating multiple pieces of relevant contextual information. For example, we see both suicide and depression-related behavior (multiple contexts) in the text ``I have a gun and feel pretty bad about my life, and it wouldn't be the worst thing if I didn't wake up tomorrow''. Domain specificity in self-attention architectures is handled by fine-tuning on excerpts from relevant domain specific resources (datasets and external knowledge - medical textbook chapters on mental health diagnosis related to suicide and depression). We propose a modified self-attention architecture Knowledge-infused Self Attention Transformer (KSAT) that achieves the integration of multiple domain-specific contexts through the use of external knowledge sources. KSAT introduces knowledge-guided biases in dedicated self-attention layers for each knowledge source to accomplish this. In addition, KSAT provides mechanics for controlling the trade-off between learning from data and learning from knowledge. Our quantitative and qualitative evaluations show that (1) the KSAT architecture provides novel human-understandable ways to precisely measure and visualize the contributions of the infused domain contexts, and (2) KSAT performs competitively with other knowledge-infused baselines and significantly outperforms baselines that use fine-tuning for domain-specific tasks.


title: Privacy-preserving Intelligent Resource Allocation for Federated Edge Learning in Quantum Internet

abstract: Federated edge learning (FEL) is a promising paradigm of distributed machine learning that can preserve data privacy while training the global model collaboratively. However, FEL is still facing model confidentiality issues due to eavesdropping risks of exchanging cryptographic keys through traditional encryption schemes. Therefore, in this paper, we propose a hierarchical architecture for quantum-secured FEL systems with ideal security based on the quantum key distribution (QKD) to facilitate public key and model encryption against eavesdropping attacks. Specifically, we propose a stochastic resource allocation model for efficient QKD to encrypt FEL keys and models. In FEL systems, remote FEL workers are connected to cluster heads via quantum-secured channels to train an aggregated global model collaboratively. However, due to the unpredictable number of workers at each location, the demand for secret-key rates to support secure model transmission to the server is unpredictable. The proposed systems need to efficiently allocate limited QKD resources (i.e., wavelengths) such that the total cost is minimized in the presence of stochastic demand by formulating the optimization problem for the proposed architecture as a stochastic programming model. To this end, we propose a federated reinforcement learning-based resource allocation scheme to solve the proposed model without complete state information. The proposed scheme enables QKD managers and controllers to train a global QKD resource allocation policy while keeping their private experiences local. Numerical results demonstrate that the proposed schemes can successfully achieve the cost-minimizing objective under uncertain demand while improving the training efficiency by about 50\% compared to state-of-the-art schemes.


title: Flat polymerized membranes at three-loop order

abstract: In this conference report, we present a recent field theoretic renormalization group analysis of flat polymerized membranes at three-loop order by the present authors [Phys. Rev. E 105, L012603 (2022)].


title: An Instance Selection Algorithm for Big Data in High imbalanced datasets based on LSH

abstract: Training of Machine Learning (ML) models in real contexts often deals with big data sets and high-class imbalance samples where the class of interest is unrepresented (minority class). Practical solutions using classical ML models address the problem of large data sets using parallel/distributed implementations of training algorithms, approximate model-based solutions, or applying instance selection (IS) algorithms to eliminate redundant information. However, the combined problem of big and high imbalanced datasets has been less addressed. This work proposes three new methods for IS to be able to deal with large and imbalanced data sets. The proposed methods use Locality Sensitive Hashing (LSH) as a base clustering technique, and then three different sampling methods are applied on top of the clusters (or buckets) generated by LSH. The algorithms were developed in the Apache Spark framework, guaranteeing their scalability. The experiments carried out in three different datasets suggest that the proposed IS methods can improve the performance of a base ML model between 5% and 19% in terms of the geometric mean.


title: Pruning Adversarially Robust Neural Networks without Adversarial Examples

abstract: Adversarial pruning compresses models while preserving robustness. Current methods require access to adversarial examples during pruning. This significantly hampers training efficiency. Moreover, as new adversarial attacks and training methods develop at a rapid rate, adversarial pruning methods need to be modified accordingly to keep up. In this work, we propose a novel framework to prune a previously trained robust neural network while maintaining adversarial robustness, without further generating adversarial examples. We leverage concurrent self-distillation and pruning to preserve knowledge in the original model as well as regularizing the pruned model via the Hilbert-Schmidt Information Bottleneck. We comprehensively evaluate our proposed framework and show its superior performance in terms of both adversarial robustness and efficiency when pruning architectures trained on the MNIST, CIFAR-10, and CIFAR-100 datasets against five state-of-the-art attacks. Code is available at https://github.com/neu-spiral/PwoA/.


title: A Beam-Space Active Sensing Scheme for Integrated Communication and Sensing Applications

abstract: In this paper, we develop an active sensing strategy for a millimeter wave (mmWave) band Integrated Sensing and Communication (ISAC) system adopting a realistic hybrid digital-analog (HDA) architecture. To maintain a desired SNR level, initial beam acquisition (BA) must be established prior to data transmission. In the considered setup, a Base Station (BS) Tx transmits data via a digitally modulated waveform and a co-located radar receiver simultaneously performs radar estimation from the backscattered signal. In this BA scheme, a single common data stream is broadcast over a wide angular sector such that the radar receiver can detect the presence of not yet acquired users and perform coarse parameter estimation (angle of arrival, time of flight, and Doppler). As a result of the HDA architecture, we consider the design of multi-block adaptive RF-domain 'reduction matrices' (from antennas to RF chains) at the radar receiver, to achieve a compromise between the exploration capability in the angular domain and the directivity of the beamforming patterns. Our numerical results demonstrate that the proposed approach is able to reliably detect multiple targets while significantly reducing the initial acquisition time.


title: On the Need of Analog Signals and Systems for Digital-Twin Representations

abstract: We consider the task of converting different digital descriptions of analog bandlimited signals and systems into each other, with a rigorous application of mathematical computability theory. Albeit very fundamental, the problem appears in the scope of digital twinning, an emerging concept in the field of digital processing of analog information that is regularly mentioned as one of the key enablers for next-generation cyber-physical systems and their areas of application. In this context, we prove that essential quantities such as the peak-to-average power ratio and the bounded-input/bounded-output norm, which determine the behavior of the real-world analog system, cannot generally be determined from the system's digital twin, depending on which of the above-mentioned descriptions is chosen. As a main result, we characterize the algorithmic strength of Shannon's sampling type representation as digital twin implementation and also introduce a new digital twin implementation of analog signals and systems. We show there exist two digital descriptions, both of which uniquely characterize a certain analog system, such that one description can be algorithmically converted into the other, but not vice versa.


title: How general is the strong cosmic censorship bound for quasinormal modes?

abstract: Hod's proposal claims that the least damped quasinormal mode of a black hole must have the imaginary part smaller than half of the surface gravity at the event horizon. The Strong Cosmic Censorship in General Relativity implies that this bound must be even weaker: half of the surface gravity at the Cauchy horizon. The appealing question is whether these bounds are limited by the Einstein theory only? Here we will present numerical evidence that once the black hole size is much smaller than then the radius of the cosmological horizon, both the Hod's proposal and the strong cosmic censorship bound for quasinormal modes are satisfied for general spherically symmetric black holes in an arbitrary metric theory of gravity. The low-lying quasinormal frequencies have the universal behavior in this regime and do not depend on the near-horizon geometry, but only on the asymptotic parameters: the value of the cosmological constant and black hole mass.


title: Understanding the impact of heavy ions and tailoring the optical properties of large-area Monolayer WS2 using Focused Ion Beam

abstract: Focused ion beam (FIB) has been used as an effective tool for precise nanoscale fabrication. It has recently been employed to tailor defect engineering in functional nanomaterials such as two-dimensional transition metal dichalcogenides (TMDCs), providing desirable properties in TMDC-based optoelectronic devices. However, the damage caused by the FIB irradiation and milling process to these delicate atomically thin materials, especially in the extended area, has not yet been elaboratively characterised. Understanding the correlation between lateral ion beam effects and optical properties of 2D TMDCs is crucial in designing and fabricating high-performance optoelectronic devices. In this work, we investigate lateral damage in large-area monolayer WS2 caused by the gallium focused ion beam milling process. Three distinct zones away from the milling location are identified and characterised via steady-state photoluminescence (PL) and Raman spectroscopy. An unexpected bright ring-shaped emission around the milled location has been revealed by time-resolved PL spectroscopy with high spatial resolution. Our finding opens new avenues for tailoring the optical properties of TMDCs by charge and defect engineering via focused ion beam lithography. Furthermore, our study provides evidence that while some localised damage is inevitable, distant destruction can be eliminated by reducing the ion beam current. It paves the way for the use of FIB to create nanostructures in 2D TMDCs, as well as the design and realisation of optoelectrical devices on a wafer scale.


title: In-flight radiometric calibration of the ExoMars TGO Colour and Stereo Surface Imaging System

abstract: The Colour and Stereo Surface Science Imaging System (CaSSIS) of the ExoMars Trace Gas Orbiter returns on average twenty images per day of the Martian surface, most of them in 3 or 4 colours and some of them in stereo. CaSSIS uses a push-frame approach to acquire colour images, with four bandpass filters deposited directly above the sensor and an imaging cadence synchronized with the ground track velocity to cover the imaged area with tens of small, partially overlapping images. These "framelets" are later map-projected and mosaicked to build the final image. This approach offers both advantages and challenges in terms of radiometric calibration. While the collection of dark and flatfield frames is considerably enhanced by the frequent and fast acquisition of tens of successive images, mosaics assembled from the adjacent framelets highlight the straylight and changes in the bias of the detector. Both issues have been identified on CaSSIS images, with low intensities overall (up to a few percents), but sufficient to generate prominent artefacts on the final assembled colour images. We have therefore developed methods to correct these artefacts that are now included into the radiometric calibration pipeline. We detail here the different steps of the calibration procedure and the generation of the products used for calibration, and discuss the efficacy of the corrections. The relative uncertainties on the bias and flatfield frames are low, of the order of 0.2 and 0.1 percents, respectively. The uncertainty on the absolute radiometric calibration is of 3 percents, which is quite low for such an instrument. The straylight adds an estimated about 1 percent error to the absolute calibration. The residuals after corrections of the straylight and bias offsets are of the order of a few DNs to tens of DNs.


title: A Spectral Approach to Item Response Theory

abstract: The Rasch model is one of the most fundamental models in \emph{item response theory} and has wide-ranging applications from education testing to recommendation systems. In a universe with $n$ users and $m$ items, the Rasch model assumes that the binary response $X_{li} \in \{0,1\}$ of a user $l$ with parameter $\theta^*_l$ to an item $i$ with parameter $\beta^*_i$ (e.g., a user likes a movie, a student correctly solves a problem) is distributed as $\Pr(X_{li}=1) = 1/(1 + \exp{-(\theta^*_l - \beta^*_i)})$. In this paper, we propose a \emph{new item estimation} algorithm for this celebrated model (i.e., to estimate $\beta^*$). The core of our algorithm is the computation of the stationary distribution of a Markov chain defined on an item-item graph. We complement our algorithmic contributions with finite-sample error guarantees, the first of their kind in the literature, showing that our algorithm is consistent and enjoys favorable optimality properties. We discuss practical modifications to accelerate and robustify the algorithm that practitioners can adopt. Experiments on synthetic and real-life datasets, ranging from small education testing datasets to large recommendation systems datasets show that our algorithm is scalable, accurate, and competitive with the most commonly used methods in the literature.


title: Prediction intervals for neural network models using weighted asymmetric loss functions

abstract: We propose a simple and efficient approach to generate a prediction intervals (PI) for approximated and forecasted trends. Our method leverages a weighted asymmetric loss function to estimate the lower and upper bounds of the PI, with the weights determined by its coverage probability. We provide a concise mathematical proof of the method, show how it can be extended to derive PIs for parametrised functions and discuss its effectiveness when training deep neural networks. The presented tests of the method on a real-world forecasting task using a neural network-based model show that it can produce reliable PIs in complex machine learning scenarios.


title: Dissecting adaptive methods in GANs

abstract: Adaptive methods are a crucial component widely used for training generative adversarial networks (GANs). While there has been some work to pinpoint the "marginal value of adaptive methods" in standard tasks, it remains unclear why they are still critical for GAN training. In this paper, we formally study how adaptive methods help train GANs; inspired by the grafting method proposed in arXiv:2002.11803 [cs.LG], we separate the magnitude and direction components of the Adam updates, and graft them to the direction and magnitude of SGDA updates respectively. By considering an update rule with the magnitude of the Adam update and the normalized direction of SGD, we empirically show that the adaptive magnitude of Adam is key for GAN training. This motivates us to have a closer look at the class of normalized stochastic gradient descent ascent (nSGDA) methods in the context of GAN training. We propose a synthetic theoretical framework to compare the performance of nSGDA and SGDA for GAN training with neural networks. We prove that in that setting, GANs trained with nSGDA recover all the modes of the true distribution, whereas the same networks trained with SGDA (and any learning rate configuration) suffer from mode collapse. The critical insight in our analysis is that normalizing the gradients forces the discriminator and generator to be updated at the same pace. We also experimentally show that for several datasets, Adam's performance can be recovered with nSGDA methods.


title: QAScore -- An Unsupervised Unreferenced Metric for the Question Generation Evaluation

abstract: Question Generation (QG) aims to automate the task of composing questions for a passage with a set of chosen answers found within the passage. In recent years, the introduction of neural generation models has resulted in substantial improvements of automatically generated questions in terms of quality, especially compared to traditional approaches that employ manually crafted heuristics. However, the metrics commonly applied in QG evaluations have been criticized for their low agreement with human judgement. We therefore propose a new reference-free evaluation metric that has the potential to provide a better mechanism for evaluating QG systems, called QAScore. Instead of fine-tuning a language model to maximize its correlation with human judgements, QAScore evaluates a question by computing the cross entropy according to the probability that the language model can correctly generate the masked words in the answer to that question. Furthermore, we conduct a new crowd-sourcing human evaluation experiment for the QG evaluation to investigate how QAScore and other metrics can correlate with human judgements. Experiments show that QAScore obtains a stronger correlation with the results of our proposed human evaluation method compared to existing traditional word-overlap-based metrics such as BLEU and ROUGE, as well as the existing pretrained-model-based metric BERTScore.


title: A Nonlinear Heat Equation Arising from Automated-Vehicle Traffic Flow Models

abstract: In this paper, a new nonlinear heat equation is studied that arises as a model of the collective behavior of automated vehicles. The properties of the solutions of this equation are studied by introducing the appropriate notion of a weak solution that requires certain entropy-like conditions. To obtain an approximation of the solution of the nonlinear heat equation, a new conservative first-order finite difference scheme is proposed that respects the corresponding entropy conditions, and certain links between the weak solution and the numerical scheme are provided. Finally, a traffic simulation scenario and a comparison with the Lighthill-Witham-Richards (LWR) model are provided, illustrating the benefits of the use of automated vehicles.


title: Periodic Weighted Sums of Binomial Coefficients

abstract: Using elementary methods, we establish old and new relations between binomial coefficients, Fibonacci numbers, Lucas numbers, and more.


title: Deep Learning Inference Frameworks Benchmark

abstract: Deep learning (DL) has been widely adopted those last years but they are computing-intensive method. Therefore, scientists proposed diverse optimization to accelerate their predictions for end-user applications. However, no single inference framework currently dominates in terms of performance. This paper takes a holistic approach to conduct an empirical comparison and analysis of four representative DL inference frameworks. First, given a selection of CPU-GPU configurations, we show that for a specific DL framework, different configurations of its settings may have a significant impact on the prediction speed, memory, and computing power. Second, to the best of our knowledge, this study is the first to identify the opportunities for accelerating the ensemble of co-localized models in the same GPU. This measurement study provides an in-depth empirical comparison and analysis of four representative DL frameworks and offers practical guidance for service providers to deploy and deliver DL predictions.


title: Photonuclear reactions cross-sections at energies up to 100 MeV for different experimental setups

abstract: In experiments on the electron linac LUE-40 of RDC "Accelerator" NSC KIPT, the flux-averaged cross-sections $\langle{\sigma(E_{\rm{\gamma max}})}\rangle_{\rm{exp}}$ of photonuclear reactions ${^{100}\rm{Mo}}(\gamma,n)^{99}\rm{Mo}$, ${^{27}\rm{Al}}(\gamma,x)^{24}\rm{Na}$, ${^{93}\rm{Nb}}(\gamma,n)^{92m}\rm{Nb}$, ${^{93}\rm{Nb}}(\gamma,3n)^{90}\rm{Nb}$, and ${^{181}\rm{Ta}}(\gamma,n)^{180g}\rm{Ta}$ were measured using the $\gamma$-activation technique. The theoretical flux-average cross-sections $\langle{\sigma(E_{\rm{\gamma max}})}\rangle_{\rm{th}}$ were computed using the partial cross-section $\sigma(E)$ values from the TALYS1.9-1.95 codes and bremsstrahlung $\gamma$-flux calculated using GEANT4.9.2. Two different experimental setups were used in the experiments: an aluminum electron absorber and a deflecting magnet to clean the bremsstrahlung $\gamma$-flux from electrons. A comparison of the flux-average cross-sections measured for two experimental setups was performed. The possibility of using the reactions ${^{100}\rm{Mo}}(\gamma,n)^{99}\rm{Mo}$, ${^{27}\rm{Al}}(\gamma,x)^{24}\rm{Na}$, ${^{93}\rm{Nb}}(\gamma,n)^{92m}\rm{Nb}$, ${^{93}\rm{Nb}}(\gamma,3n)^{90}\rm{Nb}$, and ${^{181}\rm{Ta}}(\gamma,n)^{180g}\rm{Ta}$ as monitors of the bremsstrahlung $\gamma$-flux for the energy range 30-100 MeV was investigated.


title: ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language Models

abstract: Data-to-text generation is challenging due to the great variety of the input data in terms of domains (e.g., finance vs sports) or schemata (e.g., diverse predicates). Recent end-to-end neural methods thus require substantial training examples to learn to disambiguate and describe the data. Yet, real-world data-to-text problems often suffer from various data-scarce issues: one may have access to only a handful of or no training examples, and/or have to rely on examples in a different domain or schema. To fill this gap, we propose Any-Shot Data-to-Text (ASDOT), a new approach flexibly applicable to diverse settings by making efficient use of any given (or no) examples. ASDOT consists of two steps, data disambiguation and sentence fusion, both of which are amenable to be solved with off-the-shelf pretrained language models (LMs) with optional finetuning. In the data disambiguation stage, we employ the prompted GPT-3 model to understand possibly ambiguous triples from the input data and convert each into a short sentence with reduced ambiguity. The sentence fusion stage then uses an LM like T5 to fuse all the resulting sentences into a coherent paragraph as the final description. We evaluate extensively on various datasets in different scenarios, including the zero-/few-/full-shot settings, and generalization to unseen predicates and out-of-domain data. Experimental results show that ASDOT consistently achieves significant improvement over baselines, e.g., a 30.81 BLEU gain on the DART dataset under the zero-shot setting.


title: Piecewise-linear promotion and RSK in rectangles and moon polyominoes

abstract: We study piecewise-linear and birational lifts of Sch\"utzenberger promotion, evacuation, and the RSK correspondence defined in terms of toggles. Using this perspective, we prove that certain chain statistics in rectangles shift predictably under the action of these maps. We then use this to construct piecewise-linear and birational versions of Rubey's bijections between fillings of equivalent moon polyominoes that preserve these chain statistics, and we show that these maps form a commuting diagram. We also discuss how these results imply Ehrhart equivalence and Ehrhart quasi-polynomial period collapse of certain analogues of chain polytopes for moon polyominoes.


title: Direct visualization and control of antiferromagnetic domains and spin reorientation in a parent cuprate

abstract: We report magnetic optical second-harmonic generation (SHG) polarimetry and imaging on Sr$_2$Cu$_3$O$_4$Cl$_2$, which allows direct visualization of the mesoscopic antiferromagnetic (AFM) structure of a parent cuprate. Temperature- and magnetic-field-dependent SHG reveals large domains with 90$^{\circ}$ relative orientations that are stabilized by a combination of uniaxial magnetic anisotropy and the Earth's magnetic field. Below a temperature $T_R$ $\sim$ 97 K, we observe an unusual 90$^{\circ}$ spin reorientation transition, possibly driven by competing magnetic anisotropies of the two copper sublattices, which swaps the AFM domain states while preserving the domain structure. This allows deterministic switching of the AFM states by thermal or laser heating. Near $T_R$, the domain walls become exceptionally responsive to an applied magnetic field, with the Earth's field sufficient to completely expel them from the crystal. Our findings unlock opportunities to study the mesoscopic AFM behavior of parent cuprates and explore their potential for AFM technologies.


title: seL4 Microkernel for virtualization use-cases: Potential directions towards a standard VMM

abstract: Virtualization plays an essential role in providing security to computational systems by isolating execution environments. Many software solutions, called hypervisors, have been proposed to provide virtualization capabilities. However, only a few were designed for being deployed at the edge of the network, in devices with fewer computation resources when compared with servers in the Cloud. Among the few lightweight software that can play the hypervisor role, seL4 stands out by providing a small Trusted Computing Base and formally verified components, enhancing its security. Despite today being more than a decade with seL4 microkernel technology, its existing userland and tools are still scarce and not very mature. Over the last few years, the main effort has been put into increasing the maturity of the kernel itself and not the tools and applications that can be hosted on top. Therefore, it currently lacks proper support for a full-featured userland Virtual Machine Monitor, and the existing one is quite fragmented. This article discusses the potential directions to a standard VMM by presenting our view of design principles and feature set needed. This article does not intend to define a standard VMM, we intend to instigate this discussion through the seL4 community.


title: Improved time integration for phase-field crystal models of solidification

abstract: We optimize a numerical time-stabilization routine for the phase-field crystal (PFC) models of solidification. By numerical experiments, we showcase that our approach can improve the accuracy of underlying time integration schemes by a few orders of magnitude. We investigate different time integration schemes. Moreover, as a prototypical example for applications, we extend our numerical approach to a PFC model of solidification with an explicit temperature coupling.


title: Benchmarking multi-qubit gates -- I: Metrological aspects

abstract: Accurate and precise control of large quantum systems is paramount to achieve practical advantages on quantum devices. Therefore, benchmarking the hardware errors in quantum computers has drawn significant attention lately. Existing benchmarks for digital quantum computers involve averaging the global fidelity over a large set of quantum circuits and are therefore unsuitable for specific multi-qubit gates used in analog quantum operations. Moreover, average global fidelity is not the optimal figure-of-merit for some of the applications specific to multi-qubit gates and analog devices , such as the study of many-body physics, which often use local observables. In this two-part paper, we develop a new figure-of-merit suitable for multi-qubit quantum gates based on the reduced Choi matrix of the operation. In the first part, we develop an efficient, scalable protocol to completely characterize the reduced Choi matrix. We identify two sources of sampling errors in measurements of the reduced Choi matrix and we show that there are fundamental limits to the rate of convergence of the sampling errors, analogous to the standard quantum limit and Heisenberg limit. A slow convergence rate of sampling errors would mean that we need a large number of experimental shots. We develop protocols using quantum information scrambling, which has been observed in disordered systems for e.g., to speed up the rate of convergence of the sampling error at state preparation Moreover, we develop protocols using squeezed and entangled initial states to enhance the convergence rate of the sampling error at measurement, which results in a metrologically enhanced reduced process tomography protocol.


title: Students taught by multimodal teachers are superior action recognizers

abstract: The focal point of egocentric video understanding is modelling hand-object interactions. Standard models -- CNNs, Vision Transformers, etc. -- which receive RGB frames as input perform well, however, their performance improves further by employing additional modalities such as object detections, optical flow, audio, etc. as input. The added complexity of the required modality-specific modules, on the other hand, makes these models impractical for deployment. The goal of this work is to retain the performance of such multimodal approaches, while using only the RGB images as input at inference time. Our approach is based on multimodal knowledge distillation, featuring a multimodal teacher (in the current experiments trained only using object detections, optical flow and RGB frames) and a unimodal student (using only RGB frames as input). We present preliminary results which demonstrate that the resulting model -- distilled from a multimodal teacher -- significantly outperforms the baseline RGB model (trained without knowledge distillation), as well as an omnivorous version of itself (trained on all modalities jointly), in both standard and compositional action recognition.


title: Trees of Dot Products in Thin Subsets of $\mathbb R^d$

abstract: A. Iosevich and K. Taylor showed that compact subsets of $\mathbb R^d$ with Hausdorff dimension greater than $(d+1)/2$ contain trees with gaps in an open interval. Under the same dimensional threshold, we prove the analogous result where distance is replaced by the dot product. We additionally show that the gaps of embedded trees of dot products are prevalent in a set of positive Lebesgue measure, and for Ahlfors-David regular sets, the number of trees with given gaps agrees with the regular value theorem.


title: Hypergraph-based Multi-Robot Task and Motion Planning

abstract: We present a multi-robot task and motion planning method that, when applied to the rearrangement of objects by manipulators, results in solution times up to three orders of magnitude faster than existing methods and successfully plans for problems with up to twenty objects, more than three times as many objects as comparable methods. We achieve this improvement by decomposing the planning space to consider manipulators alone, objects, and manipulators holding objects. We represent this decomposition with a hypergraph where vertices are decomposed elements of the planning spaces and hyperarcs are transitions between elements. Existing methods use graph-based representations where vertices are full composite spaces and edges are transitions between these. Using the hypergraph reduces the representation size of the planning space-for multi-manipulator object rearrangement, the number of hypergraph vertices scales linearly with the number of either robots or objects, while the number of hyperarcs scales quadratically with the number of robots and linearly with the number of objects. In contrast, the number of vertices and edges in graph-based representations scales exponentially in the number of robots and objects. We show that similar gains can be achieved for other multi-robot task and motion planning problems.


title: QuTE: decentralized multiple testing on sensor networks with false discovery rate control

abstract: This paper designs methods for decentralized multiple hypothesis testing on graphs that are equipped with provable guarantees on the false discovery rate (FDR). We consider the setting where distinct agents reside on the nodes of an undirected graph, and each agent possesses p-values corresponding to one or more hypotheses local to its node. Each agent must individually decide whether to reject one or more of its local hypotheses by only communicating with its neighbors, with the joint aim that the global FDR over the entire graph must be controlled at a predefined level. We propose a simple decentralized family of Query-Test-Exchange (QuTE) algorithms and prove that they can control FDR under independence or positive dependence of the p-values. Our algorithm reduces to the Benjamini-Hochberg (BH) algorithm when after graph-diameter rounds of communication, and to the Bonferroni procedure when no communication has occurred or the graph is empty. To avoid communicating real-valued p-values, we develop a quantized BH procedure, and extend it to a quantized QuTE procedure. QuTE works seamlessly in streaming data settings, where anytime-valid p-values may be continually updated at each node. Last, QuTE is robust to arbitrary dropping of packets, or a graph that changes at every step, making it particularly suitable to mobile sensor networks involving drones or other multi-agent systems. We study the power of our procedure using a simulation suite of different levels of connectivity and communication on a variety of graph structures, and also provide an illustrative real-world example.


title: Reconfiguration and oscillations of a vertical, cantilevered-sheet subject to vortex-shedding

abstract: The dynamics of a thin low-density polyethylene sheet subject to periodic forcing due to B\'enard-K\`arm\`an vortices in a long narrow water channel is investigated here. In particular, the time-averaged sheet deflection and its oscillation amplitude are considered. The former is first illustrated to be well-approximated by the static equilibrium between the buoyancy force, the elastic restoring force, and the profile drag based on the depth-averaged water speed. Our observations also indicate that the presence of upstream vortices hinder the overall reconfiguration effect, well-known in an otherwise steady flow. For the sheet tip oscillations, a simple model based on torsional-spring-mounted flat plate correctly captures the measured tip amplitude over a wide range of sheet physical properties and flow conditions. Furthermore, a rich phenomenology of structural dynamics including vortex-forced-vibration, lock-in with the sheet natural frequency, flow-induced vibration due to the sheet wake, multiple-frequency and modal response is reported.


title: Product-type operators between minimal M\"{o}bius invariant spaces and Zygmund type spaces

abstract: In this paper, we consider product-type operators $T^m_{u,v,\varphi}$ from minimal M\"{o}bius invariant spaces into Zygmund type spaces. So some characterizations for boundedness and essential norm of these operators are obtained. As a result some conditions for the compactness will be given.


title: Quantifying Social Biases Using Templates is Unreliable

abstract: Recently, there has been an increase in efforts to understand how large language models (LLMs) propagate and amplify social biases. Several works have utilized templates for fairness evaluation, which allow researchers to quantify social biases in the absence of test sets with protected attribute labels. While template evaluation can be a convenient and helpful diagnostic tool to understand model deficiencies, it often uses a simplistic and limited set of templates. In this paper, we study whether bias measurements are sensitive to the choice of templates used for benchmarking. Specifically, we investigate the instability of bias measurements by manually modifying templates proposed in previous works in a semantically-preserving manner and measuring bias across these modifications. We find that bias values and resulting conclusions vary considerably across template modifications on four tasks, ranging from an 81% reduction (NLI) to a 162% increase (MLM) in (task-specific) bias measurements. Our results indicate that quantifying fairness in LLMs, as done in current practice, can be brittle and needs to be approached with more care and caution.


title: A Method for Computing Inverse Parametric PDE Problems with Random-Weight Neural Networks

abstract: We present a method for computing the inverse parameters and the solution field to inverse parametric PDEs based on randomized neural networks. This extends the local extreme learning machine technique originally developed for forward PDEs to inverse problems. We develop three algorithms for training the neural network to solve the inverse PDE problem. The first algorithm (NLLSQ) determines the inverse parameters and the trainable network parameters all together by the nonlinear least squares method with perturbations (NLLSQ-perturb). The second algorithm (VarPro-F1) eliminates the inverse parameters from the overall problem by variable projection to attain a reduced problem about the trainable network parameters only. It solves the reduced problem first by the NLLSQ-perturb algorithm for the trainable network parameters, and then computes the inverse parameters by the linear least squares method. The third algorithm (VarPro-F2) eliminates the trainable network parameters from the overall problem by variable projection to attain a reduced problem about the inverse parameters only. It solves the reduced problem for the inverse parameters first, and then computes the trainable network parameters afterwards. VarPro-F1 and VarPro-F2 are reciprocal to each other in a sense. The presented method produces accurate results for inverse PDE problems, as shown by the numerical examples herein. For noise-free data, the errors for the inverse parameters and the solution field decrease exponentially as the number of collocation points or the number of trainable network parameters increases, and can reach a level close to the machine accuracy. For noisy data, the accuracy degrades compared with the case of noise-free data, but the method remains quite accurate. The presented method has been compared with the physics-informed neural network method.

categories: math.NA cs.LG cs.NA physics.comp-ph physics.flu-dyn


title: Seller-buyer networks in NFT art are driven by preferential ties

abstract: Non-Fungible Tokens (NFTs) have recently surged to mainstream attention by allowing the exchange of digital assets via blockchains. NFTs have also been adopted by artists to sell digital art. One of the promises of NFTs is broadening participation to the arts market, a traditionally closed and opaque system, to sustain a wider and more diverse set of artists and collectors. A key sign of this effect would be the disappearance or at least reduction in importance of seller-buyer preferential ties, whereby the success of an artist is strongly dependent on the patronage of a single collector. We investigate NFT art seller-buyer networks considering several galleries and a large set of nearly 40,000 sales for over 230M USD in total volume. We find that NFT art is a highly concentrated market driven by few successful sellers and even fewer systematic buyers. High concentration is present in both the number of sales and, even more strongly, in their priced volume. Furthermore, we show that, while a broader-participation market was present in the early phase of NFT art adoption, preferential ties have dominated during market growth, peak and recent decline. We consistently find that the top buyer accounts on average for over 80% of buys for a given seller. Similar trends apply to buyers and their top seller. We conclude that NFT art constitutes, at the present, a highly concentrated market driven by preferential seller-buyer ties.


title: Stability of the positive mass theorem and torus rigidity theorems under integral curvature bounds

abstract: Work of D. Stern and Bray-Kazaras-Khuri-Stern provide differential-geometric identities which relate the scalar curvature of Riemannian 3-manifolds to global invariants in terms of harmonic functions. These quantitative formulas are useful for stability results and show promise for more applications of this type. In this paper, we analyze harmonic maps to flat model spaces in order to address conjectures concerning the geometric stability of the positive mass theorem and the Geroch conjecture. By imposing integral Ricci curvature and isoperimetric bounds, we leverage the previously mentioned formulas to establish strong control on these harmonic maps. When the mass of an asymptotically flat manifold is sufficiently small or when a Riemannian torus has almost non-negative scalar curvature, we upgrade the maps to diffeomorphisms and give quantitative H\"older closeness to the model spaces.


title: ConTra: (Con)text (Tra)nsformer for Cross-Modal Video Retrieval

abstract: In this paper, we re-examine the task of cross-modal clip-sentence retrieval, where the clip is part of a longer untrimmed video. When the clip is short or visually ambiguous, knowledge of its local temporal context (i.e. surrounding video segments) can be used to improve the retrieval performance. We propose Context Transformer (ConTra); an encoder architecture that models the interaction between a video clip and its local temporal context in order to enhance its embedded representations. Importantly, we supervise the context transformer using contrastive losses in the cross-modal embedding space. We explore context transformers for video and text modalities. Results consistently demonstrate improved performance on three datasets: YouCook2, EPIC-KITCHENS and a clip-sentence version of ActivityNet Captions. Exhaustive ablation studies and context analysis show the efficacy of the proposed method.


title: Dynamics of a linearly-perturbed May-Leonard competition model

abstract: The May--Leonard model was introduced to examine the behavior of three competing populations where rich dynamics, such as limit cycles and nonperiodic cyclic solutions, arise. In this work, we perturb the system by adding the capability of global mutations, allowing one species to evolve to the other two in a linear manner. We find that for small mutation rates the perturbed system not only retains some of the dynamics seen in the classical model, such as the three-species equal-population equilibrium bifurcating to a limit cycle, but also exhibits new behavior. For instance, we capture curves of fold bifurcations where pairs of equilibria emerge and then coalesce. As a result, we uncover parameter regimes with new types of stable fixed points that are distinct from the single- and dual-population equilibria characteristic of the original model. On the contrary, the linearly-perturbed system fails to maintain heteroclinic connections that exist in the original system. In short, a linear perturbation proves to be significant enough to substantially influence the dynamics, even with small mutation rates.


title: Loss of Percolation Transition in the Presence of Simple Tracer-Media Interactions

abstract: Random motion in disordered media is sensitive to the presence of obstacles that prevent atoms, molecules, and other particles from moving freely in space. When obstacles are static, a sharp transition between confined motion and free diffusion occurs at a critical obstacle density: the percolation threshold. To test if this conventional wisdom continues to hold in the presence of simple tracer-media interactions, we introduce the Sokoban random walk. Akin to the protagonist of an eponymous video game, the Sokoban has some ability to push away obstacles that block its path. While one expects this will allow the Sokoban to venture further away, we surprisingly find that this is not always the case. Indeed, as it moves $\unicode{x2013}$ pushing obstacles around $\unicode{x2013}$ the Sokoban always confines itself to a finite region whose mean size is uniquely determined by the initial obstacle density. Consequently, the percolation transition is lost. This finding breaks from the ruling "ant in a labyrinth" paradigm, vividly illustrating that even weak and localized tracer-media interactions cannot be neglected when coming to understand transport phenomena.


title: Testing source confusion and identification capability in Cherenkov Telescope Array data

abstract: The Cherenkov Telescope Array will provide the deepest survey of the Galactic Plane performed at very-high-energy gamma-rays. Consequently, this survey will unavoidably face the challenge of source confusion, i.e., the non-unique attribution of signal to a source due to multiple overlapping sources. Among the known populations of Galactic gamma-ray sources and given their extension and number, pulsar wind nebulae (PWNe, and PWN TeV halos) will be the most affected. We aim to probe source confusion of TeV PWNe in forthcoming CTA data. For this purpose, we performed and analyzed simulations of artificially confused PWNe with CTA. As a basis for our simulations, we applied our study to TeV data collected from the H.E.S.S. Galactic Plane Survey for ten extended and two point-like firmly identified PWNe, probing various configurations of source confusion involving different projected separations, relative orientations, flux levels, and extensions among sources. Source confusion, defined here to appear when the sum of the Gaussian width of two sources is larger than the separation between their centroids, occurred in $\sim$30% of the simulations. For this sample and 0.5$\deg$ of average separation between sources, we found that CTA can likely resolve up to 60% of those confused sources above 500 GeV. Finally, we also considered simulations of isolated extended sources to see how well they could be matched to a library of morphological templates. The outcome of the simulations indicates a remarkable capability (more than 95% of the cases studied) to match a simulation with the correct input template in its proper orientation.


title: LieGG: Studying Learned Lie Group Generators

abstract: Symmetries built into a neural network have appeared to be very beneficial for a wide range of tasks as it saves the data to learn them. We depart from the position that when symmetries are not built into a model a priori, it is advantageous for robust networks to learn symmetries directly from the data to fit a task function. In this paper, we present a method to extract symmetries learned by a neural network and to evaluate the degree to which a network is invariant to them. With our method, we are able to explicitly retrieve learned invariances in a form of the generators of corresponding Lie-groups without prior knowledge of symmetries in the data. We use the proposed method to study how symmetrical properties depend on a neural network's parameterization and configuration. We found that the ability of a network to learn symmetries generalizes over a range of architectures. However, the quality of learned symmetries depends on the depth and the number of parameters.


title: Fluctuations and localization length for random band GOE matrix

abstract: We prove that GOE random band matrix localization length is $\le C\left(\log W\right)^3 W^2$, where $W$ is the width of the band and $C$ is an absolute constant. Our method consists of Green function edge-to-edge vector action approach to the Schenker method. That allows to split and decouple the action, so that it becomes transparent that \emph{the magnitudes of two consecutive Schur complements vector actions can not be both larger than an absolute constant}. That is the central technological ingedient of the method. It comes from rather involved estimates $($ the main estimates of the metod $)$, in combination with an equation relating two magnitudes in question. We call the latter \emph{recurrence equation}. The method results in the \emph{lower bound of the variance of the $\log$--norm of the vector action at $\gtrsim NW^{-1}$}, where $N$ is the total number of GOE blocks, condition $N\lesssim W^D$ with an absolute constant $D\gg 1$ applies.


title: Generalised Rado and Roth criteria

abstract: We study the Ramsey properties of equations $a_1P(x_1) + \cdots + a_sP(x_s) = b$, where $a_1,\ldots,a_s,b$ are integers, and $P$ is an integer polynomial of degree $d$. Provided there are at least $(1+o(1))d^2$ variables, we show that Rado's criterion and an intersectivity condition completely characterise which equations of this form admit monochromatic solutions with respect to an arbitrary finite colouring of the positive integers. Furthermore, we obtain a Roth-type theorem for these equations, showing that they admit non-constant solutions over any set of integers with positive upper density if and only if $b= a_1 + \cdots + a_s = 0$. In addition, we establish sharp asymptotic lower bounds for the number of monochromatic/dense solutions (supersaturation).


title: Fenton type minimax problems for sum of translates functions

abstract: Following P. Fenton, we investigate sum of translates functions $F(\mathbf{x},t):=J(t)+\sum_{j=1}^n \nu_j K(t-x_j)$, where $J:[0,1]\to {\underline{\mathbb{R}}}:=\mathbb{R}\cup\{-\infty\}$ is a "sufficiently non-degenerate" and upper-bounded "field function", and $K:[-1,1]\to {\underline{\mathbb{R}}}$ is a fixed "kernel function", concave both on $(-1,0)$ and $(0,1)$, $\mathbf{x}:=(x_1,\ldots,x_n)$ with $0\le x_1\le\dots\le x_n\le 1$, and $\nu_1,\dots,\nu_n>0$ are fixed. We analyze the behavior of the local maxima vector $\mathbf{m}:=(m_0,m_1,\ldots,m_n)$, where $m_j:=m_j(\mathbf{x}):=\sup_{x_j\le t\le x_{j+1}} F(\mathbf{x},t)$, with $x_0:=0$, $x_{n+1}:=1$; and study the optimization (minimax and maximin) problems $\inf_{\mathbf{x}}\max_j m_j(\mathbf{x})$ and $\sup_{\mathbf{x}}\min_j m_j(\mathbf{x})$. The main result is the equality of these quantities, and provided $J$ is upper semicontinuous, the existence of extremal configurations and their description as equioscillation points $\mathbf{w}$. In our previous papers we obtained results for the case of singular kernels, i.e., when $K(0)=-\infty$ and the field $J$ was assumed to be upper semicontinuous. In this work we get rid of these assumptions and prove common generalizations of Fenton's and our previous results, arriving at the greatest generality in the setting of concave kernel functions.


title: Nonlinear Sufficient Dimension Reduction with a Stochastic Neural Network

abstract: Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient dimension reduction methods often lack the scalability necessary for dealing with large-scale data. We propose a new type of stochastic neural network under a rigorous probabilistic framework and show that it can be used for sufficient dimension reduction for large-scale data. The proposed stochastic neural network is trained using an adaptive stochastic gradient Markov chain Monte Carlo algorithm, whose convergence is rigorously studied in the paper as well. Through extensive experiments on real-world classification and regression problems, we show that the proposed method compares favorably with the existing state-of-the-art sufficient dimension reduction methods and is computationally more efficient for large-scale data.


title: The evolution of CNO elements in galaxies

abstract: After hydrogen and helium, oxygen, carbon, and nitrogen - hereinafter, the CNO elements - are the most abundant species in the universe. They are observed in all kinds of astrophysical environments, from the smallest to the largest scales, and are at the basis of all known forms of life, hence, the constituents of any biomarker. As such, their study proves crucial in several areas of contemporary astrophysics, extending to astrobiology. In this review, I will summarize current knowledge about CNO element evolution in galaxies, starting from our home, the Milky Way. After a brief recap of CNO synthesis in stars, I will present the comparison between chemical evolution model predictions and observations of CNO isotopic abundances and abundance ratios in stars and in gaseous matter. Such a comparison permits to constrain the modes and time scales of the assembly of galaxies and their stellar populations, as well as stellar evolution and nucleosynthesis theories. I will stress that chemical evolution models must be carefully calibrated against the wealth of abundance data available for the Milky Way before they can be applied to the interpretation of observational datasets for other systems. In this vein, I will also discuss the usefulness of some key CNO isotopic ratios as probes of the prevailing, galaxy-wide stellar initial mass function in galaxies where more direct estimates from starlight are unfeasible.


title: California Test System (CATS): A Geographically Accurate Test System based on the California Grid

abstract: This paper presents the California Test System (CATS), a synthetic transmission grid in California that can be used by the public for power systems policy research without revealing any critical energy information. The proposed synthetic grid combines publicly available geographic data of California's electric infrastructure, such as the actual locations of transmission corridors, with invented topology and transmission line parameters that are ``realistic but not real". The result is a power grid test system that is suitable for power flow and policy analyses with geo-referenced applications, including studies related to weather, topography, and socio-economic considerations. The methods used to develop and evaluate the CATS grid are documented in detail in this report.


title: On Fila-King Conjecture in Dimension Four

abstract: We consider the following Cauchy problem for the four-dimensional energy critical heat equation \begin{equation*} \begin{cases} u_t=\Delta u+u^{3} ~&\mbox{ in }~ {\mathbb R}^4 \times (0,\infty),\\ u(x,0)=u_0(x) ~&\mbox{ in }~ {\mathbb R}^4. \end{cases} \end{equation*} We construct a positive infinite time blow-up solution $u(x,t)$ with the blow-up rate $ \| u(\cdot,t)\|_{L^\infty({\mathbb R}^4)} \sim \ln t$ as $t\to \infty$ and show the stability of the infinite time blow-up. This gives a rigorous proof of a conjecture by Fila and King \cite[Conjecture 1.1]{filaking12}.


title: $\psi$(2S) production and nuclear modification factor in nucleus--nucleus collisions with ALICE

abstract: Charmonium production is a probe sensitive to deconfinement in nucleus--nucleus collisions. The production of J/$\psi$ via regeneration within the QGP or at the phase boundary has been identified as an important ingredient for the description of the observed centrality and $p_{\rm T}$ dependence at the LHC. $\psi$(2S) production relative to J/$\psi$ is one possible discriminator between the two different regeneration scenarios. At RHIC and at the LHC, there is so far no significant observation of the $\psi$(2S) in nucleus--nucleus collisions in central events at low transverse momentum, where regeneration is the dominating process. The combined Run 2 data set of ALICE allows to extract a significant $\psi$(2S) signal in such a kinematic region at forward rapidity in the dimuon decay channel. In this contribution, we present for the first time results on the $\psi$(2S)-to-J/$\psi$ double ratio and the $\psi$(2S) nuclear modification factor in Pb--Pb collisions at $\sqrt{s_{\rm NN}} = 5.02$ TeV, calculated with respect to a new pp reference with improved precision. Results are compared with model calculations.


title: Full $f$ and $\delta f$ gyrokinetic particle simulations of Alfv\'en waves and energetic particle physics

abstract: In this work, we focus on the development of the particle-in-cell scheme and the application to the studies of Alfv\'en waves and energetic particle physics in tokamak plasmas. The $\delta f$ and full $f$ schemes are formulated on the same footing adopting mixed variables and the pullback scheme for electromagnetic problems. The TRIMEG-GKX code [Lu et al. J. Comput. Phys. 440 (2021) 110384] has been upgraded using cubic spline finite elements and full $f$ and $\delta f$ schemes. The EP-driven TAE has been simulated for the ITPA-TAE case featured by a small electron skin depth $\sim 1.18\times10^{-3}\;{\rm m}$, which is a challenging parameter regime of electromagnetic simulations, especially for the full $f$ model. The simulation results using the $\delta f$ scheme are in good agreement with previous work. Excellent performance of the mixed variable/pullback scheme has been observed for both full $f$ and $\delta f$ schemes. Simulations with mixed full $f$ EPs and $\delta f$ electrons and thermal ions demonstrate the good features of this novel scheme in mitigating the noise level. The full $f$ scheme is a natural choice for EP physics studies which allows a large variation of EP profiles and distributions in velocity space, providing a powerful tool for kinetic studies using realistic experimental distributions related to intermittent and transient plasma activities.


title: A general compactness theorem in $G(S)BD$

abstract: We give a new, simpler proof of a compactness result in $GSBD^p$, $p>1$, by the same authors, which is also valid in $GBD$ (the case $p=1$), and shows that bounded sequences converge a.e., after removal of a suitable sequence of piecewise infinitesimal rigid motions, subject to a fixed partition.


title: Recent ALICE results on quarkonium production in nuclear collisions

abstract: Quarkonium production has long been regarded as a potential signature of deconfinement in nucleus-nucleus collisions. Recently, the production of J/$\psi$ via regeneration within the quark-gluon plasma (QGP) or at the phase boundary has been identified as an important ingredient for the interpretation of quarkonium production results from lead-lead collisions at the Large Hadron Collider (LHC). Quarkonium polarization could also be used to investigate the properties of the hot and dense medium created at the LHC energies. In this contribution, the latest ALICE results on quarkonium will be presented and discussed. These include, among others, the nuclear modifications of (prompt and non-prompt) J/$\psi$ and $\psi$(2S) production, and the J/$\psi$ polarisation, all measured with lead-lead collisions at the LHC. The results will be compared with available theoretical model calculations.


title: Lower semi-continuity of Lagrangian volume

abstract: We study lower semi-continuity properties of the volume, i.e., the surface area, of a closed Lagrangian manifold with respect to the Hofer- and $\gamma$-distance on a class of monotone Lagrangian submanifolds Hamiltonian isotopic to each other. We prove that volume is $\gamma$-lower semi-continuous in two cases. In the first one the volume form comes from a K\"ahler metric with a large group of Hamiltonian isometries, but there are no additional constraints on the Lagrangian submanifold. The second one is when the volume is taken with respect to any compatible metric, but the Lagrangian submanifold must be a torus. As a consequence, in both cases, the volume is Hofer lower semi-continuous.


title: Besov Space, Schatten Classes And Commutators Of Riesz Transforms Associated With The Neumann Laplacian

abstract: This article provides a deeper study of the Riesz transform commutators associated with the Neumann Laplacian operator $\Delta_N$ on $\mathbb R^n$. Along the line of singular value estimates for Riesz transform commutators established by Janson--Wolff and Rochberg--Semmes, we establish a full range of Schatten-$p$ class characterization for these commutators.


title: Fine-Grained Detection of Solidarity for Women and Migrants in 155 Years of German Parliamentary Debates

abstract: Solidarity is a crucial concept to understand social relations in societies. In this paper, we explore fine-grained solidarity frames to study solidarity towards women and migrants in German parliamentary debates between 1867 and 2022. Using 2,864 manually annotated text snippets (with a cost exceeding 18k Euro), we evaluate large language models (LLMs) like Llama 3, GPT-3.5, and GPT-4. We find that GPT-4 outperforms other LLMs, approaching human annotation quality. Using GPT-4, we automatically annotate more than 18k further instances (with a cost of around 500 Euro) across 155 years and find that solidarity with migrants outweighs anti-solidarity but that frequencies and solidarity types shift over time. Most importantly, group-based notions of (anti-)solidarity fade in favor of compassionate solidarity, focusing on the vulnerability of migrant groups, and exchange-based anti-solidarity, focusing on the lack of (economic) contribution. Our study highlights the interplay of historical events, socio-economic needs, and political ideologies in shaping migration discourse and social cohesion. We also show that powerful LLMs, if carefully prompted, can be cost-effective alternatives to human annotation for hard social scientific tasks.


title: A unified analysis of regression adjustment in randomized experiments

abstract: Regression adjustment is broadly applied in randomized trials under the premise that it usually improves the precision of a treatment effect estimator. However, previous work has shown that this is not always true. To further understand this phenomenon, we develop a unified comparison of the asymptotic variance of a class of linear regression-adjusted estimators. Our analysis is based on the classical theory for linear regression with heteroscedastic errors and thus does not assume that the postulated linear model is correct. For a completely randomized binary treatment, we provide sufficient conditions under which some regression-adjusted estimators are guaranteed to be more asymptotically efficient than others. We explore other settings such as general treatment assignment mechanisms and generalized linear models, and find that the variance dominance phenomenon no longer occurs.


title: Iterative Convex Optimization for Model Predictive Control with Discrete-Time High-Order Control Barrier Functions

abstract: Safety is one of the fundamental challenges in control theory. Recently, multi-step optimal control problems for discrete-time dynamical systems were formulated to enforce stability, while subject to input constraints as well as safety-critical requirements using discrete-time control barrier functions within a model predictive control (MPC) framework. Existing work usually focus on the feasibility or the safety for the optimization problem, and the majority of the existing work restrict the discussions to relative-degree one control barrier functions. Additionally, the real-time computation is challenging when a large horizon is considered in the MPC problem for relative-degree one or high-order control barrier functions. In this paper, we propose a framework that solves the safety-critical MPC problem in an iterative optimization, which is applicable for any relative-degree control barrier functions. In the proposed formulation, the nonlinear system dynamics as well as the safety constraints modeled as discrete-time high-order control barrier functions (DHOCBF) are linearized at each time step. Our formulation is generally valid for any control barrier function with an arbitrary relative-degree. The advantages of fast computational performance with safety guarantee are analyzed and validated with numerical results.


title: Universality class of the mode-locked glassy random laser

abstract: By means of enhanced Monte Carlo numerical simulations parallelized on GPU's we study the critical properties of the spin-glass-like model for the mode-locked glassy random laser, a $4$-spin model with complex spins with a global spherical constraint and quenched random interactions. Using two different boundary conditions for the mode frequencies we identify the critical points and the critical indices of the random lasing phase transition using , with finite size scaling techniques. The outcome of the scaling analysis is that the mode-locked random laser is in a mean-field universality class, though different from the mean-field class of the Random Energy Model and the glassy random laser in the narrow band approximation, that is, the fully connected version of the present model. The low temperature (high pumping) phase is finally characterized by means of the overlap distribution and evidence for the onset of replica symmetry breaking in the lasing regime is provided.


title: The Monge-Ampere system: convex integration in arbitrary dimension and codimension

abstract: In this paper, we study flexibility of the weak solutions to the Monge-Amp\`ere system (MA) via convex integration. This system of Pdes is an extension of the Monge-Amp\`ere equation in $d=2$ dimensions, naturally arising from the prescribed curvature problem, and closely related to the classical problem of isometric immersions (II). Our main result achieves density, in the set of subsolutions, of the H\"older regular $\mathcal{C}^{1,\alpha}$ solutions to the weak formulation (VK) of (MA), for all $\alpha<\frac{1}{1+d(d+1)/k}$ where $d$ is an arbitrary dimension and $k$ is an arbitrary codimension of the problem. This result seems to be optimal, from the technical viewpoint, for the corrugation-based convex integration scheme. In particular, it covers the codimension interval $k\in \big(1, d(d+1)\big)$, so far uncharted even for the system (II), since the regularity $\mathcal{C}^{1,\alpha}$ with any $\alpha <1$ proved by K\"allen, strictly requires a large codimension $k\geq d(d+1)$. We also reproduce K\"allen's result in the context of (MA). At $k=1$, our result agrees with the regularity $\mathcal{C}^{1,\alpha}$ for (II) with any $\alpha <\frac{1}{1+d(d+1)}$, proved by Conti, Delellis and Szekelyhidi. Finally, our results extend the initial findings by the author and Pakzad for (MA) and $d=2, k=1$. As an application of our results for (VK), we derive an energy scaling bound in the quantitative immersability of Riemannian metrics, for nonlinear energy functionals modelled on the energies of deformations of thin prestrained films in the nonlinear elasticity.


title: A Sobolev Space Property of Logarithm of Lipschitz functions

abstract: For a Lipschitz function $f$ on an open set in $\mathbb{R}^n$, we consider the $L^{n}$ integrability of the quotient $\frac{|\nabla f|}{|f|}$ over its natural domain of definition.


title: ELIGN: Expectation Alignment as a Multi-Agent Intrinsic Reward

abstract: Modern multi-agent reinforcement learning frameworks rely on centralized training and reward shaping to perform well. However, centralized training and dense rewards are not readily available in the real world. Current multi-agent algorithms struggle to learn in the alternative setup of decentralized training or sparse rewards. To address these issues, we propose a self-supervised intrinsic reward ELIGN - expectation alignment - inspired by the self-organization principle in Zoology. Similar to how animals collaborate in a decentralized manner with those in their vicinity, agents trained with expectation alignment learn behaviors that match their neighbors' expectations. This allows the agents to learn collaborative behaviors without any external reward or centralized training. We demonstrate the efficacy of our approach across 6 tasks in the multi-agent particle and the complex Google Research football environments, comparing ELIGN to sparse and curiosity-based intrinsic rewards. When the number of agents increases, ELIGN scales well in all multi-agent tasks except for one where agents have different capabilities. We show that agent coordination improves through expectation alignment because agents learn to divide tasks amongst themselves, break coordination symmetries, and confuse adversaries. These results identify tasks where expectation alignment is a more useful strategy than curiosity-driven exploration for multi-agent coordination, enabling agents to do zero-shot coordination.


title: KP-RNN: A Deep Learning Pipeline for Human Motion Prediction and Synthesis of Performance Art

abstract: Digitally synthesizing human motion is an inherently complex process, which can create obstacles in application areas such as virtual reality. We offer a new approach for predicting human motion, KP-RNN, a neural network which can integrate easily with existing image processing and generation pipelines. We utilize a new human motion dataset of performance art, Take The Lead, as well as the motion generation pipeline, the Everybody Dance Now system, to demonstrate the effectiveness of KP-RNN's motion predictions. We have found that our neural network can predict human dance movements effectively, which serves as a baseline result for future works using the Take The Lead dataset. Since KP-RNN can work alongside a system such as Everybody Dance Now, we argue that our approach could inspire new methods for rendering human avatar animation. This work also serves to benefit the visualization of performance art in digital platforms by utilizing accessible neural networks.


title: Unsupervised RGB-to-Thermal Domain Adaptation via Multi-Domain Attention Network

abstract: This work presents a new method for unsupervised thermal image classification and semantic segmentation by transferring knowledge from the RGB domain using a multi-domain attention network. Our method does not require any thermal annotations or co-registered RGB-thermal pairs, enabling robots to perform visual tasks at night and in adverse weather conditions without incurring additional costs of data labeling and registration. Current unsupervised domain adaptation methods look to align global images or features across domains. However, when the domain shift is significantly larger for cross-modal data, not all features can be transferred. We solve this problem by using a shared backbone network that promotes generalization, and domain-specific attention that reduces negative transfer by attending to domain-invariant and easily-transferable features. Our approach outperforms the state-of-the-art RGB-to-thermal adaptation method in classification benchmarks, and is successfully applied to thermal river scene segmentation using only synthetic RGB images. Our code is made publicly available at https://github.com/ganlumomo/thermal-uda-attention.


title: Background independence and field redefinitions in quantum gravity

abstract: It is generally believed that a full-fledged theory of quantum gravity should exhibit background independence and diffeomorphism invariance. In its most general form, the latter comprises field redefinitions, which are diffeomorphisms in configuration space. We show that any path-integral approach to quantum gravity leads to a tension between these properties, such that they cannot hold simultaneously.


title: A Differentiable Distance Approximation for Fairer Image Classification

abstract: Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the cost of extra computation, unstable adversarial optimisation or have losses on the feature space structure that are disconnected from fairness measures and only loosely generalise to fairness. In this work we propose a differentiable approximation of the variance of demographics, a metric that can be used to measure the bias, or unfairness, in an AI model. Our approximation can be optimised alongside the regular training objective which eliminates the need for any extra models during training and directly improves the fairness of the regularised models. We demonstrate that our approach improves the fairness of AI models in varied task and dataset scenarios, whilst still maintaining a high level of classification accuracy. Code is available at https://bitbucket.org/nelliottrosa/base_fairness.


title: Propagation Stability Concepts for Network Synchronization Processes

abstract: A notion of disturbance propagation stability is defined for dynamical network processes, in terms of decrescence of an input-output energy metric along cutsets away from the disturbance source. A characterization of the disturbance propagation notion is developed for a canonical model for synchronization of linearly-coupled homogeneous subsystems. Specifically, propagation stability is equivalenced with the frequency response of a certain local closed-loop model, which is defined from the subsystem model and local network connections, being sub-unity gain. For the case where the subsystem is single-input single-output (SISO), a further simplification in terms of the subsystem's open loop Nyquist plot is obtained. An extension of the disturbance propagation stability concept toward imperviousness of subnetworks to disturbances is briefly developed, and an example focused on networks with planar subsystems is considered.


title: A Detailed Study of Interpretability of Deep Neural Network based Top Taggers

abstract: Recent developments in the methods of explainable AI (XAI) allow researchers to explore the inner workings of deep neural networks (DNNs), revealing crucial information about input-output relationships and realizing how data connects with machine learning models. In this paper we explore interpretability of DNN models designed to identify jets coming from top quark decay in high energy proton-proton collisions at the Large Hadron Collider (LHC). We review a subset of existing top tagger models and explore different quantitative methods to identify which features play the most important roles in identifying the top jets. We also investigate how and why feature importance varies across different XAI metrics, how correlations among features impact their explainability, and how latent space representations encode information as well as correlate with physically meaningful quantities. Our studies uncover some major pitfalls of existing XAI methods and illustrate how they can be overcome to obtain consistent and meaningful interpretation of these models. We additionally illustrate the activity of hidden layers as Neural Activation Pattern (NAP) diagrams and demonstrate how they can be used to understand how DNNs relay information across the layers and how this understanding can help to make such models significantly simpler by allowing effective model reoptimization and hyperparameter tuning. These studies not only facilitate a methodological approach to interpreting models but also unveil new insights about what these models learn. Incorporating these observations into augmented model design, we propose the Particle Flow Interaction Network (PFIN) model and demonstrate how interpretability-inspired model augmentation can improve top tagging performance.


title: Physical Implications of the Extrapolation and Statistical Bootstrap of the Nucleon Structure Function Ratio $\frac{F_2^n}{F_2^p}$ for Mirror Nuclei $^3$He and $^3$H

abstract: A nuclear physics example of statistical bootstrap is used on the MARATHON data nucleon structure function ratio, $\frac{F_2^n}{F_2^p}$, in the quark momentum fraction $x_B\rightarrow0$ and $x_B\rightarrow1$ regions. The extrapolated $F_2$ ratio value as quark momentum fraction $x_B\rightarrow 1$ approaches 0.4 and this value is compared to theoretical predictions. The extrapolated ratio when $x_B\rightarrow 0$ favors the simple model of isospin symmetry with the complete dominance of seaquarks at low momentum fraction. At high-$x_B$, the proton quark distribution function ratio $d/u$ is derived from the $x\rightarrow 1$ ratio $\frac{F_2^n}{F_2^p}\rightarrow 0.4$ and found to be $d/u \rightarrow 1/6$. Our extrapolated values for both the $\frac{F_2^n}{F_2^p}$ ratio and the $d/u$ parton distribution function ratio most closely match perturbative QCD values from quark counting and helicity conservation arguments but still differ by roughly $7\%$. The mismatch to theoretical predictions may be ameliorated if two compatible models act simultaneously in the nucleon wavefunction. One such example is nucleon wavefunctions composed of a linear combination of a quark-diquark state and a 3-valence quark correlated state with coefficients that combine to give the extrapolated $F_2$ ratio of $0.4$.


title: Contrastive Representation Learning for Conversational Question Answering over Knowledge Graphs

abstract: This paper addresses the task of conversational question answering (ConvQA) over knowledge graphs (KGs). The majority of existing ConvQA methods rely on full supervision signals with a strict assumption of the availability of gold logical forms of queries to extract answers from the KG. However, creating such a gold logical form is not viable for each potential question in a real-world scenario. Hence, in the case of missing gold logical forms, the existing information retrieval-based approaches use weak supervision via heuristics or reinforcement learning, formulating ConvQA as a KG path ranking problem. Despite missing gold logical forms, an abundance of conversational contexts, such as entire dialog history with fluent responses and domain information, can be incorporated to effectively reach the correct KG path. This work proposes a contrastive representation learning-based approach to rank KG paths effectively. Our approach solves two key challenges. Firstly, it allows weak supervision-based learning that omits the necessity of gold annotations. Second, it incorporates the conversational context (entire dialog history and domain information) to jointly learn its homogeneous representation with KG paths to improve contrastive representations for effective path ranking. We evaluate our approach on standard datasets for ConvQA, on which it significantly outperforms existing baselines on all domains and overall. Specifically, in some cases, the Mean Reciprocal Rank (MRR) and Hit@5 ranking metrics improve by absolute 10 and 18 points, respectively, compared to the state-of-the-art performance.