title: Rethinking Hierarchies in Pre-trained Plain Vision Transformer

abstract: Self-supervised pre-training vision transformer (ViT) via masked image modeling (MIM) has been proven very effective. However, customized algorithms should be carefully designed for the hierarchical ViTs, e.g., GreenMIM, instead of using the vanilla and simple MAE for the plain ViT. More importantly, since these hierarchical ViTs cannot reuse the off-the-shelf pre-trained weights of the plain ViTs, the requirement of pre-training them leads to a massive amount of computational cost, thereby incurring both algorithmic and computational complexity. In this paper, we address this problem by proposing a novel idea of disentangling the hierarchical architecture design from the self-supervised pre-training. We transform the plain ViT into a hierarchical one with minimal changes. Technically, we change the stride of linear embedding layer from 16 to 4 and add convolution (or simple average) pooling layers between the transformer blocks, thereby reducing the feature size from 1/4 to 1/32 sequentially. Despite its simplicity, it outperforms the plain ViT baseline in classification, detection, and segmentation tasks on ImageNet, MS COCO, Cityscapes, and ADE20K benchmarks, respectively. We hope this preliminary study could draw more attention from the community on developing effective (hierarchical) ViTs while avoiding the pre-training cost by leveraging the off-the-shelf checkpoints. The code and models will be released at https://github.com/ViTAE-Transformer/HPViT.


title: Crosslingual Generalization through Multitask Finetuning

abstract: Multitask prompted finetuning (MTF) has been shown to help large language models generalize to new tasks in a zero-shot setting, but so far explorations of MTF have focused on English data and models. We apply MTF to the pretrained multilingual BLOOM and mT5 model families to produce finetuned variants called BLOOMZ and mT0. We find finetuning large multilingual language models on English tasks with English prompts allows for task generalization to non-English languages that appear only in the pretraining corpus. Finetuning on multilingual tasks with English prompts further improves performance on English and non-English tasks leading to various state-of-the-art zero-shot results. We also investigate finetuning on multilingual tasks with prompts that have been machine-translated from English to match the language of each dataset. We find training on these machine-translated prompts leads to better performance on human-written prompts in the respective languages. Surprisingly, we find models are capable of zero-shot generalization to tasks in languages they have never intentionally seen. We conjecture that the models are learning higher-level capabilities that are both task- and language-agnostic. In addition, we introduce xP3, a composite of supervised datasets in 46 languages with English and machine-translated prompts. Our code, datasets and models are freely available at https://github.com/bigscience-workshop/xmtf.


title: Transition dynamics and metastable states during premelting and freezing of ice surfaces

abstract: The premelting of ice is well known, but little is known about how the premelted and solid surfaces convert to each other. In this work, the transition dynamics between two phases are revealed with large-scale molecular dynamics simulations. Supercooling and superheating states exist in the transition, and are overcome by nucleation-like processes. The natural inhomogeneity of ice surfaces enhances nuclei formation, while it only accelerates premelting but not freezing. Furthermore, the complete freezing of ice surfaces may be hindered by the stacking order mismatch between nuclei. This work points out the importance of metastable states in premelting, and the necessity of a large system scale in describing its transition process.


title: Common Information, Noise Stability, and Their Extensions

abstract: Common information (CI) is ubiquitous in information theory and related areas such as theoretical computer science and discrete probability. However, because there are multiple notions of CI, a unified understanding of the deep interconnections between them is lacking. This monograph seeks to fill this gap by leveraging a small set of mathematical techniques that are applicable across seemingly disparate problems. In Part I, we review the operational tasks and properties associated with Wyner's and G\'acs-K\"orner-Witsenhausen's (GKW's) CI. In PartII, we discuss extensions of the former from the perspective of distributed source simulation. This includes the R\'enyi CI which forms a bridge between Wyner's CI and the exact CI. Via a surprising equivalence between the R\'enyi CI of order~$\infty$ and the exact CI, we demonstrate the existence of a joint source in which the exact CI strictly exceeds Wyner's CI. Other closely related topics discussed in Part II include the channel synthesis problem and the connection of Wyner's and exact CI to the nonnegative rank of matrices. In Part III, we examine GKW's CI with a more refined lens via the noise stability or NICD problem in which we quantify the agreement probability of extracted bits from a bivariate source. We then extend this to the $k$-user NICD and $q$-stability problems, and discuss various conjectures in information theory and discrete probability, such as the Courtade-Kumar, Li-M\'edard and Mossell-O'Donnell conjectures. Finally, we consider hypercontractivity and Brascamp-Lieb inequalities, which further generalize noise stability via replacing the Boolean functions therein by nonnnegative functions. The key ideas behind the proofs in Part III can be presented in a pedagogically coherent manner and unified via information-theoretic and Fourier-analytic methods.


title: Probing the hadron mass spectrum in dense two-color QCD with the linear sigma model

abstract: We investigate modifications of hadron masses at finite quark chemical potential in two-flavor and two-color QCD, of which the data are available from lattice simulations, within a linear sigma model based on approximate Pauli-Gursey $SU(4)$ symmetry. The model describes not only ground-state scalar diquarks and pseudo-scalar mesons but also the excited pseudo-scalar diquarks and scalar mesons; each ground-state diquark (meson) has the corresponding excited diquark (hadron) with opposite parity as a chiral partner. Effects of chiral symmetry breaking and diquark condensates are incorporated by a mean-field treatment. We show that various mixings among the hadrons, which are triggered by the breakdown of baryon number conservation in the superfluid phase, lead to a rich hadron mass spectrum. We discuss the influence of $U(1)_A$ anomaly on the density dependence of the mass spectrum and also manifestations of the chiral partner structures as density increases in the superfluid phase. The predicted hadron masses are expected to provide future lattice simulations with useful information on such symmetry properties in dense two-color QCD.


title: The observed polarization direction depending on geometrical and kinematic parameters of relativistic jets

abstract: The study of the polarization direction is crucial in the issue of restoring the spatial structure of the magnetic field in the active galaxy parsec-scale jets. But, due to relativistic effects, the magnetic field projected onto the celestial sphere in the source reference frame cannot be assumed to be orthogonal to the observed direction of the electric vector in the wave. Moreover, the local axis of the jet component may not coincide with its motion direction, which affects the observed polarization direction. In this article, we analyze the transverse to jet distributions of the electric vector in the wave, obtained as a result of modeling with different jet kinematic and geometrical parameters for a helical magnetic field with a different twist angle and for a toroidal magnetic field in the center, surrounded by a varying thickness sheath, penetrated by a poloidal field. We obtained: 1) the shape of the electric vector transverse distribution depends in a complex way on the angles of the jet axis and the velocity vector with the line of sight; 2) ambiguity in determining the twist direction of the helical magnetic field under using only the distributions of the electric vector in the wave; 3) both considered magnetic field topologies can reproduce both the ``spine-sheath'' polarization structure and individual bright details with the longitudinal to the jet axis polarization direction.


title: Experimental fingerprint of the electron's longitudinal momentum at the tunnel exit in strong field ionization

abstract: We present experimental data on the strong field tunnel ionization of argon in a counter-rotating two-color (CRTC) laser field. We find that the initial momentum component along the tunneling direction changes sign comparing the rising and the falling edge of the CRTC field. If the initial momentum at the tunnel exit points in the direction of the ion at the instant of tunneling, this manifests as an enhanced Coulomb interaction of the outgoing electron with its parent ion. Our conclusions are in accordance with predictions based on strong field approximation.


title: The two-loop eight-point amplitude in ABJM theory

abstract: In this paper, we present the two-loop correction to scattering amplitudes in three-dimensional $\mathcal{N}=6$ Chern-Simons matter theory. We use eight-point case as our main example, but the method generalizes to all multiplicities. The integrand is completely fixed by dual conformal symmetry, maximal cuts, constraints from soft-collinear behavior and from vanishing of odd-multiplicity amplitudes. After performing integrations with Higgs regularizations, the integrated results demonstrate that the infrared divergence is again identical to that of ${\cal N}=4$ super Yang-Mills. After subtracting divergences, the finite part is dual conformal invariant, and respects various symmetries; it has uniform transcendentality weight two and exhibits nice analytic structure.


title: Data-driven Abstractions for Verification of Deterministic Systems

abstract: A common technique to verify complex logic specifications for dynamical systems is the construction of symbolic abstractions: simpler, finite-state models whose behaviour mimics the one of the systems of interest. Typically, abstractions are constructed exploiting an accurate knowledge of the underlying model: in real-life applications, this may be a costly assumption. By sampling random $\ell$-step trajectories of an unknown system, we build an abstraction based on the notion of $\ell$-completeness. We newly define the notion of probabilistic behavioural inclusion, and provide probably approximately correct (PAC) guarantees that this abstraction includes all behaviours of the concrete system, for finite and infinite time horizon, leveraging the scenario theory for non convex problems. Our method is then tested on several numerical benchmarks.


title: Kinks Multiply Mesons

abstract: In a (1+1)-dimensional scalar quantum field theory, we calculate the leading-order probability of meson multiplication, which is the inelastic scattering process: kink + meson $\rightarrow$ kink + 2 mesons. We also calculate the differential probability with respect to the final meson momenta and the probability that one or two of the final mesons recoils back towards the source. In the ultrarelativistic limit of the initial meson, the total probability tends to a constant, which we calculate analytically in the $\phi^4$ model. At this order the meson sector conserves energy on its own, while the incoming meson applies a positive pressure to the kink. This is in contrast with the situation in classical field theory, where Romanczukiewicz and collaborators have shown that, in the presence of a reflectionless kink, only meson fusion is allowed, resulting in a negative radiation pressure on the kink.


title: Nonrelativistic Approximations of Closed Bosonic String Theory

abstract: We further develop the string $1/c^2$ expansion of closed bosonic string theory, where $c$ is the speed of light. The expansion will be performed up to and including the next-to-next-to-leading order (NNLO). We show that the next-to-leading order (NLO) theory is equal to the Gomis--Ooguri string, generalised to a curved target space, provided the target space geometry admits a certain class of co-dimension-2 foliations. We compute the energy of the string up to NNLO for a flat target space with a circle that must be wound by the string, and we show that it agrees with the $1/c^2$ expansion of the relativistic energy. We also compute the algebra of Noether charges for a flat target space and show that this matches order-by-order with an appropriate expansion of the Poincar\'e algebra, which at NLO gives the string Bargmann algebra. Finally, we expand the phase space action, which allows us to perform the Dirac procedure and pass to the quantum theory. It turns out that the Poisson brackets change at each order, and we show that the normal ordering constant of the relativistic theory, which does not depend on $c$, can be reproduced by the NLO and NNLO theories.


title: Beyond Instance Discrimination: Relation-aware Contrastive Self-supervised Learning

abstract: Contrastive self-supervised learning (CSL) based on instance discrimination typically attracts positive samples while repelling negatives to learn representations with pre-defined binary self-supervision. However, vanilla CSL is inadequate in modeling sophisticated instance relations, limiting the learned model to retain fine semantic structure. On the one hand, samples with the same semantic category are inevitably pushed away as negatives. On the other hand, differences among samples cannot be captured. In this paper, we present relation-aware contrastive self-supervised learning (ReCo) to integrate instance relations, i.e., global distribution relation and local interpolation relation, into the CSL framework in a plug-and-play fashion. Specifically, we align similarity distributions calculated between the positive anchor views and the negatives at the global level to exploit diverse similarity relations among instances. Local-level interpolation consistency between the pixel space and the feature space is applied to quantitatively model the feature differences of samples with distinct apparent similarities. Through explicitly instance relation modeling, our ReCo avoids irrationally pushing away semantically identical samples and carves a well-structured feature space. Extensive experiments conducted on commonly used benchmarks justify that our ReCo consistently gains remarkable performance improvements.


title: Query-based Instance Discrimination Network for Relational Triple Extraction

abstract: Joint entity and relation extraction has been a core task in the field of information extraction. Recent approaches usually consider the extraction of relational triples from a stereoscopic perspective, either learning a relation-specific tagger or separate classifiers for each relation type. However, they still suffer from error propagation, relation redundancy and lack of high-level connections between triples. To address these issues, we propose a novel query-based approach to construct instance-level representations for relational triples. By metric-based comparison between query embeddings and token embeddings, we can extract all types of triples in one step, thus eliminating the error propagation problem. In addition, we learn the instance-level representation of relational triples via contrastive learning. In this way, relational triples can not only enclose rich class-level semantics but also access to high-order global connections. Experimental results show that our proposed method achieves the state of the art on five widely used benchmarks.


title: Phase Transitions in Learning and Earning under Price Protection Guarantee

abstract: Motivated by the prevalence of ``price protection guarantee", which allows a customer who purchased a product in the past to receive a refund from the seller during the so-called price protection period (typically defined as a certain time window after the purchase date) in case the seller decides to lower the price, we study the impact of such policy on the design of online learning algorithm for data-driven dynamic pricing with initially unknown customer demand. We consider a setting where a firm sells a product over a horizon of $T$ time steps. For this setting, we characterize how the value of $M$, the length of price protection period, can affect the optimal regret of the learning process. We show that the optimal regret is $\tilde{\Theta}(\sqrt{T}+\min\{M,\,T^{2/3}\})$ by first establishing a fundamental impossible regime with novel regret lower bound instances. Then, we propose LEAP, a phased exploration type algorithm for \underline{L}earning and \underline{EA}rning under \underline{P}rice Protection to match this lower bound up to logarithmic factors or even doubly logarithmic factors (when there are only two prices available to the seller). Our results reveal the surprising phase transitions of the optimal regret with respect to $M$. Specifically, when $M$ is not too large, the optimal regret has no major difference when compared to that of the classic setting with no price protection guarantee. We also show that there exists an upper limit on how much the optimal regret can deteriorate when $M$ grows large. Finally, we conduct extensive numerical experiments to show the benefit of LEAP over other heuristic methods for this problem.


title: Statistical Inference for Scale Mixture Models via Mellin Transform Approach

abstract: This paper deals with statistical inference for the scale mixture models. We study an estimation approach based on the Mellin -- Stieltjes transform that can be applied to both discrete and absolute continuous mixing distributions. The accuracy of the corresponding estimate is analysed in terms of its expected pointwise error. As an important technical result, we prove the analogue of the Berry -- Esseen inequality for the Mellin transforms. The proposed statistical approach is illustrated by numerical examples.


title: Plausible constraints on the range of bulk terrestrial exoplanet compositions in the Solar neighbourhood

abstract: Rocky planet compositions regulate planetary evolution by affecting core sizes, mantle properties, and melting behaviours. Yet, quantitative treatments of this aspect of exoplanet studies remain generally under-explored. We attempt to constrain the range of potential bulk terrestrial exoplanet compositions in the solar neighbourhood (<200 pc). We circumscribe probable rocky exoplanet compositions based on a population analysis of stellar chemical abundances from the Hypatia and GALAH catalogues. We apply a devolatilization model to simulate compositions of hypothetical, terrestrial-type exoplanets in the habitable zones around Sun-like stars, considering elements O, S, Na, Si, Mg, Fe, Ni, Ca, and Al. We further apply core-mantle differentiation by assuming constant oxygen fugacity, and model the consequent mantle mineralogy with a Gibbs energy minimisation algorithm. We report statistics on several compositional parameters and propose a reference set of (21) representative planet compositions for using as end-member compositions in imminent modelling and experimental studies. We find a strong correlation between stellar Fe/Mg and metallic core sizes, which can vary from 18 to 35 wt%. Furthermore, stellar Mg/Si gives a first-order indication of mantle mineralogy, with high-Mg/Si stars leading to weaker, ferropericlase-rich mantles, and low-Mg/Si stars leading to mechanically stronger mantles. The element Na, which modulates crustal buoyancy and mantle clinopyroxene fraction, is affected by devolatilization the most. While we find that planetary mantles mostly consist of Fe/Mg-silicates, core sizes and relative abundances of common minerals can nevertheless vary significantly among exoplanets. These differences likely lead to different evolutionary pathways among rocky exoplanets in the solar neighbourhood.


title: DECISIVE Test Methods Handbook: Test Methods for Evaluating sUAS in Subterranean and Constrained Indoor Environments, Version 1.1

abstract: This handbook outlines all test methods developed under the Development and Execution of Comprehensive and Integrated Subterranean Intelligent Vehicle Evaluations (DECISIVE) project by the University of Massachusetts Lowell for evaluating small unmanned aerial systems (sUAS) performance in subterranean and constrained indoor environments, spanning communications, field readiness, interface, obstacle avoidance, navigation, mapping, autonomy, trust, and situation awareness. For sUAS deployment in subterranean and constrained indoor environments, this puts forth two assumptions about applicable sUAS to be evaluated using these test methods: (1) able to operate without access to GPS signal, and (2) width from prop top to prop tip does not exceed 91 cm (36 in) wide (i.e., can physically fit through a typical doorway, although successful navigation through is not guaranteed). All test methods are specified using a common format: Purpose, Summary of Test Method, Apparatus and Artifacts, Equipment, Metrics, Procedure, and Example Data. All test methods are designed to be run in real-world environments (e.g., MOUT sites) or using fabricated apparatuses (e.g., test bays built from wood, or contained inside of one or more shipping containers).


title: From the replica trick to the replica symmetry breaking technique

abstract: Among the various remarkable contributions of Giorgio Parisi to physics, his formulation of the replica symmetry breaking solution for the Sherrington-Kirkpatrick model stands out. In this article, different historical sources are used to reconstruct the scientific and professional contexts of this prodigious advance.


title: Control-enhanced quantum metrology under Markovian noise

abstract: Quantum metrology is supposed to significantly improve the precision of parameter estimation by utilizing suitable quantum resources. However, the predicted precision can be severely distorted by realistic noises. Here, we propose a control-enhanced quantum metrology scheme to defend against these noises for improving the metrology performance. Our scheme can automatically alter the parameter encoding dynamics with adjustable controls, thus leading to optimal resultant states that are less sensitive to the noises under consideration. As a demonstration, we numerically apply it to the problem of frequency estimation under several typical Markovian noise channels. Through comparing our control-enhanced scheme with the standard scheme and the ancilla-assisted scheme, we show that our scheme performs better and can improve the estimation precision up to around one order of magnitude. Furthermore, we conduct a proof-of-principle experiment in nuclear magnetic resonance system to verify the effectiveness of the proposed scheme. The research here is helpful for current quantum platforms to harness the power of quantum metrology in realistic noise environments.


title: Wasserstein Steepest Descent Flows of Discrepancies with Riesz Kernels

abstract: The aim of this paper is twofold. Based on the geometric Wasserstein tangent space, we first introduce Wasserstein steepest descent flows. These are locally absolutely continuous curves in the Wasserstein space whose tangent vectors point into a steepest descent direction of a given functional. This allows the use of Euler forward schemes instead of Jordan--Kinderlehrer--Otto schemes. For $\lambda$-convex functionals, we show that Wasserstein steepest descent flows are an equivalent characterization of Wasserstein gradient flows. The second aim is to study Wasserstein flows of the maximum mean discrepancy with respect to certain Riesz kernels. The crucial part is hereby the treatment of the interaction energy. Although it is not $\lambda$-convex along generalized geodesics, we give analytic expressions for Wasserstein steepest descent flows of the interaction energy starting at Dirac measures. In contrast to smooth kernels, the particle may explode, i.e., a Dirac measure becomes a non-Dirac one. The computation of steepest descent flows amounts to finding equilibrium measures with external fields, which nicely links Wasserstein flows of interaction energies with potential theory. Finally, we provide numerical simulations of Wasserstein steepest descent flows of discrepancies.


title: FedMint: Intelligent Bilateral Client Selection in Federated Learning with Newcomer IoT Devices

abstract: Federated Learning (FL) is a novel distributed privacy-preserving learning paradigm, which enables the collaboration among several participants (e.g., Internet of Things devices) for the training of machine learning models. However, selecting the participants that would contribute to this collaborative training is highly challenging. Adopting a random selection strategy would entail substantial problems due to the heterogeneity in terms of data quality, and computational and communication resources across the participants. Although several approaches have been proposed in the literature to overcome the problem of random selection, most of these approaches follow a unilateral selection strategy. In fact, they base their selection strategy on only the federated server's side, while overlooking the interests of the client devices in the process. To overcome this problem, we present in this paper FedMint, an intelligent client selection approach for federated learning on IoT devices using game theory and bootstrapping mechanism. Our solution involves the design of: (1) preference functions for the client IoT devices and federated servers to allow them to rank each other according to several factors such as accuracy and price, (2) intelligent matching algorithms that take into account the preferences of both parties in their design, and (3) bootstrapping technique that capitalizes on the collaboration of multiple federated servers in order to assign initial accuracy value for the newly connected IoT devices. Based on our simulation findings, our strategy surpasses the VanillaFL selection approach in terms of maximizing both the revenues of the client devices and accuracy of the global federated learning model.


title: BATT: Backdoor Attack with Transformation-based Triggers

abstract: Deep neural networks (DNNs) are vulnerable to backdoor attacks. The backdoor adversaries intend to maliciously control the predictions of attacked DNNs by injecting hidden backdoors that can be activated by adversary-specified trigger patterns during the training process. One recent research revealed that most of the existing attacks failed in the real physical world since the trigger contained in the digitized test samples may be different from that of the one used for training. Accordingly, users can adopt spatial transformations as the image pre-processing to deactivate hidden backdoors. In this paper, we explore the previous findings from another side. We exploit classical spatial transformations (i.e. rotation and translation) with the specific parameter as trigger patterns to design a simple yet effective poisoning-based backdoor attack. For example, only images rotated to a particular angle can activate the embedded backdoor of attacked DNNs. Extensive experiments are conducted, verifying the effectiveness of our attack under both digital and physical settings and its resistance to existing backdoor defenses.


title: Influence of Charge on Decoupled Anisotropic Spheres in $f(G,T)$ Gravity

abstract: In this paper, we develop two anisotropic solutions for static self-gravitating spherical structure in the presence of electromagnetic field through gravitational decoupling approach in $f(G,T)$ theory, where $G$ and $T$ denote the Gauss-Bonnet term and trace of the energy-momentum tensor, respectively. The extra source with isotropic seed sector is responsible for generating anisotropy in the spacetime. The system of field equations is decoupled into two arrays by using minimal geometric deformation in the radial component. The first set portrays the isotropic regime whereas the second set represents the anisotropic system. The metric coefficients of the Krori-Barua spacetime are employed to extract solution of the first set while two constraints on the radial and temporal components of the extra source yield the corresponding two solutions. Finally, we investigate the influence of charge and decoupling parameter on the physical viability and stability of the obtained solutions. We conclude that the resulting solutions in this modified theory indicate more feasible and stable structures.


title: Dormant Neural Trojans

abstract: We present a novel methodology for neural network backdoor attacks. Unlike existing training-time attacks where the Trojaned network would respond to the Trojan trigger after training, our approach inserts a Trojan that will remain dormant until it is activated. The activation is realized through a specific perturbation to the network's weight parameters only known to the attacker. Our analysis and the experimental results demonstrate that dormant Trojaned networks can effectively evade detection by state-of-the-art backdoor detection methods.


title: Manipulation of individual judgments in the quantitative pairwise comparisons method

abstract: Decision-making methods very often use the technique of comparing alternatives in pairs. In this approach, experts are asked to compare different options, and then a quantitative ranking is created from the results obtained. It is commonly believed that experts (decision-makers) are honest in their judgments. In our work, we consider a scenario in which experts are vulnerable to bribery. For this purpose, we define a framework that allows us to determine the intended manipulation and present three algorithms for achieving the intended goal. Analyzing these algorithms may provide clues to help defend against such attacks.


title: Observational Signatures of Frame Dragging in Strong Gravity

abstract: Objects orbiting in the presence of a rotating massive body experience a gravitomagnetic frame-dragging effect, known as the Lense-Thirring effect, that has been experimentally confirmed in the weak-field limit. In the strong-field limit, near the horizon of a rotating black hole, frame dragging becomes so extreme that all objects must co-rotate with the black hole's angular momentum. In this work, we perform general relativistic numerical simulations to identify observable signatures of frame dragging in the strong-field limit that appear when infalling gas is forced to flip its direction of rotation as it is being accreted. In total intensity images, infalling streams exhibit "S"-shaped features due to the switch in the tangential velocity. In linear polarization, a flip in the handedness of spatially resolved polarization ticks as a function of radius encodes a transition in the magnetic field geometry that occurs due to magnetic flux freezing in the dragged plasma. Using a network of telescopes around the world, the Event Horizon Telescope collaboration has demonstrated that it is now possible to directly image black holes on event horizon scales. We show that the phenomena described in this work would be accessible to the next-generation Event Horizon Telescope (ngEHT) and extensions of the array into space, which would produce spatially resolved images on event horizon scales with higher spatial resolution and dynamic range.


title: Photonic Elementary Cellular Automata for Simulation of Complex Phenomena

abstract: Cellular automata are a class of computational models based on simple rules and algorithms that can simulate a wide range of complex phenomena. However, when using conventional computers, these 'simple' rules are only encapsulated at the level of software. This can be taken one step further by simplifying the underlying physical hardware. Here, we propose and implement a simple photonic hardware platform for simulating complex phenomena based on cellular automata. Using this special-purpose computer, we experimentally demonstrate complex phenomena including fractals, chaos, and solitons, which are typically associated with much more complex physical systems. The flexibility and programmability of our photonic computer presents new opportunities to simulate and harness complexity for efficient, robust, and decentralized information processing schemes using light.


title: Benchmarking local motion planners for navigation of mobile manipulators

abstract: There are various trajectory planners for mobile manipulators. It is often challenging to compare their performance under similar circumstances due to differences in hardware, dissimilarity of tasks and objectives, as well as uncertainties in measurements and operating environments. In this paper, we propose a simulation framework to evaluate the performance of the local trajectory planners to generate smooth, and dynamically and kinematically feasible trajectories for mobile manipulators in the same environment. We focus on local planners as they are key components that provide smooth trajectories while carrying a load, react to dynamic obstacles, and avoid collisions. We evaluate two prominent local trajectory planners, Dynamic-Window Approach (DWA) and Time Elastic Band (TEB) using the metrics that we introduce. Moreover, our software solution is applicable to any other local planners used in the Robot Operating System (ROS) framework, without additional programming effort.


title: Developing Modular Autonomous Capabilities for sUAS Operations

abstract: Small teams in the field can benefit from the capabilities provided by small Uncrewed Aerial Systems (sUAS) for missions such as reconnaissance, hostile attribution, remote emplacement, and search and rescue. The mobility, communications, and flexible payload capacity of sUAS can offer teams new levels of situational awareness and enable more highly coordinated missions than previously possible. However, piloting such aircraft for specific missions draws personnel away from other mission-critical tasks, increasing the load on remaining personnel while also increasing complexity of operations. For wider adoption and use of sUAS for security and humanitarian missions, safe and robust autonomy must be employed to reduce this burden on small teams. In this paper, we present the development of the Collaborative-UAS for Hostile Attribution, Surveillance, Emplacement, and Reconnaissance (CHASER) testbed, for rapidly prototyping capabilities that will reduce strain on small teams through sensor-guided autonomous control. We attempt to address autonomy needs unfilled by commercial sUAS platforms by creating and testing a series of composable modules that can be configured to support multiple missions. Methods implemented and presented here include radar track correlation, on-board computer vision target detection, target position estimation, closed-loop relative position control, and efficient search of a 3D volume for target acquisition. We configure and test a series of these modules in an example mission, executing a fully autonomous chase of an intruding sUAS in live flight, and demonstrating the success of the modularized autonomy approach. We present performance results from simulation or live flight tests for each module. Lastly, we describe the software architecture that we have developed for flexible controls and comment on how the capabilities presented may enable additional missions.


title: Self Similarity Matrix based CNN Filter Pruning

abstract: In recent years, most of the deep learning solutions are targeted to be deployed in mobile devices. This makes the need for development of lightweight models all the more imminent. Another solution is to optimize and prune regular deep learning models. In this paper, we tackle the problem of CNN model pruning with the help of Self-Similarity Matrix (SSM) computed from the 2D CNN filters. We propose two novel algorithms to rank and prune redundant filters which contribute similar activation maps to the output. One of the key features of our method is that there is no need of finetuning after training the model. Both the training and pruning process is completed simultaneously. We benchmark our method on two of the most popular CNN models - ResNet and VGG and record their performance on the CIFAR-10 dataset.


title: High-fidelity quantum control via Autler-Townes splitting

abstract: We propose quantum control protocols for the high-fidelity preparation of target states in systems with Autler-Townes splitting. We investigate an approximated three-level system obtained from a four-level one by adiabatically eliminating a state that does not participate in the evolution. In our work we use linear, arctan, and Roland-Cerf functions for transferring population between two eigenstates of the system obtaining a high fidelity for long evolution times. Additionally, in order to overcome the restriction given by the lifetimes of the experimental setup, we propose an accelerated adiabatic evolution with a shortcut to adiabaticity protocol, which allows us to reach fidelities close to one but much faster.


title: Study of light sterile neutrino at the long-baseline experiment options at KM3NeT

abstract: In this paper, we study the capability of different long-baseline experiment options at the KM3NeT facility i.e., P2O, Upgraded P2O and P2SO to probe the light sterile neutrino and compare their sensitivities with DUNE. The P2O option will have neutrinos from a 90 KW beam at Protvino to be detected at the ORCA detector, the Upgraded P2O will have neutrinos from the upgraded 450 KW beam to be detected at the ORCA detector and the option P2SO will have neutrinos from a 450 KW beam to be detected at the upgraded Super-ORCA detector. All these options will have a baseline around 2595 km. Our results show that the experiments at the KM3NeT (DUNE) would be more sensitive if the value of $\Delta m^2_{41}$ is around 10 (1) eV$^2$. Our results also show that the role of near detector is very important for the study of sterile neutrinos and addition of near detector improves the sensitivity as compared to only far detector for 3+1 scenario. Among the three options at KM3NeT, the sensitivity of P2O and upgraded P2O is limited and sensitivity of P2SO is either comparable or better than DUNE.


title: Liability regimes in the age of AI: a use-case driven analysis of the burden of proof

abstract: New emerging technologies powered by Artificial Intelligence (AI) have the potential to disruptively transform our societies for the better. In particular, data-driven learning approaches (i.e., Machine Learning (ML)) have been a true revolution in the advancement of multiple technologies in various application domains. But at the same time there is growing concern about certain intrinsic characteristics of these methodologies that carry potential risks to both safety and fundamental rights. Although there are mechanisms in the adoption process to minimize these risks (e.g., safety regulations), these do not exclude the possibility of harm occurring, and if this happens, victims should be able to seek compensation. Liability regimes will therefore play a key role in ensuring basic protection for victims using or interacting with these systems. However, the same characteristics that make AI systems inherently risky, such as lack of causality, opacity, unpredictability or their self and continuous learning capabilities, may lead to considerable difficulties when it comes to proving causation. This paper presents three case studies, as well as the methodology to reach them, that illustrate these difficulties. Specifically, we address the cases of cleaning robots, delivery drones and robots in education. The outcome of the proposed analysis suggests the need to revise liability regimes to alleviate the burden of proof on victims in cases involving AI technologies.


title: Mn(Pt$_{1-x}$Pd$_{x}$)$_5$P: Isovalent Tuning of Mn Sublattice Magnetic Order

abstract: We report the growth and characterization of MnPd$_5$P, a ferromagnet with T$_C$ $\approx$ 295 K, and conduct a substitutional study with its antiferromagnetic analogue MnPt$_5$P. We grow single crystals of MnPd$_5$P and Mn(Pt$_{1-x}$Pd$_x$)$_5$P by adding Mn into (Pt$_{1-x}$Pd$_{x}$)-P based melts. All compounds in the family adopt the layered anti-CeCoIn$_5$ structure with space group P4/mmm, and EDS and XRD results indicate that MnPt$_5$P and MnPd$_5$P form a solid solution. Based on magnetization and resistance data, we construct a T-x phase diagram for Mn(Pt$_{1-x}$Pd$_x$)$_5$P and demonstrate the antiferromagnetic order found in MnPt$_5$P is extraordinarily sensitive to Pd substitution. At low Pd fractions (x $<$ 0.010), the single antiferromagnetic transition in pure MnPt$_5$P splits into a higher temperature ferromagnetic transition followed on cooling by a lower temperature ferromagnetic to antiferromagnetic transition and then by a re-entrant antiferromagnetic to ferromagnetic transition at lower temperatures. The antiferromagnetic region makes up a bubble that persists to x $\approx$ 0.009 for T $\approx$ 150 K, with all samples x $<$ 0.009 recovering their initial ferromagnetic state with further cooling to base temperature. Over the same low x range we find a non-monotonic change in the room temperature unit cell volume, further suggesting that pure MnPt$_5$P is close to an instability. Once x $>$ 0.010, Mn(Pt$_{1-x}$Pd$_x$)$_5$P undergoes a single ferromagnetic transition. The Curie temperature increases rapidly with x, rising from T$_C$ $\approx$ 197 K at x = 0.013 to a maximum of T$_C$ $\approx$ 312 K for x $\approx$ 0.62, and then falls back to T$_C$ $\approx$ 295 K for pure MnPd$_5$P (x = 1). Given that Pt and Pd are isoelectronic, this work raises questions as to the origin of the extreme sensitivity of the magnetic ground state in MnPt$_5$P upon introducing Pd.


title: Giant atom induced zero modes and localization in the nonreciprocal Su-Schrieffer-Heeger chain

abstract: A notable feature of non-Hermitian systems with skin effects is the sensitivity of their spectra and eigenstates to the boundary conditions. In the literature, three types of boundary conditions-periodic boundary condition,open boundary condition and a defect in the system as a boundary, are explored. In this work we introduce the other type of boundary condition provided by a giant atom. The giant atom couples to a nonreciprocal SuSchrieffer-Heeger chain at two points and plays the role of defects. We study the spectrum and localization of eigenstates of the system and find that the giant atom can induce asymmetric zero modes. A remarkable feature is that bulk states might localize at the left or the right chain-atom coupling sites in weak localization regimes. This bipolar localization leads to Bloch-like states, even though translational invariance is broken. Moreover, we find that the localization is obviously weaker than the case with two small atoms or open boundary conditions even in strong coupling regimes. These intriguing results indicate that nonlocal coupling of giant atom to a nonreciprocal SSH chain weakens localization of the eigenstates. We also show that the Lyapunov exponent in the long-time dynamics in real space can act as a witness of the localized bulk states.


title: Dual density waves with neutral and charged dipolar excitons of GaAs bilayers

abstract: Strongly correlated quantum particles in lattice potentials are the building blocks for a large variety of quantum insulators, for instance Mott phases and density waves breaking the lattice symmetry. Such collective states are accessible to bosonic and fermionic systems. To expand further the spectrum of accessible quantum matter phases, mixing both species is theoretically appealing, since density order then competes with phase separation. Here we manipulate such Bose-Fermi mixture by confining neutral (boson-like) and charged (fermion-like) dipolar excitons in an artificial square lattice of a GaAs bilayer. At unitary lattice filling, strong inter- and intra-species interactions stabilise insulating phases when the fraction of charged excitons is around (1/3, 1/2, 2/3). We evidence that dual Bose-Fermi density waves are then realised, with species ordered in alternating stripes. Our observations highlight that dipolar excitons allow for controlled implementations of Bose-Fermi Hubbard models extended by off-site interactions.


title: A Virgo Environmental Survey Tracing Ionised Gas Emission (VESTIGE).XIV. The main sequence relation in a rich environment down to M_star ~ 10^6 Mo

abstract: Using a compilation of Halpha fluxes for 384 star forming galaxies detected during the VESTIGE survey, we study several important scaling relations for a complete sample of galaxies in a rich environment. The extraordinary sensitivity of the data allows us to sample the whole dynamic range of the Halpha luminosity function, from massive (M*~10^11 Mo) to dwarf systems (M*~10^6 Mo). This extends previous works to a dynamic range in stellar mass and star formation rate (10^-4<SFR<10 Mo yr^-1) never explored so far. The main sequence (MS) relation derived for all star forming galaxies within one virial radius of the Virgo cluster has a slope comparable to that observed in other nearby samples of isolated objects, but has a dispersion ~3 times larger. The dispersion is tightly connected to the available amount of HI gas, with gas-poor systems located far below objects of similar stellar mass but with a normal HI content. When measured on unperturbed galaxies with a normal HI gas content, the relation has a slope a=0.92, an intercept b=-1.57, and a scatter ~0.40. We compare these observational results to the prediction of models. The observed scatter in the MS relation can be reproduced only after a violent and active stripping process such as ram-pressure that removes gas from the disc and quenches star formation on short (<1 Gyr) timescales. This rules out milder processes such as starvation. This interpretation is also consistent with the position of galaxies of different star formation activity and gas content within the phase-space diagram. We also show that the star forming regions formed in the stripped material outside perturbed galaxies are located well above the MS relation drawn by unperturbed systems. These HII regions, which might be at the origin of compact sources typical in rich environments, are living a starburst phase lasting only <50 Myr, later becoming quiescent systems.


title: Dead-zone compensation via passivity-based control for a class of mechanical systems

abstract: This manuscript introduces a passivity-based control methodology for fully-actuated mechanical systems with symmetric or asymmetric dead-zones. To this end, we find a smooth approximation of the inverse of the function that describes such a nonlinearity. Then, we propose an energy and damping injection approach - based on the PI-PBC technique - that compensates for the dead-zone. Moreover, we provide an analysis of the performance of the proposed controller near the equilibrium. We conclude this paper by experimentally validating the results on a two degrees-of-freedom planar manipulator.


title: Doubly resonant photonic crystal cavity using merged bound states in the continuum

abstract: In this work, a doubly resonant photonic crystal (PhC) cavity using the merged bound states in the continuum (BICs) is proposed to obtain a higher second harmonic generation (SHG) efficiency. Firstly by scanning geometry parameters the accidental BICs and a band-edge mode outside the light cone can be obtained. Then as the lattice constant or the thickness of the slab is adjusted the accidental BICs will merge. A supercell with large and small holes is constructed and the band-edge mode outside the light cone can be mode-matched with the merged BICs mode. Finally the heterostructure PhC cavity is designed. The merged BICs show a high quality factor for the photonic crystal with finite size. Consequently, the SHG efficiency of the lattice constant near merged BICs of ~6000% W-1 is higher than the one of the isolated BIC.


title: Human in the loop approaches in multi-modal conversational task guidance system development

abstract: Development of task guidance systems for aiding humans in a situated task remains a challenging problem. The role of search (information retrieval) and conversational systems for task guidance has immense potential to help the task performers achieve various goals. However, there are several technical challenges that need to be addressed to deliver such conversational systems, where common supervised approaches fail to deliver the expected results in terms of overall performance, user experience and adaptation to realistic conditions. In this preliminary work we first highlight some of the challenges involved during the development of such systems. We then provide an overview of existing datasets available and highlight their limitations. We finally develop a model-in-the-loop wizard-of-oz based data collection tool and perform a pilot experiment.


title: Fast Noise Removal in Hyperspectral Images via Representative Coefficient Total Variation

abstract: Mining structural priors in data is a widely recognized technique for hyperspectral image (HSI) denoising tasks, whose typical ways include model-based methods and data-based methods. The model-based methods have good generalization ability, while the runtime cannot meet the fast processing requirements of the practical situations due to the large size of an HSI data $ \mathbf{X} \in \mathbb{R}^{MN\times B}$. For the data-based methods, they perform very fast on new test data once they have been trained. However, their generalization ability is always insufficient. In this paper, we propose a fast model-based HSI denoising approach. Specifically, we propose a novel regularizer named Representative Coefficient Total Variation (RCTV) to simultaneously characterize the low rank and local smooth properties. The RCTV regularizer is proposed based on the observation that the representative coefficient matrix $\mathbf{U}\in\mathbb{R}^{MN\times R} (R\ll B)$ obtained by orthogonally transforming the original HSI $\mathbf{X}$ can inherit the strong local-smooth prior of $\mathbf{X}$. Since $R/B$ is very small, the HSI denoising model based on the RCTV regularizer has lower time complexity. Additionally, we find that the representative coefficient matrix $\mathbf{U}$ is robust to noise, and thus the RCTV regularizer can somewhat promote the robustness of the HSI denoising model. Extensive experiments on mixed noise removal demonstrate the superiority of the proposed method both in denoising performance and denoising speed compared with other state-of-the-art methods. Remarkably, the denoising speed of our proposed method outperforms all the model-based techniques and is comparable with the deep learning-based approaches.


title: Coequalisers under the Lens

abstract: Lenses encode protocols for synchronising systems. We continue the work begun by Chollet et al. at the Applied Category Theory Adjoint School in 2020 to study the properties of the category of small categories and asymmetric delta lenses. The forgetful functor from the category of lenses to the category of functors is already known to reflect monos and epis and preserve epis; we show that it preserves monos, and give a simpler proof that it preserves epis. Together this gives a complete characterisation of the monic and epic lenses in terms of elementary properties of their get functors. Next, we initiate the study of coequalisers of lenses. We observe that not all parallel pairs of lenses have coequalisers, and that the forgetful functor from the category of lenses to the category of functors neither preserves nor reflects all coequalisers. However, some coequalisers are reflected; we study when this occurs, and then use what we learned to show that every epic lens is regular, and that discrete opfibrations have pushouts along monic lenses. Corollaries include that every monic lens is effective, every monic epic lens is an isomorphism, and the class of all epic lenses and the class of all monic lenses form an orthogonal factorisation system.


title: Demo: LE3D: A Privacy-preserving Lightweight Data Drift Detection Framework

abstract: This paper presents LE3D; a novel data drift detection framework for preserving data integrity and confidentiality. LE3D is a generalisable platform for evaluating novel drift detection mechanisms within the Internet of Things (IoT) sensor deployments. Our framework operates in a distributed manner, preserving data privacy while still being adaptable to new sensors with minimal online reconfiguration. Our framework currently supports multiple drift estimators for time-series IoT data and can easily be extended to accommodate new data types and drift detection mechanisms. This demo will illustrate the functionality of LE3D under a real-world-like scenario.


title: Erd\"os-R\'enyi Poissonized

abstract: We introduce a variant of the Erd\"os--R\'enyi random graph where the number of vertices is random and follows a Poisson law. A very simple Markov property of the model entails that the Lukasiewicz exploration is made of \textit{independent} Poisson increments. Using a vanilla Poisson counting process, this enables us to give very short proofs of classical results such as the phase transition for the giant component or the connectedness for the standard Erd\"os--R\'enyi model.


title: DriveFuzz: Discovering Autonomous Driving Bugs through Driving Quality-Guided Fuzzing

abstract: Autonomous driving has become real; semi-autonomous driving vehicles in an affordable price range are already on the streets, and major automotive vendors are actively developing full self-driving systems to deploy them in this decade. Before rolling the products out to the end-users, it is critical to test and ensure the safety of the autonomous driving systems, consisting of multiple layers intertwined in a complicated way. However, while safety-critical bugs may exist in any layer and even across layers, relatively little attention has been given to testing the entire driving system across all the layers. Prior work mainly focuses on white-box testing of individual layers and preventing attacks on each layer. In this paper, we aim at holistic testing of autonomous driving systems that have a whole stack of layers integrated in their entirety. Instead of looking into the individual layers, we focus on the vehicle states that the system continuously changes in the driving environment. This allows us to design DriveFuzz, a new systematic fuzzing framework that can uncover potential vulnerabilities regardless of their locations. DriveFuzz automatically generates and mutates driving scenarios based on diverse factors leveraging a high-fidelity driving simulator. We build novel driving test oracles based on the real-world traffic rules to detect safety-critical misbehaviors, and guide the fuzzer towards such misbehaviors through driving quality metrics referring to the physical states of the vehicle. DriveFuzz has discovered 30 new bugs in various layers of two autonomous driving systems (Autoware and CARLA Behavior Agent) and three additional bugs in the CARLA simulator. We further analyze the impact of these bugs and how an adversary may exploit them as security vulnerabilities to cause critical accidents in the real world.


title: Ranking-based Group Identification via Factorized Attention on Social Tripartite Graph

abstract: Due to the proliferation of social media, a growing number of users search for and join group activities in their daily life. This develops a need for the study on the ranking-based group identification (RGI) task, i.e., recommending groups to users. The major challenge in this task is how to effectively and efficiently leverage both the item interaction and group participation of users' online behaviors. Though recent developments of Graph Neural Networks (GNNs) succeed in simultaneously aggregating both social and user-item interaction, they however fail to comprehensively resolve this RGI task. In this paper, we propose a novel GNN-based framework named Contextualized Factorized Attention for Group identification (CFAG). We devise tripartite graph convolution layers to aggregate information from different types of neighborhoods among users, groups, and items. To cope with the data sparsity issue, we devise a novel propagation augmentation (PA) layer, which is based on our proposed factorized attention mechanism. PA layers efficiently learn the relatedness of non-neighbor nodes to improve the information propagation to users. Experimental results on three benchmark datasets verify the superiority of CFAG. Additional detailed investigations are conducted to demonstrate the effectiveness of the proposed framework.


title: Polynomial Life: the Structure of Adaptive Systems

abstract: We extend our earlier work on the compositional structure of cybernetic systems in order to account for the embodiment of such systems. All their interactions proceed through their bodies' boundaries: sensations impinge on their surfaces, and actions correspond to changes in their configurations. We formalize this morphological perspective using polynomial functors. The 'internal universes' of systems are shown to constitute an indexed category of statistical games over polynomials; their dynamics form an indexed category of behaviours. We characterize 'active inference doctrines' as indexed functors between such categories, resolving a number of open problems in our earlier work, and pointing to a formalization of the 'free energy principle' as adjoint to such doctrines. We illustrate our framework through fundamental examples from biology, including homeostasis, morphogenesis, and autopoiesis, and suggest a formal connection between spatial navigation and the process of proof.


title: Extra-Newton: A First Approach to Noise-Adaptive Accelerated Second-Order Methods

abstract: This work proposes a universal and adaptive second-order method for minimizing second-order smooth, convex functions. Our algorithm achieves $O(\sigma / \sqrt{T})$ convergence when the oracle feedback is stochastic with variance $\sigma^2$, and improves its convergence to $O( 1 / T^3)$ with deterministic oracles, where $T$ is the number of iterations. Our method also interpolates these rates without knowing the nature of the oracle apriori, which is enabled by a parameter-free adaptive step-size that is oblivious to the knowledge of smoothness modulus, variance bounds and the diameter of the constrained set. To our knowledge, this is the first universal algorithm with such global guarantees within the second-order optimization literature.


title: Basis Function feedforward for Position-Dependent Systems

abstract: Feedforward for motion systems is getting increasingly more important to achieve performance requirements. This leads to a situation where position-dependent effects cannot be neglected anymore.


title: Toward Unsupervised Outlier Model Selection

abstract: Today there exists no shortage of outlier detection algorithms in the literature, yet the complementary and critical problem of unsupervised outlier model selection (UOMS) is vastly understudied. In this work we propose ELECT, a new approach to select an effective candidate model, i.e. an outlier detection algorithm and its hyperparameter(s), to employ on a new dataset without any labels. At its core, ELECT is based on meta-learning; transferring prior knowledge (e.g. model performance) on historical datasets that are similar to the new one to facilitate UOMS. Uniquely, it employs a dataset similarity measure that is performance-based, which is more direct and goal-driven than other measures used in the past. ELECT adaptively searches for similar historical datasets, as such, it can serve an output on-demand, being able to accommodate varying time budgets. Extensive experiments show that ELECT significantly outperforms a wide range of basic UOMS baselines, including no model selection (always using the same popular model such as iForest) as well as more recent selection strategies based on meta-features.


title: Jacobians and Gradients for Cartesian Differential Categories

abstract: Cartesian differential categories come equipped with a differential combinator that formalizes the directional derivative from multivariable calculus. Cartesian differential categories provide a categorical semantics of the differential lambda-calculus and have also found applications in causal computation, incremental computation, game theory, differentiable programming, and machine learning. There has recently been a desire to provide a (coordinate-free) characterization of Jacobians and gradients in Cartesian differential categories. One's first attempt might be to consider Cartesian differential categories which are Cartesian closed, such as models of the differential lambda-calculus, and then take the curry of the derivative. Unfortunately, this approach excludes numerous important examples of Cartesian differential categories such as the category of real smooth functions. In this paper, we introduce linearly closed Cartesian differential categories, which are Cartesian differential categories that have an internal hom of linear maps, a bilinear evaluation map, and the ability to curry maps which are linear in their second argument. As such, the Jacobian of a map is defined as the curry of its derivative. Many well-known examples of Cartesian differential categories are linearly closed, such as, in particular, the category of real smooth functions. We also explain how a Cartesian closed differential category is linearly closed if and only if a certain linear idempotent on the internal hom splits. To define the gradient of a map, one must be able to define the transpose of the Jacobian, which can be done in a Cartesian reverse differential category. Thus, we define the gradient of a map to be the curry of its reverse derivative and show this equals the transpose of its Jacobian. We also explain how a linearly closed Cartesian reverse differential category is precisely a linearly closed Cartesian differential category with an appropriate notion of transpose.


title: Expected Signature For the Lorentz Invariance Violation Effects on $\gamma-\gamma$ Absorption

abstract: There are still some {significant and} unanswered questions about the {incredible} {very high energy (VHE)} $\gamma$-ray signatures. To help understand the mechanism, focusing on the linear and quadratic perturbation mode for the subluminal regime, the present paper revisited the expected signature for the Lorentz invariance violation effects on $\gamma-\gamma$ absorption in TeV spectra of Gamma-ray bursts (GRBs). We note that there is {a critical energy} for the pair production process, which is sensitive to the assumed quantum gravity energy scale. We suggest that a {reemergence of the energy spectrum of $\gamma$-rays} at the several tens of TeV is a rough observational diagnostic for the Lorentz invariance violation (LIV) effects. The expected spectra characteristics are applied to a GRB 221009A. The results show that the cosmic opacity with LIV effects considered here {can} roughly reproduce the observed $\gamma$-ray spectra for the source, which enabled us to constrain the upper limit of the values of energy scale at $E_{\rm QG,~1}\leq3.35\times10^{20}$ GeV for the linear perturbation and $E_{\rm QG,~2}\leq9.19\times10^{12}$ GeV for the quadratic perturbation. {These scenarios would update the bound of the LIV coefficient with $\xi_{\rm 1}^{\prime}\geq 3.62\times10^{-2}$ for the linear perturbation, and $\xi_{\rm 2}^{\prime}\geq 1.33\times10^{6}$ for the quadratic perturbation in the standard model extension (SME) framework, respectively. }


title: Latent Prompt Tuning for Text Summarization

abstract: Prompts with different control signals (e.g., length, keywords, etc.) can be used to control text summarization. When control signals are available, they can control the properties of generated summaries and potentially improve summarization quality (since more information are given). Unfortunately, control signals are not already available during inference time. In this paper, we propose Lotus (shorthand for Latent Prompt Tuning for Summarization), which is a single model that can be applied in both controlled and uncontrolled (without control signals) modes. During training, Lotus learns latent prompt representations from prompts with gold control signals using a contrastive learning objective. Experiments show Lotus in uncontrolled mode consistently improves upon strong (uncontrollable) summarization models across four different summarization datasets. We also demonstrate generated summaries can be controlled using prompts with user specified control tokens.


title: On the Operator Origins of Classical and Quantum Wave Functions

abstract: We investigate operator algebraic origins of the classical Koopman-von Neumann wave function $\psi_{KvN}$ as well as the quantum mechanical one $\psi_{QM}$. We introduce a formalism of Operator Mechanics (OM) based on a noncommutative Poisson, symplectic and noncommutative differential structures. OM serves as a pre-quantum algebra from which algebraic structures relevant to real-world classical and quantum mechanics follow. In particular, $\psi_{KvN}$ and $\psi_{QM}$ are both consequences of this pre-quantum formalism. No a priori Hilbert space is needed. OM admits an algebraic notion of operator expectation values without invoking states. A phase space bundle ${\cal E}$ follows from this. $\psi_{KvN}$ and $\psi_{QM}$ are shown to be sections in ${\cal E}$. The difference between $\psi_{KvN}$ and $\psi_{QM}$ originates from a quantization map interpreted as "twisting" of sections over ${\cal E}$. We also show that the Schr\"{o}dinger equation is obtained from the Koopman-von Neumann equation. What this suggests is that neither the Schr\"{o}dinger equation nor the quantum wave function are fundamental structures. Rather, they both originate from a pre-quantum operator algebra. Finally, we comment on how entanglement between these operators suggests emergence of space; and possible extensions of this formalism to field theories.


title: HyperSound: Generating Implicit Neural Representations of Audio Signals with Hypernetworks

abstract: Implicit neural representations (INRs) are a rapidly growing research field, which provides alternative ways to represent multimedia signals. Recent applications of INRs include image super-resolution, compression of high-dimensional signals, or 3D rendering. However, these solutions usually focus on visual data, and adapting them to the audio domain is not trivial. Moreover, it requires a separately trained model for every data sample. To address this limitation, we propose HyperSound, a meta-learning method leveraging hypernetworks to produce INRs for audio signals unseen at training time. We show that our approach can reconstruct sound waves with quality comparable to other state-of-the-art models.


title: LE3D: A Lightweight Ensemble Framework of Data Drift Detectors for Resource-Constrained Devices

abstract: Data integrity becomes paramount as the number of Internet of Things (IoT) sensor deployments increases. Sensor data can be altered by benign causes or malicious actions. Mechanisms that detect drifts and irregularities can prevent disruptions and data bias in the state of an IoT application. This paper presents LE3D, an ensemble framework of data drift estimators capable of detecting abnormal sensor behaviours. Working collaboratively with surrounding IoT devices, the type of drift (natural/abnormal) can also be identified and reported to the end-user. The proposed framework is a lightweight and unsupervised implementation able to run on resource-constrained IoT devices. Our framework is also generalisable, adapting to new sensor streams and environments with minimal online reconfiguration. We compare our method against state-of-the-art ensemble data drift detection frameworks, evaluating both the real-world detection accuracy as well as the resource utilisation of the implementation. Experimenting with real-world data and emulated drifts, we show the effectiveness of our method, which achieves up to 97% of detection accuracy while requiring minimal resources to run.


title: Grounding Game Semantics in Categorical Algebra

abstract: I present a formal connection between algebraic effects and game semantics, two important lines of work in programming languages semantics with applications in compositional software verification. Specifically, the algebraic signature enumerating the possible side-effects of a computation can be read as a game, and strategies for this game constitute the free algebra for the signature in a category of complete partial orders (cpos). Hence, strategies provide a convenient model of computations with uninterpreted side-effects. In particular, the operational flavor of game semantics carries over to the algebraic context, in the form of the coincidence between the initial algebras and the terminal coalgebras of cpo endofunctors. Conversely, the algebraic point of view sheds new light on the strategy constructions underlying game semantics. Strategy models can be reformulated as ideal completions of partial strategy trees (free dcpos on the term algebra). Extending the framework to multi-sorted signatures would make this construction available for a large class of games.


title: Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars

abstract: The discovery of neural architectures from simple building blocks is a long-standing goal of Neural Architecture Search (NAS). Hierarchical search spaces are a promising step towards this goal but lack a unifying search space design framework and typically only search over some limited aspect of architectures. In this work, we introduce a unifying search space design framework based on context-free grammars that can naturally and compactly generate expressive hierarchical search spaces that are 100s of orders of magnitude larger than common spaces from the literature. By enhancing and using their properties, we effectively enable search over the complete architecture and can foster regularity. Further, we propose an efficient hierarchical kernel design for a Bayesian Optimization search strategy to efficiently search over such huge spaces. We demonstrate the versatility of our search space design framework and show that our search strategy can be superior to existing NAS approaches. Code is available at https://github.com/automl/hierarchical_nas_construction.


title: Semicocycle discontinuities for substitutions and reverse-reading automata

abstract: In this article we define the semigroup associated to a substitution. We use it to construct a minimal automaton which generates a substitution sequence u in reverse reading. We show, in the case where the substitution has a coincidence, that this automaton completely describes the semicocycle discontinuities of u.


title: Space-grid approximations of hybrid stochastic differential equations and first passage properties

abstract: Hybrid stochastic differential equations are a useful tool to model continuously varying stochastic systems which are modulated by a random environment that may depend on the system state itself. In this paper, we establish the pathwise convergence of the solutions to hybrid stochastic differential equations via space-grid discretizations. While time-grid discretizations are a classical approach for simulation purposes, our space-grid discretization provides a link with multi-regime Markov modulated Brownian motions, leading to computational tractability. We exploit our convergence result to obtain efficient approximations to first passage probabilities and expected occupation times of the solutions hybrid stochastic differential equations, results which are the first of their kind for such a robust framework. We finally illustrate the performance of the resulting approximations in numerical examples.


title: Reinforcement Learning based Cyberattack Model for Adaptive Traffic Signal Controller in Connected Transportation Systems

abstract: In a connected transportation system, adaptive traffic signal controllers (ATSC) utilize real-time vehicle trajectory data received from vehicles through wireless connectivity (i.e., connected vehicles) to regulate green time. However, this wirelessly connected ATSC increases cyber-attack surfaces and increases their vulnerability to various cyber-attack modes, which can be leveraged to induce significant congestion in a roadway network. An attacker may receive financial benefits to create such a congestion for a specific roadway. One such mode is a 'sybil' attack in which an attacker creates fake vehicles in the network by generating fake Basic Safety Messages (BSMs) imitating actual connected vehicles following roadway traffic rules. The ultimate goal of an attacker will be to block a route(s) by generating fake or 'sybil' vehicles at a rate such that the signal timing and phasing changes occur without flagging any abrupt change in number of vehicles. Because of the highly non-linear and unpredictable nature of vehicle arrival rates and the ATSC algorithm, it is difficult to find an optimal rate of sybil vehicles, which will be injected from different approaches of an intersection. Thus, it is necessary to develop an intelligent cyber-attack model to prove the existence of such attacks. In this study, a reinforcement learning based cyber-attack model is developed for a waiting time-based ATSC. Specifically, an RL agent is trained to learn an optimal rate of sybil vehicle injection to create congestion for an approach(s). Our analyses revealed that the RL agent can learn an optimal policy for creating an intelligent attack.


title: Theoretical investigation of the molecular nature of $D_{s0}^*(2317)$ and $D_{s1}(2460)$ and the possibility of observing the $D\bar{D}K$ bound state $K_{c\bar{c}}(4180)$ in inclusive $e^+e^-\to c\bar{c}$ collisions

abstract: Searching for exotic multiquark states and elucidating their nature remains a central topic in understanding quantum chromodynamics--the underlying theory of the strong interaction. Two of the most studied such states are the charm-strange states $D_{s0}^*(2317)$ and $D_{s1}(2460)$. In this letter, we show for the first time that their prompt production yields in inclusive $e^+e^-\to c\bar{c}$ collisions near $\sqrt{s}=10.6$ GeV measured by the BABAR Collaboration, $Y(D_{s0}^*(2317))$ and $Y(D_{s1}(2460))$, in particular the ratio $R=Y(D_{s0}^*(2317))/Y(D_{s1}(2460))$, can be well explained in the molecular picture, which provide a highly nontrivial verification of their nature being $DK/D^*K$ molecules. On the contrary, treating them as pure $c\bar{s}$ $P-$wave states, the statistical model predicts a ratio $R$ smaller than unity, in contrast with the experimental central value, though in agreement with it considering its relatively large uncertainty. In addition, we predict the production yield of the $D\bar{D}K$ three-body bound state, $K_{c\bar{c}}(4180)$, in $e^+e^-\to c\bar{c}$ collisions and find that it is within the reach of the ongoing Belle II experiment. The present study demonstrates the feasibility of a novel method to unravel the nature of exotic hadrons and the potential of electron-positron collisions in this regard.


title: Seeing the Unseen: Errors and Bias in Visual Datasets

abstract: From face recognition in smartphones to automatic routing on self-driving cars, machine vision algorithms lie in the core of these features. These systems solve image based tasks by identifying and understanding objects, subsequently making decisions from these information. However, errors in datasets are usually induced or even magnified in algorithms, at times resulting in issues such as recognising black people as gorillas and misrepresenting ethnicities in search results. This paper tracks the errors in datasets and their impacts, revealing that a flawed dataset could be a result of limited categories, incomprehensive sourcing and poor classification.


title: Circling Back to Recurrent Models of Language

abstract: Just because some purely recurrent models suffer from being hard to optimize and inefficient on today's hardware, they are not necessarily bad models of language. We demonstrate this by the extent to which these models can still be improved by a combination of a slightly better recurrent cell, architecture, objective, as well as optimization. In the process, we establish a new state of the art for language modelling on small datasets and on Enwik8 with dynamic evaluation.


title: Unsupervised Parameter Estimation using Model-based Decoder

abstract: In this work, we consider the use of a model-based decoder in combination with an unsupervised learning strategy for direction-of-arrival (DoA) estimation. Relying only on unlabeled training data we show in our analysis that we can outperform existing unsupervised machine learning methods and classical methods. The proposed approach consists of introducing a model-based decoder in an autoencoder architecture which leads to a meaningful representation of the statistical model in the latent space of the autoencoder. Our numerical simulations show that the performance of the presented approach is not affected by correlated signals and performs well for both, uncorrelated and correlated, scenarios. This is a result of the fact, that, in the proposed framework, the signal covariance matrix and the DOAs are estimated simultaneously.


title: Hints of the Photonic Nature of the Electromagnetic fields in Classical Electrodynamics and its connection to the electronic charge and vacuum energy density

abstract: The electromagnetic fields of a long dipole working without dispersive and dissipative losses are analyzed in the frequency domains. The dipole produces radiation in bursts of duration T/2 where T is the period of oscillation. The parameter studied in this paper is the energy, U, dissipated in a single burst of radiation of duration T/2. We have studied how U vary as a function of the charge associated with the current in the dipole and the ratio of the length of the dipole and its radius. We have observed a remarkable result when this ratio is equal to the ratio of the radius of the universe to the Bohr radius. Our results, based purely on the classical electrodynamics and general relativity, show that, as the magnitude of the oscillating charge (as defined by the root mean square) reduces to the electronic charge, the energy dissipated in a single burst of radiation reduces to hv, where v is the frequency of oscillation and h is the Planck constant. The importance of this finding is discussed. In particular, the results show that the existence of a minimum free charge in nature, i.e., electronic charge, is a direct consequence of the photonic nature of the electromagnetic fields. Furthermore, the presented findings allow to derive for the first time an expression for the vacuum energy density of the universe in terms of the other fundamental constants in nature, the prediction of which is consistent with experimental observations. This equation, which combines the vacuum energy, electronic charge and mass, speed of light, gravitational constant and Planck constant, creates a link between classical field theories (i.e., classical electrodynamics and general relativity) and quantum mechanics.


title: Adaptive Stochastic Variance Reduction for Non-convex Finite-Sum Minimization

abstract: We propose an adaptive variance-reduction method, called AdaSpider, for minimization of $L$-smooth, non-convex functions with a finite-sum structure. In essence, AdaSpider combines an AdaGrad-inspired [Duchi et al., 2011, McMahan & Streeter, 2010], but a fairly distinct, adaptive step-size schedule with the recursive stochastic path integrated estimator proposed in [Fang et al., 2018]. To our knowledge, Adaspider is the first parameter-free non-convex variance-reduction method in the sense that it does not require the knowledge of problem-dependent parameters, such as smoothness constant $L$, target accuracy $\epsilon$ or any bound on gradient norms. In doing so, we are able to compute an $\epsilon$-stationary point with $\tilde{O}\left(n + \sqrt{n}/\epsilon^2\right)$ oracle-calls, which matches the respective lower bound up to logarithmic factors.


title: Revisiting Hyperparameter Tuning with Differential Privacy

abstract: Hyperparameter tuning is a common practice in the application of machine learning but is a typically ignored aspect in the literature on privacy-preserving machine learning due to its negative effect on the overall privacy parameter. In this paper, we aim to tackle this fundamental yet challenging problem by providing an effective hyperparameter tuning framework with differential privacy. The proposed method allows us to adopt a broader hyperparameter search space and even to perform a grid search over the whole space, since its privacy loss parameter is independent of the number of hyperparameter candidates. Interestingly, it instead correlates with the utility gained from hyperparameter searching, revealing an explicit and mandatory trade-off between privacy and utility. Theoretically, we show that its additional privacy loss bound incurred by hyperparameter tuning is upper-bounded by the squared root of the gained utility. However, we note that the additional privacy loss bound would empirically scale like a squared root of the logarithm of the utility term, benefiting from the design of doubling step.


title: On the Coupling of Well Posed Differential Models -- Detailed Version

abstract: Consider the coupling of $2$ evolution equations, each generating a global process. We prove that the resulting system generates a new global process. This statement can be applied to differential equations of various kinds. In particular, it also yields the well posedness of a predator-prey model, where the coupling is in the differential terms, and of an epidemiological model, which does not fit previous well posedness results.


title: Ultralight dark matter searches at the sub-Hz frontier with atom multigradiometry

abstract: Single-photon atom gradiometry is a powerful experimental technique that can be employed to search for the oscillation of atomic transition energies induced by ultralight scalar dark matter (ULDM). In the sub-Hz regime the background is expected to be dominated by gravity gradient noise (GGN), which arises as a result of mass fluctuations around the experiment. In this work we model the GGN as surface Rayleigh waves, and we construct a likelihood-based analysis that consistently folds GGN into the sensitivity estimates of vertical atom gradiometers in the frequency window between 1 mHz and 1 Hz. We show that in certain geological settings GGN can be significantly mitigated when operating a multigradiometer configuration, which consists of three or more atom interferometers in the same baseline. Multigradiometer experiments, such as future versions of AION and MAGIS-100, have the potential to probe regions of scalar ULDM parameter space in the sub-Hz regime that have not been excluded by existing experiments.


title: The pro-nilpotent Lawrence-Krammer-Bigelow representation

abstract: We construct a 3-variable enrichment of the Lawrence-Krammer-Bigelow (LKB) representation of the braid groups, which is the limit of a pro-nilpotent tower of representations having the original LKB representation as its bottom layer. We also construct analogous pro-nilpotent towers of representations of surface braid groups and loop braid groups.


title: Conditional Generative Models for Simulation of EMG During Naturalistic Movements

abstract: Numerical models of electromyographic (EMG) signals have provided a huge contribution to our fundamental understanding of human neurophysiology and remain a central pillar of motor neuroscience and the development of human-machine interfaces. However, whilst modern biophysical simulations based on finite element methods are highly accurate, they are extremely computationally expensive and thus are generally limited to modelling static systems such as isometrically contracting limbs. As a solution to this problem, we propose a transfer learning approach, in which a conditional generative model is trained to mimic the output of an advanced numerical model. To this end, we present BioMime, a conditional generative neural network trained adversarially to generate motor unit activation potential waveforms under a wide variety of volume conductor parameters. We demonstrate the ability of such a model to predictively interpolate between a much smaller number of numerical model's outputs with a high accuracy. Consequently, the computational load is dramatically reduced, which allows the rapid simulation of EMG signals during truly dynamic and naturalistic movements.


title: Algebra of the spinor invariants and the relativistic hydrogen atom

abstract: It is shown that the Dirac equation with the Coulomb potential can be solved using the algebra of the three spinor invariants of the Dirac equation without the involvement of the methods of supersymmetric quantum mechanics. The Dirac Hamiltonian is invariant with respect to the rotation transformation, which indicates the dynamical (hidden) symmetry $ SU(2) $ of the Dirac equation. The total symmetry of the Dirac equation is the symmetry $ SO(3) \otimes SU(2) $. The generator of the $ SO(3) $ symmetry group is given by the total momentum operator, and the generator of $ SU(2) $ group is given by the rotation of the vector-states in the spinor space, determined by the Dirac, Johnson-Lippmann, and the new spinor invariants. It is shown that using algebraic approach to the Dirac problem allows one to calculate the eigenstates and eigenenergies of the relativistic hydrogen atom and reveals the fundamental role of the principal quantum number as an independent number, even though it is represented as the combination of other quantum numbers.


title: Relating graph auto-encoders to linear models

abstract: Graph auto-encoders are widely used to construct graph representations in Euclidean vector spaces. However, it has already been pointed out empirically that linear models on many tasks can outperform graph auto-encoders. In our work, we prove that the solution space induced by graph auto-encoders is a subset of the solution space of a linear map. This demonstrates that linear embedding models have at least the representational power of graph auto-encoders based on graph convolutional networks. So why are we still using nonlinear graph auto-encoders? One reason could be that actively restricting the linear solution space might introduce an inductive bias that helps improve learning and generalization. While many researchers believe that the nonlinearity of the encoder is the critical ingredient towards this end, we instead identify the node features of the graph as a more powerful inductive bias. We give theoretical insights by introducing a corresponding bias in a linear model and analyzing the change in the solution space. Our experiments are aligned with other empirical work on this question and show that the linear encoder can outperform the nonlinear encoder when using feature information.


title: Computed tomography coronary angiogram images, annotations and associated data of normal and diseased arteries

abstract: Computed Tomography Coronary Angiography (CTCA) is a non-invasive method to evaluate coronary artery anatomy and disease. CTCA is ideal for geometry reconstruction to create virtual models of coronary arteries. To our knowledge there is no public dataset that includes centrelines and segmentation of the full coronary tree. We provide anonymized CTCA images, voxel-wise annotations and associated data in the form of centrelines, calcification scores and meshes of the coronary lumen in 20 normal and 20 diseased cases. Images were obtained along with patient information with informed, written consent as part of Coronary Atlas (https://www.coronaryatlas.org/). Cases were classified as normal (zero calcium score with no signs of stenosis) or diseased (confirmed coronary artery disease). Manual voxel-wise segmentations by three experts were combined using majority voting to generate the final annotations. Provided data can be used for a variety of research purposes, such as 3D printing patient-specific models, development and validation of segmentation algorithms, education and training of medical personnel and in-silico analyses such as testing of medical devices.


title: Learning safety in model-based Reinforcement Learning using MPC and Gaussian Processes

abstract: We propose a method to encourage safety in Model Predictive Control (MPC)-based Reinforcement Learning (RL) via Gaussian Process (GP) regression. This framework consists of 1) a parametric MPC scheme that is employed as model-based controller with approximate knowledge on the real system's dynamics, 2) an episodic RL algorithm tasked with adjusting the MPC parametrization in order to increase its performance, and lastly, 3) GP regressors used to estimate, directly from data, constraints on the MPC parameters capable of predicting, up to some probability, whether the parametrization is likely to yield a safe or unsafe policy. These constraints are then enforced onto the RL updates in an effort to enhance the learning method with a probabilistic safety mechanism. Compared to other recent publications combining safe RL with MPC, our method does not require further assumptions on, e.g., the prediction model in order to retain computational tractability. We illustrate the results of our method in a numerical example on the control of a quadrotor drone in a safety-critical environment.


title: Influence of a mass transfer stability criterion on double white dwarf populations

abstract: Mass transfer stability is an essential issue in binary evolution. Ge et al. studied critical mass ratios for dynamically stable mass transfer by establishing adiabatic mass loss model and found that the donor stars on the giant branches tend to be more stable than that based on the composite polytropic stellar model. We would investigate the influence of mass transfer stability on the formation and properties of DWD populations. We performed a series of binary population synthesis, where the critical mass ratios from adiabatic mass loss model (Ge's model) and that from the composite polytropic model are adopted, respectively. For Ge's model, most of the DWDs are produced from the stable non-conservative Roche lobe overflow plus common envelope (CE) ejection channel (RL+CE channel) regardless of the CE ejection efficiency $\alpha_{CE}$. While the results of the polytropic model strongly depend on the adopted value of $\alpha_{ CE}$. We find DWDs produced from the RL+CE channel have comparable WD masses and the mass ratio distribution peaks at around 1. Based on the magnitude-limited sample of DWDs, the space densities for the detectable DWDs and those with extremely low-mass WD (ELM WD) companions in Ge's model is $1347$ and $473 kpc^{-3}$, respectively, close to observations. While the polytropic model overpredicts space density of DWDs by a factor of about $2-3$. We also find that the results of DWD merger rate distribution in Ge's model reproduce the observations better than that of the polytropic model, and the merger rate of DWDs with ELM WD companions in the Galaxy is about $1.8\times 10^{-3} yr^{-1}$ in Ge's model, which is comparable to the observation estimation. We confirm that the mass transfer stability plays important roles in the formation and properties of DWD populations, and then in the progenitors of SNe Ia and detectable GW sources.


title: A note on unavoidable patterns in locally dense colourings

abstract: We show that there is a constant $C$ such that for every $\varepsilon>0$ any $2$-coloured $K_n$ with minimum degree at least $n/4+\varepsilon n$ in both colours contains a complete subgraph on $2t$ vertices where one colour class forms a $K_{t,t}$, provided that $n\geq \varepsilon^{-Ct}$. Also, we prove that if $K_n$ is $2$-coloured with minimum degree at least $\varepsilon n$ in both colours then it must contain one of two natural colourings of a complete graph. Both results are tight up to the value of $C$ and they answer two recent questions posed by Kam\v{c}ev and M\"{u}yesser.


title: Edge, Fog, and Cloud Computing : An Overview on Challenges and Applications

abstract: With the rapid growth of the Internet of Things (IoT) and a wide range of mobile devices, the conventional cloud computing paradigm faces significant challenges (high latency, bandwidth cost, etc.). Motivated by those constraints and concerns for the future of the IoT, modern architectures are gearing toward distributing the cloud computational resources to remote locations where most end-devices are located. Edge and fog computing are considered as the key enablers for applications where centralized cloud-based solutions are not suitable. In this paper, we review the high-level definition of edge, fog, cloud computing, and their configurations in various IoT scenarios. We further discuss their interactions and collaborations in many applications such as cloud offloading, smart cities, health care, and smart agriculture. Though there are still challenges in the development of such distributed systems, early research to tackle those limitations have also surfaced.


title: Mirror beta transitions

abstract: Beta decays of mirror nuclei differ in Q-value, but will otherwise proceed with transitions of similar strength. The current status is reviewed: Fermi transitions are all very similar, whereas Gamow-Teller transitions can differ in strength by more than a factor two. The main cause of the asymmetries appears to be binding energy differences between the mirror systems.


title: Deformative Magnetic Marked Length Spectrum Rigidity

abstract: Let $M$ be a closed surface and let $\{g_s \ | \ s \in (-\epsilon, \epsilon)\}$ be a smooth one-parameter family of Riemannian metrics on $M$. Also let $\{\kappa_s : M \rightarrow \mathbb{R} \ | \ s \in (-\epsilon, \epsilon)\}$ be a smooth one-parameter family of functions on $M$. Then the family $\{(g_s, \kappa_s) \ | \ s \in (-\epsilon, \epsilon)\}$ gives rise to a family of magnetic flows on $TM$. We show that if the magnetic curvatures are negative for $s \in (-\epsilon, \epsilon)$ and the lengths of each periodic orbit remains constant as the parameter $s$ varies, then there exists a smooth family of diffeomorphisms $\{f_s : M \rightarrow M \ | \ s \in (-\epsilon, \epsilon)\}$ such that $f_s^*(g_s) = g_0$ and $f_s^*(\kappa_s) = \kappa_0$. This generalizes a result of Guillemin and Kazhdan to the setting of magnetic flows.


title: ImageNet-X: Understanding Model Mistakes with Factor of Variation Annotations

abstract: Deep learning vision systems are widely deployed across applications where reliability is critical. However, even today's best models can fail to recognize an object when its pose, lighting, or background varies. While existing benchmarks surface examples challenging for models, they do not explain why such mistakes arise. To address this need, we introduce ImageNet-X, a set of sixteen human annotations of factors such as pose, background, or lighting the entire ImageNet-1k validation set as well as a random subset of 12k training images. Equipped with ImageNet-X, we investigate 2,200 current recognition models and study the types of mistakes as a function of model's (1) architecture, e.g. transformer vs. convolutional, (2) learning paradigm, e.g. supervised vs. self-supervised, and (3) training procedures, e.g., data augmentation. Regardless of these choices, we find models have consistent failure modes across ImageNet-X categories. We also find that while data augmentation can improve robustness to certain factors, they induce spill-over effects to other factors. For example, strong random cropping hurts robustness on smaller objects. Together, these insights suggest to advance the robustness of modern vision models, future research should focus on collecting additional data and understanding data augmentation schemes. Along with these insights, we release a toolkit based on ImageNet-X to spur further study into the mistakes image recognition systems make.


title: Macrophage anti-inflammatory behaviour in a multiphase model of atherosclerotic plaque development

abstract: Atherosclerosis is an inflammatory disease characterised by the formation of plaques, which are deposits of lipids and cholesterol-laden macrophages that form in the artery wall. The inflammation is often non-resolving, due in large part to changes in normal macrophage anti-inflammatory behaviour that are induced by the toxic plaque microenvironment. These changes include higher death rates, defective efferocytic uptake of dead cells, and reduced rates of emigration. We develop a free boundary multiphase model for early atherosclerotic plaques, and we use it to investigate the effects of impaired macrophage anti-inflammatory behaviour on plaque structure and growth. We find that high rates of cell death relative to efferocytic uptake results in a plaque populated mostly by dead cells. We also find that emigration can potentially slow or halt plaque growth by allowing material to exit the plaque, but this is contingent on the availability of live macrophage foam cells in the deep plaque. Finally, we introduce an additional bead species to model macrophage tagging via microspheres, and we use the extended model to explore how high rates of cell death and low rates of efferocytosis and emigration prevent the clearance of macrophages from the plaque.