title: On High Dimensional Behaviour of Some Two-Sample Tests Based on Ball Divergence

abstract: In this article, we propose some two-sample tests based on ball divergence and investigate their high dimensional behavior. First, we study their behavior for High Dimension, Low Sample Size (HDLSS) data, and under appropriate regularity conditions, we establish their consistency in the HDLSS regime, where the dimension of the data grows to infinity while the sample sizes from the two distributions remain fixed. Further, we show that these conditions can be relaxed when the sample sizes also increase with the dimension, and in such cases, consistency can be proved even for shrinking alternatives. We use a simple example involving two normal distributions to prove that even when there are no consistent tests in the HDLSS regime, the powers of the proposed tests can converge to unity if the sample sizes increase with the dimension at an appropriate rate. This rate is obtained by establishing the minimax rate optimality of our tests over a certain class of alternatives. Several simulated and benchmark data sets are analyzed to compare the performance of these proposed tests with the state-of-the-art methods that can be used for testing the equality of two high-dimensional probability distributions.


title: Optimized Symbolic Interval Propagation for Neural Network Verification

abstract: Neural networks are increasingly applied in safety critical domains, their verification thus is gaining importance. A large class of recent algorithms for proving input-output relations of feed-forward neural networks are based on linear relaxations and symbolic interval propagation. However, due to variable dependencies, the approximations deteriorate with increasing depth of the network. In this paper we present DPNeurifyFV, a novel branch-and-bound solver for ReLU networks with low dimensional input-space that is based on symbolic interval propagation with fresh variables and input-splitting. A new heuristic for choosing the fresh variables allows to ameliorate the dependency problem, while our novel splitting heuristic, in combination with several other improvements, speeds up the branch-and-bound procedure. We evaluate our approach on the airborne collision avoidance networks ACAS Xu and demonstrate runtime improvements compared to state-of-the-art tools.


title: Biomedical image analysis competitions: The state of current participation practice

abstract: The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis, we designed an international survey that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences (80 competitions in total). The survey covered participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics. A median of 72% challenge participants took part in the survey. According to our results, knowledge exchange was the primary incentive (70%) for participation, while the reception of prize money played only a minor role (16%). While a median of 80 working hours was spent on method development, a large portion of participants stated that they did not have enough time for method development (32%). 25% perceived the infrastructure to be a bottleneck. Overall, 94% of all solutions were deep learning-based. Of these, 84% were based on standard architectures. 43% of the respondents reported that the data samples (e.g., images) were too large to be processed at once. This was most commonly addressed by patch-based training (69%), downsampling (37%), and solving 3D analysis tasks as a series of 2D tasks. K-fold cross-validation on the training set was performed by only 37% of the participants and only 50% of the participants performed ensembling based on multiple identical models (61%) or heterogeneous models (39%). 48% of the respondents applied postprocessing steps.


title: On self-similar singularity formation for the binormal flow

abstract: The aim of this article is to establish a concise proof for a stability result of self-similar solutions of the binormal flow, in some more restrictive cases than in [5]. This equation, also known as the Local Induction Approximation, is a standard model for vortex filament dynamics, and its self-similar solution describes the formation of a corner singularity on the filament. Our approach strongly uses the link that Hasimoto pointed out in 1972 between the solution of the binormal flow and the one of the 1-D cubic Schr\"odinger equation, as well as the existence results associated to the latter.


title: Audio-based AI classifiers show no evidence of improved COVID-19 screening over simple symptoms checkers

abstract: Recent work has reported that AI classifiers trained on audio recordings can accurately predict severe acute respiratory syndrome coronavirus 2 (SARSCoV2) infection status. Here, we undertake a large scale study of audio-based deep learning classifiers, as part of the UK governments pandemic response. We collect and analyse a dataset of audio recordings from 67,842 individuals with linked metadata, including reverse transcription polymerase chain reaction (PCR) test outcomes, of whom 23,514 tested positive for SARS CoV 2. Subjects were recruited via the UK governments National Health Service Test-and-Trace programme and the REal-time Assessment of Community Transmission (REACT) randomised surveillance survey. In an unadjusted analysis of our dataset AI classifiers predict SARS-CoV-2 infection status with high accuracy (Receiver Operating Characteristic Area Under the Curve (ROCAUC) 0.846 [0.838, 0.854]) consistent with the findings of previous studies. However, after matching on measured confounders, such as age, gender, and self reported symptoms, our classifiers performance is much weaker (ROC-AUC 0.619 [0.594, 0.644]). Upon quantifying the utility of audio based classifiers in practical settings, we find them to be outperformed by simple predictive scores based on user reported symptoms.


title: Statistical Design and Analysis for Robust Machine Learning: A Case Study from COVID-19

abstract: Since early in the coronavirus disease 2019 (COVID-19) pandemic, there has been interest in using artificial intelligence methods to predict COVID-19 infection status based on vocal audio signals, for example cough recordings. However, existing studies have limitations in terms of data collection and of the assessment of the performances of the proposed predictive models. This paper rigorously assesses state-of-the-art machine learning techniques used to predict COVID-19 infection status based on vocal audio signals, using a dataset collected by the UK Health Security Agency. This dataset includes acoustic recordings and extensive study participant meta-data. We provide guidelines on testing the performance of methods to classify COVID-19 infection status based on acoustic features and we discuss how these can be extended more generally to the development and assessment of predictive methods based on public health datasets.


title: Textbook myths about early atomic models

abstract: Most physics textbooks at college and university level introduce quantum physics in a historical context. However, the textbook version of this history does not match the actual history. In this article, the first in a series of articles looking at the textbook description of the quantum history, we follow an exceptional student through her endeavors to understand the early atomic models that led up to the work of Niels Bohr. We experience her disappointment when she discovers that the description of the famous atomic model by Thomson, is a mere caricature with almost no trace of Thomson's work and that the supposedly important radiative instability of Rutherford's atoms, is not there at all; how could it be? Rutherford did not even discuss the motion of the electrons. These flaws in the narrative are not just cosmetic inaccuracies, the main narrative is centered around claims that are simply wrong or non-existent in the real story and thus rendering the whole telling mere fiction. We as a physics community should do better.


title: Reduced ITO for Transparent Superconducting Electronics

abstract: Absorption of light in superconducting electronics is a major limitation on the quality of circuit architectures that integrate optical components with superconducting components. A 10 nm thick film of a typical superconducting material like niobium can absorb over half of any incident optical radiation. We propose instead using superconductors which are transparent to the wavelengths used elsewhere in the system. In this paper we investigated reduced indium tin oxide (ITO) as a potential transparent superconductor for electronics. We fabricated and characterized superconducting wires of reduced indium tin oxide. We also showed that a $\SI{10}{nm}$ thick film of the material would only absorb about 1 - 20\% of light between 500 - 1700 nm.


title: An infinite family of vector-valued mock theta functions

abstract: We exhibit an infinite family of vector-valued mock theta functions indexed by positive integers coprime to $6$. These are built from specializations of Dyson's rank generating function and related functions studied by Watson, Gordon, and McIntosh. The associated completed harmonic Maass forms transform according to the Weil representation attached to a rank one lattice. This strengthens a 2010 result of Bringmann and Ono and a 2019 result of Garvan.


title: Global strong solutions of the coupled Klein-Gordon-Schr\"{o}dinger equations

abstract: We study the initial-boundary value problem for the coupled Klein-Gordon-Schr\"{o}dinger equations in a domain in $\mathbb R^N$ with $N \leq 4$. Under natural assumptions on the initial data, we prove the existence and uniqueness of global solutions in $H^2 \oplus H^2 \oplus H^1$. The method of the construction of global strong solutions depends on the proof that solutions of regularized systems by the Yosida approximation form a bounded sequence in $H^2 \oplus H^2 \oplus H^1$ and a convergent sequence in $H^1 \oplus H^1 \oplus L^2$. The method of proof is independent of the Brezis-Gallouet technique and a compactness argument.


title: Influence of cumulative damage on synchronization of Kuramoto oscillators on networks

abstract: In this paper, we study the synchronization of identical Kuramoto phase oscillators under cumulative stochastic damage to the edges of networks. We analyze the capacity of coupled oscillators to reach a coherent state from initial random phases. The process of synchronization is a global function performed by a system that gradually changes when the damage weakens individual connections of the network. We explore diverse structures characterized by different topologies. Among these are deterministic networks as a wheel or the lattice formed by the movements of the knight on a chess board, and random networks generated with the Erd\H{o}s-R\'enyi and Barab\'asi-Albert algorithms. In addition, we study the synchronization times of 109 non-isomorphic graphs with six nodes. The synchronization times and other introduced quantities are sensitive to the impact of damage, allowing us to measure the reduction of the capacity of synchronization and classify the effect of damage in the systems under study. This approach is general and paves the way for the exploration of the effect of damage accumulation in diverse dynamical processes in complex systems.


title: An Ethical Trajectory Planning Algorithm for Autonomous Vehicles

abstract: With the rise of AI and automation, moral decisions are being put into the hands of algorithms that were formerly the preserve of humans. In autonomous driving, a variety of such decisions with ethical implications are made by algorithms for behavior and trajectory planning. Therefore, we present an ethical trajectory planning algorithm with a framework that aims at a fair distribution of risk among road users. Our implementation incorporates a combination of five essential ethical principles: minimization of the overall risk, priority for the worst-off, equal treatment of people, responsibility, and maximum acceptable risk. To the best of the authors' knowledge, this is the first ethical algorithm for trajectory planning of autonomous vehicles in line with the 20 recommendations from the EU Commission expert group and with general applicability to various traffic situations. We showcase the ethical behavior of our algorithm in selected scenarios and provide an empirical analysis of the ethical principles in 2000 scenarios. The code used in this research is available as open-source software.


title: Provable Fairness for Neural Network Models using Formal Verification

abstract: Machine learning models are increasingly deployed for critical decision-making tasks, making it important to verify that they do not contain gender or racial biases picked up from training data. Typical approaches to achieve fairness revolve around efforts to clean or curate training data, with post-hoc statistical evaluation of the fairness of the model on evaluation data. In contrast, we propose techniques to \emph{prove} fairness using recently developed formal methods that verify properties of neural network models.Beyond the strength of guarantee implied by a formal proof, our methods have the advantage that we do not need explicit training or evaluation data (which is often proprietary) in order to analyze a given trained model. In experiments on two familiar datasets in the fairness literature (COMPAS and ADULTS), we show that through proper training, we can reduce unfairness by an average of 65.4\% at a cost of less than 1\% in AUC score.


title: Dynamical magnetic fields in heavy-ion collisions

abstract: The magnetic fields in heavy-ion collisions are important ingredients for many interesting phenomena, such as the Chiral Magnetic Effect, Chiral Magnetic Wave, the directed flow $v_1$ of $D^0$ mesons and the splitting of the spin polarization of the $\Lambda$/$\bar{\Lambda}$. Quantitative studies of these phenomena however suffer from limited understanding on the dynamical evolution of these fields in the medium created by the collisions, which remains a critical and challenging problem. The initial magnetic fields from the colliding nuclei decay very fast in the vacuum but their lifetime could be extended through medium response due to electrically conducting quarks and antiquarks. Here we perform a detailed analysis of such medium effect on the dynamical magnetic fields by numerically solving the Maxwell's equations concurrently with the expanding medium described by viscous hydrodynamics, under the assumption of negligible back reaction of the fields on the fluid evolution. Our results suggest a considerable enhancement of late time magnetic fields, the magnitude of which depends sensitively on the fireball expansion as well as the medium electric conductivity both before and during hydrodynamic stage.


title: Nested Gradient Codes for Straggler Mitigation in Distributed Machine Learning

abstract: We consider distributed learning in the presence of slow and unresponsive worker nodes, referred to as stragglers. In order to mitigate the effect of stragglers, gradient coding redundantly assigns partial computations to the worker such that the overall result can be recovered from only the non-straggling workers. Gradient codes are designed to tolerate a fixed number of stragglers. Since the number of stragglers in practice is random and unknown a priori, tolerating a fixed number of stragglers can yield a sub-optimal computation load and can result in higher latency. We propose a gradient coding scheme that can tolerate a flexible number of stragglers by carefully concatenating gradient codes for different straggler tolerance. By proper task scheduling and small additional signaling, our scheme adapts the computation load of the workers to the actual number of stragglers. We analyze the latency of our proposed scheme and show that it has a significantly lower latency than gradient codes.


title: Penalised regression with multiple sources of prior effects

abstract: In many high-dimensional prediction or classification tasks, complementary data on the features are available, e.g. prior biological knowledge on (epi)genetic markers. Here we consider tasks with numerical prior information that provide an insight into the importance (weight) and the direction (sign) of the feature effects, e.g. regression coefficients from previous studies. We propose an approach for integrating multiple sources of such prior information into penalised regression. If suitable co-data are available, this improves the predictive performance, as shown by simulation and application. The proposed method is implemented in the R package `transreg' (https://github.com/lcsb-bds/transreg).


title: The CDF penalty:sparse and quasi unbiased estimation in regression models

abstract: In high-dimensional regression modelling, the number of candidate covariates to be included in the predictor is quite large, and variable selection is crucial. In this work, we propose a new penalty able to guarantee both sparse variable selection, i.e. exactly zero regression coefficient estimates, and quasi-unbiasedness for the coefficients of 'selected' variables in high dimensional regression models. Simulation results suggest that our proposal performs no worse than its competitors while always ensuring that the solution is unique.


title: Semi-Siamese Network for Robust Change Detection Across Different Domains with Applications to 3D Printing

abstract: Automatic defect detection for 3D printing processes, which shares many characteristics with change detection problems, is a vital step for quality control of 3D printed products. However, there are some critical challenges in the current state of practice. First, existing methods for computer vision-based process monitoring typically work well only under specific camera viewpoints and lighting situations, requiring expensive pre-processing, alignment, and camera setups. Second, many defect detection techniques are specific to pre-defined defect patterns and/or print schematics. In this work, we approach the defect detection problem using a novel Semi-Siamese deep learning model that directly compares a reference schematic of the desired print and a camera image of the achieved print. The model then solves an image segmentation problem, precisely identifying the locations of defects of different types with respect to the reference schematic. Our model is designed to enable comparison of heterogeneous images from different domains while being robust against perturbations in the imaging setup such as different camera angles and illumination. Crucially, we show that our simple architecture, which is easy to pre-train for enhanced performance on new datasets, outperforms more complex state-of-the-art approaches based on generative adversarial networks and transformers. Using our model, defect localization predictions can be made in less than half a second per layer using a standard MacBook Pro while achieving an F1-score of more than 0.9, demonstrating the efficacy of using our method for in-situ defect detection in 3D printing.


title: Growing the First Galaxies' Merger Trees

abstract: Modelling the growth histories of specific galaxies often involves generating the entire population of objects that arise in a given cosmology and selecting systems with appropriate properties. This approach is highly inefficient when targeting rare systems such as the extremely luminous high-redshift galaxy candidates detected by JWST. Here, we present a novel framework for generating merger trees with branches that are guaranteed to achieve a desired halo mass at a chosen redshift. This method augments extended Press Schechter theory solutions with constrained random processes known as Brownian bridges and is implemented in the open-source semi-analytic model $\texttt{Galacticus}$. We generate ensembles of constrained merger trees to predict the growth histories of seven high-redshift JWST galaxy candidates, finding that these systems most likely merge $\approx 2~\mathrm{Gyr}$ after the observation epoch and occupy haloes of mass $\gtrsim 10^{14}~M_{\mathrm{\odot}}$ today. These calculations are thousands of times more efficient than existing methods, are analytically controlled, and provide physical insights into the evolution of haloes with rapid early growth. Our constrained merger tree implementation is publicly available at http://github.com/galacticusorg/galacticus.


title: Evolutionary algorithms for multi-center solutions

abstract: Large classes of multi-center supergravity solutions have been constructed in the study of supersymmetric black holes and their microstates. Many smooth multi-center solutions have the same charges as supersymmetric black holes, with all centers deep inside a long black-hole-like throat. These configurations are constrained by regularity, absence of closed timelike curves, and charge quantization. Due to these constraints, constructing explicit solutions with several centers in generic arrangements, and with all parameters in physically relevant ranges, is a hard task. In this work we present an optimization algorithm, based on evolutionary algorithms and Bayesian optimization, that systematically constructs numerical solutions satisfying all constraints. We exhibit explicit examples of novel five-center and seven-center machine-precision solutions.


title: Rethinking Cooking State Recognition with Vision Transformers

abstract: To ensure proper knowledge representation of the kitchen environment, it is vital for kitchen robots to recognize the states of the food items that are being cooked. Although the domain of object detection and recognition has been extensively studied, the task of object state classification has remained relatively unexplored. The high intra-class similarity of ingredients during different states of cooking makes the task even more challenging. Researchers have proposed adopting Deep Learning based strategies in recent times, however, they are yet to achieve high performance. In this study, we utilized the self-attention mechanism of the Vision Transformer (ViT) architecture for the Cooking State Recognition task. The proposed approach encapsulates the globally salient features from images, while also exploiting the weights learned from a larger dataset. This global attention allows the model to withstand the similarities between samples of different cooking objects, while the employment of transfer learning helps to overcome the lack of inductive bias by utilizing pretrained weights. To improve recognition accuracy, several augmentation techniques have been employed as well. Evaluation of our proposed framework on the `Cooking State Recognition Challenge Dataset' has achieved an accuracy of 94.3%, which significantly outperforms the state-of-the-art.


title: Spectral Current Density and Responsivity Scaling for Fourier Transform Photocurrent Spectroscopy

abstract: We propose and experimentally verify two methods to scale arbitrary units to photocurrent spectral density (A/eV) in Fourier Transform Photocurrent (FTPC) spectroscopy. We also propose the FTPC scaling to responsivity (A/W), provided a narrow-band optical power measurement is available. The constant background of the interferogram provides a precise determination of the photocurrent spectral density. The second method relies on the scaled amplitude of the interferogram. Although the latter method leads to more significant errors, it still provides good order of magnitude estimates of the total photocurrent. We demonstrate the technique on a calibrated InGaAs diode and weak responsivity SiC interdigital sensors. We identify a series of impurity-band and interband transitions in the SiC sensors.

categories: cond-mat.mtrl-sci physics.app-ph physics.ins-det physics.optics


title: Multi-channel ALOHA and CSMA medium-access protocols: Markovian description and large deviations

abstract: We consider a multi-channel communication system under ALOHA and CSMA protocols, resepctively, in continuous time. We derive probabilistic formulas for the most important quantities: the numbers of sending attempts and the number of successfully delivered messages in a given time interval. We derive (1) explicit formulas for the large-time limiting throughput, (2) introduce an explicit and ergodic Markov chain for a deeper probabilistic analysis, and use this to (3) derive exponential asymptotics for rare events for these quantities in the limit of large time, via large-deviation principles.


title: Data-Driven Model Reduction by Two-Sided Moment Matching

abstract: In this brief paper, we propose a time-domain data-driven method for model order reduction by two-sided moment matching for linear systems. An algorithm that asymptotically approximates the matrix product $\Upsilon \Pi$ from time-domain samples of the so-called two-sided interconnection is provided. Exploiting this estimated matrix, we determine the unique reduced-order model of order $\nu$, which asymptotically matches the moments at $2 \nu$ distinct interpolation points. Furthermore, we discuss the impact that certain disturbances and data distortions may have on the algorithm. Finally, we illustrate the use of the proposed methodology by means of a benchmark model.


title: Spin excitations in the kagome-lattice metallic antiferromagnet Fe$_{0.89}$Co$_{0.11}$Sn

abstract: Kagome-lattice materials have attracted tremendous interest due to the broad prospect for seeking superconductivity, quantum spin liquid states, and topological electronic structures. Among them, the transition-metal kagome lattices are high-profile objects for the combination of topological properties, rich magnetism, and multiple-orbital physics. Here we report an inelastic neutron scattering study on the spin dynamics of a kagome-lattice antiferromagnetic metal Fe$_{0.89}$Co$_{0.11}$Sn. Although the magnetic excitations can be observed up to $\sim$250 meV, well-defined spin waves are only identified below $\sim$90 meV and can be modeled using Heisenberg exchange with ferromagnetic in-plane nearest-neighbor coupling $J_1$, in-plane next-nearest-neighbor coupling $J_2$, and antiferromagnetic (AFM) interlayer coupling $J_c$ under linear spin-wave theory. Above $\sim$90 meV, the spin waves enter the itinerant Stoner continuum and become highly damped particle-hole excitations. At the K point of the Brillouin zone, we reveal a possible band crossing of the spin wave, which indicates a potential Dirac magnon. Our results uncover the evolution of the spin excitations from the planar AFM state to the axial AFM state in Fe$_{0.89}$Co$_{0.11}$Sn, solve the magnetic Hamiltonian for both states, and confirm the significant influence of the itinerant magnetism on the spin excitations.


title: Performance and control strategy of an integrated tunable laser with a single intra-cavity AMZI filter

abstract: Asymmetric Mach-Zehnder interferometers (AMZIs) can, in principle, enable continuous wavelength tuning of a laser when used as an intra-cavity filter. Their simplicity and good compatibility with generic foundry platforms are major advantages. However, the difficulty to develop a well-defined and robust control strategy is an important drawback which restricts the use-cases of these tunable lasers. Here, we make an in-depth investigation of the tunability properties of a laser including a single-stage AMZI in its cavity. We find that due to imperfections of Electro-Optic Phase Modulators (EOPMs), the dependence of the phase variation with the applied voltage is not linear. Because integrated EOPMs cannot be individually calibrated, these nonlinearities prevent a precise and independent tuning of the phase and amplitude of the AMZI transfer function, and thus continuous tuning cannot be reliably achieved. To overcome this issue, we propose a refined control strategy which allows for semi-continuous tuning. With this approach, we demonstrate a piece-wise continuous tuning of the emission wavelength by taking advantage of the coupling between amplitude and phase in the AMZI response. With our refined control strategy, we achieve tuning of the emission wavelength over the full free spectral range (FSR) of the AMZI.


title: On the Convergence of Random Fourier--Jacobi Series in $L_{[-1,1]}^{p,(\eta,\tau)}$ space

abstract: Liu and Liu introduced the random Fourier transform, which is a random Fourier series in Hermite functions, and applied it to image encryption and decryption. They expected its applications in optics and information technology. These motivated us to look into random Fourier series in orthogonal polynomials. Recently, we have established the convergence of random Fourier--Jacobi series $\sum\limits_{n=0}^\infty d_n r_n(\omega)\varphi_n(y),$ where $\varphi_n(y)$ are the orthonormal Jacobi polynomials $p_n^{(\gamma,\delta)}(y),$ $r_n(\omega)$ are random variables associated with stochastic processes like the Wiener process, the symmetric stable process, and the scalars $d_n$ are the Fourier--Jacobi coefficients of functions in some classes of continuous functions. It is observed that the mode of convergence of the random series depends on the choice of the scalars $d_n$ and the stochastic processes. In this article, we have investigated the scalars $d_n,$ which are chosen to be the Fourier--Jacobi coefficients of functions in some weighted $L_{[-1,1]}^{p,(\eta,\tau )}$ spaces, so that the random series converges. Further, the continuity property of the sum functions is studied.


title: A framework to generate hypergraphs with community structure

abstract: In recent years hypergraphs have emerged as a powerful tool to study systems with multi-body interactions which cannot be trivially reduced to pairs. While highly structured methods to generate synthetic data have proved fundamental for the standardized evaluation of algorithms and the statistical study of real-world networked data, these are scarcely available in the context of hypergraphs. Here we propose a flexible and efficient framework for the generation of hypergraphs with many nodes and large hyperedges, which allows specifying general community structures and tune different local statistics. We illustrate how to use our model to sample synthetic data with desired features (assortative or disassortative communities, mixed or hard community assignments, etc.), analyze community detection algorithms, and generate hypergraphs structurally similar to real-world data. Overcoming previous limitations on the generation of synthetic hypergraphs, our work constitutes a substantial advancement in the statistical modeling of higher-order systems.


title: Call-By-Name Is Just Call-By-Value with Delimited Control

abstract: Delimited control operator shift0 exhibits versatile capabilities: it can express layered monadic effects, or equivalently, algebraic effects. Little did we know it can express lambda calculus too! We present $ \Lambda_\$ $, a call-by-value lambda calculus extended with shift0 and control delimiter $ \$ $ with carefully crafted reduction theory, such that the lambda calculus with beta and eta reductions can be isomorphically embedded into $ \Lambda_\$ $ via a right inverse of a continuation-passing style translation. While call-by-name reductions of lambda calculus can trivially simulate its call-by-value version, we show that addition of shift0 and $ \$ $ is the golden mean of expressive power that suffices to simulate beta and eta reductions while still admitting a simulation back. As a corollary, calculi $ \Lambda\mu_v $, $ \lambda_\$ $, $ \Lambda_\$ $ and $ \lambda $ all correspond equationally.


title: Semiclassical Dynamics of Hawking Radiation

abstract: We consider gravity in 3+1 spacetime dimensions coupled to $N$ scalar matter fields in a semiclassical limit where $N\to\infty$. The dynamical evolution of a black hole including the back-reaction of the Hawking radiation on the metric is formulated as an initial value problem. The quantum stress energy tensor is evaluated using a point splitting regularization along spacelike geodesics. To account for the quantum entanglement of the matter fields, they are treated as a set of bilocal collective fields defined on spacelike hypersurfaces. The resulting semiclassical field equations include terms up to fourth order in derivatives that can be treated in a perturbative $\hbar$ expansion. The formulation we arrive at should be amenable to numerical simulation of time dependent semiclassical spacetime.


title: De-risking Carbon Capture and Sequestration with Explainable CO2 Leakage Detection in Time-lapse Seismic Monitoring Images

abstract: With the growing global deployment of carbon capture and sequestration technology to combat climate change, monitoring and detection of potential CO2 leakage through existing or storage induced faults are critical to the safe and long-term viability of the technology. Recent work on time-lapse seismic monitoring of CO2 storage has shown promising results in its ability to monitor the growth of the CO2 plume from surface recorded seismic data. However, due to the low sensitivity of seismic imaging to CO2 concentration, additional developments are required to efficiently interpret the seismic images for leakage. In this work, we introduce a binary classification of time-lapse seismic images to delineate CO2 plumes (leakage) using state-of-the-art deep learning models. Additionally, we localize the leakage region of CO2 plumes by leveraging Class Activation Mapping methods.

categories: physics.geo-ph cs.AI cs.CV cs.NA math.NA


title: Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Better

abstract: While the problem of hallucinations in neural machine translation has long been recognized, so far the progress on its alleviation is very little. Indeed, recently it turned out that without artificially encouraging models to hallucinate, previously existing methods fall short and even the standard sequence log-probability is more informative. It means that characteristics internal to the model can give much more information than we expect, and before using external models and measures, we first need to ask: how far can we go if we use nothing but the translation model itself ? We propose to use a method that evaluates the percentage of the source contribution to a generated translation. Intuitively, hallucinations are translations "detached" from the source, hence they can be identified by low source contribution. This method improves detection accuracy for the most severe hallucinations by a factor of 2 and is able to alleviate hallucinations at test time on par with the previous best approach that relies on external models. Next, if we move away from internal model characteristics and allow external tools, we show that using sentence similarity from cross-lingual embeddings further improves these results.


title: Fock space representations of Bogolyubov transformations as spin representations

abstract: The representation on a Fock space of the group of Bogolyubov transformations is recognized as the spin representation of an orthogonal group. Derivations based on this observation of some known formulas for the overlap amplitude of two Bogolyubov quasi-fermion vacuum states that are in some cases more complete than those in the literature are shown. It is pointed out that the name of an "Onishi formula" is assigned in the literature to two different expressions which are related but have different scopes. One of them has what has been described as a sign problem, the other one, due to Onishi and Yoshida, has a more limited scope and no sign problem. I give a short proof of the latter, whose derivation is missing in the paper by Onishi and Yoshida, and a new, combinatoric, proof of an equivalent formula recently derived by Robledo.


title: Computing Well-Covered Vector Spaces of Graphs using Modular Decomposition

abstract: A graph is well-covered if all its maximal independent sets have the same cardinality. This well studied concept was introduced by Plummer in 1970 and naturally generalizes to the weighted case. Given a graph $G$, a real-valued vertex weight function $w$ is said to be a well-covered weighting of $G$ if all its maximal independent sets are of the same weight. The set of all well-covered weightings of a graph $G$ forms a vector space over the field of real numbers, called the well-covered vector space of $G$. Since the problem of recognizing well-covered graphs is $\mathsf{co}$-$\mathsf{NP}$-complete, the problem of computing the well-covered vector space of a given graph is $\mathsf{co}$-$\mathsf{NP}$-hard. Levit and Tankus showed in 2015 that the problem admits a polynomial-time algorithm in the class of claw-free graph. In this paper, we give two general reductions for the problem, one based on anti-neighborhoods and one based on modular decomposition, combined with Gaussian elimination. Building on these results, we develop a polynomial-time algorithm for computing the well-covered vector space of a given fork-free graph, generalizing the result of Levit and Tankus. Our approach implies that well-covered fork-free graphs can be recognized in polynomial time and also generalizes some known results on cographs.


title: Buffering variability in cell regulation motifs close to criticality

abstract: Bistable biological regulatory systems need to cope with stochastic noise to fine-tune their function close to bifurcation points. Here, we study stability properties of this regime in generic systems to demonstrate that cooperative interactions buffer system variability, hampering noise-induced regime shifts. Our analysis also shows that, in the considered cooperativity range, impending regime shifts can be generically detected by statistical early warning signals from distributional data. Our generic framework, based on minimal models, can be used to extract robustness and variability properties of more complex models and empirical data close to criticality.


title: Source Tracing: Detecting Voice Spoofing

abstract: Recent anti-spoofing systems focus on spoofing detection, where the task is only to determine whether the test audio is fake. However, there are few studies putting attention to identifying the methods of generating fake speech. Common spoofing attack algorithms in the logical access (LA) scenario, such as voice conversion and speech synthesis, can be divided into several stages: input processing, conversion, waveform generation, etc. In this work, we propose a system for classifying different spoofing attributes, representing characteristics of different modules in the whole pipeline. Classifying attributes for the spoofing attack other than determining the whole spoofing pipeline can make the system more robust when encountering complex combinations of different modules at different stages. In addition, our system can also be used as an auxiliary system for anti-spoofing against unseen spoofing methods. The experiments are conducted on ASVspoof 2019 LA data set and the proposed method achieved a 20\% relative improvement against conventional binary spoof detection methods.


title: Stabilizing complex Langevin for real-time gauge theories with an anisotropic kernel

abstract: The complex Langevin (CL) method is a promising approach to overcome the sign problem that occurs in real-time formulations of quantum field theories. Using the Schwinger-Keldysh formalism, we study SU($N_c$) gauge theories with CL. We observe that current stabilization techniques are insufficient to obtain correct results. Therefore, we revise the discretization of the CL equations on complex time contours, find a time reflection symmetric formulation and introduce a novel anisotropic kernel that enables CL simulations on discretized complex time paths. Applying it to SU(2) Yang-Mills theory in 3+1 dimensions, we obtain unprecedentedly stable results that we validate using additional observables and that can be systematically improved. For the first time, we are able to simulate non-Abelian gauge theory on time contours whose real-time extent exceeds its inverse temperature. Thus, our approach may pave the way towards an ab-initio real-time framework of QCD in and out of equilibrium with a potentially large impact on the phenomenology of heavy-ion collisions.


title: Four-dimensional SO(3)-spherically symmetric Berwald Finsler spaces

abstract: We locally classify all SO(3)-invariant 4-dimensional pseudo-Finsler Berwald structures. These are Finslerian geometries which are closest to (spatially, or SO(3))-spherically symmetric pseudo-Riemannian ones - and serve as ansatz to find solutions of Finsler gravity equations which generalize the Einstein equations. We find that there exist six classes of non pseudo-Riemannian (i.e., non-quadratic in the velocities) SO(3)-spherically symmetric pseudo-Finsler Berwald functions, which have either: a power law, an exponential law, or a one- or two-variable dependence on the velocities.


title: Planning Visual-Tactile Precision Grasps via Complementary Use of Vision and Touch

abstract: Reliably planning fingertip grasps for multi-fingered hands lies as a key challenge for many tasks including tool use, insertion, and dexterous in-hand manipulation. This task becomes even more difficult when the robot lacks an accurate model of the object to be grasped. Tactile sensing offers a promising approach to account for uncertainties in object shape. However, current robotic hands tend to lack full tactile coverage. As such, a problem arises of how to plan and execute grasps for multi-fingered hands such that contact is made with the area covered by the tactile sensors. To address this issue, we propose an approach to grasp planning that explicitly reasons about where the fingertips should contact the estimated object surface while maximizing the probability of grasp success. Key to our method's success is the use of visual surface estimation for initial planning to encode the contact constraint. The robot then executes this plan using a tactile-feedback controller that enables the robot to adapt to online estimates of the object's surface to correct for errors in the initial plan. Importantly, the robot never explicitly integrates object pose or surface estimates between visual and tactile sensing, instead it uses the two modalities in complementary ways. Vision guides the robots motion prior to contact; touch updates the plan when contact occurs differently than predicted from vision. We show that our method successfully synthesises and executes precision grasps for previously unseen objects using surface estimates from a single camera view. Further, our approach outperforms a state of the art multi-fingered grasp planner, while also beating several baselines we propose.


title: Polyadic rings of $p$-adic integers

abstract: In this note we, first, recall that the sets of all representatives of some special ordinary residue classes become $\left( m,n\right) $-rings. Second, we introduce a possible $p$-adic analog of the residue class modulo a $p$-adic integer. Then, we find the relations which determine, when the representatives form a $\left( m,n\right) $-ring. At the very short spacetime scales such rings could lead to new symmetries of modern particle models.


title: Extensions of special 3-fields

abstract: We investigate finite field extensions of the unital 3-field, consisting of the unit element alone, and find considerable differences to classical field theory. Furthermore, the structure of their automorphism groups is clarified and the respective subfields are determined. In an attempt to better understand the structure of 3-fields that show up here we look at ways in which new unital 3-fields can be obtained from known ones in terms of product structures, one of them the Cartesian product which has no analogue for binary fields.


title: MURMUR: Modular Multi-Step Reasoning for Semi-Structured Data-to-Text Generation

abstract: Prompting large language models has enabled significant recent progress in multi-step reasoning over text. However, when applied to text generation from semi-structured data (e.g., graphs or tables), these methods typically suffer from low semantic coverage, hallucination, and logical inconsistency. We propose MURMUR, a neuro-symbolic modular approach to text generation from semi-structured data with multi-step reasoning. MURMUR is a best-first search method that generates reasoning paths using: (1) neural and symbolic modules with specific linguistic and logical skills, (2) a grammar whose production rules define valid compositions of modules, and (3) value functions that assess the quality of each reasoning step. We conduct experiments on two diverse data-to-text generation tasks like WebNLG and LogicNLG. These tasks differ in their data representations (graphs and tables) and span multiple linguistic and logical skills. MURMUR obtains significant improvements over recent few-shot baselines like direct prompting and chain-of-thought prompting, while also achieving comparable performance to fine-tuned GPT-2 on out-of-domain data. Moreover, human evaluation shows that MURMUR generates highly faithful and correct reasoning paths that lead to 26% more logically consistent summaries on LogicNLG, compared to direct prompting.


title: Non-Invertible Defects in Nonlinear Sigma Models and Coupling to Topological Orders

abstract: Nonlinear sigma models appear in a wide variety of physics contexts, such as the long-range order with spontaneously broken continuous global symmetries. There are also large classes of quantum criticality admit sigma model descriptions in their phase diagrams without known ultraviolet complete quantum field theory descriptions. We investigate defects in general nonlinear sigma models in any spacetime dimensions, which include the "electric" defects that are characterized by topological interactions on the defects, and the "magnetic" defects that are characterized by the isometries and homotopy groups. We use an analogue of the charge-flux attachment to show that the magnetic defects are in general non-invertible, and the electric and magnetic defects form junctions that combine defects of different dimensions into analogues of higher-group symmetry. We explore generalizations that couple nonlinear sigma models to topological quantum field theories by defect attachment, which modifies the non-invertible fusion and braiding of the defects. We discuss several applications, including constraints on energy scales and scenarios of low energy dynamics with spontaneous symmetry breaking in gauge theories, and axion gauge theories.


title: Classically Simulating Quantum Supremacy IQP Circuits through a Random Graph Approach

abstract: Quantum Supremacy is a demonstration of a computation by a quantum computer that can not be performed by the best classical computer in a reasonable time. A well-studied approach to demonstrating this on near-term quantum computers is to use random circuit sampling. It has been suggested that a good candidate for demonstrating quantum supremacy with random circuit sampling is to use \emph{IQP circuits}. These are quantum circuits where the unitary it implements is diagonal. In this paper we introduce improved techniques for classically simulating random IQP circuits. We find a simple algorithm to calculate an amplitude of an $n$-qubit IQP circuit with dense random two-qubit interactions in time $O(\frac{\log^2 n}{n} 2^n )$, which for sparse circuits (where each qubit interacts with $O(\log n)$ other qubits) runs in $o(2^n/\text{poly}(n))$ for any given polynomial. Using a more complicated stabiliser decomposition approach we improve the algorithm for dense circuits to $O\left(\frac{(\log n)^{4-\beta}}{n^{2-\beta}} 2^n \right)$ where $\beta \approx 0.396$. We benchmarked our algorithm and found that we can simulate up to 50-qubit circuits in a couple of minutes on a laptop. We estimate that 70-qubit circuits are within reach for a large computing cluster.


title: Huruf: An Application for Arabic Handwritten Character Recognition Using Deep Learning

abstract: Handwriting Recognition has been a field of great interest in the Artificial Intelligence domain. Due to its broad use cases in real life, research has been conducted widely on it. Prominent work has been done in this field focusing mainly on Latin characters. However, the domain of Arabic handwritten character recognition is still relatively unexplored. The inherent cursive nature of the Arabic characters and variations in writing styles across individuals makes the task even more challenging. We identified some probable reasons behind this and proposed a lightweight Convolutional Neural Network-based architecture for recognizing Arabic characters and digits. The proposed pipeline consists of a total of 18 layers containing four layers each for convolution, pooling, batch normalization, dropout, and finally one Global average pooling and a Dense layer. Furthermore, we thoroughly investigated the different choices of hyperparameters such as the choice of the optimizer, kernel initializer, activation function, etc. Evaluating the proposed architecture on the publicly available 'Arabic Handwritten Character Dataset (AHCD)' and 'Modified Arabic handwritten digits Database (MadBase)' datasets, the proposed model respectively achieved an accuracy of 96.93% and 99.35% which is comparable to the state-of-the-art and makes it a suitable solution for real-life end-level applications.


title: Fermions on curved backgrounds of matrix models

abstract: We discuss the propagation of fermions on generic, curved branes in IKKT-type matrix models. The Dirac operator can be understood either in terms of a Weitzenb\"ock connection, or in terms of the Levi-Civita connection with extra torsion term. We discuss in detail the coupling of spin to the background geometry using the JWKB approximation. Despite the absence of local Lorentz invariance in the underlying IKKT framework, our results agree with the expectations of Einstein-Cartan theory, and differ from general relativity only by an extra coupling to the totally antisymmetric part of the torsion. The case of FLRW cosmic background solutions is discussed as a special case.


title: Thermal expansion and the glass transition

abstract: Melting is well understood in terms of the Lindemann criterion, essentially stating that crystalline materials melt when the thermal vibrations of their atoms become such vigorous that they shake themselves free of the binding forces. However, how about another common type of solids: glasses, where the nature of the solid-liquid crossover is highly controversial? The Lindemann criterion implies that the thermal expansion coefficients alpha of crystals are inversely proportional to their melting temperatures. Here we find that, unexpectedly, alpha of glasses decreases much stronger with increasing glass-transition temperature Tg marking the liquid-solid crossover in this material class. However, scaling alpha by the fragility m, a measure of particle cooperativity, restores the proportionality, i.e., alpha/m ~ 1/Tg. Obviously, for a glass to become liquid, it is not sufficient to simply overcome the interparticle binding energies. Instead, more energy has to be invested to break up the typical cooperative particle network which is considered a hallmark feature of glassy materials. Surprisingly, alpha of the liquid phase reveals similar anomalous behaviour and is universally enhanced by a constant factor of ~3. The found universalities allow estimating glass-transition temperatures from thermal expansion and vice versa.


title: Atrous Space Bender U-Net (ASBU-Net/LogiNet)

abstract: $ $With recent advances in CNNs, exceptional improvements have been made in semantic segmentation of high resolution images in terms of accuracy and latency. However, challenges still remain in detecting objects in crowded scenes, large scale variations, partial occlusion, and distortions, while still maintaining mobility and latency. We introduce a fast and efficient convolutional neural network, ASBU-Net, for semantic segmentation of high resolution images that addresses these problems and uses no novelty layers for ease of quantization and embedded hardware support. ASBU-Net is based on a new feature extraction module, atrous space bender layer (ASBL), which is efficient in terms of computation and memory. The ASB layers form a building block that is used to make ASBNet. Since this network does not use any special layers it can be easily implemented, quantized and deployed on FPGAs and other hardware with limited memory. We present experiments on resource and accuracy trade-offs and show strong performance compared to other popular models.


title: Resonantly enhanced interatomic Coulombic electron capture in a system of three atoms

abstract: In interatomic Coulombic electron capture, the capture of a free electron at an atomic center is accompanied by the radiationless transfer of the excess energy to a neighboring atom of different species, leading to ionization of the latter. We show that this interatomic process can be strongly enhanced by the presence of an additional third atom, provided the energy of the free-bound capture transition in the first atom is resonant to a dipole-allowed excitation energy in this assisting atom. The relation of the resonantly enhanced three-center electron capture with other processes is discussed, and its dependencies on the incident electron energy and the spatial geometry of the triatomic system are illustrated.


title: A smooth transition autoregressive model for matrix-variate time series

abstract: In many applications, data are observed as matrices with temporal dependence. Matrix-variate time series modeling is a new branch of econometrics. Although stylized facts in several fields, the existing models do not account for regime switches in the dynamics of matrices that are not abrupt. In this paper, we extend linear matrix-variate autoregressive models by introducing a regime-switching model capable of accounting for smooth changes, the matrix smooth transition autoregressive model. We present the estimation processes with the asymptotic properties demonstrated with simulated and real data.


title: Translating Social Media Crisis Narratives into Road Network Utilization Metrics: The Case of 2020 Oklahoma Ice Storm

abstract: Risk communication in times of disasters is complex, involving rapid and diverse communication in social networks (i.e., public and/or private agencies; local residents) as well as limited mobilization capacity and operational constraints of physical infrastructure networks. Despite a growing literature on infrastructure interdependencies and co-dependent social-physical systems, an in-depth understanding of how risk communication in online social networks weighs into physical infrastructure networks during a major disaster remains limited, let alone in compounding risk events. This study analyzes large-scale datasets of crisis mobility and activity-related social interactions and concerns available through social media (Twitter) for communities that were impacted by an ice storm (Oct. 2020) in Oklahoma. Compounded by the COVID-19 pandemic, Oklahoma residents faced this historic ice storm (Oct. 26, 2020-Oct. 29, 2020) that caused devastating traffic impacts (among others) due to excessive ice accumulation. By using the recently released academic Application Programming Interface (API) by Twitter that provides complete and unbiased data, geotagged tweets (approx. 210K) were collected covering the entire state of Oklahoma, and ice storm-related tweets (approx. 14.2K) were considered. First, the study uses natural language processing and text quantification techniques to translate crisis narratives (i.e., tweets). Next, geo-tagged tweets are mapped into co-located road networks using traditional GIS techniques. Finally, insights are generated using network science theories and quantified social narratives to interpret different elements of road networks (e.g., local roads, freeways, etc.) for the Oklahoma communities that were impacted by the ice storm event during the pandemic.


title: A smoking gun from the power spectrum dipole for elastic interactions in the dark sector

abstract: Models with pure momentum exchange in the dark sector have been shown to provide a promising scenario to tackle the tension in the clustering inferred from high- and low-redshift probes. A distinctive feature of these models is that only the Euler equation for the dark matter component is modified and the correction is such that the net effect can be associated to an additional friction determined by the interaction rate. In this work, we show that the strength of the interaction parameter needed to resolve the $\sigma_8$ tension could be detected from the dipole of the matter power spectrum that is expected to be measured in upcoming surveys.


title: Fine properties of symmetric and positive matrix fields with bounded divergence

abstract: This paper is concerned with various fine properties of the functional \[ \mathbb{D}(A) = \int_{\mathbb{T}^n}{\text{det}}^\frac{1}{n-1}(A(x))\,dx \] introduced in [33]. This functional is defined on $X_p$, which is the cone of matrix fields $A \in L^p(\mathbb{T}^n;\text{Sym}^+(n))$ with $\text{div }(A)$ a bounded measure. We start by correcting a mistake we noted in our [13, Corollary 7], which concerns the upper semicontinuity of $\mathbb{D}(A)$ in $X_p$. We give a proof of a refined correct statement, and we will use it to study the behaviour of $\mathbb{D}(A)$ when $A \in X_\frac{n}{n-1}$, which is the critical integrability for $\mathbb{D}(A)$. One of our main results gives an explicit bound of the measure generated by $\mathbb{D}(A_k)$ for a sequence of such matrix fields $\{A_k\}_k$. In particular it allows us to characterize the upper semicontinuity of $\mathbb{D}(A)$ in the case $A \in X_\frac{n}{n - 1}$ in terms of the measure generated by the variation of $\{\text{div } A_k\}_k$. We show by explicit example that this characterization fails in $X_p$ if $p<\frac{n}{n-1}$. As a by-product of our characterization we also recover and generalize a result of P.-L. Lions [25,26] on the lack of compactness in the study of Sobolev embeddings. Furthermore, in analogy with Monge-Amp\`ere theory, we give sufficient conditions under which $\text{det}^\frac{1}{n-1}(A)$ is Hardy when $A \in X_\frac{n}{n - 1}$, generalising the celebrated result of S. M\"uller [29] when $A=\text{cof } D^2\varphi$, for a convex function $\varphi$.


title: Planting and Mitigating Memorized Content in Predictive-Text Language Models

abstract: Language models are widely deployed to provide automatic text completion services in user products. However, recent research has revealed that language models (especially large ones) bear considerable risk of memorizing private training data, which is then vulnerable to leakage and extraction by adversaries. In this study, we test the efficacy of a range of privacy-preserving techniques to mitigate unintended memorization of sensitive user text, while varying other factors such as model size and adversarial conditions. We test both "heuristic" mitigations (those without formal privacy guarantees) and Differentially Private training, which provides provable levels of privacy at the cost of some model performance. Our experiments show that (with the exception of L2 regularization), heuristic mitigations are largely ineffective in preventing memorization in our test suite, possibly because they make too strong of assumptions about the characteristics that define "sensitive" or "private" text. In contrast, Differential Privacy reliably prevents memorization in our experiments, despite its computational and model-performance costs.


title: POTATO: The Portable Text Annotation Tool

abstract: We present POTATO, the Portable text annotation tool, a free, fully open-sourced annotation system that 1) supports labeling many types of text and multimodal data; 2) offers easy-to-configure features to maximize the productivity of both deployers and annotators (convenient templates for common ML/NLP tasks, active learning, keypress shortcuts, keyword highlights, tooltips); and 3) supports a high degree of customization (editable UI, inserting pre-screening questions, attention and qualification tests). Experiments over two annotation tasks suggest that POTATO improves labeling speed through its specially-designed productivity features, especially for long documents and complex tasks. POTATO is available at https://github.com/davidjurgens/potato and will continue to be updated.


title: Digital Pixel Test Structures implemented in a 65 nm CMOS process

abstract: The ALICE ITS3 (Inner Tracking System 3) upgrade project and the CERN EP R&D on monolithic pixel sensors are investigating the feasibility of the Tower Partners Semiconductor Co. 65 nm process for use in the next generation of vertex detectors. The ITS3 aims to employ wafer-scale Monolithic Active Pixel Sensors thinned down to 20 to 40 um and bent to form truly cylindrical half barrels. Among the first critical steps towards the realisation of this detector is to validate the sensor technology through extensive characterisation both in the laboratory and with in-beam measurements. The Digital Pixel Test Structure (DPTS) is one of the prototypes produced in the first sensor submission in this technology and has undergone a systematic measurement campaign whose details are presented in this article. The results confirm the goals of detection efficiency and non-ionising and ionising radiation hardness up to the expected levels for ALICE ITS3 and also demonstrate operation at +20 C and a detection efficiency of 99% for a DPTS irradiated with a dose of $10^{15}$ 1 MeV n$_{\mathrm{eq}}/$cm$^2$. Furthermore, spatial, timing and energy resolutions were measured at various settings and irradiation levels.


title: Reconfigurable Wearable Antenna for 5G Applications using Nematic Liquid Crystals

abstract: The antenna is one of the key building blocks of many wearable electronic device, and its functions include wireless communications, energy harvesting and radiative wireless power transfer (WPT). In an effort to realise lightweight, autonomous and battery-less wearable devices, we demonstrate a reconfigurable antenna design for 5G wearable applications that require ultra-low driving voltages ($0.4$-$0.6\,$V) and operate over a high frequency range ($3.3$-$3.8\,$GHz). For smart glasses application, previous antenna designs were `fixed' and mounted on the eyeglass frame itself. Here, we demonstrate a reconfigurable design that could be achieved on the lens itself, using an anisotropic liquid crystal (LC) material. We demonstrate how LC alignment and electric field patterns strongly influence the tuning capabilities of these antennas in the gigahertz range and present a smart, reconfigurable spiral antenna system with a LC substrate.


title: Microscopic origin of the entropy of astrophysical black holes

abstract: We construct an infinite family of microstates for black holes in Minkowski spacetime which have effective semiclassical descriptions in terms of collapsing dust shells in the black hole interior. Quantum mechanical wormholes cause these states to have exponentially small, but universal, overlaps. We show that these overlaps imply that the microstates span a Hilbert space of log dimension equal to the event horizon area divided by four times the Newton constant, explaining the statistical origin of the Bekenstein-Hawking entropy.


title: Development of A Real-time POCUS Image Quality Assessment and Acquisition Guidance System

abstract: Point-of-care ultrasound (POCUS) is one of the most commonly applied tools for cardiac function imaging in the clinical routine of the emergency department and pediatric intensive care unit. The prior studies demonstrate that AI-assisted software can guide nurses or novices without prior sonography experience to acquire POCUS by recognizing the interest region, assessing image quality, and providing instructions. However, these AI algorithms cannot simply replace the role of skilled sonographers in acquiring diagnostic-quality POCUS. Unlike chest X-ray, CT, and MRI, which have standardized imaging protocols, POCUS can be acquired with high inter-observer variability. Though being with variability, they are usually all clinically acceptable and interpretable. In challenging clinical environments, sonographers employ novel heuristics to acquire POCUS in complex scenarios. To help novice learners to expedite the training process while reducing the dependency on experienced sonographers in the curriculum implementation, We will develop a framework to perform real-time AI-assisted quality assessment and probe position guidance to provide training process for novice learners with less manual intervention.


title: Bi-$\eta$ and bi-$\lambda$ deformations of $\mathbb{Z}_4$ permutation supercosets

abstract: Integrable string sigma models on AdS$_3$ backgrounds with 16 supersymmetries have the distinguishing feature that their superisometry group is a direct product. As a result the deformation theory of these models is particularly rich since the two supergroups in the product can be deformed independently. We construct bi-$\eta$ and bi-$\lambda$ deformations of two classes of $\mathbb{Z}_4$ permutation supercoset sigma models, which describe sectors of the Green-Schwarz and pure-spinor string worldsheet theories on type II AdS$_3$ backgrounds with pure R-R flux. We discuss an important limit of these models when one supergroup is undeformed. The associated deformed supergravity background should preserve 8 supersymmetries and is expected to have better properties than the full bi-deformation. As a step towards investigating the quantum properties of these models, we study the two-loop RG flow of the bosonic truncation of the bi-$\lambda$ deformation.


title: Hippocampus-Inspired Cognitive Architecture (HICA) for Operant Conditioning

abstract: The neural implementation of operant conditioning with few trials is unclear. We propose a Hippocampus-Inspired Cognitive Architecture (HICA) as a neural mechanism for operant conditioning. HICA explains a learning mechanism in which agents can learn a new behavior policy in a few trials, as mammals do in operant conditioning experiments. HICA is composed of two different types of modules. One is a universal learning module type that represents a cortical column in the neocortex gray matter. The working principle is modeled as Modulated Heterarchical Prediction Memory (mHPM). In mHPM, each module learns to predict a succeeding input vector given the sequence of the input vectors from lower layers and the context vectors from higher layers. The prediction is fed into the lower layers as a context signal (top-down feedback signaling), and into the higher layers as an input signal (bottom-up feedforward signaling). Rewards modulate the learning rate in those modules to memorize meaningful sequences effectively. In mHPM, each module updates in a local and distributed way compared to conventional end-to-end learning with backpropagation of the single objective loss. This local structure enables the heterarchical network of modules. The second type is an innate, special-purpose module representing various organs of the brain's subcortical system. Modules modeling organs such as the amygdala, hippocampus, and reward center are pre-programmed to enable instinctive behaviors. The hippocampus plays the role of the simulator. It is an autoregressive prediction model of the top-most level signal with a loop structure of memory, while cortical columns are lower layers that provide detailed information to the simulation. The simulation becomes the basis for learning with few trials and the deliberate planning required for operant conditioning.


title: Photometric Confirmation and Characterization of the Ennomos Collisional Family in the Jupiter Trojans

abstract: Collisional families offer a unique window into the interior composition of asteroid populations. Previous dynamical studies of the Jupiter Trojans have uncovered a handful of potential collisional families, two of which have been subsequently confirmed through spectral characterization. In this paper, we present new multiband photometric observations of the proposed Ennomos family and derive precise $g-i$ colors of 75 candidate family members. While the majority of the targets have visible colors that are indistinguishable from background objects, we identify 13 objects with closely grouped dynamical properties that have significantly bluer colors. We determine that the true Ennomos collisional family is tightly confined to $a'_{p} > 5.29$ au and $0.45 < \sin{i_{p}} < 0.47$, and the majority of its confirmed members have near-solar spectral slopes, including some of the bluest objects hitherto discovered in the Trojan population. The property of distinctly neutral colors that is shared by both the Ennomos family and the previously characterized Eurybates family indicates that the spectral properties of freshly exposed surfaces in the Jupiter region are markedly different than the surfaces of uncollided Trojans. This implies that the processes of ice sublimation and space weathering at 5.2 au yield a distinct regolith chemistry from the primordial environment within which the Trojans were initially accreted. It also suggests that the Trojans were emplaced in their present-day location from elsewhere sometime after the initial population formed, which is a key prediction of recent dynamical instability models of solar system evolution.


title: On the possibility of measuring the polarization of a ${}^3\rm{He}$ beam at EIC by the HJET polarimeter

abstract: The requirements for hadron polarimetry at the future Electron Ion Collider (EIC) include measurements of the absolute helion (${}^3\text{He}$, $h$) beam polarization with systematic uncertainties better than $\sigma^\text{syst}_P/P\lesssim1\%$. Here, we consider a possibility to utilize the Polarized Atomic Hydrogen Gas Jet Target (HJET) for precision measurement of polarization of the $\sim$100 GeV/n helion beam. HJET, which serves to determine absolute proton beam polarization at the Relativistic Heavy Ion Collider, provides the accuracy of about $\delta^\text{syst}P/P\sim0.5\%$. Potential problems for adapting the HJET method for the EIC helion beam include (i) necessity to know the ratio of $p^\uparrow{h}$ and $h^\uparrow{p}$ analyzing powers $A_\text{N}^{ph}(t)/A_\text{N}^{hp}(t)$ with high precision, ({ii) possible beam ${}^3\text{He}$ breakup, and (iii) operation in a 10 ns bunch spacing beam. Preliminary results of an analysis discussed here indicate that the listed problems can be overcome and the helion beam absolute polarization can be measured by HJET with the required accuracy.


title: Square integrable surface potentials on non-smooth domains and application to the Laplace equation in $L^2$

abstract: Motivated by applications in fluid dynamics involving the harmonic Bergman projection we aim at extending the theory of single and double layer potentials (well documented for functions with $H^1_{\ell oc}$ regularity) to locally square integrable functions. Having in mind numerical simulations in which functions are usually defined on a polygonal mesh, we wish this theory to cover the cases of non-smooth domains (i.e.with Lipschitz continuous or polygonal boundaries).


title: Brauer's Group Equivariant Neural Networks

abstract: We provide a full characterisation of all of the possible group equivariant neural networks whose layers are some tensor power of $\mathbb{R}^{n}$ for three symmetry groups that are missing from the machine learning literature: $O(n)$, the orthogonal group; $SO(n)$, the special orthogonal group; and $Sp(n)$, the symplectic group. In particular, we find a spanning set of matrices for the learnable, linear, equivariant layer functions between such tensor power spaces in the standard basis of $\mathbb{R}^{n}$ when the group is $O(n)$ or $SO(n)$, and in the symplectic basis of $\mathbb{R}^{n}$ when the group is $Sp(n)$.


title: Control and Placement of Finite-Resolution Intelligent Surfaces in IoT Systems with Imperfect CSI

abstract: In this paper, we study the advantages of using reconfigurable intelligent surfaces (RISs) for interference suppression in single-input single-output (SISO) distributed Internet of Things (IoT) networks. Implementing RIS-assisted networks confronts various problems, mostly related to the control and placement of the RIS. To tackle the control-related challenges, we consider noisy and local channel knowledge, based on which we devise algorithms to optimize the potentially distributed RISs to achieve an overall network objective, such as the sum-rate. We use a network with a centralized RIS as a benchmark for our comparisons. We further assume low-bit phase shifters at the RIS to capture real-world hardware limitations. We also study the placement of the RIS and analytically quantify the minimum required degrees-of-control for the RIS as a function of its location to guarantee a specific network performance metric and verify the results via simulations.


title: Enhancing Multi-modal and Multi-hop Question Answering via Structured Knowledge and Unified Retrieval-Generation

abstract: Multi-modal multi-hop question answering involves answering a question by reasoning over multiple input sources from different modalities. Existing methods often retrieve evidences separately and then use a language model to generate an answer based on the retrieved evidences, and thus do not adequately connect candidates and are unable to model the interdependent relations during retrieval. Moreover, the pipelined approaches of retrieval and generation might result in poor generation performance when retrieval performance is low. To address these issues, we propose a Structured Knowledge and Unified Retrieval-Generation (SKURG) approach. SKURG employs an Entity-centered Fusion Encoder to align sources from different modalities using shared entities. It then uses a unified Retrieval-Generation Decoder to integrate intermediate retrieval results for answer generation and also adaptively determine the number of retrieval steps. Extensive experiments on two representative multi-modal multi-hop QA datasets MultimodalQA and WebQA demonstrate that SKURG outperforms the state-of-the-art models in both source retrieval and answer generation performance with fewer parameters. Our code is available at https://github.com/HITsz-TMG/SKURG.


title: Cartographer_glass: 2D Graph SLAM Framework using LiDAR for Glass Environments

abstract: We study algorithms for detecting and including glass objects in an optimization-based Simultaneous Localization and Mapping (SLAM) algorithm in this work. When LiDAR data is the primary exteroceptive sensory input, glass objects are not correctly registered. This occurs as the incident light primarily passes through the glass objects or reflects away from the source, resulting in inaccurate range measurements for glass surfaces. Consequently, the localization and mapping performance is impacted, thereby rendering navigation in such environments unreliable. Optimization-based SLAM solutions, which are also referred to as Graph SLAM, are widely regarded as state of the art. In this paper, we utilize a simple and computationally inexpensive glass detection scheme for detecting glass objects and present the methodology to incorporate the identified objects into the occupancy grid maintained by such an algorithm (Google Cartographer). We develop both local (submap level) and global algorithms for achieving the objective mentioned above and compare the maps produced by our method with those produced by an existing algorithm that utilizes particle filter based SLAM.


title: Diabatic quantum and classical annealing of the Sherrington-Kirkpatrick model

abstract: Quantum annealing is a contender to solve combinatorial optimization problems based on quantum dynamics. While significant efforts have been undertaken to investigate the quality of the solutions and the required runtimes, much less attention has been paid to understanding the dynamics of quantum annealing and the process leading to the solution during the sweep itself. In this comprehensive study, we investigate various aspects of the quantum annealing dynamics using different approaches. We perform quantum annealing, simulated quantum annealing, and classical annealing on several hundred instances of the Sherrington-Kirkpatrick model with intermediate system sizes up to 22 spins using numerical simulations. We observe qualitative differences between the quantum and classical methods, in particular at intermediate times, where a peak in the fidelity, also known as diabatic bump, appears for hard instances. Furthermore, we investigate the two-point correlation functions, which feature differences at intermediate times as well. At short times, however, the methods are similar again, which can be explained by relating the short-time expansion of quantum annealing to a high-temperature expansion, thus allowing in principle to find the classical solution already at short times, albeit at prohibitive sampling cost.


title: Self-Prompting Large Language Models for Zero-Shot Open-Domain QA

abstract: Open-Domain Question Answering (ODQA) aims to answer questions without explicitly providing specific background documents. This task becomes notably challenging in a zero-shot setting where no data is available to train tailored retrieval-reader models. While recent Large Language Models (LLMs) like GPT-3 have demonstrated their effectiveness in zero-shot ODQA using direct prompting methods, these methods still fall short of fully harnessing the potential of LLMs when implicitly invoked. In this paper, we propose a Self-Prompting framework to explicitly utilize the massive knowledge encoded in the parameters of LLMs and their strong instruction understanding abilities. Concretely, we prompt LLMs step by step to generate multiple pseudo QA pairs with background passages and explanations entirely from scratch. These generated elements are then utilized for in-context learning. Experimental results show that our method significantly surpasses previous state-of-the-art zero-shot methods on three widely-used ODQA datasets and even achieves comparable performance with various customized fine-tuned models on full training data. Our code is available at https://github.com/lockon-n/self-prompting.


title: Finite Hypergraph Families with Rich Extremal Tur\'an Constructions via Mixing Patterns

abstract: We prove that, for any finite set of minimal $r$-graph patterns, there is a finite family $\mathcal F$ of forbidden $r$-graphs such that the extremal Tur\'an constructions for $\mathcal F$ are precisely the maximum $r$-graphs obtainable from mixing the given patterns in any way via blowups and recursion. This extends the result by the second author~\cite{PI14}, where the above statement was established for a single pattern. We present two applications of this result. First, we construct a finite family $\mathcal F$ of $3$-graphs such that there are exponentially many maximum $\mathcal F$-free $3$-graphs of each large order $n$ and, moreover, the corresponding Tur\'an problem is not finitely stable. Second, we show that there exists a finite family $\mathcal{F}$ of $3$-graphs whose feasible region function attains its maximum on a Cantor-type set of positive Hausdorff dimension.


title: Social Phases in Human Movement

abstract: Recent empirical studies found different thermodynamic phases for collective motion in animals. However, such a thermodynamic description for human movement remains unclear, mainly due to the limited resolution of existing tracking technologies. In this Letter, we used a new ultra-wideband radio frequency identification technology to collect high-resolution spatial-temporal data for classroom movements. We measured the effective temperatures for the underlying systems, and found two social phases, gas and liquid-vapor coexistence, associated with different temperatures. We also proposed a simple statistical physics model that can reproduce different empirically observed phases.


title: Sharing Neurophysiology Data from the Allen Brain Observatory: Lessons Learned

abstract: Making all data for any observation or experiment openly available is a defining feature of empirical science (e.g., nullius in verba, the motto of the Royal Society). It enhances transparency, reproducibility, and societal trust. While embraced in spirit by many, in practice open data sharing remains the exception in contemporary systems neuroscience. Here, we take stock of the Allen Brain Observatory, an effort to share data and metadata associated with surveys of neuronal activity in the visual system of laboratory mice. The data from these surveys have been used to produce new discoveries, to validate computational algorithms, and as a benchmark for comparison with other data, resulting in over 100 publications and preprints to date. We distill some of the lessons learned about open surveys and data reuse, including remaining barriers to data sharing and what might be done to address these.


title: An annotated instance segmentation XXL-CT data-set from a historic airplane

abstract: The Me 163 was a Second World War fighter airplane and a result of the German air force secret developments. One of these airplanes is currently owned and displayed in the historic aircraft exhibition of the Deutsches Museum in Munich, Germany. To gain insights with respect to its history, design and state of preservation, a complete CT scan was obtained using an industrial XXL-computer tomography scanner. Using the CT data from the Me 163, all its details can visually be examined at various levels, ranging from the complete hull down to single sprockets and rivets. However, while a trained human observer can identify and interpret the volumetric data with all its parts and connections, a virtual dissection of the airplane and all its different parts would be quite desirable. Nevertheless, this means, that an instance segmentation of all components and objects of interest into disjoint entities from the CT data is necessary. As of currently, no adequate computer-assisted tools for automated or semi-automated segmentation of such XXL-airplane data are available, in a first step, an interactive data annotation and object labelling process has been established. So far, seven 512 x 512 x 512 voxel sub-volumes from the Me 163 airplane have been annotated and labelled, whose results can potentially be used for various new applications in the field of digital heritage, non-destructive testing, or machine-learning. This work describes the data acquisition process of the airplane using an industrial XXL-CT scanner, outlines the interactive segmentation and labelling scheme to annotate sub-volumes of the airplane's CT data, describes and discusses various challenges with respect to interpreting and handling the annotated and labelled data.


title: Inflationary Quantum Spectrum of the Quasi-Isotropic Universe

abstract: We investigate the quantum dynamics of the quasi-isotropic inflationary solution. This is achieved by deriving the Lagrangian and Hamiltonian for both the FLRW background and the inhomogeneous correction, via an expansion of the Einstein-Hilbert action up to second order in the perturbation amplitudes. We do this in a gauge invariant fashion adopting the Mukhanov-Sasaki variable for the scalar degree of freedom. Then we construct the quantum dynamics in terms of a semiclassical WKB scenario for which the inhomogeneous component of the Universe is treated as a "small" quantum subsystem, evolving on the classical isotropic background. Starting from the Wheeler-DeWitt equation, we recover a Schr\"odinger dynamics for the perturbations, in which the time dependence of the wave function emerges thanks to the classicality of the background, and we solve it for a de Sitter inflationary phase. The main result of this paper is that the resulting scalar component of the power spectrum has the standard scale invariant profile, while the tensor one results to be not constrained by the inflationary expansion (modulo an overall normalization factor), therefore preserving the spatial distribution of the quasi-isotropic correction to the metric.


title: GFPose: Learning 3D Human Pose Prior with Gradient Fields

abstract: Learning 3D human pose prior is essential to human-centered AI. Here, we present GFPose, a versatile framework to model plausible 3D human poses for various applications. At the core of GFPose is a time-dependent score network, which estimates the gradient on each body joint and progressively denoises the perturbed 3D human pose to match a given task specification. During the denoising process, GFPose implicitly incorporates pose priors in gradients and unifies various discriminative and generative tasks in an elegant framework. Despite the simplicity, GFPose demonstrates great potential in several downstream tasks. Our experiments empirically show that 1) as a multi-hypothesis pose estimator, GFPose outperforms existing SOTAs by 20% on Human3.6M dataset. 2) as a single-hypothesis pose estimator, GFPose achieves comparable results to deterministic SOTAs, even with a vanilla backbone. 3) GFPose is able to produce diverse and realistic samples in pose denoising, completion and generation tasks. Project page https://sites.google.com/view/gfpose/


title: Estimating Higher-Order Mixed Memberships via the $\ell_{2,\infty}$ Tensor Perturbation Bound

abstract: Higher-order multiway data is ubiquitous in machine learning and statistics and often exhibits community-like structures, where each component (node) along each different mode has a community membership associated with it. In this paper we propose the tensor mixed-membership blockmodel, a generalization of the tensor blockmodel positing that memberships need not be discrete, but instead are convex combinations of latent communities. We establish the identifiability of our model and propose a computationally efficient estimation procedure based on the higher-order orthogonal iteration algorithm (HOOI) for tensor SVD composed with a simplex corner-finding algorithm. We then demonstrate the consistency of our estimation procedure by providing a per-node error bound, which showcases the effect of higher-order structures on estimation accuracy. To prove our consistency result, we develop the $\ell_{2,\infty}$ tensor perturbation bound for HOOI under independent, heteroskedastic, subgaussian noise that may be of independent interest. Our analysis uses a novel leave-one-out construction for the iterates, and our bounds depend only on spectral properties of the underlying low-rank tensor under nearly optimal signal-to-noise ratio conditions such that tensor SVD is computationally feasible. Finally, we apply our methodology to real and simulated data, demonstrating some effects not identifiable from the model with discrete community memberships.


title: Deforming Soft Algebras for Gauge Theory

abstract: Symmetry algebras deriving from towers of soft theorems can be deformed by a short list of higher-dimension Wilsonian corrections to the effective action. We study the simplest of these deformations in gauge theory arising from a massless complex scalar coupled to $F^2$. The soft gauge symmetry '$s$-algebra', compactly realized as a higher-spin current algebra acting on the celestial sphere, is deformed and enlarged to an associative algebra containing soft scalar generators. This deformed soft algebra is found to be non-abelian even in abelian gauge theory. A two-parameter family of central extensions of the $s$-subalgebra are generated by shifting and decoupling the scalar generators. It is shown that these central extensions can also be generated by expanding around a certain non-trivial but Lorentz invariant shockwave type background for the scalar field.


title: Henselian schemes in positive characteristic

abstract: The global analogue of a Henselian local ring is a Henselian pair: a ring A and an ideal I which satisfy a condition resembling Hensel's lemma regarding lifting coprime factorizations of polynomials over A/I to factorizations over A. The geometric counterpart is the notion of a Henselian scheme, which is an analogue of a tubular neighborhood in algebraic geometry. In this paper we revisit the foundations of the theory of Henselian schemes. The pathological behavior of quasi-coherent sheaves on Henselian schemes in characteristic 0 makes them poor models for an "algebraic tube" in characteristic 0. We show that such problems do not arise in positive characteristic, and establish good properties for analogues of smooth and \'etale maps in the general Henselian setting.


title: Efficient Conditionally Invariant Representation Learning

abstract: We introduce the Conditional Independence Regression CovariancE (CIRCE), a measure of conditional independence for multivariate continuous-valued variables. CIRCE applies as a regularizer in settings where we wish to learn neural features $\varphi(X)$ of data $X$ to estimate a target $Y$, while being conditionally independent of a distractor $Z$ given $Y$. Both $Z$ and $Y$ are assumed to be continuous-valued but relatively low dimensional, whereas $X$ and its features may be complex and high dimensional. Relevant settings include domain-invariant learning, fairness, and causal learning. The procedure requires just a single ridge regression from $Y$ to kernelized features of $Z$, which can be done in advance. It is then only necessary to enforce independence of $\varphi(X)$ from residuals of this regression, which is possible with attractive estimation properties and consistency guarantees. By contrast, earlier measures of conditional feature dependence require multiple regressions for each step of feature learning, resulting in more severe bias and variance, and greater computational cost. When sufficiently rich features are used, we establish that CIRCE is zero if and only if $\varphi(X) \perp \!\!\! \perp Z \mid Y$. In experiments, we show superior performance to previous methods on challenging benchmarks, including learning conditionally invariant image features.


title: Effect of a High-Precision Semi-Analytical Mass Function on the Merger Rate of Primordial Black Holes in Dark Matter Halos

abstract: In this work, we study the effect of a high-precision semianalytical mass function on the merger rate of primordial black holes (PBHs) in dark matter halos. For this purpose, we first explain a theoretical framework for dark matter halo models and introduce relevant quantities such as halo density profile, concentration parameter, and a high-precision semianalytical function namely Del Popolo (DP) mass function. In the following, we calculate the merger rate of PBHs in the framework of ellipsoidal-collapse dark matter halo models while considering the DP mass function, and compare it with our previous study for the Sheth-Tormen (ST) mass function. The results show that by taking the mass of PBHs as $M_{\rm PBH} = 30M_{\odot}$, the DP mass function can potentially amplify the merger rate of PBHs. Moreover, we calculate the merger rate of PBHs for the DP mass function as a function of their mass and fraction and compare it with the black hole mergers recorded by the LIGO-Virgo detectors during the latest observing run. Our findings show that the merger rate of PBHs will fall within the LIGO-Virgo band if $f_{\rm PBH} \gtrsim \mathcal{O}(10^{-1})$. This implies that the DP mass function can be used to strengthen constraints on the fraction of PBHs.


title: Chronology protection in $f(T)$ gravity: the case of Gott's pair of moving cosmic strings

abstract: As a consequence of the spacetime structure, defined by the tetrad field instead of the metric tensor alone, $f(T)$ gravity seems to harbor its own chronology protection agency. When Gott's pair of moving cosmic strings is considered, it is shown that the requirement of having a global parallelization -- i.e. a global smooth field of tetrads -- drastically restrict the form of the tetrads on the junction surface between the two strings. The junction conditions on the tetrad field are satisfied only if the corresponding boosts needed to put the strings in motion are null on the matching surface. This seems to throw overboard Gott's construction from the outset without the need of analyzing the divergence of the expectation value of the energy momentum tensor on the Cauchy horizon, evading in this way bothering quarrels concerning the choice of vacuum.


title: Connecting Permutation Equivariant Neural Networks and Partition Diagrams

abstract: We show how the Schur-Weyl duality that exists between the partition algebra and the symmetric group results in a stronger theoretical foundation for characterising all of the possible permutation equivariant neural networks whose layers are some tensor power of the permutation representation $M_n$ of the symmetric group $S_n$. In doing so, we unify two separate bodies of literature, and we correct some of the major results that are now widely quoted by the machine learning community. In particular, we find a basis of matrices for the learnable, linear, permutation equivariant layer functions between such tensor power spaces in the standard basis of $M_n$ by using an elegant graphical representation of a basis of set partitions for the partition algebra and its related vector spaces. Also, we show how we can calculate the number of weights that must appear in these layer functions by looking at certain paths through the McKay quiver for $M_n$. Finally, we describe how our approach generalises to the construction of neural networks that are equivariant to local symmetries.


title: Better May Not Be Fairer: A Study on Subgroup Discrepancy in Image Classification

abstract: In this paper, we provide 20,000 non-trivial human annotations on popular datasets as a first step to bridge gap to studying how natural semantic spurious features affect image classification, as prior works often study datasets mixing low-level features due to limitations in accessing realistic datasets. We investigate how natural background colors play a role as spurious features by annotating the test sets of CIFAR10 and CIFAR100 into subgroups based on the background color of each image. We name our datasets \textbf{CIFAR10-B} and \textbf{CIFAR100-B} and integrate them with CIFAR-Cs. We find that overall human-level accuracy does not guarantee consistent subgroup performances, and the phenomenon remains even on models pre-trained on ImageNet or after data augmentation (DA). To alleviate this issue, we propose \textbf{FlowAug}, a \emph{semantic} DA that leverages decoupled semantic representations captured by a pre-trained generative flow. Experimental results show that FlowAug achieves more consistent subgroup results than other types of DA methods on CIFAR10/100 and on CIFAR10/100-C. Additionally, it shows better generalization performance. Furthermore, we propose a generic metric, \emph{MacroStd}, for studying model robustness to spurious correlations, where we take a macro average on the weighted standard deviations across different classes. We show \textit{MacroStd} being more predictive of better performances; per our metric, FlowAug demonstrates improvements on subgroup discrepancy. Although this metric is proposed to study our curated datasets, it applies to all datasets that have subgroups or subclasses. Lastly, we also show superior out-of-distribution results on CIFAR10.1.


title: On Human Visual Contrast Sensitivity and Machine Vision Robustness: A Comparative Study

abstract: It is well established in neuroscience that color vision plays an essential part in the human visual perception system. Meanwhile, many novel designs for computer vision inspired by human vision have achieved success in a wide range of tasks and applications. Nonetheless, how color differences affect machine vision has not been well explored. Our work tries to bridge this gap between the human color vision aspect of visual recognition and that of the machine. To achieve this, we curate two datasets: CIFAR10-F and CIFAR100-F, which are based on the foreground colors of the popular CIFAR datasets. Together with CIFAR10-B and CIFAR100-B, the existing counterpart datasets with information on the background colors of CIFAR test sets, we assign each image based on its color contrast level per its foreground and background color labels and use this as a proxy to study how color contrast affects machine vision. We first conduct a proof-of-concept study, showing the effect of color difference and validate our datasets. Furthermore, on a broader level, an important characteristic of human vision is its robustness against ambient changes; therefore, drawing inspirations from ophthalmology and the robustness literature, we analogize contrast sensitivity from the human visual aspect to machine vision and complement the current robustness study using corrupted images with our CIFAR-CoCo datasets. In summary, motivated by neuroscience and equipped with the datasets we curate, we devise a new framework in two dimensions to perform extensive analyses on the effect of color contrast and corrupted images: (1) model architecture, (2) model size, to measure the perception ability of machine vision beyond total accuracy. We also explore how task complexity and data augmentation play a role in this setup. Our results call attention to new evaluation approaches for human-like machine perception.