title: Constraints on primordial non-Gaussianity from halo bias measured through CMB lensing cross-correlations

abstract: Local non-Gaussianities in the initial conditions of the Universe, parameterized by $f_{\rm NL}$, induce a scale-dependence in the large-scale bias of halos in the late Universe. This effect is a promising path to constrain multi-field inflation theories that predict non-zero $f_{\rm NL}$. While most existing constraints from the halo bias involve auto-correlations of the galaxy distribution, cross-correlations with probes of the matter density provide an alternative channel with fewer systematics. We present the strongest large-scale structure constraint on local primordial non-Gaussianity that uses cross-correlations alone. We use the cosmic infrared background (CIB) consisting of dusty galaxies as a halo tracer and cosmic microwave background (CMB) lensing as a probe of the underlying matter distribution, both from \textit{Planck} data. Milky Way dust is a key challenge in using the large-scale modes of the CIB. Importantly, the cross-correlation of the CIB with CMB lensing is far less affected by Galactic dust compared to the CIB auto-spectrum, which picks up an additive bias from Galactic dust. We find no evidence for primordial non-Gaussianity and find $-87<f_{\rm NL}<19$ with a Gaussian $\sigma(f_{\rm NL})\approx 41$, assuming universality of the halo mass function. We find that future CMB lensing data from Simons Observatory and CMB-S4 could achieve $\sigma(f_{\rm NL})$ of 23 and 20 respectively. The constraining power of such an analysis is limited by current Galactic dust cleaning techniques, requiring us to use a minimum multipole of $\ell=70$. If this challenge is overcome with improved analysis techniques or external data, constraints as tight as $\sigma(f_{\rm NL})=4$ can be achieved through the cross-correlation technique. More optimistically, constraints better than $\sigma(f_{\rm NL})=2$ could be achieved if the CIB auto-spectrum is dust-free down to the largest scales.


title: Faster Last-iterate Convergence of Policy Optimization in Zero-Sum Markov Games

abstract: Multi-Agent Reinforcement Learning (MARL) -- where multiple agents learn to interact in a shared dynamic environment -- permeates across a wide range of critical applications. While there has been substantial progress on understanding the global convergence of policy optimization methods in single-agent RL, designing and analysis of efficient policy optimization algorithms in the MARL setting present significant challenges, which unfortunately, remain highly inadequately addressed by existing theory. In this paper, we focus on the most basic setting of competitive multi-agent RL, namely two-player zero-sum Markov games, and study equilibrium finding algorithms in both the infinite-horizon discounted setting and the finite-horizon episodic setting. We propose a single-loop policy optimization method with symmetric updates from both agents, where the policy is updated via the entropy-regularized optimistic multiplicative weights update (OMWU) method and the value is updated on a slower timescale. We show that, in the full-information tabular setting, the proposed method achieves a finite-time last-iterate linear convergence to the quantal response equilibrium of the regularized problem, which translates to a sublinear last-iterate convergence to the Nash equilibrium by controlling the amount of regularization. Our convergence results improve upon the best known iteration complexities, and lead to a better understanding of policy optimization in competitive Markov games.


title: Gas Morphology of Milky Way-like Galaxies in the TNG50 Simulation: Signals of Twisting and Stretching

abstract: We present an in-depth analysis of gas morphologies for a sample of 25 Milky Way-like galaxies from the IllustrisTNG TNG50 simulation. We constrain the morphology of cold, warm, hot gas, and gas particles as a whole using a Local Shell Iterative Method (LSIM) and explore its observational implications by computing the hard-to-soft X-ray ratio, which ranges between $10^{-3}$-$10^{-2}$ in the inner $\sim 50 \rm kpc$ of the distribution and $10^{-5}$-$10^{-4}$ at the outer portion of the hot gas distribution. We group galaxies into three main categories: simple, stretched, and twisted. These categories are based on the radial reorientation of the principal axes of the reduced inertia tensor. We find that a vast majority ($77\%$) of the galaxies in our sample exhibit twisting patterns in their radial profiles. Additionally, we present detailed comparisons between 1) the gaseous distributions belonging to individual temperature regimes, 2) the cold gas distributions and stellar distributions, and 3) the gaseous distributions and dark matter (DM) halos. We find a strong correlation between the morphological properties of the cold gas and stellar distributions. Furthermore, we find a correlation between gaseous distributions with DM halo that increases with gas temperature, implying that we may use the warm-hot gaseous morphology as a tracer to probe the DM morphology. Finally, we show gaseous distributions exhibit significantly more prolate morphologies than the stellar distributions and DM halos, which we hypothesize is due to stellar and AGN feedback.


title: Optimization of the Memory Reset Rate of a Quantum Echo-State Network for Time Sequential Tasks

abstract: Quantum reservoir computing is a class of quantum machine learning algorithms involving a reservoir of an echo state network based on a register of qubits, but the dependence of its memory capacity on the hyperparameters is still rather unclear. In order to maximize its accuracy in time--series predictive tasks, we investigate the relation between the memory of the network and the reset rate of the evolution of the quantum reservoir. We benchmark the network performance by three non--linear maps with fading memory on IBM quantum hardware. The memory capacity of the quantum reservoir is maximized for central values of the memory reset rate in the interval [0,1]. As expected, the memory capacity increases approximately linearly with the number of qubits. After optimization of the memory reset rate, the mean squared errors of the predicted outputs in the tasks may decrease by a factor ~1/5 with respect to previous implementations.


title: Nodal statistics-based equivalence relation for graph collections

abstract: Node role explainability in complex networks is very difficult, yet is crucial in different application domains such as social science, neurosciences or computer science. Many efforts have been made on the quantification of hubs revealing particular nodes in a network using a given structural property. Yet, in several applications, when multiple instances of networks are available and several structural properties appear to be relevant, the identification of node roles remains largely unexplored. Inspired by the node automorphically equivalence relation, we define an equivalence relation on graph nodes associated with any collection of nodal statistics (i.e. any functions on the node-set). This allows us to define new graph global measures: the power coefficient, and the orthogonality score to evaluate the parsimony and heterogeneity of a given nodal statistics collection. In addition, we introduce a new method based on structural patterns to compare graphs that have the same vertices set. This method assigns a value to a node to determine its role distinctiveness in a graph family. Extensive numerical results of our method are conducted on both generative graph models and real data concerning human brain functional connectivity. The differences in nodal statistics are shown to be dependent on the underlying graph structure. Comparisons between generative models and real networks combining two different nodal statistics reveal the complexity of human brain functional connectivity with differences at both global and nodal levels. Using a group of 200 healthy controls connectivity networks, our method computes high correspondence scores among the whole population, to detect homotopy, and finally quantify differences between comatose patients and healthy controls.


title: Cross-Correlation Investigation of Anyon Statistics in the $\nu=1/3$ and $2/5$ Fractional Quantum Hall States

abstract: Recent pioneering works have set the stage for exploring anyon braiding statistics from negative current cross-correlations along two intersecting quasiparticle beams. In such a dual-source - analyzer quantum point contact setup, also referred to as 'collider', the anyon exchange phase of fractional quantum Hall quasiparticles is predicted to be imprinted into the cross-correlations characterized by an effective Fano-factor $P$. In the case of symmetric incoming quasiparticle beams, conventional fermions result in a vanishing $P$. In marked contrast, we observe signatures of anyon statistics in the negative $P$ found both for the $e/3$ Laughlin quasiparticles at filling factor $\nu=1/3$ ($P\approx-2$, corroborating previous findings), and for the $e/5$ quasiparticles in the hierarchical state $\nu=2/5$ ($P\approx-1$). Nevertheless, we argue that the quantitative connection between numerical value of $P\neq0$ and specific fractional exchange phase is hampered by the influence of the analyzer conductance dependence on the voltages used to generate the quasiparticles. Finally, we address the important challenge how to distinguish at $\nu=1/3$ between negative cross-correlations induced by a fractional braid phase, and those resulting from a different Andreev-like mechanism. Although with symmetric sources $P$ does not exhibit signatures of a crossover when the analyzer is progressively detuned to favor Andreev processes, we demonstrate that changing the balance between sources provides a mean to discriminate between the two mechanisms.


title: CLIP2Point: Transfer CLIP to Point Cloud Classification with Image-Depth Pre-training

abstract: Pre-training across 3D vision and language remains under development because of limited training data. Recent works attempt to transfer vision-language pre-training models to 3D vision. PointCLIP converts point cloud data to multi-view depth maps, adopting CLIP for shape classification. However, its performance is restricted by the domain gap between rendered depth maps and images, as well as the diversity of depth distributions. To address this issue, we propose CLIP2Point, an image-depth pre-training method by contrastive learning to transfer CLIP to the 3D domain, and adapt it to point cloud classification. We introduce a new depth rendering setting that forms a better visual effect, and then render 52,460 pairs of images and depth maps from ShapeNet for pre-training. The pre-training scheme of CLIP2Point combines cross-modality learning to enforce the depth features for capturing expressive visual and textual features and intra-modality learning to enhance the invariance of depth aggregation. Additionally, we propose a novel Dual-Path Adapter (DPA) module, i.e., a dual-path structure with simplified adapters for few-shot learning. The dual-path structure allows the joint use of CLIP and CLIP2Point, and the simplified adapter can well fit few-shot tasks without post-search. Experimental results show that CLIP2Point is effective in transferring CLIP knowledge to 3D vision. Our CLIP2Point outperforms PointCLIP and other self-supervised 3D networks, achieving state-of-the-art results on zero-shot and few-shot classification.


title: Optimality of Zeno Executions in Hybrid Systems

abstract: A unique feature of hybrid dynamical systems (systems whose evolution is subject to both continuous- and discrete-time laws) is Zeno trajectories. Usually these trajectories are avoided as they can cause incorrect numerical results as the problem becomes ill-conditioned. However, these are difficult to justifiably avoid as determining when and where they occur is a non-trivial task. It turns out that in optimal control problems, not only can they not be avoided, but are sometimes required in synthesizing the solutions. This work explores the pedagogical example of the bouncing ball to demonstrate the importance of "Zeno control executions."


title: Parity and Spin CFT with boundaries and defects

abstract: This paper is a follow-up to [arXiv:2001.05055] in which two-dimensional conformal field theories in the presence of spin structures are studied. In the present paper we define four types of CFTs, distinguished by whether they need a spin structure or not in order to be well-defined, and whether their fields have parity or not. The cases of spin dependence without parity, and of parity without the need of a spin structure, have not, to our knowledge, been investigated in detail so far. We analyse these theories by extending the description of CFT correlators via three-dimensional topological field theory developed in [arXiv:hep-th/0204148] to include parity and spin. In each of the four cases, the defining data are a special Frobenius algebra $F$ in a suitable ribbon fusion category, such that the Nakayama automorphism of $F$ is the identity (oriented case) or squares to the identity (spin case). We use the TFT to define correlators in terms of $F$ and we show that these satisfy the relevant factorisation and single-valuedness conditions. We allow for world sheets with boundaries and topological line defects, and we specify the categories of boundary labels and the fusion categories of line defect labels for each of the four types. The construction can be understood in terms of topological line defects as gauging a possibly non-invertible symmetry. We analyse the case of a $\mathbb{Z}_2$-symmetry in some detail and provide examples of all four types of CFT, with Bershadsky-Polyakov models illustrating the two new types.


title: Device-independent uncloneable encryption

abstract: Uncloneable encryption, first introduced by Broadbent and Lord (TQC 2020) is a quantum encryption scheme in which a quantum ciphertext cannot be distributed between two non-communicating parties such that, given access to the decryption key, both parties cannot learn the underlying plaintext. In this work, we introduce a variant of uncloneable encryption in which several possible decryption keys can decrypt a particular encryption, and the security requirement is that two parties who receive independently generated decryption keys cannot both learn the underlying ciphertext. We show that this variant of uncloneable encryption can be achieved device-independently, i.e., without trusting the quantum states and measurements used in the scheme, and that this variant works just as well as the original definition in constructing quantum money. Moreover, we show that a simple modification of our scheme yields a single-decryptor encryption scheme, which was a related notion introduced by Georgiou and Zhandry. In particular, the resulting single-decryptor encryption scheme achieves device-independent security with respect to a standard definition of security against random plaintexts. Finally, we derive an "extractor" result for a two-adversary scenario, which in particular yields a single-decryptor encryption scheme for single bit-messages that achieves perfect anti-piracy security without needing the quantum random oracle model.


title: Refined Verlinde and Segre formula for Hilbert schemes

abstract: Let $\mathrm{Hilb}_nS$ be the Hilbert scheme of $n$ points on a smooth projective surface $S$. To a class $\alpha\in K^0(S)$ correspond a tautological vector bundle $\alpha^{[n]}$ on $\mathrm{Hilb}_nS$ and line bundle $L_{(n)}\otimes E^{\otimes r}$ with $L=\det(\alpha)$, $r=\mathrm{rk}(\alpha)$. In this paper we give closed formulas for the generating functions for the Segre classes $\int_{\mathrm{Hilb}_nS} s(\alpha^{[n]})$, and the Verlinde numbers $\chi(\mathrm{Hilb}_nS,L_{(n)}\otimes E^{\otimes r})$, for any surface $S$ and any class $\alpha\in K^0(S)$. In fact we determine a more general generating function for $K$-theoretic invariants of Hilbert schemes of points, which contains the formulas for Segre and Verlinde numbers as specializations. We prove these formulas in case $K_S^2=0$. Without assuming the condition $K_S^2=0$, we show the Segre-Verlinde conjecture of Johnson and Marian-Oprea-Pandharipande, which relates the Segre and Verlinde generating series by an explicit change of variables.


title: Generating Hidden Markov Models from Process Models Through Nonnegative Tensor Factorization

abstract: Monitoring of industrial processes is a critical capability in industry and in government to ensure reliability of production cycles, quick emergency response, and national security. Process monitoring allows users to gauge the progress of an organization in an industrial process or predict the degradation or aging of machine parts in processes taking place at a remote location. Similar to many data science applications, we usually only have access to limited raw data, such as satellite imagery, short video clips, event logs, and signatures captured by a small set of sensors. To combat data scarcity, we leverage the knowledge of Subject Matter Experts (SMEs) who are familiar with the actions of interest. SMEs provide expert knowledge of the essential activities required for task completion and the resources necessary to carry out each of these activities. Various process mining techniques have been developed for this type of analysis; typically such approaches combine theoretical process models built based on domain expert insights with ad-hoc integration of available pieces of raw data. Here, we introduce a novel mathematically sound method that integrates theoretical process models (as proposed by SMEs) with interrelated minimal Hidden Markov Models (HMM), built via nonnegative tensor factorization. Our method consolidates: (a) theoretical process models, (b) HMMs, (c) coupled nonnegative matrix-tensor factorizations, and (d) custom model selection. To demonstrate our methodology and its abilities, we apply it on simple synthetic and real world process models.


title: Radiation protection and shielding materials for crewed missions on the surface of Mars

abstract: A potential crewed mission to Mars would require us to solve a number of problems, including how to protect astronauts against the devastating effects of energetic charged particles from Solar and Galactic sources. The radiation environment on Mars is of particular interest, since maintaining optimal absorbed doses by astronauts is crucial to their survival. Here, we give an overview of the conditions on Mars, as determined by theoretical models and in-situ measurements, and present the main proposed strategies to mitigate radiation exposure while on Mars. Specifically, we focus on the passive shielding technique. Several widely used materials, along with some innovative ones and combinations of those, are studied for their behavior against Solar Energetic Particle Events and Galactic Cosmic Rays in the Martian environment. For that purpose, we implement the GEANT4 package, a Monte-Carlo numerical model developed by CERN, which is specifically applied to simulate interactions of radiation with matter. A description of our model will be given, followed by outputs of the numerical model. We conclude that hydrogen-rich materials act as better attenuators, as expected, but other materials can be helpful against cosmic rays too.


title: Minimal entropy production in anisotropic temperature fields

abstract: Anisotropy of temperature fields, chemical potentials and ion concentration gradients provide the fuel that feeds dynamical processes that sustain life. Dynamical flows in respective environments incur losses manifested as entropy production. In this work we consider a rudimentary model of an overdamped stochastic thermodynamic system in an anisotropic temperature heat bath, and analyze the problem to minimize entropy production while driving the system between thermodynamic states in finite time. It is noted that entropy production in a fully isotropic temperature field, can be expressed as the Wasserstein-2 length of the path traversed by the thermodynamic state of the system. In the presence of an anisotropic temperature field, the mechanism of entropy production is substantially more complicated as, besides dissipation, it entails seepage of energy between the ambient heat sources by way of the system dynamics. We show that, in this case, the entropy production can be expressed as the solution of a suitably constrained and generalized Optimal Mass Transport (OMT) problem. In contrast to the situation in standard OMT, entropy production may not be identically zero, even when the thermodynamic state remains unchanged. Physically, this is due to the fact that maintaining a Non-Equilibrium Steady State (NESS), incurs an intrinsic entropic cost. As already noted, NESSs are the hallmark of life and living systems by necessity operate away from equilibrium. Thus our problem of minimizing entropy production appears of central importance in understanding biological processes, such as molecular motors and motor proteins, and on how such processes may have evolved to optimize for available usage of resources.


title: On Stability and Generalization of Bilevel Optimization Problem

abstract: (Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on this problem only focused on analyzing the convergence or improving the convergence rate, while little effort has been devoted to understanding its generalization behaviors. In this paper, we conduct a thorough analysis on the generalization of first-order (gradient-based) methods for the bilevel optimization problem. We first establish a fundamental connection between algorithmic stability and generalization error in different forms and give a high probability generalization bound which improves the previous best one from $\bigO(\sqrt{n})$ to $\bigO(\log n)$, where $n$ is the sample size. We then provide the first stability bounds for the general case where both inner and outer level parameters are subject to continuous update, while existing work allows only the outer level parameter to be updated. Our analysis can be applied in various standard settings such as strongly-convex-strongly-convex (SC-SC), convex-convex (C-C), and nonconvex-nonconvex (NC-NC). Our analysis for the NC-NC setting can also be extended to a particular nonconvex-strongly-convex (NC-SC) setting that is commonly encountered in practice. Finally, we corroborate our theoretical analysis and demonstrate how iterations can affect the generalization error by experiments on meta-learning and hyper-parameter optimization.


title: Electro-optic non-reciprocal polarization rotation in lithium niobate

abstract: Polarization is a fundamental degree of freedom for light and is widely leveraged in free space and fiber optics. Non-reciprocal polarization rotation, enabled via the magneto-optic Faraday effect, has been essentially unbeatable for broadband isolators and circulators. For integrated photonics foundries, however, there is still no good path to producing low-loss magneto-optic components, which has prompted a search for alternatives that do not use polarization rotation. Moreover, magneto-optic materials tend to be highly lossy, and while large (10-100 rad/cm) polarization rotation can be achieved, the key figure of merit (rotation-per-loss) is typically < 1 rad/dB. Here, we demonstrate that broadband non-reciprocal polarization rotation can be produced using electro-optics in nanophotonic devices. Our demonstration leverages electro-optic inter-polarization scattering around 780 nm in lithium niobate, in which the reciprocity is broken with the help of a radiofrequency stimulus that carries synthetic momentum. While the demonstrated electro-optic polarization rotation rate is approximately 1 rad/cm, the exceptionally low loss of lithium niobate enables non-reciprocal polarization rotators with figures of merit that are 1-2 orders-of-magnitude better than what is possible with magneto-optics. This approach can be replicated in III-V platforms paving the way for high-performance lasers with co-integrated monolithic isolators.


title: Fundamental limits of pulsed quantum light spectroscopy: Dipole moment estimation

abstract: We study the fundamental limits of the precision of estimating parameters of a quantum matter system when it is probed by a travelling pulse of quantum light. In particular, we focus on the estimation of the interaction strength between the pulse and a two-level atom, equivalent to the estimation of the dipole moment. Our analysis of single-photon pulses highlights the interplay between the information gained from the absorption of the photon by the atom as measured in absorption spectroscopy, and the perturbation to the temporal mode of the photon due to spontaneous emission. Beyond the single-photon regime, we introduce an approximate model to study more general states of light in the limit of short pulses, where spontaneous emission can be neglected. We also show that for a vast class of entangled biphoton states, quantum entanglement between the signal mode interacting with the atom and the idler mode provides no fundamental advantage and the same precision can be obtained with a separable state. We conclude by studying the estimation of the electric dipole moment of a sodium atom using quantum light. Our work initiates a quantum information theoretic methodology for developing the theory and practice of quantum light spectroscopy.


title: Comparing fractional quantum Hall Laughlin and Jain topological orders with the anyon collider

abstract: Anyon collision experiments have recently demonstrated the ability to discriminate between fermionic and anyonic statistics. However, only one type of anyons associated with the simple Laughlin state at filling factor $\nu=1/3$ has been probed so far. It is now important to establish anyon collisions as quantitative probes of fractional statistics for more complex topological orders, with the ability to distinguish between different species of anyons with different statistics. In this work, we use the anyon collider to compare the Laughlin $\nu=1/3$ state, which is used as the reference state, with the more complex Jain state at $\nu=2/5$, where low energy excitations are carried by two co-propagating edge channels. We demonstrate that anyons generated on the outer channel of the $\nu=2/5$ state (with a fractional charge $e^*=e/3$) have a similar behavior compared to $\nu=1/3$, showing the robustness of anyon collision signals for anyons of the same type. In contrast, anyons emitted on the inner channel of $\nu=2/5$ (with a fractional charge $e^*=e/5$) exhibit a reduced degree of bunching compared to the $\nu=1/3$ case, demonstrating the ability of the anyon collider to discriminate not only between anyons and fermions, but also between different species of anyons associated with different topological orders of the bulk. Our experimental results for the inner channel of $\nu=2/5$ also point towards an influence of interchannel interactions in anyon collision experiments when several co-propagating edge channels are present. A quantitative understanding of these effects will be important for extensions of anyon collisions to non-abelian topological orders, where several charged and neutral modes propagate at the edge.


abstract: A prevalent feature of high-dimensional data is the dependence among covariates, and model selection is known to be challenging when covariates are highly correlated. To perform model selection for the high-dimensional Cox proportional hazards model in presence of correlated covariates with factor structure, we propose a new model, Factor-Augmented Regularized Model for Hazard Regression (FarmHazard), which builds upon latent factors that drive covariate dependence and extends Cox's model. This new model generates procedures that operate in two steps by learning factors and idiosyncratic components from high-dimensional covariate vectors and then using them as new predictors. Cox's model is a widely used semi-parametric model for survival analysis, where censored data and time-dependent covariates bring additional technical challenges. We prove model selection consistency and estimation consistency under mild conditions. We also develop a factor-augmented variable screening procedure to deal with strong correlations in ultra-high dimensional problems. Extensive simulations and real data experiments demonstrate that our procedures enjoy good performance and achieve better results on model selection, out-of-sample C-index and screening than alternative methods.


title: Improved Measurement of the Evolution of the Reactor Antineutrino Flux and Spectrum at Daya Bay

abstract: Reactor neutrino experiments play a crucial role in advancing our knowledge of neutrinos. A precise measurement of reactor electron antineutrino flux and spectrum evolution can be key inputs in improving the knowledge of neutrino mass and mixing as well as reactor nuclear physics and searching for physics beyond the standard model. In this work, the evolution of the flux and spectrum as a function of the reactor isotopic content is reported in terms of the inverse-beta-decay yield at Daya Bay with 1958 days of data and improved systematic uncertainties. These measurements are compared with two signature model predictions: the Huber-Mueller model based on the conversion method and the SM2018 model based on the summation method. The measured average flux and spectrum, as well as their evolution with the 239Pu fraction, are inconsistent with the predictions of the Huber-Mueller model. In contrast, the SM2018 model is shown to agree with the average flux and its evolution but fails to describe the energy spectrum. Altering the predicted IBD spectrum from 239Pu does not improve the agreement with the measurement for either model. The models can be brought into better agreement with the measurements if either the predicted spectrum due to 235U is changed or the predicted 235U, 238U, 239Pu, and 241Pu spectra are changed in equal measure.


title: Dual-former: Hybrid Self-attention Transformer for Efficient Image Restoration

abstract: Recently, image restoration transformers have achieved comparable performance with previous state-of-the-art CNNs. However, how to efficiently leverage such architectures remains an open problem. In this work, we present Dual-former whose critical insight is to combine the powerful global modeling ability of self-attention modules and the local modeling ability of convolutions in an overall architecture. With convolution-based Local Feature Extraction modules equipped in the encoder and the decoder, we only adopt a novel Hybrid Transformer Block in the latent layer to model the long-distance dependence in spatial dimensions and handle the uneven distribution between channels. Such a design eliminates the substantial computational complexity in previous image restoration transformers and achieves superior performance on multiple image restoration tasks. Experiments demonstrate that Dual-former achieves a 1.91dB gain over the state-of-the-art MAXIM method on the Indoor dataset for single image dehazing while consuming only 4.2% GFLOPs as MAXIM. For single image deraining, it exceeds the SOTA method by 0.1dB PSNR on the average results of five datasets with only 21.5% GFLOPs. Dual-former also substantially surpasses the latest desnowing method on various datasets, with fewer parameters.


title: Geometry of generalized virtual polyhedra

abstract: Partial generalizations of virtual polyhedra theory (sometimes under different names) appeared recently in the theory of torus manifolds. These generalizations look very different from the original virtual polyhedra theory. They are based on simple arguments from homotopy theory while the original theory is based on integration over Euler characteristic. In the paper we explain how these generalizations are related to the classical theory of convex bodies and to the original virtual polyhedra theory. The paper basically contains no proofs: all proofs and all details can be found in the cited literature. The paper is based on my talk dedicated to V. I. Arnold's 85-th anniversary at the International Conference on Differential Equations and Dynamical Systems 2022 (Suzdal).


title: New Paradigms for Exploiting Parallel Experiments in Bayesian Optimization

abstract: Bayesian optimization (BO) is one of the most effective methods for closed-loop experimental design and black-box optimization. However, a key limitation of BO is that it is an inherently sequential algorithm (one experiment is proposed per round) and thus cannot directly exploit high-throughput (parallel) experiments. Diverse modifications to the BO framework have been proposed in the literature to enable exploitation of parallel experiments but such approaches are limited in the degree of parallelization that they can achieve and can lead to redundant experiments (thus wasting resources and potentially compromising performance). In this work, we present new parallel BO paradigms that exploit the structure of the system to partition the design space. Specifically, we propose an approach that partitions the design space by following the level sets of the performance function and an approach that exploits partially-separable structures of the performance function found. We conduct extensive numerical experiments using a reactor case study to benchmark the effectiveness of these approaches against a variety of state-of-the-art parallel algorithms reported in the literature. Our computational results show that our approaches significantly reduce the required search time and increase the probability of finding a global (rather than local) solution.


title: Understanding Influence Functions and Datamodels via Harmonic Analysis

abstract: Influence functions estimate effect of individual data points on predictions of the model on test data and were adapted to deep learning in Koh and Liang [2017]. They have been used for detecting data poisoning, detecting helpful and harmful examples, influence of groups of datapoints, etc. Recently, Ilyas et al. [2022] introduced a linear regression method they termed datamodels to predict the effect of training points on outputs on test data. The current paper seeks to provide a better theoretical understanding of such interesting empirical phenomena. The primary tool is harmonic analysis and the idea of noise stability. Contributions include: (a) Exact characterization of the learnt datamodel in terms of Fourier coefficients. (b) An efficient method to estimate the residual error and quality of the optimum linear datamodel without having to train the datamodel. (c) New insights into when influences of groups of datapoints may or may not add up linearly.


title: Distributed-Something: scripts to leverage AWS storage and computing for distributed workflows at scale

abstract: Distributed-Something coordinates the distribution of any Dockerized workflow using on-demand computational infrastructure from Amazon Web Services to enable at-scale workflows where neither computing power nor data storage are limited by local availability while minimizing the time-consuming and confusing aspects of architecture coordination. We also provide Distributed-Something implementations of several bioimaging tools: Distributed-CellProfiler, -Fiji, and -OmeZarrCreator. All are open-source and available at http://GitHub.com/DistributedScience.


title: Nonlinear Reconstruction for Operator Learning of PDEs with Discontinuities

abstract: A large class of hyperbolic and advection-dominated PDEs can have solutions with discontinuities. This paper investigates, both theoretically and empirically, the operator learning of PDEs with discontinuous solutions. We rigorously prove, in terms of lower approximation bounds, that methods which entail a linear reconstruction step (e.g. DeepONet or PCA-Net) fail to efficiently approximate the solution operator of such PDEs. In contrast, we show that certain methods employing a non-linear reconstruction mechanism can overcome these fundamental lower bounds and approximate the underlying operator efficiently. The latter class includes Fourier Neural Operators and a novel extension of DeepONet termed shift-DeepONet. Our theoretical findings are confirmed by empirical results for advection equation, inviscid Burgers' equation and compressible Euler equations of aerodynamics.


title: Decompiling x86 Deep Neural Network Executables

abstract: Due to their widespread use on heterogeneous hardware devices, deep learning (DL) models are compiled into executables by DL compilers to fully leverage low-level hardware primitives. This approach allows DL computations to be undertaken at low cost across a variety of computing platforms, including CPUs, GPUs, and various hardware accelerators. We present BTD (Bin to DNN), a decompiler for deep neural network (DNN) executables. BTD takes DNN executables and outputs full model specifications, including types of DNN operators, network topology, dimensions, and parameters that are (nearly) identical to those of the input models. BTD delivers a practical framework to process DNN executables compiled by different DL compilers and with full optimizations enabled on x86 platforms. It employs learning-based techniques to infer DNN operators, dynamic analysis to reveal network architectures, and symbolic execution to facilitate inferring dimensions and parameters of DNN operators. Our evaluation reveals that BTD enables accurate recovery of full specifications of complex DNNs with millions of parameters (e.g., ResNet). The recovered DNN specifications can be re-compiled into a new DNN executable exhibiting identical behavior to the input executable. We show that BTD can boost two representative attacks, adversarial example generation and knowledge stealing, against DNN executables. We also demonstrate cross-architecture legacy code reuse using BTD, and envision BTD being used for other critical downstream tasks like DNN security hardening and patching.


title: qTask: Task-parallel Quantum Circuit Simulation with Incrementality

abstract: Incremental quantum circuit simulation has emerged as an important tool for simulation-driven quantum applications, such as circuit synthesis, verification, and analysis. When a small portion of the circuit is modified, the simulator must incrementally update state amplitudes for reasonable turnaround time and productivity. However, this type of incrementality has been largely ignored by existing research. To fill this gap, we introduce a new incremental quantum circuit simulator called qTask. qTask leverages a task-parallel decomposition strategy to explore both inter- and intra-gate operation parallelisms from partitioned data blocks. Our partitioning strategy effectively narrows down incremental update to a small set of partitions affected by circuit modifiers. We have demonstrated the promising performance of qTask on QASMBench benchmarks. Compared to two state-of-the-art simulators, Qulacs and Qiskit, qTask is respectively 1.46x and 1.71x faster for full simulation and 5.77x and 9.76x faster for incremental simulation.


title: Improving Convolutional Neural Networks for Fault Diagnosis by Assimilating Global Features

abstract: Deep learning techniques have become prominent in modern fault diagnosis for complex processes. In particular, convolutional neural networks (CNNs) have shown an appealing capacity to deal with multivariate time-series data by converting them into images. However, existing CNN techniques mainly focus on capturing local or multi-scale features from input images. A deep CNN is often required to indirectly extract global features, which are critical to describe the images converted from multivariate dynamical data. This paper proposes a novel local-global CNN (LG-CNN) architecture that directly accounts for both local and global features for fault diagnosis. Specifically, the local features are acquired by traditional local kernels whereas global features are extracted by using 1D tall and fat kernels that span the entire height and width of the image. Both local and global features are then merged for classification using fully-connected layers. The proposed LG-CNN is validated on the benchmark Tennessee Eastman process (TEP) dataset. Comparison with traditional CNN shows that the proposed LG-CNN can greatly improve the fault diagnosis performance without significantly increasing the model complexity. This is attributed to the much wider local receptive field created by the LG-CNN than that by CNN. The proposed LG-CNN architecture can be easily extended to other image processing and computer vision tasks.


title: Unsupervised Model Selection for Time-series Anomaly Detection

abstract: Anomaly detection in time-series has a wide range of practical applications. While numerous anomaly detection methods have been proposed in the literature, a recent survey concluded that no single method is the most accurate across various datasets. To make matters worse, anomaly labels are scarce and rarely available in practice. The practical problem of selecting the most accurate model for a given dataset without labels has received little attention in the literature. This paper answers this question i.e. Given an unlabeled dataset and a set of candidate anomaly detectors, how can we select the most accurate model? To this end, we identify three classes of surrogate (unsupervised) metrics, namely, prediction error, model centrality, and performance on injected synthetic anomalies, and show that some metrics are highly correlated with standard supervised anomaly detection performance metrics such as the $F_1$ score, but to varying degrees. We formulate metric combination with multiple imperfect surrogate metrics as a robust rank aggregation problem. We then provide theoretical justification behind the proposed approach. Large-scale experiments on multiple real-world datasets demonstrate that our proposed unsupervised approach is as effective as selecting the most accurate model based on partially labeled data.


title: Small order limit of fractional Dirichlet sublinear-type problems

abstract: We study the asymptotic behavior of solutions to various Dirichlet sublinear-type problems involving the fractional Laplacian when the fractional parameter s tends to zero. Depending on the type on nonlinearity, positive solutions may converge to a characteristic function or to a positive solution of a limit nonlinear problem in terms of the logarithmic Laplacian, that is, the pseudodifferential operator with Fourier symbol $\ln(|\xi|^2)$. In the case of a logistic-type nonlinearity, our results have the following biological interpretation: in the presence of a toxic boundary, species with reduced mobility have a lower saturation threshold, higher survival rate, and are more homogeneously distributed. As a result of independent interest, we show that sublinear logarithmic problems have a unique least-energy solution, which is bounded and Dini continuous with a log-H\"older modulus of continuity.


title: Waiting time distributions in Quantum spin hall based heterostructures

abstract: For the distinction of the Andreev bound states and Majorana bound states, we study the waiting time distributions (WTDs) for heterostructures, based on one dimensional edge states of a two dimensional topological insulators (TI) in combination with an proximitized s-wave superconductor (SC) and an applied magnetic field. We show for the time reversal symmetric (TRS) situation of a Josephson junction details of the WTD. This includes different transport processes, different numbers of Andreev bound states and the phase difference of the SC. We further consider a Zeeman field in the normal part of the junctions revealing novel features in the WTD along the phase transition between trivial bound states and Majorana bound states. We finally discuss clear signatures to discriminate between them.


title: On The Effects Of Data Normalisation For Domain Adaptation On EEG Data

abstract: In the Machine Learning (ML) literature, a well-known problem is the Dataset Shift problem where, differently from the ML standard hypothesis, the data in the training and test sets can follow different probability distributions, leading ML systems toward poor generalisation performances. This problem is intensely felt in the Brain-Computer Interface (BCI) context, where bio-signals as Electroencephalographic (EEG) are often used. In fact, EEG signals are highly non-stationary both over time and between different subjects. To overcome this problem, several proposed solutions are based on recent transfer learning approaches such as Domain Adaption (DA). In several cases, however, the actual causes of the improvements remain ambiguous. This paper focuses on the impact of data normalisation, or standardisation strategies applied together with DA methods. In particular, using \textit{SEED}, \textit{DEAP}, and \textit{BCI Competition IV 2a} EEG datasets, we experimentally evaluated the impact of different normalization strategies applied with and without several well-known DA methods, comparing the obtained performances. It results that the choice of the normalisation strategy plays a key role on the classifier performances in DA scenarios, and interestingly, in several cases, the use of only an appropriate normalisation schema outperforms the DA technique.


title: Slow semiclassical dynamics of a two-dimensional Hubbard model in disorder-free potentials

abstract: The quench dynamics of the Hubbard model in tilted and harmonic potentials is discussed within the semiclassical picture. Applying the fermionic truncated Wigner approximation (fTWA), the dynamics of imbalances for charge and spin degrees of freedom is analyzed and its time evolution is compared with the exact simulations in one-dimensional lattice. Quench from charge or spin density wave is considered. We show that introduction of harmonic and spin-dependent linear potentials sufficiently validates fTWA for longer times. Such an improvement of fTWA is also obtained for the higher order correlations in terms of quantum Fisher information for charge and spin channels. This allows us to discuss the dynamics of larger system sizes and connect our discussion to the recently introduced Stark many-body localization. In particular, we focus on a finite two-dimensional system and show that at intermediate linear potential strength, the addition of a harmonic potential and spin dependence of the tilt, results in subdiffusive dynamics, similar to that of disordered systems. Moreover, for specific values of harmonic potential, we observed phase separation of ergodic and non-ergodic regions in real space. The latter fact is especially important for ultracold atom experiments in which harmonic confinement can be easily imposed, causing a significant change in relaxation times for different lattice locations.

categories: cond-mat.stat-mech cond-mat.quant-gas cond-mat.str-el quant-ph


title: Schroedinger cats and quantum complementarity

abstract: Complementarity tells us we cannot know precisely the values of all the properties of a quantum object at the same time: the precise determination of one property implies that the value of some other (complementary) property is undefined. E.g.the precise knowledge of the position of a particle implies that its momentum is undefined. Here we show that a Schroedinger cat has a well defined value of a property that is complementary to its ``being dead or alive'' property. Then, thanks to complementarity, it has an undefined value of the property ``being dead or alive''. In other words, the cat paradox is explained through quantum complementarity: of its many complementary properties, any quantum system, such as a cat, can have a well defined value only of one at a time. Schroedinger's cat has a definite value of a property which is complementary to ``being dead or alive'', so it is neither dead nor alive. Figuratively one can say it is both dead and alive. While this interpretation only uses textbook concepts (the Copenhagen interpretation), apparently it has never explicitly appeared in the literature. We detail how to build an Arduino based simulation of Schroedinger's experiment based on these concepts for science outreach events.


title: A Partially Functional Linear Modeling Framework for Integrating Genetic, Imaging, and Clinical Data

abstract: This paper is motivated by the joint analysis of genetic, imaging, and clinical (GIC) data collected in the Alzheimer's Disease Neuroimaging Initiative (ADNI) study. We propose a regression framework based on partially functional linear regression models to map high-dimensional GIC-related pathways for Alzheimer's Disease (AD). We develop a joint model selection and estimation procedure by embedding imaging data in the reproducing kernel Hilbert space and imposing the L0 penalty for the coefficients of genetic variables. We apply the proposed method to the ADNI dataset to identify important features from tens of thousands of genetic polymorphisms (reduced from millions using a preprocessing step) and study the effects of a certain set of informative genetic variants and the baseline hippocampus surface on thirteen future cognitive scores measuring different aspects of cognitive function. We explore the shared and different heritability patterns of these cognitive scores. Analysis results suggest that both the hippocampal and genetic data have heterogeneous effects on different scores, with the trend that the value of both hippocampi is negatively associated with the severity of cognition deficits. Polygenic effects are observed for all thirteen cognitive scores. The well-known APOE4 genotype only explains a small part of cognitive function. Shared genetic etiology exists, however, greater genetic heterogeneity exists within disease classifications after accounting for the baseline diagnosis status. These analyses are useful in further investigation of functional mechanisms for AD evolution.


title: Thin actions on CAT(0) spaces

abstract: We study groups of isometries of packed, geodesically complete, CAT$(0)$-spaces for which the systole at every point is smaller than a universal constant depending only on the packing, deducing strong rigidity results. We show that if a space as above has some negative curvature behaviour then it cannot support a thin action: this generalizes the classical Margulis Lemma to a broader class of spaces.


title: Ordinary isogeny graphs over $\mathbb{F}_p$: the inverse volcano problem

abstract: We give a detailed presentation of $\ell$-isogeny graphs associated with ordinary elliptic curves defined over $\mathbb{F}_p$. We then focus on the following inverse problem: given an abstract volcano $V$, do there always exist primes $\ell, p \in \mathbb{N}$ such that the ordinary $\ell$-isogeny graph over $\mathbb{F}_p$ contains $V$ as a connected component? We provide an affirmative answer to this question.


title: Singular hermitian metrics and the decomposition theorem of Catanese, Fujita, and Kawamata

abstract: We prove that a torsion-free sheaf $\mathcal F$ endowed with a singular hermitian metric with semi-positive curvature and satisfying the minimal extension property admits a direct-sum decomposition $\mathcal F \simeq \mathcal U \oplus \mathcal A$ where $\mathcal U$ is a hermitian flat bundle and $\mathcal A$ is a generically ample sheaf. The result applies to the case of direct images of relative pluricanonical bundles $f_* \omega_{X/Y}^{\otimes m}$ under a surjective morphism $f\colon X \to Y$ of smooth projective varieties with $m\geq 2$. This extends previous results of Fujita, Catanese--Kawamata, and Iwai.


title: Generalized solution of the paraxial equation

abstract: A fairly general expression for a light beam is found as a solution of the paraxial Helmholtz equation. It is achieved by exploiting appropriately chosen complex variables which entail the separability of the equation. Next, the expression for the beam is obtained independently by superimposing shifted Gaussian beams, whereby the shift can be made either by a real vector (in which case the foci of the Gaussian beams are located on a circle) or by a complex one. The solutions found depend on several parameters, the specific choice of which allows to obtain beams with quite different properties. For several selected parameter values figures are drawn, demonstrating the spatial distribution of the energy density and phase. In special cases, the effect of a shift of the intensity peak from one branch to another and phase singularities are observed.


title: Acoustic Localization and Communication Using a MEMS Microphone for Low-cost and Low-power Bio-inspired Underwater Robots

abstract: Having accurate localization capabilities is one of the fundamental requirements of autonomous robots. For underwater vehicles, the choices for effective localization are limited due to limitations of GPS use in water and poor environmental visibility that makes camera-based methods ineffective. Popular inertial navigation methods for underwater localization using Doppler-velocity log sensors, sonar, high-end inertial navigation systems, or acoustic positioning systems require bulky expensive hardware which are incompatible with low cost, bio-inspired underwater robots. In this paper, we introduce an approach for underwater robot localization inspired by GPS methods known as acoustic pseudoranging. Our method allows us to potentially localize multiple bio-inspired robots equipped with commonly available micro electro-mechanical systems microphones. This is achieved through estimating the time difference of arrival of acoustic signals sent simultaneously through four speakers with a known constellation geometry. We also leverage the same acoustic framework to perform oneway communication with the robot to execute some primitive motions. To our knowledge, this is the first application of the approach for the on-board localization of small bio-inspired robots in water. Hardware schematics and the accompanying code are released to aid further development in the field3.


title: Nonstationary data stream classification with online active learning and siamese neural networks

abstract: We have witnessed in recent years an ever-growing volume of information becoming available in a streaming manner in various application areas. As a result, there is an emerging need for online learning methods that train predictive models on-the-fly. A series of open challenges, however, hinder their deployment in practice. These are, learning as data arrive in real-time one-by-one, learning from data with limited ground truth information, learning from nonstationary data, and learning from severely imbalanced data, while occupying a limited amount of memory for data storage. We propose the ActiSiamese algorithm, which addresses these challenges by combining online active learning, siamese networks, and a multi-queue memory. It develops a new density-based active learning strategy which considers similarity in the latent (rather than the input) space. We conduct an extensive study that compares the role of different active learning budgets and strategies, the performance with/without memory, the performance with/without ensembling, in both synthetic and real-world datasets, under different data nonstationarity characteristics and class imbalance levels. ActiSiamese outperforms baseline and state-of-the-art algorithms, and is effective under severe imbalance, even only when a fraction of the arriving instances' labels is available. We publicly release our code to the community.


title: The (In)Effectiveness of Intermediate Task Training For Domain Adaptation and Cross-Lingual Transfer Learning

abstract: Transfer learning from large language models (LLMs) has emerged as a powerful technique to enable knowledge-based fine-tuning for a number of tasks, adaptation of models for different domains and even languages. However, it remains an open question, if and when transfer learning will work, i.e. leading to positive or negative transfer. In this paper, we analyze the knowledge transfer across three natural language processing (NLP) tasks - text classification, sentimental analysis, and sentence similarity, using three LLMs - BERT, RoBERTa, and XLNet - and analyzing their performance, by fine-tuning on target datasets for domain and cross-lingual adaptation tasks, with and without an intermediate task training on a larger dataset. Our experiments showed that fine-tuning without an intermediate task training can lead to a better performance for most tasks, while more generalized tasks might necessitate a preceding intermediate task training step. We hope that this work will act as a guide on transfer learning to NLP practitioners.


title: Multifractal analysis and Erd\"os-R\'enyi laws of large numbers for branching random walks in $\R^d$

abstract: We revisit the multifractal analysis of $\R^d$-valued branching random walks averages by considering subsets of full Hausdorff dimension of the standard level sets, over each infinite branch of which a quantified version of the Erd\"os-R\'enyi law of large numbers holds. Assuming that the exponential moments of the increments of the walks are finite, we can indeed control simultaneously such sets when the levels belong to the interior of the compact convex domain $I$ of possible levels, i.e. when they are associated to so-called Gibbs measures, as well as when they belong to the subset $(\partial{I})_{\mathrm{crit}}$ of $\partial I$ made of levels associated to ``critical'' versions of these Gibbs measures. It turns out that given such a level of one of these two types, the associated Erd\"os-R\'enyi LLN depends on the metric with which is endowed the boundary of the underlying Galton-Watson tree. To extend our control to all the boundary points in cases where $\partial I\neq (\partial{I})_{\mathrm{crit}}$, we slightly strengthen our assumption on the distribution of the increments to exhibit a natural decomposition of $\partial I\setminus (\partial{I})_{\mathrm{crit}}$ into at most countably many convex sets $J$ of affine dimension $\le d-1$ over each of which we can essentially reduce the study to that of interior and critical points associated to some $\R^{\dim J}$-valued branching random~walk.


title: Droplet Arrays in Doubly-Dipolar Bose-Einstein condensates

abstract: Gases of doubly-dipolar particles, with both magnetic and electric dipole moments, offer intriguing novel possibilities. We show that the interplay between doubly-dipolar interactions, quantum stabilization, and external confinement results in a rich ground-state physics of supersolids and incoherent droplet arrays in doubly-dipolar condensates. Our study reveals novel possibilities for engineering quantum droplets and droplet supersolids, including supersolid-supersolid transitions and the realization of supersolid arrays of pancake droplets.


title: Fast and accurate predictions of the nonlinear matter power spectrum for general models of Dark Energy and Modified Gravity

abstract: We embed linear and nonlinear parametrisations of beyond standard cosmological physics in the halo model reaction framework, providing a model-independent prescription for the nonlinear matter power spectrum. As an application, we focus on Horndeski theories, using the Effective Field Theory of Dark Energy (EFTofDE) to parameterise linear and quasi-nonlinear perturbations. In the nonlinear regime we investigate both a nonlinear parameterised-post Friedmannian (nPPF) approach as well as a physically motivated and approximate phenomenological model based on the error function (Erf). We compare the parameterised approaches' predictions of the nonlinear matter power spectrum to the exact solutions, as well as state-of-the-art emulators, in an evolving dark energy scenario and two well studied modified gravity models, finding sub-percent agreement in the reaction using the Erf model at $z\leq1$ and $k\leq 5~h/{\rm Mpc}$. This suggests only an additional 3 free constants, above the background and linear theory parameters, are sufficient to model nonlinear, non-standard cosmology in the matter power spectrum at scales down to $k \leq 3h~/{\rm Mpc}$ within $2\%$ accuracy. We implement the parametrisations into ver.2.0 of the ReACT code.


title: Potential theory and quasisymmetric maps between compact Ahlfors regular metric measure spaces via Besov functions: preliminary

abstract: We study Besov capacities in a compact Ahlfors regular metric measure space by means of hyperbolic fillings of the space. This approach is applicable even if the space does not support any Poincar\'e inequalities. As an application of the Besov capacity estimates we show that if a homeomorphism between two Ahlfors regular metric measure spaces preserves, under some additional assumptions, certain Besov classes, then the homeomorphism is necessarily a quasisymmetric map.


title: Doing data science with platforms crumbs: an investigation into fakes views on YouTube

abstract: This paper contributes to the ongoing discussions on the scholarly access to social media data, discussing a case where this access is barred despite its value for understanding and countering online disinformation and despite the absence of privacy or copyright issues. Our study concerns YouTube's engagement metrics and, more specifically, the way in which the platform removes "fake views" (i.e., views considered as artificial or illegitimate by the platform). Working with one and a half year of data extracted from a thousand French YouTube channels, we show the massive extent of this phenomenon, which concerns the large majority of the channels and more than half the videos in our corpus. Our analysis indicates that most fakes news are corrected relatively late in the life of the videos and that the final view counts of the videos are not independent from the fake views they received. We discuss the potential harm that delays in corrections could produce in content diffusion: by inflating views counts, illegitimate views could make a video appear more popular than it is and unwarrantedly encourage its human and algorithmic recommendation. Unfortunately, we cannot offer a definitive assessment of this phenomenon, because YouTube provides no information on fake views in its API or interface. This paper is, therefore, also a call for greater transparency by YouTube and other online platforms about information that can have crucial implications for the quality of online public debate.


title: hdtg: An R package for high-dimensional truncated normal simulation

abstract: Simulating from the multivariate truncated normal distribution (MTN) is required in various statistical applications yet remains challenging in high dimensions. Currently available algorithms and their implementations often fail when the number of parameters exceeds a few hundred. To provide a general computational tool to efficiently sample from high-dimensional MTNs, we introduce the hdtg package that implements two state-of-the-art simulation algorithms: harmonic Hamiltonian Monte Carlo (harmonic-HMC) and zigzag Hamiltonian Monte Carlo (Zigzag-HMC). Both algorithms exploit analytical solutions of the Hamiltonian dynamics under a quadratic potential energy with hard boundary constraints, leading to rejection-free methods. We compare their efficiencies against another state-of-the-art algorithm for MTN simulation, the minimax tilting accept-reject sampler (MET). The run-time of these three approaches heavily depends on the underlying multivariate normal correlation structure. Zigzag-HMC and harmonic-HMC both achieve 100 effective samples within 3,600 seconds across all tests with dimension ranging from 100 to 1,600, while MET has difficulty in several high-dimensional examples. We provide guidance on how to choose an appropriate method for a given situation and illustrate the usage of hdtg.


title: Quantum colored lozenge tiling and entanglement phase transition

abstract: While volume violation of area law has been exhibited in several quantum spin chains, the construction of a corresponding model in higher dimensions, with isotropic terms, has been an open problem. Here we construct a 2D frustration-free Hamiltonian with maximal violation of the area law. We do so by building a quantum model of random surfaces with color degree of freedom that can be viewed as a collection of colored Dyck paths. The Hamiltonian may be viewed as a 2D generalization of the Fredkin spin chain. Its action is shown to be ergodic within the Hilbert subspace of zero fixed Dirichlet boundary condition and positive height function in the bulk and exhibits a non-degenerate ground state. Its entanglement entropy between subsystems exhibits an entanglement phase transition as the deformation parameter is tuned. The area- and volume-law phases are similar to the one-dimensional model, while the critical point scales with the linear size of the system $L$ as $L\log L$. Similar models can be built in higher dimensions with even softer area law violations at the critical point.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: Model error and its estimation, with particular application to loss reserving

abstract: This paper is concerned with forecast error, particularly in relation to loss reserving. This is generally regarded as consisting of three components, namely parameter, process and model errors. The first two of these components, and their estimation, are well understood, but less so model error. Model error itself is considered in two parts: one part that is capable of estimation from past data (internal model error), and another part that is not (external model error). Attention is focused here on internal model error. Estimation of this error component is approached by means of Bayesian model averaging, using the Bayesian interpretation of the LASSO. This is used to generate a set of admissible models, each with its prior probability and the likelihood of observed data. A posterior on the model set, conditional on the data, results, and an estimate of model error (contained in a loss reserve) is obtained as the variance of the loss reserve according to this posterior. The population of models entering materially into the support of the posterior may turn out to be thinner than desired, and bootstrapping of the LASSO is used to gain bulk. This provides the bonus of an estimate of parameter error also. It turns out that the estimates of parameter and model errors are entangled, and dissociation of them is at least difficult, and possibly not even meaningful. These matters are discussed. The majority of the discussion applies to forecasting generally, but numerical illustration of the concepts is given in relation to insurance data and the problem of insurance loss reserving.


title: SPRAT: A Spatially-Explicit Marine Ecosystem Model Based on Population Balance Equations

abstract: To successfully manage marine fisheries using an ecosystem-based approach, long-term predictions of fish stock development considering changing environmental conditions are necessary. Such predictions can be provided by end-to-end ecosystem models, which couple existing physical and biogeochemical ocean models with newly developed spatially-explicit fish stock models. Typically, Individual-Based Models (IBMs) and models based on Advection-Diffusion-Reaction (ADR) equations are employed for the fish stock models. In this paper, we present a novel fish stock model called SPRAT for end-to\hyp{}end ecosystem modeling based on Population Balance Equations (PBEs) that combines the advantages of IBMs and ADR models while avoiding their main drawbacks. SPRAT accomplishes this by describing the modeled ecosystem processes from the perspective of individuals while still being based on partial differential equations. We apply the SPRAT model to explore a well-documented regime shift observed on the eastern Scotian Shelf in the 1990s from a cod-dominated to a herring-dominated ecosystem. Model simulations are able to reconcile the observed multitrophic dynamics with documented changes in both fishing pressure and water temperature, followed by a predator-prey reversal that may have impeded recovery of depleted cod stocks. We conclude that our model can be used to generate new hypotheses and test ideas about spatially interacting fish populations, and their joint responses to both environmental and fisheries forcing.


title: Deep diving off the `Cosmic Cliffs': previously hidden outflows in NGC 3324 revealed by JWST

abstract: We present a detailed analysis of the protostellar outflow activity in the massive star-forming region NGC 3324, as revealed by new Early Release Observations (ERO) from the James Webb Space Telescope (JWST). Emission from numerous outflows is revealed in narrow-band images of hydrogen Paschen-$\alpha$ (Pa-$\alpha$) and molecular hydrogen. In particular, we report the discovery of 24 previously unknown outflows based on their H$_2$ emission. We find three candidate driving sources for these H$_2$ flows in published catalogs of young stellar objects (YSOs) and we identify 15 IR point sources in the new JWST images as potential driving protostars. We also identify several Herbig-Haro (HH) objects in Pa-$\alpha$ images from JWST; most are confirmed as jets based on their proper motions measured in a comparison with previous Hubble Space Telescope (HST) H$\alpha$ images. This confirmed all previous HST-identified HH jets and candidate jets, and revealed 7 new HH objects. The unprecedented capabilities of JWST allow the direct comparison of atomic and molecular outflow components at comparable angular resolution. Future observations will allow quantitative analysis of the excitation, mass-loss rates, and velocities of these new flows. As a relatively modest region of massive star formation (larger than Orion but smaller than starburst clusters), NGC 3324 offers a preview of what star formation studies with JWST may provide.


title: On Equivariant flag $f$-vectors for balanced relative simplicial complexes

abstract: We study the equivariant flag $f$-vector and equivariant flag $h$-vector of a balanced relative simplicial complex with respect to a group action. When the complex satisfies Serre's condition $(S_{\ell}),$ we show that the equivariant flag $h$-vector, the equivariant $h$-vector, and the equivariant $f$-vector satisfy several inequalities. We apply these results to the study of $P$-partitions of double posets, and weak colorings of mixed graphs.


title: Dual control of coupled oscillator networks

abstract: Robust coordination and organization in large ensembles of nonlinear oscillatory units play a vital role in a wide range of natural and engineered system. The control of self-organizing network-coupled systems has recently seen significant attention, but largely in the context of modifying or augmenting existing structures. This leaves a gap in our understanding of reactive control, where and how to design direct interventions, and what such control strategies may teach us about existing structures and dynamics. Here we study reactive control of coupled oscillator networks and demonstrate dual control strategies that may be implemented interchangeably to achieve synchronization. These differing strategies take advantage of different network properties, the first directly targeting oscillator that are difficult to entrain, and the second targeting oscillators with strong influence on others. Thus, in addition to enlarge strategies for network control, the different control sets shed light on the oscillators dynamical and structural roles within the system. We close with a demonstration of the applicability of dual control of a power grid dynamics.


title: Local Computation of Maximal Independent Set

abstract: We present a randomized Local Computation Algorithm (LCA) with query complexity $poly(\Delta) \cdot \log n$ for the Maximal Independent Set (MIS) problem. That is, the algorithm determines whether each node is in the computed MIS or not using $poly(\Delta) \cdot \log n$ queries to the adjacency lists of the graph, with high probability, and this can be done for different nodes simultaneously and independently. Here $\Delta$ and $n$ denote the maximum degree and the number of nodes. This algorithm resolves a key open problem in the study of local computations and sublinear algorithms (attributed to Rubinfeld).


title: The limit in the $(k+2, k)$-Problem of Brown, Erd\H{o}s and S\'os exists for all $k\geq 2$

abstract: Let $f^{(r)}(n;s,k)$ be the maximum number of edges of an $r$-uniform hypergraph on~$n$ vertices not containing a subgraph with $k$~edges and at most $s$~vertices. In 1973, Brown, Erd\H{o}s and S\'os conjectured that the limit $$\lim_{n\to \infty} n^{-2} f^{(3)}(n;k+2,k)$$ exists for all positive integers $k\ge 2$. They proved this for $k=2$. In 2019, Glock proved this for $k=3$ and determined the limit. Quite recently, Glock, Joos, Kim, K\"{u}hn, Lichev and Pikhurko proved this for $k=4$ and determined the limit; we combine their work with a new reduction to fully resolve the conjecture by proving that indeed the limit exists for all positive integers $k\ge 2$.


title: Exploiting dissipative reactions to perform in-beam $\gamma$-ray spectroscopy of the neutron-deficient isotopes \nuc{38,39}{Ca}

abstract: The neutron-deficient Ca isotopes continue to attract attention due to their importance for testing isospin symmetry and their relevance in capture reactions of interest for nova nucleosynthesis and the shape of light curves in Type I X-ray bursts. To date, spectroscopic information on 38,39 Ca is largely limited to data on lower-spin excited states. Here, we report in-beam {\gamma}-ray spectroscopy of complementary higher-spin, complex-structure states in 39 Ca populated in fast-beam-induced, momentum-dissipative processes leading to neutron pickup onto excited configurations of the projectile, 9 Be(38 Ca , 39 Ca + {\gamma})X. Such a dissipative reaction was recently characterized for the case of inelastic scattering of 38 Ca off 9 Be, 9 Be(38 Ca, 38 Ca + {\gamma})X. Additional data and discussion on the nuclear structure of 38 Ca is also presented. An explanation for the more-complex-structure states, populated with small cross sections in one-nucleon knockout reactions, and observed in the tails of their longitudinal momentum distributions, is also offered.


title: Temperature and Differential Emission Measure Profiles in Turbulent Solar Active Region Loops

abstract: We examine the temperature structure of static coronal active region loops in regimes where thermal conductive transport is driven by Coulomb collisions, by turbulent scattering, or by a combination of the two. (In the last case collisional scattering dominates the heat transport at lower levels in the loop where temperatures are low and densities are high, while turbulent scattering dominates the heat transport at higher temperatures/lower densities.) Temperature profiles and their corresponding differential emission measure distributions are calculated and compared to observations, and earlier scaling laws relating the loop apex temperature and volumetric heating rate to the loop length and pressure are revisited. Results reveal very substantial changes, compared to the wholly collision-dominated case, to both the loop scaling laws and the temperature/density profiles along the loop. They also show that the well-known excess of differential emission measure at relatively low temperatures in the loop may be a consequence of for by the flatter temperature gradients (and so increased amount of material within a specified temperature range) that results from the predominance of turbulent scattering in the upper regions of the loop.


abstract: We propose MINT, a new Multilingual INTimacy analysis dataset covering 13,372 tweets in 10 languages including English, French, Spanish, Italian, Portuguese, Korean, Dutch, Chinese, Hindi, and Arabic. We benchmarked a list of popular multilingual pre-trained language models. The dataset is released along with the SemEval 2023 Task 9: Multilingual Tweet Intimacy Analysis (https://sites.google.com/umich.edu/semeval-2023-tweet-intimacy).


title: Digital financial services and open banking innovation: are banks becoming invisible?

abstract: Digitalization in many economic sectors drove the financial system to adapt to new paradigms of technological transformation. Moreover, the extant regulatory framework forced the financial system to reconsider its business models and its relationship with the market. Such reasons generated also in the banking sector a new model of competition within the ecosystem never seen before in this sector. The new ecosystem of banks and financial institutions lacks a common framework that not only synthesizes the development lines of open innovation in the banking sector, but also regarding the planification of strategic choices and organisation within the new ecosystems. The present study aims to inquire the strategic positioning of European banks toward their digital transformation strategies, by analysing the decision-making processes that occurred between 2015 and 2019. A qualitative analysis on partnerships and the adoption of Application Programming Interfaces (APIs) development in support of new service models was carried out. Results have relevant policy implications for regulators, linked to the business evolution and the risks of outsourcing, and managerial implications for the followers, specifically on the plan of service integration to diversify and boost their activities in the segment of customer relationship management and care, providing a better user experience.


title: The JWST Hubble Sequence: The Rest-Frame Optical Evolution of Galaxy Structure at $1.5 < z < 8$

abstract: We present results on the morphological and structural evolution of a total of 4265 galaxies observed with JWST at $1.5 < z < 8$ in the JWST CEERS observations that overlap with the CANDELS EGS field. This is the biggest visually classified sample observed with JWST yet, $\sim20$ times larger than previous studies, and allows us to examine in detail how galaxy structure has changed over this critical epoch. All sources were classified by six individual classifiers using a simple classification scheme aimed to produce disk/spheroid/peculiar classifications, whereby we determine how the relative number of these morphologies evolves since the Universe's first billion years. Additionally, we explore structural and quantitative morphology measurements using \textsc{Morfometryka}, and show that galaxies at $z > 3$ are not dominated by irregular and peculiar structures, either visually or quantitatively, as previously thought. We find a strong dominance of morphologically selected disk galaxies up to $z = 8$, a far higher redshift than previously thought possible. We also find that the stellar mass and star formation rate densities are dominated by disk galaxies up to $z \sim 6$, demonstrating that most stars in the universe were likely formed in a disk galaxy. We compare our results to theory to show that the fraction of types we find is predicted by cosmological simulations, and that the Hubble Sequence was already in place as early as one billion years after the Big Bang. Additionally, we make our visual classifications public for the community.


title: MultiGuard: Provably Robust Multi-label Classification against Adversarial Examples

abstract: Multi-label classification, which predicts a set of labels for an input, has many applications. However, multiple recent studies showed that multi-label classification is vulnerable to adversarial examples. In particular, an attacker can manipulate the labels predicted by a multi-label classifier for an input via adding carefully crafted, human-imperceptible perturbation to it. Existing provable defenses for multi-class classification achieve sub-optimal provable robustness guarantees when generalized to multi-label classification. In this work, we propose MultiGuard, the first provably robust defense against adversarial examples to multi-label classification. Our MultiGuard leverages randomized smoothing, which is the state-of-the-art technique to build provably robust classifiers. Specifically, given an arbitrary multi-label classifier, our MultiGuard builds a smoothed multi-label classifier via adding random noise to the input. We consider isotropic Gaussian noise in this work. Our major theoretical contribution is that we show a certain number of ground truth labels of an input are provably in the set of labels predicted by our MultiGuard when the $\ell_2$-norm of the adversarial perturbation added to the input is bounded. Moreover, we design an algorithm to compute our provable robustness guarantees. Empirically, we evaluate our MultiGuard on VOC 2007, MS-COCO, and NUS-WIDE benchmark datasets. Our code is available at: \url{https://github.com/quwenjie/MultiGuard}


title: Generative Category-Level Shape and Pose Estimation with Semantic Primitives

abstract: Empowering autonomous agents with 3D understanding for daily objects is a grand challenge in robotics applications. When exploring in an unknown environment, existing methods for object pose estimation are still not satisfactory due to the diversity of object shapes. In this paper, we propose a novel framework for category-level object shape and pose estimation from a single RGB-D image. To handle the intra-category variation, we adopt a semantic primitive representation that encodes diverse shapes into a unified latent space, which is the key to establish reliable correspondences between observed point clouds and estimated shapes. Then, by using a SIM(3)-invariant shape descriptor, we gracefully decouple the shape and pose of an object, thus supporting latent shape optimization of target objects in arbitrary poses. Extensive experiments show that the proposed method achieves SOTA pose estimation performance and better generalization in the real-world dataset. Code and video are available at https://zju3dv.github.io/gCasp.


title: The impact of resistive electric fields on particle acceleration in reconnection layers

abstract: In the context of particle acceleration in high-energy astrophysical environments featuring magnetic reconnection, the importance of the resistive term of the electric field compared to the convective one is still under debate. In this work, we present a quantitative analysis through 2D magnetohydrodynamic numerical simulations of tearing-unstable current sheets coupled to a test-particles approach, performed with the PLUTO code. We find that the resistive field plays a significant role in the early-stage energization of high-energy particles. Indeed, these particles are firstly accelerated due to the resistive electric field when they cross an X-point, created during the fragmentation of the current sheet. If this preliminary particle acceleration mechanism dominated by the resistive field is neglected, particles cannot reach the same high energies. Our results support therefore the conclusion that the resistive field is not only non-negligible but it does actually play an important role in the particle acceleration mechanism.


title: Optical Saturation Produces Spurious Evidence for Photoinduced Superconductivity in K$_{3}$C$_{60}$

abstract: We discuss a systematic uncertainty in time-resolved optical conductivity measurements that becomes important at high pump intensities. We show that common optical nonlinearities can distort the photoconductivity depth profile, and by extension distort the photoconductivity spectrum. We show evidence that this distortion is present in existing measurements on K$_{3}$C$_{60}$, and describe how it may create the appearance of photoinduced superconductivity where none exists. Similar errors may emerge in other pump-probe spectroscopy measurements, and we discuss how to correct for them.


title: LASP: Text-to-Text Optimization for Language-Aware Soft Prompting of Vision & Language Models

abstract: Soft prompt learning has recently emerged as one of the methods of choice for adapting V&L models to a downstream task using a few training examples. However, current methods significantly overfit the training data, suffering from large accuracy degradation when tested on unseen classes from the same domain. To this end, in this paper, we make the following 4 contributions: (1) To alleviate base class overfitting, we propose a novel Language-Aware Soft Prompting (LASP) learning method by means of a text-to-text cross-entropy loss that maximizes the probability of the learned prompts to be correctly classified with respect to pre-defined hand-crafted textual prompts. (2) To increase the representation capacity of the prompts, we propose grouped LASP where each group of prompts is optimized with respect to a separate subset of textual prompts. (3) We identify a visual-language misalignment introduced by prompt learning and LASP, and more importantly, propose a re-calibration mechanism to address it. (4) We show that LASP is inherently amenable to including, during training, virtual classes, i.e. class names for which no visual samples are available, further increasing the robustness of the learned prompts. Through evaluations on 11 datasets, we show that our approach (a) significantly outperforms all prior works on soft prompting, and (b) matches and surpasses, for the first time, the accuracy on novel classes obtained by hand-crafted prompts and CLIP for 8 out of 11 test datasets. Code will be made available at https://www.adrianbulat.com/lasp


title: That Sounds Right: Auditory Self-Supervision for Dynamic Robot Manipulation

abstract: Learning to produce contact-rich, dynamic behaviors from raw sensory data has been a longstanding challenge in robotics. Prominent approaches primarily focus on using visual or tactile sensing, where unfortunately one fails to capture high-frequency interaction, while the other can be too delicate for large-scale data collection. In this work, we propose a data-centric approach to dynamic manipulation that uses an often ignored source of information: sound. We first collect a dataset of 25k interaction-sound pairs across five dynamic tasks using commodity contact microphones. Then, given this data, we leverage self-supervised learning to accelerate behavior prediction from sound. Our experiments indicate that this self-supervised 'pretraining' is crucial to achieving high performance, with a 34.5% lower MSE than plain supervised learning and a 54.3% lower MSE over visual training. Importantly, we find that when asked to generate desired sound profiles, online rollouts of our models on a UR10 robot can produce dynamic behavior that achieves an average of 11.5% improvement over supervised learning on audio similarity metrics.


title: Omnigrok: Grokking Beyond Algorithmic Data

abstract: Grokking, the unusual phenomenon for algorithmic datasets where generalization happens long after overfitting the training data, has remained elusive. We aim to understand grokking by analyzing the loss landscapes of neural networks, identifying the mismatch between training and test losses as the cause for grokking. We refer to this as the "LU mechanism" because training and test losses (against model weight norm) typically resemble "L" and "U", respectively. This simple mechanism can nicely explain many aspects of grokking: data size dependence, weight decay dependence, the emergence of representations, etc. Guided by the intuitive picture, we are able to induce grokking on tasks involving images, language and molecules. In the reverse direction, we are able to eliminate grokking for algorithmic datasets. We attribute the dramatic nature of grokking for algorithmic datasets to representation learning.

categories: cs.LG cs.AI physics.data-an stat.ME stat.ML


title: A Selberg zeta function for warped AdS$_3$ black holes

abstract: The Selberg zeta function and trace formula are powerful tools used to calculate kinetic operator spectra and quasinormal modes on hyperbolic quotient spacetimes. In this article, we extend this formalism to non-hyperbolic quotients by constructing a Selberg zeta function for warped AdS$_3$ black holes. We also consider the so-called self-dual solutions, which are of interest in connection to near-horizon extremal Kerr. We establish a map between the zeta function zeroes and the quasinormal modes on warped AdS$_3$ black hole backgrounds. In the process, we use a method involving conformal coordinates and the symmetry structure of the scalar Laplacian to construct a warped version of the hyperbolic half-space metric, which to our knowledge is new and may have interesting applications of its own, which we describe. We end by discussing several future directions for this work, such as computing 1-loop determinants (which govern quantum corrections) on the quotient spacetimes we consider, as well as adapting the formalism presented here to more generic orbifolds.


title: Energetic Electron Irradiations of Amorphous and Crystalline Sulphur-Bearing Astrochemical Ices

abstract: Laboratory experiments have confirmed that the radiolytic decay rate of astrochemical ice analogues is dependent upon the solid phase of the target ice, with some crystalline molecular ices being more radio-resistant than their amorphous counterparts. The degree of radio-resistance exhibited by crystalline ice phases is dependent upon the nature, strength, and extent of the intermolecular interactions that characterise their solid structure. For example, it has been shown that crystalline CH3OH decays at a significantly slower rate when irradiated by 2 keV electrons at 20 K than does the amorphous phase due to the stabilising effect imparted by the presence of an extensive array of strong hydrogen bonds. These results have important consequences for the astrochemistry of interstellar ices and outer Solar System bodies, as they imply that the chemical products arising from the irradiation of amorphous ices (which may include prebiotic molecules relevant to biology) should be more abundant than those arising from similar irradiations of crystalline phases. In this present study, we have extended our work on this subject by performing comparative energetic electron irradiations of the amorphous and crystalline phases of the sulphur-bearing molecules H2S and SO2 at 20 K. We have found evidence for phase-dependent chemistry in both these species, with the radiation-induced exponential decay of amorphous H2S being more rapid than that of the crystalline phase, similar to the effect that has been previously observed for CH3OH. For SO2, two fluence regimes are apparent: a low-fluence regime in which the crystalline ice exhibits a rapid exponential decay while the amorphous ice possibly resists decay, and a high-fluence regime in which both phases undergo slow exponential-like decays.

categories: physics.chem-ph astro-ph.EP astro-ph.GA cond-mat.other


title: Predicting CO$_2$ Absorption in Ionic Liquids with Molecular Descriptors and Explainable Graph Neural Networks

abstract: Ionic Liquids (ILs) provide a promising solution for CO$_2$ capture and storage to mitigate global warming. However, identifying and designing the high-capacity IL from the giant chemical space requires expensive, and exhaustive simulations and experiments. Machine learning (ML) can accelerate the process of searching for desirable ionic molecules through accurate and efficient property predictions in a data-driven manner. But existing descriptors and ML models for the ionic molecule suffer from the inefficient adaptation of molecular graph structure. Besides, few works have investigated the explainability of ML models to help understand the learned features that can guide the design of efficient ionic molecules. In this work, we develop both fingerprint-based ML models and Graph Neural Networks (GNNs) to predict the CO$_2$ absorption in ILs. Fingerprint works on graph structure at the feature extraction stage, while GNNs directly handle molecule structure in both the feature extraction and model prediction stage. We show that our method outperforms previous ML models by reaching a high accuracy (MAE of 0.0137, $R^2$ of 0.9884). Furthermore, we take the advantage of GNNs feature representation and develop a substructure-based explanation method that provides insight into how each chemical fragments within IL molecules contribute to the CO$_2$ absorption prediction of ML models. We also show that our explanation result agrees with some ground truth from the theoretical reaction mechanism of CO$_2$ absorption in ILs, which can advise on the design of novel and efficient functional ILs in the future.


title: Independence of Linear Statistics with Random Coefficients and Characterizations of Geometric and Poisson Distributions

abstract: There is given a characterization of the geometric distribution by the independence of linear forms with random coefficients. The result is a discrete analog of the corresponding theorem on exponential distribution. The property of linear statistics independence is also a characterization of Poisson law. Keywords: geometric distribution; exponential distribution; Poisson distribution; linear forms; random coefficients


title: BIASeD: Bringing Irrationality into Automated System Design

abstract: Human perception, memory and decision-making are impacted by tens of cognitive biases and heuristics that influence our actions and decisions. Despite the pervasiveness of such biases, they are generally not leveraged by today's Artificial Intelligence (AI) systems that model human behavior and interact with humans. In this theoretical paper, we claim that the future of human-machine collaboration will entail the development of AI systems that model, understand and possibly replicate human cognitive biases. We propose the need for a research agenda on the interplay between human cognitive biases and Artificial Intelligence. We categorize existing cognitive biases from the perspective of AI systems, identify three broad areas of interest and outline research directions for the design of AI systems that have a better understanding of our own biases.


title: Towards Learned Simulators for Cell Migration

abstract: Simulators driven by deep learning are gaining popularity as a tool for efficiently emulating accurate but expensive numerical simulators. Successful applications of such neural simulators can be found in the domains of physics, chemistry, and structural biology, amongst others. Likewise, a neural simulator for cellular dynamics can augment lab experiments and traditional computational methods to enhance our understanding of a cell's interaction with its physical environment. In this work, we propose an autoregressive probabilistic model that can reproduce spatiotemporal dynamics of single cell migration, traditionally simulated with the Cellular Potts model. We observe that standard single-step training methods do not only lead to inconsistent rollout stability, but also fail to accurately capture the stochastic aspects of the dynamics, and we propose training strategies to mitigate these issues. Our evaluation on two proof-of-concept experimental scenarios shows that neural methods have the potential to faithfully simulate stochastic cellular dynamics at least an order of magnitude faster than a state-of-the-art implementation of the Cellular Potts model.


title: Automatic Neural Network Hyperparameter Optimization for Extrapolation: Lessons Learned from Visible and Near-Infrared Spectroscopy of Mango Fruit

abstract: Neural networks are configured by choosing an architecture and hyperparameter values; doing so often involves expert intuition and hand-tuning to find a configuration that extrapolates well without overfitting. This paper considers automatic methods for configuring a neural network that extrapolates in time for the domain of visible and near-infrared (VNIR) spectroscopy. In particular, we study the effect of (a) selecting samples for validating configurations and (b) using ensembles. Most of the time, models are built of the past to predict the future. To encourage the neural network model to extrapolate, we consider validating model configurations on samples that are shifted in time similar to the test set. We experiment with three validation set choices: (1) a random sample of 1/3 of non-test data (the technique used in previous work), (2) using the latest 1/3 (sorted by time), and (3) using a semantically meaningful subset of the data. Hyperparameter optimization relies on the validation set to estimate test-set error, but neural network variance obfuscates the true error value. Ensemble averaging - computing the average across many neural networks - can reduce the variance of prediction errors. To test these methods, we do a comprehensive study of a held-out 2018 harvest season of mango fruit given VNIR spectra from 3 prior years. We find that ensembling improves the state-of-the-art model's variance and accuracy. Furthermore, hyperparameter optimization experiments - with and without ensemble averaging and with each validation set choice - show that when ensembling is combined with using the latest 1/3 of samples as the validation set, a neural network configuration is found automatically that is on par with the state-of-the-art.


title: Spectral2Spectral: Image-spectral Similarity Assisted Spectral CT Deep Reconstruction without Reference

abstract: Spectral computed tomography based on a photon-counting detector (PCD) attracts more and more attentions since it has the capability to provide more accurate identification and quantitative analysis for biomedical materials. The limited number of photons within narrow energy bins leads to imaging results of low signal-noise ratio. The existing supervised deep reconstruction networks for CT reconstruction are difficult to address these challenges because it is usually impossible to acquire noise-free clinical images with clear structures as references. In this paper, we propose an iterative deep reconstruction network to synergize unsupervised method and data priors into a unified framework, named as Spectral2Spectral. Our Spectral2Spectral employs an unsupervised deep training strategy to obtain high-quality images from noisy data in an end-to-end fashion. The structural similarity prior within image-spectral domain is refined as a regularization term to further constrain the network training. The weights of neural network are automatically updated to capture image features and structures within the iterative process. Three large-scale preclinical datasets experiments demonstrate that the Spectral2spectral reconstructs better image quality than other the state-of-the-art methods.