title: Reinterpreting deformed Heisenberg algebras

abstract: Minimal and maximal uncertainties of position measurements are widely considered possible hallmarks of low-energy quantum as well as classical gravity. While General Relativity describes interactions in terms of spatial curvature, its quantum analogue may also extend to the realm of curved momentum space as suggested, e. g. in the context of Relative Locality in Deformed Special Relativity. Drawing on earlier work, we show in an entirely Born reciprocal, i. e. position and momentum space covariant, way that the quadratic Generalized Extended Uncertainty principle can alternatively be described in terms of quantum dynamics on a general curved cotangent manifold. In the case of the Extended Uncertainty Principle the curvature tensor in position space is proportional to the noncommutativity of the momenta, while an analogous relation applies to the curvature tensor in momentum space and the noncommutativity of the coordinates for the Generalized Uncertainty Principle. In the process of deriving this map, the covariance of the approach constrains the admissible models to an interesting subclass of noncommutative geometries which has not been studied before. Furthermore, we reverse the approach to derive general anisotropically deformed uncertainty relations from general background geometries. As an example, this formalism is applied to (anti)-de Sitter spacetime.


title: AGN X-ray Spectroscopy with Neural Networks

abstract: We explore the possibility of using machine learning to estimate physical parameters directly from AGN X-ray spectra without needing computationally expensive spectral fitting. Specifically, we consider survey quality data, rather than long pointed observations, to ensure that this approach works in the regime where it is most likely to be applied. We simulate Athena WFI spectra of AGN with warm absorbers, and train simple neural networks to estimate the ionisation and column density of the absorbers. We find that this approach can give comparable accuracy to spectral fitting, without the risk of outliers caused by the fit sticking in a false minimum, and with an improvement of around three orders of magnitude in speed. We also demonstrate that using principal component analysis to reduce the dimensionality of the data prior to inputting it into the neural net can significantly increase the accuracy of the parameter estimation for negligible computational cost, while also allowing a simpler network architecture to be used.


title: In search for an alternative to the computer metaphor of the mind and brain

abstract: The brain-as-computer metaphor has anchored the professed computational nature of the mind, wresting it down from the intangible logic of Platonic philosophy to a material basis for empirical science. However, as with many long-lasting metaphors in science, the computer metaphor has been explored and stretched long enough to reveal its boundaries. These boundaries highlight widening gaps in our understanding of the brain's role in an organism's goal-directed, intelligent behaviors and thoughts. In search of a more appropriate metaphor that reflects the potentially noncomputable functions of mind and brain, eight author groups answer the following questions: (1) What do we understand by the computer metaphor of the brain and cognition? (2) What are some of the limitations of this computer metaphor? (3) What metaphor should replace the computational metaphor? (4) What findings support alternative metaphors? Despite agreeing about feeling the strain of the strictures of computer metaphors, the authors suggest an exciting diversity of possible metaphoric options for future research into the mind and brain.


title: Sequential Analysis of a finite number of Coherent states

abstract: We investigate an advantage for information processing of ordering a set of states over making a global quantum processing with a fixed number of copies of coherent states. Suppose Alice has $N$ copies of one of two quantum states $\sigma_0$ or $\sigma_1$ and she gives these states to Bob. Using the optimal sequential test, the SPRT, we ask if processing the states in batches of size $l$ is advantageous to optimally distinguish the two hypotheses. We find that for the symmetric case $\{|\gamma\rangle,|-\gamma\rangle\}$ there is no advantage of taking any batch size $l$. We give an expression for the optimal batch size $l_\text{opt}$ in the assymetric case. We give bounds $l_\text{min}$ and $l_\text{max}$ for when $P_S\approx 1$.


title: A Two-Ball Ellsberg Paradox: An Experiment

abstract: We conduct an incentivized experiment on a nationally representative US sample \\ (N=708) to test whether people prefer to avoid ambiguity even when it means choosing dominated options. In contrast to the literature, we find that 55\% of subjects prefer a risky act to an ambiguous act that always provides a larger probability of winning. Our experimental design shows that such a preference is not mainly due to a lack of understanding. We conclude that subjects avoid ambiguity \textit{per se} rather than avoiding ambiguity because it may yield a worse outcome. Such behavior cannot be reconciled with existing models of ambiguity aversion in a straightforward manner.


title: A recent update of gas-phase chemical reactions and molecular lines in CLOUDY: its effects on millimeter and sub-millimeter molecular line predictions

abstract: Here we present our current updates of the gas-phase chemical reaction rates and molecular lines in the spectral synthesis code CLOUDY, and its implications in spectroscopic modelling of various astrophysical environments. We include energy levels, radiative and collisional rates for HF, CF$^+$, HC$_3$N, ArH$^+$, HCl, HCN, CN, CH, and CH$_2$. Simultaneously, we expand our molecular network involving these molecules. For this purpose, we have added 561 new reactions and have updated the existing 165 molecular reaction rates involving these molecules. As a result, CLOUDY now predicts all the lines arising from these nine molecules. In addition, we also update H$_2$--H$_2$ collisional data up to rotational levels $J$=31 for $v$=0. We demonstrate spectroscopic simulations of these molecules for a few astrophysical environments. Our existing model for globules in the Crab nebula successfully predicts the observed column density of ArH$^+$. Our model predicts a detectable amount of HeH$^+$, OH$^+$, and CH$^+$ for the Crab nebula. We also model the ISM towards HD185418, W31C, NGC 253, and our predictions match with most of the observed column densities within the observed error bars. Very often molecular lines trace various physical conditions. Hence, this update will be very supportive for spectroscopic modelling of various astrophysical environments, particularly involving sub-millimeter and mid-infrared observations using ALMA and JWST, respectively.


title: On Margins and Generalisation for Voting Classifiers

abstract: We study the generalisation properties of majority voting on finite ensembles of classifiers, proving margin-based generalisation bounds via the PAC-Bayes theory. These provide state-of-the-art guarantees on a number of classification tasks. Our central results leverage the Dirichlet posteriors studied recently by Zantedeschi et al. [2021] for training voting classifiers; in contrast to that work our bounds apply to non-randomised votes via the use of margins. Our contributions add perspective to the debate on the "margins theory" proposed by Schapire et al. [1998] for the generalisation of ensemble classifiers.


title: Quantum clones inside black holes

abstract: A systematic procedure is proposed for better understanding the evolution laws of black holes in terms of pure quantum states. We start with the two opposed regions I and II in the Penrose diagram, and study the evolution of matter in these regions, using the algebra derived earlier from the Shapiro effect in quantum particles. Since this spacetime has two distinct asymptotic regions, one must assume that there is a mechanism that reduces the number of states. In earlier work we proposed that region II describes the angular antipodes of region I, the `antipodal identification', but this eventually leads to contradictions. Our much simpler proposal is now that all states defined in region II are exact quantum clones of those in region I. This indicates more precisely how to restore unitarity by making all quantum states observable, and in addition suggests that generalisations towards other black hole structures will be possible. An apparent complication is that the wave function must evolve with a purely antisymmetric, imaginary-valued Hamiltonian, but this complication can be well-understood in a realistic interpretation of quantum mechanics.


title: A study of Feynman integrals with uniform transcendental weights and the symbology from dual conformal symmetry

abstract: Multi-loop Feynman integrals are key objects for the high-order correction computations in high energy phenomenology. These integrals with multiple scales, may have complicated symbol structures. We show that the dual conformal symmetry sheds light on the alphabet and symbol structures of multi-loop Feynman integrals. In this paper, first, as a cutting-edge example, we derive the two-loop four-external-mass Feynman integrals with uniform transcendental (UT) weights, based on the latest developments on UT integrals. Then we show that all the symbol letters can be nicely obtained from those of closely-related dual conformal integrals, by sending a dual point to infinity. Certain properties of the symbol such as first two entries and extended Steinmann relations are also studied from analogous properties of dual conformal integrals.


title: Maximal Brill-Noether loci via K3 surfaces

abstract: We explain a strategy for distinguishing Brill-Noether loci in the moduli space of curves by studying the lifting of linear systems on curves in polarized K3 surfaces, which motivates a conjecture identifying the maximal Brill-Noether loci with respect to containment. Via an analysis of the stability of Lazarsfeld-Mukai bundles, we obtain new lifting results for linear systems of rank 3 which suffice to prove the maximal Brill-Noether loci conjecture in genus 9-19, 22, and 23.


title: The distribution of radio quiet active galactic nuclei in the star formation-stellar mass plane

abstract: That active galactic nuclei (AGN) with jets can alternately enhance as well as suppress star formation rates, explains the location and slope of radio loud AGN on the star formation rate-stellar mass plane. Here, we explore 860 type 1 and 2 AGN at z<0.2 from the ROSAT-2XRS survey in order to understand both different location and lower slopes for non-jetted AGN in the star formation rate-stellar mass plane. We describe the nature of these differences in terms of different degrees of black hole feedback, with relatively weak negative feedback from non-jetted AGN compared to both relatively strong positive and negative feedback from jetted AGN. The validity of these ideas brings us a step closer towards understanding the black hole scaling relation across space and time.


title: A computational framework for weighted simplicial homology

abstract: We provide a bottom up construction of torsion generators for weighted homology of a weighted complex over a discrete valuation ring $R=\mathbb{F}[[\pi]]$. This is achieved by starting from a basis for classical homology of the $n$-th skeleton for the underlying complex with coefficients in the residue field $\mathbb{F}$ and then lifting it to a basis for the weighted homology with coefficients in the ring $R$. Using the latter, a bijection is established between $n+1$ and $n$ dimensional simplices whose weight ratios provide the exponents of the $\pi$-monomials that generate each torsion summand in the structure theorem of the weighted homology modules over $R$. We present algorithms that subsume the torsion computation by reducing it to normalization over the residue field of $R$, and describe a Python package we implemented that takes advantage of this reduction and performs the computation efficiently.


title: Explicit Regularization in Overparametrized Models via Noise Injection

abstract: Injecting noise within gradient descent has several desirable features, such as smoothing and regularizing properties. In this paper, we investigate the effects of injecting noise before computing a gradient step. We demonstrate that small perturbations can induce explicit regularization for simple models based on the L1-norm, group L1-norms, or nuclear norms. However, when applied to overparametrized neural networks with large widths, we show that the same perturbations can cause variance explosion. To overcome this, we propose using independent layer-wise perturbations, which provably allow for explicit regularization without variance explosion. Our empirical results show that these small perturbations lead to improved generalization performance compared to vanilla gradient descent.


title: A Random Card Shuffling Process

abstract: Consider a randomly shuffled deck of $2n$ cards with $n$ red cards and $n$ black cards. We study the average number of moves it takes to go from a randomly shuffled deck to a deck that alternates in color by performing the following move: If the top card and the bottom card of the deck differ in color place the top card at the bottom of the deck, otherwise, insert the top card randomly in the deck. We use tools from combinatorics, probability, and linear algebra to model this process as a finite Markov chain.


title: Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

abstract: Language models demonstrate both quantitative improvement and new qualitative capabilities with increasing scale. Despite their potentially transformative impact, these new capabilities are as yet poorly characterized. In order to inform future research, prepare for disruptive new model capabilities, and ameliorate socially harmful effects, it is vital that we understand the present and near-future capabilities and limitations of language models. To address this challenge, we introduce the Beyond the Imitation Game benchmark (BIG-bench). BIG-bench currently consists of 204 tasks, contributed by 450 authors across 132 institutions. Task topics are diverse, drawing problems from linguistics, childhood development, math, common-sense reasoning, biology, physics, social bias, software development, and beyond. BIG-bench focuses on tasks that are believed to be beyond the capabilities of current language models. We evaluate the behavior of OpenAI's GPT models, Google-internal dense transformer architectures, and Switch-style sparse transformers on BIG-bench, across model sizes spanning millions to hundreds of billions of parameters. In addition, a team of human expert raters performed all tasks in order to provide a strong baseline. Findings include: model performance and calibration both improve with scale, but are poor in absolute terms (and when compared with rater performance); performance is remarkably similar across model classes, though with benefits from sparsity; tasks that improve gradually and predictably commonly involve a large knowledge or memorization component, whereas tasks that exhibit "breakthrough" behavior at a critical scale often involve multiple steps or components, or brittle metrics; social bias typically increases with scale in settings with ambiguous context, but this can be improved with prompting.


title: Skein lasagna modules and handle decompositions

abstract: The skein lasagna module is an extension of Khovanov-Rozansky homology to the setting of a four-manifold and a link in its boundary. This invariant plays the role of the Hilbert space of an associated fully extended (4+epsilon)-dimensional TQFT. We give a general procedure for expressing the skein lasagna module in terms of a handle decomposition for the four-manifold. We use this to calculate a few examples, and show that the skein lasagna module can sometimes be locally infinite dimensional.


title: Autonomous Drone Landing with Fiducial Markers and a Gimbal-Mounted Camera for Active Tracking

abstract: Precision landing is a remaining challenge in autonomous drone flight. Fiducial markers provide a computationally cheap way for a drone to locate a landing pad and autonomously execute precision landings. However, most work in this field depends on either rigidly-mounted or downward-facing cameras which restrict the drone's ability to detect the marker. We present a method of autonomous landing that uses a gimbal-mounted camera to quickly search for the landing pad by simply spinning in place while tilting the camera up and down, and to continually aim the camera at the landing pad during approach and landing. This method demonstrates successful search, tracking, and landing with 4 of 5 tested fiducial systems on a physical drone with no human intervention. Per fiducial system, we present the distributions of the distances from the drone to the center of the landing pad after each successful landing. We also show representative examples of flight trajectories, marker tracking performance, and control outputs for each channel during the landing. Finally, we discuss qualitative strengths and weaknesses underlying each system.


title: Higgs-mass prediction in the NMSSM with heavy BSM particles

abstract: We address the prediction for the mass of the SM-like Higgs boson in NMSSM scenarios where all BSM particles, including the singlets, have masses at the TeV scale. We provide a full one-loop computation of the matching condition for the quartic Higgs coupling in the NMSSM, supplemented with the two-loop contributions that involve the strong gauge coupling. We discuss the impact of the one- and two-loop corrections that are specific to the NMSSM on the prediction for the Higgs mass, and propose a method to estimate of the uncertainty associated with the uncomputed higher-order terms. Finally, we illustrate how the measured value of the Higgs mass can be used to constrain some yet-unmeasured parameters of the NMSSM.


title: A self-consistent wave description of axion miniclusters and their survival in the galaxy

abstract: We present a solution of the Schr\"odinger-Poisson system based on the WKB ansatz for the wave function. In this way we obtain a description of a gravitationally bound clump of axion dark matter by a superposition of energy eigenstates with random phases. It can be applied to any self-consistent pair of radial density distribution and phase space density $f(E)$ related by Eddington's formula. We adopt this as a model for axion miniclusters in our galaxy and use it to study the mass loss due to a star encounter by using standard perturbation theory methods known from quantum mechanics. Finally, we perform a Monte Carlo study to estimate the surviving fraction of axion miniclusters in the dark matter halo of our galaxy. We find that the reaction to perturbations and the survival probability depend crucially on the density profile. Weakly bound clusters are heated up and eventually destroyed, whereas more strongly bound systems get even more compact as a result of perturbations and are driven towards an axion star configuration.


title: On the Generalization and Adaption Performance of Causal Models

abstract: Learning models that offer robust out-of-distribution generalization and fast adaptation is a key challenge in modern machine learning. Modelling causal structure into neural networks holds the promise to accomplish robust zero and few-shot adaptation. Recent advances in differentiable causal discovery have proposed to factorize the data generating process into a set of modules, i.e. one module for the conditional distribution of every variable where only causal parents are used as predictors. Such a modular decomposition of knowledge enables adaptation to distributions shifts by only updating a subset of parameters. In this work, we systematically study the generalization and adaption performance of such modular neural causal models by comparing it to monolithic models and structured models where the set of predictors is not constrained to causal parents. Our analysis shows that the modular neural causal models outperform other models on both zero and few-shot adaptation in low data regimes and offer robust generalization. We also found that the effects are more significant for sparser graphs as compared to denser graphs.


title: A Critical Review on the Use (and Misuse) of Differential Privacy in Machine Learning

abstract: We review the use of differential privacy (DP) for privacy protection in machine learning (ML). We show that, driven by the aim of preserving the accuracy of the learned models, DP-based ML implementations are so loose that they do not offer the ex ante privacy guarantees of DP. Instead, what they deliver is basically noise addition similar to the traditional (and often criticized) statistical disclosure control approach. Due to the lack of formal privacy guarantees, the actual level of privacy offered must be experimentally assessed ex post, which is done very seldom. In this respect, we present empirical results showing that standard anti-overfitting techniques in ML can achieve a better utility/privacy/efficiency trade-off than DP.


title: Local exact controllability to constant trajectories for Navier-Stokes-Korteweg model

abstract: In this article, we study the local exact controllability to a constant trajectory for a compressible Navier-Stokes-Korteweg system on the torus in dimension $ d\in\{1,2,3\}$ when the control acts on an open subset. To be more precise, we obtain the local exact controllability to the constant state $(\rho_{\star},0)$ for arbitrary small positive times and without any geometric condition on the control region. In order to do so, we analyze the control properties of the linearized equation, and present a detailed study of the observability of the adjoint equations. In particular, we shall exhibit the parabolic (possibly also dispersive) structure of these adjoint equations. Based on that, we will be able to recover observability of the adjoint system through Carleman estimates.


title: Excitation-damping quantum channels

abstract: We study a class of quantum channels describing a quantum system, split into the direct sum of an excited and a ground sector, undergoing a one-way transfer of population from the former to the latter; this construction, which provides a generalization of the amplitude-damping qubit channel, can be regarded as a way to upgrade a trace non-increasing quantum operation, defined on the excited sector, to a possibly trace preserving operation on a larger Hilbert space. We provide necessary and sufficient conditions for the complete positivity of such channels, and we also show that complete positivity is equivalent to simple positivity whenever the ground sector is one-dimensional. Finally, we examine the time-dependent scenario and characterize all CP-divisible channels and Markovian semigroups belonging to this class.


title: Factuality Enhanced Language Models for Open-Ended Text Generation

abstract: Pretrained language models (LMs) are susceptible to generate text with nonfactual information. In this work, we measure and improve the factual accuracy of large-scale LMs for open-ended text generation. We design the FactualityPrompts test set and metrics to measure the factuality of LM generations. Based on that, we study the factual accuracy of LMs with parameter sizes ranging from 126M to 530B. Interestingly, we find that larger LMs are more factual than smaller ones, although a previous study suggests that larger LMs can be less truthful in terms of misconceptions. In addition, popular sampling algorithms (e.g., top-p) in open-ended text generation can harm the factuality due to the ''uniform randomness'' introduced at every sampling step. We propose the factual-nucleus sampling algorithm that dynamically adapts the randomness to improve the factuality of generation while maintaining quality. Furthermore, we analyze the inefficiencies of the standard training method in learning correct associations between entities from factual text corpus (e.g., Wikipedia). We propose a factuality-enhanced training method that uses TopicPrefix for better awareness of facts and sentence completion as the training objective, which can vastly reduce the factual errors. We release our code and FactualityPrompts benchmark at: https://github.com/nayeon7lee/FactualityPrompt.


title: AttX: Attentive Cross-Connections for Fusion of Wearable Signals in Emotion Recognition

abstract: We propose cross-modal attentive connections, a new dynamic and effective technique for multimodal representation learning from wearable data. Our solution can be integrated into any stage of the pipeline, i.e., after any convolutional layer or block, to create intermediate connections between individual streams responsible for processing each modality. Additionally, our method benefits from two properties. First, it can share information uni-directionally (from one modality to the other) or bi-directionally. Second, it can be integrated into multiple stages at the same time to further allow network gradients to be exchanged in several touch-points. We perform extensive experiments on three public multimodal wearable datasets, WESAD, SWELL-KW, and CASE, and demonstrate that our method can effectively regulate and share information between different modalities to learn better representations. Our experiments further demonstrate that once integrated into simple CNN-based multimodal solutions (2, 3, or 4 modalities), our method can result in superior or competitive performance to state-of-the-art and outperform a variety of baseline uni-modal and classical multimodal methods.


title: Beam-based RF Station Fault Identification at the SLAC Linac Coherent Light Source

abstract: Accelerators produce too many signals for a small operations team to monitor in real time. In addition, many of these signals are only interpretable by subject matter experts with years of experience. As a result, changes in accelerator performance can require time-intensive consultations with experts to identify the underlying problem. Herein, we focus on a particular anomaly detection task for radio-frequency (RF) stations at the Linac Coherent Light Source (LCLS). The existing RF station diagnostics are bandwidth limited, resulting in slow, unreliable signals. As a result, anomaly detection is currently a manual process. We propose a beam-based method, identifying changes in the accelerator status using shot-to-shot data from the beam position monitoring system; by comparing the beam-based anomalies to data from RF stations, we identify the source of the change. We find that our proposed method can be fully automated while identifying more events with fewer false positives than the RF station diagnostics alone. Our automated fault identification system has been used to create a new data set for investigating the interaction between the RF stations and accelerator performance.


title: Gaussian Process Model for the Local Stellar Velocity Field from Gaia Data Release 2

abstract: We model the local stellar velocity field using position and velocity measurements for 4M stars from the second data release of Gaia. We determine the components of the mean or bulk velocity in ~27k spatially-defined bins. Our assumption is that these quantities constitute a Gaussian process where the correlation between the bulk velocity at different locations is described by a simple covariance function or kernel. We use a sparse Gaussian process algorithm based on inducing points to construct a non-parametric, smooth, and differentiable model for the underlying velocity field. We estimate the Oort constants A, B, C, and K and find values in excellent agreement with previous results. Maps of the velocity field within 2 kpc of the Sun reveal complicated substructures, which provide clear evidence that the local disk is in a state of disequilibrium. We present the first 3D map of the divergence of the stellar velocity field and identify regions of the disk that may be undergoing compression and rarefaction.

categories: astro-ph.GA astro-ph.IM astro-ph.SR physics.data-an


title: On retrograde orbits, resonances and stability

abstract: We start by reviewing our previous work on retrograde orbital configurations and on modeling and identifying retrograde resonances. Then, we present new results regarding the enhanced stability of retrograde configurations with respect to prograde configurations in the low mass ratio regime of the planar circular restricted 3-body problem. Motivated by the recent discovery of small bodies which are in retrograde resonance with the Solar System's giant planets we then explore the case with mass ratio 0.001 and show new stability maps in a grid of semi-major axis versus eccentricity for the 2/1 and 1/2 retrograde resonances. Finally, we explain how the stability borders of the 2/1 and 1/2 retrograde resonances are related to the resonant orbits' geometry.


title: On the Optimization of Underwater Quantum Key Distribution Systems with Time-Gated SPADs

abstract: In this paper, we study the effect of various transmitter and receiver parameters on the quantum bit error rate (QBER) performance of underwater quantum key distribution. We utilize a Monte Carlo approach to simulate the trajectories of emitted photons transmitting in the water from the transmitter towards receiver. Based on propagation delay results, we first determine a proper value for bit period to avoid the intersymbol interference as a result of possible multiple scattering events. Then, based on the angle of arrival of the received photons, we determine a proper field-of-view to limit the average number of received background noise. Finally, we determine the optimal value for the single photon avalanche diode (SPAD) gate time in the sense of minimizing the QBER for the selected system parameters and given propagation environment.


title: Reflected Entropy in Boundary/Interface Conformal Field Theory

abstract: Boundary conformal field theory (BCFT) and interface conformal field theory (ICFT) attract attention in the context of the information paradox problem. On this background, we develop the idea of the reflected entropy in BCFT/ICFT. We first introduce the left-right reflected entropy (LRRE) in BCFT and show that its holographic dual is given by the area of the entanglement wedge cross section (EWCS) through AdS/BCFT. We also present how to evaluate the reflected entropy in ICFT. By using this technique, we can show the universal behavior of the Markov gap in some special cases. Furthermore, we clarify what is the holographic dual of boundary primary correlation functions by using this LRRE/EWCS duality.


title: Unshielded portable optically pumped magnetometer for the remote detection of conductive objects using eddy current measurements

abstract: Electrically conductive objects can be detected using the principle of electromagnetic induction where a primary oscillating magnetic field induces eddy currents in the object, which in turn produce a secondary magnetic field that can be measured with a magnetometer. We have developed a portable radio-frequency optically pumped magnetometer (RF OPM) working in unshielded conditions with sub-pT/sqrt(Hz) magnetic field sensitivity when used for the detection of small oscillating magnetic fields, setting a new benchmark for the sensitivity of a portable RF OPM in unshielded conditions. Using this OPM, we have detected the induced magnetic field from aluminium disks with diameters as small as 1.5 cm and with the disks being ~25 cm from both the excitation coil and the magnetometer. When used for eddy current detection, our magnetometer achieves a sensitivity of a 2-6 pT/sqrt(Hz). We have also detected a moving aluminium disk using our RF OPM and analysed the magnetometer signals which depend on the position of the disk, illustrating the potential of high sensitivity RF OPMs for remote sensing applications.


title: Temporal Logic Imitation: Learning Plan-Satisficing Motion Policies from Demonstrations

abstract: Learning from demonstration (LfD) has succeeded in tasks featuring a long time horizon. However, when the problem complexity also includes human-in-the-loop perturbations, state-of-the-art approaches do not guarantee the successful reproduction of a task. In this work, we identify the roots of this challenge as the failure of a learned continuous policy to satisfy the discrete plan implicit in the demonstration. By utilizing modes (rather than subgoals) as the discrete abstraction and motion policies with both mode invariance and goal reachability properties, we prove our learned continuous policy can simulate any discrete plan specified by a linear temporal logic (LTL) formula. Consequently, an imitator is robust to both task- and motion-level perturbations and guaranteed to achieve task success. Project page: https://yanweiw.github.io/tli/


title: Bireversible automata generating lamplighter groups

abstract: For every non-trivial finite abelian group $A$, we exhibit a bireversible automaton generating the lamplighter group $A \wr \mathbb{Z}$.


title: The Economics of Automated Market Makers

abstract: This paper studies the question whether automated market maker protocols such as Uniswap can sustainably retain a portion of their trading fees for the protocol. We approach the problem by modelling how to optimally choose a pool's take rate, i.e\ the fraction of fee revenue that remains with the protocol, in order to maximize the protocol's revenue. The model suggest that if AMMs have a portion of loyal trade volume, they can sustainably set a non-zero take rate, even without losing liquidity to competitors with a zero take rate. Furthermore, we determine the optimal take rate depending on a number of model parameters including how much loyal trade volume pools have and how high the competitors' take rates are.


title: Optimal Design of Energy-Harvesting Hybrid VLC-RF Networks

abstract: In this paper, we consider an indoor downlink dual-hop hybrid visible light communication (VLC)/radio frequency (RF) scenario. For each transmission block, we dynamically allocate a portion of time resources to VLC and the other portion to RF transmission. In the first phase (i.e., VLC transmission), the LED carries both data and energy to an energy harvester relay node. In the second phase (i.e., RF communication), the relay utilizes the harvested energy to re-transmit the decoded information to the far RF user. During this phase, the LED continues to transmit power (no information) to the relay node, aiming to harvest energy that can be used in the next transmission block. We formulate the optimization problem in the sense of maximizing the data rate under the assumption of decode-and-forward (DF) relaying. As the design parameters, the direct current (DC) bias and the assigned time duration for VLC transmission are taken into account. In particular, the joint non-convex optimization is split into two sub-problems, which are then cyclically solved. In the first sub-problem, we fix the assigned time duration to VLC link and utilize the majorization-minimization (MM) procedure to solve the non-convex DC bias problem. In the second sub-problem, we fix the DC bias obtained in the previous step and solve the optimization problem for the assigned VLC link time duration. Our results demonstrate that a higher data rate can be achieved by solving the joint problem of DC bias and time duration compared to solely optimizing the DC bias.


title: Spatial Entropy as an Inductive Bias for Vision Transformers

abstract: Recent work on Vision Transformers (VTs) showed that introducing a local inductive bias in the VT architecture helps reducing the number of samples necessary for training. However, the architecture modifications lead to a loss of generality of the Transformer backbone, partially contradicting the push towards the development of uniform architectures, shared, e.g., by both the Computer Vision and the Natural Language Processing areas. In this work, we propose a different and complementary direction, in which a local bias is introduced using an auxiliary self-supervised task, performed jointly with standard supervised training. Specifically, we exploit the observation that the attention maps of VTs, when trained with self-supervision, can contain a semantic segmentation structure which does not spontaneously emerge when training is supervised. Thus, we explicitly encourage the emergence of this spatial clustering as a form of training regularization. In more detail, we exploit the assumption that, in a given image, objects usually correspond to few connected regions, and we propose a spatial formulation of the information entropy to quantify this object-based inductive bias. By minimizing the proposed spatial entropy, we include an additional self-supervised signal during training. Using extensive experiments, we show that the proposed regularization leads to equivalent or better results than other VT proposals which include a local bias by changing the basic Transformer architecture, and it can drastically boost the VT final accuracy when using small-medium training sets. The code is available at https://github.com/helia95/SAR.


title: Thermal Transport in Turbostratic Multilayer Graphene

abstract: The presence of twist angles between layers of two-dimensional materials has a profound impact on their physical properties. Turbostratic multilayer graphene is a system containing a distribution of rotational stacking faults, and these interfaces also have variable twist angles. In this work, we examine the influence of turbostratic single-layer graphene content on the in-plane thermal conductivity of a defect free multilayer graphene system with low defect density. Detailed Raman mode analysis is used to quantify the content of turbostratic single-layer graphene in the system while complementing insight is obtained from selected area electron diffraction studies. Thermal transport in these systems is investigated with Raman optothermal technique supported with finite element analysis simulations. Thermal conductivity of AB-stacked graphene diminishes by a factor of 2.59 for 1% of turbostratic single-layer graphene content, while the decrease at 19% turbostratic content is by an order in magnitude. Thermal conductivity broadly obeys the relation, $\kappa$ $\propto$ exp(-F), where F is the fraction of turbostratic single-layer graphene content in the system


title: On large deviation principles and the Monge--Amp\`ere equation (following Berman, Hultgren)

abstract: This is mostly an exposition, aimed to be accessible to geometers, analysts, and probabilists, of a fundamental recent theorem of R. Berman with recent developments by J. Hultgren, that asserts that the second boundary value problem for the real Monge--Amp\`ere equation admits a probabilistic interpretation, in terms of many particle limit of permanental point processes satisfying a large deviation principle with a rate function given explicitly using optimal transport. An alternative proof of a step in the Berman--Hultgren Theorem is presented allowing to to deal with all "tempratures" simultaneously instead of first reducing to the zero-temperature case.


title: Alexandrov-Fenchel inequalities for convex hypersurfaces in the half-space with capillary boundary

abstract: In this paper, we first introduce quermassintegrals for capillary hypersurfaces in the half-space. Then we solve the related isoperimetric type problems for the convex capillary hypersurfaces and obtain the corresponding Alexandrov-Fenchel inequalities. In order to prove these results, we construct a new locally constrained curvature flow and prove that the flow converges globally to a spherical cap.


title: Regret Bounds for Information-Directed Reinforcement Learning

abstract: Information-directed sampling (IDS) has revealed its potential as a data-efficient algorithm for reinforcement learning (RL). However, theoretical understanding of IDS for Markov Decision Processes (MDPs) is still limited. We develop novel information-theoretic tools to bound the information ratio and cumulative information gain about the learning target. Our theoretical results shed light on the importance of choosing the learning target such that the practitioners can balance the computation and regret bounds. As a consequence, we derive prior-free Bayesian regret bounds for vanilla-IDS which learns the whole environment under tabular finite-horizon MDPs. In addition, we propose a computationally-efficient regularized-IDS that maximizes an additive form rather than the ratio form and show that it enjoys the same regret bound as vanilla-IDS. With the aid of rate-distortion theory, we improve the regret bound by learning a surrogate, less informative environment. Furthermore, we extend our analysis to linear MDPs and prove similar regret bounds for Thompson sampling as a by-product.

categories: cs.LG cs.IT math.IT math.ST stat.ME stat.ML stat.TH


title: Evidence of jet induced optical microvariability in radio-loud Narrow Line Seyfert 1 Galaxies

abstract: To quantify the role of radio jets for Intra-Night Optical Variability (INOV) in Radio-Loud Narrow-Line Seyfert 1 (RLNLSy1) galaxies, we report the first systematic comparative INOV study of 23 RLNLSy1 galaxies, with 15 RLNLSy1s having confirmed detection of jets (jetted) and the remaining 8 RLNLSy1s having no detection of jets (non-jetted) based on their Very Long Baseline Array observations. We have monitored these two samples, respectively, in 37 and 16 sessions of a minimum 3-hour duration each. Based upon F$^{\eta}$-test at 99\% confidence level with a typical INOV amplitude ($\psi$) detection threshold of $>$ 3\%, we find the INOV duty cycles of 12\% for the sample of jetted RLNLSy1s, however, none of the sources showed INOV in the sample of non-jetted RLNLSy1s. Among the jetted RLNLSy1s, we find that the Duty Cycle (DC) for jetted $\gamma$-ray detected ($\gamma$-ray) RLNLSy1s is found to be 34\% in contrast to null INOV detection in the case of non-$\gamma$-ray RLNLSy1s. It suggests that instead of the mere presence of a jet, relativistic beaming plays a significant role for INOV in the case of low-luminous high accreting AGNs such as NLSy1s in which dilution of the AGN's non-thermal optical emission by the (much steadier) optical emission contributed by the nuclear accretion disc is quite likely. Our study of jetted $\gamma$-ray RLNLSy1s shows more frequent INOV detection for sources with higher apparent jet speed. Further, our results also suggest that among the NLSy1s, only jetted $\gamma$-ray RNLSy1 galaxies DC approaches blazar like DC.


title: Probability flow solution of the Fokker-Planck equation

abstract: The method of choice for integrating the time-dependent Fokker-Planck equation in high-dimension is to generate samples from the solution via integration of the associated stochastic differential equation. Here, we study an alternative scheme based on integrating an ordinary differential equation that describes the flow of probability. Acting as a transport map, this equation deterministically pushes samples from the initial density onto samples from the solution at any later time. Unlike integration of the stochastic dynamics, the method has the advantage of giving direct access to quantities that are challenging to estimate from trajectories alone, such as the probability current, the density itself, and its entropy. The probability flow equation depends on the gradient of the logarithm of the solution (its "score"), and so is a-priori unknown. To resolve this dependence, we model the score with a deep neural network that is learned on-the-fly by propagating a set of samples according to the instantaneous probability current. We show theoretically that the proposed approach controls the KL divergence from the learned solution to the target, while learning on external samples from the stochastic differential equation does not control either direction of the KL divergence. Empirically, we consider several high-dimensional Fokker-Planck equations from the physics of interacting particle systems. We find that the method accurately matches analytical solutions when they are available as well as moments computed via Monte-Carlo when they are not. Moreover, the method offers compelling predictions for the global entropy production rate that out-perform those obtained from learning on stochastic trajectories, and can effectively capture non-equilibrium steady-state probability currents over long time intervals.

categories: cs.LG cond-mat.dis-nn cond-mat.stat-mech cs.NA math.NA math.PR


title: On the Performance of the Neyman Allocation with Small Pilots

abstract: The Neyman Allocation is used in many papers on experimental design, which typically assume that researchers have access to large pilot studies. This may be unrealistic. To understand the properties of the Neyman Allocation with small pilots, we study its behavior in an asymptotic framework that takes pilot size to be fixed even as the size of the main wave tends to infinity. Our analysis shows that the Neyman Allocation can lead to estimates of the ATE with higher asymptotic variance than with (non-adaptive) balanced randomization. In particular, this happens when the outcome variable is relatively homoskedastic with respect to treatment status or when it exhibits high kurtosis. We provide a series of empirical examples showing that such situations can arise in practice. Our results suggest that researchers with small pilots should not use the Neyman Allocation if they believe that outcomes are homoskedastic or heavy-tailed. Finally, we examine some potential methods for improving the finite sample performance of the FNA via simulations.


title: Quantifying Properties of Photospheric Magnetic Cancellations in the Quiet Sun Internetwork

abstract: We analyzed spectropolarimetric data from the Swedish 1-meter Solar Telescope to investigate physical properties of small-scale magnetic cancellations in the quiet Sun photosphere. Specifically, we looked at the full Stokes polarization profiles along the Fe I 557.6 nm and of the Fe I 630.1 nm lines measured by CRisp Imaging SpectroPolarimeter (CRISP) to study temporal evolution of the line-of-sight (LOS) magnetic field during 42.5 minutes of quiet Sun evolution. From this magnetogram sequence, we visually identified 38 cancellation events. We then used Yet Another Feature Tracking Algorithm (YAFTA) to characterize physical properties of these magnetic cancellations. We found on average $1.6\times10^{16}$ Mx of magnetic flux cancelled in each event with an average cancellation rate of $3.8\times10^{14}$ Mx s$^{-1}$. The derived cancelled flux is associated with strong downflows, with an average speed of $V_\mathrm{LOS}\approx1.1$ km s$^{-1}$. Our results show that the average lifetime of each event is $9.2$ minutes with an average $44.8\%$ of initial magnetic flux being cancelled. Our estimates of magnetic fluxes provide a lower limit since studied magnetic cancellation events have magnetic field values that are very close to the instrument noise level. We observed no horizontal magnetic fields at the cancellation sites and therefore can not conclude whether the events are associated structures that could cause magnetic reconnection.


title: Sub picosecond steering of ultrafast incoherent emission from semiconductor metasurfaces

abstract: The ability to dynamically steer fs pulses from a monolithically integrated source is a critical milestone for the fields of nanophotonics and ultrafast optics. The nascent field of reconfigurable metasurfaces -- made of optically resonant meta-atoms -- has shown great promise in manipulating light-matter interactions through subwavelength control of the phase, amplitude, and polarization of light. These active metasurfaces arbitrarily transform an incident wavefront using a reconfigurable spatial phase profile and thus have been limited to manipulating coherent external sources. Light emitting metasurfaces obtained through integration of incoherent emitters with meta-atoms, have been used to statically increase the quantum efficiency of the emission through Purcell factor enhancement and control the far-field emission properties of the light to collimate and focus spontaneous emission. Active manipulation of such incoherent light sources, however, remains a challenge as current phase-sensitive approaches used for coherent sources cannot be directly applied. Spatiotemporal control at ultrafast timescales of incoherent light emission could lead to a transformative technological leap allowing low-power light emitting diodes (LEDs) to replace high-power coherent laser sources, enabling holographic LED displays and other key optical transceiver applications including remote-sensing, perception, and high-speed optical communication systems. In this work, we theoretically predict and experimentally demonstrate for the first time, sub-picosecond steering over a 70{\deg} range of ultrafast incoherent emission from a light emitting metasurface.


title: Minimax Optimal Algorithms for Fixed-Budget Best Arm Identification

abstract: We consider the fixed-budget best arm identification problem where the goal is to find the arm of the largest mean with a fixed number of samples. It is known that the probability of misidentifying the best arm is exponentially small to the number of rounds. However, limited characterizations have been discussed on the rate (exponent) of this value. In this paper, we characterize the minimax optimal rate as a result of an optimization over all possible parameters. We introduce two rates, $R^{\mathrm{go}}$ and $R^{\mathrm{go}}_{\infty}$, corresponding to lower bounds on the probability of misidentification, each of which is associated with a proposed algorithm. The rate $R^{\mathrm{go}}$ is associated with $R^{\mathrm{go}}$-tracking, which can be efficiently implemented by a neural network and is shown to outperform existing algorithms. However, this rate requires a nontrivial condition to be achievable. To address this issue, we introduce the second rate $R^{\mathrm{go}}_\infty$. We show that this rate is indeed achievable by introducing a conceptual algorithm called delayed optimal tracking (DOT).


title: VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution

abstract: Videos typically record the streaming and continuous visual data as discrete consecutive frames. Since the storage cost is expensive for videos of high fidelity, most of them are stored in a relatively low resolution and frame rate. Recent works of Space-Time Video Super-Resolution (STVSR) are developed to incorporate temporal interpolation and spatial super-resolution in a unified framework. However, most of them only support a fixed up-sampling scale, which limits their flexibility and applications. In this work, instead of following the discrete representations, we propose Video Implicit Neural Representation (VideoINR), and we show its applications for STVSR. The learned implicit neural representation can be decoded to videos of arbitrary spatial resolution and frame rate. We show that VideoINR achieves competitive performances with state-of-the-art STVSR methods on common up-sampling scales and significantly outperforms prior works on continuous and out-of-training-distribution scales. Our project page is at http://zeyuan-chen.com/VideoINR/ .


title: Weighing the Darkness III: How Gaia Could, but Probably Won't, Astrometrically Detect Free-Floating Black Holes

abstract: The gravitational pull of an unseen companion to a luminous star is well-known to cause deviations to the parallax and proper motion of a star. In a previous paper in this series, we argue that the astrometric mission Gaia can identify long-period binaries by precisely measuring these arcs. An arc in a star's path can also be caused by a fly-by -- the hyperbolic encounter with another massive object. We quantify the apparent acceleration over time induced by a companion star as a function of the impact parameter, velocity of interaction, and companion mass. In principle, Gaia could be used to astrometrically identify the contribution of massive compact halo objects to the local dark matter potential of the Milky Way. However, after quantifying their rate and Gaia's sensitivity, we find that fly-bys are so rare that Gaia will probably never observe one. Therefore every star in the Gaia database exhibiting astrometric acceleration is likely in a long-period binary with another object. Nevertheless, we show how intermediate mass black holes, if they exist in the Solar Neighborhood, could be detected by the anomalously large accelerations they induce on nearby stars.


title: On a conjecture of De Giorgi about the phase-field approximation of the Willmore functional

abstract: In 1991 De Giorgi conjectured that, given $\lambda >0$, if $\mu_\varepsilon$ stands for the density of the Allen-Cahn energy and $v_\varepsilon$ represents its first variation, then $\int [v_\varepsilon^2 + \lambda] d\mu_\varepsilon$ should $\Gamma$-converge to $c\lambda \mathrm{Per}(E) + k \mathcal{W}(\Sigma)$ for some real constant $k$, where $\mathrm{Per}(E)$ is the perimeter of the set $E$, $\Sigma=\partial E$, $\mathcal{W}(\Sigma)$ is the Willmore functional, and $c$ is an explicit positive constant. A modified version of this conjecture was proved in space dimensions $2$ and $3$ by R\"oger and Sch\"atzle, when the term $\int v_\varepsilon^2 \, d\mu_\varepsilon$ is replaced by $ \int v_\varepsilon^2 {\varepsilon}^{-1} dx$, with a suitable $k>0$. In the present paper we show that, surprisingly, the original De Giorgi conjecture holds with $k=0$. Further properties on the limit measures obtained under a uniform control of the approximating energies are also provided.


title: Robust Performance Analysis of Cooperative Control Dynamics via Integral Quadratic Constraints

abstract: We study cooperative control dynamics with gradient based forcing terms. As a specific example, we focus on source-seeking dynamics with vehicles embedded in an unknown scalar field with a subset of agents having gradient information. As interaction mechanisms, formation control dynamics and flocking dynamics are considered. We leverage the framework of $\alpha$-integral quadratic constraints to obtain convergence rate estimates whenever exponential stability can be achieved. The communication graph and the interaction potential are assumed to be time-invariant and uncertain. Sufficient conditions take the form of linear matrix inequalities independent of the size of network. A derivation (purely in time-domain) of the so-called \textit{hard} Zames-Falb $\alpha$-IQCs involving general non-causal higher order multipliers is given along with a suitably adapted parameterization of the multipliers to the $\alpha$-IQC setting. The time-domain arguments facilitate a straightforward extension to linear parameter varying systems. Numerical examples illustrate the application of the theoretical results.


title: Gromov hyperbolicity of pseudo-convex Levi corank one domains

abstract: After a study of the Kobayashi metrics on certain scaled domains, we show the stabilities of the infinitesimal Kobayashi metrics and the integrated distances in different scaling processes. As an application, we prove that bounded pseudo-convex domains of finite type where the Levi form of every boundary point has corank one are Gromov hyperbolic with respect to the Kobayashi metric. The results in this note generalize Zimmer's and Fiacchi's related works on Gromov hyperbolicity of weakly pseudo-convex domains.


title: Family Floer mirror space for local SYZ singularities

abstract: We give a mathematically precise statement of SYZ conjecture between mirror space pairs and prove it for any toric Calabi-Yau manifold with Gross's special Lagrangian fibration. To date, it is the first time we realize the SYZ proposal with singular fibers beyond the topological level. The dual singular fibration is explicitly written and proved to be compatible with the family Floer mirror construction. We use both ideas of Kontsevich-Soibelman and Gross-Hacking-Keel-Siebert. Moreover, we discover that the Maurer-Cartan set of a singular Lagrangian is only a strict subset of the corresponding dual singular fiber. This responds negatively to the previous expectation and leads to new perspectives of SYZ singularities. As extra evidence, we also check some computations for a well-known folklore conjecture for the Landau-Ginzburg model.


title: Grothendieck classes of quadric hypersurfaces and involution varieties

abstract: In this article, by combining the recent theory of noncommutative motives with the classical theory of motives, we prove that if two quadrics (or, more generally, two involution varieties) have the same Grothendieck class, then they have the same even Clifford algebra and the same signature. As an application, we show in numerous cases (e.g., when the base field is a local or global field) that two quadrics (or, more generally, two involution varieties) have the same Grothendieck class if and only if they are isomorphic.


title: Photoinduced Band Renormalization Effects in ZrSiS Topological Nodal-line Semimetal

abstract: Out-of-equilibrium effects provide an elegant pathway to probing and understanding the underlying physics of topological materials. Creating exotic states of matter using ultrafast optical pulses in particular has shown promise towards controlling electronic band structure properties. Of recent interest is band renormalization in Dirac and Weyl semimetals as it leads to direct physical observables through the enhancement of the effective mass, or, in the shift of resonant energies. Here we provide experimental and theoretical signatures of photo-induced renormalization of the electronic band structure in a topological nodal line semimetal ZrSiS. Specifically, we show how the change of the transient reflectivity spectra under femtosecond optical excitations is induced by out-of-equilibrium effects that renormalize the kinetic energy of electrons. We associate the observed spectral shift to an enhancement of the effective mass and to a red-shift of the resonant frequency as a function of pump field strength. Finally, we show that the transient relaxation dynamics of the reflectivity is primarily an electronic effect with negligible phononic contribution. Our study presents the modifications of electronic properties in ZrSiS using ultrashort pulses, and demonstrates the potential of this approach in creating photo-induced phases in topological quantum mater through an all-optical route.


title: Towards Layer-wise Image Vectorization

abstract: Image rasterization is a mature technique in computer graphics, while image vectorization, the reverse path of rasterization, remains a major challenge. Recent advanced deep learning-based models achieve vectorization and semantic interpolation of vector graphs and demonstrate a better topology of generating new figures. However, deep models cannot be easily generalized to out-of-domain testing data. The generated SVGs also contain complex and redundant shapes that are not quite convenient for further editing. Specifically, the crucial layer-wise topology and fundamental semantics in images are still not well understood and thus not fully explored. In this work, we propose Layer-wise Image Vectorization, namely LIVE, to convert raster images to SVGs and simultaneously maintain its image topology. LIVE can generate compact SVG forms with layer-wise structures that are semantically consistent with human perspective. We progressively add new bezier paths and optimize these paths with the layer-wise framework, newly designed loss functions, and component-wise path initialization technique. Our experiments demonstrate that LIVE presents more plausible vectorized forms than prior works and can be generalized to new images. With the help of this newly learned topology, LIVE initiates human editable SVGs for both designers and other downstream applications. Codes are made available at https://github.com/Picsart-AI-Research/LIVE-Layerwise-Image-Vectorization.


title: Simple Cues Lead to a Strong Multi-Object Tracker

abstract: For a long time, the most common paradigm in Multi-Object Tracking was tracking-by-detection (TbD), where objects are first detected and then associated over video frames. For association, most models resourced to motion and appearance cues, e.g., re-identification networks. Recent approaches based on attention propose to learn the cues in a data-driven manner, showing impressive results. In this paper, we ask ourselves whether simple good old TbD methods are also capable of achieving the performance of end-to-end models. To this end, we propose two key ingredients that allow a standard re-identification network to excel at appearance-based tracking. We extensively analyse its failure cases, and show that a combination of our appearance features with a simple motion model leads to strong tracking results. Our tracker generalizes to four public datasets, namely MOT17, MOT20, BDD100k, and DanceTrack, achieving state-of-the-art performance. https://github.com/dvl-tum/GHOST.


title: Maximally symmetric nonlinear extension of electrodynamics and charged particles

abstract: We consider couplings of electrically and magnetically charged sources to the maximally symmetric non-linear extension of Maxwell's theory called ModMax. The aim is to reveal physical effects which distinguish ModMax from Maxwell's electrodynamics. We find that, in contrast to generic models of non-linear electrodynamics, Lienard-Wiechert fields induced by a moving electric or magnetic particle, or a dyon are exact solutions of the ModMax equations of motion. We then study whether and how ModMax non-linearity affects properties of electromagnetic interactions of charged objects, in particular the Lorentz force, the Coulomb law, the Lienard-Wiechert fields, Dirac's and Schwinger's quantization of electric and magnetic charges, and the Compton Effect. In passing we also present an alternative form of the ModMax Lagrangian in terms of the coupling of Maxwell's theory to axion-dilaton-like auxiliary scalar fields which may be relevant for revealing the effective field theory origin of ModMax.


title: BigVGAN: A Universal Neural Vocoder with Large-Scale Training

abstract: Despite recent progress in generative adversarial network (GAN)-based vocoders, where the model generates raw waveform conditioned on acoustic features, it is challenging to synthesize high-fidelity audio for numerous speakers across various recording environments. In this work, we present BigVGAN, a universal vocoder that generalizes well for various out-of-distribution scenarios without fine-tuning. We introduce periodic activation function and anti-aliased representation into the GAN generator, which brings the desired inductive bias for audio synthesis and significantly improves audio quality. In addition, we train our GAN vocoder at the largest scale up to 112M parameters, which is unprecedented in the literature. We identify and address the failure modes in large-scale GAN training for audio, while maintaining high-fidelity output without over-regularization. Our BigVGAN, trained only on clean speech (LibriTTS), achieves the state-of-the-art performance for various zero-shot (out-of-distribution) conditions, including unseen speakers, languages, recording environments, singing voices, music, and instrumental audio. We release our code and model at: https://github.com/NVIDIA/BigVGAN


title: Jewelry Shop Conversational Chatbot

abstract: Since the advent of chatbots in the commercial sector, they have been widely employed in the customer service department. Typically, these commercial chatbots are retrieval-based, so they are unable to respond to queries absent in the provided dataset. On the contrary, generative chatbots try to create the most appropriate response, but are mostly unable to create a smooth flow in the customer-bot dialog. Since the client has few options left for continuing after receiving a response, the dialog becomes short. Through our work, we try to maximize the intelligence of a simple conversational agent so it can answer unseen queries, and generate follow-up questions or remarks. We have built a chatbot for a jewelry shop that finds the underlying objective of the customer's query by finding similarity of the input to patterns in the corpus. Our system features an audio input interface for clients, so they may speak to it in natural language. After converting the audio to text, we trained the model to extract the intent of the query, to find an appropriate response and to speak to the client in a natural human voice. To gauge the system's performance, we used performance metrics such as Recall, Precision and F1 score.


title: Large deviation principle for random permutations

abstract: We derive a large deviation principle for random permutations induced by probability measures of the unit square, called permutons. These permutations are called $\mu$-random permutations. We also introduce and study a new general class of models of random permutations, called Gibbs permutation models, which combines and generalizes $\mu$-random permutations and the celebrated Mallows model for permutations. Most of our results hold in the general setting of Gibbs permutation models. We apply the tools that we develop to the case of $\mu$-random permutations conditioned to have an atypical proportion of patterns. Several results are made more concrete in the specific case of inversions. For instance, we prove the existence of at least one phase transition for a generalized version of the Mallows model where the base measure is non-uniform. This is in contrast with the results of Starr (2009, 2018) on the (standard) Mallows model, where the absence of phase transition, i.e., phase uniqueness, was proven. Our results naturally lead us to investigate a new notion of permutons, called conditionally constant permutons, which generalizes both pattern-avoiding and pattern-packing permutons. We describe some properties of conditionally constant permutons with respect to inversions. The study of conditionally constant permutons for general patterns seems to be a challenging problem.


title: Distillation Decision Tree

abstract: Machine learning models, particularly the black-box models, are widely favored for their outstanding predictive capabilities. However, they often face scrutiny and criticism due to the lack of interpretability. Paradoxically, their strong predictive capabilities suggest a deep understanding about the underlying data, implying significant potential for interpretation. Leveraging the emerging concept of knowledge distillation, we introduced the method of distillation decision tree (DDT). This method enables the distillation of knowledge about the data from a black-box model into a decision tree, thereby facilitating the interpretation of the black-box model. Constructed through the knowledge distillation process, the interpretability of DDT relies significantly on the stability of its structure. We establish the theoretical foundations for the structural stability of DDT, demonstrating that its structure can achieve stability under mild assumptions. Furthermore, we develop algorithms for efficient construction of (hybrid) DDTs. A comprehensive simulation study validates DDT's ability to provide accurate and reliable interpretations. Additionally, we explore potential application scenarios and provide corresponding case studies to illustrate how DDT can be applied to real-world problems.


title: DiSparse: Disentangled Sparsification for Multitask Model Compression

abstract: Despite the popularity of Model Compression and Multitask Learning, how to effectively compress a multitask model has been less thoroughly analyzed due to the challenging entanglement of tasks in the parameter space. In this paper, we propose DiSparse, a simple, effective, and first-of-its-kind multitask pruning and sparse training scheme. We consider each task independently by disentangling the importance measurement and take the unanimous decisions among all tasks when performing parameter pruning and selection. Our experimental results demonstrate superior performance on various configurations and settings compared to popular sparse training and pruning methods. Besides the effectiveness in compression, DiSparse also provides a powerful tool to the multitask learning community. Surprisingly, we even observed better performance than some dedicated multitask learning methods in several cases despite the high model sparsity enforced by DiSparse. We analyzed the pruning masks generated with DiSparse and observed strikingly similar sparse network architecture identified by each task even before the training starts. We also observe the existence of a "watershed" layer where the task relatedness sharply drops, implying no benefits in continued parameters sharing. Our code and models will be available at: https://github.com/SHI-Labs/DiSparse-Multitask-Model-Compression.


title: Provably efficient variational generative modeling of quantum many-body systems via quantum-probabilistic information geometry

abstract: The dual tasks of quantum Hamiltonian learning and quantum Gibbs sampling are relevant to many important problems in physics and chemistry. In the low temperature regime, algorithms for these tasks often suffer from intractabilities, for example from poor sample- or time-complexity. With the aim of addressing such intractabilities, we introduce a generalization of quantum natural gradient descent to parameterized mixed states, as well as provide a robust first-order approximating algorithm, Quantum-Probabilistic Mirror Descent. We prove data sample efficiency for the dual tasks using tools from information geometry and quantum metrology, thus generalizing the seminal result of classical Fisher efficiency to a variational quantum algorithm for the first time. Our approaches extend previously sample-efficient techniques to allow for flexibility in model choice, including to spectrally-decomposed models like Quantum Hamiltonian-Based Models, which may circumvent intractable time complexities. Our first-order algorithm is derived using a novel quantum generalization of the classical mirror descent duality. Both results require a special choice of metric, namely, the Bogoliubov-Kubo-Mori metric. To test our proposed algorithms numerically, we compare their performance to existing baselines on the task of quantum Gibbs sampling for the transverse field Ising model. Finally, we propose an initialization strategy leveraging geometric locality for the modelling of sequences of states such as those arising from quantum-stochastic processes. We demonstrate its effectiveness empirically for both real and imaginary time evolution while defining a broader class of potential applications.


title: On Data Scaling in Masked Image Modeling

abstract: An important goal of self-supervised learning is to enable model pre-training to benefit from almost unlimited data. However, one method that has recently become popular, namely masked image modeling (MIM), is suspected to be unable to benefit from larger data. In this work, we break this misconception through extensive experiments, with data scales ranging from 10\% of ImageNet-1K to full ImageNet-22K, model sizes ranging from 49 million to 1 billion, and training lengths ranging from 125K iterations to 500K iterations. Our study reveals that: (i) Masked image modeling is also demanding on larger data. We observed that very large models got over-fitted with relatively small data; (ii) The length of training matters. Large models trained with masked image modeling can benefit from more data with longer training; (iii) The validation loss in pre-training is a good indicator to measure how well the model performs for fine-tuning on multiple tasks. This observation allows us to pre-evaluate pre-trained models in advance without having to make costly trial-and-error assessments of downstream tasks. We hope that our findings will advance the understanding of masked image modeling in terms of scaling ability.


title: AGConv: Adaptive Graph Convolution on 3D Point Clouds

abstract: Convolution on 3D point clouds is widely researched yet far from perfect in geometric deep learning. The traditional wisdom of convolution characterises feature correspondences indistinguishably among 3D points, arising an intrinsic limitation of poor distinctive feature learning. In this paper, we propose Adaptive Graph Convolution (AGConv) for wide applications of point cloud analysis. AGConv generates adaptive kernels for points according to their dynamically learned features. Compared with the solution of using fixed/isotropic kernels, AGConv improves the flexibility of point cloud convolutions, effectively and precisely capturing the diverse relations between points from different semantic parts. Unlike the popular attentional weight schemes, AGConv implements the adaptiveness inside the convolution operation instead of simply assigning different weights to the neighboring points. Extensive evaluations clearly show that our method outperforms state-of-the-arts of point cloud classification and segmentation on various benchmark datasets.Meanwhile, AGConv can flexibly serve more point cloud analysis approaches to boost their performance. To validate its flexibility and effectiveness, we explore AGConv-based paradigms of completion, denoising, upsampling, registration and circle extraction, which are comparable or even superior to their competitors. Our code is available at https://github.com/hrzhou2/AdaptConv-master.


title: Diffuse radio emission from non-Planck galaxy clusters in the LoTSS-DR2 fields

abstract: The presence of large-scale magnetic fields and ultra-relativistic electrons in the intra-cluster medium (ICM) is confirmed through the detection of diffuse radio synchrotron sources, so-called radio halos and relics. Due to their steep-spectrum nature, these sources are rarely detected at frequencies above a few GHz, especially in low-mass systems. The aim of this study is to discover and characterise diffuse radio sources in low-mass galaxy clusters in order to understand their origin and their scaling with host cluster properties. We searched for cluster-scale radio emission from low-mass galaxy clusters in the Low Frequency Array (LOFAR) Two-metre Sky Survey - Data Release 2 (LoTSS-DR2) fields. We made use of existing optical (Abell, DESI, WHL) and X-ray (comPRASS, MCXC) catalogues. The LoTSS-DR2 data were processed further to improve the quality of the images that are used to detect and characterize diffuse sources. We have detected diffuse radio emission in 28 galaxy clusters. The number of confirmed (candidates) halos and relics are six (seven) and 10 (three), respectively. Among these, 11 halos and 10 relics, including candidates, are newly discovered by LOFAR. Beside these, five diffuse sources are detected in tailed radio galaxies and are probably associated with mergers during the formation of the host clusters. We are unable to classify other 13 diffuse sources. We compare our newly detected, diffuse sources to known sources by placing them on the scaling relation between the radio power and the mass of the host clusters.


title: Extreme Masking for Learning Instance and Distributed Visual Representations

abstract: The paper presents a scalable approach for learning spatially distributed visual representations over individual tokens and a holistic instance representation simultaneously. We use self-attention blocks to represent spatially distributed tokens, followed by cross-attention blocks to aggregate the holistic image instance. The core of the approach is the use of extremely large token masking (75\%-90\%) as the data augmentation for supervision. Our model, named ExtreMA, follows the plain BYOL approach where the instance representation from the unmasked subset is trained to predict that from the intact input. Instead of encouraging invariance across inputs, the model is required to capture informative variations in an image. The paper makes three contributions: 1) It presents random masking as a strong and computationally efficient data augmentation for siamese representation learning. 2) With multiple sampling per instance, extreme masking greatly speeds up learning and improves performance with more data. 3) ExtreMA obtains stronger linear probing performance than masked modeling methods, and better transfer performance than prior contrastive models.


title: GateHUB: Gated History Unit with Background Suppression for Online Action Detection

abstract: Online action detection is the task of predicting the action as soon as it happens in a streaming video. A major challenge is that the model does not have access to the future and has to solely rely on the history, i.e., the frames observed so far, to make predictions. It is therefore important to accentuate parts of the history that are more informative to the prediction of the current frame. We present GateHUB, Gated History Unit with Background Suppression, that comprises a novel position-guided gated cross-attention mechanism to enhance or suppress parts of the history as per how informative they are for current frame prediction. GateHUB further proposes Future-augmented History (FaH) to make history features more informative by using subsequently observed frames when available. In a single unified framework, GateHUB integrates the transformer's ability of long-range temporal modeling and the recurrent model's capacity to selectively encode relevant information. GateHUB also introduces a background suppression objective to further mitigate false positive background frames that closely resemble the action frames. Extensive validation on three benchmark datasets, THUMOS, TVSeries, and HDD, demonstrates that GateHUB significantly outperforms all existing methods and is also more efficient than the existing best work. Furthermore, a flow-free version of GateHUB is able to achieve higher or close accuracy at 2.8x higher frame rate compared to all existing methods that require both RGB and optical flow information for prediction.


title: Beyond RGB: Scene-Property Synthesis with Neural Radiance Fields

abstract: Comprehensive 3D scene understanding, both geometrically and semantically, is important for real-world applications such as robot perception. Most of the existing work has focused on developing data-driven discriminative models for scene understanding. This paper provides a new approach to scene understanding, from a synthesis model perspective, by leveraging the recent progress on implicit 3D representation and neural rendering. Building upon the great success of Neural Radiance Fields (NeRFs), we introduce Scene-Property Synthesis with NeRF (SS-NeRF) that is able to not only render photo-realistic RGB images from novel viewpoints, but also render various accurate scene properties (e.g., appearance, geometry, and semantics). By doing so, we facilitate addressing a variety of scene understanding tasks under a unified framework, including semantic segmentation, surface normal estimation, reshading, keypoint detection, and edge detection. Our SS-NeRF framework can be a powerful tool for bridging generative learning and discriminative learning, and thus be beneficial to the investigation of a wide range of interesting problems, such as studying task relationships within a synthesis paradigm, transferring knowledge to novel tasks, facilitating downstream discriminative tasks as ways of data augmentation, and serving as auto-labeller for data creation.


title: PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies

abstract: PointNet++ is one of the most influential neural architectures for point cloud understanding. Although the accuracy of PointNet++ has been largely surpassed by recent networks such as PointMLP and Point Transformer, we find that a large portion of the performance gain is due to improved training strategies, i.e. data augmentation and optimization techniques, and increased model sizes rather than architectural innovations. Thus, the full potential of PointNet++ has yet to be explored. In this work, we revisit the classical PointNet++ through a systematic study of model training and scaling strategies, and offer two major contributions. First, we propose a set of improved training strategies that significantly improve PointNet++ performance. For example, we show that, without any change in architecture, the overall accuracy (OA) of PointNet++ on ScanObjectNN object classification can be raised from 77.9% to 86.1%, even outperforming state-of-the-art PointMLP. Second, we introduce an inverted residual bottleneck design and separable MLPs into PointNet++ to enable efficient and effective model scaling and propose PointNeXt, the next version of PointNets. PointNeXt can be flexibly scaled up and outperforms state-of-the-art methods on both 3D classification and segmentation tasks. For classification, PointNeXt reaches an overall accuracy of 87.7 on ScanObjectNN, surpassing PointMLP by 2.3%, while being 10x faster in inference. For semantic segmentation, PointNeXt establishes a new state-of-the-art performance with 74.9% mean IoU on S3DIS (6-fold cross-validation), being superior to the recent Point Transformer. The code and models are available at https://github.com/guochengqian/pointnext.


title: Open Challenges in Deep Stereo: the Booster Dataset

abstract: We present a novel high-resolution and challenging stereo dataset framing indoor scenes annotated with dense and accurate ground-truth disparities. Peculiar to our dataset is the presence of several specular and transparent surfaces, i.e. the main causes of failures for state-of-the-art stereo networks. Our acquisition pipeline leverages a novel deep space-time stereo framework which allows for easy and accurate labeling with sub-pixel precision. We release a total of 419 samples collected in 64 different scenes and annotated with dense ground-truth disparities. Each sample include a high-resolution pair (12 Mpx) as well as an unbalanced pair (Left: 12 Mpx, Right: 1.1 Mpx). Additionally, we provide manually annotated material segmentation masks and 15K unlabeled samples. We evaluate state-of-the-art deep networks based on our dataset, highlighting their limitations in addressing the open challenges in stereo and drawing hints for future research.


title: Overcoming the Spectral Bias of Neural Value Approximation

abstract: Value approximation using deep neural networks is at the heart of off-policy deep reinforcement learning, and is often the primary module that provides learning signals to the rest of the algorithm. While multi-layer perceptron networks are universal function approximators, recent works in neural kernel regression suggest the presence of a spectral bias, where fitting high-frequency components of the value function requires exponentially more gradient update steps than the low-frequency ones. In this work, we re-examine off-policy reinforcement learning through the lens of kernel regression and propose to overcome such bias via a composite neural tangent kernel. With just a single line-change, our approach, the Fourier feature networks (FFN) produce state-of-the-art performance on challenging continuous control domains with only a fraction of the compute. Faster convergence and better off-policy stability also make it possible to remove the target network without suffering catastrophic divergences, which further reduces TD}(0)'s estimation bias on a few tasks.


title: Neural Prompt Search

abstract: The size of vision models has grown exponentially over the last few years, especially after the emergence of Vision Transformer. This has motivated the development of parameter-efficient tuning methods, such as learning adapter layers or visual prompt tokens, which allow a tiny portion of model parameters to be trained whereas the vast majority obtained from pre-training are frozen. However, designing a proper tuning method is non-trivial: one might need to try out a lengthy list of design choices, not to mention that each downstream dataset often requires custom designs. In this paper, we view the existing parameter-efficient tuning methods as "prompt modules" and propose Neural prOmpt seArcH (NOAH), a novel approach that learns, for large vision models, the optimal design of prompt modules through a neural architecture search algorithm, specifically for each downstream dataset. By conducting extensive experiments on over 20 vision datasets, we demonstrate that NOAH (i) is superior to individual prompt modules, (ii) has a good few-shot learning ability, and (iii) is domain-generalizable. The code and models are available at https://github.com/Davidzhangyuanhan/NOAH.


title: Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs

abstract: To build an artificial neural network like the biological intelligence system, recent works have unified numerous tasks into a generalist model, which can process various tasks with shared parameters and do not have any task-specific modules. While generalist models achieve promising results on various benchmarks, they have performance degradation on some tasks compared with task-specialized models. In this work, we find that interference among different tasks and modalities is the main factor to this phenomenon. To mitigate such interference, we introduce the Conditional Mixture-of-Experts (Conditional MoEs) to generalist models. Routing strategies under different levels of conditions are proposed to take both the training/inference cost and generalization ability into account. By incorporating the proposed Conditional MoEs, the recently proposed generalist model Uni-Perceiver can effectively mitigate the interference across tasks and modalities, and achieves state-of-the-art results on a series of downstream tasks via prompt tuning on 1% of downstream data. Moreover, the introduction of Conditional MoEs still holds the generalization ability of generalist models to conduct zero-shot inference on new tasks, e.g., video-text retrieval and video caption. Code and pre-trained generalist models shall be released.


title: Deep Convolutional Ritz Method: Parametric PDE surrogates without labeled data

abstract: Parametric surrogate models for partial differential equations (PDEs) are a necessary component for many applications in the computational sciences, and convolutional neural networks (CNNs) have proved as an excellent tool to generate these surrogates when parametric fields are present. CNNs are commonly trained on labeled data based on one-to-one sets of parameter-input and PDE-output fields. Recently, residual-based convolutional physics-informed neural network (CPINN) solvers for parametric PDEs have been proposed to build surrogates without the need for labeled data. These allow for the generation of surrogates without an expensive offline-phase. In this work, we present an alternative formulation termed Deep Convolutional Ritz Method (DCRM) as a parametric PDE solver. The approach is based on the minimization of energy functionals, which lowers the order of the differential operators compared to residual-based methods. Based on studies involving the Poisson equation with a spatially parameterized source term and boundary conditions, we found that CNNs trained on labeled data outperform CPINNs in convergence speed and generalization ability. Surrogates generated from DCRM, however, converge significantly faster than their CPINN counterparts and prove to generalize faster and better than surrogates obtained from both CNNs trained on labeled data and CPINNs. This hints that DCRM could make PDE solution surrogates trained without labeled data possible.


title: Extending Momentum Contrast with Cross Similarity Consistency Regularization

abstract: Contrastive self-supervised representation learning methods maximize the similarity between the positive pairs, and at the same time tend to minimize the similarity between the negative pairs. However, in general the interplay between the negative pairs is ignored as they do not put in place special mechanisms to treat negative pairs differently according to their specific differences and similarities. In this paper, we present Extended Momentum Contrast (XMoCo), a self-supervised representation learning method founded upon the legacy of the momentum-encoder unit proposed in the MoCo family configurations. To this end, we introduce a cross consistency regularization loss, with which we extend the transformation consistency to dissimilar images (negative pairs). Under the cross consistency regularization rule, we argue that semantic representations associated with any pair of images (positive or negative) should preserve their cross-similarity under pretext transformations. Moreover, we further regularize the training loss by enforcing a uniform distribution of similarity over the negative pairs across a batch. The proposed regularization can easily be added to existing self-supervised learning algorithms in a plug-and-play fashion. Empirically, we report a competitive performance on the standard Imagenet-1K linear head classification benchmark. In addition, by transferring the learned representations to common downstream tasks, we show that using XMoCo with the prevalently utilized augmentations can lead to improvements in the performance of such tasks. We hope the findings of this paper serve as a motivation for researchers to take into consideration the important interplay among the negative examples in self-supervised learning.


title: On the Permanence of Backdoors in Evolving Models

abstract: Existing research on training-time attacks for deep neural networks (DNNs), such as backdoors, largely assume that models are static once trained, and hidden backdoors trained into models remain active indefinitely. In practice, models are rarely static but evolve continuously to address distribution drifts in the underlying data. This paper explores the behavior of backdoor attacks in time-varying models, whose model weights are continually updated via fine-tuning to adapt to data drifts. Our theoretical analysis shows how fine-tuning with fresh data progressively "erases" the injected backdoors, and our empirical study illustrates how quickly a time-varying model "forgets" backdoors under a variety of training and attack settings. We also show that novel fine-tuning strategies using smart learning rates can significantly accelerate backdoor forgetting. Finally, we discuss the need for new backdoor defenses that target time-varying models specifically.


title: ReCo: A Dataset for Residential Community Layout Planning

abstract: Layout planning is centrally important in the field of architecture and urban design. Among the various basic units carrying urban functions, residential community plays a vital part for supporting human life. Therefore, the layout planning of residential community has always been of concern, and has attracted particular attention since the advent of deep learning that facilitates the automated layout generation and spatial pattern recognition. However, the research circles generally suffer from the insufficiency of residential community layout benchmark or high-quality datasets, which hampers the future exploration of data-driven methods for residential community layout planning. The lack of datasets is largely due to the difficulties of large-scale real-world residential data acquisition and long-term expert screening. In order to address the issues and advance a benchmark dataset for various intelligent spatial design and analysis applications in the development of smart city, we introduce Residential Community Layout Planning (ReCo) Dataset, which is the first and largest open-source vector dataset related to real-world community to date. ReCo Dataset is presented in multiple data formats with 37,646 residential community layout plans, covering 598,728 residential buildings with height information. ReCo can be conveniently adapted for residential community layout related urban design tasks, e.g., generative layout design, morphological pattern recognition and spatial evaluation. To validate the utility of ReCo in automated residential community layout planning, two Generative Adversarial Network (GAN) based generative models are further applied to the dataset. We expect ReCo Dataset to inspire more creative and practical work in intelligent design and beyond. The ReCo Dataset is published at: https://www.kaggle.com/fdudsde/reco-dataset.


title: POODLE: Improving Few-shot Learning via Penalizing Out-of-Distribution Samples

abstract: In this work, we propose to use out-of-distribution samples, i.e., unlabeled samples coming from outside the target classes, to improve few-shot learning. Specifically, we exploit the easily available out-of-distribution samples to drive the classifier to avoid irrelevant features by maximizing the distance from prototypes to out-of-distribution samples while minimizing that of in-distribution samples (i.e., support, query data). Our approach is simple to implement, agnostic to feature extractors, lightweight without any additional cost for pre-training, and applicable to both inductive and transductive settings. Extensive experiments on various standard benchmarks demonstrate that the proposed method consistently improves the performance of pretrained networks with different architectures.


title: Some Optimisation Problems in Insurance with a Terminal Distribution Constraint

abstract: In this paper, we study two optimisation settings for an insurance company, under the constraint that the terminal surplus at a deterministic and finite time $T$ follows a normal distribution with a given mean and a given variance. In both cases, the surplus of the insurance company is assumed to follow a Brownian motion with drift. First, we allow the insurance company to pay dividends and seek to maximise the expected discounted dividend payments or to minimise the ruin probability under the terminal distribution constraint. Here, we find explicit expressions for the optimal strategies in both cases: in discrete and continuous time settings. Second, we let the insurance company buy a reinsurance contract for a pool of insured or a branch of business. To achieve a certain level of sustainability (i.e. the collected premia should be sufficient to buy reinsurance and to pay the occurring claims) the initial capital is set to be zero. We only allow for piecewise constant reinsurance strategies producing a normally distributed terminal surplus, whose mean and variance lead to a given Value at Risk or Expected Shortfall at some confidence level $\alpha$. We investigate the question which admissible reinsurance strategy produces a smaller ruin probability, if the ruin-checks are due at discrete deterministic points in time.


title: Gaussian Fourier Pyramid for Local Laplacian Filter

abstract: Multi-scale processing is essential in image processing and computer graphics. Halos are a central issue in multi-scale processing. Several edge-preserving decompositions resolve halos, e.g., local Laplacian filtering (LLF), by extending the Laplacian pyramid to have an edge-preserving property. Its processing is costly; thus, an approximated acceleration of fast LLF was proposed to linearly interpolate multiple Laplacian pyramids. This paper further improves the accuracy by Fourier series expansion, named Fourier LLF. Our results showed that Fourier LLF has a higher accuracy for the same number of pyramids. Moreover, Fourier LLF exhibits parameter-adaptive property for content-adaptive filtering. The code is available at: https://norishigefukushima.github.io/GaussianFourierPyramid/.


title: RT-DNAS: Real-time Constrained Differentiable Neural Architecture Search for 3D Cardiac Cine MRI Segmentation

abstract: Accurately segmenting temporal frames of cine magnetic resonance imaging (MRI) is a crucial step in various real-time MRI guided cardiac interventions. To achieve fast and accurate visual assistance, there are strict requirements on the maximum latency and minimum throughput of the segmentation framework. State-of-the-art neural networks on this task are mostly hand-crafted to satisfy these constraints while achieving high accuracy. On the other hand, while existing literature have demonstrated the power of neural architecture search (NAS) in automatically identifying the best neural architectures for various medical applications, they are mostly guided by accuracy, sometimes with computation complexity, and the importance of real-time constraints are overlooked. A major challenge is that such constraints are non-differentiable and are thus not compatible with the widely used differentiable NAS frameworks. In this paper, we present a strategy that directly handles real-time constraints in a differentiable NAS framework named RT-DNAS. Experiments on extended 2017 MICCAI ACDC dataset show that compared with state-of-the-art manually and automatically designed architectures, RT-DNAS is able to identify ones with better accuracy while satisfying the real-time constraints.


title: Molecular dynamics without molecules: searching the conformational space of proteins with generative neural networks

abstract: All-atom and coarse-grained molecular dynamics are two widely used computational tools to study the conformational states of proteins. Yet, these two simulation methods suffer from the fact that without access to supercomputing resources, the time and length scales at which these states become detectable are difficult to achieve. One alternative to such methods is based on encoding the atomistic trajectory of molecular dynamics as a shorthand version devoid of physical particles, and then learning to propagate the encoded trajectory through the use of artificial intelligence. Here we show that a simple textual representation of the frames of molecular dynamics trajectories as vectors of Ramachandran basin classes retains most of the structural information of the full atomistic representation of a protein in each frame, and can be used to generate equivalent atom-less trajectories suitable to train different types of generative neural networks. In turn, the trained generative models can be used to extend indefinitely the atom-less dynamics or to sample the conformational space of proteins from their representation in the models latent space. We define intuitively this methodology as molecular dynamics without molecules, and show that it enables to cover physically relevant states of proteins that are difficult to access with traditional molecular dynamics.