title: The structure of greedy-type bases in Tsirelson's space and its convexifications

abstract: Tsirelson's space $\mathcal{T}$ made its appearance in Banach space theory in 1974 soon to become one of the most significant counterexamples in the theory. Its structure broke the ideal pattern that analysts had conceived for a generic Banach space, thus giving rise to the era of pathological examples. Since then, many authors have contributed to the study of different aspects of this special space with an eye on better understanding its idiosyncrasies. In this paper we are concerned with the greedy-type basis structure of $\mathcal{T}$, a subject that had not been previously explored in the literature. More specifically, we show that Tsirelson's space and its convexifications $\mathcal{T}^{(p)}$ for $0<p<\infty$ have uncountably many non-equivalent greedy bases. We also investigate the conditional basis structure of spaces $\mathcal{T}^{(p)}$ in the range of $0<p<\infty$ and prove that they have uncountably many non-equivalent conditional almost greedy bases.


title: Vector invariants of permutation groups in characteristic zero

abstract: We consider a finite permutation group acting naturally on a vector space $V$ over a field $\Bbbk$. A well known theorem of G\"obel asserts that the corresponding ring of invariants $\Bbbk[V]^G$ is generated by invariants of degree at most $\binom{\dim V}{2}$. In this note we show that if the characteristic of $\Bbbk$ is zero then the top degree of vector coinvariants $\Bbbk[V^m]_G$ is also bounded above by $\binom{\dim V}{2}$, which implies the degree bound $\binom{\dim V}{2}+ 1$ for the ring of vector invariants $\Bbbk[V^m]^G$. So G\"obel's bound almost holds for vector invariants in characteristic zero as well.


title: Q-Ensemble for Offline RL: Don't Scale the Ensemble, Scale the Batch Size

abstract: Training large neural networks is known to be time-consuming, with the learning duration taking days or even weeks. To address this problem, large-batch optimization was introduced. This approach demonstrated that scaling mini-batch sizes with appropriate learning rate adjustments can speed up the training process by orders of magnitude. While long training time was not typically a major issue for model-free deep offline RL algorithms, recently introduced Q-ensemble methods achieving state-of-the-art performance made this issue more relevant, notably extending the training duration. In this work, we demonstrate how this class of methods can benefit from large-batch optimization, which is commonly overlooked by the deep offline RL community. We show that scaling the mini-batch size and naively adjusting the learning rate allows for (1) a reduced size of the Q-ensemble, (2) stronger penalization of out-of-distribution actions, and (3) improved convergence time, effectively shortening training duration by 3-4x times on average.


title: VER: Unifying Verbalizing Entities and Relations

abstract: Entities and relationships between entities are vital in the real world. Essentially, we understand the world by understanding entities and relations. For instance, to understand a field, e.g., computer science, we need to understand the relevant concepts, e.g., machine learning, and the relationships between concepts, e.g., machine learning and artificial intelligence. To understand a person, we should first know who he/she is and how he/she is related to others. To understand entities and relations, humans may refer to natural language descriptions. For instance, when learning a new scientific term, people usually start by reading its definition in dictionaries or encyclopedias. To know the relationship between two entities, humans tend to create a sentence to connect them. In this paper, we propose VER: a unified model for Verbalizing Entities and Relations. Specifically, we attempt to build a system that takes any entity or entity set as input and generates a sentence to represent entities and relations. Extensive experiments demonstrate that our model can generate high-quality sentences describing entities and entity relationships and facilitate various tasks on entities and relations, including definition modeling, relation modeling, and generative commonsense reasoning.


title: Directional self-propelled transport of coalesced droplets on a superhydrophilic cylindrical wire

abstract: Droplets coalescing on flat surfaces tend to end up with the smaller droplet migrating into the larger one. We report a counter-intuitive droplet coalescence pattern on a superhydrophilic cylindrical wire, where the larger droplet is pulled toward the smaller one. Consequently, the center of the combined mass significantly moves toward, often beyond, the original location of the smaller droplet. This phenomenon occurs primarily because the viscous friction that a droplet experiences on a cylindrical wire is not positively correlated with the size of the droplet, unlike the droplets coalescing on flat surfaces. We conducted a dimensional analysis based on a mass-spring-damper (MSD) model. Our model predicts a variety of coalescence patterns as a function of the ratio between droplet sizes, and the prediction matches the experimental observation.


title: Eventual Stability of pure polynomials over the rational field

abstract: A polynomial with rational coefficients is said to be pure with respect to a rational prime $p$ if its Newton polygon has one slope. In this article, we prove that the number of irreducible factors of the $n$-th iterate of a pure polynomial over the rational field $\mathbb Q$ is bounded independent of $n$. In other words, we show that pure polynomials are {\em eventually stable}. Consequently, several eventual stability results available in literature follow; including the eventual stability of the polynomial $x^d+c\in\mathbb{Q}[x]$, where $c\ne 0,1$, is not a reciprocal of an integer. In addition, we establish the dynamical irreducibility, i.e., the irreducibility of all iterates, of a subfamily of pure polynomials, namely Dumas polynomials with respect to a rational prime $p$ under a mild condition on the degree. This provides iterative techniques to produce irreducible polynomials in $\mathbb{Q}[x]$ by composing pure polynomials of different degrees. During the course of this work, we characterize all polynomials whose degrees are large enough that are not pure, yet they possess pure iterates. This implies the existence of polynomials whose shifts are all dynamically irreducible in $\mathbb{Z}[x]$.


title: Let Offline RL Flow: Training Conservative Agents in the Latent Space of Normalizing Flows

abstract: Offline reinforcement learning aims to train a policy on a pre-recorded and fixed dataset without any additional environment interactions. There are two major challenges in this setting: (1) extrapolation error caused by approximating the value of state-action pairs not well-covered by the training data and (2) distributional shift between behavior and inference policies. One way to tackle these problems is to induce conservatism - i.e., keeping the learned policies closer to the behavioral ones. To achieve this, we build upon recent works on learning policies in latent action spaces and use a special form of Normalizing Flows for constructing a generative model, which we use as a conservative action encoder. This Normalizing Flows action encoder is pre-trained in a supervised manner on the offline dataset, and then an additional policy model - controller in the latent space - is trained via reinforcement learning. This approach avoids querying actions outside of the training dataset and therefore does not require additional regularization for out-of-dataset actions. We evaluate our method on various locomotion and navigation tasks, demonstrating that our approach outperforms recently proposed algorithms with generative action models on a large portion of datasets.


title: Annual Benefit Analysis of Integrating the Seasonal Hydrogen Storage into the Renewable Power Grids

abstract: There has been growing interest in integrating hydrogen storage into power grids with high renewable penetration levels. The economic benefits and power grid reliability are both essential for hydrogen storage integration. In this paper, an annual scheduling model (ASM) for energy hubs (EH) coupled power grids is proposed to investigate the annual benefits of seasonal hydrogen storage (SHS). Each energy hub consists of hydrogen storage, electrolyzers, and fuel cells. The electrical and hydrogen energy can be exchanged on the bus with the energy hub. The physical constraints for both grids and EHs are enforced in ASM. The proposed ASM considers the intra-season daily operation of the EH coupled grids. Four typical daily profiles are used in ASM to represent the grid conditions in four seasons, which reduces the computational burden. Besides, both the intra-season and cross-season hydrogen exchange and storage are modeled in the ASM. Hence, the utilization of hydrogen storage is optimized on a year-round level. Numerical simulations are conducted on the IEEE 24-bus system. The simulation results indicate that seasonal hydrogen storage can effectively save the annual operation cost and reduce renewable curtailments.


title: Plasmon-magnon interactions in two-dimensional honeycomb magnets

abstract: Two-dimensional honeycomb ferromagnets offer the unprecedented opportunity to study interactions between collective modes that in standard bulk ferromagnets do not cross paths. Indeed, they harbor an optical spin-wave branch, i.e. a spin wave which disperses weakly near the Brillouin zone center. When doped with free carriers, they also host the typical gapless plasmonic mode of 2D itinerant electron/hole systems. When the plasmon branch meets the optical spin-wave branch, energy and momentum matching occurs, paving the way for interactions between the charge and spin sector. In this Letter we present a microscopic theory of such plasmon-magnon interactions, which is based on a double random phase approximation. We comment on the possibility to unveil this physics in recently isolated 2D honeycomb magnets such as ${\rm Cr}_2{\rm Ge}_2{\rm Te}_6$.


title: Effective equidistribution for some one parameter unipotent flows

abstract: We prove effective equidistribution theorems, with polynomial error rate, for orbits of the unipotent subgroups of $\operatorname{SL}_2(\mathbb R)$ in arithmetic quotients of $\operatorname{SL}_2(\mathbb C)$ and $\operatorname{SL}_2(\mathbb R)\times\operatorname{SL}_2(\mathbb R)$. The proof is based on the use of a Margulis function, tools from incidence geometry, and the spectral gap of the ambient space.


title: Data-driven Tracking of the Bounce-back Path after Disasters: Critical Milestones of Population Activity Recovery and Their Spatial Inequality

abstract: The ability to measure and track the speed and trajectory of a community's post-disaster recovery is essential to inform resource allocation and prioritization. The current survey-based approaches to examining community recovery, however, have significant lags and put the burden of data collection on affected people. Also, the existing literature lacks quantitative measures for important milestones to inform the assessment of recovery trajectory. Recognizing these gaps, this study uses location-based data related to visitation patterns and credit card transactions to specify critical recovery milestones related to population activity recovery. Using data from 2017 Hurricane Harvey in Harris County (Texas), the study specifies four critical post-disaster recovery milestones and calculates quantitative measurements of the length of time between the end of a hazard event and when the spatial areas (census tracts) reached these milestones based on fluctuations in visits to essential and non-essential facilities, and essential and non-essential credit card transactions. Accordingly, an integrated recovery metric is created for an overall measurement of each spatial area's recovery progression. Exploratory statistical analyses were conducted to examine whether variations in community recovery progression in achieving the critical milestones is correlated to its flood status, socioeconomic characteristics, and demographic composition. Finally, the extent of spatial inequality is examined. The results show the presence of moderate spatial inequality in population activity recovery in Hurricane Harvey, based upon which the inequality of recovery is measured. Results of this study can benefit post-disaster recovery resource allocation as well as improve community resilience towards future natural hazards.


title: Fine shape III: $\Delta$-spaces and $\nabla$-spaces

abstract: In this paper we obtain results indicating that fine shape is tractable and "not too strong" even in the non-locally compact case, and can be used to better understand infinite-dimensional metrizable spaces and their homology theories. We show that every Polish space $X$ is fine shape equivalent to the limit of an inverse sequence of simplicial maps between metric simplicial complexes. A deeper result is that if $X$ is locally finite dimensional, then the simplicial maps can be chosen to be non-degenerate. They cannot be chosen to be non-degenerate if $X$ is the Taylor compactum.


title: Fine shape II: A Whitehead-type theorem

abstract: We prove an "abelian, locally compact" Whitehead theorem in fine shape: A fine shape morphism between locally connected finite-dimensional locally compact separable metrizable spaces with trivial $\pi_0$ and $\pi_1$ is a fine shape equivalence if and only if it induces isomorphisms on the $\pi_i$ (=the Steenrod-Sitnikov homotopy groups). We show by an example that the hypothesis of local connectedness cannot be dropped (even though it can be dropped in the compact case). As a byproduct, we also show that for a locally compact separable metrizable space $X$, the Steenrod-Sitnikov homology $H_n(X)=0$ if and only if each compactum $K\subset X$ lies in a compactum $L\subset X$ such that the map $H_n(K)\to H_n(L)$ is trivial. A cornerstone result of the paper is purely algebraic: If a direct sequence of groups $\Gamma_0\to\Gamma_1\to\dots$ has trivial colimit, then it is trivial as an ind-group (i.e. each $\Gamma_i$ maps trivially to some $\Gamma_j$), as long as it has one of the following forms: $\bullet$ $\lim^1_i G_{i0}\to\lim^1_i G_{i1}\to\dots$, where the $G_{ij}$ are countable abelian groups; $\bullet$ $\lim_i G_{i0}\to\lim_i G_{i1}\to\dots$, where the $G_{ij}$ are finitely generated groups, which are either all abelian or satisfy the Mittag-Leffler condition for each $j$.


title: The Past Does Matter: Correlation of Subsequent States in Trajectory Predictions of Gaussian Process Models

abstract: Computing the distribution of trajectories from a Gaussian Process model of a dynamical system is an important challenge in utilizing such models. Motivated by the computational cost of sampling-based approaches, we consider approximations of the model's output and trajectory distribution. We show that previous work on uncertainty propagation, focussed on discrete state-space models, incorrectly included an independence assumption between subsequent states of the predicted trajectories. Expanding these ideas to continuous ordinary differential equation models, we illustrate the implications of this assumption and propose a novel piecewise linear approximation of Gaussian Processes to mitigate them.


title: Revisiting fundamental equations of fluid flow

abstract: The study rederives the fundamental equations of fluid flow and examines the inherent relationship between momentum conservation and mechanical energy conservation. It is shown that the material derivative of velocity is to depict the acceleration of fluid particles in Eulerian perspective, and momentum conservation and mechanical energy conservation are the same concept termed in different descriptions. According to the study, the traditional formula for energy conservation of fluid fails to distinguish the difference between physical quantities described in Lagrangian and Eulerian perspectives. The study simplifies the energy conservation of incompressible Newtonian fluid to be internal energy conservation.


title: Remarks on scalable frames

abstract: This paper investigates scalable frame in ${\mathbb R}^n$. We define the reduced diagram matrix of a frame and use it to classify scalability of the frame under some conditions. We give a new approach to the scaling problem by breaking the problem into two smaller ones, each of which is easily solved, giving a simple way to check scaling. Finally, we study the scalability of dual frames.


title: Efficient shallow learning as an alternative to deep learning

abstract: The realization of complex classification tasks requires training of deep learning (DL) architectures consisting of tens or even hundreds of convolutional and fully connected hidden layers, which is far from the reality of the human brain. According to the DL rationale, the first convolutional layer reveals localized patterns in the input and large-scale patterns in the following layers, until it reliably characterizes a class of inputs. Here, we demonstrate that with a fixed ratio between the depths of the first and second convolutional layers, the error rates of the generalized shallow LeNet architecture, consisting of only five layers, decay as a power law with the number of filters in the first convolutional layer. The extrapolation of this power law indicates that the generalized LeNet can achieve small error rates that were previously obtained for the CIFAR-10 database using DL architectures. A power law with a similar exponent also characterizes the generalized VGG-16 architecture. However, this results in a significantly increased number of operations required to achieve a given error rate with respect to LeNet. This power law phenomenon governs various generalized LeNet and VGG-16 architectures, hinting at its universal behavior and suggesting a quantitative hierarchical time-space complexity among machine learning architectures. Additionally, the conservation law along the convolutional layers, which is the square-root of their size times their depth, is found to asymptotically minimize error rates. The efficient shallow learning that is demonstrated in this study calls for further quantitative examination using various databases and architectures and its accelerated implementation using future dedicated hardware developments.


title: The Fell topology and the modular Gromov-Hausdorff propinquity

abstract: Given a unital AF-algebra $A$ equipped with a faithful tracial state, we equip each (norm-closed two-sided) ideal of $A$ with a metrized quantum vector bundle structure, when canonically viewed as a module over $A$, in the sense of Latr\'emoli\`ere using previous work of the first author and Latr\'emoli\`ere. Moreover, we show that convergence of ideals in the Fell topology implies convergence of the associated metrized quantum vector bundles in the modular Gromov-Hausdorff propinquity of Latr\'emoli\`ere. In a similar vein but requiring a different approach, given a compact metric space $(X,d)$, we equip each ideal of $C(X)$ with a metrized quantum vector bundle structure, and show that convergence in the Fell topology implies convergence in the modular Gromov-Hausdorff propinquity.


title: Microvalve-Based Tunability of Electrically Driven Ion Transport Through a Microfluidic System with Ion-Exchange Membrane

abstract: Microfluidic channels with embedded ion permselective medium under the application of electric current are commonly used for electrokinetic processes as on-chip ion concentration polarization (ICP) and bioparticle preconcentration to enhance biosensing. Herein, we demonstrate the ability to dynamically control the electrically driven ion transport by integrating individually addressable microvalves. The microvalves are located along a main microchannel that is uniformly coated with a thin layer of an ion-exchange membrane (IEM). The interplay of ionic transport between the solution within the microchannel and the thin IEM, under an applied electric current, can be locally tuned by the deformation of the microvalve. This tunability provides a robust and simple means of implementing new functionalities into lab-on-a-chip devices, e.g., dynamic control over multiple ICP layers and their associated preconcentrated molecule plugs, multiplex sensing, suppression of biofouling as well as plug dispersion, while maintaining the well-known application of microvalves as steric filtration.


title: Deep Learning on a Healthy Data Diet: Finding Important Examples for Fairness

abstract: Data-driven predictive solutions predominant in commercial applications tend to suffer from biases and stereotypes, which raises equity concerns. Prediction models may discover, use, or amplify spurious correlations based on gender or other protected personal characteristics, thus discriminating against marginalized groups. Mitigating gender bias has become an important research focus in natural language processing (NLP) and is an area where annotated corpora are available. Data augmentation reduces gender bias by adding counterfactual examples to the training dataset. In this work, we show that some of the examples in the augmented dataset can be not important or even harmful for fairness. We hence propose a general method for pruning both the factual and counterfactual examples to maximize the model's fairness as measured by the demographic parity, equality of opportunity, and equality of odds. The fairness achieved by our method surpasses that of data augmentation on three text classification datasets, using no more than half of the examples in the augmented dataset. Our experiments are conducted using models of varying sizes and pre-training settings.


title: $K$-Theory of Truncated Polynomials

abstract: We study the algebraic $K$-theory of rings of the form $R[x]/x^e$. We do this via trace methods and filtrations on topological Hochschild homology and related theories by quasisyntomic sheaves. We produce computations for $R$ a perfectoid ring in terms of the big Witt vectors of $R$, for $R$ a smooth curve over a perfectoid ring in terms of the prismatic cohomology of $R$, and for $R$ a complete mixed characteristic discrete valuation rings with perfect residue field in terms of the prismatic cohomology and Hodge-Tate divisor of $R$.


title: Spectral theorem approach to commutative C* -algebras generated by Toeplitz operators on the unit ball: quasi-elliptic related cases

abstract: We consider commutative C* -algebras of Toeplitz operators in the weighted Bergman space on the unit ball in $\mathbb{C}^{\mathbf{n}}$. For the algebras of elliptic type we find a new representation, namely as the algebra of operators which are functions of certain collections of commuting unbounded self-adjoint operators in the Bergman space.


title: Coherent Sheaves, Chern Classes, and Superconnections on Compact Complex-Analytic Manifolds

abstract: We construct a twist-closed enhancement of the category ${\mathcal D}^b_{\rm coh}(X)$, the bounded derived category of complexes of ${\mathcal O}_X$-modules with coherent cohomology, by means of the DG-category of $\bar\partial$-superconnections. Then we apply the techniques of $\bar\partial$-superconnections to define Chern classes and Bott-Chern classes of objects in the category, in particular, of coherent sheaves.


title: From Fake News to #FakeNews: Mining Direct and Indirect Relationships among Hashtags for Fake News Detection

abstract: The COVID-19 pandemic has gained worldwide attention and allowed fake news, such as ``COVID-19 is the flu,'' to spread quickly and widely on social media. Combating this coronavirus infodemic demands effective methods to detect fake news. To this end, we propose a method to infer news credibility from hashtags involved in news dissemination on social media, motivated by the tight connection between hashtags and news credibility observed in our empirical analyses. We first introduce a new graph that captures all (direct and \textit{indirect}) relationships among hashtags. Then, a language-independent semi-supervised algorithm is developed to predict fake news based on this constructed graph. This study first investigates the indirect relationship among hashtags; the proposed approach can be extended to any homogeneous graph to capture a comprehensive relationship among nodes. Language independence opens the proposed method to multilingual fake news detection. Experiments conducted on two real-world datasets demonstrate the effectiveness of our approach in identifying fake news, especially at an \textit{early} stage of propagation.


title: Semi-supervised Local Cluster Extraction by Compressive Sensing

abstract: Local clustering problem aims at extracting a small local structure inside a graph without the necessity of knowing the entire graph structure. As the local structure is usually small in size compared to the entire graph, one can think of it as a compressive sensing problem where the indices of target cluster can be thought as a sparse solution to a linear system. In this paper, we propose a new semi-supervised local cluster extraction approach by applying the idea of compressive sensing based on two pioneering works under the same framework. Our approves improves the existing works by making the initial cut to be the entire graph and hence overcomes a major limitation of existing works, which is the low quality of initial cut. Extensive experimental results on multiple benchmark datasets demonstrate the effectiveness of our approach.


title: Multifidelity Active Learning for Failure Estimation of TRISO Nuclear Fuel

abstract: The Tristructural isotropic (TRISO)-coated particle fuel is a robust nuclear fuel proposed to be used for multiple modern nuclear technologies. Therefore, characterizing its safety is vital for the reliable operation of nuclear technologies. However, the TRISO fuel failure probabilities are small and the computational model is time consuming to evaluate them using traditional Monte Carlo-type approaches. In the paper, we present a multifidelity active learning approach to efficiently estimate small failure probabilities given an expensive computational model. Active learning suggests the next best training set for optimal subsequent predictive performance and multifidelity modeling uses cheaper low-fidelity models to approximate the high-fidelity model output. After presenting the multifidelity active learning approach, we apply it to efficiently predict TRISO failure probability and make comparisons to the reference results.


title: Structure-Encoding Auxiliary Tasks for Improved Visual Representation in Vision-and-Language Navigation

abstract: In Vision-and-Language Navigation (VLN), researchers typically take an image encoder pre-trained on ImageNet without fine-tuning on the environments that the agent will be trained or tested on. However, the distribution shift between the training images from ImageNet and the views in the navigation environments may render the ImageNet pre-trained image encoder suboptimal. Therefore, in this paper, we design a set of structure-encoding auxiliary tasks (SEA) that leverage the data in the navigation environments to pre-train and improve the image encoder. Specifically, we design and customize (1) 3D jigsaw, (2) traversability prediction, and (3) instance classification to pre-train the image encoder. Through rigorous ablations, our SEA pre-trained features are shown to better encode structural information of the scenes, which ImageNet pre-trained features fail to properly encode but is crucial for the target navigation task. The SEA pre-trained features can be easily plugged into existing VLN agents without any tuning. For example, on Test-Unseen environments, the VLN agents combined with our SEA pre-trained features achieve absolute success rate improvement of 12% for Speaker-Follower, 5% for Env-Dropout, and 4% for AuxRN.


title: Hard Rod Hydrodynamics and the Levy Chentsov Field

abstract: We study the hydrodynamics of the hard rod model proposed by Boldrighini, Dobrushin and Soukhov by describing the displacement of each quasiparticle with respect to the corresponding ideal gas particle as a height difference in a related field. Starting with a family of nonhomogeneous Poisson processes contained in the position-velocity-length space $\mathbb{R}^3$, we show laws of large numbers for the quasiparticle positions and the length fields, and the joint convergence of the quasiparticle fluctuations to a Levy Chentsov field. We allow variable rod lengths, including negative lengths.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: The Internal Operads of Combinatory Algebras

abstract: We argue that operads provide a general framework for dealing with polynomials and combinatory completeness of combinatory algebras, including the classical $\mathbf{SK}$-algebras, linear $\mathbf{BCI}$-algebras, planar $\mathbf{BI}(\_)^\bullet$-algebras as well as the braided $\mathbf{BC^\pm I}$-algebras. We show that every extensional combinatory algebra gives rise to a canonical closed operad, which we shall call the internal operad of the combinatory algebra. The internal operad construction gives a left adjoint to the forgetful functor from closed operads to extensional combinatory algebras. As a by-product, we derive extensionality axioms for the classes of combinatory algebras mentioned above.


title: Counterfactual Learning with Multioutput Deep Kernels

abstract: In this paper, we address the challenge of performing counterfactual inference with observational data via Bayesian nonparametric regression adjustment, with a focus on high-dimensional settings featuring multiple actions and multiple correlated outcomes. We present a general class of counterfactual multi-task deep kernels models that estimate causal effects and learn policies proficiently thanks to their sample efficiency gains, while scaling well with high dimensions. In the first part of the work, we rely on Structural Causal Models (SCM) to formally introduce the setup and the problem of identifying counterfactual quantities under observed confounding. We then discuss the benefits of tackling the task of causal effects estimation via stacked coregionalized Gaussian Processes and Deep Kernels. Finally, we demonstrate the use of the proposed methods on simulated experiments that span individual causal effects estimation, off-policy evaluation and optimization.


title: Magnetic trapping of ultracold molecules at high density

abstract: Trapping ultracold molecules in conservative traps is essential for applications -- such as quantum state-controlled chemistry, quantum simulations, and quantum information processing. These applications require high densities or phase-space densities. We report magnetic trapping of NaLi molecules in the triplet ground state at high density ($\approx 10^{11} \; \rm{cm}^{-3}$) and ultralow temperature ($\approx 1\;{\rm \mu K}$). Magnetic trapping at these densities allows studies on both atom-molecule and molecule-molecule collisions in the ultracold regime in the absence of trapping light, which has often lead to undesired photo-chemistry. We measure the inelastic loss rates in a single spin sample and spin-mixtures of fermionic NaLi as well as spin-stretched NaLi$+$Na mixtures. We demonstrate sympathetic cooling of NaLi molecules in the magnetic trap by radio frequency evaporation of co-trapped Na atoms and observe an increase in the molecules' phase-space density by a factor of $\approx 16$.


title: Fourier series for the three-dimensional random flight

abstract: The probability density function of the random flight with isotropic initial conditions is obtained by an expansion in the number of collisions and the in the spatial harmonics of the solution, as in a Fourier series. The method holds for any dimension and is worked out in detail for the three dimensional case. In this case the probability density functions conditional to 1 and 2 collisions are also found using a different method, which yields them in terms of elementary functions and the polylogarithm function Li$_2$. The latter method is exact in the sense that one does not have to truncate a series, as in the first method. This provides a reference to decide where to truncate the series. A link is provided to a web page where the reader may download the series truncated at 132 collisions; for times larger than 100 times the average inter-collision time, the Gaussian approximations is used. The case in which the initial condition is a particle moving along a fixed direction is briefly considered.


title: On bilinear estimates and critical uniqueness classes for Navier-Stokes equations

abstract: We are concerned with bilinear estimates and uniqueness of mild solutions for the Navier-Stokes equations in critical spaces. For that, we construct general settings in which estimates for the bilinear term of the mild formulation hold true without using auxiliary norms such as Kato time-weighted ones. We first obtain necessary conditions in abstract critical spaces and then consider further structures to obtain the estimates in general classes of Besov, Morrey and Besov-Morrey spaces based on Banach spaces. Examples of applications are provided in different spaces as well as for other PDEs. In particular, as far as we know, the bilinear estimate and the uniqueness property obtained in the framework of Besov-weak-Herz spaces are not available in the existing literature. The proofs are mainly based on characterizations and estimates on the corresponding predual spaces.


title: Theoretical and Experimental Approach to p-Class Field Towers of Cyclic Cubic Number Fields

abstract: Cyclic number fields of odd prime degree are constructed as ray class fields over the rational number field. They are collected in multiplets sharing a common conductor and discriminant. The algorithms are implemented in Magma and applied to all cyclic quintic and cyclic cubic fields with conductors below 100000. Our primary attention is devoted to the theory of cyclic cubic fields with two or three prime divisors of the conductor. These fields form doublets and quartets. Theoretical techniques comprise cubic residue conditions between the primes dividing the conductor, the structure of 3-class groups of all components of doublets and quartets, Galois cohomology of unit groups and ambiguous principal ideals, absolute genus fields and their bicyclic bicubic subfields, class number relations, transfer kernels and abelian quotient invariants of unramified cyclic cubic extensions and their impact on the class field tower, pattern recognition via Artin transfers on descendant trees of finite groups with order a power of 3, the Shafarevich Theorem on the relation rank of the 3-class field tower group, and the Galois action on the tower group and on its metabelianization. Rigorous proofs are given for the first occurrences of three-stage towers over cyclic cubic fields with elementary bicyclic or tricyclic or non-elementary bicyclic 3-class group. Experimentally, the second p-class groups and the length of the p-class tower are determined for all conductors below 100000 and for p=2,3,5, with the exception of the few intricate octets. An interesting application is able to identify and realize the closed groups by Andozhskii and Tsvetkov.


title: New techniques to solve the 1-dimensional random flight

abstract: We present here two new techniques to solve the one-dimensional random flight. The first one is an expansion in the number of collisions. The second one is the obtention of a Fourier series. This second technique can be applied to an arbitrary number of dimensions. Some mathematical identities are obtained.


title: Flow through Pore-Size Graded Membrane Pore Networks

abstract: Pore-size gradients are often used in the design of membrane filters to increase filter lifetime and ensure fuller use of the initial membrane pore volume. In this work, we impose pore-size gradients in the setting of a membrane filter with an internal network of interconnected tube-like pores. We model the flow and foulant transport through the filter using the Hagen-Poiseuille framework coupled with advection equations via conservation of fluid and particle flux, with adsorption as the sole fouling mechanism. We study the influence of pore-size gradient on performance measures such as total filtrate throughput and accumulated contaminant concentration at the membrane downstream pore outlets. Within the limitations of our modeling assumptions we find that there is an optimal pore-radius gradient that maximizes filter efficiency independent of maximum pore length (an input parameter that influences the structure of the pore network), and that filters with longer characteristic pore length perform better.


title: Character sheaves in characteristic $p$ have nilpotent singular support

abstract: We prove that character sheaves have nilpotent singular support in any characteristic, partially extending the work of Mirkovic, Vilonen and independently Ginzburg to positive characteristic. We do this by introducing a category of tame perverse sheaves and studying its properties.


title: Taming Reachability Analysis of DNN-Controlled Systems via Abstraction-Based Training

abstract: The intrinsic complexity of deep neural networks (DNNs) makes it challenging to verify not only the networks themselves but also the hosting DNN-controlled systems. Reachability analysis of these systems faces the same challenge. Existing approaches rely on over-approximating DNNs using simpler polynomial models. However, they suffer from low efficiency and large overestimation, and are restricted to specific types of DNNs. This paper presents a novel abstraction-based approach to bypass the crux of over-approximating DNNs in reachability analysis. Specifically, we extend conventional DNNs by inserting an additional abstraction layer, which abstracts a real number to an interval for training. The inserted abstraction layer ensures that the values represented by an interval are indistinguishable to the network for both training and decision-making. Leveraging this, we devise the first black-box reachability analysis approach for DNN-controlled systems, where trained DNNs are only queried as black-box oracles for the actions on abstract states. Our approach is sound, tight, efficient, and agnostic to any DNN type and size. The experimental results on a wide range of benchmarks show that the DNNs trained by using our approach exhibit comparable performance, while the reachability analysis of the corresponding systems becomes more amenable with significant tightness and efficiency improvement over the state-of-the-art white-box approaches.


title: Local limit theorem for random walks on symmetric spaces

abstract: We reduce the local limit theorem for a non-compact semisimple Lie group acting on its symmetric space to establishing that a natural operator associated to the measure is quasicompact. Under strong Diophantine assumptions on the underlying measure, we deduce the necessary spectral results for the operator in question. We thereby give the first examples of finitely supported measures satisfying such a local limit theorem. Moreover, quantitative error rates for the local limit theorem are proved under additional assumptions.


title: H-FISTA: A hierarchical algorithm for phase retrieval with application to pulsar dynamic spectra

abstract: A pulsar dynamic spectrum is an inline digital hologram of the interstellar medium; it encodes information on the propagation paths by which signals have travelled from source to telescope. To decode the hologram it is necessary to "retrieve" the phases of the wavefield from intensity measurements, which directly gauge only the field modulus, by imposing additional constraints on the model. We present a new method for phase retrieval in the context of pulsar spectroscopy. Our method makes use of the Fast Iterative Shrinkage Thresholding Algorithm (FISTA) to obtain sparse models of the wavefield in a hierarchical approach with progressively increasing depth. Once the tail of the noise distribution is reached the hierarchy terminates with a final, unregularised optimisation. The result is a fully dense model of the complex wavefield that permits the discovery of faint signals by appropriate averaging. We illustrate the performance of our method on synthetic test cases and on real data. Our algorithm, which we call H-FISTA, is implemented in the Python programming language and is freely available.


title: Safe Stabilization for Stochastic Time-Delay Systems

abstract: This paper addresses the safe stabilization problem of stochastic nonlinear time-delay systems. Based on theKrasovskii approach, we first propose a stochastic control Lyapunov-Krasovskii functional to guarantee the stabilization objective and a stochastic control barrier-Krasovskii functional to ensure the safety objective. Both functionals are developed respectively for each control objectives for the first time. Since the optimization problem is not easy to be resolved for stochastic time-delay systems, we derive a sliding mode based approach to combine the proposed two functionals and to mediate stabilization and safety objectives, which allows to achieve the stabilization objective under the safety requirement. The proposed approach is illustrated via a numerical example.


title: Doubly Contrastive End-to-End Semantic Segmentation for Autonomous Driving under Adverse Weather

abstract: Road scene understanding tasks have recently become crucial for self-driving vehicles. In particular, real-time semantic segmentation is indispensable for intelligent self-driving agents to recognize roadside objects in the driving area. As prior research works have primarily sought to improve the segmentation performance with computationally heavy operations, they require far significant hardware resources for both training and deployment, and thus are not suitable for real-time applications. As such, we propose a doubly contrastive approach to improve the performance of a more practical lightweight model for self-driving, specifically under adverse weather conditions such as fog, nighttime, rain and snow. Our proposed approach exploits both image- and pixel-level contrasts in an end-to-end supervised learning scheme without requiring a memory bank for global consistency or the pretraining step used in conventional contrastive methods. We validate the effectiveness of our method using SwiftNet on the ACDC dataset, where it achieves up to 1.34%p improvement in mIoU (ResNet-18 backbone) at 66.7 FPS (2048x1024 resolution) on a single RTX 3080 Mobile GPU at inference. Furthermore, we demonstrate that replacing image-level supervision with self-supervision achieves comparable performance when pre-trained with clear weather images.


title: Vacuum-Induced Symmetry Breaking of Chiral Enantiomer Formation in Chemical Reactions

abstract: A material with symmetry breaking inside can transmit the symmetry breaking to its vicinity by vacuum electromagnetic fluctuations. Here, we show that vacuum quantum fluctuations proximate to a parity-symmetry-broken material can induce a chirality-dependent spectral shift of chiral molecules, resulting in a chemical reaction process that favors producing one chirality over the other. We calculate concrete examples and evaluate the chirality production rate with experimentally realizable parameters, showing the promise of selecting chirality with symmetry-broken vacuum quantum fluctuations.

categories: quant-ph cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph physics.optics


title: Enhancing Accuracy and Robustness of Steering Angle Prediction with Attention Mechanism

abstract: In this paper, our focus is on enhancing steering angle prediction for autonomous driving tasks. We initiate our exploration by investigating two veins of widely adopted deep neural architectures, namely ResNets and InceptionNets. Within both families, we systematically evaluate various model sizes to understand their impact on performance. Notably, our key contribution lies in the incorporation of an attention mechanism to augment steering angle prediction accuracy and robustness. By introducing attention, our models gain the ability to selectively focus on crucial regions within the input data, leading to improved predictive outcomes. Our findings showcase that our attention-enhanced models not only achieve state-of-the-art results in terms of steering angle Mean Squared Error (MSE) but also exhibit enhanced adversarial robustness, addressing critical concerns in real-world deployment. For example, in our experiments on the Kaggle SAP and our created publicly available datasets, attention can lead to over 6% error reduction in steering angle prediction and boost model robustness by up to 56.09%.


title: Electric dipole transition amplitudes for atoms and ions with one valence electron

abstract: Motivated by recent measurements for several alkali-metal atoms and alkali-metal-like ions, we perform a detailed study of electric dipole (E1) transition amplitudes in K, Ca+, Rb, Sr+, Cs, Ba+, Fr, and Ra+, which are of interest for studies of atomic parity violation, electric dipole moments, and polarizabilities. Using the all-orders correlation potential method, we perform high-precision calculations of E1 transition amplitudes between low-lying s, p, and d states. We perform a robust error analysis, and compare our calculations to many amplitudes for which there are high-precision experimental determinations. We find excellent agreement, with deviations at the level of ~0.1%. We also compare our results to other theoretical evaluations, and discuss the implications for uncertainty analyses. Further, combining calculations of branching ratios with recent measurements, we extract high-precision values for several E1 amplitudes of Ca+, Sr+, Cs, Fr, and Ra+.


title: Biasymptotically quasiperiodic solutions for time-dependent Hamiltonians

abstract: In a previous work [Asymptotically quasiperiodic solutions for time-dependent Hamiltonians, arXiv preprint arXiv:2211.06623 (2022)], we consider time-dependent perturbations of a Hamiltonian vector field having an invariant torus supporting quasiperiodic solutions. Assuming the perturbation decays polynomially fast as time tends to infinity, we prove the existence of an asymptotic KAM torus. An asymptotic KAM torus is a time-dependent family of embedded tori converging as time tends to infinity to the invariant torus associated with the unperturbed system. Now, it is quite natural to wonder when we have the existence of a biasymptotic KAM torus. That is a continuous time-dependent family of embedded tori converging in the future and the past to suitable quasiperiodic invariant tori. In this work, we go one step further. We analyze time-dependent perturbations of integrable and near-integrable Hamiltonians. Assuming the perturbation decays polynomially fast in time, we prove the existence of orbit converging to some quasiperiodic solutions in the future and the past.


title: Wood traceability system using blockchain and zero-knowledge proof

abstract: The system proposed in this study uses zero-knowledge proof (ZKP) to verify the traceability of wood recorded in a public blockchain. Wood is a byproduct of several states, ranging from standing trees to logs, lumber, and wood products (hereinafter ``wood objects''). The advantage of using the blockchain for record keeping is that participants can freely record the information at their discretion, without any restrictions. However, the openness of the blockchain may allow a malicious third party to introduce disinformation. In this study, we employ ZKP and near-field communication (NFC) chips to eliminate the possibility of disinformation introduction. ZKP is used to prove/validate changes in the state of wood objects, and the unique nonce associated with that state is encrypted and recorded on an NFC chip. The nonce is concealed and id of the wood object is defined as hash value of this nonce. We developed a prototype system based on an Android application and an Ethereum smart contract. We confirm that wood traceability and verification can be performed using the prototype system.


title: Long Range Constraints for Neural Texture Synthesis Using Sliced Wasserstein Loss

abstract: In the past decade, exemplar-based texture synthesis algorithms have seen strong gains in performance by matching statistics of deep convolutional neural networks. However, these algorithms require regularization terms or user-added spatial tags to capture long range constraints in images. Having access to a user-added spatial tag for all situations is not always feasible, and regularization terms can be difficult to tune. Thus, we propose a new set of statistics for texture synthesis based on Sliced Wasserstein Loss, create a multi-scale method to synthesize textures without a user-added spatial tag, study the ability of our proposed method to capture long range constraints, and compare our results to other optimization-based, single texture synthesis algorithms.


title: Diffusion-Based Scene Graph to Image Generation with Masked Contrastive Pre-Training

abstract: Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this challenge by using scene layouts, which are image-like representations of scene graphs designed to capture the coarse structures of scene images. Because scene layouts are manually crafted, the alignment with images may not be fully optimized, causing suboptimal compliance between the generated images and the original scene graphs. To tackle this issue, we propose to learn scene graph embeddings by directly optimizing their alignment with images. Specifically, we pre-train an encoder to extract both global and local information from scene graphs that are predictive of the corresponding images, relying on two loss functions: masked autoencoding loss and contrastive loss. The former trains embeddings by reconstructing randomly masked image regions, while the latter trains embeddings to discriminate between compliant and non-compliant images according to the scene graph. Given these embeddings, we build a latent diffusion model to generate images from scene graphs. The resulting method, called SGDiff, allows for the semantic manipulation of generated images by modifying scene graph nodes and connections. On the Visual Genome and COCO-Stuff datasets, we demonstrate that SGDiff outperforms state-of-the-art methods, as measured by both the Inception Score and Fr\'echet Inception Distance (FID) metrics. We will release our source code and trained models at https://github.com/YangLing0818/SGDiff.


title: Bisection of Trapezoids in Elamite Mathematics

abstract: The bisection of trapezoids by transversal lines has many examples in Babylonian mathematics. In this article, we study a similar problem in Elamite mathematics, inscribed on a clay tablet held in the collection of the Louvre Museum and thought to date from between 1894--1595 BC. We seek to demonstrate that this problem is different from typical Babylonian problems about bisecting trapezoids by transversal lines. We also identify some of the possible mathematical ideas underlying this problem and the innovative approach that might have motivated its design.


title: Probing a 96 GeV Higgs Boson in the Di-Photon Channel at the LHC

abstract: Recently the CMS collaboration reported a $\sim 3 \sigma$ local excess in the di-photon spectrum at 96 GeV. The same mass range concurs with a $\sim2 \sigma$ local excess in the $b\bar{b}$ invariant mass spectrum in four-jet events collected at LEP. In this contribution we show that at 1$\sigma$ level the 2HDM type-III can perfectly fit both excesses simultaneously, while satisfying all experimental and theoretical constraints.


title: Attacking Shortest Paths by Cutting Edges

abstract: Identifying shortest paths between nodes in a network is a common graph analysis problem that is important for many applications involving routing of resources. An adversary that can manipulate the graph structure could alter traffic patterns to gain some benefit (e.g., make more money by directing traffic to a toll road). This paper presents the Force Path Cut problem, in which an adversary removes edges from a graph to make a particular path the shortest between its terminal nodes. We prove that this problem is APX-hard, but introduce PATHATTACK, a polynomial-time approximation algorithm that guarantees a solution within a logarithmic factor of the optimal value. In addition, we introduce the Force Edge Cut and Force Node Cut problems, in which the adversary targets a particular edge or node, respectively, rather than an entire path. We derive a nonconvex optimization formulation for these problems, and derive a heuristic algorithm that uses PATHATTACK as a subroutine. We demonstrate all of these algorithms on a diverse set of real and synthetic networks, illustrating the network types that benefit most from the proposed algorithms.


title: A generalization on spectral extrema of $K_{s,t}$-minor free graphs

abstract: The spectral extrema problems on forbidding minors have aroused wide attention. Very recently, Zhai and Lin [J. Combin. Theory Ser. B 157 (2022) 184--215] determined the extremal graph with maximum adjacency spectral radius among all $K_{s,t}$-minor free graphs of sufficiently large order. The matrix $A_{\alpha}(G)$ is a generalization of the adjacency matrix $A(G)$, which is defined by Nikiforov \cite{Nikiforov2} as $$A_{\alpha}(G) = \alpha D(G) + (1 - \alpha)A(G),$$ where $0\leq\alpha \leq1$. Given a graph $F$, the $A_\alpha$-spectral extrema problem is to determine the maximum spectral radius of $A_{\alpha}(G)$ or characterize the extremal graph among all graphs with no subgraph isomorphic to $F$. For $\alpha=0$, the matrix $A_{\alpha}(G)$ is exactly the adjacency matrix $A(G)$. Motivated by the nice work of Zhai and Lin, in this paper we determine the extremal graph with maximum $A_\alpha$-spectral radius among all $K_{s,t}$-minor free graphs of sufficiently large order, where $0<\alpha<1$ and $2\leq s\leq t$. As by-products, we completely solve the Conjecture posed by Chen and Zhang in [Linear Multilinear Algebra 69 (10) (2021) 1922--1934].


title: Increasing mass-to-flux ratio from the dense core to the protostellar envelope around the Class 0 protostar HH 211

abstract: To study transportation of magnetic flux from large to small scales in protostellar sources, we analyzed the Nobeyama 45-m N2H+ (1-0), JCMT 850 um polarization, and ALMA C18O (2-1) and 1.3 mm and 0.8 mm (polarized) continuum data of the Class 0 protostar HH 211. The magnetic field strength in the dense core on a 0.1 pc scale was estimated with the single-dish line and polarization data using the Davis-Chandrasekhar-Fermi method, and that in the protostellar envelope on a 600 au scale was estimated from the force balance between the gravity and magnetic field tension by analyzing the gas kinematics and magnetic field structures with the ALMA data. Our analysis suggests that from 0.1 pc to 600 au scales, the magnetic field strength increases from 40-107 uG to 0.3-1.2 mG with a scaling relation between the magnetic field strength and density of $B \propto \rho^{0.36\pm0.08}$, and the mass-to-flux ratio increases from 1.2-3.7 to 9.1-32.3. The increase in the mass-to-flux ratio could suggest that the magnetic field is partially decoupled from the neutral matter between 0.1 pc and 600 au scales, and hint at efficient ambipolar diffusion in the infalling protostellar envelope in HH 211, which is the dominant non-ideal magnetohydrodynamic effect considering the density on these scales. Thus, our results could support the scenario of efficient ambipolar diffusion enabling the formation of the 20 au Keplerian disk in HH 211.


title: Coarse-Super-Resolution-Fine Network (CoSF-Net): A Unified End-to-End Neural Network for 4D-MRI with Simultaneous Motion Estimation and Super-Resolution

abstract: Four-dimensional magnetic resonance imaging (4D-MRI) is an emerging technique for tumor motion management in image-guided radiation therapy (IGRT). However, current 4D-MRI suffers from low spatial resolution and strong motion artifacts owing to the long acquisition time and patients' respiratory variations; these limitations, if not managed properly, can adversely affect treatment planning and delivery in IGRT. Herein, we developed a novel deep learning framework called the coarse-super-resolution-fine network (CoSF-Net) to achieve simultaneous motion estimation and super-resolution in a unified model. We designed CoSF-Net by fully excavating the inherent properties of 4D-MRI, with consideration of limited and imperfectly matched training datasets. We conducted extensive experiments on multiple real patient datasets to verify the feasibility and robustness of the developed network. Compared with existing networks and three state-of-the-art conventional algorithms, CoSF-Net not only accurately estimated the deformable vector fields between the respiratory phases of 4D-MRI but also simultaneously improved the spatial resolution of 4D-MRI with enhanced anatomic features, yielding 4D-MR images with high spatiotemporal resolution.


title: Von Neumann-Steinhaus decomposition of parallelepipeds

abstract: A problem of Steinhaus was to partition a finite interval $I$ of the real line into countably infinitely many pairwise disjoint sets that are congruent in the sense that each set is a translate of a fixed set $A$. This paper describes von Neumann's solution of the Steinhaus problem and generalizes the result to parallelepipeds in $\mathbf{R}^n$.


title: Magnetocaloric effect at the reorientation of the magnetization in ferromagnetic multilayers with perpendicular anisotropy

abstract: We investigate the magnetocaloric effect obtained by the rotation of a magnetic field applied to an exchange-coupled multilayer system composed of two different ferromagnetic (FM) materials. We specifically consider a system in which the two FMs have perpendicular uniaxial anisotropy axes and utilise conditions which yield a reorientation of the total magnetization when compensation between the anisotropies of the two layers occurs. We calculate the consequent entropy change associated with the "artificial" reorientation. By using known parameters from MnBi and Co we predict an entropy change of $\Delta s = 0.34$ Jkg$^{-1}$K$^{-1}$ for perfect coupling. Lastly, we study the behavior of the multilayer under a rotating magnetic field via a micromagnetic model. When the layer thicknesses are of the order of the local domain wall width, the magnetic field-induced entropy change can be obtained with magnetic fields one order of magnitude lower than in the uncoupled case.


title: Optimal quaternary linear codes with one-dimensional Hermitian hull and the related EAQECCs

abstract: Linear codes with small hulls over finite fields have been extensively studied due to their practical applications in computational complexity and information protection. In this paper, we develop a general method to determine the exact value of $D_4^H(n,k,1)$ for $n\leq 12$ or $k\in \{1,2,3,n-1,n-2,n-3\}$, where $D_4^H(n,k,1)$ denotes the largest minimum distance among all quaternary linear $[n,k]$ codes with one-dimensional Hermitian hull. As a consequence, we solve a conjecture proposed by Mankean and Jitman on the largest minimum distance of a quaternary linear code with one-dimensional Hermitian hull. As an application, we construct some binary entanglement-assisted quantum error-correcting codes (EAQECCs) from quaternary linear codes with one-dimensional Hermitian hull. Some of these EAQECCs are optimal codes, and some of them are better than previously known ones.


title: Failed Solar Eruption of A Multi-thermal Flux Rope

abstract: A magnetic flux rope (FR), hosting hot plasma, is thought to be central to the physics of coronal mass ejection. Such FRs are widely observed with passbands of the Atmospheric Imaging Assembly (AIA) onboard the Solar Dynamics Observatory (SDO), that are sensitive to emission from the hot plasma around 10 MK. In contrast, observations of warmer (around 1 MK) counterparts of FRs are sparse. In this study, we report the failed eruption of a multi-thermal FR, hosting both hot and warm plasma. On 2015 May 1, a hot channel appeared in the AIA high temperature passbands out of the southeastern solar limb to the south of a nearby flare, and then erupted outward. During the eruption, it rotated perpendicular to the erupting direction. The hot channel stopped erupting, and disappeared gradually, showing a failed eruption. During the hot channel eruption, a warm channel appeared sequentially in the AIA low temperature passbands. It underwent the similar evolution, including the failed eruption, rotation, and disappearance, to the hot channel. A bright compression front is formed in front of the warm channel eruption in AIA low temperature images. Under the hot and warm channel eruptions, a small flare occurred, upon which several current sheets, connecting the erupting channels and the underneath flare, formed in the AIA high temperature passbands. Investigating the spatial and temporal relation between the hot and warm channels, we suggest that both channels twist together, constituting the same multi-thermal FR that has plasma with the high and low temperatures.


title: Higher modularity of elliptic curves over function fields

abstract: We investigate a notion of "higher modularity" for elliptic curves over function fields. Given such an elliptic curve $E$ and an integer $r\geq 1$, we say that $E$ is $r$-modular when there is an algebraic correspondence between a stack of $r$-legged shtukas, and the $r$-fold product of $E$ considered as an elliptic surface. The (known) case $r=1$ is analogous to the notion of modularity for elliptic curves over $\mathbf{Q}$. Our main theorem is that if $E/\mathbf{F}_q(t)$ is a nonisotrivial elliptic curve whose conductor has degree 4, then $E$ is 2-modular. Ultimately, the proof uses properties of K3 surfaces. Along the way we prove a result of independent interest: A K3 surface admits a finite morphism to a Kummer surface attached to a product of elliptic curves if and only if its Picard lattice is rationally isometric to the Picard lattice of such a Kummer surface.


title: Comparing hierarchical black hole mergers in star clusters and active galactic nuclei

abstract: Star clusters (SCs) and active galactic nuclei (AGNs) are promising sites for the occurrence of hierarchical black hole (BH) mergers. We use simple models to compare hierarchical BH mergers in two of the dynamical formation channels. We find that the primary mass distribution of hierarchical mergers in AGNs is higher than that in SCs, with the peaks of $\sim$$50\,M_{\odot}$ and $\sim$$13\,M_{\odot}$, respectively. The effective spin ($\chi_{\rm eff}$) distribution of hierarchical mergers in SCs is symmetrical around zero as expected and $\sim$$50\%$ of the mergers have $|\chi_{\rm eff}|>0.2$. The distribution of $\chi_{\rm eff}$ in AGNs is narrow and prefers positive values with the peak of $\chi_{\rm eff}\ge0.3$ due to the assistance of AGN disks. BH hierarchical growth efficiency in AGNs, with at least $\sim$$30\%$ of mergers being hierarchies, is much higher than the efficiency in SCs. Furthermore, there are obvious differences in the mass ratios and effective precession parameters of hierarchical mergers in SCs and AGNs. We argue that the majority of the hierarchical merger candidates detected by LIGO-Virgo may originate from the AGN channel as long as AGNs get half of the hierarchical merger rate.


title: First Observation of $\Lambda\pi^+$ and $\Lambda\pi^-$ Signals near the $\bar{K}N (I=1)$ Mass Threshold in $\Lambda_c^+\rightarrow\Lambda\pi^+\pi^+\pi^-$ Decay

abstract: Using the data sample of 980 fb$^{-1}$ collected with the Belle detector operating at the KEKB asymmetric-energy $e^+e^-$ collider, we present the results of an investigation of the $\Lambda\pi^+$ and $\Lambda\pi^-$ invariant mass distributions looking for substructure in the decay $\Lambda_c^+\rightarrow\Lambda\pi^+\pi^+\pi^-$. We find a significant signal in each mass dis\ tribution. When interpreted as resonances, we find for the $\Lambda\pi^+$ ($\Lambda\pi^-$) combination a mass of $1434.3 \pm 0.6 (\mathrm{stat}) \pm 0.9(\mathrm{syst})$ MeV/$c^2$ [$1438.5 \pm 0.9 (\mathrm{stat}) \pm 2.5(\mathrm{syst})$ MeV/$c^2$], an intrinsic width of $11.5 \pm 2.8 (\mathrm{stat}) \pm 5.3(\mathrm{syst})$ MeV/$c^2$ [$33.0 \pm 7.5 (\mathrm{stat}) \pm 23.6(\mathrm{syst})$ MeV/$c^2$] with a significance of 7.5$\sigma$ (6.2$\sigma$). As these two signals are very close to the $\bar{K}N$ threshold, we also investigate the possibility of a $\bar{K}N$ cusp, and find that \ we cannot discriminate between these two interpretations due to the limited size of the data sample.


title: You Need Multiple Exiting: Dynamic Early Exiting for Accelerating Unified Vision Language Model

abstract: Large-scale Transformer models bring significant improvements for various downstream vision language tasks with a unified architecture. The performance improvements come with increasing model size, resulting in slow inference speed and increased cost for severing. While some certain predictions benefit from the full complexity of the large-scale model, not all of inputs need the same amount of computation to conduct, potentially leading to computation resource waste. To handle this challenge, early exiting is proposed to adaptively allocate computational power in term of input complexity to improve inference efficiency. The existing early exiting strategies usually adopt output confidence based on intermediate layers as a proxy of input complexity to incur the decision of skipping following layers. However, such strategies cannot apply to encoder in the widely-used unified architecture with both encoder and decoder due to difficulty of output confidence estimation in the encoder. It is suboptimal in term of saving computation power to ignore the early exiting in encoder component. To handle this challenge, we propose a novel early exiting strategy for unified visual language models, which allows dynamically skip the layers in encoder and decoder simultaneously in term of input layer-wise similarities with multiple times of early exiting, namely \textbf{MuE}. By decomposing the image and text modalities in the encoder, MuE is flexible and can skip different layers in term of modalities, advancing the inference efficiency while minimizing performance drop. Experiments on the SNLI-VE and MS COCO datasets show that the proposed approach MuE can reduce expected inference time by up to 50\% and 40\% while maintaining 99\% and 96\% performance respectively.


title: Unifying Vision-Language Representation Space with Single-tower Transformer

abstract: Contrastive learning is a form of distance learning that aims to learn invariant features from two related representations. In this paper, we explore the bold hypothesis that an image and its caption can be simply regarded as two different views of the underlying mutual information, and train a model to learn a unified vision-language representation space that encodes both modalities at once in a modality-agnostic manner. We first identify difficulties in learning a generic one-tower model for vision-language pretraining (VLP), and propose OneR as a simple yet effective framework for our goal. We discover intriguing properties that distinguish OneR from the previous works that learn modality-specific representation spaces such as zero-shot object localization, text-guided visual reasoning and multi-modal retrieval, and present analyses to provide insights into this new form of multi-modal representation learning. Thorough evaluations demonstrate the potential of a unified modality-agnostic VLP framework.


title: DVGG: Deep Variational Grasp Generation for Dextrous Manipulation

abstract: Grasping with anthropomorphic robotic hands involves much more hand-object interactions compared to parallel-jaw grippers. Modeling hand-object interactions is essential to the study of multi-finger hand dextrous manipulation. This work presents DVGG, an efficient grasp generation network that takes single-view observation as input and predicts high-quality grasp configurations for unknown objects. In general, our generative model consists of three components: 1) Point cloud completion for the target object based on the partial observation; 2) Diverse sets of grasps generation given the complete point cloud; 3) Iterative grasp pose refinement for physically plausible grasp optimization. To train our model, we build a large-scale grasping dataset that contains about 300 common object models with 1.5M annotated grasps in simulation. Experiments in simulation show that our model can predict robust grasp poses with a wide variety and high success rate. Real robot platform experiments demonstrate that the model trained on our dataset performs well in the real world. Remarkably, our method achieves a grasp success rate of 70.7\% for novel objects in the real robot platform, which is a significant improvement over the baseline methods.


title: From Indoor To Outdoor: Unsupervised Domain Adaptive Gait Recognition

abstract: Gait recognition is an important AI task, which has been progressed rapidly with the development of deep learning. However, existing learning based gait recognition methods mainly focus on the single domain, especially the constrained laboratory environment. In this paper, we study a new problem of unsupervised domain adaptive gait recognition (UDA-GR), that learns a gait identifier with supervised labels from the indoor scenes (source domain), and is applied to the outdoor wild scenes (target domain). For this purpose, we develop an uncertainty estimation and regularization based UDA-GR method. Specifically, we investigate the characteristic of gaits in the indoor and outdoor scenes, for estimating the gait sample uncertainty, which is used in the unsupervised fine-tuning on the target domain to alleviate the noises of the pseudo labels. We also establish a new benchmark for the proposed problem, experimental results on which show the effectiveness of the proposed method. We will release the benchmark and source code in this work to the public.


title: A Continuous $hp-$Mesh Model for Discontinuous Petrov-Galerkin Finite Element Schemes with Optimal Test Functions

abstract: We present an anisotropic $hp-$mesh adaptation strategy using a continuous mesh model for discontinuous Petrov-Galerkin (DPG) finite element schemes with optimal test functions, extending our previous work on $h-$adaptation. The proposed strategy utilizes the inbuilt residual-based error estimator of the DPG discretization to compute both the polynomial distribution and the anisotropy of the mesh elements. In order to predict the optimal order of approximation, we solve local problems on element patches, thus making these computations highly parallelizable. The continuous mesh model is formulated either with respect to the error in the solution, measured in a suitable norm, or with respect to certain admissible target functionals. We demonstrate the performance of the proposed strategy using several numerical examples on triangular grids. Keywords: Discontinuous Petrov-Galerkin, Continuous mesh models, $hp-$ adaptations, Anisotropy


title: On the Nonexistence of a Strong Minimal Pair

abstract: Two nonzero recursively enumerable (r.e.) degrees $\mathbf{a}$ and $\mathbf{b}$ form a strong minimal pair if $\mathbf{a} \wedge \mathbf{b}=\mathbf{0}$ and $\mathbf{b}\vee \mathbf{x}\geq \mathbf{a}$ for any nonzero r.e. degree $\mathbf{x}\leq \mathbf{a}$. We prove that there is no strong minimal pair in the r.e. degrees. Our construction goes beyond the usual $\mathbf{0}'''$-priority arguments and we give some evidence to show that it needs $\mathbf{0}^{(4)}$-priority arguments.


title: Language in a Bottle: Language Model Guided Concept Bottlenecks for Interpretable Image Classification

abstract: Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-stakes applications. CBMs require manually specified concepts and often under-perform their black box counterparts, preventing their broad adoption. We address these shortcomings and are first to show how to construct high-performance CBMs without manual specification of similar accuracy to black box models. Our approach, Language Guided Bottlenecks (LaBo), leverages a language model, GPT-3, to define a large space of possible bottlenecks. Given a problem domain, LaBo uses GPT-3 to produce factual sentences about categories to form candidate concepts. LaBo efficiently searches possible bottlenecks through a novel submodular utility that promotes the selection of discriminative and diverse information. Ultimately, GPT-3's sentential concepts can be aligned to images using CLIP, to form a bottleneck layer. Experiments demonstrate that LaBo is a highly effective prior for concepts important to visual recognition. In the evaluation with 11 diverse datasets, LaBo bottlenecks excel at few-shot classification: they are 11.7% more accurate than black box linear probes at 1 shot and comparable with more data. Overall, LaBo demonstrates that inherently interpretable models can be widely applied at similar, or better, performance than black box approaches.


title: Directed Acyclic Graph Factorization Machines for CTR Prediction via Knowledge Distillation

abstract: With the growth of high-dimensional sparse data in web-scale recommender systems, the computational cost to learn high-order feature interaction in CTR prediction task largely increases, which limits the use of high-order interaction models in real industrial applications. Some recent knowledge distillation based methods transfer knowledge from complex teacher models to shallow student models for accelerating the online model inference. However, they suffer from the degradation of model accuracy in knowledge distillation process. It is challenging to balance the efficiency and effectiveness of the shallow student models. To address this problem, we propose a Directed Acyclic Graph Factorization Machine (KD-DAGFM) to learn the high-order feature interactions from existing complex interaction models for CTR prediction via Knowledge Distillation. The proposed lightweight student model DAGFM can learn arbitrary explicit feature interactions from teacher networks, which achieves approximately lossless performance and is proved by a dynamic programming algorithm. Besides, an improved general model KD-DAGFM+ is shown to be effective in distilling both explicit and implicit feature interactions from any complex teacher model. Extensive experiments are conducted on four real-world datasets, including a large-scale industrial dataset from WeChat platform with billions of feature dimensions. KD-DAGFM achieves the best performance with less than 21.5% FLOPs of the state-of-the-art method on both online and offline experiments, showing the superiority of DAGFM to deal with the industrial scale data in CTR prediction task. Our implementation code is available at: https://github.com/RUCAIBox/DAGFM.


title: Unsupervised Explanation Generation via Correct Instantiations

abstract: While large pre-trained language models (PLM) have shown their great skills at solving discriminative tasks, a significant gap remains when compared with humans for explanation-related tasks. Among them, explaining the reason why a statement is wrong (e.g., against commonsense) is incredibly challenging. The major difficulty is finding the conflict point, where the statement contradicts our real world. This paper proposes Neon, a two-phrase, unsupervised explanation generation framework. Neon first generates corrected instantiations of the statement (phase I), then uses them to prompt large PLMs to find the conflict point and complete the explanation (phase II). We conduct extensive experiments on two standard explanation benchmarks, i.e., ComVE and e-SNLI. According to both automatic and human evaluations, Neon outperforms baselines, even for those with human-annotated instantiations. In addition to explaining a negative prediction, we further demonstrate that Neon remains effective when generalizing to different scenarios.


title: A universal and improved mutation strategy for iterative wavefront shaping

abstract: Recent advances in iterative wavefront shaping (WFS) techniques have made it possible to manipulate the light focusing and transport in scattering media. To improve the optimization performance, various optimization algorithms and improved strategies have been utilized. Here, a novel guided mutation (GM) strategy is proposed to improve optimization efficiency for iterative WFS. For both phase modulation and binary amplitude modulation, considerable improvements in optimization effect and rate have been obtained using multiple GM-enhanced algorithms. Due of its improvements and universality, GM is beneficial for applications ranging from controlling the transmission of light through disordered media to optical manipulation behind them.


title: Covariant superspace approaches to ${\cal N}=2$ supergravity

abstract: We provide a unified description of the three covariant superspace approaches to ${\cal N}=2$ conformal supergravity in four dimensions: (i) conformal superspace; (ii) $\mathsf{U}(2)$ superspace; and (iii) $\mathsf{SU}(2)$ superspace. Each of them can be used to formulate general supergravity-matter systems, although conformal superspace has the largest structure group and is intimately related to the superconformal tensor calculus. We review the structure of covariant projective multiplets and demonstrate how they are used to describe pure and matter-coupled supergravity, including locally superconformal off-shell sigma models. Higher-derivative invariants, topological invariants and super-Weyl anomalies are also briefly discussed.


title: Global existence of solutions to the chemotaxis system with logistic source under nonlinear Neumann boundary condition

abstract: We consider classical solutions to the chemotaxis system with logistic source $f(u) := au-\mu u^2$ under nonlinear Neumann boundary condition $\frac{\partial u}{ \partial \nu } = |u|^{p}$ with $p>1$ in a smooth convex bounded domain $\Omega \subset \mathbb{R}^n$ where $n \geq 2$. This paper aims to show that if $p<\frac{3}{2}$, and $\mu >0$, $n=2$, or $\mu$ is sufficiently large when $n\geq 3$, then the parabolic-elliptic chemotaxis system admits a unique positive global-in-time classical solution that is bounded in $\Omega \times (0, \infty)$. The similar result is also true if $p<\frac{3}{2}$, $n=2$, and $\mu>0$ or $p<\frac{7}{5}$, $n=3$, and $\mu $ is sufficiently large for the parabolic-parabolic chemotaxis system.


title: On the Laplacian spectrum of $k$-symmetric graphs

abstract: For some positive integer $k$, if the finite cyclic group $\mathbb{Z}_k$ can act freely on a graph $G$, then we say that $G$ is $k$-symmetric. In 1985, Faria showed that the multiplicity of Laplacian eigenvalue 1 is greater than or equal to the difference between the number of pendant vertices and the number of quasi-pendant vertices. But if a graph has a pendant vertex, then it is at most 1-connected. In this paper, we investigate a class of 2-connected $k$-symmetric graphs with a Laplacian eigenvalue 1. We also identify a class of $k$-symmetric graphs in which all Laplacian eigenvalues are integers.


title: A Benchmark of Video-Based Clothes-Changing Person Re-Identification

abstract: Person re-identification (Re-ID) is a classical computer vision task and has achieved great progress so far. Recently, long-term Re-ID with clothes-changing has attracted increasing attention. However, existing methods mainly focus on image-based setting, where richer temporal information is overlooked. In this paper, we focus on the relatively new yet practical problem of clothes-changing video-based person re-identification (CCVReID), which is less studied. We systematically study this problem by simultaneously considering the challenge of the clothes inconsistency issue and the temporal information contained in the video sequence for the person Re-ID problem. Based on this, we develop a two-branch confidence-aware re-ranking framework for handling the CCVReID problem. The proposed framework integrates two branches that consider both the classical appearance features and cloth-free gait features through a confidence-guided re-ranking strategy. This method provides the baseline method for further studies. Also, we build two new benchmark datasets for CCVReID problem, including a large-scale synthetic video dataset and a real-world one, both containing human sequences with various clothing changes. We will release the benchmark and code in this work to the public.


title: Hypergraph Analysis Toolbox for Chromosome Conformation

abstract: Recent advances in biological technologies, such as multi-way chromosome conformation capture (3C), require development of methods for analysis of multi-way interactions. Hypergraphs are mathematically tractable objects that can be utilized to precisely represent and analyze multi-way interactions. Here we present the Hypergraph Analysis Toolbox (HAT), a software package for visualization and analysis of multi-way interactions in complex systems.


title: Vision Transformer with Super Token Sampling

abstract: Vision transformer has achieved impressive performance for many vision tasks. However, it may suffer from high redundancy in capturing local features for shallow layers. Local self-attention or early-stage convolutions are thus utilized, which sacrifice the capacity to capture long-range dependency. A challenge then arises: can we access efficient and effective global context modeling at the early stages of a neural network? To address this issue, we draw inspiration from the design of superpixels, which reduces the number of image primitives in subsequent processing, and introduce super tokens into vision transformer. Super tokens attempt to provide a semantically meaningful tessellation of visual content, thus reducing the token number in self-attention as well as preserving global modeling. Specifically, we propose a simple yet strong super token attention (STA) mechanism with three steps: the first samples super tokens from visual tokens via sparse association learning, the second performs self-attention on super tokens, and the last maps them back to the original token space. STA decomposes vanilla global attention into multiplications of a sparse association map and a low-dimensional attention, leading to high efficiency in capturing global dependencies. Based on STA, we develop a hierarchical vision transformer. Extensive experiments demonstrate its strong performance on various vision tasks. In particular, without any extra training data or label, it achieves 86.4% top-1 accuracy on ImageNet-1K with less than 100M parameters. It also achieves 53.9 box AP and 46.8 mask AP on the COCO detection task, and 51.9 mIOU on the ADE20K semantic segmentation task. Code is released at https://github.com/hhb072/STViT.


title: Total positivity in twisted product of flag varieties

abstract: We show that the totally nonnegative part of the twisted product of flag varieties of a Kac-Moody group admits a cellular decomposition, and the closure of each cell is a topological manifold with boundary. We also establish explicit parameterizations of each totally positive cell. In the special cases of double flag varieties and braid varieties, we show that the totally nonnegative parts are regular CW complexes homeomorphic to closed balls. Moreover, we prove that the link of any totally nonnegative double Bruhat cell in a reductive group is a regular CW complex homeomorphic to a closed ball, solving an open problem of Fomin and Zelevinsky.


title: Learning biological neuronal networks with artificial neural networks: neural oscillations

abstract: First-principles-based modelings have been extremely successful in providing crucial insights and predictions for complex biological functions and phenomena. However, they can be hard to build and expensive to simulate for complex living systems. On the other hand, modern data-driven methods thrive at modeling many types of high-dimensional and noisy data. Still, the training and interpretation of these data-driven models remain challenging. Here, we combine the two types of methods to model stochastic neuronal network oscillations. Specifically, we develop a class of first-principles-based artificial neural networks to provide faithful surrogates to the high-dimensional, nonlinear oscillatory dynamics produced by neural circuits in the brain. Furthermore, when the training data set is enlarged within a range of parameter choices, the artificial neural networks become generalizable to these parameters, covering cases in distinctly different dynamical regimes. In all, our work opens a new avenue for modeling complex neuronal network dynamics with artificial neural networks.


title: The loss of the property of locality of the kernel in high-dimensional Gaussian process regression on the example of the fitting of molecular potential energy surfaces

abstract: Kernel based methods including Gaussian process regression (GPR) and generally kernel ridge regression (KRR) have been finding increasing use in computational chemistry, including the fitting of potential energy surfaces and density functionals in high-dimensional feature spaces. Kernels of the Matern family such as Gaussian-like kernels (basis functions) are often used, which allows imparting them the meaning of covariance functions and formulating GPR as an estimator of the mean of a Gaussian distribution. The notion of locality of the kernel is critical for this interpretation. It is also critical to the formulation of multi-zeta type basis functions widely used in computational chemistry We show, on the example of fitting of molecular potential energy surfaces of increasing dimensionality, the practical disappearance of the property of locality of a Gaussian-like kernel in high dimensionality. We also formulate a multi-zeta approach to the kernel and show that it significantly improves the quality of regression in low dimensionality but loses any advantage in high dimensionality, which is attributed to the loss of the property of locality.


title: Enhanced five-photon photoluminescence in subwavelength AlGaAs resonators

abstract: Multiphoton processes of absorption photoluminescence have enabled a wide range of applications including three-dimensional microfabrication, data storage, and biological imaging. While the applications of two-photon and three-photon absorption and luminescence have matured considerably, higher-order photoluminescence processes remain more challenging to study due to their lower efficiency, particularly in subwavelength systems. Here we report the observation of it five-photon luminescence from a single subwavelength nanoantenna at room temperature enabled by the Mie resonances. We excite an AlGaAs resonator at around 3.6 um and observe photoluminescence at around 740 nm. We show that the interplay of the Mie multipolar modes at the subwavelength scale can enhance the efficiency of the five-photon luminescence by at least four orders of magnitude, being limited only by sensitivity of our detector. Our work paves the way towards applications of higher-order multiphoton processes at the subwavelength scales enabled by the physics of Mie resonances.


title: HARL: Hierarchical Adaptive Reinforcement Learning Based Auto Scheduler for Neural Networks

abstract: To efficiently perform inference with neural networks, the underlying tensor programs require sufficient tuning efforts before being deployed into production environments. Usually, enormous tensor program candidates need to be sufficiently explored to find the one with the best performance. This is necessary to make the neural network products meet the high demand of real-world applications such as natural language processing, auto-driving, etc. Auto-schedulers are being developed to avoid the need for human intervention. However, due to the gigantic search space and lack of intelligent search guidance, current auto-schedulers require hours to days of tuning time to find the best-performing tensor program for the entire neural network. In this paper, we propose HARL, a reinforcement learning (RL) based auto-scheduler specifically designed for efficient tensor program exploration. HARL uses a hierarchical RL architecture in which learning-based decisions are made at all different levels of search granularity. It also automatically adjusts exploration configurations in real-time for faster performance convergence. As a result, HARL improves the tensor operator performance by 22% and the search speed by 4.3x compared to the state-of-the-art auto-scheduler. Inference performance and search speed are also significantly improved on end-to-end neural networks.


title: A min-max theorem for the minimum fleet-size problem

abstract: A retrospective fleet-sizing problem can be solved via bipartite matching, where a maximum cardinality matching corresponds to the minimum number of vehicles needed to cover all trips. We prove a min-max theorem on this minimum fleet-size problem: the maximum number of pairwise incompatible trips is equal to the minimum fleet size needed.


title: Unveiling the Tapestry: the Interplay of Generalization and Forgetting in Continual Learning

abstract: In AI, generalization refers to a model's ability to perform well on out-of-distribution data related to the given task, beyond the data it was trained on. For an AI agent to excel, it must also possess the continual learning capability, whereby an agent incrementally learns to perform a sequence of tasks without forgetting the previously acquired knowledge to solve the old tasks. Intuitively, generalization within a task allows the model to learn underlying features that can readily be applied to novel tasks, facilitating quicker learning and enhanced performance in subsequent tasks within a continual learning framework. Conversely, continual learning methods often include mechanisms to mitigate catastrophic forgetting, ensuring that knowledge from earlier tasks is retained. This preservation of knowledge over tasks plays a role in enhancing generalization for the ongoing task at hand. Despite the intuitive appeal of the interplay of both abilities, existing literature on continual learning and generalization has proceeded separately. In the preliminary effort to promote studies that bridge both fields, we first present empirical evidence showing that each of these fields has a mutually positive effect on the other. Next, building upon this finding, we introduce a simple and effective technique known as Shape-Texture Consistency Regularization (STCR), which caters to continual learning. STCR learns both shape and texture representations for each task, consequently enhancing generalization and thereby mitigating forgetting. Remarkably, extensive experiments validate that our STCR, can be seamlessly integrated with existing continual learning methods, where its performance surpasses these continual learning methods in isolation or when combined with established generalization techniques by a large margin. Our data and source code will be made publicly available upon publication.


title: CoPEM: Cooperative Perception Error Models for Autonomous Driving

abstract: In this paper, we introduce the notion of Cooperative Perception Error Models (coPEMs) towards achieving an effective and efficient integration of V2X solutions within a virtual test environment. We focus our analysis on the occlusion problem in the (onboard) perception of Autonomous Vehicles (AV), which can manifest as misdetection errors on the occluded objects. Cooperative perception (CP) solutions based on Vehicle-to-Everything (V2X) communications aim to avoid such issues by cooperatively leveraging additional points of view for the world around the AV. This approach usually requires many sensors, mainly cameras and LiDARs, to be deployed simultaneously in the environment either as part of the road infrastructure or on other traffic vehicles. However, implementing a large number of sensor models in a virtual simulation pipeline is often prohibitively computationally expensive. Therefore, in this paper, we rely on extending Perception Error Models (PEMs) to efficiently implement such cooperative perception solutions along with the errors and uncertainties associated with them. We demonstrate the approach by comparing the safety achievable by an AV challenged with a traffic scenario where occlusion is the primary cause of a potential collision.


title: Modeling Multivariate Biosignals With Graph Neural Networks and Structured State Space Models

abstract: Multivariate biosignals are prevalent in many medical domains, such as electroencephalography, polysomnography, and electrocardiography. Modeling spatiotemporal dependencies in multivariate biosignals is challenging due to (1) long-range temporal dependencies and (2) complex spatial correlations between the electrodes. To address these challenges, we propose representing multivariate biosignals as time-dependent graphs and introduce GraphS4mer, a general graph neural network (GNN) architecture that improves performance on biosignal classification tasks by modeling spatiotemporal dependencies in biosignals. Specifically, (1) we leverage the Structured State Space architecture, a state-of-the-art deep sequence model, to capture long-range temporal dependencies in biosignals and (2) we propose a graph structure learning layer in GraphS4mer to learn dynamically evolving graph structures in the data. We evaluate our proposed model on three distinct biosignal classification tasks and show that GraphS4mer consistently improves over existing models, including (1) seizure detection from electroencephalographic signals, outperforming a previous GNN with self-supervised pre-training by 3.1 points in AUROC; (2) sleep staging from polysomnographic signals, a 4.1 points improvement in macro-F1 score compared to existing sleep staging models; and (3) 12-lead electrocardiogram classification, outperforming previous state-of-the-art models by 2.7 points in macro-F1 score.


title: NeuMap: Neural Coordinate Mapping by Auto-Transdecoder for Camera Localization

abstract: This paper presents an end-to-end neural mapping method for camera localization, dubbed NeuMap, encoding a whole scene into a grid of latent codes, with which a Transformer-based auto-decoder regresses 3D coordinates of query pixels. State-of-the-art feature matching methods require each scene to be stored as a 3D point cloud with per-point features, consuming several gigabytes of storage per scene. While compression is possible, performance drops significantly at high compression rates. Conversely, coordinate regression methods achieve high compression by storing scene information in a neural network but suffer from reduced robustness. NeuMap combines the advantages of both approaches by utilizing 1) learnable latent codes for efficient scene representation and 2) a scene-agnostic Transformer-based auto-decoder to infer coordinates for query pixels. This scene-agnostic network design learns robust matching priors from large-scale data and enables rapid optimization of codes for new scenes while keeping the network weights fixed. Extensive evaluations on five benchmarks show that NeuMap significantly outperforms other coordinate regression methods and achieves comparable performance to feature matching methods while requiring a much smaller scene representation size. For example, NeuMap achieves 39.1% accuracy in the Aachen night benchmark with only 6MB of data, whereas alternative methods require 100MB or several gigabytes and fail completely under high compression settings. The codes are available at https://github.com/Tangshitao/NeuMap


title: Adaptive Finite-Time Model Estimation and Control for Manipulator Visual Servoing using Sliding Mode Control and Neural Networks

abstract: The image-based visual servoing without models of system is challenging since it is hard to fetch an accurate estimation of hand-eye relationship via merely visual measurement. Whereas, the accuracy of estimated hand-eye relationship expressed in local linear format with Jacobian matrix is important to whole system's performance. In this article, we proposed a finite-time controller as well as a Jacobian matrix estimator in a combination of online and offline way. The local linear formulation is formulated first. Then, we use a combination of online and offline method to boost the estimation of the highly coupled and nonlinear hand-eye relationship with data collected via depth camera. A neural network (NN) is pre-trained to give a relative reasonable initial estimation of Jacobian matrix. Then, an online updating method is carried out to modify the offline trained NN for a more accurate estimation. Moreover, sliding mode control algorithm is introduced to realize a finite-time controller. Compared with previous methods, our algorithm possesses better convergence speed. The proposed estimator possesses excellent performance in the accuracy of initial estimation and powerful tracking capabilities for time-varying estimation for Jacobian matrix compared with other data-driven estimators. The proposed scheme acquires the combination of neural network and finite-time control effect which drives a faster convergence speed compared with the exponentially converge ones. Another main feature of our algorithm is that the state signals in system is proved to be semi-global practical finite-time stable. Several experiments are carried out to validate proposed algorithm's performance.