title: Structure-Preserving Model Order Reduction for Index Two Port-Hamiltonian Descriptor Systems

abstract: We present a new optimization-based structure-preserving model order reduction (MOR) method for port-Hamiltonian descriptor systems (pH-DAEs) with differentiation index two. Our method is based on a novel parameterization that allows us to represent any linear time-invariant pH-DAE with a minimal number of parameters, which makes it well-suited to model reduction. We propose two algorithms which directly optimize the parameters of a reduced model to approximate a given large-scale model with respect to either the H-infinity or the H-2 norm. This approach has several benefits. Our parameterization ensures that the reduced model is again a pH-DAE system and enables a compact representation of the algebraic part of the large-scale model, which in projection-based methods often requires a more involved treatment. The direct optimization is entirely based on transfer function evaluations of the large-scale model and is therefore independent of the system matrices' structure. Numerical experiments are conducted to illustrate the high accuracy and small reduced model orders in comparison to other structure-preserving MOR methods.


title: Robust Environment Perception for Automated Driving: A Unified Learning Pipeline for Visual-Infrared Object Detection

abstract: The RGB complementary metal-oxidesemiconductor (CMOS) sensor works within the visible light spectrum. Therefore it is very sensitive to environmental light conditions. On the contrary, a long-wave infrared (LWIR) sensor operating in 8-14 micro meter spectral band, functions independent of visible light. In this paper, we exploit both visual and thermal perception units for robust object detection purposes. After delicate synchronization and (cross-) labeling of the FLIR [1] dataset, this multi-modal perception data passes through a convolutional neural network (CNN) to detect three critical objects on the road, namely pedestrians, bicycles, and cars. After evaluation of RGB and infrared (thermal and infrared are often used interchangeably) sensors separately, various network structures are compared to fuse the data at the feature level effectively. Our RGB-thermal (RGBT) fusion network, which takes advantage of a novel entropy-block attention module (EBAM), outperforms the state-of-the-art network [2] by 10% with 82.9% mAP.


title: Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-implementation Guidelines

abstract: Online reinforcement learning (RL) algorithms are increasingly used to personalize digital interventions in the fields of mobile health and online education. Common challenges in designing and testing an RL algorithm in these settings include ensuring the RL algorithm can learn and run stably under real-time constraints, and accounting for the complexity of the environment, e.g., a lack of accurate mechanistic models for the user dynamics. To guide how one can tackle these challenges, we extend the PCS (Predictability, Computability, Stability) framework, a data science framework that incorporates best practices from machine learning and statistics in supervised learning (Yu and Kumbier, 2020), to the design of RL algorithms for the digital interventions setting. Further, we provide guidelines on how to design simulation environments, a crucial tool for evaluating RL candidate algorithms using the PCS framework. We illustrate the use of the PCS framework for designing an RL algorithm for Oralytics, a mobile health study aiming to improve users' tooth-brushing behaviors through the personalized delivery of intervention messages. Oralytics will go into the field in late 2022.


title: Challenges in Applying Explainability Methods to Improve the Fairness of NLP Models

abstract: Motivations for methods in explainable artificial intelligence (XAI) often include detecting, quantifying and mitigating bias, and contributing to making machine learning models fairer. However, exactly how an XAI method can help in combating biases is often left unspecified. In this paper, we briefly review trends in explainability and fairness in NLP research, identify the current practices in which explainability methods are applied to detect and mitigate bias, and investigate the barriers preventing XAI methods from being used more widely in tackling fairness issues.


title: Sampling at twice the Nyquist rate in two frequency bins guarantees uniqueness in Gabor phase retrieval

abstract: We show that bandlimited signals can be uniquely recovered (up to a constant global phase factor) from Gabor transform magnitudes sampled at twice the Nyquist rate in two frequency bins.


title: Survival in two-species reaction-superdiffusion system: Renormalization group treatment and numerical simulations

abstract: We analyze the two-species reaction-diffusion system including trapping reaction $A + B \to A$ as well as coagulation/annihilation reactions $A + A \to (A,0)$ where particles of both species are performing L\'evy flights with control parameter $0 < \sigma < 2$, known to lead to superdiffusive behaviour. The density, as well as the correlation function for target particles $B$ in such systems, are known to scale with nontrivial universal exponents at space dimension $d \leq d_{c}$. Applying the renormalization group formalism we calculate these exponents in a case of superdiffusion below the critical dimension $d_c=\sigma$. The numerical simulations in one-dimensional case are performed as well. The quantitative estimates for the decay exponent of the density of survived particles $B$ are in good agreement with our analytical results. In particular, it is found that the surviving probability of the target particles in a superdiffusive regime is higher than that in a system with ordinary diffusion.


title: Hypergraphs with infinitely many extremal constructions

abstract: We give the first exact and stability results for a hypergraph Tur\'{a}n problem with infinitely many extremal constructions that are far from each other in edit-distance. This includes an example of triple systems with Tur\'{a}n density $2/9$, thus answering some questions posed by the third and fourth authors and Reiher about the feasible region of hypergraphs. Our results also provide extremal constructions whose shadow density is a transcendental number. Our novel approach is to construct certain multilinear polynomials that attain their maximum (in the standard simplex) on a line segment and then to use these polynomials to define an operation on hypergraphs that gives extremal constructions.


title: Nonlocal traffic models with general kernels: singular limit, entropy admissibility, and convergence rate

abstract: Nonlocal conservation laws (the signature feature being that the flux function depends on the solution through the convolution with a given kernel) are extensively used in the modeling of vehicular traffic. In this work we discuss the singular local limit, namely the convergence of the nonlocal solutions to the entropy admissible solution of the conservation law obtained by replacing the convolution kernel with a Dirac delta. Albeit recent counter-examples rule out convergence in the general case, in the specific framework of traffic models (with anisotropic convolution kernels) the singular limit has been established under rigid assumptions, i.e. in the case of the exponential kernel (which entails algebraic identities between the kernel and its derivatives) or under fairly restrictive requirements on the initial datum. In this work we obtain general convergence results under assumptions that are entirely natural in view of applications to traffic models, plus a convexity requirement on the convolution kernels. We then provide a general criterion for entropy admissibility of the limit and a convergence rate. We also exhibit a counter-example showing that the convexity assumption is necessary for our main compactness estimate.


title: Transfer learning to decode brain states reflecting the relationship between cognitive tasks

abstract: Transfer learning improves the performance of the target task by leveraging the data of a specific source task: the closer the relationship between the source and the target tasks, the greater the performance improvement by transfer learning. In neuroscience, the relationship between cognitive tasks is usually represented by similarity of activated brain regions or neural representation. However, no study has linked transfer learning and neuroscience to reveal the relationship between cognitive tasks. In this study, we propose a transfer learning framework to reflect the relationship between cognitive tasks, and compare the task relations reflected by transfer learning and by the overlaps of brain regions (e.g., neurosynth). Our results of transfer learning create cognitive taskonomy to reflect the relationship between cognitive tasks which is well in line with the task relations derived from neurosynth. Transfer learning performs better in task decoding with fMRI data if the source and target cognitive tasks activate similar brain regions. Our study uncovers the relationship of multiple cognitive tasks and provides guidance for source task selection in transfer learning for neural decoding based on small-sample data.


title: Interpretability of artificial neural network models in artificial Intelligence vs. neuroscience

abstract: Computationally explicit hypotheses of brain function derived from machine learning (ML)-based models have recently revolutionized neuroscience. Despite the unprecedented ability of these artificial neural networks (ANNs) to capture responses in biological neural networks (brains), and our full access to all internal model components (unlike the brain), ANNs are often referred to as black-boxes with limited interpretability. Interpretability, however, is a multi-faceted construct that is used differently across fields. In particular, interpretability, or explainability, efforts in Artificial Intelligence (AI) focus on understanding how different model components contribute to its output (i.e., decision making). In contrast, the neuroscientific interpretability of ANNs requires explicit alignment between model components and neuroscientific constructs (e.g., different brain areas or phenomena, like recurrence or top-down feedback). Given the widespread calls to improve the interpretability of AI systems, we here highlight these different notions of interpretability and argue that the neuroscientific interpretability of ANNs can be pursued in parallel with, but independently from, the ongoing efforts in AI. Certain ML techniques (e.g., deep dream) can be leveraged in both fields, to ask what stimulus optimally activates the specific model features (feature visualization by optimization), or how different features contribute to the model's output (feature attribution). However, without appropriate brain alignment, certain features will remain uninterpretable to neuroscientists.


title: A Regression Tree Method for Longitudinal and Clustered Data with Multivariate Responses

abstract: RE-EM tree is a tree-based method that combines the regression tree and the linear mixed effects model for modeling univariate response longitudinal or clustered data. In this paper, we generalize the RE-EM tree method to multivariate response data, by adopting the Multivariate Regression Tree method proposed by De'Ath [2002]. The Multivariate RE-EM tree method estimates a population-level single tree structure that is driven by the multiple responses simultaneously and object-level random effects for each response variable, where correlation between the response variables and between the associated random effects are each allowed. Through simulation studies, we verify the advantage of the Multivariate RE-EM tree over the use of multiple univariate RE-EM trees and the Multivariate Regression Tree. We apply the Multivariate RE-EM tree to analyze a real data set that contains multidimensional nonfinancial characteristics of poverty of different countries as responses, and various potential causes of poverty as predictors.


title: Tight Bounds on the Chromatic Edge Stability Index of Graphs

abstract: The chromatic edge stability index $\mathrm{es}_{\chi'}(G)$ of a graph $G$ is the minimum number of edges whose removal results in a graph with smaller chromatic index. We give best-possible upper bounds on $\mathrm{es}_{\chi'}(G)$ in terms of the number of vertices of degree $\Delta(G)$ (if $G$ is Class 2), and the numbers of vertices of degree $\Delta(G)$ and ${\Delta(G)-1}$ (if $G$ is Class 1). If $G$ is bipartite we give an exact expression for $\mathrm{es}_{\chi'}(G)$ involving the maximum size of a matching in the subgraph induced by vertices of degree $\Delta(G)$. Finally, we consider whether a minimum mitigating set, that is a set of size $\mathrm{es}_{\chi'}(G)$ whose removal reduces the chromatic index, has the property that every edge meets a vertex of degree at least $\Delta(G)-1$; we prove that this is true for some minimum mitigating set of $G$, but not necessarily for every minimum mitigating set of $G$.


title: Mathematical model bridges disparate timescales of lifelong learning

abstract: Lifelong learning occurs on timescales ranging from minutes to decades. People can lose themselves in a new skill, practicing for hours until exhausted. And they can pursue mastery over days or decades, perhaps abandoning old skills entirely to seek out new challenges. A full understanding of learning requires an account that integrates these timescales. Here, we present a minimal quantitative model that unifies the nested timescales of learning. Our dynamical model recovers classic accounts of skill acquisition, and describes how learning emerges from moment-to-moment dynamics of motivation, fatigue, and work, while also situated within longer-term dynamics of skill selection, mastery, and abandonment. We apply this model to explore the benefits and pitfalls of a variety of training regimes and to characterize individual differences in motivation and skill development. Our model connects previously disparate timescales -- and the subdisciplines that typically study each timescale in isolation -- to offer a unified account of the timecourse of skill acquisition.


title: Out-of-Distribution Detection with Class Ratio Estimation

abstract: Density-based Out-of-distribution (OOD) detection has recently been shown unreliable for the task of detecting OOD images. Various density ratio based approaches achieve good empirical performance, however methods typically lack a principled probabilistic modelling explanation. In this work, we propose to unify density ratio based methods under a novel framework that builds energy-based models and employs differing base distributions. Under our framework, the density ratio can be viewed as the unnormalized density of an implicit semantic distribution. Further, we propose to directly estimate the density ratio of a data sample through class ratio estimation. We report competitive results on OOD image problems in comparison with recent work that alternatively requires training of deep generative models for the task. Our approach enables a simple and yet effective path towards solving the OOD detection problem.


title: The number of small-degree vertices in matchstick graphs

abstract: A matchstick graph is a crossing-free unit-distance graph in the plane. Harborth (1981) proposed the problem of determining whether there exists a matchstick graph in which every vertex has degree exactly $5$. In 1982, Blokhuis gave a proof of non-existence. A shorter proof was found by Kurz and Pinchasi (2011) using a charging method. We combine their method with the isoperimetric inequality to show that there are $\Omega(\sqrt{n})$ vertices in a matchstick graph on $n$ vertices that are of degree at most $4$, which is asymptotically tight.


title: Construction of a spike-based memory using neural-like logic gates based on Spiking Neural Networks on SpiNNaker

abstract: Neuromorphic engineering concentrates the efforts of a large number of researchers due to its great potential as a field of research, in a search for the exploitation of the advantages of the biological nervous system and the brain as a whole for the design of more efficient and real-time capable applications. For the development of applications as close to biology as possible, Spiking Neural Networks (SNNs) are used, considered biologically-plausible and that form the third generation of Artificial Neural Networks (ANNs). Since some SNN-based applications may need to store data in order to use it later, something that is present both in digital circuits and, in some form, in biology, a spiking memory is needed. This work presents a spiking implementation of a memory, which is one of the most important components in the computer architecture, and which could be essential in the design of a fully spiking computer. In the process of designing this spiking memory, different intermediate components were also implemented and tested. The tests were carried out on the SpiNNaker neuromorphic platform and allow to validate the approach used for the construction of the presented blocks. In addition, this work studies in depth how to build spiking blocks using this approach and includes a comparison between it and those used in other similar works focused on the design of spiking components, which include both spiking logic gates and spiking memory. All implemented blocks and developed tests are available in a public repository.


title: Dynamics of fast and slow magnetoacoustic waves in plasma slabs with thermal misbalance

abstract: Non-uniformity of the solar atmosphere along with the presence of non-adiabatic processes such as radiation cooling and unspecified heating can significantly affect the dynamics and properties of magnetoacoustic (MA) waves. To address the co-influence of these factors on the dispersion properties of MA waves, we considered a single magnetic slab composed of the thermally active plasma. Using the perturbation theory, we obtained a differential equation that determines the dynamics of the two-dimensional perturbations. Applying the assumption of strong magnetic structuring, we derived the dispersion relations for the sausage and kink MA modes. The numerical solution of the dispersion relations for the coronal conditions was performed to investigate the interplay between the non-uniformity and the thermal misbalance. For the heating scenario considered, it was obtained that the phase speed of both the sausage and kink slow MA waves is highly affected by the thermal misbalance in the long wavelength limit. The obtained characteristic timescales of the slow waves dissipation coincide with the periods of waves observed in the corona. Simultaneously, the phase speed of the fast waves is not affected by the thermal misbalance. The geometry of the magnetic structure still remains the main dispersion mechanism for the fast waves. Our estimation reveals that dissipation of the fast waves is weaker than dissipation of the slow waves in the coronal conditions. The obtained results are of importance for using the magnetoacoustic waves not only as a tool for estimating plasma parameters, but also as a tool for estimating the non-adiabatic processes.


title: Structural identifiability of compartmental models for infectious disease transmission is influenced by data type

abstract: If model identifiability is not confirmed, inferences from infectious disease transmission models may not be reliable, so they might lead to misleading recommendations. Structural identifiability analysis characterizes whether it is possible to obtain unique solutions for all unknown model parameters, given the model structure. In this work, we studied the structural identifiability of some typical deterministic compartmental models for infectious disease transmission, focusing on the influence of the data type considered as model output on the identifiability of unknown model parameters, including initial conditions. We defined 26 model versions, each having a unique combination of underlying compartmental structure and data type(s) considered as model output(s). Four compartmental model structures and three common data types in disease surveillance (incidence, prevalence and detected vector counts) were studied. The structural identifiability of some parameters varied depending on the type of model output. In general, models with multiple data types as outputs had more structurally identifiable parameters, than did models with a single data type as output. This study highlights the importance of a careful consideration of data types as an integral part of the inference process with compartmental infectious disease transmission models.


title: Predict better with less training data using a QNN

abstract: Over the past decade, machine learning revolutionized vision-based quality assessment for which convolutional neural networks (CNNs) have now become the standard. In this paper, we consider a potential next step in this development and describe a quanvolutional neural network (QNN) algorithm that efficiently maps classical image data to quantum states and allows for reliable image analysis. We practically demonstrate how to leverage quantum devices in computer vision and how to introduce quantum convolutions into classical CNNs. Dealing with a real world use case in industrial quality control, we implement our hybrid QNN model within the PennyLane framework and empirically observe it to achieve better predictions using much fewer training data than classical CNNs. In other words, we empirically observe a genuine quantum advantage for an industrial application where the advantage is due to superior data encoding.


title: On head-to-head results as tie-breaker and consequent opportunities for collusion

abstract: The outcome of some football matches has benefited both teams at the expense of a third team because head-to-head results were used for breaking ties. Inspired by these examples, our mathematical analysis identifies all possible collusion opportunities caused by this particular ranking rule in a single round-robin tournament with four teams. According to a simulation model based on the 2024 UEFA European Football Championship, merely the tie-breaking rule increases the probability of reaching a situation vulnerable to collusion by between 11.5 and 14.8 percentage points. This risk can scarcely be mitigated by a static match schedule. Therefore, tournament organisers are strongly encouraged to choose goal difference as the primary tie-breaking rule, similar to the official policy of FIFA.


title: Oxygenation-Controlled Collective Dynamics in Aquatic Worm Blobs

abstract: Many types of organisms utilize group aggregation as a method for survival. The freshwater oligochaete, California blackworms Lumbriculus variegatus form tightly entangled structures, or worm "blobs", that have adapted to survive in extremely low levels of dissolved oxygen (DO). Individual blackworms adapt to hypoxic environments through respiration via their mucous body wall and posterior ciliated hindgut, which they wave above them. However, the change in collective behavior at different levels of DO is not known. Using a closed-loop respirometer with flow, we discover that the relative tail reaching activity flux in low DO is $\sim$75x higher than in the high DO condition. Additionally, when flow rate is increased to suspend the worm blobs upward, we find that the average exposed surface area of a blob in low DO is $\sim$1.4x higher than in high DO. Furthermore, we observe emergent properties that arise when a worm blob is exposed to extreme DO levels. Here we show that internal stress is generated when worm blobs are exposed to high DO levels, allowing them to be physically lifted off from the bottom of a conical container using a serrated endpiece. Our results demonstrate how both collective behavior and the emergent generation of internal stress in worm blobs change to accommodate differing levels of oxygen, which could be used to model and simulate swarm robots, self-assembly structures, or soft material entanglements.


title: Gas Column Density Distribution of Molecular Clouds in the Third Quadrant of the Milky Way

abstract: We have obtained column density maps for an unbiased sample of 120 molecular clouds in the third quadrant of the Milky Way mid-plane (b$\le |5|^{\circ}$) within the galactic longitude range from 195$^{\circ}$ to 225$^{\circ}$, using the high sensitivity $^{12}$CO and $^{13}$CO ($J=1-0$) data from the Milky Way Imaging Scroll Painting (MWISP) project. The probability density functions of the molecular hydrogen column density of the clouds, N-PDFs, are fitted with both log-normal (LN) function and log-normal plus power-law (LN+PL) function. The molecular clouds are classified into three categories according to their shapes of N-PDFs, i.e., LN, LN+PL, and UN (unclear), respectively. About 72\% of the molecular clouds fall into the LN category, while 18\% and 10\% into the LN+PL and UN categories, respectively. A power-law scaling relation, $\sigma_s\propto N_{H_2}^{0.44}$, exists between the width of the N-PDF, $\sigma_s$, and the average column density, $N_{H_2}$, of the molecular clouds. However, $\sigma_s$ shows no correlation with the mass of the clouds. A correlation is found between the dispersion of normalized column density, $\sigma_{N/\rm <N>}$, and the sonic Mach number, $\mathcal{M}$, of molecular clouds. Overall, as predicted by numerical simulations, the N-PDFs of the molecular clouds with active star formation activity tend to have N-PDFs with power-law high-density tails.


title: Characterizing quantum criticality and steered coherence in the XY-Gamma chain

abstract: In this paper, we show that an effective spin Hamiltonian with various types of couplings can be engineered using quantum simulators in atomic-molecular-optical laboratories, dubbed the \emph{XY}-Gamma model. We analytically solve the one-dimensional short-range interacting case with the Jordan-Wigner transformation and establish the phase diagram. In the gapless phase, an incommensurate spiral order is manifested by the vector-chiral correlations. Between distinct gapped phases, a logarithmic scaling behavior of local measures, including spin correlations and the steered quantum coherence, is identified for the quantum critical points, yielding a compelling value of the correlation-length critical exponent. We derive explicit scaling forms of the excitation gap near the quantum critical points. The extracted critical exponents reveal the quantum phase transition on the boundary of Tomonaga-Luttinger liquid belongs to Lifshitz universality class.Our results may provide useful insights into the underlying mechanism in quantum criticality for state-of-the-art experiments of quantum simulation.


title: Combining Monte-Carlo Tree Search with Proof-Number Search

abstract: Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search methods by incorporating the concept of proof and disproof numbers into the UCT formula of MCTS. Experimental results demonstrate that PN-MCTS outperforms basic MCTS in several games including Lines of Action, MiniShogi, Knightthrough, and Awari, achieving win rates up to 94.0%.


title: FedHPO-B: A Benchmark Suite for Federated Hyperparameter Optimization

abstract: Hyperparameter optimization (HPO) is crucial for machine learning algorithms to achieve satisfactory performance, whose progress has been boosted by related benchmarks. Nonetheless, existing efforts in benchmarking all focus on HPO for traditional centralized learning while ignoring federated learning (FL), a promising paradigm for collaboratively learning models from dispersed data. In this paper, we first identify some uniqueness of HPO for FL algorithms from various aspects. Due to this uniqueness, existing HPO benchmarks no longer satisfy the need to compare HPO methods in the FL setting. To facilitate the research of HPO in the FL setting, we propose and implement a benchmark suite FedHPO-B that incorporates comprehensive FL tasks, enables efficient function evaluations, and eases continuing extensions. We also conduct extensive experiments based on FedHPO-B to benchmark a few HPO methods. We open-source FedHPO-B at https://github.com/alibaba/FederatedScope/tree/master/benchmark/FedHPOB.


title: MOCCA-Survey Database: Extra Galactic Globular Clusters. II. Milky Way and Andromeda

abstract: A comprehensive study of the co-evolution of globular cluster systems (GCS) in galaxies requires the ability to model both the large scale dynamics (0.01 - 10 kpc) regulating their orbital evolution, and the small scale dynamics (sub-pc - AU) regulating the internal dynamics of each globular cluster (GC). In this work we present a novel method that combine semi-analytic models of GCS with fully self-consistent Monte Carlo models to simultaneously evolve large GCSs. We use the population synthesis code MASinGa and the MOCCA-Survey Database I to create synthetic GC populations aimed at representing the observed features of GCs in the Milky Way (MW) and Andromeda (M31). Our procedure enables us to recover the spatial and mass distribution of GCs in such galaxies, and to constrain the amount of mass that GCs left either in the halo as dispersed debris, or in the galactic centre, where they can contribute to the formation of a nuclear star cluster (NSC) and can bring stellar and possibly intermediate mass black holes there. The final masses reported by our simulations are of a few order of magnitudes smaller than the observed values. These differences show that mass build-up of a NSC and central BHs in galaxies like MW and M31 cannot be solely explained by the infalling GC scenario. This build-up is likely to depend on the interplay between interactions and mergers of infalling GCs and gas. The latter can contribute to both in-situ star formation in the NSC and growth of the central BH.


title: Interpreting systems of continuity equations in spaces of probability measures through PDE duality

abstract: We introduce a notion of duality solution for a single or a system of transport equations in spaces of probability measures reminiscent of the viscosity solution notion for nonlinear parabolic equations. Our notion of solution by duality is, under suitable assumptions, equivalent to gradient flow solutions in case the single/system of equations has this structure. In contrast, we can deal with a quite general system of nonlinear nonlocal, diffusive or not, system of PDEs without any variational structure.


title: Lithium Ion Battery Electrode Manufacturing Model Accounting for 3D Realistic Shapes of Active Material Particles

abstract: The demand for lithium ion batteries (LIBs) on the market has gradually risen, with production increasing every year. To meet industrial needs, the development of digital twins designed to optimize LIB manufacturing processes is essential. Here, by using LiNi0.33Co0.33Mn0.33O2 (NMC111) material as an example, we introduce the realistic particles shapes of the active material obtained from X-ray micro-computed tomography into a Coarse-Grained Molecular Dynamic physical model to simulate the slurry and its drying, and into a Discrete Element Method model able to simulate the calendering of the resulting electrode. This model enables to link the manufacturing parameters with the microstructure of the electrodes and to better observe the effect of the former on the heterogeneity of the electrodes. The results of the simulations allow us, among others, to observe the alteration of the electrode heterogeneity during the manufacturing process and the slight deformation of the secondary particles of active material.


title: Narrowing the Coordinate-frame Gap in Behavior Prediction Models: Distillation for Efficient and Accurate Scene-centric Motion Forecasting

abstract: Behavior prediction models have proliferated in recent years, especially in the popular real-world robotics application of autonomous driving, where representing the distribution over possible futures of moving agents is essential for safe and comfortable motion planning. In these models, the choice of coordinate frames to represent inputs and outputs has crucial trade offs which broadly fall into one of two categories. Agent-centric models transform inputs and perform inference in agent-centric coordinates. These models are intrinsically invariant to translation and rotation between scene elements, are best-performing on public leaderboards, but scale quadratically with the number of agents and scene elements. Scene-centric models use a fixed coordinate system to process all agents. This gives them the advantage of sharing representations among all agents, offering efficient amortized inference computation which scales linearly with the number of agents. However, these models have to learn invariance to translation and rotation between scene elements, and typically underperform agent-centric models. In this work, we develop knowledge distillation techniques between probabilistic motion forecasting models, and apply these techniques to close the gap in performance between agent-centric and scene-centric models. This improves scene-centric model performance by 13.2% on the public Argoverse benchmark, 7.8% on Waymo Open Dataset and up to 9.4% on a large In-House dataset. These improved scene-centric models rank highly in public leaderboards and are up to 15 times more efficient than their agent-centric teacher counterparts in busy scenes.


title: How to structure citations data and bibliographic metadata in the OpenCitations accepted format

abstract: The OpenCitations organization is working on ingesting citation data and bibliographic metadata directly provided by the community (e.g., scholars and publishers). The aim is to improve the general coverage of open citations, which is still far from being complete, and use the provided metadata to enrich the characterization of the citing and cited entities. This paper illustrates how the citation data and bibliographic metadata should be structured to comply with the OpenCitations accepted format.


title: Macroscopic Quantum Tunneling of a Topological Ferromagnet

abstract: The recent advent of topological states of matter spawned many significant discoveries. The quantum anomalous Hall effect[1-3] is a prime example due to its potential for applications in quantum metrology[4, 5] as well as its influence on fundamental research into the underlying topological and magnetic states[6-11] and axion electrodynamics[2, 12-14]. Here, we perform electronic transport studies on a (V,Bi,Sb)2Te3 ferromagnetic topological insulator nanostructure in the quantum anomalous Hall regime. This allows us access to the dynamics of an individual ferromagnetic domain. The volume of the domain is estimated to be about 85 000 nm3, containing some 50 000 vanadium atoms, spread over a macroscopic distance of 115 nm. Telegraph noise resulting from the magnetization fluctuations of this domain is observed in the Hall signal. Careful analysis of the influence of temperature and external magnetic field on the domain switching statistics provides evidence for quantum tunneling of magnetization[15-22] in a macrospin state. This ferromagnetic macrospin is not only the largest magnetic object in which quantum tunneling has been observed, but also the first observation of the effect in a topological state of matter.


title: Classification of Stochastic Processes with Topological Data Analysis

abstract: In this study, we examine if engineered topological features can distinguish time series sampled from different stochastic processes with different noise characteristics, in both balanced and unbalanced sampling schemes. We compare our classification results against the results of the same classification tasks built on statistical and raw features. We conclude that in classification tasks of time series, different machine learning models built on engineered topological features perform consistently better than those built on standard statistical and raw features.


title: Upper bounds on two Hilbert coefficients

abstract: New upper bounds on the first and the second Hilbert coefficients of a Cohen-Macaulay module over a local ring are given. Characterizations are provided for some upper bounds to be attained. The characterizations are given in terms of Hilbert series as well as in terms of the Castelnuovo-Mumford regularity of the associated graded module.


title: Functional linear and single-index models: A unified approach via Gaussian Stein identity

abstract: Functional linear and single-index models are core regression methods in functional data analysis and are widely used for performing regression in a wide range of applications when the covariates are random functions coupled with scalar responses. In the existing literature, however, the construction of associated estimators and the study of their theoretical properties is invariably carried out on a case-by-case basis for specific models under consideration. In this work, assuming the predictors are Gaussian processes, we provide a unified methodological and theoretical framework for estimating the index in functional linear, and its direction in single-index models. In the latter case, the proposed approach does not require the specification of the link function. In terms of methodology, we show that the reproducing kernel Hilbert space (RKHS) based functional linear least-squares estimator, when viewed through the lens of an infinite-dimensional Gaussian Stein's identity, also provides an estimator of the index of the single-index model. Theoretically, we characterize the convergence rates of the proposed estimators for both linear and single-index models. Our analysis has several key advantages: (i) it does not require restrictive commutativity assumptions for the covariance operator of the random covariates and the integral operator associated with the reproducing kernel; and (ii) the true index parameter can lie outside of the chosen RKHS, thereby allowing for index misspecification as well as for quantifying the degree of such index misspecification. Several existing results emerge as special cases of our analysis.


title: Optimal Locomotion for Limbless Crawlers

abstract: Limbless crawling is ubiquitous in biology, from cells to organisms. We develop and analyze a model for the dynamics of one-dimensional elastic crawlers, subject to active stress and deformation-dependent friction with the substrate. We find that the optimal active stress distribution that maximizes the crawler's center of mass displacement given a fixed amount of energy input is a traveling wave. This theoretical optimum corresponds to peristalsis-like extension-contraction waves observed in biological organisms, possibly explaining the prevalence of peristalsis as a convergent gait across species. Our theory elucidates key observations in biological systems connecting the anchoring phase of a crawler to the retrograde and prograde distinction seen in peristaltic waves among various organisms. Using our optimal gait solution, we derive a scaling relation between the crawling speed and body mass, explaining experiments on earthworms with three orders of magnitude body mass variations. Our results offer insights and tools for optimal bioinspired crawling robots design with finite battery capacity.


title: Diffusion Curvature for Estimating Local Curvature in High Dimensional Data

abstract: We introduce a new intrinsic measure of local curvature on point-cloud data called diffusion curvature. Our measure uses the framework of diffusion maps, including the data diffusion operator, to structure point cloud data and define local curvature based on the laziness of a random walk starting at a point or region of the data. We show that this laziness directly relates to volume comparison results from Riemannian geometry. We then extend this scalar curvature notion to an entire quadratic form using neural network estimations based on the diffusion map of point-cloud data. We show applications of both estimations on toy data, single-cell data, and on estimating local Hessian matrices of neural network loss landscapes.


title: Emergence of Spinmerism for Molecular Spin-Qubits Generation

abstract: Molecular platforms are regarded as promising candidates in the generation of units of information for quantum computing. Herein, a strategy combining spin-crossover metal ions and radical ligands is proposed from a model Hamiltonian first restricted to exchange interactions. Unusual spin states structures emerge from the linkage of a singlet/triplet commutable metal centre with two doublet-radical ligands. The ground state nature is modulated by charge transfers and can exhibit a mixture of triplet and singlet local metal spin states. Besides, the superposition reaches a maximum for $2K_M = K_1 + K_2$, suggesting a necessary competition between the intramolecular $K_M$ and inter-metal-ligand $K_1$ and $K_2$ direct exchange interactions. The results promote \textit{spinmerism}, an original manifestation of quantum entanglement between the spin states of a metal centre and radical ligands. The study provides insights into spin-coupled compounds and inspiration for the development of molecular spin-qubits.


title: Similarity scaling of the axisymmetric turbulent jet

abstract: In the current work, we find that a free axisymmetric jet in air displays self-similarity in the fully developed part of the jet. We report accurate measurements of first, second and third order, spatially averaged statistical functions of the axial velocity component performed with a laser Doppler anemometer, including in the outer (high intensity) regions of the jet. The measurements are compared to predictions derived from a simple jet model, described in a separate publication, and we discuss the implications for the further study of self-similarity in a free jet. It appears that all statistical functions included in this study can be scaled with a single geometrical scaling factor -- the downstream distance from a common virtual origin.


title: Narrowing the allowed mass range of ultralight bosons with the S2 star

abstract: It is well known that N-body simulations of ultralight bosons show the formation of a solitonic dark matter core in the innermost part of the halo. The scale length of such a soliton depends on the inverse of the mass of the boson. On the other hand, the orbital motion of stars in the Galactic Center depends on the distribution of matter whether be it baryonic or dark, providing an excellent probe for the gravitational field of the region. In this Letter we propose the S-stars in the Galactic Center as a new observational tool, complementary to other astrophysical systems, to narrow down the range of allowed values for an ultralight dark matter candidate boson mass. We built mock catalogs mirroring the forthcoming astrometric and spectroscopic observations of S2, and we used a MCMC analysis to predict the accuracy down to which the mass of an ultralight boson may be bounded, and we showed that, once complementary constraints are considered, this analysis will help to restrict the allowed range of the boson mass. Our analysis forecasts the bound on the mass of an ultralight boson to be $< 10^{-19}$ eV at the 95% of confidence level.


title: Phonon Induced Instabilities in Correlated Electron Hamiltonians

abstract: Studies of Hamiltonians modeling the coupling between electrons as well as to local phonon excitations have been fundamental in capturing the novel ordering seen in many quasi-one dimensional condensed matter systems. Extending studies of such Hamiltonians to quasi-two dimensional systems is of great current interest, as electron-phonon couplings are predicted to play a major role in the stabilization or enhancement of novel phases in 2D material systems. In this work, we study model systems that describe the interplay between the Hubbard coupling and the phonon modes in the Holstein (H) and Su-Schrieffer-Heeger (SSH) Hamiltonians using the functional renormalization group (fRG). For both types of electron phonon couplings, we find the predicted charge density wave phases in competition with anti-ferromagnetic ($AF$) ordering. As the system is doped, the transition shifts, with both orders showing incommensurate peaks. We compare the evolution of the quasiparticle weight for the Holstein model with that of the SSH model as the systems transition from antiferromagnetic to charge-ordered ground states. Finally, we calculate the self-energy of the phonon and capture the impact of charge ordering on the phonon modes.


title: Chains of rotating boson stars

abstract: Boson Stars are stationary, axially symmetric solutions of a complex scalar field theory coupled to gravity. Recently, multi-solitonic configurations interpreted as static chains of multiple Boson Stars bound by gravity and carrying no angular momentum were reported. We propose to generalize those solutions to the stationary case by constructing chains of rotating Boson Stars and analyze their properties. The non-linear elliptic field equations are solved using the finite element method. We find that chains with an even number of constituents exhibit the same spiral-like frequency dependence of their mass, angular momentum and Noether charge as single Boson Stars. In contrast, sequences of chains with an odd number of constituents show nontrivial loops starting and ending at the flat vacuum. As a consequence, such solutions cannot be uniquely parametrized by a single parameter. We conjecture that all rotating chains correspond to excitations of single Boson Stars or pairs of them. We also analyze their flat space limit and find that they reduce to chains of $Q$-balls.


title: Graph rigidity properties of Ramanujan graphs

abstract: A recent result of Cioab\u{a}, Dewar and Gu implies that any $k$-regular Ramanujan graph with $k\geq 8$ is globally rigid in $\mathbb{R}^2$. In this paper, we extend these results and prove that any $k$-regular Ramanujan graph of sufficiently large order is globally rigid in $\mathbb{R}^2$ when $k\in \{6, 7\}$, and when $k\in \{4,5\}$ if it is also vertex-transitive. These results imply that the Ramanujan graphs constructed by Morgenstern in 1994 are globally rigid. We also prove several results on other types of framework rigidity, including body-bar rigidity, body-hinge rigidity, and rigidity on surfaces of revolution. In addition, we use computational methods to determine which Ramanujan graphs of small order are globally rigid in $\mathbb{R}^2$.


title: Distributed Generalized Wirtinger Flow for Interferometric Imaging on Networks

abstract: We study the problem of decentralized interferometric imaging over networks, where agents have access to a subset of local radar measurements and can compute pair-wise correlations with their neighbors. We propose a primal-dual distributed algorithm named Distributed Generalized Wirtinger Flow (DGWF). We use the theory of low rank matrix recovery to show when the interferometric imaging problem satisfies the Regularity Condition, which implies the Polyak-Lojasiewicz inequality. Moreover, we show that DGWF converges geometrically for smooth functions. Numerical simulations for single-scattering radar interferometric imaging demonstrate that DGWF can achieve the same mean-squared error image reconstruction quality as its centralized counterpart for various network connectivity and size.


title: How unfair is private learning ?

abstract: As machine learning algorithms are deployed on sensitive data in critical decision making processes, it is becoming increasingly important that they are also private and fair. In this paper, we show that, when the data has a long-tailed structure, it is not possible to build accurate learning algorithms that are both private and results in higher accuracy on minority subpopulations. We further show that relaxing overall accuracy can lead to good fairness even with strict privacy requirements. To corroborate our theoretical results in practice, we provide an extensive set of experimental results using a variety of synthetic, vision (CIFAR10 and CelebA), and tabular (Law School) datasets and learning algorithms.


title: An Askey-Wilson Algebra of Rank 2

abstract: An algebra is introduced which can be considered as a rank 2 extension of the Askey-Wilson algebra. Relations in this algebra are motivated by relations between coproducts of twisted primitive elements in the two-fold tensor product of the quantum algebra $\mathcal{U}_{q}(\mathfrak{sl}(2,\mathbb C))$. It is shown that bivariate $q$-Racah polynomials appear as overlap coefficients of eigenvectors of generators of the algebra. Furthermore, the corresponding $q$-difference operators are calculated using the defining relations of the algebra, showing that it encodes the bispectral properties of the bivariate $q$-Racah polynomials.


title: Constrained Imitation Learning for a Flapping Wing Unmanned Aerial Vehicle

abstract: This paper presents a data-driven optimal control policy for a micro flapping wing unmanned aerial vehicle. First, a set of optimal trajectories are computed off-line based on a geometric formulation of dynamics that captures the nonlinear coupling between the large angle flapping motion and the quasi-steady aerodynamics. Then, it is transformed into a feedback control system according to the framework of imitation learning. In particular, an additional constraint is incorporated through the learning process to enhance the stability properties of the resulting controlled dynamics. Compared with conventional methods, the proposed constrained imitation learning eliminates the need to generate additional optimal trajectories on-line, without sacrificing stability. As such, the computational efficiency is substantially improved. Furthermore, this establishes the first nonlinear control system that stabilizes the coupled longitudinal and lateral dynamics of flapping wing aerial vehicle without relying on averaging or linearization. These are illustrated by numerical examples for a simulated model inspired by Monarch butterflies.


title: Large cavitation bubbles in the tube with a conical-frustum shaped closed end during a transient process

abstract: The transient process accompanied by extreme acceleration in the conical sections of hydraulic systems (e.g., draft tube, diffuser) can induce large cavitation bubbles both at the closed ends and in the bulk liquid. The collapses of the large cavitation bubbles can cause severe damage to the solid walls. We conduct experiments in the tubes with different conical-frustum shaped closed ends with the `tube-arrest' method and observe bubbles generated at these two locations. For the bubbles generated at the close end of the tube, we propose the onset criteria, consisting of two universal non-dimensional parameters $Ca_1$ and $Ca_2$, of large cavitation bubbles separating the water column. We investigate their dynamics including the collapse time and speed. The results indicate that the larger the conical angle, the faster the bubbles collapse. For the bubbles generated in the bulk liquid, we numerically study the collapse time, the jet characteristics and the pressure pulse at bubble collapse. We observe a much stronger jet and pressure pulse of bubbles in tubes, comparing with a bubble near an infinite plate. Our results can provide guidance in the design and safe operation of hydraulic machinery with complex geometries, considering the cavitation during the transient process.


title: Pterodactyls: A Tool to Uniformly Search and Vet for Young Transiting Planets In TESS Primary Mission Photometry

abstract: Kepler's short-period exoplanet population has revealed evolutionary features such as the Radius Valley and the Hot Neptune desert that are likely sculpted by atmospheric loss over time. These findings suggest that the primordial planet population is different from the Gyr-old Kepler population, and motivates exoplanet searches around young stars. Here, we present pterodactyls , a data reduction pipeline specifically built to address the challenges in discovering exoplanets around young stars and to work with TESS Primary Mission 30-min cadence photometry, since most young stars were not pre-selected TESS 2-min cadence targets. pterodactyls builds on publicly available and tested tools in order to extract, detrend, search, and vet transiting young planet candidates. We search five clusters with known transiting planets: Tucana-Horologium Association, IC 2602, Upper Centaurus Lupus, Ursa Major and Pisces Eridani. We show that pterodactyls recovers seven out of the eight confirmed planets and one out of the two planet candidates, most of which were initially detected in 2-min cadence data. For these clusters, we conduct injection-recovery tests to characterize our detection efficiency, and compute an intrinsic planet occurrence rate of 49+-20% for sub-Neptunes and Neptunes (1.8-6 Re) within 12.5 days, which is higher than Kepler's Gyr-old occurrence rates of 6.8+-0.3%. This potentially implies that these planets have shrunk with time due to atmospheric mass loss. However, a proper assessment of the occurrence of transiting young planets will require a larger sample unbiased to planets already detected. As such, pterodactyls will be used in future work to search and vet for planet candidates in nearby clusters and moving groups.


title: Hysteretic Behavior Simulation Based on Pyramid Neural Network:Principle, Network Architecture, Case Study and Explanation

abstract: An accurate and efficient simulation of the hysteretic behavior of materials and components is essential for structural analysis. The surrogate model based on neural networks shows significant potential in balancing efficiency and accuracy. However, its serial information flow and prediction based on single-level features adversely affect the network performance. Therefore, a weighted stacked pyramid neural network architecture is proposed herein. This network establishes a pyramid architecture by introducing multi-level shortcuts to integrate features directly in the output module. In addition, a weighted stacked strategy is proposed to enhance the conventional feature fusion method. Subsequently, the redesigned architectures are compared with other commonly used network architectures. Results show that the redesigned architectures outperform the alternatives in 87.5% of cases. Meanwhile, the long and short-term memory abilities of different basic network architectures are analyzed through a specially designed experiment, which could provide valuable suggestions for network selection.


title: Persistent Path Laplacian

abstract: Path homology proposed by S.-T.Yau and his co-workers provides a new mathematical model for directed graphs and networks. Persistent path homology (PPH) extends the path homology with filtration to deal with asymmetry structures. However, PPH is constrained to purely topological persistence and cannot track the homotopic shape evolution of data during filtration. To overcome the limitation of PPH, persistent path Laplacian (PPL) is introduced to capture the shape evolution of data. PPL's harmonic spectra fully recover PPH's topological persistence and its non-harmonic spectra reveal the homotopic shape evolution of data during filtration.


title: Neural Diffusion Processes

abstract: Neural network approaches for meta-learning distributions over functions have desirable properties such as increased flexibility and a reduced complexity of inference. Building on the successes of denoising diffusion models for generative modelling, we propose Neural Diffusion Processes (NDPs), a novel approach that learns to sample from a rich distribution over functions through its finite marginals. By introducing a custom attention block we are able to incorporate properties of stochastic processes, such as exchangeability, directly into the NDP's architecture. We empirically show that NDPs can capture functional distributions close to the true Bayesian posterior, demonstrating that they can successfully emulate the behaviour of Gaussian processes and surpass the performance of neural processes. NDPs enable a variety of downstream tasks, including regression, implicit hyperparameter marginalisation, non-Gaussian posterior prediction and global optimisation.


title: Finding and Following Optimal Trajectories for an Overactuated Floating Robotic Platform

abstract: The recent increase in yearly spacecraft launches and the high number of planned launches have raised questions about maintaining accessibility to space for all interested parties. A key to sustaining the future of space-flight is the ability to service malfunctioning - and actively remove dysfunctional spacecraft from orbit. Robotic platforms that autonomously perform these tasks are a topic of ongoing research and thus must undergo thorough testing before launch. For representative system-level testing, the European Space Agency (ESA) uses, among other things, the Orbital Robotics and GNC Lab (ORGL), a flat-floor facility where air-bearing based platforms exhibit free-floating behavior in three Degrees of Freedom (DoF). This work introduces a representative simulation of a free-floating platform in the testing environment and a software framework for controller development. Finally, this work proposes a controller within that framework for finding and following optimal trajectories between arbitrary states, which is evaluated in simulation and reality.


title: A High Resolution Optimum 2D Coprime Planar Array

abstract: Designing a new class of rectangular two-dimensional sparse array to enhance the signal resolving capabilities with a limited number of sensors has always been a challenge. We explore the non-uniformity of the sparse arrays to enhance the Degrees of Freedom (DOF) by considering the under-determined cases using the concept of the virtual array. In this paper, we propose a two-dimensional novel sparse array configurations to estimate both azimuth and elevation angle of arrival of the signal. We propose a new class of rectangular two-dimensional arrays with sensors on a plane, whose difference co-array can give rise to a virtual two-dimensional planar array with a much larger number of elements, leading to an increase in the fully augmentable range of the array. The difference co-array of the proposed rectangular array gives a contiguous dense structure which leads to a reduction in holes within the planar array as compared to the traditional methods of CPA geometry in which there are many holes present in the outer dimension of the array structure as well as within the array as well. Moreover, we know that the angular resolution of an array is highly dependent on its beamwidth which itself is inversely proportional to array size or effective array aperture. Hence by increasing the array dimension a higher resolution can be achieved. The proposed arrays provide a higher DOF for the given number of physical sensors. Optimization is performed on the proposed geometry to maximize the directivity in the array steering look-up direction by suppressing the sidelobe levels to a greater extent.


title: Constraining GUP Models Using Limits on SME Coefficients

abstract: In this proceedings, I outline recent efforts to constrain models based on generalized uncertainty principles (GUP) using limits on coefficients of the Standard-Model Extension. Two main results are reported: (1) bounds on isotropic GUP models are improved by a factor of $10^{10}$ compared to previous spectroscopic bounds; and (2) anisotropic GUP models are established and also constrained.


title: Sharp-MAML: Sharpness-Aware Model-Agnostic Meta Learning

abstract: Model-agnostic meta learning (MAML) is currently one of the dominating approaches for few-shot meta-learning. Albeit its effectiveness, the optimization of MAML can be challenging due to the innate bilevel problem structure. Specifically, the loss landscape of MAML is much more complex with possibly more saddle points and local minimizers than its empirical risk minimization counterpart. To address this challenge, we leverage the recently invented sharpness-aware minimization and develop a sharpness-aware MAML approach that we term Sharp-MAML. We empirically demonstrate that Sharp-MAML and its computation-efficient variant can outperform the plain-vanilla MAML baseline (e.g., $+3\%$ accuracy on Mini-Imagenet). We complement the empirical study with the convergence rate analysis and the generalization bound of Sharp-MAML. To the best of our knowledge, this is the first empirical and theoretical study on sharpness-aware minimization in the context of bilevel learning. The code is available at https://github.com/mominabbass/Sharp-MAML.


title: A Rewriting Framework for Interacting Cyber-Physical Agents

abstract: The analysis of cyber-physical systems (CPS) is challenging due to the large state space and the continuous changes occurring in their constituent parts. Design practices favor modularity to help reducing this complexity. In a previous work, we proposed a discrete semantic model for CPS that captures both cyber and physical aspects as streams of discrete observations, which ultimately form the behavior of a component. This semantic model is denotational and compositional, where each composition operator algebraically models an interaction between a pair of components. In this paper, we propose a specification of components as rewrite systems. The specification is operational and executable, and we study conditions for its semantics as components to be compositional. We demonstrate our framework by modeling a coordination of robots moving on a shared field. We show that our system of robots can be coordinated by a protocol in order to exhibit a desired emerging behavior. We use an implementation of our framework in Maude to give practical results.


title: Temperature-independent non-linear terahertz transmission by liquid water

abstract: Liquid water is one of the most studied substances, yet many of its properties are difficult to rationalize. The uniqueness of water is rooted in the dynamic network of hydrogen-bonded molecules with relaxation time constants of about one picosecond. Terahertz fields oscillate on a picosecond timescale and are inherently suited to study water. Recent advances in non-linear terahertz spectroscopy have revealed large signals from water, which have been interpreted with different, sometimes competing, theoretical models. Here we show that the non-linear transmission of liquid water at ~1 THz is equal at 21 {\deg}C and 4 {\deg}C, thus suggesting that the most appropriate microscopic models should depend weakly on temperature. Among the different mechanisms proposed to date, the resonant reorientation of hydrogen-bonded water molecules might be the most appropriate to describe all of the currently available experimental results.


title: A complete metric topology on relative low energy spaces

abstract: In this paper, we show that the low energy spaces in the prescribed singularity case $\mathcal{E}_{\psi}(X,\theta,\phi)$ have a natural topology which is completely metrizable. This topology is stronger than convergence in capacity.


title: Duality between predictability and reconstructability in complex systems

abstract: Predicting the evolution of a large system of units using its structure of interaction is a fundamental problem in complex system theory. And so is the problem of reconstructing the structure of interaction from temporal observations. Here, we find an intricate relationship between predictability and reconstructability using an information-theoretical point of view. We use the mutual information between a random graph and a stochastic process evolving on this random graph to quantify their codependence. Then, we show how the uncertainty coefficients, which are intimately related to that mutual information, quantify our ability to reconstruct a graph from an observed time series, and our ability to predict the evolution of a process from the structure of its interactions. Interestingly, we find that predictability and reconstructability, even though closely connected by the mutual information, can behave differently, even in a dual manner. We prove how such duality universally emerges when changing the number of steps in the process, and provide numerical evidence of other dualities occurring near the criticality of multiple different processes evolving on different types of structures.


title: Classification of equilibria for the spatially homogeneous Boltzmann equation for Fermi-Dirac particles

abstract: The classification of equilibria for the spatially homogeneous Boltzmann equation for Fermi-Dirac particles is proved for any $n$-dimensional velocity space with $n\ge 2$. The same classification has been proven in \cite{Lu2001} for $n=3$. Now the proof for $n\ge 2$ is based on a recent result on a characterization of Euclidean balls for all dimensions $\ge 2$.


title: On Degenerate $3$-$(\alpha,\delta)$-Sasakian Manifolds

abstract: We propose a new method to construct degenerate $3$-$(\alpha,\delta)$-Sasakian manifolds as fiber products of Boothby-Wang bundles over hyperk\"ahler manifolds. Subsequently, we study homogeneous degenerate $3$-$(\alpha, \delta)$-Sasakian manifolds and prove that no non-trivial compact examples exist as well as that there is exactly one family of nilpotent Lie groups with this geometry, the quaternionic Heisenberg groups.


title: Patch-based Object-centric Transformers for Efficient Video Generation

abstract: In this work, we present Patch-based Object-centric Video Transformer (POVT), a novel region-based video generation architecture that leverages object-centric information to efficiently model temporal dynamics in videos. We build upon prior work in video prediction via an autoregressive transformer over the discrete latent space of compressed videos, with an added modification to model object-centric information via bounding boxes. Due to better compressibility of object-centric representations, we can improve training efficiency by allowing the model to only access object information for longer horizon temporal information. When evaluated on various difficult object-centric datasets, our method achieves better or equal performance to other video generation models, while remaining computationally more efficient and scalable. In addition, we show that our method is able to perform object-centric controllability through bounding box manipulation, which may aid downstream tasks such as video editing, or visual planning. Samples are available at https://sites.google.com/view/povt-public


title: A Mean Field Game model for COVID-19 with human capital accumulation

abstract: In this manuscript we present several possible ways of modeling human capital accumulation during the spread of a disease following an agent based approach, where agents behave maximizing their intertemporal utility. We assume that the interaction between agents is of mean field type, yielding a Mean Field Game description of the problem. We discuss how the analysis of a model including both the mechanism of change of species from one epidemiological state to the other and an optimization problem for each agent leads to an aggregate behavior that is not easy to describe, and that sometimes exhibits structural problems. Therefore we eventually propose and study numerically a SEIRD model in which the rate of infection depends on the distribution of the population, given exogenously as the solution to the the Mean Field Game system arising as the macroscopic description of the discrete multi-agent economic model for the accumulation of human capital. Such model arises in fact as a simplified but tractable version of the initial one.


title: The role of dRGT mass terms in cutoff holography and the Randall--Sundrum II scenario

abstract: We show how the $T^2$ deformation of large $N$, holographic conformal field theories arise from coupling them to the quadratic mass term of ghost-free massive gravity. We then show that in a certain approximation, the equations arising from the variation of the background frame field are those of the Randall--Sundrum II scenario.


title: Few-Shot Audio-Visual Learning of Environment Acoustics

abstract: Room impulse response (RIR) functions capture how the surrounding physical environment transforms the sounds heard by a listener, with implications for various applications in AR, VR, and robotics. Whereas traditional methods to estimate RIRs assume dense geometry and/or sound measurements throughout the environment, we explore how to infer RIRs based on a sparse set of images and echoes observed in the space. Towards that goal, we introduce a transformer-based method that uses self-attention to build a rich acoustic context, then predicts RIRs of arbitrary query source-receiver locations through cross-attention. Additionally, we design a novel training objective that improves the match in the acoustic signature between the RIR predictions and the targets. In experiments using a state-of-the-art audio-visual simulator for 3D environments, we demonstrate that our method successfully generates arbitrary RIRs, outperforming state-of-the-art methods and -- in a major departure from traditional methods -- generalizing to novel environments in a few-shot manner. Project: http://vision.cs.utexas.edu/projects/fs_rir.


title: Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalization

abstract: Curbing online hate speech has become the need of the hour; however, a blanket ban on such activities is infeasible for several geopolitical and cultural reasons. To reduce the severity of the problem, in this paper, we introduce a novel task, hate speech normalization, that aims to weaken the intensity of hatred exhibited by an online post. The intention of hate speech normalization is not to support hate but instead to provide the users with a stepping stone towards non-hate while giving online platforms more time to monitor any improvement in the user's behavior. To this end, we manually curated a parallel corpus - hate texts and their normalized counterparts (a normalized text is less hateful and more benign). We introduce NACL, a simple yet efficient hate speech normalization model that operates in three stages - first, it measures the hate intensity of the original sample; second, it identifies the hate span(s) within it; and finally, it reduces hate intensity by paraphrasing the hate spans. We perform extensive experiments to measure the efficacy of NACL via three-way evaluation (intrinsic, extrinsic, and human-study). We observe that NACL outperforms six baselines - NACL yields a score of 0.1365 RMSE for the intensity prediction, 0.622 F1-score in the span identification, and 82.27 BLEU and 80.05 perplexity for the normalized text generation. We further show the generalizability of NACL across other platforms (Reddit, Facebook, Gab). An interactive prototype of NACL was put together for the user study. Further, the tool is being deployed in a real-world setting at Wipro AI as a part of its mission to tackle harmful content on online platforms.


title: Normalized solutions for Schr\"{o}dinger-Bopp-Podolsky system

abstract: In this paper, we study the following energy functional originates from the Schr\"{o}dinger-Bopp-Podolsky system $$I(u)=\frac{1}{2}\int_{\mathbb{R}^{3}}|\nabla u|^{2}dx+\frac{1}{4}\int_{\mathbb{R}^{3}} \phi_{u}u^{2}dx-\frac{1}{p}\int_{\mathbb{R}^{3}}|u|^{p}dx$$ constrained on $B_{\rho}=\left\{u\in H^{1}(\mathbb{R}^{3},C):\ \left\|u\right\|_{2}=\rho\right\},$ where $\rho>0.$ As such constrained problem $I(u)$ is bounded from below on $B_{\rho}$ when $p\in(2,\frac{10}{3}).$ We use minimizing method to get a normalized solution.


title: Coupling by reflection for controlled diffusion processes: turnpike property and large time behavior of Hamilton Jacobi Bellman equations

abstract: We investigate the long time behavior of weakly dissipative semilinear Hamilton-Jacobi-Bellman (HJB) equations and the turnpike property for the corresponding stochastic control problems. To this aim, we develop a probabilistic approach based on a variant of coupling by reflection adapted to the study of controlled diffusion processes. We prove existence and uniqueness of solutions for the ergodic Hamilton-Jacobi-Bellman equation and different kind of quantitative exponential convergence results at the level of the value function, of the optimal controls and of the optimal processes. Moreover, we provide uniform in time gradient and Hessian estimates for the solutions of the HJB equation that are of independent interest.


title: Strongly contracting axes for fully irreducible automorphisms of Generalized Baumslag-Solitar groups

abstract: Similarly to the action of $Out(F_N)$ on Outer Space, the outer automorphism group of a Generalized Baumslag Solitar group acts on a deformation space endowed with the Lipschitz metric and the action of any fully irreducible automorphism with a train track representative is hyperbolic. Inspired by previous work by Algom-Kfir, we prove that the axis of such an automorphism is strongly contracting.


title: Robust Semantic Communications with Masked VQ-VAE Enabled Codebook

abstract: Although semantic communications have exhibited satisfactory performance for a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise refers to the misleading between the intended semantic symbols and received ones, thus cause the failure of tasks. In this paper, we first propose a framework for the robust end-to-end semantic communication systems to combat the semantic noise. In particular, we analyze sample-dependent and sample-independent semantic noise. To combat the semantic noise, the adversarial training with weight perturbation is developed to incorporate the samples with semantic noise in the training dataset. Then, we propose to mask a portion of the input, where the semantic noise appears frequently, and design the masked vector quantized-variational autoencoder (VQ-VAE) with the noise-related masking strategy. We use a discrete codebook shared by the transmitter and the receiver for encoded feature representation. To further improve the system robustness, we develop a feature importance module (FIM) to suppress the noise-related and task-unrelated features. Thus, the transmitter simply needs to transmit the indices of these important task-related features in the codebook. Simulation results show that the proposed method can be applied in many downstream tasks and significantly improve the robustness against semantic noise with remarkable reduction on the transmission overhead.


title: Model Selection in Variational Mixed Effects Models

abstract: Variational inference is an alternative estimation technique for Bayesian models. Recent work shows that variational methods provide consistent estimation via efficient, deterministic algorithms. Other tools, such as model selection using variational AICs (VAIC) have been developed and studied for the linear regression case. While mixed effects models have enjoyed some study in the variational context, tools for model selection are lacking. One important feature of model selection in mixed effects models, particularly longitudinal models, is the selection of the random effects which in turn determine the covariance structure for the repeatedly sampled outcome. To address this, we derive a VAIC specifically for variational mixed effects (VME) models. We also implement a parameter-efficient VME as part of our study which reduces any general random effects structure down to a single subject-specific score. This model accommodates a wide range of random effect structures including random intercept and slope models as well as random functional effects. Our VAIC can model and perform selection on a variety of VME models including more classic longitudinal models as well as longitudinal scalar-on-function regression. As we demonstrate empirically, our VAIC performs well in discriminating between correctly and incorrectly specified random effects structures. Finally, we illustrate the use of VAICs for VMEs on two datasets: a study of lead levels in children and a study of diffusion tensor imaging.


title: The influence of color on prices of abstract paintings

abstract: Determination of price of an artwork is a fundamental problem in cultural economics. In this work we investigate what impact visual characteristics of a painting have on its price. We construct a number of visual features measuring complexity of the painting, its points of interest, segmentation-based features, local color features, and features based on Itten and Kandinsky theories, and utilize mixed-effects model to study impact of these features on the painting price. We analyze the influence of the color on the example of the most complex art style - abstractionism, by created Kandinsky, for which the color is the primary basis. We use Itten's theory - the most recognized color theory in art history, from which the largest number of subtheories was born. For this day it is taken as the base for teaching artists. We utilize novel dataset of 3885 paintings collected from Christie's and Sotheby's and find that color harmony has some explanatory power, color complexity metrics are insignificant and color diversity explains price well.


title: Open level lines of a superposition of periodic potentials on a plane

abstract: We consider here open level lines of potentials resulting from the superposition of two different periodic potentials on the plane. This problem can be considered as a particular case of the Novikov problem on the behavior of open level lines of quasi-periodic potentials on the plane with four quasi-periods. At the same time, the formulation of this problem may have many additional features that arise in important physical systems related to it. Here we will try to give a general description of the emerging picture both in the most general case and in the presence of additional restrictions. The main approach to describing the possible behavior of the open level lines will be based on their division into topologically regular and chaotic level lines.


title: Improving trajectory calculations using deep learning inspired single image superresolution

abstract: Lagrangian trajectory or particle dispersion models as well as semi-Lagrangian advection schemes require meteorological data such as wind, temperature and geopotential at the exact spatio-temporal locations of the particles that move independently from a regular grid. Traditionally, this high-resolution data has been obtained by interpolating the meteorological parameters from the gridded data of a meteorological model or reanalysis, e.g. using linear interpolation in space and time. However, interpolation errors are a large source of error for these models. Reducing them requires meteorological input fields with high space and time resolution, which may not always be available and can cause severe data storage and transfer problems. Here, we interpret this problem as a single image superresolution task. We interpret meteorological fields available at their native resolution as low-resolution images and train deep neural networks to up-scale them to higher resolution, thereby providing more accurate data for Lagrangian models. We train various versions of the state-of-the-art Enhanced Deep Residual Networks for Superresolution on low-resolution ERA5 reanalysis data with the goal to up-scale these data to arbitrary spatial resolution. We show that the resulting up-scaled wind fields have root-mean-squared errors half the size of the winds obtained with linear spatial interpolation at acceptable computational inference costs. In a test setup using the Lagrangian particle dispersion model FLEXPART and reduced-resolution wind fields, we demonstrate that absolute horizontal transport deviations of calculated trajectories from "ground-truth" trajectories calculated with undegraded 0.5{\deg} winds are reduced by at least 49.5% (21.8%) after 48 hours relative to trajectories using linear interpolation of the wind data when training on 2{\deg} to 1{\deg} (4{\deg} to 2{\deg}) resolution data.


title: SYNERgy between SYNaptic consolidation and Experience Replay for general continual learning

abstract: Continual learning (CL) in the brain is facilitated by a complex set of mechanisms. This includes the interplay of multiple memory systems for consolidating information as posited by the complementary learning systems (CLS) theory and synaptic consolidation for protecting the acquired knowledge from erasure. Thus, we propose a general CL method that creates a synergy between SYNaptic consolidation and dual memory Experience Replay (SYNERgy). Our method maintains a semantic memory that accumulates and consolidates information across the tasks and interacts with the episodic memory for effective replay. It further employs synaptic consolidation by tracking the importance of parameters during the training trajectory and anchoring them to the consolidated parameters in the semantic memory. To the best of our knowledge, our study is the first to employ dual memory experience replay in conjunction with synaptic consolidation that is suitable for general CL whereby the network does not utilize task boundaries or task labels during training or inference. Our evaluation on various challenging CL scenarios and characteristics analyses demonstrate the efficacy of incorporating both synaptic consolidation and CLS theory in enabling effective CL in DNNs.


title: Sensitivity of viscoelastic characterization in multi-harmonic atomic force microscopy

abstract: Quantifying the nanomechanical properties of soft-matter using multi-frequency atomic force microscopy (AFM) is crucial for studying the performance of polymers, ultra-thin coatings, and biological systems. Such characterization processes often make use of cantilever's spectral components to discern nanomechanical properties within a multi-parameter optimization problem. This could inadvertently lead to an over-determined parameter estimation with no clear relation between the identified parameters and their influence on the experimental data. In this work, we explore the sensitivity of viscoelastic characterization in polymeric samples to the experimental observables of multi-frequency intermodulation AFM. By performing simulations and experiments we show that surface viscoelasticity has negligible effect on the experimental data and can lead to inconsistent and often non-physical identified parameters. Our analysis reveals that this lack of influence of the surface parameters relates to a vanishing gradient and non-convexity while minimizing the objective function. By removing the surface dependency from the model, we show that the characterization of bulk properties can be achieved with ease and without any ambiguity. Our work sheds light on the sensitivity issues that can be faced when optimizing for a large number of parameters and observables in AFM operation, and calls for the development of new viscoelastic models at the nanoscale and improved computational methodologies for nanoscale mapping of viscoelasticity using AFM.


title: Nonadiabatic transition paths from quantum jump trajectories

abstract: We present a means of studying rare reactive pathways in open quantum systems using Transition Path Theory and ensembles of quantum jump trajectories. This approach allows for elucidation of reactive paths for dissipative, nonadiabatic dynamics when the system is embedded in a Markovian environment. We detail the dominant pathways and rates of thermally activated processes, as well as the relaxation pathways and photoyields following vertical excitation in a minimal model of a conical intersection. We find that the geometry of the conical intersection affects the electronic character of the transition state, as defined through a generalization of a committor function for a thermal barrier crossing event. Similarly, the geometry changes the mechanism of relaxation following a vertical excitation. Relaxation in models resulting from small diabatic coupling proceed through pathways dominated by pure dephasing, while those with large diabatic coupling proceed through pathways limited by dissipation. The perspective introduced here for the nonadiabatic dynamics of open quantum systems generalizes classical notions of reactive paths to fundamentally quantum mechanical processes.


title: Simultaneous computation of Kendall's tau and its jackknife variance

abstract: We present efficient algorithms for simultaneously computing Kendall's tau and the jackknife estimator of its variance. For the classical pairwise tau, we describe a modification of Knight's algorithm (originally designed to compute only tau) that does so while preserving its $O(n \log_2 n)$ runtime in the number of observations $n$. We also introduce a novel algorithm computing a multivariate extension of tau and its jackknife variance in $O(n \log_2^p n)$ time.


title: Penalty methods to compute stationary solutions in constrained optimization problems

abstract: This paper is devoted to studying the stationary solutions of a general constrained optimization problem through its associated unconstrained penalized problems. We aim to answer the question, "what do the stationary solutions of a penalized unconstrained problem tell us about the solutions of the original constrained optimization problem?". We answer the latter question by establishing relationships between global (local) minimizers and stationary points of the two optimization problems. Given the strong connection between stationary solutions between problems, we introduce a new approximate $\varepsilon$-stationary solution for the constrained optimization problems. We propose an algorithm to compute such an approximate stationary solution for a general constrained optimization problem, even in the absence of Clarke regularity. Under reasonable assumptions, we establish the rate $O(\varepsilon^{-2})$ for our algorithm, akin to the gradient descent method for smooth minimization. Since our penalty terms are constructed by the powers of the distance function, our stationarity analysis heavily depends on the generalized differentiation of the distance function. In particular, we characterize the (semi-)differentiability of the distance function $\mbox{dist}(. ;X)$ defined by a Fr\'echet smooth norm, in terms of the geometry of the set $X$. We show that $\mbox{dist} (. ;X)$ is semi-differentiable if and only if $X$ is geometrically derivable. The latter opens the door to design optimization algorithms for constrained optimization problems that suffer from Clarke irregularity in their objectives and constraint functions.


title: Arithmetic functions and fixed points of powers of permutations

abstract: Let $\sigma$ be a permutation of a nonempty finite or countably infinite set $X$ and let $F_X\left( \sigma^k\right)$ count the number of fixed points of the $k$th power of $\sigma$. This paper explains how the arithmetic function $k \mapsto \left(F_X\left( \sigma^k\right) \right)_{k=1}^{\infty}$ determines the conjugacy class of the permutation $\sigma$, constructs an algorithm to compute the conjugacy class from the fixed point counting function $F_X\left( \sigma^k\right)$, and describes the arithmetic functions that are fixed point counting functions of permutations.


title: Rigidity for higher rank lattice actions on dendrites

abstract: We study the rigidity in the sense of Zimmer for higher rank lattice actions on dendrites and show that: (1) if $\Gamma$ is a higher rank lattice and $X$ is a nondegenerate dendrite with no infinite order points, then any action of $\Gamma$ on $X$ cannot be almost free; (2) if $\Gamma$ is further a finite index subgroup of $SL_n(\mathbb Z)$ with $n\geq 3$, then every action of $\Gamma$ on $X$ has a nontrivial almost finite subsystem. During the proof, we get a new characterization of the left-orderability of a finitely generated group through its actions on dendrites.


title: Engineering transistor-like optical gain in two-dimensional materials with Berry curvature dipoles

abstract: Semiconductor transistors are essential elements of electronic circuits as they enable, for example, the isolation or amplification of voltage signals. While conventional transistors are point-type (lumped-element) devices, it may be highly interesting to realize a distributed transistor-type optical response in a bulk material. Here, we show that low-symmetry two-dimensional metallic systems may be the ideal solution to implement such a distributed-transistor response. To this end, using the semiclassical Boltzmann equation approach, we characterize the optical conductivity of a two-dimensional material under a static electric bias. It is found that similar to the nonlinear Hall effect, the electron transport depends on the Berry curvature dipole. Our analysis reveals that the electro-optic effect modifies the optical conductivity of the material, breaking the electromagnetic reciprocity and yielding a dynamical response that imitates that of a transistor but in a distributed volume. Furthermore, the effective conductivity tensor can be non-Hermitian, opening the possibility of optical gain. To maximize the non-Hermitian response, we explore the specific case of strained twisted bilayer graphene. Our analysis reveals that the optical gain for incident light transmitted through the biased system depends on the light polarization, and can be quite large, especially for multilayer configurations.


title: Trace Diagnostics for Signal-based Temporal Properties

abstract: Most of the trace-checking tools only yield a Boolean verdict. However, when a property is violated by a trace, engineers usually inspect the trace to understand the cause of the violation; such manual diagnostic is time-consuming and error-prone. Existing approaches that complement trace-checking tools with diagnostic capabilities either produce low-level explanations that are hardly comprehensible by engineers or do not support complex signal-based temporal properties. In this paper, we propose TD-SB-TemPsy, a trace-diagnostic approach for properties expressed using SB-TemPsy-DSL. Given a property and a trace that violates the property, TD-SB-TemPsy determines the root cause of the property violation. TD-SB-TemPsy relies on the concepts of violation cause, which characterizes one of the behaviors of the system that may lead to a property violation, and diagnoses, which are associated with violation causes and provide additional information to help engineers understand the violation cause. As part of TD-SB-TemPsy, we propose a language-agnostic methodology to define violation causes and diagnoses. In our context, its application resulted in a catalog of 34 violation causes, each associated with one diagnosis, tailored to properties expressed in SB-TemPsy-DSL. We assessed the applicability of TD-SB-TemPsy on two datasets, including one based on a complex industrial case study.The results show that TD-SB-TemPsy could finish within a timeout of 1 min for ~83.66% of the trace-property combinations in the industrial dataset, yielding a diagnosis in ~99.84% of these cases. Moreover, it also yielded a diagnosis for all the trace-property combinations in the other dataset. These results suggest that our tool is applicable and efficient in most cases.


title: Population synthesis of AX J1745.6-2901 X-ray nova type binaries with rapidly decreasing orbital periods

abstract: The neutron star low mass X-ray binary (LMXB) AX J1745.6-2901 was detected an anomalously fast decrease of orbital period. The decreasing rate of orbital period exceeds the contribution of all processes extracting angular momentum from the binary star in standard model. Using SCENARIO MACHINE code we conducted a population synthesis study of X-ray novae with neutron stars to investigate a possible formation and evolution of such binaries. Such close LMXBs should experience a preceding common envelope stage, in which the magnetic fields of the low mass main-sequence donor stars can be dramatically amplified. Our calculations show that the magnetic stellar wind of the optical companion can efficiently extract angular momentum from the binary systems, and produce the observed orbital-period derivatives of AX J1745.6-2901 and black hole LMXBs. The estimated values of the required magnetic field induction are following: $B_\textrm{d}\approx 400$ G (AX~J1745.6-2901), $B_\textrm{d}\approx 1500$ G (KV UMa), $B_\textrm{d}\approx 400$ G (A0620-00), $B_\textrm{d}\approx 1800$ G (Nova Muscae). We successfully reproduced the current observational abundance of such anomalous neutron star X-ray novae, and computed the appropriate value of the parameter of magnetic braking $\lambda_\textrm{MSW}$ ($0.8-0.6$ for Roche lobe filling stars and $0.4-0.15$ for binaries with partial Roche lobe filling).


title: States localized on a boundary of the time-dependent parity-breaking medium

abstract: We consider the massive vector field propagating in the inhomogeneous parity-breaking medium, such as the dense hot hadronic matter with chiral imbalance. The transition between the regions with approximately constant values of the parity-breaking parameter allows for the states localized on such boundary to occur. The adiabatic change of the background introduces either decay or the amplification of the localized states. We also discuss the non-adiabatic destruction of these bound states.


title: Coherent spin dynamics of rare-earth doped crystals in the high-cooperativity regime

abstract: Rare-earth doped crystals have long coherence times and the potential to provide quantum interfaces between microwave and optical photons. Such applications benefit from a high cooperativity between the spin ensemble and a microwave cavity -- this motivates an increase in the rare earth ion concentration which in turn impacts the spin coherence lifetime. We measure spin dynamics of two rare-earth spin species, $^{145}$Nd and Yb doped into Y$_{2}$SiO$_{5}$, coupled to a planar microwave resonator in the high cooperativity regime, in the temperature range 1.2 K to 14 mK. We identify relevant decoherence mechanisms including instantaneous diffusion arising from resonant spins and temperature-dependent spectral diffusion from impurity electron and nuclear spins in the environment. We explore two methods to mitigate the effects of spectral diffusion in the Yb system in the low-temperature limit, first, using magnetic fields of up to 1 T to suppress impurity spin dynamics and, second, using transitions with low effective g-factors to reduce sensitivity to such dynamics. Finally, we demonstrate how the `clock transition' present in the $^{171}$Yb system at zero field can be used to increase coherence times up to $T_{2} = 6(1)$ ms.


title: CO^3: Cooperative Unsupervised 3D Representation Learning for Autonomous Driving

abstract: Unsupervised contrastive learning for indoor-scene point clouds has achieved great successes. However, unsupervised learning point clouds in outdoor scenes remains challenging because previous methods need to reconstruct the whole scene and capture partial views for the contrastive objective. This is infeasible in outdoor scenes with moving objects, obstacles, and sensors. In this paper, we propose CO^3, namely Cooperative Contrastive Learning and Contextual Shape Prediction, to learn 3D representation for outdoor-scene point clouds in an unsupervised manner. CO^3 has several merits compared to existing methods. (1) It utilizes LiDAR point clouds from vehicle-side and infrastructure-side to build views that differ enough but meanwhile maintain common semantic information for contrastive learning, which are more appropriate than views built by previous methods. (2) Alongside the contrastive objective, shape context prediction is proposed as pre-training goal and brings more task-relevant information for unsupervised 3D point cloud representation learning, which are beneficial when transferring the learned representation to downstream detection tasks. (3) As compared to previous methods, representation learned by CO^3 is able to be transferred to different outdoor scene dataset collected by different type of LiDAR sensors. (4) CO^3 improves current state-of-the-art methods on both Once and KITTI datasets by up to 2.58 mAP. Codes and models will be released. We believe CO^3 will facilitate understanding LiDAR point clouds in outdoor scene.


title: Accelerating Score-based Generative Models for High-Resolution Image Synthesis

abstract: Score-based generative models (SGMs) have recently emerged as a promising class of generative models. The key idea is to produce high-quality images by recurrently adding Gaussian noises and gradients to a Gaussian sample until converging to the target distribution, a.k.a. the diffusion sampling. To ensure stability of convergence in sampling and generation quality, however, this sequential sampling process has to take a small step size and many sampling iterations (e.g., 2000). Several acceleration methods have been proposed with focus on low-resolution generation. In this work, we consider the acceleration of high-resolution generation with SGMs, a more challenging yet more important problem. We prove theoretically that this slow convergence drawback is primarily due to the ignorance of the target distribution. Further, we introduce a novel Target Distribution Aware Sampling (TDAS) method by leveraging the structural priors in space and frequency domains. Extensive experiments on CIFAR-10, CelebA, LSUN, and FFHQ datasets validate that TDAS can consistently accelerate state-of-the-art SGMs, particularly on more challenging high resolution (1024x1024) image generation tasks by up to 18.4x, whilst largely maintaining the synthesis quality. With fewer sampling iterations, TDAS can still generate good quality images. In contrast, the existing methods degrade drastically or even fails completely