title: PMNet: Robust Pathloss Map Prediction via Supervised Learning

abstract: Pathloss prediction is an essential component of wireless network planning. While ray tracing based methods have been successfully used for many years, they require significant computational effort that may become prohibitive with the increased network densification and/or use of higher frequencies in 5G/B5G (beyond 5G) systems. In this paper, we propose and evaluate a data-driven and model-free pathloss prediction method, dubbed PMNet. This method uses a supervised learning approach: training a neural network (NN) with a limited amount of ray tracing (or channel measurement) data and map data and then predicting the pathloss over location with no ray tracing data with a high level of accuracy. Our proposed pathloss map prediction-oriented NN architecture, which is empowered by state-of-the-art computer vision techniques, outperforms other architectures that have been previously proposed (e.g., UNet, RadioUNet) in terms of accuracy while showing generalization capability. Moreover, PMNet trained on a 4-fold smaller dataset surpasses the other baselines (trained on a 4-fold larger dataset), corroborating the potential of PMNet.


title: Where is my Wallet? Modeling Object Proposal Sets for Egocentric Visual Query Localization

abstract: This paper deals with the problem of localizing objects in image and video datasets from visual exemplars. In particular, we focus on the challenging problem of egocentric visual query localization. We first identify grave implicit biases in current query-conditioned model design and visual query datasets. Then, we directly tackle such biases at both frame and object set levels. Concretely, our method solves these issues by expanding limited annotations and dynamically dropping object proposals during training. Additionally, we propose a novel transformer-based module that allows for object-proposal set context to be considered while incorporating query information. We name our module Conditioned Contextual Transformer or CocoFormer. Our experiments show the proposed adaptations improve egocentric query detection, leading to a better visual query localization system in both 2D and 3D configurations. Thus, we are able to improve frame-level detection performance from 26.28% to 31.26 in AP, which correspondingly improves the VQ2D and VQ3D localization scores by significant margins. Our improved context-aware query object detector ranked first and second in the VQ2D and VQ3D tasks in the 2nd Ego4D challenge. In addition to this, we showcase the relevance of our proposed model in the Few-Shot Detection (FSD) task, where we also achieve SOTA results. Our code is available at https://github.com/facebookresearch/vq2d_cvpr.


title: Fock-space Schrieffer--Wolff transformation: classically-assisted rank-reduced quantum phase estimation algorithm

abstract: We present an extension of many-body downfolding methods to reduce the resources required in the quantum phase estimation (QPE) algorithm. In this paper, we focus on the Schrieffer--Wolff (SW) transformation of the electronic Hamiltonians for molecular systems that provides significant simplifications of quantum circuits for simulations of quantum dynamics. We demonstrate that by employing Fock-space variants of the SW transformation (or rank-reducing similarity transformations (RRST)) one can significantly increase the locality of the qubit-mapped similarity transformed Hamiltonians. The practical utilization of the SW-RRST formalism is associated with a series of approximations discussed in the manuscript. In particular, amplitudes that define RRST can be evaluated using conventional computers and then encoded on quantum computers. The SW-RRST QPE quantum algorithms can also be viewed as an extension of the standard state-specific coupled-cluster downfolding methods to provide a robust alternative to the traditional QPE algorithms to identify the ground and excited states for systems with various numbers of electrons using the same Fock-space representations of the downfolded Hamiltonian.The RRST formalism serves as a design principle for developing new classes of approximate schemes that reduce the complexity of quantum circuits.


title: Provable Defense against Backdoor Policies in Reinforcement Learning

abstract: We propose a provable defense mechanism against backdoor policies in reinforcement learning under subspace trigger assumption. A backdoor policy is a security threat where an adversary publishes a seemingly well-behaved policy which in fact allows hidden triggers. During deployment, the adversary can modify observed states in a particular way to trigger unexpected actions and harm the agent. We assume the agent does not have the resources to re-train a good policy. Instead, our defense mechanism sanitizes the backdoor policy by projecting observed states to a 'safe subspace', estimated from a small number of interactions with a clean (non-triggered) environment. Our sanitized policy achieves $\epsilon$ approximate optimality in the presence of triggers, provided the number of clean interactions is $O\left(\frac{D}{(1-\gamma)^4 \epsilon^2}\right)$ where $\gamma$ is the discounting factor and $D$ is the dimension of state space. Empirically, we show that our sanitization defense performs well on two Atari game environments.


title: Trigonometric splines of several variables

abstract: Under consideration methods of constructing trigonometric interpolation splines of two variables on rectangular areas. These methods are easily generalized to the case of trigonometric interpolation splines of several variables on such domains. A numerical example illustrating the main theoretical propositions is considered. The given methods of constructing such splines can be widely used in practice.


title: Semantic Encoder Guided Generative Adversarial Face Ultra-Resolution Network

abstract: Face super-resolution is a domain-specific image super-resolution, which aims to generate High-Resolution (HR) face images from their Low-Resolution (LR) counterparts. In this paper, we propose a novel face super-resolution method, namely Semantic Encoder guided Generative Adversarial Face Ultra-Resolution Network (SEGA-FURN) to ultra-resolve an unaligned tiny LR face image to its HR counterpart with multiple ultra-upscaling factors (e.g., 4x and 8x). The proposed network is composed of a novel semantic encoder that has the ability to capture the embedded semantics to guide adversarial learning and a novel generator that uses a hierarchical architecture named Residual in Internal Dense Block (RIDB). Moreover, we propose a joint discriminator which discriminates both image data and embedded semantics. The joint discriminator learns the joint probability distribution of the image space and latent space. We also use a Relativistic average Least Squares loss (RaLS) as the adversarial loss to alleviate the gradient vanishing problem and enhance the stability of the training procedure. Extensive experiments on large face datasets have proved that the proposed method can achieve superior super-resolution results and significantly outperform other state-of-the-art methods in both qualitative and quantitative comparisons.


title: By how much can closed-loop frameworks accelerate computational materials discovery?

abstract: The implementation of automation and machine learning surrogatization within closed-loop computational workflows is an increasingly popular approach to accelerate materials discovery. However, the scale of the speedup associated with this paradigm shift from traditional manual approaches remains an open question. In this work, we rigorously quantify the acceleration from each of the components within a closed-loop framework for material hypothesis evaluation by identifying four distinct sources of speedup: (1) task automation, (2) calculation runtime improvements, (3) sequential learning-driven design space search, and (4) surrogatization of expensive simulations with machine learning models. This is done using a time-keeping ledger to record runs of automated software and corresponding manual computational experiments within the context of electrocatalysis. From a combination of the first three sources of acceleration, we estimate that overall hypothesis evaluation time can be reduced by over 90%, i.e., achieving a speedup of $\sim$$10\times$. Further, by introducing surrogatization into the loop, we estimate that the design time can be reduced by over 95%, i.e., achieving a speedup of $\sim$$15$-$20\times$. Our findings present a clear value proposition for utilizing closed-loop approaches for accelerating materials discovery.


title: Ultra-wideband optical coherence elastography from acoustic to ultrasonic frequencies

abstract: Visualizing elastic waves by noninvasive imaging has been useful for analyzing the mechanical properties of materials and tissues. However, the maximum wave frequency of elastography has been limited to ~10 kHz due to the finite sensitivity to small vibration and finite imaging speed. Here, we present an optical coherence elastography technique that extends the frequency range to MHz by noise reduction, anti-aliasing demodulation, and advanced wave analysis. Our system can measure the stiffness of hard (GPa) materials including bones with mm-scale resolution and characterize soft, viscoelastic materials from 100 Hz to 1 MHz. The dispersion of Rayleigh surface waves over the wide frequency range allowed us to profile depth-dependent shear modulus (10 kPa to 100 MPa) in cartilages ex vivo and the human skin in vivo. This technique opened a new window for the characterization of materials in situ with 3-dimensional resolution.


title: Velocity-Coherent Substructure in TMC-1: Inflow and Fragmentation

abstract: Filamentary structures have been found nearly ubiquitously in molecular clouds and yet their formation and evolution is still poorly understood. We examine a segment of Taurus Molecular Cloud 1 (TMC-1) that appears as a single, narrow filament in continuum emission from dust. We use the Regularized Optimization for Hyper-Spectral Analysis (ROHSA), a Gaussian decomposition algorithm which enforces spatial coherence when fitting multiple velocity components simultaneously over a data cube. We analyze HC$_5$N (9-8) line emission as part of the Green Bank Ammonia Survey (GAS) and identify three velocity-coherent components with ROHSA. The two brightest components extend the length of the filament, while the third component is fainter and clumpier. The brightest component has a prominent transverse velocity gradient of $2.7 \pm 0.1$ km s$^{-1}$ pc$^{-1}$ that we show to be indicative of gravitationally induced inflow. In the second component, we identify regularly spaced emission peaks along its length. We show that the local minima between pairs of adjacent HC$_5$N peaks line up closely with submillimetre continuum emission peaks, which we argue is evidence for fragmentation along the spine of TMC-1. While coherent velocity components have been described as separate physical structures in other star-forming filaments, we argue that the two bright components identified in HC$_5$N emission in TMC-1 are tracing two layers in one filament: a lower density outer layer whose material is flowing under gravity towards the higher density inner layer of the filament.


title: Global simulations of Tayler instability in stellar interiors: a long-time multi-stage evolution of the magnetic field

abstract: Magnetic fields have been observed in massive Ap/Bp stars and presumably are also present in the radiative zone of solar-like stars. Yet, to date there is no clear understanding of the dynamics of the magnetic field in stably stratified layers. A purely toroidal magnetic field configuration is known to be unstable, developing mainly non-axisymmetric modes. Rotation and a small poloidal field component may lead to a stable configuration. Here we perform global MHD simulations with the EULAG-MHD code to explore the evolution of a toroidal magnetic field located in a layer whose stratification resembles the solar tachocline. Our numerical experiments allow us to explore the initial unstable phase as well as the long-term evolution of the magnetic field. During the first Alfven cycles, we observe the development of the Tayler instability with the prominent longitudinal wavenumber, $m=1$. Rotation decreases the growth rate of the instability, and eventually suppresses it. However, after a stable phase, sudden energy surges lead to the development of higher order modes even for fast rotation. These modes extract energy from the initial toroidal field. Nevertheless, our results show that sufficiently fast rotation leads to a lower saturation energy of the unstable modes, resulting in a magnetic topology with only a small fraction of poloidal field which remains steady for several hundreds of Alfven travel times. At this stage, the system becomes turbulent and the field is prone to turbulent diffusion. The final toroidal-poloidal configuration of the magnetic field may represent an important aspect of the field generation and evolution in stably-stratified layers.


title: Energy decay estimates for an axially travelling string damped at one end

abstract: We study the small vibrations of an axially travelling string with a dashpoint damping at one end. The string is modelled by a wave equation in a time-dependent interval with two endpoints moving at a constant speed $v$. For the undamped case, we obtain a conserved functional equivalent to the energy of the solution. We derive precise upper and lower estimates for the exponential decay of the energy with explicit constants. These estimates do not seem to be reported in the literature even for the non-travelling case $v=0$.


title: Rome Precision Solar Photometric Telescope: precision solar full-disk photometry during solar cycles 23-25

abstract: The Rome Precision Solar Photometric Telescope (Rome/PSPT) is a ground-based telescope engaged in precision solar photometry. It has a 27-year database of full-disk images of the photosphere and chromosphere beginning in 1996 and continuing to 2022. The solar images have been obtained daily, weather permitting, with approximately 2 arcsec/pixel scale in Ca II K line at 393.3 nm, G-band at 430.6 nm, and continuum in the blue and red parts of the spectrum at 409.4 nm and 607.2 nm, respectively. Regular observations were also performed at the green continuum at 535.7 nm for a period of about 18 months. Since the first-light, Rome/PSPT operations have been directed at understanding the source of short-and long-term solar irradiance changes, spanning from one minute to several months, and from one year to a few solar cycles, respectively. However, Rome/PSPT data have also served to study a variety of other topics, including the photometric properties of solar disk features and of the supergranulation manifested by the chromospheric network. Moreover, they have been unique in allowing to connect series of historical and modern full-disk solar observations, especially the Ca II K line data. Here, we provide an overview of the Rome/PSPT telescope and of the solar monitoring carried out with it from its first light to the present, across solar cycles 23-25. We also briefly describe the main results achieved with Rome/PSPT data, and give an overview of new results being derived with the whole time series of observations covering the period 1996-2022.


title: Impact of visual assistance for automated audio captioning

abstract: We study the impact of visual assistance for automated audio captioning. Utilizing multi-encoder transformer architectures, which have previously been employed to introduce vision-related information in the context of sound event detection, we analyze the usefulness of incorporating a variety of pretrained features. We perform experiments on a YouTube-based audiovisual data set and investigate the effect of applying the considered transfer learning technique in terms of a variety of captioning metrics. We find that only one of the considered kinds of pretrained features provides consistent improvements, while the others do not provide any noteworthy gains at all. Interestingly, the outcomes of prior research efforts indicate that the exact opposite is true in the case of sound event detection, leading us to conclude that the optimal choice of visual embeddings is strongly dependent on the task at hand. More specifically, visual features focusing on semantics appear appropriate in the context of automated audio captioning, while for sound event detection, time information seems to be more important.


title: Waiting Nets: State Classes and Taxonomy

abstract: In time Petri nets (TPNs), time and control are tightly connected: time measurement for a transition starts only when all resources needed to fire it are available. Further, upper bounds on duration of enabledness can force transitions to fire (this is called urgency). For many systems, one wants to decouple control and time, i.e. start measuring time as soon as a part of the preset of a transition is filled, and fire it after some delay \underline{and} when all needed resources are available. This paper considers an extension of TPN called waiting nets that dissociates time measurement and control. Their semantics allows time measurement to start with incomplete presets, and can ignore urgency when upper bounds of intervals are reached but all resources needed to fire are not yet available. Firing of a transition is then allowed as soon as missing resources are available. It is known that extending bounded TPNs with stopwatches leads to undecidability. Our extension is weaker, and we show how to compute a finite state class graph for bounded waiting nets, yielding decidability of reachability and coverability. We then compare expressiveness of waiting nets with that of other models w.r.t. timed language equivalence, and show that they are strictly more expressive than TPNs.


title: Phase transition and higher order analysis of $L_q$ regularization under dependence

abstract: We study the problem of estimating a $k$-sparse signal ${\mbox{$\beta$}}_0\in{\bf R}^p$ from a set of noisy observations ${\bf y}\in{\bf R}^n$ under the model ${\bf y}={\bf X}{\mbox{$\beta$}}+{\bf w}$, where ${\bf X}\in{\bf R}^{n\times p}$ is the measurement matrix the row of which is drawn from distribution $N(0,{\mbox{$\Sigma$}})$. We consider the class of $L_q$-regularized least squares (LQLS) given by the formulation $\hat{\mbox{$\beta$}}(\lambda,q)=\text{argmin}_{{\mbox{$\beta$}}\in{\bf R}^p}\frac{1}{2}\|{\bf y}-{\bf X}{\mbox{$\beta$}}\|^2_2+\lambda\|{\mbox{$\beta$}}\|_q^q$, where $\|\cdot\|_q$ $(0\le q\le 2)$ denotes the $L_q$-norm. In the setting $p,n,k\rightarrow\infty$ with fixed $k/p=\epsilon$ and $n/p=\delta$, we derive the asymptotic risk of $\hat{\mbox{$\beta$}}(\lambda,q)$ for arbitrary covariance matrix ${\mbox{$\Sigma$}}$ which generalizes the existing results for standard Gaussian design, i.e. $X_{ij}\overset{i.i.d}{\sim}N(0,1)$. We perform a higher-order analysis for LQLS in the small-error regime in which the first dominant term can be used to determine the phase transition behavior of LQLS. Our results show that the first dominant term does not depend on the covariance structure of ${\mbox{$\Sigma$}}$ in the cases $0\le q< 1$ and $1< q\le 2$ which indicates that the correlations among predictors only affect the phase transition curve in the case $q=1$ a.k.a. LASSO. To study the influence of the covariance structure of ${\mbox{$\Sigma$}}$ on the performance of LQLS in the cases $0\le q< 1$ and $1<q\le 2$, we derive the explicit formulas for the second dominant term in the expansion of the asymptotic risk in terms of small error. Extensive computational experiments confirm that our analytical predictions are consistent with numerical results.


title: Hodge-Decomposition of Brain Networks

abstract: We analyze brain networks by decomposing them into three orthogonal components: gradient, curl, and harmonic flows, through the Hodge decomposition, a technique advantageous for capturing complex topological features. A Wasserstein distance based topological inference is developed to determine the statistical significance of each component. The Hodge decomposition is applied to human brain networks obtained from a resting-state fMRI study. Our results indicate statistically significant differences in the topological features between male and female brain networks.


title: Mean-field ground-state phase diagram of the ${t-t^\prime}$ ionic-Hubbard chain

abstract: Ground state (GS) phase diagram of the one dimensional repulsive Hubbard model with both nearest neighbor ($t$) and next-nearest-neighbor ($t^{\prime}$) hopping and a staggered potential ($\Delta$) is determined in the case of half-filled band and zero net magnetization within the mean-field theory. The model may be realized by cold atoms in engineered optical lattices. Connection between the peculiarities of the GS phase diagram of the interacting system and the topological Lifshitz transition in GS of free particle chain is discussed. The mean-field Hamiltonian is given by six order parameters, which are determined self-consistently. It is shown that the GS phase diagram {\em predominantly} consists of insulating phases characterized by coexistence of the long-range ordered modulations of the charge- (I) and antiferromagnetic (AF) spin-density with wavelengths equal to two and/or four lattice units. Below the Lifshitz transition, the GS phase diagram is qualitatively similar to that of the standard (${t^{\prime}=0}$) ionic Hubbard model. After the Lifshitz transition, charge- and spin-density modulations emerge within the sublattices and have wavelengths equal to four lattice units. For moderate values of the on-site repulsion the insulating phases are characterized by the presence of I and AF modulations coexisting with ferrimagnetic spin- and charge-density modulations within the one sublattice, or by the coexistence of I order and additional AF spin density modulation only within the sublattice with high ionic potential. At large repulsion the insulating phase with AF order inside both sublattices and remaining small ionicity left between the sublattices is realized.


title: The luminous type Ia supernova 2022ilv and its early excess emission

abstract: We present observations and analysis of the host-less and luminous type Ia supernova 2022ilv, illustrating it is part of the 2003fg-like family, often referred to as super-Chandrasekhar (Ia-SC) explosions. The ATLAS light curve shows evidence of a short-lived, pulse-like early excess, similar to that detected in another luminous type Ia supernova (SN 2020hvf). The light curve is broad and the early spectra are remarkably similar to SN 2009dc. Adopting a redshift of $z=0.026 \pm 0.005$ for SN 2022ilv based on spectral matching, our model light curve requires a large $^{56}$Ni mass in the range $0.7-1.5$ M$_{\odot}$, and a large ejecta mass in the range $1.6-2.3$ M$_{\odot}$. The early excess can be explained by fast-moving SN ejecta interacting with a thin, dense shell of circumstellar material close to the progenitor ($\sim 10^{13}$ cm), a few hours after the explosion. This may be realised in a double-degenerate scenario, wherein a white dwarf merger is preceded by ejection of a small amount ($\sim 10^{-3}-10^{-2}$ M$_{\odot}$) of hydrogen and helium-poor tidally stripped material. A deep pre-explosion Pan-STARRS1 stack indicates no host galaxy to a limiting magnitude of $r \sim 24.5$. This implies a surprisingly faint limit for any host of $M_r \gtrsim -11$, providing further evidence that these types of explosion occur predominantly in low-metallicity environments.


title: Projection algorithm for state preparation on quantum computers

abstract: We present an efficient method to prepare states of a many-body system on quantum hardware, first isolating individual quantum numbers and then using time evolution to isolate the energy. Our method in its simplest form requires only one additional auxiliary qubit. The total time evolved for an accurate solution is proportional to the ratio of the spectrum range of the trial state to the gap to the lowest excited state, and the accuracy increases exponentially with the time evolved. Isolating the quantum numbers is efficient because of the known eigenvalues, and increases the gap thus shortening the propagation time required. The success rate of the algorithm, or the probability of producing the desired state, is a simple function of measurement times and phases and is dominated by the square overlap of the original state to the desired state. We present examples from the nuclear shell model and the Heisenberg model. We compare this algorithm to previous algorithms for short evolution times and discuss potential further improvements.


title: Evaluating COVID-19 Sequence Data Using Nearest-Neighbors Based Network Model

abstract: The SARS-CoV-2 coronavirus is the cause of the COVID-19 disease in humans. Like many coronaviruses, it can adapt to different hosts and evolve into different lineages. It is well-known that the major SARS-CoV-2 lineages are characterized by mutations that happen predominantly in the spike protein. Understanding the spike protein structure and how it can be perturbed is vital for understanding and determining if a lineage is of concern. These are crucial to identifying and controlling current outbreaks and preventing future pandemics. Machine learning (ML) methods are a viable solution to this effort, given the volume of available sequencing data, much of which is unaligned or even unassembled. However, such ML methods require fixed-length numerical feature vectors in Euclidean space to be applicable. Similarly, euclidean space is not considered the best choice when working with the classification and clustering tasks for biological sequences. For this purpose, we design a method that converts the protein (spike) sequences into the sequence similarity network (SSN). We can then use SSN as an input for the classical algorithms from the graph mining domain for the typical tasks such as classification and clustering to understand the data. We show that the proposed alignment-free method is able to outperform the current SOTA method in terms of clustering results. Similarly, we are able to achieve higher classification accuracy using well-known Node2Vec-based embedding compared to other baseline embedding approaches.


title: Leaf clustering using circular densities

abstract: In the biology field of botany, leaf shape recognition is an important task. One way of characterising the leaf shape is through the centroid contour distances (CCD). Each CCD path might have different resolution, so normalisation is done by considering that they are circular densities. Densities are rotated by subtracting the mean preferred direction. Distance measures between densities are used to produce a hierarchical clustering method to classify the leaves. We illustrate our approach with a real dataset.


title: {\tt ee$\in$MC}: Arbitrary Initial Spin States for the Production of $\bf e^{+}e^{-} \to \tau^{+}\tau^{-} (\gamma) $ Events and the Impact on Spin Correlations

abstract: We present a modified spin algorithm, including spin correlations, which has been implemented in {\tt ee$\in$MC} for the simulation of $e^{+}e^{-} \to \tau^{+}\tau^{-} (\gamma)$ events with an arbitrary initial spin configuration. This algorithm is suitable for the proposed BELLE-II polarization upgrade to SuperKEKB, both for the ideal case and for the case where there are misalignments, radiative effects and allows for changing polarization conditions. The spin $1/2$ states of the polarized beams are constructed in terms of a super-positioning of the helicity states corresponding to the polarimetric-vector describing the overall beam polarization and implemented both through a modification of the initial state in the modified Altrelli-Parsis Density Function as well as a change of basis of the helicity states.


title: Local Contrastive Feature learning for Tabular Data

abstract: Contrastive self-supervised learning has been successfully used in many domains, such as images, texts, graphs, etc., to learn features without requiring label information. In this paper, we propose a new local contrastive feature learning (LoCL) framework, and our theme is to learn local patterns/features from tabular data. In order to create a niche for local learning, we use feature correlations to create a maximum-spanning tree, and break the tree into feature subsets, with strongly correlated features being assigned next to each other. Convolutional learning of the features is used to learn latent feature space, regulated by contrastive and reconstruction losses. Experiments on public tabular datasets show the effectiveness of the proposed method versus state-of-the-art baseline methods.


title: Debiasing Meta-Gradient Reinforcement Learning by Learning the Outer Value Function

abstract: Meta-gradient Reinforcement Learning (RL) allows agents to self-tune their hyper-parameters in an online fashion during training. In this paper, we identify a bias in the meta-gradient of current meta-gradient RL approaches. This bias comes from using the critic that is trained using the meta-learned discount factor for the advantage estimation in the outer objective which requires a different discount factor. Because the meta-learned discount factor is typically lower than the one used in the outer objective, the resulting bias can cause the meta-gradient to favor myopic policies. We propose a simple solution to this issue: we eliminate this bias by using an alternative, \emph{outer} value function in the estimation of the outer loss. To obtain this outer value function we add a second head to the critic network and train it alongside the classic critic, using the outer loss discount factor. On an illustrative toy problem, we show that the bias can cause catastrophic failure of current meta-gradient RL approaches, and show that our proposed solution fixes it. We then apply our method to a more complex environment and demonstrate that fixing the meta-gradient bias can significantly improve performance.


title: A Practical Stereo Depth System for Smart Glasses

abstract: We present the design of a productionized end-to-end stereo depth sensing system that does pre-processing, online stereo rectification, and stereo depth estimation with a fallback to monocular depth estimation when rectification is unreliable. The output of our depth sensing system is then used in a novel view generation pipeline to create 3D computational photography effects using point-of-view images captured by smart glasses. All these steps are executed on-device on the stringent compute budget of a mobile phone, and because we expect the users can use a wide range of smartphones, our design needs to be general and cannot be dependent on a particular hardware or ML accelerator such as a smartphone GPU. Although each of these steps is well studied, a description of a practical system is still lacking. For such a system, all these steps need to work in tandem with one another and fallback gracefully on failures within the system or less than ideal input data. We show how we handle unforeseen changes to calibration, e.g., due to heat, robustly support depth estimation in the wild, and still abide by the memory and latency constraints required for a smooth user experience. We show that our trained models are fast, and run in less than 1s on a six-year-old Samsung Galaxy S8 phone's CPU. Our models generalize well to unseen data and achieve good results on Middlebury and in-the-wild images captured from the smart glasses.


title: High and dry: billion-year trends in the aridity of river-forming climates on Mars

abstract: Mars' wet-to-dry transition is a major environmental catastrophe, yet the spatial pattern, tempo, and cause of drying are poorly constrained. We built a globally-distributed database of constraints on Mars late-stage paleolake size relative to catchment area (aridity index), and found evidence for climate zonation as Mars was drying out. Aridity increased over time in southern midlatitude highlands, where lakes became proportionally as small as in modern Nevada. Meanwhile, intermittently wetter climates persisted in equatorial and northern-midlatitude lowlands. This is consistent with a change in Mars' greenhouse effect that left highlands too cold for liquid water except during a brief melt season, or alternatively with a fall in Mars' groundwater table. The data are consistent with a switch of unknown cause in the dependence of aridity index on elevation, from high-and-wet early on, to high-and-dry later. These results sharpen our view of Mars' climate as surface conditions became increasingly stressing for life.


title: Branching Fractions of $B$ Meson Decays in Mesogenesis

abstract: Production of the matter-antimatter asymmetry in the $B$-Mesogenesis mechanism is directly related to the branching fraction of seemingly baryon number violating decays of $B$ mesons into a light Standard Model baryon and missing energy. Achieving the observed baryon asymmetry requires that the branching fraction for such decays be greater than about $10^{-7}-10^{-5}$. Experimental searches at $B$ Factories and Hadron Colliders target specific decay modes. Therefore, computing the exclusive branching fraction for each decay is a critical step towards testing Mesogenesis. In this work we use QCD Light Cone Sum Rules to compute the form factors and branching fractions of the various possible channels contributing to the baryon asymmetry. Using the results, we comment on implications for current and future experimental searches.


title: On Schr\"odinger equations involving the regional fractional Laplacian in a ball with the zero boundary condition

abstract: Our purpose in this article to show the existence of positive classical solutions of $$ ( - \Delta )_{B_1}^s u +u=h_1 u^p+\epsilon h_2 \quad {\rm in} \ \, B_1,\qquad u = 0 \quad {\rm on}\ \partial B_1 $$ for $\epsilon>0$ small enough, where $( - \Delta )_{B_1}^s$ is the regional fractional Laplacian, $p>1$, $h_i$ with $i=1,2$ are H\"older continuous and satisfy some additional conditions. Our existence is based on the solution of $$ ( - \Delta )_{B_1}^s u +u=1 \quad {\rm in} \ \, B_1,\qquad u = 0 \quad {\rm on}\ \partial B_1. $$


title: Noise-Resilient Quantum Power Flow

abstract: Quantum power flow (QPF) provides inspiring directions for tackling power flow's computational burdens leveraging quantum computing. However, existing QPF methods are mainly based on noise-sensitive quantum algorithms, whose practical utilization is significantly hindered by the limited capability of today's noisy-intermediate-scale quantum (NISQ) devices. This paper devises a NISQ-QPF algorithm, which enables power flow calculation on noisy quantum computers. The main contributions include: (1) a variational quantum circuit (VQC)-based AC power flow formulation, which enables QPF using short-depth quantum circuits; (2) noise-resilient QPF solvers based on the variational quantum linear solver (VQLS) and modified fast decoupled power flow; (3) a practical NISQ-QPF framework for implementable and reliable power flow analysis on noisy quantum machines. Promising case studies validate the effectiveness and accuracy of NISQ-QPF on IBM's real, noisy quantum devices.


title: A Distanced Matching Game, Decremental APSP in Expanders, and Faster Deterministic Algorithms for Graph Cut Problems

abstract: Expander graphs play a central role in graph theory and algorithms. With a number of powerful algorithmic tools developed around them, such as the Cut-Matching game, expander pruning, expander decomposition, and algorithms for decremental All-Pairs Shortest Paths (APSP) in expanders, to name just a few, the use of expanders in the design of graph algorithms has become ubiquitous. Specific applications of interest to us are fast deterministic algorithms for cut problems in static graphs, and algorithms for dynamic distance-based graph problems, such as APSP. Unfortunately, the use of expanders in these settings incurs a number of drawbacks. For example, the best currently known algorithm for decremental APSP in constant-degree expanders can only achieve a $(\log n)^{O(1/\epsilon^2)}$-approximation with $n^{1+O(\epsilon)}$ total update time for any $\epsilon$. All currently known algorithms for the Cut Player in the Cut-Matching game are either randomized, or provide rather weak guarantees. This, in turn, leads to somewhat weak algorithmic guarantees for several central cut problems: for example, the best current almost linear time deterministic algorithm for Sparsest Cut can only achieve approximation factor $(\log n)^{\omega(1)}$. Lastly, when relying on expanders in distance-based problems, such as dynamic APSP, via current methods, it seems inevitable that one has to settle for approximation factors that are at least $\Omega(\log n)$. In this paper we propose the use of well-connected graphs, and introduce a new algorithmic toolkit for such graphs that, in a sense, mirrors the above mentioned algorithmic tools for expanders. One of these new tools is the Distanced Matching game, an analogue of the Cut-Matching game for well-connected graphs. We demonstrate the power of these new tools by obtaining better results for several of the problems mentioned above.


title: LHC Benchmark scenarios in the TRSM

abstract: The TRSM is a new physics model that extends the scalar sector of the Standard Model by two additional CP even scalars. It leads to a large variety of interesting signatures, some of which have not yet been explored by the LHC experiments. I will also discuss the option to explore the hhh final state within this model.


title: Internal Representations of Vision Models Through the Lens of Frames on Data Manifolds

abstract: While the last five years have seen considerable progress in understanding the internal representations of deep learning models, many questions remain. This is especially true when trying to understand the impact of model design choices, such as model architecture or training algorithm, on hidden representation geometry and dynamics. In this work we present a new approach to studying such representations inspired by the idea of a frame on the tangent bundle of a manifold. Our construction, which we call a neural frame, is formed by assembling a set of vectors representing specific types of perturbations of a data point, for example infinitesimal augmentations, noise perturbations, or perturbations produced by a generative model, and studying how these change as they pass through a network. Using neural frames, we make observations about the way that models process, layer-by-layer, specific modes of variation within a small neighborhood of a datapoint. Our results provide new perspectives on a number of phenomena, such as the manner in which training with augmentation produces model invariance or the proposed trade-off between adversarial training and model generalization.


title: Is there a one-to-one correspondence between interparticle interactions and physical properties of liquid?

abstract: In this study, we present the original method for reconstructing the potential of interparticle interaction from statistically averaged structural data, namely, the radial distribution function of particles in many-particle system. This method belongs to a family of machine learning methods and is implemented through the differential evolution algorithm. As demonstrated for the case of the Lennard-Jones liquid taken as an example, there is no one-to-one correspondence between structure and potential of interparticle interaction of a many-particle disordered system at a certain thermodynamic state. Namely, a whole family of the Mie potentials determined by two parameters $p_{ 1 }$ and $p_{ 2 }$ related to each other according to a certain rule can reproduce properly a unique structure of the Lennard-Jones liquid at a given thermodynamic state. It is noteworthy that this family of the potentials quite correctly reproduces for the Lennard-Jones liquid the transport properties (in particular, the self-diffusion coefficient) over a temperature range as well as the dynamic structure factor, which is one of the key characteristics of the collective dynamics of particles.

categories: physics.comp-ph cond-mat.dis-nn cond-mat.soft cond-mat.stat-mech physics.chem-ph


title: Analytic preconditioners for decoupled potential integral equations and wideband analysis of scattering from PEC objects

abstract: Many integral equations used to analyze scattering, such as the standard combined field integral equation (CFIE), are not well-conditioned for a wide range of frequencies and multi-scale geometries. There has been significant effort to alleviate this problem. A more recent one is using a set of decoupled potential integral equations (DPIE). These equations have been shown to be robust at low frequencies and immune to topology breakdown. But they mimic the ill-conditioning behavior of CFIE at high frequencies. This paper addresses this deficiency through new Calder\'{o}n-type identities derived from the Vector Potential Integral Equation (VPIE). We construct novel analytic preconditioners for the vector potential integral equation (VPIE) and scalar potential integral equation (SPIE) constrained to perfect electric conductors (PEC). These new formulations are wide-band well-conditioned and converge rapidly for multi-scale geometries. This is demonstrated though a number of examples that use analytic and piecewise basis sets.


title: Pre-hydrodynamic evolution in large and small systems

abstract: We extend our previous investigation of the effects of pre-hydrodynamic evolution on final-state observables in heavy-ion collisions to smaller systems. We use a state-of-the-art hybrid model for the numerical simulations with optimal parameters obtained from a previous Bayesian study. By studying p-Pb collisions, we find that the effects due to the assumption of a conformal evolution in the pre-hydrodynamical stage are even more important in small systems. We also show that this effect depends on the time duration of the pre-equilibrium stage, which is further enhanced in small systems. Finally, we show that the recent proposal of a free-streaming with subluminal velocity for the pre-equilibrium stage, thus effectively breaking conformal invariance, can alleviate the contamination of final state observables. Our study further reinforces the need for moving beyond conformal approaches in pre-equilibrium dynamics modeling, especially when extracting transport coefficients from hybrid models in the high-precision era of heavy-ion collisions.


title: Relativistic Unruh-DeWitt detectors with quantized center of mass

abstract: In this paper, we extend the Unruh-DeWitt (UDW) model to include a relativistic quantized center of mass (c.m.) for the detector, which traditionally has a classical c.m. and follows a classical trajectory. We develop a relativistic model of an inertial detector following two different approaches, starting from either a first- or second-quantized treatment, which enables us to compare the fundamental differences between the two schemes. In particular, we find that the notion of localization is different between the two models, and leads to distinct predictions, which we study by comparing the spontaneous emission rates for the UDW detector interacting with a massless scalar field. Furthermore, we consider the UDW system in both a vacuum and medium, and compare our results to existing models describing a classical or quantized c.m. at low energies. We find that the predictions of each model, including the two relativistic cases, can in principle be empirically distinguished, and our results can be further extended to find optimal detector states and processes to perform such experiments. This would clarify both the role of a quantized c.m. for interactions with an external field, and the differing localizations between the first- and second-quantized treatments.


title: Real-World Image Super Resolution via Unsupervised Bi-directional Cycle Domain Transfer Learning based Generative Adversarial Network

abstract: Deep Convolutional Neural Networks (DCNNs) have exhibited impressive performance on image super-resolution tasks. However, these deep learning-based super-resolution methods perform poorly in real-world super-resolution tasks, where the paired high-resolution and low-resolution images are unavailable and the low-resolution images are degraded by complicated and unknown kernels. To break these limitations, we propose the Unsupervised Bi-directional Cycle Domain Transfer Learning-based Generative Adversarial Network (UBCDTL-GAN), which consists of an Unsupervised Bi-directional Cycle Domain Transfer Network (UBCDTN) and the Semantic Encoder guided Super Resolution Network (SESRN). First, the UBCDTN is able to produce an approximated real-like LR image through transferring the LR image from an artificially degraded domain to the real-world LR image domain. Second, the SESRN has the ability to super-resolve the approximated real-like LR image to a photo-realistic HR image. Extensive experiments on unpaired real-world image benchmark datasets demonstrate that the proposed method achieves superior performance compared to state-of-the-art methods.


title: Gumbel-Softmax Selective Networks

abstract: ML models often operate within the context of a larger system that can adapt its response when the ML model is uncertain, such as falling back on safe defaults or a human in the loop. This commonly encountered operational context calls for principled techniques for training ML models with the option to abstain from predicting when uncertain. Selective neural networks are trained with an integrated option to abstain, allowing them to learn to recognize and optimize for the subset of the data distribution for which confident predictions can be made. However, optimizing selective networks is challenging due to the non-differentiability of the binary selection function (the discrete decision of whether to predict or abstain). This paper presents a general method for training selective networks that leverages the Gumbel-softmax reparameterization trick to enable selection within an end-to-end differentiable training framework. Experiments on public datasets demonstrate the potential of Gumbel-softmax selective networks for selective regression and classification.


title: Filterbank Learning for Noise-Robust Small-Footprint Keyword Spotting

abstract: In the context of keyword spotting (KWS), the replacement of handcrafted speech features by learnable features has not yielded superior KWS performance. In this study, we demonstrate that filterbank learning outperforms handcrafted speech features for KWS whenever the number of filterbank channels is severely decreased. Reducing the number of channels might yield certain KWS performance drop, but also a substantial energy consumption reduction, which is key when deploying common always-on KWS on low-resource devices. Experimental results on a noisy version of the Google Speech Commands Dataset show that filterbank learning adapts to noise characteristics to provide a higher degree of robustness to noise, especially when dropout is integrated. Thus, switching from typically used 40-channel log-Mel features to 8-channel learned features leads to a relative KWS accuracy loss of only 3.5% while simultaneously achieving a 6.3x energy consumption reduction.


title: Self-regulating surfaces for efficient liquid collection

abstract: To achieve efficient liquid collection, a surface must regulate incoming liquid accumulation with outgoing liquid transport. Often, this can be proposed to be achieved by functionalizing surfaces with non-wetting characteristics. Yet, there remain fundamental, practical limits to which non-wetting surfaces can effectively be employed. We instead utilize filmwise wetting to achieve liquid regulation via a Laplace pressure gradient induced by solid surface curvature. The key parameters affecting this capillary flow are then introduced, namely solid properties like scale and curvature and liquid properties like surface tension and density. The liquid regulation mechanism can then be employed in condensation and aerosol processes to generate enhanced flow, while the solid geometry needed to create this capillary flow itself is capable of affecting and enhancing liquid generation. Ultimately, the surface design framework can be customized to each unique application to optimize processes in HVAC, industrial steam generation, chemical depositions, and atmospheric water harvesting.


title: CL-CrossVQA: A Continual Learning Benchmark for Cross-Domain Visual Question Answering

abstract: Visual Question Answering (VQA) is a multi-discipline research task. To produce the right answer, it requires an understanding of the visual content of images, the natural language questions, as well as commonsense reasoning over the information contained in the image and world knowledge. Recently, large-scale Vision-and-Language Pre-trained Models (VLPMs) have been the mainstream approach to VQA tasks due to their superior performance. The standard practice is to fine-tune large-scale VLPMs pre-trained on huge general-domain datasets using the domain-specific VQA datasets. However, in reality, the application domain can change over time, necessitating VLPMs to continually learn and adapt to new domains without forgetting previously acquired knowledge. Most existing continual learning (CL) research concentrates on unimodal tasks, whereas a more practical application scenario, i.e, CL on cross-domain VQA, has not been studied. Motivated by this, we introduce CL-CrossVQA, a rigorous Continual Learning benchmark for Cross-domain Visual Question Answering, through which we conduct extensive experiments on 4 VLPMs, 4 CL approaches, and 5 VQA datasets from different domains. In addition, by probing the forgetting phenomenon of the intermediate layers, we provide insights into how model architecture affects CL performance, why CL approaches can help mitigate forgetting in VLPMs to some extent, and how to design CL approaches suitable for VLPMs in this challenging continual learning environment. To facilitate future work on CL for cross-domain VQA, we will release our datasets and code.


title: Multi-Speaker Expressive Speech Synthesis via Multiple Factors Decoupling

abstract: This paper aims to synthesize the target speaker's speech with desired speaking style and emotion by transferring the style and emotion from reference speech recorded by other speakers. We address this challenging problem with a two-stage framework composed of a text-to-style-and-emotion (Text2SE) module and a style-and-emotion-to-wave (SE2Wave) module, bridging by neural bottleneck (BN) features. To further solve the multi-factor (speaker timbre, speaking style and emotion) decoupling problem, we adopt the multi-label binary vector (MBV) and mutual information (MI) minimization to respectively discretize the extracted embeddings and disentangle these highly entangled factors in both Text2SE and SE2Wave modules. Moreover, we introduce a semi-supervised training strategy to leverage data from multiple speakers, including emotion-labeled data, style-labeled data, and unlabeled data. To better transfer the fine-grained expression from references to the target speaker in non-parallel transfer, we introduce a reference-candidate pool and propose an attention-based reference selection approach. Extensive experiments demonstrate the good design of our model.


title: Quaternionic fermionic field

abstract: The second quantization of the quaternionic fermionic field is undertaken using the real Hilbert space approach to quaternionic quantum mechanics ($\mathbbm H$QM). The solution responds to an open problem of quaternionic quantum theory, and launches the basis to the development of the quaternionic interaction theory.


title: Resolving the puzzle of sound propagation in a dilute Bose-Einstein condensate

abstract: A unified model of a dilute Bose-Einstein condensate is proposed, combining of the logarithmic and Gross-Pitaevskii nonlinear terms in a wave equation, where the Gross-Pitaevskii term describes two-body interactions, as suggested by standard perturbation theory; while the logarithmic term is essentially non-perturbative, and takes into account quantum vacuum effects. The model is shown to have excellent agreement with sound propagation data in the condensate of cold sodium atoms known since the now classic works by Andrews and collaborators. The data also allowed us to place constraints on two of the unified model's parameters, which describe the strengths of the logarithmic and Gross-Pitaevskii terms. Additionally, we suggest an experiment constraining the value of the third parameter (the characteristic density scale of the logarithmic part of the model), using the conjectured attraction-repulsion transition of many-body interaction inside the condensate.


title: Preperiodic points with local rationality conditions in the quadratic unicritical family

abstract: For rational numbers $c$, we present a trichotomy of the set of totally real (totally $p$-adic, respectively) preperiodic points for maps in the quadratic unicritical family $f_c(x)=x^2+c$. As a consequence, we classify quadratic polynomials $f_c$ with rational parameters $c\in\mathbb{Q}$ so that $f_c$ has only finitely many totally real (totally $p$-adic, respectively) preperiodic points. These results rely on an adelic Fekete-type theorem and dynamics of the filled Julia set of $f_c$. Moreover, using a numerical criterion introduced in [NP], we make explicit calculations of the set of totally real $f_c$-preperiodic points when $c=-1,0,\frac{1}{5}$ and $\frac{1}{4}.$


title: Tunable Josephson diode effect on the surface of topological insulators

abstract: The Josephson rectification effect, where the resistance is finite in one direction while zero in the other, has been recently realized experimentally. The resulting Josephson diode has many potential applications on superconducting devices, including quantum computers. Here, we theoretically show that a superconductor-normal metal-superconductor Josephson junction diode on the two-dimensional surface of a topological insulator has large tunability. The magnitude and sign of the diode quality factor strongly depend on the external magnetic field, gate voltage, and the length of the junction. Such rich properties stem from the interplay between different current-phase relations for the multiple transverse transport channels, and can be used for designing realistic superconducting diode devices.


title: Silicon anisotropy in a bi-dimensional optomechanical cavity

abstract: In this work, we study the effects of mechanical anisotropy in a 2D optomechanical crystal geometry. We fabricate and measure devices with different orientations, showing the dependence of the mechanical spectrum and the optomechanical coupling with the relative angle of the device to the crystallography directions of silicon. Our results show that the device orientation strongly affects its mechanical band structure, which makes the devices more susceptible to fabrication imperfections. Finally, we show that our device is compatible with cryogenic measurements reaching ground state occupancy of 0.2 phonons at mK temperature.


title: A 2030 United States Macro Grid Unlocking Geographical Diversity to Accomplish Clean Energy Goals

abstract: Some U.S. states have set clean energy goals and targets in an effort to decarbonize their electricity sectors. There are many reasons for such goals and targets, including the increasingly apparent effects of climate change. A handful of states (Washington, California, New York, and Virginia) are aiming for deep decarbonization by 2050 or earlier, a mere 30 years or less from today. The urgency of substantial carbon emissions reduction (50% or more by 2030) needed to avoid catastrophic climate impacts requires even more ambitious efforts than some of the original targets (e.g., a 30% renewable portfolio standard) set for between now and 2030. With the cost of solar and wind energy falling faster than expected in recent years, economics are also driving rapid expansion of clean energy investments. With this in mind, this report examines combinations of interregional AC and High-Voltage DC (HVDC) transmission upgrades and additions to evaluate the benefits of large-scale transmission expansion.


title: Bayesian autoencoders for data-driven discovery of coordinates, governing equations and fundamental constants

abstract: Recent progress in autoencoder-based sparse identification of nonlinear dynamics (SINDy) under $\ell_1$ constraints allows joint discoveries of governing equations and latent coordinate systems from spatio-temporal data, including simulated video frames. However, it is challenging for $\ell_1$-based sparse inference to perform correct identification for real data due to the noisy measurements and often limited sample sizes. To address the data-driven discovery of physics in the low-data and high-noise regimes, we propose Bayesian SINDy autoencoders, which incorporate a hierarchical Bayesian sparsifying prior: Spike-and-slab Gaussian Lasso. Bayesian SINDy autoencoder enables the joint discovery of governing equations and coordinate systems with a theoretically guaranteed uncertainty estimate. To resolve the challenging computational tractability of the Bayesian hierarchical setting, we adapt an adaptive empirical Bayesian method with Stochatic gradient Langevin dynamics (SGLD) which gives a computationally tractable way of Bayesian posterior sampling within our framework. Bayesian SINDy autoencoder achieves better physics discovery with lower data and fewer training epochs, along with valid uncertainty quantification suggested by the experimental studies. The Bayesian SINDy autoencoder can be applied to real video data, with accurate physics discovery which correctly identifies the governing equation and provides a close estimate for standard physics constants like gravity $g$, for example, in videos of a pendulum.


title: Zero-filter limit for the Camassa-Holm equation in Sobolev spaces

abstract: The aim of this paper is to answer the question left in \cite{GL} (Math. Z. (2015) 281). We prove that the zero-filter limit of the Camassa-Holm equation is the Burgers equation in the same topology of Sobolev spaces as the initial data.


title: Graded local cohomology of modules over semigroup rings

abstract: We give a combinatorial description of local cohomology modules of a graded module over a semigroup ring, with support at the graded maximal ideal. This combinatorial framework yields Hochster-type formulas for the Hilbert series of such local cohomology modules in terms of the homology of finitely many polyhedral cell complexes. A Cohen--Macaulay criterion immediately follows. We also provide an alternative proof of a result of [18] characterizing Cohen--Macaulay affine semigroup rings.


title: ABINet++: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Spotting

abstract: Scene text spotting is of great importance to the computer vision community due to its wide variety of applications. Recent methods attempt to introduce linguistic knowledge for challenging recognition rather than pure visual classification. However, how to effectively model the linguistic rules in end-to-end deep networks remains a research challenge. In this paper, we argue that the limited capacity of language models comes from 1) implicit language modeling; 2) unidirectional feature representation; and 3) language model with noise input. Correspondingly, we propose an autonomous, bidirectional and iterative ABINet++ for scene text spotting. Firstly, the autonomous suggests enforcing explicitly language modeling by decoupling the recognizer into vision model and language model and blocking gradient flow between both models. Secondly, a novel bidirectional cloze network (BCN) as the language model is proposed based on bidirectional feature representation. Thirdly, we propose an execution manner of iterative correction for the language model which can effectively alleviate the impact of noise input. Finally, to polish ABINet++ in long text recognition, we propose to aggregate horizontal features by embedding Transformer units inside a U-Net, and design a position and content attention module which integrates character order and content to attend to character features precisely. ABINet++ achieves state-of-the-art performance on both scene text recognition and scene text spotting benchmarks, which consistently demonstrates the superiority of our method in various environments especially on low-quality images. Besides, extensive experiments including in English and Chinese also prove that, a text spotter that incorporates our language modeling method can significantly improve its performance both in accuracy and speed compared with commonly used attention-based recognizers.


title: Tired of Over-smoothing? Stress Graph Drawing Is All You Need!

abstract: In designing and applying graph neural networks, we often fall into some optimization pitfalls, the most deceptive of which is that we can only build a deep model by solving over-smoothing. The fundamental reason is that we do not understand how graph neural networks work. Stress graph drawing can offer a unique viewpoint to message iteration in the graph, such as the root of the over-smoothing problem lies in the inability of graph models to maintain an ideal distance between nodes. We further elucidate the trigger conditions of over-smoothing and propose Stress Graph Neural Networks. By introducing the attractive and repulsive message passing from stress iteration, we show how to build a deep model without preventing over-smoothing, how to use repulsive information, and how to optimize the current message-passing scheme to approximate the full stress message propagation. By performing different tasks on 23 datasets, we verified the effectiveness of our attractive and repulsive models and the derived relationship between stress iteration and graph neural networks. We believe that stress graph drawing will be a popular resource for understanding and designing graph neural networks.


title: Normal Transformer: Extracting Surface Geometry from LiDAR Points Enhanced by Visual Semantics

abstract: High-quality estimation of surface normal can help reduce ambiguity in many geometry understanding problems, such as collision avoidance and occlusion inference. This paper presents a technique for estimating the normal from 3D point clouds and 2D colour images. We have developed a transformer neural network that learns to utilise the hybrid information of visual semantic and 3D geometric data, as well as effective learning strategies. Compared to existing methods, the information fusion of the proposed method is more effective, which is supported by experiments. We have also built a simulation environment of outdoor traffic scenes in a 3D rendering engine to obtain annotated data to train the normal estimator. The model trained on synthetic data is tested on the real scenes in the KITTI dataset. And subsequent tasks built upon the estimated normal directions in the KITTI dataset show that the proposed estimator has advantage over existing methods.


title: Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusion

abstract: Bird-eye-view (BEV) based methods have made great progress recently in multi-view 3D detection task. Comparing with BEV based methods, sparse based methods lag behind in performance, but still have lots of non-negligible merits. To push sparse 3D detection further, in this work, we introduce a novel method, named Sparse4D, which does the iterative refinement of anchor boxes via sparsely sampling and fusing spatial-temporal features. (1) Sparse 4D Sampling: for each 3D anchor, we assign multiple 4D keypoints, which are then projected to multi-view/scale/timestamp image features to sample corresponding features; (2) Hierarchy Feature Fusion: we hierarchically fuse sampled features of different view/scale, different timestamp and different keypoints to generate high-quality instance feature. In this way, Sparse4D can efficiently and effectively achieve 3D detection without relying on dense view transformation nor global attention, and is more friendly to edge devices deployment. Furthermore, we introduce an instance-level depth reweight module to alleviate the ill-posed issue in 3D-to-2D projection. In experiment, our method outperforms all sparse based methods and most BEV based methods on detection task in the nuScenes dataset.


title: Linear RNNs Provably Learn Linear Dynamic Systems

abstract: We study the learning ability of linear recurrent neural networks with Gradient Descent. We prove the first theoretical guarantee on linear RNNs to learn any stable linear dynamic system using any a large type of loss functions. For an arbitrary stable linear system with a parameter $\rho_C$ related to the transition matrix $C$, we show that despite the non-convexity of the parameter optimization loss if the width of the RNN is large enough (and the required width in hidden layers does not rely on the length of the input sequence), a linear RNN can provably learn any stable linear dynamic system with the sample and time complexity polynomial in $\frac{1}{1-\rho_C}$. Our results provide the first theoretical guarantee to learn a linear RNN and demonstrate how can the recurrent structure help to learn a dynamic system.


title: An Information-State Based Approach to Linear Time Varying System Identification and Control

abstract: This paper considers the problem of system identification for linear time varying systems. We propose a new system realization approach that uses an "information-state" as the state vector, where the "information-state" is composed of a finite number of past inputs and outputs. The system identification algorithm uses input-output data to fit an autoregressive moving average model (ARMA) to represent the current output in terms of finite past inputs and outputs. This information-state-based approach allows us to directly realize a state-space model using the estimated time varying ARMA paramters linear time varying (LTV) systems. The paper develops the theoretical foundation for using ARMA parameters-based system representation using only the concept of linear observability, details the reasoning for exact output modeling using only the finite history, and shows that there is no need to separate the free and the forced response for identification. The paper also discusses the implications of using the information-state system for optimal output feedback control and shows that the solution obtained using a suitably posed information state problem is optimal for the original problem. The proposed approach is tested on various different systems, and the performance is compared with state-of-the-art LTV system identification techniques.


title: Chess tableaux, powers of two and affine Lie algebras

abstract: Chess tableaux are a special kind of standard Young tableaux where, in the chessboard coloring of the Young diagram, even numbers always appear in white cells and odd numbers in black cells. If, for $\lambda$ a partition of $n$, $\text{Chess}(\lambda)$ denotes the number of chess tableaux of shape $\lambda$, then Chow, Eriksson and Fan observed that $\displaystyle\sum_{\lambda \vdash n} \text{Chess}(\lambda)^2$ is divisible by unusually large powers of $2$. In this paper, we give an explanation for this phenomenon, proving a lower bound of $n-O(\sqrt{n})$ for the $2$-adic valuation of this sum and a generalization of it. We do this by exploiting a connection with a certain representation of the affine Lie algebra $\widehat{\mathfrak{sl}_2}$ on the vector space with basis indexed by partitions. Our result about chess tableaux then follows from a study of the basic representation of $\widehat{\mathfrak{sl}_2}$ with coefficients taken from the ring of rational numbers with odd denominators.


title: Prediction-aware and Reinforcement Learning based Altruistic Cooperative Driving

abstract: Autonomous vehicle (AV) navigation in the presence of Human-driven vehicles (HVs) is challenging, as HVs continuously update their policies in response to AVs. In order to navigate safely in the presence of complex AV-HV social interactions, the AVs must learn to predict these changes. Humans are capable of navigating such challenging social interaction settings because of their intrinsic knowledge about other agents behaviors and use that to forecast what might happen in the future. Inspired by humans, we provide our AVs the capability of anticipating future states and leveraging prediction in a cooperative reinforcement learning (RL) decision-making framework, to improve safety and robustness. In this paper, we propose an integration of two essential and earlier-presented components of AVs: social navigation and prediction. We formulate the AV decision-making process as a RL problem and seek to obtain optimal policies that produce socially beneficial results utilizing a prediction-aware planning and social-aware optimization RL framework. We also propose a Hybrid Predictive Network (HPN) that anticipates future observations. The HPN is used in a multi-step prediction chain to compute a window of predicted future observations to be used by the value function network (VFN). Finally, a safe VFN is trained to optimize a social utility using a sequence of previous and predicted observations, and a safety prioritizer is used to leverage the interpretable kinematic predictions to mask the unsafe actions, constraining the RL policy. We compare our prediction-aware AV to state-of-the-art solutions and demonstrate performance improvements in terms of efficiency and safety in multiple simulated scenarios.


title: Scaling Up Dataset Distillation to ImageNet-1K with Constant Memory

abstract: Dataset Distillation is a newly emerging area that aims to distill large datasets into much smaller and highly informative synthetic ones to accelerate training and reduce storage. Among various dataset distillation methods, trajectory-matching-based methods (MTT) have achieved SOTA performance in many tasks, e.g., on CIFAR-10/100. However, due to exorbitant memory consumption when unrolling optimization through SGD steps, MTT fails to scale to large-scale datasets such as ImageNet-1K. Can we scale this SOTA method to ImageNet-1K and does its effectiveness on CIFAR transfer to ImageNet-1K? To answer these questions, we first propose a procedure to exactly compute the unrolled gradient with constant memory complexity, which allows us to scale MTT to ImageNet-1K seamlessly with ~6x reduction in memory footprint. We further discover that it is challenging for MTT to handle datasets with a large number of classes, and propose a novel soft label assignment that drastically improves its convergence. The resulting algorithm sets new SOTA on ImageNet-1K: we can scale up to 50 IPCs (Image Per Class) on ImageNet-1K on a single GPU (all previous methods can only scale to 2 IPCs on ImageNet-1K), leading to the best accuracy (only 5.9% accuracy drop against full dataset training) while utilizing only 4.2% of the number of data points - an 18.2% absolute gain over prior SOTA. Our code is available at https://github.com/justincui03/tesla


title: A note on the transcendental meromorphic solutions of Hayman's equation

abstract: We present a complete description of the form of transcendental meromorphic solutions of the second order differential equation \begin{equation}\tag{\dag} w''w-w'^2+a w'w+b w^2=\alpha{w}+\beta{w'}+\gamma, \end{equation} where $a,b,\alpha,\beta,\gamma$ are all rational functions. Together with the Wiman--Valiron theorem, our results yield that any transcendental meromorphic solution $w$ of $(\dag)$ has hyper-order $\varsigma(w)\leq n$ for some integer $n\geq 0$. Moreover, if $w$ has finite order $\sigma(w)=\sigma$, then $\sigma$ is in the set $\{n/2: n=1,2,\cdots\}$ and, if $w$ has infinite order and $\gamma\not\equiv0$, then the hyper-order $\varsigma$ of $w$ is in the set $\{n: n=1,2,\cdots\}$. Each order or hyper-order in these two sets is attained for some coefficients $a,b,\alpha,\beta,\gamma$.


title: Prior Guided Deep Difference Meta-Learner for Fast Adaptation to Stylized Segmentation

abstract: When a pre-trained general auto-segmentation model is deployed at a new institution, a support framework in the proposed Prior-guided DDL network will learn the systematic difference between the model predictions and the final contours revised and approved by clinicians for an initial group of patients. The learned style feature differences are concatenated with the new patients (query) features and then decoded to get the style-adapted segmentations. The model is independent of practice styles and anatomical structures. It meta-learns with simulated style differences and does not need to be exposed to any real clinical stylized structures during training. Once trained on the simulated data, it can be deployed for clinical use to adapt to new practice styles and new anatomical structures without further training. To show the proof of concept, we tested the Prior-guided DDL network on six different practice style variations for three different anatomical structures. Pre-trained segmentation models were adapted from post-operative clinical target volume (CTV) segmentation to segment CTVstyle1, CTVstyle2, and CTVstyle3, from parotid gland segmentation to segment Parotidsuperficial, and from rectum segmentation to segment Rectumsuperior and Rectumposterior. The mode performance was quantified with Dice Similarity Coefficient (DSC). With adaptation based on only the first three patients, the average DSCs were improved from 78.6, 71.9, 63.0, 52.2, 46.3 and 69.6 to 84.4, 77.8, 73.0, 77.8, 70.5, 68.1, for CTVstyle1, CTVstyle2, and CTVstyle3, Parotidsuperficial, Rectumsuperior, and Rectumposterior, respectively, showing the great potential of the Priorguided DDL network for a fast and effortless adaptation to new practice styles


title: Air-Aided Communication Between Ground Assets in a Poisson Forest

abstract: Ground assets deployed in a cluttered environment with randomized obstacles (e.g., a forest) may experience line of sight (LoS) obstruction due to those obstacles. Air assets can be deployed in the vicinity to aid the communication by establishing two-hop paths between the ground assets. Obstacles that are taller than a position-dependent critical height may still obstruct the LoS between a ground asset and an air asset. In this paper, we provide an analytical framework for computing the probability of obtaining a LoS path in a Poisson forest. Given the locations and heights of a ground asset and an air asset, we establish the critical height, which is a function of distance. To account for this dependence on distance, the blocking is modeled as an inhomogenous Poisson point process, and the LoS probability is its void probability. Examples and closed-form expressions are provided for two obstruction height distributions: uniform and truncated Gaussian. The examples are validated through simulation. Additionally, the end-to-end throughput is determined and shown to be a metric that balances communication distance with the impact of LoS blockage. Throughput is used to determine the range at which it is better to relay communications through the air asset, and, when the air asset is deployed, its optimal height.


title: Bidirectional Generation of Structure and Properties Through a Single Molecular Foundation Model

abstract: The recent success of large foundation models in artificial intelligence has prompted the emergence of chemical pre-trained models. Despite the growing interest in large molecular pre-trained models that provide informative representations for downstream tasks, attempts for multimodal pre-training approaches on the molecule domain were limited. To address this, we present a novel multimodal molecular pre-trained model that incorporates the modalities of structure and biochemical properties, drawing inspiration from recent advances in multimodal learning techniques. Our proposed model pipeline of data handling and training objectives aligns the structure/property features in a common embedding space, which enables the model to regard bidirectional information between the molecules' structure and properties. These contributions emerge synergistic knowledge, allowing us to tackle both multimodal and unimodal downstream tasks through a single model. Through extensive experiments, we demonstrate that our model shows remarkable capabilities in solving various meaningful chemical challenges, including conditional molecule generation, property prediction, molecule classification, and reaction prediction.


title: A Stochastic Second-Order Proximal Method for Distributed Optimization

abstract: In this paper, we propose a distributed stochastic second-order proximal method that enables agents in a network to cooperatively minimize the sum of their local loss functions without any centralized coordination. The proposed algorithm, referred to as St-SoPro, incorporates a decentralized second-order approximation into an augmented Lagrangian function, and then randomly samples the local gradients and Hessian matrices of the agents, so that it is computationally and memory-wise efficient, particularly for large-scale optimization problems. We show that for globally restricted strongly convex problems, the expected optimality error of St-SoPro asymptotically drops below an explicit error bound at a linear rate, and the error bound can be arbitrarily small with proper parameter settings. Simulations over real machine learning datasets demonstrate that St-SoPro outperforms several state-of-the-art distributed stochastic first-order methods in terms of convergence speed as well as computation and communication costs.


title: Likely intersections

abstract: We prove a general likely intersections theorem, a counterpart to the Zilber-Pink conjectures, under the assumption that the Ax-Schanuel property and some mild additional conditions are known to hold for a given category of complex quotient spaces definable in some fixed o-minimal expansion of the ordered field of real numbers. For an instance of our general result, consider the case of subvarieties of Shimura varieties. Let $S$ be a Shimura variety. Let $\pi:D \to \Gamma \backslash D = S$ realize $S$ as a quotient of $D$, a homogeneous space for the action of a real algebraic group $G$, by the action of $\Gamma < G$, an arithmetic subgroup. Let $S' \subseteq S$ be a special subvariety of $S$ realized as $\pi(D')$ for $D' \subseteq D$ a homogeneous space for an algebraic subgroup of $G$. Let $X \subseteq S$ be an irreducible subvariety of $S$ not contained in any proper weakly special subvariety of $S$. Assume that the intersection of $X$ with $S'$ is persistently likely meaning that whenever $\zeta:S_1 \to S$ and $\xi:S_1 \to S_2$ are maps of Shimura varieties (meaning regular maps of varieties induced by maps of the corresponding Shimura data) with $\zeta$ finite, $\dim \xi \zeta^{-1} X + \dim \xi \zeta^{-1} S' \geq \dim \xi S_1$. Then $X \cap \bigcup_{g \in G, \pi(g D') \text{ is special }} \pi(g D')$ is dense in $X$ for the Euclidean topology.


title: MatrixVT: Efficient Multi-Camera to BEV Transformation for 3D Perception

abstract: This paper proposes an efficient multi-camera to Bird's-Eye-View (BEV) view transformation method for 3D perception, dubbed MatrixVT. Existing view transformers either suffer from poor transformation efficiency or rely on device-specific operators, hindering the broad application of BEV models. In contrast, our method generates BEV features efficiently with only convolutions and matrix multiplications (MatMul). Specifically, we propose describing the BEV feature as the MatMul of image feature and a sparse Feature Transporting Matrix (FTM). A Prime Extraction module is then introduced to compress the dimension of image features and reduce FTM's sparsity. Moreover, we propose the Ring \& Ray Decomposition to replace the FTM with two matrices and reformulate our pipeline to reduce calculation further. Compared to existing methods, MatrixVT enjoys a faster speed and less memory footprint while remaining deploy-friendly. Extensive experiments on the nuScenes benchmark demonstrate that our method is highly efficient but obtains results on par with the SOTA method in object detection and map segmentation tasks


title: Autoregressive GNN-ODE GRU Model for Network Dynamics

abstract: Revealing the continuous dynamics on the networks is essential for understanding, predicting, and even controlling complex systems, but it is hard to learn and model the continuous network dynamics because of complex and unknown governing equations, high dimensions of complex systems, and unsatisfactory observations. Moreover, in real cases, observed time-series data are usually non-uniform and sparse, which also causes serious challenges. In this paper, we propose an Autoregressive GNN-ODE GRU Model (AGOG) to learn and capture the continuous network dynamics and realize predictions of node states at an arbitrary time in a data-driven manner. The GNN module is used to model complicated and nonlinear network dynamics. The hidden state of node states is specified by the ODE system, and the augmented ODE system is utilized to map the GNN into the continuous time domain. The hidden state is updated through GRUCell by observations. As prior knowledge, the true observations at the same timestamp are combined with the hidden states for the next prediction. We use the autoregressive model to make a one-step ahead prediction based on observation history. The prediction is achieved by solving an initial-value problem for ODE. To verify the performance of our model, we visualize the learned dynamics and test them in three tasks: interpolation reconstruction, extrapolation prediction, and regular sequences prediction. The results demonstrate that our model can capture the continuous dynamic process of complex systems accurately and make precise predictions of node states with minimal error. Our model can consistently outperform other baselines or achieve comparable performance.


title: Explainable Artificial Intelligence and Causal Inference based ATM Fraud Detection

abstract: Gaining the trust of customers and providing them empathy are very critical in the financial domain. Frequent occurrence of fraudulent activities affects these two factors. Hence, financial organizations and banks must take utmost care to mitigate them. Among them, ATM fraudulent transaction is a common problem faced by banks. There following are the critical challenges involved in fraud datasets: the dataset is highly imbalanced, the fraud pattern is changing, etc. Owing to the rarity of fraudulent activities, Fraud detection can be formulated as either a binary classification problem or One class classification (OCC). In this study, we handled these techniques on an ATM transactions dataset collected from India. In binary classification, we investigated the effectiveness of various over-sampling techniques, such as the Synthetic Minority Oversampling Technique (SMOTE) and its variants, Generative Adversarial Networks (GAN), to achieve oversampling. Further, we employed various machine learning techniques viz., Naive Bayes (NB), Logistic Regression (LR), Support Vector Machine (SVM), Decision Tree (DT), Random Forest (RF), Gradient Boosting Tree (GBT), Multi-layer perceptron (MLP). GBT outperformed the rest of the models by achieving 0.963 AUC, and DT stands second with 0.958 AUC. DT is the winner if the complexity and interpretability aspects are considered. Among all the oversampling approaches, SMOTE and its variants were observed to perform better. In OCC, IForest attained 0.959 CR, and OCSVM secured second place with 0.947 CR. Further, we incorporated explainable artificial intelligence (XAI) and causal inference (CI) in the fraud detection framework and studied it through various analyses.


title: Bipartite-play Dialogue Collection for Practical Automatic Evaluation of Dialogue Systems

abstract: Automation of dialogue system evaluation is a driving force for the efficient development of dialogue systems. This paper introduces the bipartite-play method, a dialogue collection method for automating dialogue system evaluation. It addresses the limitations of existing dialogue collection methods: (i) inability to compare with systems that are not publicly available, and (ii) vulnerability to cheating by intentionally selecting systems to be compared. Experimental results show that the automatic evaluation using the bipartite-play method mitigates these two drawbacks and correlates as strongly with human subjectivity as existing methods.


title: Adjacent Slice Feature Guided 2.5D Network for Pulmonary Nodule Segmentation

abstract: More and more attention has been paid to the segmentation of pulmonary nodules. Among the current methods based on deep learning, 3D segmentation methods directly input 3D images, which takes up a lot of memory and brings huge computation. However, most of the 2D segmentation methods with less parameters and calculation have the problem of lacking spatial relations between slices, resulting in poor segmentation performance. In order to solve these problems, we propose an adjacent slice feature guided 2.5D network. In this paper, we design an adjacent slice feature fusion model to introduce information from adjacent slices. To further improve the model performance, we construct a multi-scale fusion module to capture more context information, in addition, we design an edge-constrained loss function to optimize the segmentation results in the edge region. Fully experiments show that our method performs better than other existing methods in pulmonary nodule segmentation task.


title: LidarGait: Benchmarking 3D Gait Recognition with Point Clouds

abstract: Video-based gait recognition has achieved impressive results in constrained scenarios. However, visual cameras neglect human 3D structure information, which limits the feasibility of gait recognition in the 3D wild world. Instead of extracting gait features from images, this work explores precise 3D gait features from point clouds and proposes a simple yet efficient 3D gait recognition framework, termed LidarGait. Our proposed approach projects sparse point clouds into depth maps to learn the representations with 3D geometry information, which outperforms existing point-wise and camera-based methods by a significant margin. Due to the lack of point cloud datasets, we built the first large-scale LiDAR-based gait recognition dataset, SUSTech1K, collected by a LiDAR sensor and an RGB camera. The dataset contains 25,239 sequences from 1,050 subjects and covers many variations, including visibility, views, occlusions, clothing, carrying, and scenes. Extensive experiments show that (1) 3D structure information serves as a significant feature for gait recognition. (2) LidarGait outperforms existing point-based and silhouette-based methods by a significant margin, while it also offers stable cross-view results. (3) The LiDAR sensor is superior to the RGB camera for gait recognition in the outdoor environment. The source code and dataset have been made available at https://lidargait.github.io.


title: Eigenvalue Analysis and Applications of the Legendre Dual-Petrov-Galerkin Methods for Initial Value Problems

abstract: In this paper, we show that the eigenvalues and eigenvectors of the spectral discretisation matrices resulted from the Legendre dual-Petrov-Galerkin (LDPG) method for the $m$th-order initial value problem (IVP): $u^{(m)}(t)=\sigma u(t),\, t\in (-1,1)$ with constant $\sigma\not=0$ and usual initial conditions at $t=-1,$ are associated with the generalised Bessel polynomials (GBPs). The essential idea of the analysis is to properly construct the basis functions for the solution and its dual spaces so that the matrix of the $m$th derivative is an identity matrix, and the mass matrix is then identical or approximately equals to the Jacobi matrix of the three-term recurrence of GBPs with specific integer parameters. This allows us to characterise the eigenvalue distributions and identify the eigenvectors. As a by-product, we are able to answer some open questions related to the very limited known results on the collocation method at Legendre points (studied in 1980s) for the first-order IVP, by reformulating it into a Petrov-Galerkin formulation. Moreover, we present two stable algorithms for computing zeros of the GBPs, and develop a general space-time spectral method for evolutionary PDEs using either the matrix diagonalisation, which is restricted to a small number of unknowns in time due to the ill-conditioning but is fully parallel, or the QZ decomposition which is numerically stable for a large number of unknowns in time but involves sequential computations. We provide ample numerical results to demonstrate the high accuracy and robustness of the space-time spectral methods for some interesting examples of linear and nonlinear wave problems.


title: Robust mode-locking in a hybrid ultrafast laser based on nonlinear multimodal interference

abstract: We experimentally demonstrate the realization of a half-polarization-maintaining (half-PM) fiber laser, in which mode-locking is provided by a reflective multimode-interference saturable absorber (SA). In the specially designed SA, linearly polarized light is coupled into a 15-cm-long graded-index multimode fiber (GIMF) through the PM fiber, and then reflected back to the PM structure through a mirror pigtailed with a single-mode fiber (SMF). The modulation depth and saturation peak power are measured to be 1.5% and 0.6 W, respectively. The proposed SA device is incorporated into a novel half-PM erbium-doped fiber oscillator, which generates soliton pulses with 409 fs temporal duration at a 33.3 MHz repetition rate. The proposed fiber laser is compared with a conventional non-PM fiber laser mode-locked by nonlinear polarization evolution (NPE) in terms of optical properties such as spectral bandwidth, pulse duration, and stability performance. Short- and long-time stability tests and superior noise performance corroborate robust mode-locking in this setup.


title: Index Theory of Chiral Unitaries and Split-Step Quantum Walks

abstract: Building from work by Cedzich et al. and Suzuki et al., we consider topological and index-theoretic properties of chiral unitaries, which are an abstraction of the time evolution of a chiral-symmetric self-adjoint operator. Split-step quantum walks provide a rich class of examples. We use the index of a pair of projections and the Cayley transform to define topological indices for chiral unitaries on both Hilbert spaces and Hilbert $C^*$-modules. In the case of the discrete time evolution of a Hamiltonian-like operator, we relate the index for chiral unitaries to the index of the Hamiltonian. We also prove a double-sided winding number formula for anisotropic split-step quantum walks on Hilbert $C^*$-modules, extending a result by Matsuzawa.


title: Simulating topological materials with photonic synthetic dimensions in cavities

abstract: Photons play essential roles in fundamental physics and practical technologies. They have become one of the attractive informaiton carriers for quantum computation and quantum simulation. Recently, various photonic degrees of freedom supported by optical resonant cavities form photonic synthetic dimensions, which contribute to all-optical platforms for simulating novel topological materials. The photonic discrete or continuous degrees of freedom are mapped to the lattices or momenta of the simulated topological matter, and the couplings between optical modes are equivalent to the interactions among quasi-particles. Mature optical modulations enable flexible engineering of the simulated Hamiltonian. Meanwhile, the resonant detection methods provide direct approaches to obtaining the corresponding energy band structures, particle distributions and dynamical evolutions. In this Review, we give an overview of the synthetic dimensions in optical cavities, including frequency, orbital angular momentum, time-multiplexed lattice, and independent parameters. Abundant higher-dimensional topological models have been demonstrated in lower dimensional synthetic systems. We further discuss the potential development of photonic synthetic dimensions in the future.


title: Investigating the Security of EV Charging Mobile Applications As an Attack Surface

abstract: In this paper, we study the security posture of the EV charging ecosystem against a new type of remote that exploits vulnerabilities in the EV charging mobile applications as an attack surface. We leverage a combination of static and dynamic analysis techniques to analyze the security of widely used EV charging mobile applications. Our analysis was performed on 31 of the most widely used mobile applications including their interactions with various components such as cloud management systems. The attack, scenarios that exploit these vulnerabilities were verified on a real-time co-simulation test bed. Our discoveries indicate the lack of user/vehicle verification and improper authorization for critical functions, which allow adversaries to remotely hijack charging sessions and launch attacks against the connected critical infrastructure. The attacks were demonstrated using the EVCS mobile applications showing the feasibility and the applicability of our attacks. Indeed, we discuss specific remote attack scenarios and their impact on EV users. More importantly, our analysis results demonstrate the feasibility of leveraging existing vulnerabilities across various EV charging mobile applications to perform wide-scale coordinated remote charging/discharging attacks against the connected critical infrastructure (e.g., power grid), with significant economical and operational implications. Finally, we propose countermeasures to secure the infrastructure and impede adversaries from performing reconnaissance and launching remote attacks using compromised accounts.


title: Deep-learning electronic-structure calculation of magnetic superstructures

abstract: Ab initio study of magnetic superstructures (e.g., magnetic skyrmion) is indispensable to the research of novel materials but bottlenecked by its formidable computational cost. For solving the bottleneck problem, we develop a deep equivariant neural network method (named xDeepH) to represent density functional theory Hamiltonian $H_\text{DFT}$ as a function of atomic and magnetic structures and apply neural networks for efficient electronic structure calculation. Intelligence of neural networks is optimized by incorporating a priori knowledge about the important locality and symmetry properties into the method. Particularly, we design a neural-network architecture fully preserving all equivalent requirements on $H_\text{DFT}$ by the Euclidean and time-reversal symmetries ($E(3) \times \{I, T\}$), which is essential to improve method performance. High accuracy (sub-meV error) and good transferability of xDeepH are shown by systematic experiments on nanotube, spin-spiral, and Moir\'{e} magnets, and the capability of studying magnetic skyrmion is also demonstrated. The method could find promising applications in magnetic materials research and inspire development of deep-learning ab initio methods.


title: ISAC Meets SWIPT: Multi-functional Wireless Systems Integrating Sensing, Communication, and Powering

abstract: This paper unifies integrated sensing and communication (ISAC) and simultaneous wireless information and power transfer (SWIPT), by investigating a new multi-functional multiple-input multiple-output (MIMO) system integrating wireless sensing, communication, and powering. In this system, one multi-antenna hybrid access point (H-AP) transmits wireless signals to communicate with one multi-antenna information decoding (ID) receiver, wirelessly charge one multi-antenna energy harvesting (EH) receiver, and perform radar target sensing based on the echo signal at the same time. Under this setup, we aim to reveal the fundamental performance tradeoff limits among sensing, communication, and powering, in terms of the estimation Cramer-Rao bound (CRB), achievable communication rate, and harvested energy level, respectively. In particular, we consider two different target models for radar sensing, namely the point and extended targets, for which we are interested in estimating the target angle and the complete target response matrix, respectively. For both models, we define the achievable CRB-rate-energy (C-R-E) region and characterize its Pareto boundary by maximizing the achievable rate at the ID receiver, subject to the estimation CRB requirement for target sensing, the harvested energy requirement at the EH receiver, and the maximum transmit power constraint at the H-AP. We obtain the well-structured optimal transmit covariance solutions to the two formulated problems by applying advanced convex optimization techniques. Numerical results show the optimal C-R-E region boundary achieved by our proposed design, as compared to the benchmark schemes based on time switching and eigenmode transmission (EMT).


title: Search for higher mass resonances via KK decay channel in pp collisions with ALICE at the LHC

abstract: The quark model has proven successful in describing the basic building blocks of strongly interacting particles in the Standard Model, where hadronic states consist of quarks and gluons. At the same time, Lattice QCD predicts the possibility of glueball candidates in the mass range \mbox{1550--1750} MeV/$c^2$, which have never been observed. The experimental search for the existence of mesons with no quark content is both interesting and challenging as the glueball is very likely to mix with surrounding quark-antiquark scalar meson states with the same quantum numbers. The large statistics data sample collected by ALICE in pp collisions at the highest LHC center-of-mass energy provides an opportunity to measure high mass resonances, whose characteristics and internal structure are still unknown. In this article, we report on the measurements of invariant mass distributions of higher mass resonances using the decay channels of K$^{0}_\mathrm{S}\mathrm{K}^{0}_\mathrm{S}$ and K$^{+}$K$^{-}$ pairs in pp collisions at $\sqrt{s}$ = 13 TeV using ALICE detector at midrapidity.