title: Anomalous resistivity upturn in the van der Waals ferromagnet Fe$_5$GeTe$_2$

abstract: Fe$_5$GeTe$_2$ (n = 3, 4, 5) have recently attracted increasing attention due to their two-dimensional van der Waals characteristic and high temperature ferromagnetism, which make promises for spintronic devices. The Fe(1) split site is one important structural characteristic of Fe$_5$GeTe$_2$ which makes it very different from other Fe$_5$GeTe$_2$ (n = 3, 4) systems. The local atomic disorder and short-range order can be induced by the split site. In this work, the high-quality van der Waals ferromagnet Fe$_5$GeTe$_2$ were grown to study the low-temperature transport properties. We found a resistivity upturn below 10 K. The temperature and magnetic field dependence of the resistivity are in good agreement with a combination of the theory of disorder-enhanced three-dimensional electron-electron and single-channel Kondo effect. The Kondo effect exists only at low magnetic field B < 3 T, while electron-electron dominates the appearance for the low-temperature resistivity upturn. We believe that the enhanced three-dimensional electron-electron interaction in this system is induced by the local atomic structural disorder due to the split site of Fe(1). Our results indicate that the split site of Fe plays an important role for the exceptional transport properties.


title: Intelligent Amphibious Ground-Aerial Vehicles: State of the Art Technology for Future Transportation

abstract: Amphibious ground-aerial vehicles fuse flying and driving modes to enable more flexible air-land mobility and have received growing attention recently. By analyzing the existing amphibious vehicles, we highlight the autonomous fly-driving functionality for the effective uses of amphibious vehicles in complex three-dimensional urban transportation systems. We review and summarize the key enabling technologies for intelligent flying-driving in existing amphibious vehicle designs, identify major technological barriers and propose potential solutions for future research and innovation. This paper aims to serve as a guide for research and development of intelligent amphibious vehicles for urban transportation toward the future.


title: Causal Fairness Analysis

abstract: Decision-making systems based on AI and machine learning have been used throughout a wide range of real-world scenarios, including healthcare, law enforcement, education, and finance. It is no longer far-fetched to envision a future where autonomous systems will be driving entire business decisions and, more broadly, supporting large-scale decision-making infrastructure to solve society's most challenging problems. Issues of unfairness and discrimination are pervasive when decisions are being made by humans, and remain (or are potentially amplified) when decisions are made using machines with little transparency, accountability, and fairness. In this paper, we introduce a framework for \textit{causal fairness analysis} with the intent of filling in this gap, i.e., understanding, modeling, and possibly solving issues of fairness in decision-making settings. The main insight of our approach will be to link the quantification of the disparities present on the observed data with the underlying, and often unobserved, collection of causal mechanisms that generate the disparity in the first place, challenge we call the Fundamental Problem of Causal Fairness Analysis (FPCFA). In order to solve the FPCFA, we study the problem of decomposing variations and empirical measures of fairness that attribute such variations to structural mechanisms and different units of the population. Our effort culminates in the Fairness Map, which is the first systematic attempt to organize and explain the relationship between different criteria found in the literature. Finally, we study which causal assumptions are minimally needed for performing causal fairness analysis and propose a Fairness Cookbook, which allows data scientists to assess the existence of disparate impact and disparate treatment.


title: Learning an Adaptive Forwarding Strategy for Mobile Wireless Networks: Resource Usage vs. Latency

abstract: Designing effective routing strategies for mobile wireless networks is challenging due to the need to seamlessly adapt routing behavior to spatially diverse and temporally changing network conditions. In this work, we use deep reinforcement learning (DeepRL) to learn a scalable and generalizable single-copy routing strategy for such networks. We make the following contributions: i) we design a reward function that enables the DeepRL agent to explicitly trade-off competing network goals, such as minimizing delay vs. the number of transmissions per packet; ii) we propose a novel set of relational neighborhood, path, and context features to characterize mobile wireless networks and model device mobility independently of a specific network topology; and iii) we use a flexible training approach that allows us to combine data from all packets and devices into a single offline centralized training set to train a single DeepRL agent. To evaluate generalizeability and scalability, we train our DeepRL agent on one mobile network scenario and then test it on other mobile scenarios, varying the number of devices and transmission ranges. Our results show our learned single-copy routing strategy outperforms all other strategies in terms of delay except for the optimal strategy, even on scenarios on which the DeepRL agent was not trained.


title: Early Results from GLASS-JWST. I: Confirmation of Lensed $z\geqslant7$ Lyman-Break Galaxies Behind the Abell 2744 Cluster With NIRISS

abstract: We present the first search for $z\geqslant7$, continuum-confirmed sources with NIRISS/WFS spectroscopy over the Abell 2744 Frontier Fields cluster, as part of the GLASS-JWST ERS survey. With $\sim15$ hrs of pre-imaging and multi-angle grism exposures in the F115W, F150W, and F200W filters, we describe the general data handling (i.e., reduction, cleaning, modeling, and extraction processes) and analysis for the GLASS-JWST survey. We showcase the power of JWST to peer deep into reionization, when most intergalactic hydrogen is neutral, by confirming two galaxies at $z=8.04\pm0.15$ and $z=7.90\pm0.13$ by means of their Lyman breaks. Fainter continuum spectra are observed in both the F150W and F200W bands, indicative of blue ($-1.69$ and $-1.33$) UV slopes and moderately-bright absolute magnitudes ($-20.37$ and $-19.68$ mag). We do not detect strong Ly$\alpha$ in either galaxy, but do observe tentative ($\sim2.7-3.8\sigma$) HeII$\lambda$1640 A, OIII]$\lambda\lambda$1661,1666 A, and NIII]$\lambda\lambda$1747,1749 A line emission in one, suggestive of low metallicity, star-forming systems with possible non-thermal contributions. These novel observations provide a first look at the extraordinary potential of JWST/NIRISS for confirming representative samples of bright $z\geqslant7$ sources in the absence of strong emission lines, and gain unprecedented insight into their contributions towards cosmic reionization.


title: Low-Complexity Acoustic Echo Cancellation with Neural Kalman Filtering

abstract: The Kalman filter has been adopted in acoustic echo cancellation due to its robustness to double-talk, fast convergence, and good steady-state performance. The performance of Kalman filter is closely related to the estimation accuracy of the state noise covariance and the observation noise covariance. The estimation error may lead to unacceptable results, especially when the echo path suffers abrupt changes, the tracking performance of the Kalman filter could be degraded significantly. In this paper, we propose the neural Kalman filtering (NKF), which uses neural networks to implicitly model the covariance of the state noise and observation noise and to output the Kalman gain in real-time. Experimental results on both synthetic test sets and real-recorded test sets show that, the proposed NKF has superior convergence and re-convergence performance while ensuring low near-end speech degradation comparing with the state-of-the-art model-based methods. Moreover, the model size of the proposed NKF is merely 5.3 K and the RTF is as low as 0.09, which indicates that it can be deployed in low-resource platforms.


title: Two-Aspect Information Fusion Model For ABAW4 Multi-task Challenge

abstract: In this paper, we propose the solution to the Multi-Task Learning (MTL) Challenge of the 4th Affective Behavior Analysis in-the-wild (ABAW) competition. The task of ABAW is to predict frame-level emotion descriptors from videos: discrete emotional state; valence and arousal; and action units. Although researchers have proposed several approaches and achieved promising results in ABAW, current works in this task rarely consider interactions between different emotion descriptors. To this end, we propose a novel end to end architecture to achieve full integration of different types of information. Experimental results demonstrate the effectiveness of our proposed solution.


title: Ultraviolet Spectroscopy of Lucy Mission Targets with the Hubble Space Telescope

abstract: The recently launched Lucy mission aims to understand the dynamical history of the Solar System by examining the Jupiter Trojans, a population of primitive asteroids co-orbital with Jupiter. Using the G280 grism on the Hubble Space Telescope's Wide Field Camera 3 we obtained near ultraviolet spectra of four of the five Lucy mission targets -- (617) Patroclus-Menoetius, (11351) Leucus, (3548) Eurybates, and (21900) Orus -- to search for novel spectral features. We observe a local reflectance minimum at 0.4 $\mu$m accompanied by an increase in reflectance from 0.35-0.3 $\mu$m in the spectra of Patroclus and Orus. We use the principles of Rayleigh scattering and geometric optics to develop a Hapke optical model to investigate whether this feature can be explained by the presence of submicroscopic grains on Trojan surfaces. The near ultraviolet "bump" feature can be explained by scattering due to fine-grained opaques (iron, amorphous carbon, or graphite) with grain sizes ranging from 20 - 80 nm.


title: Directional carrier transport in micrometer-thick gallium oxide films for high-performance deep-ultraviolet photodetection

abstract: Incorporating emerging ultrawide bandgap semiconductors with a metal-semiconductor-metal (MSM) architecture is highly desired for deep-ultraviolet (DUV) photodetection. However, synthesis-induced defects in semiconductors complicate the rational design of MSM DUV photodetectors due to their dual role as carrier donors and trap centers, leading to a commonly observed trade-off between responsivity and response time. Here, we demonstrate a simultaneous improvement of these two parameters in {\epsilon}-Ga2O3 MSM photodetectors by establishing a low-defect diffusion barrier for directional carrier transport. Specifically, using a micrometer thickness far exceeding its effective light absorption depth, the {\epsilon}-Ga2O3 MSM photodetector achieves over 18-fold enhancement of responsivity and simultaneous reduction of the response time, which exhibits a state-of-the-art photo-to-dark current ratio near 10^8, a superior responsivity of >1300 A/W, an ultrahigh detectivity of >10^16 Jones and a decay time of 123 ms. Combined depth-profile spectroscopic and microscopic analysis reveals the existence of a broad defective region near the lattice-mismatched interface followed by a more defect-free dark region, while the latter one serves as a diffusion barrier to assist frontward carrier transport for substantially enhancing the photodetector performance. This work reveals the critical role of the semiconductor defect profile in tuning carrier transport for fabricating high-performance MSM DUV photodetectors.


title: Simultaneous Inference for Time Series Functional Linear Regression

abstract: We consider the problem of joint simultaneous confidence band (JSCB) construction for regression coefficient functions of time series scalar-on-function linear regression when the regression model is estimated by roughness penalization approach with flexible choices of orthonormal basis functions. A simple and unified multiplier bootstrap methodology is proposed for the JSCB construction which is shown to achieve the correct coverage probability asymptotically. Furthermore, the JSCB is asymptotically robust to inconsistently estimated standard deviations of the model. The proposed methodology is applied to a time series data set of electricity market to visually investigate and formally test the overall regression relationship as well as perform model validation.


title: Deep Pneumonia: Attention-Based Contrastive Learning for Class-Imbalanced Pneumonia Lesion Recognition in Chest X-rays

abstract: Computer-aided X-ray pneumonia lesion recognition is important for accurate diagnosis of pneumonia. With the emergence of deep learning, the identification accuracy of pneumonia has been greatly improved, but there are still some challenges due to the fuzzy appearance of chest X-rays. In this paper, we propose a deep learning framework named Attention-Based Contrastive Learning for Class-Imbalanced X-Ray Pneumonia Lesion Recognition (denoted as Deep Pneumonia). We adopt self-supervised contrastive learning strategy to pre-train the model without using extra pneumonia data for fully mining the limited available dataset. In order to leverage the location information of the lesion area that the doctor has painstakingly marked, we propose mask-guided hard attention strategy and feature learning with contrastive regulation strategy which are applied on the attention map and the extracted features respectively to guide the model to focus more attention on the lesion area where contains more discriminative features for improving the recognition performance. In addition, we adopt Class-Balanced Loss instead of traditional Cross-Entropy as the loss function of classification to tackle the problem of serious class imbalance between different classes of pneumonia in the dataset. The experimental results show that our proposed framework can be used as a reliable computer-aided pneumonia diagnosis system to assist doctors to better diagnose pneumonia cases accurately.


title: Quantum third-order nonlinear Hall effect of a four-terminal device with time-reversal symmetry

abstract: The third-order nonlinear Hall effect induced by Berry-connection polarizability tensor has been observed in Weyl semimetals T$_d$-MoTe$_2$ as well as T$_d$-TaIrTe$_4$. The experiments were performed on bulk samples, and the results were interpreted with the semiclassical Boltzmann approach. Beyond the bulk limit, we develop a quantum nonlinear transport theory to investigate the third-order Hall response of a four-terminal setup with time-reversal symmetry in quantum regime. The quantum nonlinear theory is verified on a model system of monolayer MoTe$_2$, and numerical results on the angle-resolved Hall currents are qualitatively consistent with the experiment. More importantly, quantum signatures of the third-order Hall effect are revealed, which are independent of the system symmetry. The first quantum signature is quantum enhancement of the third-order Hall current, which is characterized by sharp current peaks whose magnitudes are three orders larger than the first-order Hall current. Such quantum enhancement originates from quantum interference in coherent transport, and it can be easily destroyed by dephasing effect. The second quantum signature is disorder-induced enhancement of the third-order Hall current for weak disorders. Our findings reveal quantum characteristics of the third-order Hall effect, and we propose feasible ways to enhance it in nanoscale systems. The quantum third-order theory developed in this work provides a general formalism for describing nonlinear coherent transport properties in multi-terminal devices, regardless of the system symmetry.


title: Quantum Multiple-Valued Decision Diagrams with Linear Transformations

abstract: Due to the rapid development of quantum computing, the compact representation of quantum operations based on decision diagrams has been received more and more attraction. Since variable orders have a significant impact on the size of the decision diagram, identifying a good variable order is of paramount importance. In this paper, we integrate linear transformations into an efficient and canonical form of quantum computing: Quantum Multiple-Valued Decision Diagrams (QMDDs) and develop a novel canonical representation, namely linearly transformed QMDDs (LTQMDDs). We design a linear sifting algorithm for LTQMDDs that search a good linear transformation to obtain a more compact form of quantum function. Experimental results show that the linear sifting algorithm is able to generate decision diagrams that are significantly improved compared with the original sifting algorithm. Moreover, for certain types of circuits, linear sifting algorithm have good performance whereas sifting algorithm does not decrease the size of QMDDs.


title: Orientation and Context Entangled Network for Retinal Vessel Segmentation

abstract: Most of the existing deep learning based methods for vessel segmentation neglect two important aspects of retinal vessels, one is the orientation information of vessels, and the other is the contextual information of the whole fundus region. In this paper, we propose a robust Orientation and Context Entangled Network (denoted as OCE-Net), which has the capability of extracting complex orientation and context information of the blood vessels. To achieve complex orientation aware, a Dynamic Complex Orientation Aware Convolution (DCOA Conv) is proposed to extract complex vessels with multiple orientations for improving the vessel continuity. To simultaneously capture the global context information and emphasize the important local information, a Global and Local Fusion Module (GLFM) is developed to simultaneously model the long-range dependency of vessels and focus sufficient attention on local thin vessels. A novel Orientation and Context Entangled Non-local (OCE-NL) module is proposed to entangle the orientation and context information together. In addition, an Unbalanced Attention Refining Module (UARM) is proposed to deal with the unbalanced pixel numbers of background, thick and thin vessels. Extensive experiments were performed on several commonly used datasets (DRIVE, STARE and CHASEDB1) and some more challenging datasets (AV-WIDE, UoA-DR, RFMiD and UK Biobank). The ablation study shows that the proposed method achieves promising performance on maintaining the continuity of thin vessels and the comparative experiments demonstrate that our OCE-Net can achieve state-of-the-art performance on retinal vessel segmentation.


title: Rayleigh Regression Model for Ground Type Detection in SAR Imagery

abstract: This letter proposes a regression model for nonnegative signals. The proposed regression estimates the mean of Rayleigh distributed signals by a structure which includes a set of regressors and a link function. For the proposed model, we present: (i)~parameter estimation; (ii)~large data record results; and (iii)~a detection technique. In this letter, we present closed-form expressions for the score vector and Fisher information matrix. The proposed model is submitted to extensive Monte Carlo simulations and to measured data. The Monte Carlo simulations are used to evaluate the performance of maximum likelihood estimators. Also, an application is performed comparing the detection results of the proposed model with Gaussian-, Gamma-, and Weibull-based regression models in SAR images.

categories: stat.ME eess.IV eess.SP physics.data-an physics.ins-det


title: All-optical nanoscale thermometry based on silicon-vacancy centers in detonation nanodiamonds

abstract: Silicon-vacancy (SiV) centers in diamond are a promising candidate for all-optical nanoscale high-sensitivity thermometry because they have sufficient sensitivity to reach the subkelvin precision required for application to biosystems. It is expected that nanodiamonds with SiV centers can be injected into cells to measure the nanoscale local temperatures of biosystems such as organelles. However, the smallest particle size used to demonstrate thermometry using SiV centers is a few hundred nanometers. We recently developed SiV-center-containing nanodiamonds via a detonation process that is suitable for large-scale production. Here, we investigate the spectral response of SiV-center-containing detonation nanodiamonds (SiV-DNDs) to temperature. We used air-oxidized and polyglycerol-coated SiV-DNDs with a mean particle size of around 20 nm, which is the smallest size used to demonstrate thermometry using color centers in nanodiamond. We found that the zero-phonon line for SiV-DND is linearly red-shifted with increasing temperature in the range of 22.0 to 40.5 $^\circ C$. The peak sensitivity to temperature was 0.011 $\pm$ 0.002 nm/K, which agrees with the reported high sensitivity of SiV centers in bulk diamond. A temperature sensitivity analysis revealed that SiV-DND thermometry can achieve subkelvin precision. All-optical SiV-DND thermometry will be important for investigating nanosystems such as organelles in living cells.


title: Asymptotically free and safe quantum gravity scenarios consistent with Hubble, laboratory, and inflation scale physics

abstract: To find out the possible scenarios for quantum gravity consistent with the observed universe, we numerically investigate the non-perturbative renormalization group equations of a general quadratic gravity theory recently derived by Sen, Wetterich and Yamada (\textit{JHEP} 03 (2022) 130). As boundary conditions, we impose consistency with the Hubble scale and the laboratory scale experiments, and the Starobinsky model of inflation. We find two kinds of trajectories which go to different regime at the trans-Planckian scales: i) a trajectory which flows to the asymptotically free regime, and ii) a trajectory which flows to the asymptotically safe regime. To determine the early-time cosmological scenario, an additional observational data from beyond the homogeneous and isotropic space-time is necessary.


title: Wavelength-Resolution SAR Ground Scene Prediction Based on Image Stack

abstract: This paper presents five different statistical methods for ground scene prediction (GSP) in wavelength-resolution synthetic aperture radar (SAR) images. The GSP image can be used as a reference image in a change detection algorithm yielding a high probability of detection and low false alarm rate. The predictions are based on image stacks, which are composed of images from the same scene acquired at different instants with the same flight geometry. The considered methods for obtaining the ground scene prediction include (i) autoregressive models; (ii) trimmed mean; (iii) median; (iv) intensity mean; and (v) mean. It is expected that the predicted image presents the true ground scene without change and preserves the ground backscattering pattern. The study indicate that the the median method provided the most accurate representation of the true ground. To show the applicability of the GSP, a change detection algorithm was considered using the median ground scene as a reference image. As a result, the median method displayed the probability of detection of $97\%$ and a false alarm rate of 0.11/km$^2, when considering military vehicles concealed in a forest.

categories: eess.IV eess.SP physics.data-an stat.AP stat.ME


title: Chunk-aware Alignment and Lexical Constraint for Visual Entailment with Natural Language Explanations

abstract: Visual Entailment with natural language explanations aims to infer the relationship between a text-image pair and generate a sentence to explain the decision-making process. Previous methods rely mainly on a pre-trained vision-language model to perform the relation inference and a language model to generate the corresponding explanation. However, the pre-trained vision-language models mainly build token-level alignment between text and image yet ignore the high-level semantic alignment between the phrases (chunks) and visual contents, which is critical for vision-language reasoning. Moreover, the explanation generator based only on the encoded joint representation does not explicitly consider the critical decision-making points of relation inference. Thus the generated explanations are less faithful to visual-language reasoning. To mitigate these problems, we propose a unified Chunk-aware Alignment and Lexical Constraint based method, dubbed as CALeC. It contains a Chunk-aware Semantic Interactor (arr. CSI), a relation inferrer, and a Lexical Constraint-aware Generator (arr. LeCG). Specifically, CSI exploits the sentence structure inherent in language and various image regions to build chunk-aware semantic alignment. Relation inferrer uses an attention-based reasoning network to incorporate the token-level and chunk-level vision-language representations. LeCG utilizes lexical constraints to expressly incorporate the words or chunks focused by the relation inferrer into explanation generation, improving the faithfulness and informativeness of the explanations. We conduct extensive experiments on three datasets, and experimental results indicate that CALeC significantly outperforms other competitor models on inference accuracy and quality of generated explanations.


title: A Novel Rapid-flooding Approach with Real-time Delay Compensation for Wireless Sensor Network Time Synchronization

abstract: One-way-broadcast based flooding time synchronization algorithms are commonly used in wireless sensor networks (WSNs). However, the packet delay and clock drift pose challenges to accuracy, as they entail serious by-hop error accumulation problems in the WSNs. To overcome it, a rapid flooding multi-broadcast time synchronization with real-time delay compensation (RDC-RMTS) is proposed in this paper. By using a rapid-flooding protocol, flooding latency of the referenced time information is significantly reduced in the RDC-RMTS. In addition, a new joint clock skew-offset maximum likelihood estimation is developed to obtain the accurate clock parameter estimations, and the real-time packet delay estimation. Moreover, an innovative implementation of the RDC-RMTS is designed with an adaptive clock offset estimation. The experimental results indicate that, the RDC-RMTS can easily reduce the variable delay and significantly slow the growth of by-hop error accumulation. Thus, the proposed RDC-RMTS can achieve accurate time synchronization in large-scale complex WSNs.


title: A Deployable Online Optimization Framework for EV Smart Charging with Real-World Test Cases

abstract: We present a customizable online optimization framework for real-time EV smart charging to be readily implemented at real large-scale charging facilities. Notably, due to real-world constraints, we designed our framework around 3 main requirements. First, the smart charging strategy is readily deployable and customizable for a wide-array of facilities, infrastructure, objectives, and constraints. Second, the online optimization framework can be easily modified to operate with or without user input for energy request amounts and/or departure time estimates which allows our framework to be implemented on standard chargers with 1-way communication or newer chargers with 2-way communication. Third, our online optimization framework outperforms other real-time strategies (including first-come-first-serve, least-laxity-first, earliest-deadline-first, etc.) in multiple real-world test cases with various objectives. We showcase our framework with two real-world test cases with charging session data sourced from SLAC and Google campuses in the Bay Area.


title: Validation and Verification of Turbulence Mixing due to Richtmyer-Meshkov Instability of an air/SF$_6$ interface

abstract: Turbulent mixing due to hydrodynamic instabilities occurs in a wide range of science and engineering applications such as supernova explosions and inertial confinement fusion. The experimental, theoretical and numerical studies help us to understand the dynamics of hydrodynamically unstable interfaces between fluids in these important problems. In this paper, we present an increasingly accurate and robust front tracking method for the numerical simulations of Richtmyer-Meshkov Instability (RMI) to estimate the growth rate. The single-mode shock tube experiments of Collins and Jacobs 2002 for two incident shock strengths ($M=1.11$ and $M=1.21$) are used to validate the RMI simulations. The simulations based on the classical fifth order weighted essentially non-oscillatory (WENO) scheme of Jiang and Shu 1996 with Yang's artificial compression are compared with Collins and Jacobs 2002 shock tube experiments. We investigate the resolution effects using front tracking with WENO schemes on the two-dimensional RMI of an air/SF$_6$ interface. We achieve very good agreement on the early time interface displacement and amplitude growth rate between simulations and experiments for Mach number $M=1.11$. A 4% discrepancy on early-time amplitude is observed between the fine grid simulation and the $M=1.21$ experiments of Collins and Jacobs 2002.


title: A New Approach to Drifting Games, Based on Asymptotically Optimal Potentials

abstract: We develop a new approach to drifting games, a class of two-person games with many applications to boosting and online learning settings. Our approach involves (a) guessing an asymptotically optimal potential by solving an associated partial differential equation (PDE); then (b) justifying the guess, by proving upper and lower bounds on the final-time loss whose difference scales like a negative power of the number of time steps. The proofs of our potential-based upper bounds are elementary, using little more than Taylor expansion. The proofs of our potential-based lower bounds are also elementary, combining Taylor expansion with probabilistic or combinatorial arguments. Not only is our approach more elementary, but we give new potentials and derive corresponding upper and lower bounds that match each other in the asymptotic regime.


title: PS-NeRF: Neural Inverse Rendering for Multi-view Photometric Stereo

abstract: Traditional multi-view photometric stereo (MVPS) methods are often composed of multiple disjoint stages, resulting in noticeable accumulated errors. In this paper, we present a neural inverse rendering method for MVPS based on implicit representation. Given multi-view images of a non-Lambertian object illuminated by multiple unknown directional lights, our method jointly estimates the geometry, materials, and lights. Our method first employs multi-light images to estimate per-view surface normal maps, which are used to regularize the normals derived from the neural radiance field. It then jointly optimizes the surface normals, spatially-varying BRDFs, and lights based on a shadow-aware differentiable rendering layer. After optimization, the reconstructed object can be used for novel-view rendering, relighting, and material editing. Experiments on both synthetic and real datasets demonstrate that our method achieves far more accurate shape reconstruction than existing MVPS and neural rendering methods. Our code and model can be found at https://ywq.github.io/psnerf.


title: Big Memory Servers and Modern Approaches to Disk-Based Computation

abstract: The Big Memory solution is a new computing paradigm facilitated by commodity server platforms that are available today. It exposes a large RAM subsystem to the Operating System and therefore affords application programmers a number of previously unavailable options for data management. Additionally, certain vendor-specific solutions offer additional memory management options that will result in better data reliability and access speeds.


title: Halftoning with Multi-Agent Deep Reinforcement Learning

abstract: Deep neural networks have recently succeeded in digital halftoning using vanilla convolutional layers with high parallelism. However, existing deep methods fail to generate halftones with a satisfying blue-noise property and require complex training schemes. In this paper, we propose a halftoning method based on multi-agent deep reinforcement learning, called HALFTONERS, which learns a shared policy to generate high-quality halftone images. Specifically, we view the decision of each binary pixel value as an action of a virtual agent, whose policy is trained by a low-variance policy gradient. Moreover, the blue-noise property is achieved by a novel anisotropy suppressing loss function. Experiments show that our halftoning method produces high-quality halftones while staying relatively fast.


title: Computer Vision Aided mmWave Beam Alignment in V2X Communications

abstract: Visual information, captured for example by cameras, can effectively reflect the sizes and locations of the environmental scattering objects, and thereby can be used to infer communications parameters like propagation directions, receiver powers, as well as the blockage status. In this paper, we propose a novel beam alignment framework that leverages images taken by cameras installed at the mobile user. Specifically, we utilize 3D object detection techniques to extract the size and location information of the dynamic vehicles around the mobile user, and design a deep neural network (DNN) to infer the optimal beam pair for transceivers without any pilot signal overhead. Moreover, to avoid performing beam alignment too frequently or too slowly, a beam coherence time (BCT) prediction method is developed based on the vision information. This can effectively improve the transmission rate compared with the beam alignment approach with the fixed BCT. Simulation results show that the proposed vision based beam alignment methods outperform the existing LIDAR and vision based solutions, and demand for much lower hardware cost and communication overhead.


title: MN4 Embedded Graphene Layers: Tunable Decay Rate of RKKY Interaction

abstract: One of the most important tasks in the development of high-performance spintronic devices is the preparation of two dimensional (2D) magnetic layers with long-range exchange interactions. MN4 embedded graphene (MN4-G) layers, with M being transition metal elements, are experimentally accessible 2D layers, which exhibit interesting magnetic properties. In this paper, by employing the spin-polarized density functional theory (SP-DFT), we study MN4-G layers with a special focus on the behavior of the indirect M-M exchange interactions, and demonstrate that the MN4-Gs with M = Fe, Mn and Co, are 2D anisotropic magnetic layers with Ruderman-Kittel-Kasuya-Yosida (RKKY) interaction. By examining the electronic configurations of the M atoms for various M-M spacers, we demonstrate that the RKKY interaction in such layers are tunable and exhibiting an unusual prolonged decay (r to the power of minus n, n between 0.5 and 2). In addition, we investigate the influence of the CuN4 moiety in the graphene host, and show that, in contrary to the other MN4-Gs, the 2D CuN4-G layer behaves as decoupled one-dimensional spin chains, regardless of the spacer lengths.


title: Dynamics of NEMS Resonators across Dissipation Limits

abstract: The oscillatory dynamics of nanoelectromechanical systems (NEMS) is at the heart of many emerging applications in nanotechnology. For common NEMS, such as beams and strings, the oscillatory dynamics is formulated using a dissipationless wave equation derived from elasticity. Under a harmonic ansatz, the wave equation gives an undamped free vibration equation; solving this equation with the proper boundary conditions provides the undamped eigenfunctions with the familiar standing wave patterns. Any harmonically driven solution is expressible in terms of these undamped eigenfunctions. Here, we show that this formalism becomes inconvenient as dissipation increases. To this end, we experimentally map out the position- and frequency-dependent oscillatory motion of a NEMS string resonator driven linearly by a non-symmetric force on one end at different dissipation limits. At low dissipation (high Q factor), we observe sharp resonances with standing wave patterns that closely match the eigenfunctions of an undamped string. With a slight increase in dissipation, the standing wave patterns become lost and waves begin to propagate along the nanostructure. At large dissipation (low Q factor), these propagating waves become strongly attenuated and display little, if any, resemblance to the undamped string eigenfunctions. A more efficient and intuitive description of the oscillatory dynamics of a NEMS resonator can be obtained by superposition of waves propagating along the nanostructure.


title: Satellite Detection in Unresolved Space Imagery for Space Domain Awareness Using Neural Networks

abstract: This work utilizes a MobileNetV2 Convolutional Neural Network (CNN) for fast, mobile detection of satellites, and rejection of stars, in cluttered unresolved space imagery. First, a custom database is created using imagery from a synthetic satellite image program and labeled with bounding boxes over satellites for "satellite-positive" images. The CNN is then trained on this database and the inference is validated by checking the accuracy of the model on an external dataset constructed of real telescope imagery. In doing so, the trained CNN provides a method of rapid satellite identification for subsequent utilization in ground-based orbit estimation.


title: Detection and Initial Assessment of Lunar Landing Sites Using Neural Networks

abstract: Robotic and human lunar landings are a focus of future NASA missions. Precision landing capabilities are vital to guarantee the success of the mission, and the safety of the lander and crew. During the approach to the surface there are multiple challenges associated with Hazard Relative Navigation to ensure safe landings. This paper will focus on a passive autonomous hazard detection and avoidance sub-system to generate an initial assessment of possible landing regions for the guidance system. The system uses a single camera and the MobileNetV2 neural network architecture to detect and discern between safe landing sites and hazards such as rocks, shadows, and craters. Then a monocular structure from motion will recreate the surface to provide slope and roughness analysis.


title: Modeling and Analysis of a Coupled SIS Bi-Virus Model

abstract: The paper deals with the setting where two viruses (say virus 1 and virus 2) coexist in a population, and they are not necessarily mutually exclusive, in the sense that infection due to one virus does not preclude the possibility of simultaneous infection due to the other. We develop a coupled bi-virus susceptible-infected-susceptible (SIS) model from a 4n-state Markov chain model, where n is the number of agents (i.e., individuals or subpopulation) in the population. We identify a sufficient condition for both viruses to eventually die out, and a sufficient condition for the existence, uniqueness and asymptotic stability of the endemic equilibrium of each virus. We establish a sufficient condition and multiple necessary conditions for local exponential convergence to the boundary equilibrium (i.e., one virus persists, the other one dies out) of each virus. Under mild assumptions on the healing rate, we show that there cannot exist a coexisting equilibrium where for each node there is a nonzero fraction infected only by virus 1; a nonzero fraction infected only by virus 2; but no fraction that is infected by both viruses 1 and 2. Likewise, assuming that healing rates are strictly positive, a coexisting equilibrium where for each node there is a nonzero fraction infected by both viruses 1 and 2, but no fraction is infected only by virus 1 (resp. virus 2) does not exist. Further, we provide a necessary condition for the existence of certain other kinds of coexisting equilibria. We show that, unlike the competitive bivirus model, the coupled bivirus model is not monotone. Finally, we illustrate our theoretical findings using an extensive set of in-depth simulations.


title: Convergence in a Repeated Non-atomic Routing Game with Partial Signaling

abstract: We study the following repeated non-atomic routing game. In every round, nature chooses a state in an i.i.d. manner according to a publicly known distribution, which influences link latency functions. The system planner makes private route recommendations to participating agents, which constitute a fixed fraction, according to a publicly known signaling strategy. The participating agents choose between obeying or not obeying the recommendation according to cumulative regret of the participating agent population in the previous round. The non-participating agents choose route according to myopic best response to a calibrated forecast of the routing decisions of the participating agents. We show that, for parallel networks, if the planner's signal strategy satisfies the obedience condition, then, almost surely, the link flows are asymptotically consistent with the Bayes correlated equilibrium induced by the signaling strategy.


title: Data Adaptive Regularization for Abdominal Quantitative Susceptibility Mapping

abstract: Purpose: To improve repeatability and reproducibility across acquisition parameters and reduce bias in quantitative susceptibility mapping (QSM) of the liver, through development of an optimized regularized reconstruction algorithm for abdominal QSM. Theory and Methods: An optimized approach to estimation of magnetic susceptibility distribution is formulated as a constrained reconstruction problem that incorporates estimates of the input data reliability and anatomical priors available from chemical shift-encoded imaging. The proposed data-adaptive method was evaluated with respect to bias, repeatability, and reproducibility in a patient population with a wide range of liver iron concentration (LIC). The proposed method was compared to the state-of-the-art approach in liver QSM for two multi-echo SGRE protocols with different acquisition parameters at 3T. Results: The data-adaptive method produced susceptibility maps with higher subjective quality due to reduced shading artifacts. For both acquisition protocols, higher linear correlation with both $R_2$ and $R_2^*$-based measurements were observed for the data-adaptive method ($r^2=0.74/0.72$ for $R_2$, $0.98/0.99$ for $R_2^*$) than the standard method ($r^2=0.62/0.67$ and $0.84/0.91$). For both protocols, the data-adaptive method enabled better test-retest repeatability (repeatability coefficients 0.14/0.14ppm for the data-adaptive method, 0.26/0.31ppm for the standard method) and reproducibility across protocols (reproducibility coefficient 0.25ppm vs 0.36ppm) than the standard method. Conclusions: The proposed data-adaptive QSM algorithm may enable quantification of liver iron concentration with improved repeatability/reproducibility across different acquisition parameters as 3T.


title: Multiscale Neural Operator: Learning Fast and Grid-independent PDE Solvers

abstract: Numerical simulations in climate, chemistry, or astrophysics are computationally too expensive for uncertainty quantification or parameter-exploration at high-resolution. Reduced-order or surrogate models are multiple orders of magnitude faster, but traditional surrogates are inflexible or inaccurate and pure machine learning (ML)-based surrogates too data-hungry. We propose a hybrid, flexible surrogate model that exploits known physics for simulating large-scale dynamics and limits learning to the hard-to-model term, which is called parametrization or closure and captures the effect of fine- onto large-scale dynamics. Leveraging neural operators, we are the first to learn grid-independent, non-local, and flexible parametrizations. Our \textit{multiscale neural operator} is motivated by a rich literature in multiscale modeling, has quasilinear runtime complexity, is more accurate or flexible than state-of-the-art parametrizations and demonstrated on the chaotic equation multiscale Lorenz96.


title: Enhanced Curie temperature and skyrmion stability in room temperature ferromagnetic semiconductor CrISe monolayer

abstract: We report CrISe monolayer as a room temperature ferromagnetic semiconductor with the Curie temperature ($T_C$), magnetic anisotropy energy (MAE) and band gap being 322 K, 113 $\mu$eV and 0.67 eV, respectively. The $T_C$ and MAE can be further enhanced up to 385 K and 313 $\mu$eV by tensile strain. More interestingly, the magnetic easy axis can be switched between off-plane and in-plane by compressive strain. Particularly, due to the broken inversion symmetry and strong spin-orbit coupling of Se atoms, a large Dzyaloshinskii-Moriya interaction (DMI) of 2.40 meV is obtained. More importantly, by micromagnetic simulations, stable skyrmions with sub-10 nm radius are stabilized by the large DMI above room temperature in a wide range of strain from $-2\%$ to $6\%$. Our work demonstrates CrISe as a promising candidate for next-generation skyrmion-based information storage devices and provides guidance for the research of DMI and skyrmions in room temperature ferromagnetic semiconductors.


title: A study of Bishop operators from the point of view of linear dynamics

abstract: In this paper, we study the so-called Bishop operators $T _ \alpha$ on $L ^ p ([0, 1])$, with $\alpha \in (0, 1)$ and $1 < p < + \infty$, from the point of view of linear dynamics. We show that they are never hypercyclic nor supercyclic, and investigate extensions of these results to the case of weighted translation operators. We then investigate the cyclicity of the Bishop operators $T _ \alpha$. Building on results by Chalendar and Partington in the case where $\alpha$ is rational, we show that $T _ \alpha$ is cyclic for a dense $G _ \delta$-set of irrational $\alpha$'s, discuss cyclic functions and provide conditions in terms of convergents of $\alpha \in \mathbf R \backslash \mathbf Q$ implying that certain functions are cyclic.


title: Nonreciprocal Transport in Noncoplanar Magnetic Systems without Spin-Orbit Coupling, Net Scalar Chirality, or Magnetization

abstract: We propose a new mechanism of nonlinear nonreciprocal transport in magnetic systems. By considering a noncoplanar magnetic ordering on a bilayer triangular lattice, we clarify that a local scalar chirality degree of freedom is a source of nonreciprocal transport, which does not require any relativistic spin-orbit coupling, net scalar chirality, and net magnetization. We show a close relationship between the asymmetric band modulation and the nonreciprocal transport under the noncoplanar magnetic ordering based on the model-parameter dependences in the real-space picture.


title: Residual Entropy of Glasses and the Third Law Expression

abstract: The third law of thermodynamics dictates that the entropy of materials becomes zero as temperature ($T$) approaches zero. Contrarily, glass and other similar materials exhibit nonzero entropy at $T=0$, which contradicts the third law. For over a century, it has been a common practice to evade this problem by regarding glass as nonequilibrium. However, this treatment causes many inconsistencies in thermodynamics theory. This paper provides resolutions to these inconsistencies and provides a rigorous expression of the third law without any exception. To seek the entropy origin, the anthropomorphic feature of entropy must be resolved. Because entropy can be uniquely determined only when thermodynamic coordinates (TCs) are specified, we have to know which are TCs. This requires the reconsideration of the definition of equilibrium for solids in an unambiguous way, which does not depend on the solid structure. On this basis, it is deduced that TCs of solids are the equilibrium positions of atoms. TCs comprise a thermodynamic space, on which a unique value can be assigned to the entropy. For solids, equilibrium states are specified by discrete points in the thermodynamic space, which define atom configurations. Among various atom configurations, only one is thermally activated at sufficiently low temperatures, and others are called frozen configuration, which do not contribute to the temperature dependence of entropy in that region. The rigorous statement of the third law has been established by expressing that the entropy associated with the active configuration vanishes at $T=0$. Residual entropy arises when the entropy is evaluated on an extended space including the frozen configurations, which were previously active at high temperatures. The reconciliation of the two different views is explained through several debates on the glass transition.


title: McKean-Vlasov multivalued stochastic differential equations with oblique subgradients and related stochastic control problems

abstract: In this article, we prove the existence of weak solutions as well as the existence and uniqueness of strong solutions for McKean-Vlasov multivalued stochastic differential equations with oblique subgradients (MVMSDEswOS, for short) by means of the equations of Euler type and Skorohod's representation theorem. For this type of equation, compared with the method in [19,13], since we can't use the maximal monotony property of its constituent subdifferential operator, some different specific techniques are applied to solve our problems. Afterwards, we give an example for MVMSDEswOS with time-dependent convex constraints, which can be reduced to MVMSDEswOS. Finally, we consider an optimal control problem and establish the dynamic programming principle for the value function.


title: Invisible non-Hermitian potentials in discrete-time photonic quantum walks

abstract: Discrete-time photonic quantum walks on a synthetic lattice, where both spatial and temporal evolution of light is discretized, have provided recently a fascinating platform for the observation of a wealth of non-Hermitian physical phenomena and for the control of light scattering in complex media. A rather open question is whether invisible potentials, analogous to the ones known for continuous optical media, do exist in such discretized systems. Here it is shown that, under certain conditions, slowly-drifting Kramers-Kronig potentials behave as invisible potentials in discrete-time photonic quantum walks.


title: The existence of positive ground state solutions for the Choquard type equation on groups of polynomial growth

abstract: In this paper, let $G$ be a Cayley graph of a discrete group of polynomial growth with homogeneous dimension $N\geq3$. We study the Choquard type equation on $G$: \begin{equation} \Delta u+(R_{\alpha}\ast\mid u\mid^{p})\mid u\mid^{p-2}u=0, \end{equation} where $\alpha\in(0,N)$, $p>\frac{N+\alpha}{N-2}$ and $R_{\alpha}$ stands for the Green's function of the discrete fractional Laplace operator, which has same asymptotics as the Riesz potential. We prove the discrete Hardy-Littlewood-Sobolev inequality on such Cayley graphs, and by the discrete Concentration-Compactness principle we prove the existence of extremal functions for the corresponding Sobolev type inequalities in supercritical cases, which yields a positive ground state solution of the above Choquard type equation. Moreover, we obtain positive ground state solutions of Choquard type equations with $p$-Laplace, biharmonic and $p$-biharmonic operators etc.


title: A Dual Accelerated Method for Online Stochastic Distributed Averaging: From Consensus to Decentralized Policy Evaluation

abstract: Motivated by decentralized sensing and policy evaluation problems, we consider a particular type of distributed stochastic optimization problem over a network, called the online stochastic distributed averaging problem. We design a dual-based method for this distributed consensus problem with Polyak--Ruppert averaging and analyze its behavior. We show that the proposed algorithm attains an accelerated deterministic error depending optimally on the condition number of the network, and also that it has an order-optimal stochastic error. This improves on the guarantees of state-of-the-art distributed stochastic optimization algorithms when specialized to this setting, and yields -- among other things -- corollaries for decentralized policy evaluation. Our proofs rely on explicitly studying the evolution of several relevant linear systems, and may be of independent interest. Numerical experiments are provided, which validate our theoretical results and demonstrate that our approach outperforms existing methods in finite-sample scenarios on several natural network topologies.


title: On semilinear elliptic equation with negative exponent arising from a closed MEMS model

abstract: This paper is concerned with the elliptic equation $-\Delta u=\frac{\lambda }{(a-u)^p}$ in a connected, bounded $C^2$ domain $\Omega$ of $\mathbb{R}^N$ subject to zero Dirichlet boundary conditions, where $\lambda>0$, $N\geq 1$, $p>0$ and $a:\bar\Omega\to[0,1]$ vanishes at the boundary with the rate ${\rm dist}(x,\partial\Omega)^\gamma$ for $\gamma>0$. When $p=2$ and $N=2$, this equation models the closed Micro-Electromechanical Systems devices, where the elastic membrane sticks the curved ground plate on the boundary, but insulating on the boundary. The function $a$ shapes the curved ground plate. Our aim in this paper is to study qualitative properties of minimal solutions of this equation when $\lambda>0$, $p>0$ and to show how the boundary decaying of $a$ works on the minimal solutions and the pull-in voltage. Particularly, we give a complete analysis for the stability of the minimal solutions.


title: The FASER Detector

abstract: FASER, the ForwArd Search ExpeRiment, is an experiment dedicated to searching for light, extremely weakly-interacting particles at CERN's Large Hadron Collider (LHC). Such particles may be produced in the very forward direction of the LHC's high-energy collisions and then decay to visible particles inside the FASER detector, which is placed 480 m downstream of the ATLAS interaction point, aligned with the beam collisions axis. FASER also includes a sub-detector, FASER$\nu$, designed to detect neutrinos produced in the LHC collisions and to study their properties. In this paper, each component of the FASER detector is described in detail, as well as the installation of the experiment system and its commissioning using cosmic-rays collected in September 2021 and during the LHC pilot beam test carried out in October 2021. FASER will start taking LHC collision data in 2022, and will run throughout LHC Run 3.


title: MISO: Exploiting Multi-Instance GPU Capability on Multi-Tenant Systems for Machine Learning

abstract: GPU technology has been improving at an expedited pace in terms of size and performance, empowering HPC and AI/ML researchers to advance the scientific discovery process. However, this also leads to inefficient resource usage, as most GPU workloads, including complicated AI/ML models, are not able to utilize the GPU resources to their fullest extent -- encouraging support for GPU multi-tenancy. We propose MISO, a technique to exploit the Multi-Instance GPU (MIG) capability on the latest NVIDIA datacenter GPUs (e.g., A100, H100) to dynamically partition GPU resources among co-located jobs. MISO's key insight is to use the lightweight, more flexible Multi-Process Service (MPS) capability to predict the best MIG partition allocation for different jobs, without incurring the overhead of implementing them during exploration. Due to its ability to utilize GPU resources more efficiently, MISO achieves 49% and 16% lower average job completion time than the unpartitioned and optimal static GPU partition schemes, respectively.


title: Resolving degeneracies in Google search via quantum stochastic walks

abstract: The Internet is one of the most valuable technologies invented to date. Among them, Google is the most widely used search engine. The PageRank algorithm is the backbone of Google search, ranking web pages according to relevance and recency. We employ quantum stochastic walks (QSWs) to improve the classical PageRank (CPR) algorithm based on classical continuous time random walks. We implement QSW via two schemes: only incoherence and dephasing with incoherence. PageRank using QSW with only incoherence or QSW with dephasing and incoherence best resolves degeneracies that are unresolvable via CPR and with a convergence time comparable to that for CPR, which is generally the minimum. For some networks, the two QSW schemes obtain a convergence time lower than CPR and an almost degeneracy-free ranking compared to CPR.

categories: quant-ph cond-mat.dis-nn cs.SI cs.SY eess.SY physics.comp-ph


title: Rate-Splitting Multiple Access in Multi-cell Dense Networks: A Stochastic Geometry Approach

abstract: In this paper, the potential benefits of applying the Rate-Splitting Multiple Access (RSMA) in multi-cell dense networks are explored. Using tools of stochastic geometry, the sum-rate of RSMA-enhanced multi-cell dense networks is evaluated mathematically based on a Moment Generating Function (MGF) based framework to prove that RSMA is a general and powerful strategy for multi-antenna downlink systems. Further elaboration of the systematic performance metrics is undertaken by developing analytical expressions for area spectral efficiency and sum-rate in the RSMA-enhanced multi-cell dense networks. Based on the tractable expressions, we then offer an optimization framework for energy efficiency in terms of the number of antennas. Additionally, simulation results are shown to verify the accuracy of our analytical results and provide some insightful insights into system design. Analytically, it has been shown that: 1) the sum-rate of RSMA-enhanced multi-cell dense networks is significantly influenced by the power splitting ratio, and there is a unique value that maximizes the sum-rate; 2) the RSMA-enhanced multi-cell dense networks transmission scheme has superior sum-rate performance compared with Non-Orthogonal Multiple Access (NOMA) and Space-Division Multiple Access (SDMA) in a wide range of power splitting ratio; 3) By increasing the number of antennas and BS density in an RSMA-enhanced multi-cell dense network, the area spectral efficiency can be substantially enhanced; 4) As for energy efficiency, there exists an optimal antenna number for maximizing this performance metric.


title: Epersist: A Self Balancing Robot Using PID Controller And Deep Reinforcement Learning

abstract: A two-wheeled self-balancing robot is an example of an inverse pendulum and is an inherently non-linear, unstable system. The fundamental concept of the proposed framework "Epersist" is to overcome the challenge of counterbalancing an initially unstable system by delivering robust control mechanisms, Proportional Integral Derivative(PID), and Reinforcement Learning (RL). Moreover, the micro-controller NodeMCUESP32 and inertial sensor in the Epersist employ fewer computational procedures to give accurate instruction regarding the spin of wheels to the motor driver, which helps control the wheels and balance the robot. This framework also consists of the mathematical model of the PID controller and a novel self-trained advantage actor-critic algorithm as the RL agent. After several experiments, control variable calibrations are made as the benchmark values to attain the angle of static equilibrium. This "Epersist" framework proposes PID and RL-assisted functional prototypes and simulations for better utility.


title: Driver Dojo: A Benchmark for Generalizable Reinforcement Learning for Autonomous Driving

abstract: Reinforcement learning (RL) has shown to reach super human-level performance across a wide range of tasks. However, unlike supervised machine learning, learning strategies that generalize well to a wide range of situations remains one of the most challenging problems for real-world RL. Autonomous driving (AD) provides a multi-faceted experimental field, as it is necessary to learn the correct behavior over many variations of road layouts and large distributions of possible traffic situations, including individual driver personalities and hard-to-predict traffic events. In this paper we propose a challenging benchmark for generalizable RL for AD based on a configurable, flexible, and performant code base. Our benchmark uses a catalog of randomized scenario generators, including multiple mechanisms for road layout and traffic variations, different numerical and visual observation types, distinct action spaces, diverse vehicle models, and allows for use under static scenario definitions. In addition to purely algorithmic insights, our application-oriented benchmark also enables a better understanding of the impact of design decisions such as action and observation space on the generalizability of policies. Our benchmark aims to encourage researchers to propose solutions that are able to successfully generalize across scenarios, a task in which current RL methods fail. The code for the benchmark is available at https://github.com/seawee1/driver-dojo.


title: Enhancing Document-level Relation Extraction by Entity Knowledge Injection

abstract: Document-level relation extraction (RE) aims to identify the relations between entities throughout an entire document. It needs complex reasoning skills to synthesize various knowledge such as coreferences and commonsense. Large-scale knowledge graphs (KGs) contain a wealth of real-world facts, and can provide valuable knowledge to document-level RE. In this paper, we propose an entity knowledge injection framework to enhance current document-level RE models. Specifically, we introduce coreference distillation to inject coreference knowledge, endowing an RE model with the more general capability of coreference reasoning. We also employ representation reconciliation to inject factual knowledge and aggregate KG representations and document representations into a unified space. The experiments on two benchmark datasets validate the generalization of our entity knowledge injection framework and the consistent improvement to several document-level RE models.


title: RIBBON: Cost-Effective and QoS-Aware Deep Learning Model Inference using a Diverse Pool of Cloud Computing Instances

abstract: Deep learning model inference is a key service in many businesses and scientific discovery processes. This paper introduces RIBBON, a novel deep learning inference serving system that meets two competing objectives: quality-of-service (QoS) target and cost-effectiveness. The key idea behind RIBBON is to intelligently employ a diverse set of cloud computing instances (heterogeneous instances) to meet the QoS target and maximize cost savings. RIBBON devises a Bayesian Optimization-driven strategy that helps users build the optimal set of heterogeneous instances for their model inference service needs on cloud computing platforms -- and, RIBBON demonstrates its superiority over existing approaches of inference serving systems using homogeneous instance pools. RIBBON saves up to 16% of the inference service cost for different learning models including emerging deep learning recommender system models and drug-discovery enabling models.


title: Prime, composite and fundamental Kirchhoff graphs

abstract: A Kirchhoff graph is a vector graph with orthogonal cycles and vertex cuts. An algorithm has been developed that constructs all the Kirchhoff graphs up to a fixed edge multiplicity. This algorithm is used to explore the structure of prime Kirchhoff graph tilings. The existence of infinitely many prime Kirchhoff graphs given a set of fundamental Kirchhoff graphs is established, as is the existence of a minimal multiplicity for Kirchhoff graphs to exist.


title: Facing Changes: Continual Entity Alignment for Growing Knowledge Graphs

abstract: Entity alignment is a basic and vital technique in knowledge graph (KG) integration. Over the years, research on entity alignment has resided on the assumption that KGs are static, which neglects the nature of growth of real-world KGs. As KGs grow, previous alignment results face the need to be revisited while new entity alignment waits to be discovered. In this paper, we propose and dive into a realistic yet unexplored setting, referred to as continual entity alignment. To avoid retraining an entire model on the whole KGs whenever new entities and triples come, we present a continual alignment method for this task. It reconstructs an entity's representation based on entity adjacency, enabling it to generate embeddings for new entities quickly and inductively using their existing neighbors. It selects and replays partial pre-aligned entity pairs to train only parts of KGs while extracting trustworthy alignment for knowledge augmentation. As growing KGs inevitably contain non-matchable entities, different from previous works, the proposed method employs bidirectional nearest neighbor matching to find new entity alignment and update old alignment. Furthermore, we also construct new datasets by simulating the growth of multilingual DBpedia. Extensive experiments demonstrate that our continual alignment method is more effective than baselines based on retraining or inductive learning.


title: The prediction of the quality of results in Logic Synthesis using Transformer and Graph Neural Networks

abstract: In the logic synthesis stage, structure transformations in the synthesis tool need to be combined into optimization sequences and act on the circuit to meet the specified circuit area and delay. However, logic synthesis optimization sequences are time-consuming to run, and predicting the quality of the results (QoR) against the synthesis optimization sequence for a circuit can help engineers find a better optimization sequence faster. In this work, we propose a deep learning method to predict the QoR of unseen circuit-optimization sequences pairs. Specifically, the structure transformations are translated into vectors by embedding methods and advanced natural language processing (NLP) technology (Transformer) is used to extract the features of the optimization sequences. In addition, to enable the prediction process of the model to be generalized from circuit to circuit, the graph representation of the circuit is represented as an adjacency matrix and a feature matrix. Graph neural networks(GNN) are used to extract the structural features of the circuits. For this problem, the Transformer and three typical GNNs are used. Furthermore, the Transformer and GNNs are adopted as a joint learning policy for the QoR prediction of the unseen circuit-optimization sequences. The methods resulting from the combination of Transformer and GNNs are benchmarked. The experimental results show that the joint learning of Transformer and GraphSage gives the best results. The Mean Absolute Error (MAE) of the predicted result is 0.412.


title: Arbitrary Style Transfer with Structure Enhancement by Combining the Global and Local Loss

abstract: Arbitrary style transfer generates an artistic image which combines the structure of a content image and the artistic style of the artwork by using only one trained network. The image representation used in this method contains content structure representation and the style patterns representation, which is usually the features representation of high-level in the pre-trained classification networks. However, the traditional classification networks were designed for classification which usually focus on high-level features and ignore other features. As the result, the stylized images distribute style elements evenly throughout the image and make the overall image structure unrecognizable. To solve this problem, we introduce a novel arbitrary style transfer method with structure enhancement by combining the global and local loss. The local structure details are represented by Lapstyle and the global structure is controlled by the image depth. Experimental results demonstrate that our method can generate higher-quality images with impressive visual effects on several common datasets, comparing with other state-of-the-art methods.


title: A Taxonomy of Recurrent Learning Rules

abstract: Backpropagation through time (BPTT) is the de facto standard for training recurrent neural networks (RNNs), but it is non-causal and non-local. Real-time recurrent learning is a causal alternative, but it is highly inefficient. Recently, e-prop was proposed as a causal, local, and efficient practical alternative to these algorithms, providing an approximation of the exact gradient by radically pruning the recurrent dependencies carried over time. Here, we derive RTRL from BPTT using a detailed notation bringing intuition and clarification to how they are connected. Furthermore, we frame e-prop within in the picture, formalising what it approximates. Finally, we derive a family of algorithms of which e-prop is a special case.


title: The horizontal profile of the atmospheric electric fields as measured during thunderstorms by the network of NaI spectrometers located on the slopes of Mt. Aragats

abstract: In the present report, we describe the NaI particle detector network and present the first results of the experiment demonstrating that the particle fluxes from the atmospheric electron accelerators can cover large areas on the earth surface.


title: Meta Spatio-Temporal Debiasing for Video Scene Graph Generation

abstract: Video scene graph generation (VidSGG) aims to parse the video content into scene graphs, which involves modeling the spatio-temporal contextual information in the video. However, due to the long-tailed training data in datasets, the generalization performance of existing VidSGG models can be affected by the spatio-temporal conditional bias problem. In this work, from the perspective of meta-learning, we propose a novel Meta Video Scene Graph Generation (MVSGG) framework to address such a bias problem. Specifically, to handle various types of spatio-temporal conditional biases, our framework first constructs a support set and a group of query sets from the training data, where the data distribution of each query set is different from that of the support set w.r.t. a type of conditional bias. Then, by performing a novel meta training and testing process to optimize the model to obtain good testing performance on these query sets after training on the support set, our framework can effectively guide the model to learn to well generalize against biases. Extensive experiments demonstrate the efficacy of our proposed framework.


title: $\mu\text{KG}$: A Library for Multi-source Knowledge Graph Embeddings and Applications

abstract: This paper presents $\mu\text{KG}$, an open-source Python library for representation learning over knowledge graphs. $\mu\text{KG}$ supports joint representation learning over multi-source knowledge graphs (and also a single knowledge graph), multiple deep learning libraries (PyTorch and TensorFlow2), multiple embedding tasks (link prediction, entity alignment, entity typing, and multi-source link prediction), and multiple parallel computing modes (multi-process and multi-GPU computing). It currently implements 26 popular knowledge graph embedding models and supports 16 benchmark datasets. $\mu\text{KG}$ provides advanced implementations of embedding techniques with simplified pipelines of different tasks. It also comes with high-quality documentation for ease of use. $\mu\text{KG}$ is more comprehensive than existing knowledge graph embedding libraries. It is useful for a thorough comparison and analysis of various embedding models and tasks. We show that the jointly learned embeddings can greatly help knowledge-powered downstream tasks, such as multi-hop knowledge graph question answering. We will stay abreast of the latest developments in the related fields and incorporate them into $\mu\text{KG}$.


title: Cohomology, superderivations, and abelian extensions of $3$-Lie superalgebras

abstract: The main object of study of this paper is the notion of 3-Lie superalgebras with superderivations. We consider a representation $(\Phi,\mathcal{P})$ of a $3$-Lie superalgebra $\mathcal{Q}$ on $\mathcal{P}$ and construct first-order cohomologies by using superderivations of $\mathcal{P},\mathcal{Q}$ which induces a Lie superalgebra $\mathcal{T}_{\Phi}$ and its representation $\Psi$. Then we consider abelian extensions of $3$-Lie superalgebras of the form $0\rightarrow \mathcal{P}\hookrightarrow \mathcal{L}\rightarrow \mathcal{Q}\rightarrow 0$ with $[\mathcal{P},\mathcal{P},\mathcal{L}]=0$ and construct an obstruction class to extensibility of a compatible pair of superderivation. Moreover we prove that a pair of superderivation is extensible if and only if its obstruction class is trivial under some suitable conditions.


title: Finite-Blocklength RIS-Aided Transmit Beamforming

abstract: This paper considers the downlink of an ultra-reliable low-latency communication (URLLC) system in which a base station (BS) serves multiple single-antenna users in the short (finite) blocklength (FBL) regime with the assistance of a reconfigurable intelligent surface (RIS). In the FBL regime, the users' achievable rates are complex functions of the beamforming vectors and of the RIS's programmable reflecting elements (PREs). We propose the joint design of the transmit beamformers and PREs, the problem of maximizing the geometric mean (GM) of these rates (GM-rate) and show that this aforementioned results are providing fair rate distribution and thus reliable links to all users. A novel computational algorithm is developed, which is based on closed forms to generate improved feasible points, using its execution. The simulations show the merit of our solution.


title: Detecting capable pairs of some nilpotent Lie superalgebras

abstract: In this article, we define the capable pairs of Lie superalgebras. We classify all capable pairs of abelian and Heisenberg Lie superalgebras. After that we discuss on pairs of Lie superalgebras with derived subalgebra of dimension one and a non-abelian ideal. Finally, we determine the structure of the Schur multiplier of pairs of Heisenberg Lie superalgebras.


title: BuyTheDips: PathLoss for improved topology-preserving deep learning-based image segmentation

abstract: Capturing the global topology of an image is essential for proposing an accurate segmentation of its domain. However, most of existing segmentation methods do not preserve the initial topology of the given input, which is detrimental for numerous downstream object-based tasks. This is all the more true for deep learning models which most work at local scales. In this paper, we propose a new topology-preserving deep image segmentation method which relies on a new leakage loss: the Pathloss. Our method is an extension of the BALoss [1], in which we want to improve the leakage detection for better recovering the closeness property of the image segmentation. This loss allows us to correctly localize and fix the critical points (a leakage in the boundaries) that could occur in the predictions, and is based on a shortest-path search algorithm. This way, loss minimization enforces connectivity only where it is necessary and finally provides a good localization of the boundaries of the objects in the image. Moreover, according to our research, our Pathloss learns to preserve stronger elongated structure compared to methods without using topology-preserving loss. Training with our topological loss function, our method outperforms state-of-the-art topology-aware methods on two representative datasets of different natures: Electron Microscopy and Historical Map.


title: Handling Data Heterogeneity in Federated Learning via Knowledge Distillation and Fusion

abstract: Federated learning (FL) supports distributed training of a global machine learning model across multiple devices with the help of a central server. However, data heterogeneity across different devices leads to the client model drift issue and results in model performance degradation and poor model fairness. To address the issue, we design Federated learning with global-local Knowledge Fusion (FedKF) scheme in this paper. The key idea in FedKF is to let the server return the global knowledge to be fused with the local knowledge in each training round so that the local model can be regularized towards the global optima. Therefore, the client model drift issue can be mitigated. In FedKF, we first propose the active-inactive model aggregation technique that supports a precise global knowledge representation. Then, we propose a data-free knowledge distillation (KD) approach to enable each client model to learn the global knowledge (embedded in the global model) while each client model can still learn the local knowledge (embedded in the local dataset) simultaneously, thereby realizing the global-local knowledge fusion process. The theoretical analysis and intensive experiments demonstrate the superiority of FedKF over previous solutions.


title: Airfoil Optimization using Design-by-Morphing

abstract: We present Design-by-Morphing (DbM), a novel design methodology applicable to creating a search space for topology optimization of 2D airfoils. Most design techniques impose geometric constraints and sometimes designers' bias on the design space itself, thus restricting the novelty of the designs created, and only allowing for small local changes. We show that DbM methodology does not impose any such restrictions on the design space and allows for extrapolation from the search space, thus granting truly radical and large search space with a few design parameters. In comparison to other shape design methodologies, we apply DbM to create a search space for 2D airfoils. We optimize this airfoil shape design space for maximizing the lift-over-drag ratio, $CLD_{max}$, and stall angle tolerance, $\Delta \alpha$. Using a bi-objective genetic algorithm to optimize the DbM space, it is found that we create a Pareto-front of radical airfoils exhibiting remarkable properties for both objectives.


title: Generating quantum feature maps for SVM classifier

abstract: We present and compare two methods of generating quantum feature maps for quantum-enhanced support vector machine, a classifier based on kernel method, by which we can access high dimensional Hilbert space efficiently. The first method is a genetic algorithm with multi-objective fitness function using penalty method, which incorporates maximizing the accuracy of classification and minimizing the gate cost of quantum feature map circuit. The second method uses variational quantum circuit, focusing on how to contruct the ansatz based on unitary matrix decomposition. Numerical results and comparisons are presented to demonstrate how the fitness fuction reduces gate cost while remaining high accuracy and conducting circuit through unitary matrix obtains even better performance. In particular, we propose some thoughts on reducing and optimizing the gate cost of a circuit while remaining perfect accuracy.


title: Investigating $S$-wave bound states composed of two pseudoscalar mesons

abstract: In this work, we systematically investigate the two-pseudoscalar meson systems with the Bethe-Salpeter equation in the ladder and instantaneous approximations. By solving the Bethe-Salpeter equation numerically with the kernel containing the one-particle exchange diagrams, we find that the $K\bar{K}$, $DK$, $B\bar{K}$, $D\bar{D}$, $B\bar{B}$, $BD$, $D\bar{K}$, $BK$, and $B\bar{D}$ systems with $I=0$ can exist as bound states. We also study the contributions from heavy meson ($J/\psi$ and $\Upsilon$) exchanges, and we find that the contribution from heavy meson exchange can not be ignored.


title: Optimization of the Shape of a Hydrokinetic Turbine's Draft Tube and Hub Assembly Using Design-by-Morphing with Bayesian Optimization

abstract: Finding the optimal design of a hydrodynamic or aerodynamic surface is often impossible due to the expense of evaluating the cost functions (say, with computational fluid dynamics) needed to determine the performances of the flows that the surface controls. In addition, inherent limitations of the design space itself due to imposed geometric constraints, conventional parameterization methods, and user bias can restrict {\it all} of the designs within a chosen design space regardless of whether traditional optimization methods or newer, data-driven design algorithms with machine learning are used to search the design space. We present a 2-pronged attack to address these difficulties: we propose (1) a methodology to create the design space using morphing that we call {\it Design-by-Morphing} (DbM); and (2) an optimization algorithm to search that space that uses a novel Bayesian Optimization (BO) strategy that we call {\it Mixed variable, Multi-Objective Bayesian Optimization} (MixMOBO). We apply this shape optimization strategy to maximize the power output of a hydrokinetic turbine. Applying these two strategies in tandem, we demonstrate that we can create a novel, geometrically-unconstrained, design space of a draft tube and hub shape and then optimize them simultaneously with a {\it minimum} number of cost function calls. Our framework is versatile and can be applied to the shape optimization of a variety of fluid problems.


title: Platial mobility: expanding place and mobility in GIS via platio-temporal representations and the mobilities paradigm

abstract: While platial representations are being developed for sedentary entities, a parallel and useful endeavour would be to consider time in so-called "platio-temporal" representations that would also expand notions of mobility in GIScience, that are solely dependent on Euclidean space and time. Besides enhancing such aspects of place and mobility via spatio-temporal, we also include human aspects of these representations via considerations of the sociological notions of mobility via the mobilities paradigm that can systematically introduce representation of both platial information along with mobilities associated with 'moving places.' We condense these aspects into 'platial mobility,' a novel conceptual framework, as an integration in GIScience and the mobilities paradigm in sociology, that denotes movement of places in our platio-temporal and sociology-based representations. As illustrative cases for further study using platial mobility as a framework, we explore its benefits and methodological aspects toward developing better understanding for disaster management, disaster risk reduction and pandemics. We then discuss some of the illustrative use cases to clarify the concept of platial mobility and its application prospects in the areas of disaster management, disaster risk reduction and pandemics. These use cases, which include flood events and the ongoing COVID-19 pandemic, have led to displaced and restricted communities having to change practices and places, which would be particularly amenable to the conceptual framework developed in our work.


title: Novel Improvement for Nonlinear Compatibility of Least Mean Square Adaptive Algorithm

abstract: In order to improve the least mean squares (LMS) adaptation algorithm to accommodate the nonlinear transfer function, and to adjust the coefficients of adaptive filter during the actual implement of bias voltage and signal amplitude, methods are proposed and simulated to develop a nonlinear adaptive filter. The inputs to LMS are replaced by the derivatives of traditional inputs, and the step for each training iteration is adaptively controlled by the difference between target signal and actual signal. The simulation utilizes the implementation of Nyquist pulses optical sampling and works as a digital signal processing pre-compensation to reduce influence of the frequency responses on wires and devices. The simulation result shows promising improvement with the modified adaptation algorithm method in tackling Mach Zehnder modulator's non-monotonic transfer function.


title: Cosmic acceleration and ekpyrotic bounce with Chameleon field

abstract: In this article, we explore the homogeneous and isotropic flat Friedmann-Robertson-Walker (FRW) model in Chameleon cosmology. By considering a non-minimal coupling between the scalar field and matter, we present a non-singular bouncing cosmological scenario of the universe. The universe initially exhibits the ekpyrotic phase during the contracting era, undergoes a non-singular bounce, and then in expanding era, it smoothly transits to the decelerating era having matter and radiation dominated phases. Further, this decelerating era is smoothly connected to the late-time dark energy-dominated era of the present epoch. We use numerical solution techniques to solve non-minimally coupled gravity equations for understanding the evolution of scalar field along with other quantities like effective potential in the model. The model thus unifies an ekpyrotic, non-singular, asymmetric bounce with the dark energy era of the present epoch. We study the evolution of bouncing model and confront the model with observational results on the equation of state parameter by constraining the model parameters.


title: UC-OWOD: Unknown-Classified Open World Object Detection

abstract: Open World Object Detection (OWOD) is a challenging computer vision problem that requires detecting unknown objects and gradually learning the identified unknown classes. However, it cannot distinguish unknown instances as multiple unknown classes. In this work, we propose a novel OWOD problem called Unknown-Classified Open World Object Detection (UC-OWOD). UC-OWOD aims to detect unknown instances and classify them into different unknown classes. Besides, we formulate the problem and devise a two-stage object detector to solve UC-OWOD. First, unknown label-aware proposal and unknown-discriminative classification head are used to detect known and unknown objects. Then, similarity-based unknown classification and unknown clustering refinement modules are constructed to distinguish multiple unknown classes. Moreover, two novel evaluation protocols are designed to evaluate unknown-class detection. Abundant experiments and visualizations prove the effectiveness of the proposed method. Code is available at https://github.com/JohnWuzh/UC-OWOD.


title: Accelerating Vertical Federated Learning

abstract: Privacy, security and data governance constraints rule out a brute force process in the integration of cross-silo data, which inherits the development of the Internet of Things. Federated learning is proposed to ensure that all parties can collaboratively complete the training task while the data is not out of the local. Vertical federated learning is a specialization of federated learning for distributed features. To preserve privacy, homomorphic encryption is applied to enable encrypted operations without decryption. Nevertheless, together with a robust security guarantee, homomorphic encryption brings extra communication and computation overhead. In this paper, we analyze the current bottlenecks of vertical federated learning under homomorphic encryption comprehensively and numerically. We propose a straggler-resilient and computation-efficient accelerating system that reduces the communication overhead in heterogeneous scenarios by 65.26% at most and reduces the computation overhead caused by homomorphic encryption by 40.66% at most. Our system can improve the robustness and efficiency of the current vertical federated learning framework without loss of security.


title: Marginal Bayesian Statistics Using Masked Autoregressive Flows and Kernel Density Estimators with Examples in Cosmology

abstract: Cosmological experiments often employ Bayesian workflows to derive constraints on cosmological and astrophysical parameters from their data. It has been shown that these constraints can be combined across different probes such as Planck and the Dark Energy Survey and that this can be a valuable exercise to improve our understanding of the universe and quantify tension between multiple experiments. However, these experiments are typically plagued by differing systematics, instrumental effects and contaminating signals, which we collectively refer to as `nuisance' components, that have to be modelled alongside target signals of interest. This leads to high dimensional parameter spaces, especially when combining data sets, with > 20 dimensions of which only around 5 correspond to key physical quantities. We present a means by which to combine constraints from different data sets in a computationally efficient manner by generating rapid, reusable and reliable marginal probability density estimators, giving us access to nuisance-free likelihoods. This is possible through the unique combination of nested sampling, which gives us access to Bayesian evidences, and the marginal Bayesian statistics code MARGARINE. Our method is lossless in the signal parameters, resulting in the same posterior distributions as would be found from a full nested sampling run over all nuisance parameters, and typically quicker than evaluating full likelihoods. We demonstrate our approach by applying it to the combination of posteriors from the Dark Energy Survey and Planck.


title: Multi-User Rate Splitting in Optical Wireless Networks

abstract: Optical wireless communication (OWC) has recently received massive interest as a new technology that can support the enormous data traffic increasing on daily basis. Laser-based OWC networks can provide terabits per second (Tbps) aggregate data rates. However, the emerging OWC networks require clusters of optical transmitters to provide uniform coverage for multiple users. In this context, multi-user interference (MUI) is a crucial issue that must be managed efficiently to provide high spectral efficiency. Rate splitting (RS) is proposed as a transmission scheme to serve multiple users simultaneously by splitting the message of a given user into common and private messages, and then, each user decodes the desired message following a certain procedure. In radio frequency (RF) networks, RS provides higher spectral efficiency compared with orthogonal and non-orthogonal transmission schemes. Considering the high density of OWC networks, the performance of RS is limited by the cost of providing channel state information (CSI) at transmitters and by the noise resulting from interference cancellation. In this work, a user-grouping algorithm is proposed and used to form multiple groups, each group contains users spatially clustered. Then, an outer precoder is designed to manage inter-group interference following the methodology of blind interference alignment (BIA), which reduces the requirements of CSI at RF or optical transmitters. For intra-group interference, RS is applied within each group where the users belonging to a given group receive a unique common message on which their private messages are superimposed. Furthermore, an optimization problem is formulated to allocate the power among the private messages intended to all users such that the sum rate of the network is maximized.


title: Capacity of Entanglement for Non-local Hamiltonian

abstract: The notion of capacity of entanglement is the quantum information theoretic counterpart of the heat capacity which is defined as the second cumulant of the entanglement spectrum. Given any bipartite pure state, we can define the capacity of entanglement as the variance of the modular Hamiltonian in the reduced state of any of the subsystems. Here, we study the dynamics of this quantity under non-local Hamiltonian. Specifically, we address the question: Given an arbitrary non-local Hamiltonian what is the capacity of entanglement that the system can possess? As an useful application, we show that the quantum speed limit for creating the entanglement is not only governed by the fluctuation in the non-local Hamiltonian, but also depends inversely on the time average of square root of the capacity of entanglement. Furthermore, we discuss this quantity for a general self-inverse Hamiltonian and provide a bound on the rate of the capacity of entanglement. Towards the end, we generalise the capacity of entanglement for bipartite mixed states based on the relative entropy of entanglement and show that the above definition reduces to the capacity of entanglement for pure bipartite states. Our results can have several applications in diverse areas of physics.


title: Practical Perspectives on Symplectic Accelerated Optimization

abstract: Geometric numerical integration has recently been exploited to design symplectic accelerated optimization algorithms by simulating the Lagrangian and Hamiltonian systems from the variational framework introduced in Wibisono et al. In this paper, we discuss practical considerations which can significantly boost the computational performance of these optimization algorithms, and considerably simplify the tuning process. In particular, we investigate how momentum restarting schemes ameliorate computational efficiency and robustness by reducing the undesirable effect of oscillations, and ease the tuning process by making time-adaptivity superfluous. We also discuss how temporal looping helps avoiding instability issues caused by numerical precision, without harming the computational efficiency of the algorithms. Finally, we compare the efficiency and robustness of different geometric integration techniques, and study the effects of the different parameters in the algorithms to inform and simplify tuning in practice. From this paper emerge symplectic accelerated optimization algorithms whose computational efficiency, stability and robustness have been improved, and which are now much simpler to use and tune for practical applications.


title: Electronic origin of x-ray absorption peak shifts

abstract: Encoded in the transient x-ray absorption (XAS) and magnetic circular (MCD) response functions resides a wealth of information of the microscopic processes of ultrafast demagnetisation. Employing state of the art first principles dynamical simulations we show that the experimentally observed energy shift of the L3 XAS peak in Ni, and the absence of a corresponding shift in the dichroic MCD response, can be explained in terms of laser induced changes in band occupation. Strikingly, we predict that for the same ultrashort pump pulse applied to Co the opposite effect will occur: a substantial shift upwards in energy of the MCD peaks will be accompanied by very small change in the position of XAS peaks, a fact we relate to the reduced $d$-band filling of Co that allows a greater energetic range above the Fermi energy into which charge can be excited. We also carefully elucidate the dependence of this effect on pump pulse parameters. These findings (i) establish a electronic origin for early time peak shifts in transient XAS and MCD spectroscopy and (ii) illustrate the rich information that may be extracted from transient response functions of the underlying dynamical system.


title: Saturating the one-axis twisting quantum Cram\'{e}r-Rao bound with a total spin readout

abstract: We show that the lowest quantum Cram\'{e}r-Rao bound achievable in interferometry with a one-axis twisted spin coherent state is saturated by the asymptotic method of moments error of a protocol that uses one call to the one-axis twisting, one call to time-reversed one-axis twisting, and a final total spin measurement (i.e., a twist-untwist protocol). The result is derived by first showing that the metrological phase diagram for one-axis twisting is asymptotically characterized by a single quantum Fisher information value $N(N+1)/2$ for all times, then constructing a twist-untwist protocol having a method of moments error that saturates this value. The case of finite-range one-axis twisting is similarly analyzed, and a simple functional form for the metrological phase diagram is found in both the short-range and long-range interaction regimes. Numerical evidence suggests that the finite-range analogues of twist-untwist protocols can exhibit a method of moments error that asymptotically saturates the lowest quantum Cram\'{e}r-Rao bound achievable in interferometry with finite-range one-axis twisted spin coherent states for all interaction times.


title: When Counting Meets HMER: Counting-Aware Network for Handwritten Mathematical Expression Recognition

abstract: Recently, most handwritten mathematical expression recognition (HMER) methods adopt the encoder-decoder networks, which directly predict the markup sequences from formula images with the attention mechanism. However, such methods may fail to accurately read formulas with complicated structure or generate long markup sequences, as the attention results are often inaccurate due to the large variance of writing styles or spatial layouts. To alleviate this problem, we propose an unconventional network for HMER named Counting-Aware Network (CAN), which jointly optimizes two tasks: HMER and symbol counting. Specifically, we design a weakly-supervised counting module that can predict the number of each symbol class without the symbol-level position annotations, and then plug it into a typical attention-based encoder-decoder model for HMER. Experiments on the benchmark datasets for HMER validate that both joint optimization and counting results are beneficial for correcting the prediction errors of encoder-decoder models, and CAN consistently outperforms the state-of-the-art methods. In particular, compared with an encoder-decoder model for HMER, the extra time cost caused by the proposed counting module is marginal. The source code is available at https://github.com/LBH1024/CAN.


title: Learning Object Placement via Dual-path Graph Completion

abstract: Object placement aims to place a foreground object over a background image with a suitable location and size. In this work, we treat object placement as a graph completion problem and propose a novel graph completion module (GCM). The background scene is represented by a graph with multiple nodes at different spatial locations with various receptive fields. The foreground object is encoded as a special node that should be inserted at a reasonable place in this graph. We also design a dual-path framework upon the structure of GCM to fully exploit annotated composite images. With extensive experiments on OPA dataset, our method proves to significantly outperform existing methods in generating plausible object placement without loss of diversity.