title: Styleverse: Towards Identity Stylization across Heterogeneous Domains

abstract: We propose a new challenging task namely IDentity Stylization (IDS) across heterogeneous domains. IDS focuses on stylizing the content identity, rather than completely swapping it using the reference identity. We use an effective heterogeneous-network-based framework $Styleverse$ that uses a single domain-aware generator to exploit the Metaverse of diverse heterogeneous faces, based on the proposed dataset FS13 with limited data. FS13 means 13 kinds of Face Styles considering diverse lighting conditions, art representations and life dimensions. Previous similar tasks, \eg, image style transfer can handle textural style transfer based on a reference image. This task usually ignores the high structure-aware facial area and high-fidelity preservation of the content. However, Styleverse intends to controllably create topology-aware faces in the Parallel Style Universe, where the source facial identity is adaptively styled via AdaIN guided by the domain-aware and reference-aware style embeddings from heterogeneous pretrained models. We first establish the IDS quantitative benchmark as well as the qualitative Styleverse matrix. Extensive experiments demonstrate that Styleverse achieves higher-fidelity identity stylization compared with other state-of-the-art methods.


title: SEA: Bridging the Gap Between One- and Two-stage Detector Distillation via SEmantic-aware Alignment

abstract: We revisit the one- and two-stage detector distillation tasks and present a simple and efficient semantic-aware framework to fill the gap between them. We address the pixel-level imbalance problem by designing the category anchor to produce a representative pattern for each category and regularize the topological distance between pixels and category anchors to further tighten their semantic bonds. We name our method SEA (SEmantic-aware Alignment) distillation given the nature of abstracting dense fine-grained information by semantic reliance to well facilitate distillation efficacy. SEA is well adapted to either detection pipeline and achieves new state-of-the-art results on the challenging COCO object detection task on both one- and two-stage detectors. Its superior performance on instance segmentation further manifests the generalization ability. Both 2x-distilled RetinaNet and FCOS with ResNet50-FPN outperform their corresponding 3x ResNet101-FPN teacher, arriving 40.64 and 43.06 AP, respectively. Code will be made publicly available.


title: A Unifying Framework for Some Directed Distances in Statistics

abstract: Density-based directed distances -- particularly known as divergences -- between probability distributions are widely used in statistics as well as in the adjacent research fields of information theory, artificial intelligence and machine learning. Prominent examples are the Kullback-Leibler information distance (relative entropy) which e.g. is closely connected to the omnipresent maximum likelihood estimation method, and Pearson's chisquare-distance which e.g. is used for the celebrated chisquare goodness-of-fit test. Another line of statistical inference is built upon distribution-function-based divergences such as e.g. the prominent (weighted versions of) Cramer-von Mises test statistics respectively Anderson-Darling test statistics which are frequently applied for goodness-of-fit investigations; some more recent methods deal with (other kinds of) cumulative paired divergences and closely related concepts. In this paper, we provide a general framework which covers in particular both the above-mentioned density-based and distribution-function-based divergence approaches; the dissimilarity of quantiles respectively of other statistical functionals will be included as well. From this framework, we structurally extract numerous classical and also state-of-the-art (including new) procedures. Furthermore, we deduce new concepts of dependence between random variables, as alternatives to the celebrated mutual information. Some variational representations are discussed, too.

categories: math.ST cs.IT math.IT math.PR stat.ML stat.TH


title: An Onsager-Machlup approach to the most probable transition pathway for a genetic regulatory network

abstract: We investigate a quantitative network of gene expression dynamics describing the competence development in Bacillus subtilis. First, we introduce an Onsager-Machlup approach to quantify the most probable transition pathway for both excitable and bistable dynamics. Then, we apply a machine learning method to calculate the most probable transition pathway via the Euler-Lagrangian equation. Finally, we analyze how the noise intensity affects the transition phenomena.


title: Beyond Virtual Bazaar: How Social Commerce Promotes Inclusivity for the Traditionally Underserved Community in Chinese Developing Regions

abstract: The disadvantaged population is often underserved and marginalized in technology engagement: prior works show they are generally more reluctant and experience more barriers in adopting and engaging with mainstream technology. Here, we contribute to the HCI4D and ICTD literature through a novel "counter" case study on Chinese social commerce (e.g., Pinduoduo), which 1) first prospers among the traditionally underserved community from developing regions ahead of the more technologically advantaged communities, and 2) has been heavily engaged by this community. Through 12 in-depth interviews with social commerce users from the traditionally underserved community in Chinese developing regions, we demonstrate how social commerce, acting as a "counter", brings online the traditional offline socioeconomic lives the community has lived for ages, fits into the community's social, cultural, and economic context, and thus effectively promotes technology inclusivity. Our work provides novel insights and implications for building inclusive technology for the "next billion" population.


title: Proper usage of Scherrer's and Guinier's formulas in X-ray analysis of size distribution in systems of monocrystalline CeO2 nanoparticles

abstract: Small-angle X-ray scattering (SAXS) and X-ray diffraction (XRD) techniques are widely used as analytical tools in the optimization and control of nanomaterial synthesis processes. In crystalline nanoparticle systems with size distribution, the discrepant size values determined by using SAXS and XRD still lacks a well-established description in quantitative terms. To address fundamental questions, the isolated effect of size distribution is investigated by SAXS and XRD simulation in polydisperse systems of virtual nanoparticles. It quantitatively answered a few questions, among which the most accessible and reliable size values and what they stand for regarding the size distribution parameters. When a finite size distribution is introduced, the two techniques produce differing results even in perfectly crystalline nanoparticles. Once understood, the deviation in resulting size values can, in principle, resolve two parameters size distributions of crystalline nanoparticles. To demonstrate data analysis procedures in light of this understanding, XRD and SAXS experiments were carried out on a series of powder samples of cubic ceria nanoparticles. Besides changes in the size distribution related to the synthesis parameters, proper comparison of XRD and SAXS results revealed particle-particle interaction effects underneath the SAXS intensity curves. It paves the way for accurate and reliable methodologies to assess size, size dispersion, and degree of crystallinity in synthesized nanoparticles.


title: Incremental Transformer Structure Enhanced Image Inpainting with Masking Positional Encoding

abstract: Image inpainting has made significant advances in recent years. However, it is still challenging to recover corrupted images with both vivid textures and reasonable structures. Some specific methods only tackle regular textures while losing holistic structures due to the limited receptive fields of convolutional neural networks (CNNs). On the other hand, attention-based models can learn better long-range dependency for the structure recovery, but they are limited by the heavy computation for inference with large image sizes. To address these issues, we propose to leverage an additional structure restorer to facilitate the image inpainting incrementally. The proposed model restores holistic image structures with a powerful attention-based transformer model in a fixed low-resolution sketch space. Such a grayscale space is easy to be upsampled to larger scales to convey correct structural information. Our structure restorer can be integrated with other pretrained inpainting models efficiently with the zero-initialized residual addition. Furthermore, a masking positional encoding strategy is utilized to improve the performance with large irregular masks. Extensive experiments on various datasets validate the efficacy of our model compared with other competitors. Our codes are released in https://github.com/DQiaole/ZITS_inpainting.


title: An Instance Space Analysis of Constrained Multi-Objective Optimization Problems

abstract: Multi-objective optimization problems with constraints (CMOPs) are generally considered more challenging than those without constraints. This in part can be attributed to the creation of infeasible regions generated by the constraint functions, and/or the interaction between constraints and objectives. In this paper, we explore the relationship between constrained multi-objective evolutionary algorithms (CMOEAs) performance and CMOP instances characteristics using Instance Space Analysis (ISA). To do this, we extend recent work focused on the use of Landscape Analysis features to characterise CMOP. Specifically, we scrutinise the multi-objective landscape and introduce new features to describe the multi-objective-violation landscape, formed by the interaction between constraint violation and multi-objective fitness. Detailed evaluation of problem-algorithm footprints spanning six CMOP benchmark suites and fifteen CMOEAs, illustrates that ISA can effectively capture the strength and weakness of the CMOEAs. We conclude that two key characteristics, the isolation of non-dominate set and the correlation between constraints and objectives evolvability, have the greatest impact on algorithm performance. However, the current benchmarks problems do not provide enough diversity to fully reveal the efficacy of CMOEAs evaluated.


title: Hybrid Optimized Deep Convolution Neural Network based Learning Model for Object Detection

abstract: Object identification is one of the most fundamental and difficult issues in computer vision. It aims to discover object instances in real pictures from a huge number of established categories. In recent years, deep learning-based object detection techniques that developed from computer vision have grabbed the public's interest. Object recognition methods based on deep learning frameworks have quickly become a popular way to interpret moving images acquired by various sensors. Due to its vast variety of applications for various computer vision tasks such as activity or event detection, content-based image retrieval, and scene understanding, academics have spent decades attempting to solve this problem. With this goal in mind, a unique deep learning classification technique is used to create an autonomous object detecting system. The noise destruction and normalising operations, which are carried out using gaussian filter and contrast normalisation techniques, respectively, are the first steps in the study activity. The pre-processed picture is next subjected to entropy-based segmentation algorithms, which separate the image's significant areas in order to distinguish between distinct occurrences. The classification challenge is completed by the suggested Hybrid Optimized Dense Convolutional Neural Network (HODCNN). The major goal of this framework is to aid in the precise recognition of distinct items from the gathered input frames. The suggested system's performance is assessed by comparing it to existing machine learning and deep learning methodologies. The experimental findings reveal that the suggested framework has a detection accuracy of 0.9864, which is greater than current techniques. As a result, the suggested object detection model outperforms other current methods.


title: Faith-Shap: The Faithful Shapley Interaction Index

abstract: Shapley values, which were originally designed to assign attributions to individual players in coalition games, have become a commonly used approach in explainable machine learning to provide attributions to input features for black-box machine learning models. A key attraction of Shapley values is that they uniquely satisfy a very natural set of axiomatic properties. However, extending the Shapley value to assigning attributions to interactions rather than individual players, an interaction index, is non-trivial: as the natural set of axioms for the original Shapley values, extended to the context of interactions, no longer specify a unique interaction index. Many proposals thus introduce additional less ''natural'' axioms, while sacrificing the key axiom of efficiency, in order to obtain unique interaction indices. In this work, rather than introduce additional conflicting axioms, we adopt the viewpoint of Shapley values as coefficients of the most faithful linear approximation to the pseudo-Boolean coalition game value function. By extending linear to $\ell$-order polynomial approximations, we can then define the general family of faithful interaction indices. We show that by additionally requiring the faithful interaction indices to satisfy interaction-extensions of the standard individual Shapley axioms (dummy, symmetry, linearity, and efficiency), we obtain a unique Faithful Shapley Interaction index, which we denote Faith-Shap, as a natural generalization of the Shapley value to interactions. We then provide some illustrative contrasts of Faith-Shap with previously proposed interaction indices, and further investigate some of its interesting algebraic properties. We further show the computational efficiency of computing Faith-Shap, together with some additional qualitative insights, via some illustrative experiments.


title: Dense Voxel Fusion for 3D Object Detection

abstract: Camera and LiDAR sensor modalities provide complementary appearance and geometric information useful for detecting 3D objects for autonomous vehicle applications. However, current end-to-end fusion methods are challenging to train and underperform state-of-the-art LiDAR-only detectors. Sequential fusion methods suffer from a limited number of pixel and point correspondences due to point cloud sparsity, or their performance is strictly capped by the detections of one of the modalities. Our proposed solution, Dense Voxel Fusion (DVF) is a sequential fusion method that generates multi-scale dense voxel feature representations, improving expressiveness in low point density regions. To enhance multi-modal learning, we train directly with projected ground truth 3D bounding box labels, avoiding noisy, detector-specific 2D predictions. Both DVF and the multi-modal training approach can be applied to any voxel-based LiDAR backbone. DVF ranks 3rd among published fusion methods on KITTI 3D car detection benchmark without introducing additional trainable parameters, nor requiring stereo images or dense depth labels. In addition, DVF significantly improves 3D vehicle detection performance of voxel-based methods on the Waymo Open Dataset.


title: Implications of Distance over Redistricting Maps: Central and Outlier Maps

abstract: In representative democracy, a redistricting map is chosen to partition an electorate into a collection of districts each of which elects a representative. A valid redistricting map must satisfy a collection of constraints such as being compact, contiguous, and of almost equal population. However, these imposed constraints are still loose enough to enable an enormous ensemble of valid redistricting maps. This fact introduces a difficulty in drawing redistricting maps and it also enables a partisan legislature to possibly gerrymander by choosing a map which unfairly favors it. In this paper, we introduce an interpretable and tractable distance measure over redistricting maps which does not use election results and study its implications over the ensemble of redistricting maps. Specifically, we define a central map which may be considered as being "most typical" and give a rigorous justification for it by showing that it mirrors the Kemeny ranking in a scenario where we have a committee voting over a collection of redistricting maps to be drawn. We include run-time and sample complexity analysis for our algorithms, including some negative results which hold using any algorithm. We further study outlier detection based on this distance measure. More precisely, we show gerrymandered maps that lie very far away from our central maps in comparison to a large ensemble of valid redistricting maps. Since our distance measure does not rely on election results, this gives a significant advantage in gerrymandering detection which is lacking in all previous methods.


title: Spatial entanglement between two quantum walkers with exchange symmetric coins

abstract: We investigate how the initial and final exchange symmetries between the two-coin states influence the spatial entanglement dynamics between the two corresponding quantum walkers. Notably, when the initial state is anti-symmetric and the final measurement on the coins yields symmetric outcomes, all the initial entanglement will be transferred to the spatial degrees of freedom, regardless of when the coins are measured. Conversely, if the final outcomes are anti-symmetric, the spatial entanglement exhibits damped oscillation with a period ($T$) being inversely proportional to the coin operator parameter ($\theta$). These behaviours are reversed for symmetric initial states. Moreover, we also observe the same spatial entanglement damping regardless of the initial state when the post-selected results lack symmetry. Our findings reveal how symmetries affect the entanglement dynamics in quantum walks, offering potential insights for applications in quantum technology.


title: Follow your Nose: Using General Value Functions for Directed Exploration in Reinforcement Learning

abstract: Improving sample efficiency is a key challenge in reinforcement learning, especially in environments with large state spaces and sparse rewards. In literature, this is resolved either through the use of auxiliary tasks (subgoals) or through clever exploration strategies. Exploration methods have been used to sample better trajectories in large environments while auxiliary tasks have been incorporated where the reward is sparse. However, few studies have attempted to tackle both large scale and reward sparsity at the same time. This paper explores the idea of combining exploration with auxiliary task learning using General Value Functions (GVFs) and a directed exploration strategy. We present a way to learn value functions which can be used to sample actions and provide directed exploration. Experiments on navigation tasks with varying grid sizes demonstrate the performance advantages over several competitive baselines.


title: Learning Object Relations with Graph Neural Networks for Target-Driven Grasping in Dense Clutter

abstract: Robots in the real world frequently come across identical objects in dense clutter. When evaluating grasp poses in these scenarios, a target-driven grasping system requires knowledge of spatial relations between scene objects (e.g., proximity, adjacency, and occlusions). To efficiently complete this task, we propose a target-driven grasping system that simultaneously considers object relations and predicts 6-DoF grasp poses. A densely cluttered scene is first formulated as a grasp graph with nodes representing object geometries in the grasp coordinate frame and edges indicating spatial relations between the objects. We design a Grasp Graph Neural Network (G2N2) that evaluates the grasp graph and finds the most feasible 6-DoF grasp pose for a target object. Additionally, we develop a shape completion-assisted grasp pose sampling method that improves sample quality and consequently grasping efficiency. We compare our method against several baselines in both simulated and real settings. In real-world experiments with novel objects, our approach achieves a 77.78% grasping accuracy in densely cluttered scenarios, surpassing the best-performing baseline by more than 15%. Supplementary material is available at https://sites.google.com/umn.edu/graph-grasping.


title: On the Dynamics of Imploding and Exploding Spherical Shock Wave Inside a Shock Tube

abstract: The present work aims to study the phenomenon of shock wave focusing and the effect of viscosity in it. The focusing is achieved with a shock tube and a converging section attached to it. The converging section transforms the planar shock into a spherical shock and focuses it into a confined area. A shock of an initial strength Ms=2.94 has been chosen for the present studies. A detailed numerical study of the focusing region shows the formation of a mushroom-shaped structure behind the reflected shock and vortex formation. This was visualised through numerical shadowgraph images and by tracing the streamlines in the flow field. A study on the variation in temperature is carried out in order to have a quantitative assessment. It was found that the temperature inside the mushroom structure is higher than that behind the reflected shock. The study of species mass fraction in this region is also made. The flow inside the mushroom structure was found to be a reactive mixture of gas slug.


title: Chiral-coupling-assisted refrigeration in trapped ions

abstract: The tapped ions can be cooled close to their motional ground state, which is imperative in implementing quantum computation and quantum simulation. Here we demonstrate the capability of light-mediated chiral couplings between ions, which enables a superior cooling scheme exceeding the single-ion limit of sideband cooling. We present the chiral-coupling-assisted refrigeration in the target ion at the price of heating the others under asymmetric drivings, where its steady-state phonon occupation outperforms the lower bound set by a single ion. We further locate the optimal operation condition of the refrigeration and identify the parameter region where a faster rate of cooling emerges. Under an additional nonguided decay channel, the heating effect in the reciprocal coupling regime becomes suppressed and turns into cooling instead. Our results present a resource of collective chiral couplings which help surpass the bottleneck of cooling procedure in applications of trapped-ion-based quantum computer and simulator.


title: The First Insight-HXMT Gamma-Ray Burst Catalog: The First Four Years

abstract: The Hard X-ray Modulation Telescope (Insight-HXMT), is China's first X-ray astronomy satellite launched on June 15, 2017. The anti-coincidence CsI detectors of the High Energy X-ray telescope (HE) onboard Insight-HXMT could serve as an all-sky gamma-ray monitor in about 0.2-3 MeV. In its first four years of operation, Insight-HXMT has detected 322 Gamma-Ray Bursts (GRBs) by offline search pipeline including blind search and targeted search. For the GOLDEN sample of Insight-HXMT GRBs, joint analyses were performed with other GRB missions, including Fermi Gamma-ray Burst Monitor (Fermi/GBM), Swift Burst Alert Telescope (Swift/BAT) and Gravitational wave high-energy Electromagnetic Counterpart All-sky Monitor (GECAM). It shows that Insight-HXMT can provide better constraint on GRB spectrum at higher energy band. The properties of Insight-HXMT GRBs are reported in detail, including their trigger time, duration, spectral parameters, peak fluxes of different time scales and fluence. This catalog is an official product of the Insight-HXMT GRB team.


title: Ultrasound Triggering of Rayleigh-Taylor Instability: Solution of Compressible Navier-Stokes Equation by a Non-Overlapping Parallel Compact Scheme

abstract: Rayleigh-Taylor instability (RTI) occurs at the interface of two media when the heavier fluid is accelerated into the lighter fluid and is a prototypical hydrodynamic event present in many physical events. In high energy physics, this manifests itself across a wide range of length scales from nuclear confinement fusion at micron-scale to supernova explosion at terra scales. RTI can also be viewed as a baroclinic instability prevalent in engineering, geophysics, and astrophysics, a pedagogic description of which is given in Sengupta {\it et al., Comput. Fluids,} {\bf 225}, 104995 (2021) with respect to the experimental results of Read, {\it Physica D}, {\bf 12} 45-58 (1984). Here, a recently proposed non-overlapping parallel algorithm is used to solve this three-dimensional canonical problem, having the unique property of not distinguishing between sequential and parallel computing, using 4.19 billion points and a refined time step of $7.69 \times 10^{-8} sec$. The problem achieves the required density gradient by considering two volumes of air at different temperatures (with a temperature difference of 200K) separated by a non-conducting, impermeable partition at the onset of the experiment, which is removed impulsively at $t=0$. The resulting buoyancy force at the interface acting from top to bottom is the seed of the baroclinic instability. Present high precision computation enables one to capture the ensuing RTI triggered by ultrasonic waves created at the interface.


title: A Two-Zone Model as origin of Hard TeV Spectrum in Extreme BL Lacs

abstract: The emission of the so-called extreme BL Lacs poses challenges to the particle acceleration models. The hardness of their spectrum, $\lesssim 2$, in the high-energy band demands unusual parameters using the standard one-zone synchrotron self-Compton (SSC) model with a deficient magnetized plasma. Some authors use either two-zone or hadronic/lepto-hadronic models to relax these atypical values. In this work, we present a lepto-hadronic two-zone model to explain the multi-wavelength observations of the six best-known \textit{extreme} BL Lacs. The very-high-energy gamma-ray observations are described by the photo-hadronic processes in a blob close to the AGN core and by SSC and external inverse Compton-processes in an outer blob. The photo-hadronic interactions occur when accelerated protons in the inner blob interact with annihilation line photons from a sub-relativistic pair plasma. The X-ray observations are described by synchrotron radiation from the outer blob. The parameter values found from the description of the spectral energy distribution for each object with our phenomenological model are similar to each other, and lie in the typical range reported in BL Lacs.


title: The symbiotic and bipolar nebula M2-9: Morphological variability of the collimated ionized wind arising from the core

abstract: We studied the central region of bipolar nebula M\,2-9 using radio-continuum observations obtained from the Jansky Very Large Array (JVLA) and the Atacama Large Millimeter Array (ALMA) interferometers. This work presents new images at $\sim$ 43 GHz ($\sim$ 7.0 mm) and $\sim$ 345 GHz ($\sim$ 0.9 mm) with angular resolutions of $\sim$ 0$\rlap{.}^{\prime\prime}$047 and 0$\rlap{.}^{\prime\prime}$09, respectively. The continuum emission at $\sim$ 43 GHz shows an elongated jet-like structure perpendicular to the $\sim$ 345 GHz observation. We conclude that both emissions could correspond to tracing an isothermal collimated fast wind with constant expansion velocity and being driven by the circumstellar ring traced by ALMA. Although this configuration has been discussed within the scope of planetary nebulae models, there is a remarkable fact: the collimated fast wind shows morphological spatial variability. This supports the idea of a symbiotic binary system within the innermost part of M\,2-9, which would be composed of a white dwarf and an AGB star. The latter could explain the mirror symmetry observed at larger scales due to their orbital motion.


title: The Hardness-intensity Correlation of Photospheric Emission from a Structured Jet for Gamma-Ray Bursts

abstract: For many gamma-ray bursts (GRBs), hardness-intensity correlation (HIC) can be described by a power-law function, $E_{\rm p}\propto F^{\kappa}$, where $E_{\rm p}$ is the peak energy of $\nu F_{\nu}$ spectrum, and $F$ is the instantaneous energy flux. In this paper, HIC of the non-dissipative photospheric emission from a structured jet is studied in different regimes. An intermediate photosphere, which contains both of unsaturated and saturated emissions is introduced, and we find positive $\kappa<1/4$ in this case. The same conclusion could be generalized to the photospheric emission from a hybrid jet without magnetic dissipations, or that with sub-photospheric magnetic dissipations and fully thermalized. This may imply that the contribution peaking at $\sim1/2$ in the distribution of observed $\kappa$ are mainly from the prompt emission of GRBs with synchrotron origin. Besides, emissions of the intermediate photosphere could give a smaller low-energy photon index $\alpha$ than that in the unsaturated regime, and naturally reproduce anti-correlation in $\alpha-E_{\rm p}$ in a GRB pulse.


title: Frequency stabilization of a 739 nm laser to an $I_2$ spectrum for trapped Ytterbium ions

abstract: We report on the frequency stabilization of a 739 nm Ti:sapphire laser to a hyperfine component of the $^{127}I_{2}$ B(1)-X(11) P(70) transition using acousto-optic modulation transfer spectroscopy (MTS). A frequency stability of $3.83\times 10^{-11}$ around 13 s averaging time is achieved when the laser frequency is stabilized. The observed hyperfine transition of the molecular iodine is an ideal frequency reference for locking the lasers used in experiments with trapped ytterbium ions, since its second harmonic frequency is the $^{2}S_{\frac{1}{2}}-^{2}P_{\frac{1}{2}}$ transition of the ytterbium ion at 369.5 nm. By investigating the line broadening effects due to the iodine vapor pressure and laser power, the locking is optimized to the theoretical signal to noise ratio (TSNR) of this iodine transition.


title: Strong and tunable magnetoelectric coupling in 2D trilayer heterostructures

abstract: The quest for electric-field control of nanoscale magnetic states such as skyrmions, which would impact the field of spintronics, has led to a challenging search for multiferroic materials or structures with strong magnetoelectric coupling and efficient electric-field control. Here we report a theoretical prediction that such phenomena can be realized in two-dimensional (2D) bilayer FE/PMM and trilayer FE/PMM/FE heterostructures (two-terminal and three-terminal devices), where FE is a 2D ferroelectric and PMM is a polar magnetic metal with strong spin-orbit coupling. Such a PMM has strong Dzyaloshinskii-Moriya interactions (DMI) that can generate skyrmions, while the FE can generate strong magnetoelectric coupling through polarization-polarization interactions. In trilayer heterostructures, contact to the metallic PMM layer enables multiple polarization configurations for electric-field control of skyrmions. We report density-functional-theory calculations for particular material choices that demonstrate the effectiveness of these arrangements, with the key driver being the polarization-polarization interactions between the PMM and FE layers. The present findings provide a method to achieve strong magnetoelectric coupling in the 2D limit and a new perspective for the design of related spintronics.


title: A Learning Based Framework for Handling Uncertain Lead Times in Multi-Product Inventory Management

abstract: Most existing literature on supply chain and inventory management consider stochastic demand processes with zero or constant lead times. While it is true that in certain niche scenarios, uncertainty in lead times can be ignored, most real-world scenarios exhibit stochasticity in lead times. These random fluctuations can be caused due to uncertainty in arrival of raw materials at the manufacturer's end, delay in transportation, an unforeseen surge in demands, and switching to a different vendor, to name a few. Stochasticity in lead times is known to severely degrade the performance in an inventory management system, and it is only fair to abridge this gap in supply chain system through a principled approach. Motivated by the recently introduced delay-resolved deep Q-learning (DRDQN) algorithm, this paper develops a reinforcement learning based paradigm for handling uncertainty in lead times (\emph{action delay}). Through empirical evaluations, it is further shown that the inventory management with uncertain lead times is not only equivalent to that of delay in information sharing across multiple echelons (\emph{observation delay}), a model trained to handle one kind of delay is capable to handle delays of another kind without requiring to be retrained. Finally, we apply the delay-resolved framework to scenarios comprising of multiple products subjected to stochasticity in lead times, and elucidate how the delay-resolved framework negates the effect of any delay to achieve near-optimal performance.


title: Holographic quantum simulation of entanglement renormalization circuits

abstract: While standard approaches to quantum simulation require a number of qubits proportional to the number of simulated particles, current noisy quantum computers are limited to tens of qubits. With the technique of holographic quantum simulation, a $D$-dimensional system can be simulated with a $D{\rm -}1$-dimensional subset of qubits, enabling the study of systems significantly larger than current quantum computers. Using circuits derived from the multiscale entanglement renormalization ansatz (MERA), we accurately prepare the ground state of an $L=32$ critical, non-integrable perturbed Ising model and measure long-range correlations on the 10 qubit Quantinuum trapped ion computer. We introduce generalized MERA (gMERA) networks that interpolate between MERA and matrix product state networks and demonstrate that gMERA can capture far longer correlations than a MERA with the same number of qubits, at the expense of greater circuit depth. Finally, we perform noisy simulations of these two network ans\"atze and find that the optimal choice of network depends on noise level, available qubits, and the state to be represented.


title: Sampling Ex-Post Group-Fair Rankings

abstract: Randomized rankings have been of recent interest to achieve ex-ante fairer exposure and better robustness than deterministic rankings. We propose a set of natural axioms for randomized group-fair rankings and prove that there exists a unique distribution $D$ that satisfies our axioms and is supported only over ex-post group-fair rankings, i.e., rankings that satisfy given lower and upper bounds on group-wise representation in the top-$k$ ranks. Our problem formulation works even when there is implicit bias, incomplete relevance information, or only ordinal ranking is available instead of relevance scores or utility values. We propose two algorithms to sample a random group-fair ranking from the distribution $D$ mentioned above. Our first dynamic programming-based algorithm samples ex-post group-fair rankings uniformly at random in time $O(k^2\ell)$, where $\ell$ is the number of groups. Our second random walk-based algorithm samples ex-post group-fair rankings from a distribution $\delta$-close to $D$ in total variation distance and has expected running time $O^*(k^2\ell^2)$, when there is a sufficient gap between the given upper and lower bounds on the group-wise representation. The former does exact sampling, but the latter runs significantly faster on real-world data sets for larger values of $k$. We give empirical evidence that our algorithms compare favorably against recent baselines for fairness and ranking utility on real-world data sets.


title: Towards Contextual Spelling Correction for Customization of End-to-end Speech Recognition Systems

abstract: Contextual biasing is an important and challenging task for end-to-end automatic speech recognition (ASR) systems, which aims to achieve better recognition performance by biasing the ASR system to particular context phrases such as person names, music list, proper nouns, etc. Existing methods mainly include contextual LM biasing and adding bias encoder into end-to-end ASR models. In this work, we introduce a novel approach to do contextual biasing by adding a contextual spelling correction model on top of the end-to-end ASR system. We incorporate contextual information into a sequence-to-sequence spelling correction model with a shared context encoder. Our proposed model includes two different mechanisms: autoregressive (AR) and non-autoregressive (NAR). We propose filtering algorithms to handle large-size context lists, and performance balancing mechanisms to control the biasing degree of the model. We demonstrate the proposed model is a general biasing solution which is domain-insensitive and can be adopted in different scenarios. Experiments show that the proposed method achieves as much as 51% relative word error rate (WER) reduction over ASR system and outperforms traditional biasing methods. Compared to the AR solution, the proposed NAR model reduces model size by 43.2% and speeds up inference by 2.1 times.


title: Experimental demonstration of genuine tripartite nonlocality under strict locality conditions

abstract: Nonlocality captures one of the counterintuitive features of nature that defies classical intuition. Recent investigations reveal that our physical world's nonlocality is at least tripartite; i.e., genuinely tripartite nonlocal correlations in nature cannot be reproduced by any causal theory involving bipartite nonclassical resources and unlimited shared randomness. Here, by allowing the fair sampling assumption and postselection, we experimentally demonstrate such genuine tripartite nonlocality in a network under strict locality constraints that are ensured by spacelike separating all relevant events and employing fast quantum random number generators and high-speed polarization measurements. In particular, for a photonic quantum triangular network we observe a locality-loophole-free violation of the Bell-type inequality by 7.57 standard deviations for a postselected tripartite Greenberger-Horne-Zeilinger state of fidelity $(93.13 \pm 0.24)\%$, which convincingly disproves the possibility of simulating genuine tripartite nonlocality by bipartite nonlocal resources with globally shared randomness.


title: Viscoelasticity and Rheological Hysteresis

abstract: Rheological characterization of complex fluids subjected to cyclic shear-rate sweep often exhibits hysteresis. Since both viscoelastic and thixotropic materials show hysteresis loops, it is important to understand distinguishing features (if any) in the same shown by either. Lately, there has been substantial work that attempts to relate the area enclosed by the hysteresis loop with the manner in which shear rate is varied in the cycle, in order to infer thixotropic parameters of a material. In this work, we use the nonlinear Giesekus model to study its response to the application of cyclic shear-rate sweep. We find that this model produces each type of ualitatively similar hysteresis loop that has hitherto been ascribed to thixotropic materials. We also show that the area of the hysteresis loop for a viscoelastic material as a function of sweep rate shows bell-shaped/bi-modal curves as has been observed for thixotropic materials. This study illustrates that caution needs to be exercised while attributing hysteresis loops and associated features observed in a material exclusively to thixotropy. Another feature related to the hysteresis loop is the occurrence of shear banding instability. We find that viscoelastic hysteresis may not have any connection to shear banding instability.


title: Providing A Compiler Technology-Based Alternative For Big Data Application Infrastructures

abstract: The unprecedented growth of data volumes has caused traditional approaches to computing to be re-evaluated. This has started a transition towards the use of very large-scale clusters of commodity hardware and has given rise to the development of many new languages and paradigms for data processing and analysis. In this paper, we propose a compiler technology-based alternative to the development of many different Big Data application infrastructures. Key to this approach is the development of a single intermediate representation that enables the integration of compiler optimization and query optimization, and the re-use of many traditional compiler techniques for parallelization such as data distribution and loop scheduling. We show how the single intermediate can act as a generic intermediate for Big Data languages by mapping SQL and MapReduce onto this intermediate.


title: Joint Localization and Orientation Estimation in Millimeter-Wave MIMO OFDM Systems via Atomic Norm Minimization

abstract: Herein, an atomic norm based method for accurately estimating the location and orientation of a target from millimeter-wave multi-input-multi-output (MIMO) orthogonal frequency-division multiplexing (OFDM) signals is presented. A novel virtual channel matrix is introduced and an algorithm to extract localization-relevant channel parameters from its atomic norm decomposition is designed. Then, based on the extended invariance principle, a weighted least squares problem is proposed to accurately recover the location and orientation using both line-of-sight and non-line-of-sight channel information. The conditions for the optimality and uniqueness of the estimate and theoretical guarantees for the estimation error are characterized for the noiseless and the noisy scenarios. Theoretical results are confirmed via simulation. Numerical results investigate the robustness of the proposed algorithm to incorrect model order selection or synchronization error, and highlight performance improvements over a prior method. The resultant performance nearly achieves the Cramer-Rao lower bound on the estimation error.


title: FAST-LIVO: Fast and Tightly-coupled Sparse-Direct LiDAR-Inertial-Visual Odometry

abstract: To achieve accurate and robust pose estimation in Simultaneous Localization and Mapping (SLAM) task, multi-sensor fusion is proven to be an effective solution and thus provides great potential in robotic applications. This paper proposes FAST-LIVO, a fast LiDAR-Inertial-Visual Odometry system, which builds on two tightly-coupled and direct odometry subsystems: a VIO subsystem and a LIO subsystem. The LIO subsystem registers raw points (instead of feature points on e.g., edges or planes) of a new scan to an incrementally-built point cloud map. The map points are additionally attached with image patches, which are then used in the VIO subsystem to align a new image by minimizing the direct photometric errors without extracting any visual features (e.g., ORB or FAST corner features). To further improve the VIO robustness and accuracy, a novel outlier rejection method is proposed to reject unstable map points that lie on edges or are occluded in the image view. Experiments on both open data sequences and our customized device data are conducted. The results show our proposed system outperforms other counterparts and can handle challenging environments at reduced computation cost. The system supports both multi-line spinning LiDARs and emerging solid-state LiDARs with completely different scanning patterns, and can run in real-time on both Intel and ARM processors. We open source our code and dataset of this work on Github to benefit the robotics community.


title: The structure of cosmic strings of a $U(1)$ gauge field for the conservation of $B-L$

abstract: We consider an extension of the Standard Model, where the difference between the baryon number $B$ and the lepton number $L$ is gauged with an Abelian gauge field, in order to explain the exact conservation of $B-L$. To avoid a gauge anomaly, we add a right-handed neutrino $\nu_{\rm R}$ to each fermion generation. Here it is not sterile, so the usual Majorana term is excluded by gauge invariance. We provide a mass term for $\nu_{\rm R}$ by adding a non-standard 1-component Higgs field, thus arriving at a consistent extension of the Standard Model, where the conservation of $B-L$ is natural, with a modest number of additional fields. We study the possible formation of cosmic strings by solving the coupled field equations of the two Higgs fields and the non-standard U(1) gauge field. Numerical methods provide the corresponding string profiles, depending on the Higgs winding numbers, such that the appropriate boundary conditions in the string center and far from it are fulfilled.


title: Are two finite $H$-spaces homotopy equivalent?

abstract: This paper proposes an algorithm that decides if two simply connected spaces represented by finite simplicial sets of finite $k$-type and finite dimension $d$ are homotopy equivalent. If the spaces are homotopy equivalent, the algorithm finds a homotopy equivalence between their Postnikov stages in dimension $d$. As a consequence, we get an algorithm deciding if two spaces represented by finite simplicial sets are stably homotopy equivalent.


title: Difference of photometric properties between regular and non-regular Miras in the Magellanic Clouds

abstract: Mira variables are asymptotic giant branch pulsating stars with long pulsation periods and large amplitudes in optical bands. By applying the random forest algorithm to the I-band light curves for the Miras in the Magellanic Clouds, we have classified these Miras into regular Miras and non-regular Miras. Wherein non-regular Miras exhibit a long-term variation in addition to their primary pulsation periods. Our results confirm that the period-luminosity relation for maximum light has a smaller dispersion, but only occurs on the regular oxygen-rich (O-rich) Miras, which we recommend to be applied in future distance scale work. We have also collected multi-band photometry for these Miras to perform a spectral-energy-distribution (SED) fitting with stellar and dust components, showing that a significant fraction of dust is present around the non-regular Miras. According to our results, we believe that the periodic long-term variations seen in the non-regular Miras might be due to the presence of dust.


title: An Effective Way for Cross-Market Recommendation with Hybrid Pre-Ranking and Ranking Models

abstract: The Cross-Market Recommendation task of WSDM CUP 2022 is about finding solutions to improve individual recommendation systems in resource-scarce target markets by leveraging data from similar high-resource source markets. Finally, our team OPDAI won the first place with NDCG@10 score of 0.6773 on the leaderboard. Our solution to this task will be detailed in this paper. To better transform information from source markets to target markets, we adopt two stages of ranking. In pre-ranking stage, we adopt diverse pre-ranking methods or models to do feature generation. After elaborate feature analysis and feature selection, we train LightGBM with 10-fold bagging to do the final ranking.


title: Relativistic free motion time of arrival operator for massive spin-0 particles with positive energy

abstract: A relativistic version of the Aharonov-Bohm time of arrival operator for spin-0 particles was constructed by Razavi in [Il Nuovo Cimento B \textbf{63}, 271 (1969)]. We study the operator in detail by taking its rigged Hilbert space extension. It is shown that the rigged Hilbert space extension of the operator provides more insights into the time of arrival problem that goes beyond Razavi's original results. This allows us to use time of arrival eigenfunctions that exhibit unitary arrival to construct time of arrival distributions. The expectation value is also calculated and shown that particles can arrive earlier or later than expected classically. Lastly, the constructed time of arrival distribution, and expectation value are shown to be consistent with special relativity.


title: Machine learning based lens-free imaging technique for field-portable cytometry

abstract: Lens-free Shadow Imaging Technique (LSIT) is a well-established technique for the characterization of microparticles and biological cells. Due to its simplicity and cost-effectiveness, various low-cost solutions have been evolved, such as automatic analysis of complete blood count (CBC), cell viability, 2D cell morphology, 3D cell tomography, etc. The developed auto characterization algorithm so far for this custom-developed LSIT cytometer was based on the hand-crafted features of the cell diffraction patterns from the LSIT cytometer, that were determined from our empirical findings on thousands of samples of individual cell types, which limit the system in terms of induction of a new cell type for auto classification or characterization. Further, its performance is suffering from poor image (cell diffraction pattern) signatures due to its small signal or background noise. In this work, we address these issues by leveraging the artificial intelligence-powered auto signal enhancing scheme such as denoising autoencoder and adaptive cell characterization technique based on the transfer of learning in deep neural networks. The performance of our proposed method shows an increase in accuracy >98% along with the signal enhancement of >5 dB for most of the cell types, such as Red Blood Cell (RBC) and White Blood Cell (WBC). Furthermore, the model is adaptive to learn new type of samples within a few learning iterations and able to successfully classify the newly introduced sample along with the existing other sample types.


title: Cell-Free Massive MIMO-OFDM for High-Speed Train Communications

abstract: Cell-free (CF) massive multiple-input multiple-output (MIMO) systems show great potentials in low-mobility scenarios, due to cell boundary disappearance and strong macro diversity. However, the great Doppler frequency offset (DFO) leads to serious inter-carrier interference in orthogonal frequency division multiplexing (OFDM) technology, which makes it difficult to provide high-quality transmissions for both high-speed train (HST) operation control systems and passengers. In this paper, we focus on the performance of CF massive MIMO-OFDM systems with both fully centralized and local minimum mean square error (MMSE) combining in HST communications. Considering the local maximum ratio (MR) combining, the large-scale fading decoding (LSFD) cooperation and the practical effect of DFO on system performance, exact closed-form expressions for uplink spectral efficiency (SE) expressions are derived. We observe that cooperative MMSE combining achieves better SE performance than uncooperative MR combining. In addition, HST communications with small cell and cellular massive MIMO-OFDM systems are compared in terms of SE. Numerical results reveal that the CF massive MIMO-OFDM system achieves a larger and more uniform SE than the other systems. Finally, the train antenna centric (TA-centric) CF massive MIMO-OFDM system is designed for practical implementation in HST communications, and three power control schemes are adopted to optimize the propagation of TAs for reducing the impact of the DFO.


title: Cosmology and perturbations in tachyonic massive gravity

abstract: As massive gravity and its extensions offer physically well-defined gravitational theories with a nonzero graviton mass, we present a new extension of the de Rham-Gabadadze-Tolley (dRGT)massive gravity, which is tachyonic massive gravity theory. We firstly introduce the new extension of the dRGT massive gravity, constructed by adding a tachyonic term. We then find the cosmological background equations, and present the analysis of self-accelerating solutions. We examine the tensor perturbations to calculate the dispersion relation of gravitational waves (GWs). In a special case, we consider a constant tachyon potential for the tachyon field, and calculate the equations of motion and self-accelerating solutions. Finally, we investigate the background perturbations, which include tensor, vector, and scalar perturbations in this case. We calculate the dispersion relation of GWs in the FLRW cosmology in a tachyonic massive gravity theory. These analyses provide potential inputs to future applications in cosmology and GWs propagation.


title: Do Prompts Solve NLP Tasks Using Natural Language?

abstract: Thanks to the advanced improvement of large pre-trained language models, prompt-based fine-tuning is shown to be effective on a variety of downstream tasks. Though many prompting methods have been investigated, it remains unknown which type of prompts are the most effective among three types of prompts (i.e., human-designed prompts, schema prompts and null prompts). In this work, we empirically compare the three types of prompts under both few-shot and fully-supervised settings. Our experimental results show that schema prompts are the most effective in general. Besides, the performance gaps tend to diminish when the scale of training data grows large.


title: Combining Reinforcement Learning and Optimal Transport for the Traveling Salesman Problem

abstract: The traveling salesman problem is a fundamental combinatorial optimization problem with strong exact algorithms. However, as problems scale up, these exact algorithms fail to provide a solution in a reasonable time. To resolve this, current works look at utilizing deep learning to construct reasonable solutions. Such efforts have been very successful, but tend to be slow and compute intensive. This paper exemplifies the integration of entropic regularized optimal transport techniques as a layer in a deep reinforcement learning network. We show that we can construct a model capable of learning without supervision and inferences significantly faster than current autoregressive approaches. We also empirically evaluate the benefits of including optimal transport algorithms within deep learning models to enforce assignment constraints during end-to-end training.


title: Weakly Supervised Correspondence Learning

abstract: Correspondence learning is a fundamental problem in robotics, which aims to learn a mapping between state, action pairs of agents of different dynamics or embodiments. However, current correspondence learning methods either leverage strictly paired data -- which are often difficult to collect -- or learn in an unsupervised fashion from unpaired data using regularization techniques such as cycle-consistency -- which suffer from severe misalignment issues. We propose a weakly supervised correspondence learning approach that trades off between strong supervision over strictly paired data and unsupervised learning with a regularizer over unpaired data. Our idea is to leverage two types of weak supervision: i) temporal ordering of states and actions to reduce the compounding error, and ii) paired abstractions, instead of paired data, to alleviate the misalignment problem and learn a more accurate correspondence. The two types of weak supervision are easy to access in real-world applications, which simultaneously reduces the high cost of annotating strictly paired data and improves the quality of the learned correspondence.


title: Responsible-AI-by-Design: a Pattern Collection for Designing Responsible AI Systems

abstract: Although AI has significant potential to transform society, there are serious concerns about its ability to behave and make decisions responsibly. Many ethical regulations, principles, and guidelines for responsible AI have been issued recently. However, these principles are high-level and difficult to put into practice. In the meantime much effort has been put into responsible AI from the algorithm perspective, but they are limited to a small subset of ethical principles amenable to mathematical analysis. Responsible AI issues go beyond data and algorithms and are often at the system-level crosscutting many system components and the entire software engineering lifecycle. Based on the result of a systematic literature review, this paper identifies one missing element as the system-level guidance - how to design the architecture of responsible AI systems. We present a summary of design patterns that can be embedded into the AI systems as product features to contribute to responsible-AI-by-design.


title: Distributed goal assignment strategy for improving leader-following formation control performance

abstract: This paper investigates a distributed goal assignment problem in leader-following formation control of second-order multi-agent systems. It is assumed that each agent can communicate with nearby agents within the communication range and the leader information is only available to a subset of agents. Compared with existing formation control schemes addressing the goal assignment issue, the main contribution of this paper is to construct a novel distributed assignment strategy allotting appropriate goal positions of agents in the leader-following formation control framework. Based on the rigorous analysis using the Lyapunov stability theory, the enhancement of the control performance is proved via the proposed assignment strategy. To demonstrate the effectiveness of our theoretical results, two examples including multiple quadrotors are simulated.


title: Split Semantic Detection in Sandplay Images

abstract: Sandplay image, as an important psychoanalysis carrier, is a visual scene constructed by the client selecting and placing sand objects (e.g., sand, river, human figures, animals, vegetation, buildings, etc.). As the projection of the client's inner world, it contains high-level semantic information reflecting the client's subjective psychological states, which is different from the common natural image scene that only contains the objective basic semantics (e.g., object's name, attribute, bounding box, etc.). In this work, we take "split" which is a typical psychological semantics related to many emotional and personality problems as the research goal, and we propose an automatic detection model, which can replace the time-consuming and expensive manual analysis process. To achieve that, we design a distribution map generation method projecting the semantic judgment problem into a visual problem, and a feature dimensionality reduction and extraction algorithm which can provide a good representation of split semantics. Besides, we built a sandplay datasets by collecting one sample from each client and inviting 5 therapists to label each sample, which has a large data cost. Experimental results demonstrated the effectiveness of our proposed method.


title: Probing the interlayer coupling in 2$H$-NbS$_2$ via soft x-ray angle-resolved photoemission spectroscopy

abstract: In the large family of two-dimensional (2D) layered materials including graphene, its honeycomb analogs, and transition-metal dichalcogenides, the interlayer coupling plays a rather intriguing role. On the one hand, the weak van der Waals interaction that holds the layers together endows these compounds with quasi-2D properties, which might imply small interlayer effects on the electronically active bands. On the other hand, the oft-witnessed differences in electronic, optical, and magnetic behaviors of monolayers, bilayers, and multilayers of the same compound must have as their microscopic origin the detailed interlayer hopping parameters. Given the few experimental reports that have attempted to explicitly extract these parameters, we employ soft-x-ray angle-resolved photoemission spectroscopy (SX-ARPES) to probe the interlayer coupling in superconducting 2$H$-NbS$_2$. We visualize the S 3$p_z$ bands that disperse with respect to the out-of-plane momentum and introduce a simple tight-binding model to extract the interlayer hopping parameters. From first-principles calculations, we clarify how atomic distances and the proper accounting for screening via hybrid functionals influence these bands. The knowledge of interlayer hopping parameters is particularly pertinent in NbS$_2$, where recent experiments have uncovered fingerprints of finite-momentum superconductivity in the bulk material and heterostructures.


title: Splitting Receiver with Joint Envelope and Coherent Detection

abstract: This letter proposes a new splitting receiver design with joint envelope detection (ED) and coherent detection (CD). To characterize its fundamental performance limit, we conduct high signal-to-noise ratio (SNR) analysis on the proposed ED-CD splitting receiver and obtain closed-form approximations of both the achievable mutual information and the optimal splitting ratio (i.e., a key design parameter of the receiver). Our numerical results show that these high SNR approximations are accurate over a wide range of moderate SNR values, signifying the usefulness of the obtained analytical results. We also provide insights on the conditions at which the proposed splitting receiver has significant performance advantages over the traditional receivers.


title: Location problems with cutoff

abstract: In this paper we study a generalized version of the Weber problem of finding a point that minimizes the sum of its distances to a finite number of given points. In our setting these distances may be $cut$ $off$ at a given value $C > 0$, and we allow for the option of an $empty$ solution at a fixed cost $C'$. We analyze under which circumstances these problems can be reduced to the simpler Weber problem, and also when we definitely have to solve the more complex problem with cutoff. We furthermore present adaptions of the algorithm of [Drezner et al., 1991, $Transportation$ $Science$ 25(3), 183--187] to our setting, which in certain situations are able to substantially reduce computation times as demonstrated in a simulation study. The sensitivity with respect to the cutoff value is also studied, which allows us to provide an algorithm that efficiently solves the problem simultaneously for all $C>0$.


title: Towards Bidirectional Arbitrary Image Rescaling: Joint Optimization and Cycle Idempotence

abstract: Deep learning based single image super-resolution models have been widely studied and superb results are achieved in upscaling low-resolution images with fixed scale factor and downscaling degradation kernel. To improve real world applicability of such models, there are growing interests to develop models optimized for arbitrary upscaling factors. Our proposed method is the first to treat arbitrary rescaling, both upscaling and downscaling, as one unified process. Using joint optimization of both directions, the proposed model is able to learn upscaling and downscaling simultaneously and achieve bidirectional arbitrary image rescaling. It improves the performance of current arbitrary upscaling models by a large margin while at the same time learns to maintain visual perception quality in downscaled images. The proposed model is further shown to be robust in cycle idempotence test, free of severe degradations in reconstruction accuracy when the downscaling-to-upscaling cycle is applied repetitively. This robustness is beneficial for image rescaling in the wild when this cycle could be applied to one image for multiple times. It also performs well on tests with arbitrary large scales and asymmetric scales, even when the model is not trained with such tasks. Extensive experiments are conducted to demonstrate the superior performance of our model.


title: Compositions of Belyi Maps and their Extended Monodromy Groups

abstract: Given a composition of Bely\u{\i} maps $\beta \circ \gamma: X \rightarrow Z$, paths between edges of $\beta$ are extended to form loops, then lifted by $\gamma$. These liftings are then studied to understand how loops in $Z$ act on edges of $\beta \circ \gamma$, demonstrating the group operation in $\mathop{\mathrm{Mon}} \beta \circ \gamma \unlhd \mathop{\mathrm{Mon}} \gamma \wr \mathop{\mathrm{Mon}} \beta$. Abstracting away the specific Bely\u{\i} map $\gamma$ and finding the image of $\pi_{1}(Z)$ in $\pi_{1}(Y) \wr \mathop{\mathrm{Mon}} \beta$ instead allows subsequently determining $\mathop{\mathrm{Mon}} \beta \circ \gamma$, for any $\gamma$, using only the monodromy representation of $\gamma$.


title: A Principled Design of Image Representation: Towards Forensic Tasks

abstract: Image forensics is a rising topic as the trustworthy multimedia content is critical for modern society. Like other vision-related applications, forensic analysis relies heavily on the proper image representation. Despite the importance, current theoretical understanding for such representation remains limited, with varying degrees of neglect for its key role. For this gap, we attempt to investigate the forensic-oriented image representation as a distinct problem, from the perspectives of theory, implementation, and application. Our work starts from the abstraction of basic principles that the representation for forensics should satisfy, especially revealing the criticality of robustness, interpretability, and coverage. At the theoretical level, we propose a new representation framework for forensics, called Dense Invariant Representation (DIR), which is characterized by stable description with mathematical guarantees. At the implementation level, the discrete calculation problems of DIR are discussed, and the corresponding accurate and fast solutions are designed with generic nature and constant complexity. We demonstrate the above arguments on the dense-domain pattern detection and matching experiments, providing comparison results with state-of-the-art descriptors. Also, at the application level, the proposed DIR is initially explored in passive and active forensics, namely copy-move forgery detection and perceptual hashing, exhibiting the benefits in fulfilling the requirements of such forensic tasks.


title: PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsampling

abstract: We propose a generative adversarial network for point cloud upsampling, which can not only make the upsampled points evenly distributed on the underlying surface but also efficiently generate clean high frequency regions. The generator of our network includes a dynamic graph hierarchical residual aggregation unit and a hierarchical residual aggregation unit for point feature extraction and upsampling, respectively. The former extracts multiscale point-wise descriptive features, while the latter captures rich feature details with hierarchical residuals. To generate neat edges, our discriminator uses a graph filter to extract and retain high frequency points. The generated high resolution point cloud and corresponding high frequency points help the discriminator learn the global and high frequency properties of the point cloud. We also propose an identity distribution loss function to make sure that the upsampled points remain on the underlying surface of the input low resolution point cloud. To assess the regularity of the upsampled points in high frequency regions, we introduce two evaluation metrics. Objective and subjective results demonstrate that the visual quality of the upsampled point clouds generated by our method is better than that of the state-of-the-art methods.


title: MIAShield: Defending Membership Inference Attacks via Preemptive Exclusion of Members

abstract: In membership inference attacks (MIAs), an adversary observes the predictions of a model to determine whether a sample is part of the model's training data. Existing MIA defenses conceal the presence of a target sample through strong regularization, knowledge distillation, confidence masking, or differential privacy. We propose MIAShield, a new MIA defense based on preemptive exclusion of member samples instead of masking the presence of a member. The key insight in MIAShield is weakening the strong membership signal that stems from the presence of a target sample by preemptively excluding it at prediction time without compromising model utility. To that end, we design and evaluate a suite of preemptive exclusion oracles leveraging model-confidence, exact or approximate sample signature, and learning-based exclusion of member data points. To be practical, MIAShield splits a training data into disjoint subsets and trains each subset to build an ensemble of models. The disjointedness of subsets ensures that a target sample belongs to only one subset, which isolates the sample to facilitate the preemptive exclusion goal. We evaluate MIAShield on three benchmark image classification datasets. We show that MIAShield effectively mitigates membership inference (near random guess) for a wide range of MIAs, achieves far better privacy-utility trade-off compared with state-of-the-art defenses, and remains resilient against an adaptive adversary.


title: Fourth cluster and virial coefficients of a unitary Fermi gas for an arbitrary mass ratio

abstract: We calculate the fourth cluster coefficients of the homogeneous unitary spin 1/2 Fermi gas as functions of the internal-state mass ratio, over intervals constrained by the 3- or 4-body Efimov effect. For this we use our 2016 conjecture (validated for equal masses by Hou and Drut in 2020) in a numerically efficient formulation making the sum over angular momentum converge faster, which is crucial at large mass ratio. The mean cluster coefficient, relevant for equal chemical potentials, is not of constant sign and increases rapidly close to the Efimovian thresholds. We also get the fourth virial coefficients, which we find to be very poor indicators of interaction-induced 4-body correlations. We obtain analytically for all $n$ the cluster coefficients of order $n$ + 1 for an infinity-mass impurity fermion, matching the conjecture for $n=3$. Finally, in a harmonic potential, we predict a non-monotonic behavior of the 3 + 1 cluster coefficient with trapping frequency, near mass ratios where this coefficient vanishes in the homogeneous case.


title: Machine Learning Methods for Inferring the Number of UAV Emitters via Massive MIMO Receive Array

abstract: To provide important prior knowledge for the DOA estimation of UAV emitters in future wireless networks, we present a complete DOA preprocessing system for inferring the number of emitters via massive MIMO receive array. Firstly, in order to eliminate the noise signals, two high-precision signal detectors, square root of maximum eigenvalue times minimum eigenvalue (SR-MME) and geometric mean (GM), are proposed. Compared to other detectors, SR-MME and GM can achieve a high detection probability while maintaining extremely low false alarm probability. Secondly, if the existence of emitters is determined by detectors, we need to further confirm their number. Therefore, we perform feature extraction on the the eigenvalue sequence of sample covariance matrix to construct feature vector and innovatively propose a multi-layer neural network (ML-NN). Additionally, the support vector machine (SVM), and naive Bayesian classifier (NBC) are also designed. The simulation results show that the machine learning-based methods can achieve good results in signal classification, especially neural networks, which can always maintain the classification accuracy above 70\% with massive MIMO receive array. Finally, we analyze the classical signal classification methods, Akaike (AIC) and Minimum description length (MDL). It is concluded that the two methods are not suitable for scenarios with massive MIMO arrays, and they also have much worse performance than machine learning-based classifiers.


title: Smart Tracking Tray System for A Smart and Sustainable Wet Lab Community

abstract: The laboratories and research institutes are the major places for cutting-edge scientific exploration. Hundreds of millions of research papers were formed from front-line labs. Behind this glorious achievement were unsustainable facts. More and more human investment is required in innovative experimental design and analysis of results. However, the laboratory operating environment has not been subversively transformed for centuries. This abstract proposed a smart tracking system, consisting of IoT and Data Visualization technologies, to track the chemicals in an automatic and timely approach. Positive feedback has been collected from pilot tests in several labs. The system benefits various lab users in their daily work and improves their working efficiency. In the long run, it will play an essential role in promoting the efficient use of lab resources and achieving the goal of sustainable labs.


title: A single-atom level mechano-optical transducer for ultrasensitive force sensing

abstract: Using light as a probe to detect a mechanical motion is one of the most successful experimental approaches in physics. The history of mechanical sensing based on the reflection, refraction and scattering of light dates back to the 16th century, where in the Cavendish experiment, the angle of rotation induced by the gravitational force is measured by the deflection of a light beam reflected from a mirror attached to the suspension. In modern science, mechano-optical transducers are such devices that could detect, measure and convert a force or displacement signal to an optical one, and are widely used for force detection. Especially, ultraweak force sensor with ultrahigh spatial resolution is highly demanded for detecting force anomaly in surface science, biomolecule imaging, and atomtronics. Here we show a novel scheme using a single trapped ion as a mechano-optical transduction. This method utilizes the force-induced micromotion, converting the micromotion to a time-resolved fluorescence signal, in which the ion's excess micromotion coupled to the Doppler shift of the scattered photons. We demonstrate the measurement sensitivity about 600 $\textrm{zN}/\sqrt{\textrm{Hz}}$ (1 $\textrm{zN} =10^{-21}$N). By alternating the detection laser beam in all three dimensions, the amplitude and the direction of a vector force can be precisely determined, constituting a 3D force sensor. This mechano-optical transducer provides high sensitivity with spatial resolution in single-atom level, enabling the applications in material industry and the search for possible exotic spin-dependent interactions that beyond the standard model.


title: Integer Factorization with Compositional Distributed Representations

abstract: In this paper, we present an approach to integer factorization using distributed representations formed with Vector Symbolic Architectures. The approach formulates integer factorization in a manner such that it can be solved using neural networks and potentially implemented on parallel neuromorphic hardware. We introduce a method for encoding numbers in distributed vector spaces and explain how the resonator network can solve the integer factorization problem. We evaluate the approach on factorization of semiprimes by measuring the factorization accuracy versus the scale of the problem. We also demonstrate how the proposed approach generalizes beyond the factorization of semiprimes; in principle, it can be used for factorization of any composite number. This work demonstrates how a well-known combinatorial search problem may be formulated and solved within the framework of Vector Symbolic Architectures, and it opens the door to solving similarly difficult problems in other domains.


title: New criterions on nonexistence of periodic orbits of planar dynamical systems and their applications

abstract: Characterizing existence or not of periodic orbit is a classical problem and it has both theoretical importance and many real applications. Here, several new criterions on nonexistence of periodic orbits of the planar dynamical system $\dot x=y,~\dot y=-g(x)-f(x,y)y$ are obtained in this paper, and by examples showing that these criterions are applicable, but the known ones are invalid to them. Based on these criterions, we further characterize the local topological structures of its equilibrium, which also show that one of the classical results by A.F. Andreev [Amer. Math. Soc. Transl. 8 (1958), 183--207] on local topological classification of the degenerate equilibrium is incomplete. Finally, as another application of these results, we classify the global phase portraits of a planar differential system, which comes from the third question in the list of the 33 questions posed by A. Gasull and also from a mechanical oscillator under suitable restriction to its parameters.


title: Canonical foliations of neural networks: application to robustness

abstract: Deep learning models are known to be vulnerable to adversarial attacks. Adversarial learning is therefore becoming a crucial task. We propose a new vision on neural network robustness using Riemannian geometry and foliation theory. The idea is illustrated by creating a new adversarial attack that takes into account the curvature of the data space. This new adversarial attack called the two-step spectral attack is a piece-wise linear approximation of a geodesic in the data space. The data space is treated as a (degenerate) Riemannian manifold equipped with the pullback of the Fisher Information Metric (FIM) of the neural network. In most cases, this metric is only semi-definite and its kernel becomes a central object to study. A canonical foliation is derived from this kernel. The curvature of transverse leaves gives the appropriate correction to get a two-step approximation of the geodesic and hence a new efficient adversarial attack. The method is first illustrated on a 2D toy example in order to visualize the neural network foliation and the corresponding attacks. Next, experiments on the MNIST dataset with the proposed technique and a state of the art attack presented in Zhao et al. (2019) are reported. The result show that the proposed attack is more efficient at all levels of available budget for the attack (norm of the attack), confirming that the curvature of the transverse neural network FIM foliation plays an important role in the robustness of neural networks.


title: Manipulating electron waves in graphene using carbon nanotube gating

abstract: Graphene with its dispersion relation resembling that of photons offers ample opportunities for applications in electron optics. The spacial variation of carrier density by external gates can be used to create electron waveguides, in analogy to optical fiber, with additional confinement of the carriers in bipolar junctions leading to the formation of few transverse guiding modes. We show that waveguides created by gating graphene with carbon nanotubes (CNTs) allow obtaining sharp conductance plateaus, and propose applications in the Aharonov-Bohm and two-path interferometers, and a pointlike source for injection of carriers in graphene. Other applications can be extended to Bernal-stacked or twisted bilayer graphene or two-dimensional electron gas. Thanks to their versatility, CNT-induced waveguides open various possibilities for electron manipulation in graphene-based devices.


title: Translation Invariant Global Estimation of Heading Angle Using Sinogram of LiDAR Point Cloud

abstract: Global point cloud registration is an essential module for localization, of which the main difficulty exists in estimating the rotation globally without initial value. With the aid of gravity alignment, the degree of freedom in point cloud registration could be reduced to 4DoF, in which only the heading angle is required for rotation estimation. In this paper, we propose a fast and accurate global heading angle estimation method for gravity-aligned point clouds. Our key idea is that we generate a translation invariant representation based on Radon Transform, allowing us to solve the decoupled heading angle globally with circular cross-correlation. Besides, for heading angle estimation between point clouds with different distributions, we implement this heading angle estimator as a differentiable module to train a feature extraction network end- to-end. The experimental results validate the effectiveness of the proposed method in heading angle estimation and show better performance compared with other methods.


title: Manapy: MPI-Based framework for solving partial differential equations using finite-volume on unstructured-grid

abstract: Manapy is a parallel, unstructured, finite-volume based solver for the solution of partial differential equations (PDE). The framework is written using Python, it is object-oriented, and is organized in such a way that it is easy to understand and modify. In this paper, we present the parallel implementation and scalability of the differential operators used on a general case of PDE. The performance of massively parallel direct and iterative methods for solving large sparse systems of linear equations in plasma physics is evaluated on a latest high performance computing system, and 3D test cases for plasma physics are presented.


title: Parameterized Image Quality Score Distribution Prediction

abstract: Recently, image quality has been generally describedby a mean opinion score (MOS). However, we observe that thequality scores of an image given by a group of subjects are verysubjective and diverse. Thus it is not enough to use a MOS todescribe the image quality. In this paper, we propose to describeimage quality using a parameterized distribution rather thana MOS, and an objective method is also proposed to predictthe image quality score distribution (IQSD). At first, the LIVEdatabase is re-recorded. Specifically, we have invited a largegroup of subjects to evaluate the quality of all images in theLIVE database, and each image is evaluated by a large numberof subjects (187 valid subjects), whose scores can form a reliableIQSD. By analyzing the obtained subjective quality scores, wefind that the IQSD can be well modeled by an alpha stable model,and it can reflect much more information than a single MOS, suchas the skewness of opinion score, the subject diversity and themaximum probability score for an image. Therefore, we proposeto model the IQSD using the alpha stable model. Moreover, wepropose a framework and an algorithm to predict the alphastable model based IQSD, where quality features are extractedfrom each image based on structural information and statisticalinformation, and support vector regressors are trained to predictthe alpha stable model parameters. Experimental results verifythe feasibility of using alpha stable model to describe the IQSD,and prove the effectiveness of objective alpha stable model basedIQSD prediction method.


title: TransDARC: Transformer-based Driver Activity Recognition with Latent Space Feature Calibration

abstract: Traditional video-based human activity recognition has experienced remarkable progress linked to the rise of deep learning, but this effect was slower as it comes to the downstream task of driver behavior understanding. Understanding the situation inside the vehicle cabin is essential for Advanced Driving Assistant System (ADAS) as it enables identifying distraction, predicting driver's intent and leads to more convenient human-vehicle interaction. At the same time, driver observation systems face substantial obstacles as they need to capture different granularities of driver states, while the complexity of such secondary activities grows with the rising automation and increased driver freedom. Furthermore, a model is rarely deployed under conditions identical to the ones in the training set, as sensor placements and types vary from vehicle to vehicle, constituting a substantial obstacle for real-life deployment of data-driven models. In this work, we present a novel vision-based framework for recognizing secondary driver behaviours based on visual transformers and an additional augmented feature distribution calibration module. This module operates in the latent feature-space enriching and diversifying the training set at feature-level in order to improve generalization to novel data appearances, (e.g., sensor changes) and general feature quality. Our framework consistently leads to better recognition rates, surpassing previous state-of-the-art results of the public Drive&Act benchmark on all granularity levels. Our code is publicly available at https://github.com/KPeng9510/TransDARC.


title: Video is All You Need: Attacking PPG-based Biometric Authentication

abstract: Unobservable physiological signals enhance biometric authentication systems. Photoplethysmography (PPG) signals are convenient owning to its ease of measurement and are usually well protected against remote adversaries in authentication. Any leaked PPG signals help adversaries compromise the biometric authentication systems, and the advent of remote PPG (rPPG) enables adversaries to acquire PPG signals through restoration. While potentially dangerous, rPPG-based attacks are overlooked because existing methods require the victim's PPG signals. This paper proposes a novel spoofing attack approach that uses the waveforms of rPPG signals extracted from video clips to fool the PPG-based biometric authentication. We develop a new PPG restoration model that does not require leaked PPG signals for adversarial attacks. Test results on state-of-art PPG-based biometric authentication show that the signals recovered through rPPG pose a severe threat to PPG-based biometric authentication.


title: The impact of AGN outflows on the surface habitability of terrestrial planets in the Milky Way

abstract: It is well-known that active galactic nuclei (AGN) are accompanied by winds and outflows, some of which may reach weakly relativistic speeds of about $10$ percent the speed of light. Yet, in spite of their ubiquity, the impact of AGN outflows in modulating surface habitability of terrestrial planets on galactic scales, using the Milky Way as the basis for comparison, is poorly investigated and inadequately understood. In this work, we address this issue by focusing on two key mechanisms: AGN winds can heat atmospheres and drive atmospheric escape, as well as stimulate the formation of nitrogen oxides and thence cause ozone depletion. By developing simple models, we estimate the maximal distance up to which these deleterious effects are rendered significant for Earth-like planets in the Milky Way, and thereby demonstrate that this value may extend to $\lesssim 1$ kpc. In the case of quasars hosting larger supermassive black holes, such effects could actually influence the AGN host galaxy as a whole.


title: Plasmonic nanocrystals with complex shapes for photocatalysis and growth: Contrasting anisotropic hot-electron generation with the photothermal effect

abstract: In plasmonics, and particularly in plasmonic photochemistry, the effect of hot-electron generation is an exciting phenomenon driving new fundamental and applied research. However, obtaining a microscopic description of the hot-electron states represents a challenging problem, limiting our capability to design efficient nanoantennas exploiting these excited carriers. This paper addresses this limitation and studies the spatial distributions of the photophysical dynamic parameters controlling the local surface photochemistry on a plasmonic nanocrystal. We found that the generation of energetic electrons and holes in small plasmonic nanocrystals with complex shapes is strongly position-dependent and anisotropic, whereas the phototemperature across the nanocrystal surface is nearly uniform. Our formalism includes three mechanisms for the generation of excited carriers: the Drude process, the surface-assisted generation of hot-electrons in the sp-band, and the excitation of interband d-holes. Our computations show that the hot-carrier generation originating from these mechanisms reflects the internal structure of hot spots in nanocrystals with complex shapes. The injection of energetic carriers and increased surface phototemperature are driving forces for photocatalytic and photo-growth processes on the surface of plasmonic nanostructures. Therefore, developing a consistent microscopic theory of such processes is necessary for designing efficient nanoantennas for photocatalytic applications.


title: MuSE-SVS: Multi-Singer Emotional Singing Voice Synthesizer that Controls Emotional Intensity

abstract: We propose a multi-singer emotional singing voice synthesizer, Muse-SVS, that expresses emotion at various intensity levels by controlling subtle changes in pitch, energy, and phoneme duration while accurately following the score. To control multiple style attributes while avoiding loss of fidelity and expressiveness due to interference between attributes, Muse-SVS represents all attributes and their relations together by a joint embedding in a unified embedding space. Muse-SVS can express emotional intensity levels not included in the training data through embedding interpolation and extrapolation. We also propose a statistical pitch predictor to express pitch variance according to emotional intensity, and a context-aware residual duration predictor to prevent the accumulation of variances in phoneme duration, which is crucial for synchronization with instrumental parts. In addition, we propose a novel ASPP-Transformer, which combines atrous spatial pyramid pooling (ASPP) and Transformer, to improve fidelity and expressiveness by referring to broad contexts. In experiments, Muse-SVS exhibited improved fidelity, expressiveness, and synchronization performance compared with baseline models. The visualization results show that Muse-SVS effectively express the variance in pitch, energy, and phoneme duration according to emotional intensity. To the best of our knowledge, Muse-SVS is the first neural SVS capable of controlling emotional intensity.


title: New Sasaki-Einstein 5-manifolds

abstract: We prove that closed simply connected $5$-manifolds $2(S^2\times S^3)\# nM_2$ allow Sasaki-Einstein structures, where $M_2$ is the closed simply connected $5$-manifold with $\mathrm{H}_2(M_2,\mathbb{Z})=\mathbb{Z}/2\mathbb{Z}\oplus \mathbb{Z}/2\mathbb{Z}$, $nM_2$ is the $n$-fold connected sum of $M_2$, and $2(S^2\times S^3)$ is the two-fold connected sum of $S^2\times S^3$.


title: Quantum Anomalous Semimetals

abstract: The topological states of matter and topological materials have been attracting extensive interests as one of the frontier topics in condensed matter physics and materials science since the discovery of quantum Hall effect in 1980s. So far all the topological phases such as quantum Hall effect, quantum spin Hall effect and topological insulators and superconductors are characterized by a nonzero integer or Z and Z2 topological invariant. None is a half-integer or fractional. Here we propose a novel type of semimetals which hosts a single cone of Wilson fermions instead of Dirac fermions. The Wilson fermions possess linear dispersion near the energy crossing point, but breaks the chiral or parity symmetry such that an unpaired Dirac cone can be realized on a lattice. They are not prohibited by the Nielsen-Ninomiya theorem and avoid the fermion doubling problem. We find that the system can be classified by the relative homotopy group, and the topological invariant is a half-integer. We term the unexpected and nontrivial quantum phase as "quantum anomalous semimetal". The topological phase is a synergy of topology of band structure in solid and quantum anomaly in quantum field theory. The work opens the door towards exploring novel states of matter with fractional topological charge.


title: Cross-Layer Optimization: Joint User Scheduling and Beamforming Design With QoS Support in Joint Transmission Networks

abstract: User scheduling and beamforming design are two crucial yet coupled topics for wireless communication systems. They are usually optimized separately with conventional optimization methods. In this paper, a novel cross-layer optimization problem is considered, namely, the user scheduling and beamforming are jointly discussed subjecting to the requirement of per-user quality of service (QoS) and the maximum allowable transmit power for multicell multiuser joint transmission networks. To achieve the goal, a mixed discrete-continue variables combinational optimization problem is investigated with aiming at maximizing the sum rate of the communication system. To circumvent the original non-convex problem with dynamic solution space, we first transform it into a 0-1 integer and continue variables optimization problem, and then obtain a tractable form with continuous variables by exploiting the characteristics of 0-1 constraint. Finally, the scheduled users and the optimized beamforming vectors are simultaneously calculated by an alternating optimization algorithm. We also theoretically prove that the base stations allocate zero power to the unscheduled users. Furthermore, two heuristic optimization algorithms are proposed respectively based on brute-force search and greedy search. Numerical results validate the effectiveness of our proposed methods, and the optimization approach gets relatively balanced results compared with the other two approaches.


title: Sublinearly Morse Boundary of CAT(0) admissible groups

abstract: We show that if G is an admissible group acting geometrically on a CAT(0) space X, then G is a hierarchically hyperbolic space and with mild assumptions the sublinearly-Morse boundary of the group is a topological model for associated Poisson boundaries .


title: Continual Learning of Multi-modal Dynamics with External Memory

abstract: We study the problem of fitting a model to a dynamical environment when new modes of behavior emerge sequentially. The learning model is aware when a new mode appears, but it cannot access the true modes of individual training sequences. The state-of-the-art continual learning approaches cannot handle this setup, because parameter transfer suffers from catastrophic interference and episodic memory design requires the knowledge of the ground-truth modes of sequences. We devise a novel continual learning method that overcomes both limitations by maintaining a \textit{descriptor} of the mode of an encountered sequence in a neural episodic memory. We employ a Dirichlet Process prior on the attention weights of the memory to foster efficient storage of the mode descriptors. Our method performs continual learning by transferring knowledge across tasks by retrieving the descriptors of similar modes of past tasks to the mode of a current sequence and feeding this descriptor into its transition kernel as control input. We observe the continual learning performance of our method to compare favorably to the mainstream parameter transfer approach.


title: ES-dRNN with Dynamic Attention for Short-Term Load Forecasting

abstract: Short-term load forecasting (STLF) is a challenging problem due to the complex nature of the time series expressing multiple seasonality and varying variance. This paper proposes an extension of a hybrid forecasting model combining exponential smoothing and dilated recurrent neural network (ES-dRNN) with a mechanism for dynamic attention. We propose a new gated recurrent cell -- attentive dilated recurrent cell, which implements an attention mechanism for dynamic weighting of input vector components. The most relevant components are assigned greater weights, which are subsequently dynamically fine-tuned. This attention mechanism helps the model to select input information and, along with other mechanisms implemented in ES-dRNN, such as adaptive time series processing, cross-learning, and multiple dilation, leads to a significant improvement in accuracy when compared to well-established statistical and state-of-the-art machine learning forecasting models. This was confirmed in the extensive experimental study concerning STLF for 35 European countries.


title: Neuro-Symbolic Verification of Deep Neural Networks

abstract: Formal verification has emerged as a powerful approach to ensure the safety and reliability of deep neural networks. However, current verification tools are limited to only a handful of properties that can be expressed as first-order constraints over the inputs and output of a network. While adversarial robustness and fairness fall under this category, many real-world properties (e.g., "an autonomous vehicle has to stop in front of a stop sign") remain outside the scope of existing verification technology. To mitigate this severe practical restriction, we introduce a novel framework for verifying neural networks, named neuro-symbolic verification. The key idea is to use neural networks as part of the otherwise logical specification, enabling the verification of a wide variety of complex, real-world properties, including the one above. Moreover, we demonstrate how neuro-symbolic verification can be implemented on top of existing verification infrastructure for neural networks, making our framework easily accessible to researchers and practitioners alike.


title: Non-hermitian Dirac Hamiltonian in the presence of local Fermi velocity

abstract: We present a new approach to study a class of non-Hermitian (1+1)-dimensional Dirac Hamiltonian in the presence of local Fermi velocity. We apply the well known Nikiforov-Uvarov method to solve such a system. We discuss applications and explore the solvability of both $\mathcal{PT}$-symmetric and non-$\mathcal{PT}$ symmetric classes of potentials. In the former case we obtain the solution of a harmonic oscillator in the presence of a linear vector potential while in the latter case we solve the shifted harmonic oscillator problem.


title: Fast Decoding of AG Codes

abstract: We present an efficient list decoding algorithm in the style of Guruswami-Sudan for algebraic geometry codes. Our decoder can decode any such code using $\tilde{\mathcal O}(s\ell^{\omega}\mu^{\omega-1}(n+g))$ operations in the underlying finite field, where $n$ is the code length, $g$ is the genus of the function field used to construct the code, $s$ is the multiplicity parameter, $\ell$ is the designed list size and $\mu$ is the smallest positive element in the Weierstrass semigroup at some chosen place; the "soft-O" notation $\tilde{\mathcal O}(\cdot)$ is similar to the "big-O" notation ${\mathcal O}(\cdot)$, but ignores logarithmic factors. For the interpolation step, which constitutes the computational bottleneck of our approach, we use known algorithms for univariate polynomial matrices, while the root-finding step is solved using existing algorithms for root-finding over univariate power series.