title: Dunhuang murals contour generation network based on convolution and self-attention fusion

abstract: Dunhuang murals are a collection of Chinese style and national style, forming a self-contained Chinese-style Buddhist art. It has very high historical and cultural value and research significance. Among them, the lines of Dunhuang murals are highly general and expressive. It reflects the character's distinctive character and complex inner emotions. Therefore, the outline drawing of murals is of great significance to the research of Dunhuang Culture. The contour generation of Dunhuang murals belongs to image edge detection, which is an important branch of computer vision, aims to extract salient contour information in images. Although convolution-based deep learning networks have achieved good results in image edge extraction by exploring the contextual and semantic features of images. However, with the enlargement of the receptive field, some local detail information is lost. This makes it impossible for them to generate reasonable outline drawings of murals. In this paper, we propose a novel edge detector based on self-attention combined with convolution to generate line drawings of Dunhuang murals. Compared with existing edge detection methods, firstly, a new residual self-attention and convolution mixed module (Ramix) is proposed to fuse local and global features in feature maps. Secondly, a novel densely connected backbone extraction network is designed to efficiently propagate rich edge feature information from shallow layers into deep layers. Compared with existing methods, it is shown on different public datasets that our method is able to generate sharper and richer edge maps. In addition, testing on the Dunhuang mural dataset shows that our method can achieve very competitive performance.


title: Integer Subspace Differential Privacy

abstract: We propose new differential privacy solutions for when external \emph{invariants} and \emph{integer} constraints are simultaneously enforced on the data product. These requirements arise in real world applications of private data curation, including the public release of the 2020 U.S. Decennial Census. They pose a great challenge to the production of provably private data products with adequate statistical usability. We propose \emph{integer subspace differential privacy} to rigorously articulate the privacy guarantee when data products maintain both the invariants and integer characteristics, and demonstrate the composition and post-processing properties of our proposal. To address the challenge of sampling from a potentially highly restricted discrete space, we devise a pair of unbiased additive mechanisms, the generalized Laplace and the generalized Gaussian mechanisms, by solving the Diophantine equations as defined by the constraints. The proposed mechanisms have good accuracy, with errors exhibiting sub-exponential and sub-Gaussian tail probabilities respectively. To implement our proposal, we design an MCMC algorithm and supply empirical convergence assessment using estimated upper bounds on the total variation distance via $L$-lag coupling. We demonstrate the efficacy of our proposal with applications to a synthetic problem with intersecting invariants, a sensitive contingency table with known margins, and the 2010 Census county-level demonstration data with mandated fixed state population totals.


title: StructVPR: Distill Structural Knowledge with Weighting Samples for Visual Place Recognition

abstract: Visual place recognition (VPR) is usually considered as a specific image retrieval problem. Limited by existing training frameworks, most deep learning-based works cannot extract sufficiently stable global features from RGB images and rely on a time-consuming re-ranking step to exploit spatial structural information for better performance. In this paper, we propose StructVPR, a novel training architecture for VPR, to enhance structural knowledge in RGB global features and thus improve feature stability in a constantly changing environment. Specifically, StructVPR uses segmentation images as a more definitive source of structural knowledge input into a CNN network and applies knowledge distillation to avoid online segmentation and inference of seg-branch in testing. Considering that not all samples contain high-quality and helpful knowledge, and some even hurt the performance of distillation, we partition samples and weigh each sample's distillation loss to enhance the expected knowledge precisely. Finally, StructVPR achieves impressive performance on several benchmarks using only global retrieval and even outperforms many two-stage approaches by a large margin. After adding additional re-ranking, ours achieves state-of-the-art performance while maintaining a low computational cost.


title: How does your gyroid grow?: A mesoatomic perspective on supramolecular, soft matter network crystals

abstract: We propose a framework to understand supramolecular network crystals formed in soft matter in terms of mesoatomic building blocks, collective groupings of amphiphilic molecules that play a role analogous to atomic or molecular subunits of hard matter crystals. While the concept of mesoatoms is intuitive and widely invoked in crystalline arrangements of sphere- or cylinder-like (micelle-like) domains, analogous notions of physically meaningful building blocks of triply periodic network crystals, like the double-gyroid or double-diamond structures are obscured by the complex, bicontinuous domain shapes and intercatenated topologies of the double networks. Focusing on the example of diblock copolymer melts, we propose generic rules for decomposing triply-periodic network crystals into a unique set of mesoatomic building blocks, leading to mesoatomic volumes that are non-convex and bound by smoothly curved faces, unlike the more familiar polyhedral shapes associated with sphere- and cylinder-like mesoatoms. We analyze the shapes of these mesoatoms, their internal structure and importantly their local packing with neighbor mesoatomic units. Hypothesizing that mesoatoms are kinetically favored intermediate structures whose local shapes and packing template network crystal assembly on long time scales, we propose and study a minimal energetic model of mesoatom assembly for three different cubic double-network crystals, which predicts a detailed picture for kinetics of intercatenation and surface growth. We discuss potential extensions and elaborations of the mesoatomic description of supramolecular soft matter network crystals, experimental observations of malleable mesoatomic units in the precursor sponge phase as well as in ordered cubic networks, as well as possibilities for observing mesoatoms in primordial, pre-crystalline states.


title: DisaggRec: Architecting Disaggregated Systems for Large-Scale Personalized Recommendation

abstract: Deep learning-based personalized recommendation systems are widely used for online user-facing services in production datacenters, where a large amount of hardware resources are procured and managed to reliably provide low-latency services without disruption. As the recommendation models continue to evolve and grow in size, our analysis projects that datacenters deployed with monolithic servers will spend up to 12.4x total cost of ownership (TCO) to meet the requirement of model size and complexity over the next three years. Moreover, through in-depth characterization, we reveal that the monolithic server-based cluster suffers resource idleness and wastes up to 30% TCO by provisioning resources in fixed proportions. To address this challenge, we propose DisaggRec, a disaggregated system for large-scale recommendation serving. DisaggRec achieves the independent decoupled scaling-out of the compute and memory resources to match the changing demands from fast-evolving workloads. It also improves system reliability by segregating the failures of compute nodes and memory nodes. These two main benefits from disaggregation collectively reduce the TCO by up to 49.3%. Furthermore, disaggregation enables flexible and agile provisioning of increasing hardware heterogeneity in future datacenters. By deploying new hardware featuring near-memory processing capability, our evaluation shows that the disaggregated cluster achieves 21%-43.6% TCO savings over the monolithic server-based cluster across a three-year span of model evolution.


title: Binocular Localization Using Resonant Beam

abstract: Locating mobile devices precisely in indoor scenarios is a challenging task because of the signal diffraction and reflection in complicated environments. One vital cause deteriorating the localization performance is the inevitable power dissipation along the propagation path of localization signals. In this paper, we propose a high-accuracy localization scheme based on the resonant beam system (RBS) and the binocular vision, i.e., binocular based resonant beam localization (BRBL). The BRBL system utilizes the energy-concentrated and self-aligned transmission of RBS to realize high-efficiency signal propagation and self-positioning for the target. The binocular method is combined with RBS to obtain the three-dimensional (3-D) coordinates of the target for the first time. To exhibit the localization mechanism, we first elaborate on the binocular localization model, including the resonant beam transmission analysis and the geometric derivation of the binocular method with RBS. Then, we establish the power model of RBS, and the signal and noise models of beam spot imaging, respectively, to analyse the performance of the BRBL system. Finally, the numerical results show an outstanding performance of centimeter level accuracy (i.e., $<5\mathrm{cm}$ in $0.4\mathrm{m}$ width and $0.4\mathrm{m}$ length effective range at $1\mathrm{m}$ vertical distance, $<13\mathrm{cm}$ in $0.6\mathrm{m}$ width and $0.6\mathrm{m}$ length effective range at $2\mathrm{m}$ vertical distance), which applies to indoor scenarios.


title: Adaptive Exploration and Optimization of Materials Crystal Structures

abstract: A central problem of materials science is to determine whether a hypothetical material is stable without being synthesized, which is mathematically equivalent to a global optimization problem on a highly non-linear and multi-modal potential energy surface (PES). This optimization problem poses multiple outstanding challenges, including the exceedingly high dimensionality of the PES and that PES must be constructed from a reliable, sophisticated, parameters-free, and thus, very expensive computational method, for which density functional theory (DFT) is an example. DFT is a quantum mechanics based method that can predict, among other things, the total potential energy of a given configuration of atoms. DFT, while accurate, is computationally expensive. In this work, we propose a novel expansion-exploration-exploitation framework to find the global minimum of the PES. Starting from a few atomic configurations, this ``known'' space is expanded to construct a big candidate set. The expansion begins in a non-adaptive manner, where new configurations are added without considering their potential energy. A novel feature of this step is that it tends to generate a space-filling design without the knowledge of the boundaries of the domain space. If needed, the non-adaptive expansion of the space of configurations is followed by adaptive expansion, where ``promising regions'' of the domain space (those with low energy configurations) are further expanded. Once a candidate set of configurations is obtained, it is simultaneously explored and exploited using Bayesian optimization to find the global minimum. The methodology is demonstrated using a problem of finding the most stable crystal structure of Aluminum.


title: A Geometric-Relational Deep Learning Framework for BIM Object Classification

abstract: Interoperability issue is a significant problem in Building Information Modeling (BIM). Object type, as a kind of critical semantic information needed in multiple BIM applications like scan-to-BIM and code compliance checking, also suffers when exchanging BIM data or creating models using software of other domains. It can be supplemented using deep learning. Current deep learning methods mainly learn from the shape information of BIM objects for classification, leaving relational information inherent in the BIM context unused. To address this issue, we introduce a two-branch geometric-relational deep learning framework. It boosts previous geometric classification methods with relational information. We also present a BIM object dataset IFCNet++, which contains both geometric and relational information about the objects. Experiments show that our framework can be flexibly adapted to different geometric methods. And relational features do act as a bonus to general geometric learning methods, obviously improving their classification performance, thus reducing the manual labor of checking models and improving the practical value of enriched BIM models.


title: Barcode entropy of geodesic flows

abstract: We introduce and study the barcode entropy for geodesic flows of closed Riemannian manifolds, which measures the exponential growth rate of the number of not-too-short bars in the Morse-theoretic barcode of the energy functional. We prove that the barcode entropy bounds from below the topological entropy of the geodesic flow and, conversely, bounds from above the topological entropy of any hyperbolic compact invariant set. As a consequence, for Riemannian metrics on surfaces, the barcode entropy is equal to the topological entropy. A key to the proofs and of independent interest is a crossing energy theorem for gradient flow lines of the energy functional.


title: A $4/3\cdot OPT+2/3$ approximation for big two-bar charts packing problem

abstract: Two-Bar Charts Packing Problem is to pack $n$ two-bar charts (2-BCs) in a minimal number of unit-capacity bins. This problem generalizes the strongly NP-hard Bin Packing Problem. We prove that the problem remains strongly NP-hard even if each 2-BC has at least one bar higher than 1/2. Next we consider the case when the first (or second) bar of each 2-BC is higher than 1/2 and show that the $O(n^2)$-time greedy algorithm with preliminary lexicographic ordering of 2-BCs constructs a packing of length at most $OPT+1$, where $OPT$ is optimum. Eventually, this result allowed us to present an $O(n^{2.5})$-time algorithm that constructs a packing of length at most $4/3\cdot OPT+2/3$ for the NP-hard case when each 2-BC has at least one bar higher than 1/2.


title: Nonadiabatic to Adiabatic Transition of Electron Transfer in Colloidal Quantum Dot Molecules

abstract: Electron transfer is an important and fundamental process in chemistry, biology and physics, and has received significant attention in recent years. Perhaps one of the most intriguing questions concerns with the realization of the transitions between nonadiabatic and adiabatic regimes of electron transfer, as the coupling (hybridization) energy, $J$, between the donor and acceptor is varied. Here, using colloidal quantum dot molecules, a new class of coupled quantum dot dimers, we computationally demonstrate how the hybridization energy between the donor and acceptor quantum dots can be tuned by simply changing the neck dimensions and/or the quantum dot size. This provides a handle to tune the electron transfer from the nonadiabatic over-damped Marcus regime to the coherent adiabatic regime in a single system, without changing the reorganization energy, $\lambda$, or the typical phonon frequency, $\omega_c$. We develop an atomistic model to account for several donor and acceptor states and how they couple to the lattice vibrations, and utilize the Ehrenfest mean-field mixed quantum-classical method to describe the charge transfer dynamics as the nonadiabatic parameter, $\gamma$, is varied. We find that charge transfer rates increase by several orders of magnitude as the system is driven to the coherent, adiabatic limit, even at elevated temperatures, and delineate the inter-dot and torsional acoustic modes that couple most strongly to the charge transfer reaction coordinate.


title: Trie-Compressed Intersectable Sets

abstract: We introduce space- and time-efficient algorithms and data structures for the offline set intersection problem. We show that a sorted integer set $S \subseteq [0{..}u)$ of $n$ elements can be represented using compressed space while supporting $k$-way intersections in adaptive $O(k\delta\lg{\!(u/\delta)})$ time, $\delta$ being the alternation measure introduced by Barbay and Kenyon. Our experimental results suggest that our approaches are competitive in practice, outperforming the most efficient alternatives (Partitioned Elias-Fano indexes, Roaring Bitmaps, and Recursive Universe Partitioning (RUP)) in several scenarios, offering in general relevant space-time trade-offs.


title: Quantitative bounds for unconditional pairs of frames

abstract: We formulate a quantitative finite-dimensional conjecture about frame multipliers and prove that it is equivalent to Conjecture 1 in [SB2]. We then present solutions to the conjecture for certain classes of frame multipliers. In particular, we prove that there is a universal constant $\kappa>0$ so that for all $C,\beta>0$ and $N\in\mathbb{N}$ the following is true. Let $(x_j)_{j=1}^N$ and $(f_j)_{j=1}^N$ be sequences in a finite dimensional Hilbert space which satisfy $\|x_j\|=\|f_j\|$ for all $1\leq j\leq N$ and $$\Big\|\sum_{j=1}^N \varepsilon_j\langle x,f_j\rangle x_j\Big\|\leq C\|x\|, \qquad\textrm{ for all $x\in \ell_2^M$ and $|\varepsilon_j|=1$}. $$ If the frame operator for $(f_j)_{j=1}^N$ has eigenvalues $\lambda_1\geq...\geq\lambda_M$ and $\lambda_1\leq \beta M^{-1}\sum_{j=1}^M\lambda_j$ then $(f_j)_{j=1}^N$ has Bessel bound $\kappa \beta^2 C$. The same holds for $(x_j)_{j=1}^N$.


title: A Potential New Mechanism for the Butterfly Diagram of the Solar Cycle: Latitude-dependent Radial Flux Transport

abstract: The butterfly diagram of the solar cycle is the equatorward migration of the emergence latitudes of sunspots as the solar cycle evolves. Revealing the mechanism for the butterfly diagram is essential for understanding the solar and stellar dynamo. The equatorward meridional flow at the base of the convection zone (CZ) was believed to be responsible for the butterfly diagram. However, helioseismological studies indicate controversial forms of the flow, and even present poleward flow at the base of the CZ, which poses a big challenge to the widely accepted mechanism. This motivates us to propose a new mechanism in this study. Using a data-driven Babcock-Leighton-type dynamo model, we carry out numerical simulations to explore how the latitude-dependent radial flux transport affects the latitudinal migration of the toroidal field, under different meridional flow profiles. The results indicate that when the radial transport of the poloidal field at higher latitudes is sufficiently faster, the toroidal fields of a new cycle at higher latitudes are generated earlier than that at lower latitudes, and vice versa. Thus, the butterfly diagram is suggested to correspond to the time- and latitude-dependent regeneration of the toroidal field due to the latitude-dependent radial transport of the poloidal flux.


title: On the Fast Track: Rapid construction of stellar stream paths

abstract: Stellar streams are sensitive probes of the Galactic potential. The likelihood of a stream model given stream data is often assessed using simulations. However, comparing to simulations is challenging when even the stream paths can be hard to quantify. Here we present a novel application of Self-Organizing Maps and first-order Kalman Filters to reconstruct a stream's path, propagating measurement errors and data sparsity into the stream path uncertainty. The technique is Galactic-model independent, non-parametric, and works on phase-wrapped streams. With this technique, we can uniformly analyze and compare data with simulations, enabling both comparison of simulation techniques and ensemble analysis with stream tracks of many stellar streams. Our method is implemented in the public Python package TrackStream, available at https://github.com/nstarman/trackstream.


title: Gravitational lensing modification of the high redshift galaxy luminosity function

abstract: The bright end of the rest-frame UV luminosity function (UVLF) of high-redshift galaxies is modified by gravitational lensing magnification bias. Motivated by recent discoveries of very high-z galaxies with JWST, we study the dependence of magnification bias on the finite size of sources at $6<z<14$. We calculate the magnification probability distributions and use these to calculate the magnification bias assuming a rest-frame Schechter UVLF for galaxies at redshift $6<z<14$. We find that the finite size of bright high-redshift galaxies together with lens ellipticity significantly suppresses magnification bias, producing an observed bright end which declines more sharply than the power-law resulting from assumption of point sources. By assuming a luminosity-size relation for the source population and comparing with the observed $z=6$ galaxy luminosity function from Harikane+(2022), we show that the UVLF can be used to set mild constraints on the galaxies intrinsic size, favoring smaller galaxies compared to the fiducial luminosity-size relation. In the future, wide surveys using Euclid and Roman Space Telescope will place stronger constraints. We also tabulate the maximum magnification possible as a function of source size and lens ellipticity.


title: SimpleMind adds thinking to deep neural networks

abstract: Deep neural networks (DNNs) detect patterns in data and have shown versatility and strong performance in many computer vision applications. However, DNNs alone are susceptible to obvious mistakes that violate simple, common sense concepts and are limited in their ability to use explicit knowledge to guide their search and decision making. While overall DNN performance metrics may be good, these obvious errors, coupled with a lack of explainability, have prevented widespread adoption for crucial tasks such as medical image analysis. The purpose of this paper is to introduce SimpleMind, an open-source software framework for Cognitive AI focused on medical image understanding. It allows creation of a knowledge base that describes expected characteristics and relationships between image objects in an intuitive human-readable form. The SimpleMind framework brings thinking to DNNs by: (1) providing methods for reasoning with the knowledge base about image content, such as spatial inferencing and conditional reasoning to check DNN outputs; (2) applying process knowledge, in the form of general-purpose software agents, that are chained together to accomplish image preprocessing, DNN prediction, and result post-processing, and (3) performing automatic co-optimization of all knowledge base parameters to adapt agents to specific problems. SimpleMind enables reasoning on multiple detected objects to ensure consistency, providing cross checking between DNN outputs. This machine reasoning improves the reliability and trustworthiness of DNNs through an interpretable model and explainable decisions. Example applications are provided that demonstrate how SimpleMind supports and improves deep neural networks by embedding them within a Cognitive AI framework.


title: On the Limit of Explaining Black-box Temporal Graph Neural Networks

abstract: Temporal Graph Neural Network (TGNN) has been receiving a lot of attention recently due to its capability in modeling time-evolving graph-related tasks. Similar to Graph Neural Networks, it is also non-trivial to interpret predictions made by a TGNN due to its black-box nature. A major approach tackling this problems in GNNs is by analyzing the model' responses on some perturbations of the model's inputs, called perturbation-based explanation methods. While these methods are convenient and flexible since they do not need internal access to the model, does this lack of internal access prevent them from revealing some important information of the predictions? Motivated by that question, this work studies the limit of some classes of perturbation-based explanation methods. Particularly, by constructing some specific instances of TGNNs, we show (i) node-perturbation cannot reliably identify the paths carrying out the prediction, (ii) edge-perturbation is not reliable in determining all nodes contributing to the prediction and (iii) perturbing both nodes and edges does not reliably help us identify the graph's components carrying out the temporal aggregation in TGNNs.


title: Few-Shot Nested Named Entity Recognition

abstract: While Named Entity Recognition (NER) is a widely studied task, making inferences of entities with only a few labeled data has been challenging, especially for entities with nested structures. Unlike flat entities, entities and their nested entities are more likely to have similar semantic feature representations, drastically increasing difficulties in classifying different entity categories in the few-shot setting. Although prior work has briefly discussed nested structures in the context of few-shot learning, to our best knowledge, this paper is the first one specifically dedicated to studying the few-shot nested NER task. Leveraging contextual dependency to distinguish nested entities, we propose a Biaffine-based Contrastive Learning (BCL) framework. We first design a Biaffine span representation module for learning the contextual span dependency representation for each entity span rather than only learning its semantic representation. We then merge these two representations by the residual connection to distinguish nested entities. Finally, we build a contrastive learning framework to adjust the representation distribution for larger margin boundaries and more generalized domain transfer learning ability. We conducted experimental studies on three English, German, and Russian nested NER datasets. The results show that the BCL outperformed three baseline models on the 1-shot and 5-shot tasks in terms of F1 score.


title: The most probable host of CHIME FRB 190425A, associated with binary neutron star merger GW190425, and a late-time transient search

abstract: The identification and localization of Fast Radio Bursts to their host galaxies has revealed important details about the progenitors of these mysterious, millisecond-long bursts of coherent radio emission. In this work we study the most probable host galaxy of the apparently non-repeating CHIME/FRB event FRB 20190425A -- a particularly high luminosity, low dispersion measure event that was demonstrated by Moroianu et al. 2022 to be temporally and spatially coincident with the LIGO-Virgo-KAGRA binary neutron star merger GW190425, suggesting an astrophysical association (p-value 0.0052). In this paper we remain agnostic to this result, and we confirm UGC10667 as the most probable host galaxy of FRB 20190425A, demonstrating that the host galaxies of low dispersion measure, one-off CHIME FRBs can be plausibly identified. We then perform multi-wavelength observations to characterize the galaxy and search for any afterglow emission associated with the FRB and its putative GW counterpart. We find no radio or optical transient emission in our observations $2.5\,\mathrm{yr}$ post-burst. UGC10667 is a spiral galaxy at $z\sim0.03$, dominated by an old stellar population. We find no evidence of a large population of young stars, with nebular emission dominated by star formation at a rate of $1-2\,\mathrm{M_\odot\,yr^{-1}}$. While we cannot rule out a young magnetar as the origin of FRB 20190425A, our observations are consistent with an origin in a long delay-time neutron star binary merger as posited by Moroianu et al. 2022.


title: Prim-LAfD: A Framework to Learn and Adapt Primitive-Based Skills from Demonstrations for Insertion Tasks

abstract: Learning generalizable insertion skills in a data-efficient manner has long been a challenge in the robot learning community. While the current state-of-the-art methods with reinforcement learning (RL) show promising performance in acquiring manipulation skills, the algorithms are data-hungry and hard to generalize. To overcome the issues, in this paper we present Prim-LAfD, a simple yet effective framework to learn and adapt primitive-based insertion skills from demonstrations. Prim-LAfD utilizes black-box function optimization to learn and adapt the primitive parameters leveraging prior experiences. Human demonstrations are modeled as dense rewards guiding parameter learning. We validate the effectiveness of the proposed method on eight peg-hole and connector-socket insertion tasks. The experimental results show that our proposed framework takes less than one hour to acquire the insertion skills and as few as fifteen minutes to adapt to an unseen insertion task on a physical robot.


title: Exploring The Relationship Between Road Infrastructure and Crimes in Memphis, Tennessee

abstract: Memphis, Tennessee is one of the cities with highest crime rate in the United States. In this work, we explore the relationship between road infrastructure, especially potholes, and crimes. The pothole and crime data are collected from Memphis Data Hub between 2020 and 2022. The crime data report various crimes in the Memphis area, which contain the location, time, and type of the crime. The pothole data is part of the Open 311 data, which contains information of different infrastructure projects, including the location of the project, and the starting and ending dates of the project. We focus on infrastructure projects regarding pothole repairs.


title: First-principles study of the bandgap renormalization and optical property of ${\beta}$-LiGaO$_2$

abstract: ${\beta}$-LiGaO$_2$ with an orthorhombic wurtzite-derived structure is a candidate ultrawide direct-bandgap semiconductor. In this work, using the non-adiabatic Allen-Heine-Cardona approach, we investigate the bandgap renormalization arising from electron-phonon coupling. We find a sizable zero-point motion correction of -0.362 eV to the gap at ${\Gamma}$, which is dominated by the contributions of long-wavelength longitudinal optical phonons. The bandgap of ${\beta}$-LiGaO$_2$ decreases monotonically with increasing temperature. We investigate the optical spectra by comparing the model Bethe-Salpether equation method with the independent-particle approximation. The calculated optical spectra including electron-hole interactions exhibit strong excitonic effects, in qualitative agreement with experiment. The contributing interband transitions and the binding energy for the excitonic states are analyzed.


title: A local central limit theorem for random walks on expander graphs

abstract: There is a long history of establishing central limit theorems for Markov chains. Quantitative bounds for chains with a spectral gap were proved by Mann and refined later. Recently, rates of convergence for the total variation distance were obtained for random walks on expander graphs, which are often used to generate sequences satisfying desirable pseudorandom properties. We prove a local central limit theorem with an explicit rate of convergence for random walks on expander graphs, and derive an improved bound for the total variation distance.


title: UniKGQA: Unified Retrieval and Reasoning for Solving Multi-hop Question Answering Over Knowledge Graph

abstract: Multi-hop Question Answering over Knowledge Graph~(KGQA) aims to find the answer entities that are multiple hops away from the topic entities mentioned in a natural language question on a large-scale Knowledge Graph (KG). To cope with the vast search space, existing work usually adopts a two-stage approach: it first retrieves a relatively small subgraph related to the question and then performs the reasoning on the subgraph to find the answer entities accurately. Although these two stages are highly related, previous work employs very different technical solutions for developing the retrieval and reasoning models, neglecting their relatedness in task essence. In this paper, we propose UniKGQA, a novel approach for multi-hop KGQA task, by unifying retrieval and reasoning in both model architecture and parameter learning. For model architecture, UniKGQA consists of a semantic matching module based on a pre-trained language model~(PLM) for question-relation semantic matching, and a matching information propagation module to propagate the matching information along the directed edges on KGs. For parameter learning, we design a shared pre-training task based on question-relation matching for both retrieval and reasoning models, and then propose retrieval- and reasoning-oriented fine-tuning strategies. Compared with previous studies, our approach is more unified, tightly relating the retrieval and reasoning stages. Extensive experiments on three benchmark datasets have demonstrated the effectiveness of our method on the multi-hop KGQA task. Our codes and data are publicly available at~\url{https://github.com/RUCAIBox/UniKGQA}.


title: Small amplitude ion-acoustic solitary waves in a four-component magneto-rotating plasma with a modified Cairns-Tsallis distribution

abstract: The small amplitude ion-acoustic solitary waves in the magneto-rotating plasma consisting of cold fluid ions, hot positrons, and the two-temperature electrons (cold and hot electrons) are investigated when the electrons obey a modified Cairns-Tsallis distribution. By using the reductive perturbation method, we derive the Korteweg-de Vries equation and the modified Korteweg-de Vries equation and obtain the small amplitude ion-acoustic solitary wave solutions. The dependences of solitary wave solutions on the nonextensive q-parameter, the nonthermal alpha-parameter and the plasma physical quantities are analyzed numerically. We show the significant effects of the nonextensive q-parameter and the nonthermal alpha-parameter etc. on the ion-acoustic solitary waves.


title: Modeling and Optimization of Steady Flow of Natural Gas and Hydrogen Mixtures in Pipeline Networks

abstract: We extend the canonical problems of simulation and optimization of steady-state gas flows in pipeline networks with compressors to the transport of mixtures of highly heterogeneous gases injected throughout a network. Our study is motivated by proposed projects to blend hydrogen generated using clean energy into existing natural gas pipeline systems as part of efforts to reduce the reliance of energy systems on fossil fuels. Flow in a pipe is related to endpoint pressures by a basic Weymouth equation model, with an ideal gas equation of state, where the wave speed depends on the hydrogen concentration. At vertices, in addition to mass balance, we also consider mixing of incoming flows of varying hydrogen concentrations. The problems of interest are the heterogeneous gas flow simulation (HGFS), which determines system pressures and flows given fixed boundary conditions and compressor settings, as well as the heterogeneous gas flow optimization (HGFO), which extremizes an objective by determining optimal boundary conditions and compressor settings. We examine conditions for uniqueness of solutions to the HGFS, as well as compare and contrast mixed-integer and continuous nonlinear programming formulations for the HGFO. We develop computational methods to solve both problems, and examine their performance using four test networks of increasing complexity.


title: Celestial amplitudes in an ambidextrous basis

abstract: We start by constructing a conformally covariant improvement of the celestial light transform which keeps track of the mixing between incoming and outgoing states under finite Lorentz transformations in $\mathbb{R}^{2,2}$. We then compute generic 2, 3 and 4-point celestial amplitudes for massless external states in the ambidextrous basis prepared by composing this $\mathrm{SL}(2,\mathbb{R})$ intertwiner with the usual celestial map between momentum and boost eigenstates. The results are non-distributional in the celestial coordinates $(z,\bar{z})$ and conformally covariant in all scattering channels. Finally, we focus on the tree level 4-gluon amplitude where we present a streamlined route to the ambidextrous correlator based on Grassmannian formulae and examine its alpha space representation. In the process, we gain insights into the operator dictionary and CFT data of the holographic dual.


title: Yang-Baxter maps and independence preserving property

abstract: We study a surprising relationship between two properties for bijective functions $F : \mathcal{X} \times \mathcal{X} \to \mathcal{X} \times \mathcal{X}$ for a set $\mathcal{X}$ which are introduced from very different backgrounds. One of the property is that $F$ is a Yang-Baxter map, namely it satisfies the "set-theoretical" Yang-Baxter equation, and the other property is the independence preserving property (IP property for short), which means that there exist independent (non-constant) $\mathcal{X}$-valued random variables $X,Y$ such that $U,V$ are also independent with $(U,V)=F(X,Y)$. Recently in the study of invariant measures for a discrete integrable system, a class of functions having these two properties were found. Motivated by this, we analyze a relationship between the Yang-Baxter maps and the IP property, which has never been studied as far as we are aware, focusing on the case $\mathcal{X}=\mathbb{R}_+$. Our first main result is that all quadrirational Yang-Baxter maps $F : \mathbb{R}_+ \times \mathbb{R}_+ \to \mathbb{R}_+ \times \mathbb{R}_+$ in the most interesting subclass have the independence preserving property. In particular, we find new classes of bijections having the IP property. Our second main result is that these newly introduce bijections are fundamental in the class of (known) bijections with the IP property, in the sense that most of known bijections having the IP property are derived from these maps by taking special parameters or performing some limiting procedure. This reveals that the IP property, which has been investigated for specific functions individually, can be understood in a unified manner.


title: JAX-FEM: A differentiable GPU-accelerated 3D finite element solver for automatic inverse design and mechanistic data science

abstract: This paper introduces JAX-FEM, an open-source differentiable finite element method (FEM) library. Constructed on top of Google JAX, a rising machine learning library focusing on high-performance numerical computing, JAX-FEM is implemented with pure Python while scalable to efficiently solve problems with moderate to large sizes. For example, in a 3D tensile loading problem with 7.7 million degrees of freedom, JAX-FEM with GPU achieves around 10$\times$ acceleration compared to a commercial FEM code depending on platform. Beyond efficiently solving forward problems, JAX-FEM employs the automatic differentiation technique so that inverse problems are solved in a fully automatic manner without the need to manually derive sensitivities. Examples of 3D topology optimization of nonlinear materials are shown to achieve optimal compliance. Finally, JAX-FEM is an integrated platform for machine learning-aided computational mechanics. We show an example of data-driven multi-scale computations of a composite material where JAX-FEM provides an all-in-one solution from microscopic data generation and model training to macroscopic FE computations. The source code of the library and these examples are shared with the community to facilitate computational mechanics research.


title: AL-iGAN: An Active Learning Framework for Tunnel Geological Reconstruction Based on TBM Operational Data

abstract: In tunnel boring machine (TBM) underground projects, an accurate description of the rock-soil types distributed in the tunnel can decrease the construction risk ({\it e.g.} surface settlement and landslide) and improve the efficiency of construction. In this paper, we propose an active learning framework, called AL-iGAN, for tunnel geological reconstruction based on TBM operational data. This framework contains two main parts: one is the usage of active learning techniques for recommending new drilling locations to label the TBM operational data and then to form new training samples; and the other is an incremental generative adversarial network for geological reconstruction (iGAN-GR), whose weights can be incrementally updated to improve the reconstruction performance by using the new samples. The numerical experiment validate the effectiveness of the proposed framework as well.


title: A Hybrid Deep Learning Anomaly Detection Framework for Intrusion Detection

abstract: Cyber intrusion attacks that compromise the users' critical and sensitive data are escalating in volume and intensity, especially with the growing connections between our daily life and the Internet. The large volume and high complexity of such intrusion attacks have impeded the effectiveness of most traditional defence techniques. While at the same time, the remarkable performance of the machine learning methods, especially deep learning, in computer vision, had garnered research interests from the cyber security community to further enhance and automate intrusion detections. However, the expensive data labeling and limitation of anomalous data make it challenging to train an intrusion detector in a fully supervised manner. Therefore, intrusion detection based on unsupervised anomaly detection is an important feature too. In this paper, we propose a three-stage deep learning anomaly detection based network intrusion attack detection framework. The framework comprises an integration of unsupervised (K-means clustering), semi-supervised (GANomaly) and supervised learning (CNN) algorithms. We then evaluated and showed the performance of our implemented framework on three benchmark datasets: NSL-KDD, CIC-IDS2018, and TON_IoT.


title: Genetic underpinnings of brain structural connectome for young adults

abstract: With distinct advantages in power over behavioral phenotypes, brain imaging traits have become emerging endophenotypes to dissect molecular contributions to behaviors and neuropsychiatric illnesses. Among different imaging features, brain structural connectivity (i.e., structural connectome), which summarizes the anatomical connections between different brain regions, is one of the most cutting-edge while under-investigated traits; and the genetic influence on the structural connectome variation remains highly elusive. Relying on a landmark imaging genetics study for young adults, we develop a biologically plausible brain network response shrinkage model to comprehensively characterize the relationship between high dimensional genetic variants and the structural connectome phenotype. Under a unified Bayesian framework, we accommodate the topology of brain network and biological architecture within the genome; and eventually establish a mechanistic mapping between genetic biomarkers and the associated brain sub-network units. An efficient expectation-maximization algorithm is developed to estimate the model and ensure computing feasibility. In the application to the Human Connectome Project Young Adult (HCP-YA) data, we establish the genetic underpinnings which are highly interpretable under functional annotation and brain tissue eQTL analysis, for the brain white matter tracts connecting the hippocampus and two cerebral hemispheres. We also show the superiority of our method in extensive simulations.


title: UIU-Net: U-Net in U-Net for Infrared Small Object Detection

abstract: Learning-based infrared small object detection methods currently rely heavily on the classification backbone network. This tends to result in tiny object loss and feature distinguishability limitations as the network depth increases. Furthermore, small objects in infrared images are frequently emerged bright and dark, posing severe demands for obtaining precise object contrast information. For this reason, we in this paper propose a simple and effective ``U-Net in U-Net'' framework, UIU-Net for short, and detect small objects in infrared images. As the name suggests, UIU-Net embeds a tiny U-Net into a larger U-Net backbone, enabling the multi-level and multi-scale representation learning of objects. Moreover, UIU-Net can be trained from scratch, and the learned features can enhance global and local contrast information effectively. More specifically, the UIU-Net model is divided into two modules: the resolution-maintenance deep supervision (RM-DS) module and the interactive-cross attention (IC-A) module. RM-DS integrates Residual U-blocks into a deep supervision network to generate deep multi-scale resolution-maintenance features while learning global context information. Further, IC-A encodes the local context information between the low-level details and high-level semantic features. Extensive experiments conducted on two infrared single-frame image datasets, i.e., SIRST and Synthetic datasets, show the effectiveness and superiority of the proposed UIU-Net in comparison with several state-of-the-art infrared small object detection methods. The proposed UIU-Net also produces powerful generalization performance for video sequence infrared small object datasets, e.g., ATR ground/air video sequence dataset. The codes of this work are available openly at \url{https://github.com/danfenghong/IEEE_TIP_UIU-Net}.


title: Energy pathways in large- and small-scale convection-driven dynamos

abstract: We investigate the energy pathways between the velocity and the magnetic fields in a rotating plane layer dynamo driven by Rayleigh-B\'enard convection using direct numerical simulations. The kinetic and magnetic energies are divided into mean and turbulent components to study the production, transport, and dissipation associated with large and small-scale dynamos. This energy balance-based characterization reveals distinct mechanisms for large- and small-scale magnetic field generation in dynamos, depending on the nature of the velocity field and the conditions imposed at the boundaries.

categories: physics.flu-dyn astro-ph.EP astro-ph.SR physics.geo-ph physics.plasm-ph


title: Bayesian Physics Informed Neural Networks for Data Assimilation and Spatio-Temporal Modelling of Wildfires

abstract: We apply the Physics Informed Neural Network (PINN) to the problem of wildfire fire-front modelling. We use the PINN to solve the level-set equation, which is a partial differential equation that models a fire-front through the zero-level-set of a level-set function. The result is a PINN that simulates a fire-front as it propagates through the spatio-temporal domain. We show that popular optimisation cost functions used in the literature can result in PINNs that fail to maintain temporal continuity in modelled fire-fronts when there are extreme changes in exogenous forcing variables such as wind direction. We thus propose novel additions to the optimisation cost function that improves temporal continuity under these extreme changes. Furthermore, we develop an approach to perform data assimilation within the PINN such that the PINN predictions are drawn towards observations of the fire-front. Finally, we incorporate our novel approaches into a Bayesian PINN (B-PINN) to provide uncertainty quantification in the fire-front predictions. This is significant as the standard solver, the level-set method, does not naturally offer the capability for data assimilation and uncertainty quantification. Our results show that, with our novel approaches, the B-PINN can produce accurate predictions with high quality uncertainty quantification on real-world data.


title: Discovering Governing Equations in Discrete Systems Using PINNs

abstract: Sparse identification of nonlinear dynamical systems is a topic of continuously increasing significance in the dynamical systems community. Here we explore it at the level of lattice nonlinear dynamical systems of many degrees of freedom. We illustrate the ability of a suitable adaptation of Physics-Informed Neural Networks (PINNs) to solve the inverse problem of parameter identification in such discrete, high-dimensional systems inspired by physical applications. The methodology is illustrated in a diverse array of examples including real-field ones ($\phi^4$ and sine-Gordon), as well as complex-field (discrete nonlinear Schr{\"o}dinger equation) and going beyond Hamiltonian to dissipative cases (the discrete complex Ginzburg-Landau equation). Both the successes, as well as some limitations of the method are discussed along the way.


title: Cloud-Device Collaborative Adaptation to Continual Changing Environments in the Real-world

abstract: When facing changing environments in the real world, the lightweight model on client devices suffers from severe performance drops under distribution shifts. The main limitations of the existing device model lie in (1) unable to update due to the computation limit of the device, (2) the limited generalization ability of the lightweight model. Meanwhile, recent large models have shown strong generalization capability on the cloud while they can not be deployed on client devices due to poor computation constraints. To enable the device model to deal with changing environments, we propose a new learning paradigm of Cloud-Device Collaborative Continual Adaptation, which encourages collaboration between cloud and device and improves the generalization of the device model. Based on this paradigm, we further propose an Uncertainty-based Visual Prompt Adapted (U-VPA) teacher-student model to transfer the generalization capability of the large model on the cloud to the device model. Specifically, we first design the Uncertainty Guided Sampling (UGS) to screen out challenging data continuously and transmit the most out-of-distribution samples from the device to the cloud. Then we propose a Visual Prompt Learning Strategy with Uncertainty guided updating (VPLU) to specifically deal with the selected samples with more distribution shifts. We transmit the visual prompts to the device and concatenate them with the incoming data to pull the device testing distribution closer to the cloud training distribution. We conduct extensive experiments on two object detection datasets with continually changing environments. Our proposed U-VPA teacher-student framework outperforms previous state-of-the-art test time adaptation and device-cloud collaboration methods. The code and datasets will be released.


title: A Domain-Knowledge-Inspired Music Embedding Space and a Novel Attention Mechanism for Symbolic Music Modeling

abstract: Following the success of the transformer architecture in the natural language domain, transformer-like architectures have been widely applied to the domain of symbolic music recently. Symbolic music and text, however, are two different modalities. Symbolic music contains multiple attributes, both absolute attributes (e.g., pitch) and relative attributes (e.g., pitch interval). These relative attributes shape human perception of musical motifs. These important relative attributes, however, are mostly ignored in existing symbolic music modeling methods with the main reason being the lack of a musically-meaningful embedding space where both the absolute and relative embeddings of the symbolic music tokens can be efficiently represented. In this paper, we propose the Fundamental Music Embedding (FME) for symbolic music based on a bias-adjusted sinusoidal encoding within which both the absolute and the relative attributes can be embedded and the fundamental musical properties (e.g., translational invariance) are explicitly preserved. Taking advantage of the proposed FME, we further propose a novel attention mechanism based on the relative index, pitch and onset embeddings (RIPO attention) such that the musical domain knowledge can be fully utilized for symbolic music modeling. Experiment results show that our proposed model: RIPO transformer which utilizes FME and RIPO attention outperforms the state-of-the-art transformers (i.e., music transformer, linear transformer) in a melody completion task. Moreover, using the RIPO transformer in a downstream music generation task, we notice that the notorious degeneration phenomenon no longer exists and the music generated by the RIPO transformer outperforms the music generated by state-of-the-art transformer models in both subjective and objective evaluations.


title: Faster Adaptive Federated Learning

abstract: Federated learning has attracted increasing attention with the emergence of distributed data. While extensive federated learning algorithms have been proposed for the non-convex distributed problem, federated learning in practice still faces numerous challenges, such as the large training iterations to converge since the sizes of models and datasets keep increasing, and the lack of adaptivity by SGD-based model updates. Meanwhile, the study of adaptive methods in federated learning is scarce and existing works either lack a complete theoretical convergence guarantee or have slow sample complexity. In this paper, we propose an efficient adaptive algorithm (i.e., FAFED) based on the momentum-based variance-reduced technique in cross-silo FL. We first explore how to design the adaptive algorithm in the FL setting. By providing a counter-example, we prove that a simple combination of FL and adaptive methods could lead to divergence. More importantly, we provide a convergence analysis for our method and prove that our algorithm is the first adaptive FL algorithm to reach the best-known samples $O(\epsilon^{-3})$ and $O(\epsilon^{-2})$ communication rounds to find an $\epsilon$-stationary point without large batches. The experimental results on the language modeling task and image classification task with heterogeneous data demonstrate the efficiency of our algorithms.


title: Relation-Aware Language-Graph Transformer for Question Answering

abstract: Question Answering (QA) is a task that entails reasoning over natural language contexts, and many relevant works augment language models (LMs) with graph neural networks (GNNs) to encode the Knowledge Graph (KG) information. However, most existing GNN-based modules for QA do not take advantage of rich relational information of KGs and depend on limited information interaction between the LM and the KG. To address these issues, we propose Question Answering Transformer (QAT), which is designed to jointly reason over language and graphs with respect to entity relations in a unified manner. Specifically, QAT constructs Meta-Path tokens, which learn relation-centric embeddings based on diverse structural and semantic relations. Then, our Relation-Aware Self-Attention module comprehensively integrates different modalities via the Cross-Modal Relative Position Bias, which guides information exchange between relevant entites of different modalities. We validate the effectiveness of QAT on commonsense question answering datasets like CommonsenseQA and OpenBookQA, and on a medical question answering dataset, MedQA-USMLE. On all the datasets, our method achieves state-of-the-art performance. Our code is available at http://github.com/mlvlab/QAT.


title: Pattern formation in 2d stochastic anisotropic Swift-Hohenberg equation

abstract: In this paper, we study a phenomenological model for pattern formation in electroconvection, and the effect of noise on the pattern. As such model we consider an anisotropic Swift-Hohenberg equation adding an additive noise. We prove the existence of a global solution of that equation on the two dimensional torus. In addition, inserting a scaling parameter, we consider the equation on a large domain near its change of stability. We observe numerically that, under the appropriate scaling, its solutions can be approximated by a periodic wave, which is modulated by the solutions to a stochastic Ginzburg-Landau equation.


title: PSPC: Efficient Parallel Shortest Path Counting on Large-Scale Graphs

abstract: In modern graph analytics, the shortest path is a fundamental concept. Numerous \rrev{recent works} concentrate mostly on the distance of these shortest paths. Nevertheless, in the era of betweenness analysis, the counting of the shortest path between $s$ and $t$ is equally crucial. \rrev{It} is \rev{also} an important issue in the area of graph databases. In recent years, several studies have been conducted in an effort to tackle such issues. Nonetheless, the present technique faces a considerable barrier to parallel due to the dependencies in the index construction stage, hence limiting its application possibilities and wasting the potential hardware performance. To address this problem, we provide a parallel shortest path counting method that could avoid these dependencies and obtain approximately linear index time speedup as the number of threads increases. Our empirical evaluations verify the efficiency and effectiveness.


title: Charge asymmetry in the spectra of bremsstrahlung and pair production

abstract: We calculate the first Coulomb correction to the spectra of two processes: the electron bremsstrahlung and electron-positron photoproduction in the Coulomb field. We show that, in contrast to the results obtained in the Born approximation and in the high-energy limit, the obtained corrections for these two process are not related by the crossing symmetry substitutions. The found corrections determine the leading contribution to the charge asymmetry in these processes. We use modern multiloop methods based on the IBP reduction and on the differential equations for master integrals. The results are presented in terms of classical polylogarithms. We provide both the threshold and the high-energy asymptotics of the obtained expressions and compare them with available results.


title: PASTA: Proportional Amplitude Spectrum Training Augmentation for Syn-to-Real Domain Generalization

abstract: Synthetic data offers the promise of cheap and bountiful training data for settings where labeled real-world data is scarce. However, models trained on synthetic data significantly underperform when evaluated on real-world data. In this paper, we propose Proportional Amplitude Spectrum Training Augmentation (PASTA), a simple and effective augmentation strategy to improve out-of-the-box synthetic-to-real (syn-to-real) generalization performance. PASTA perturbs the amplitude spectra of synthetic images in the Fourier domain to generate augmented views. Specifically, with PASTA we propose a structured perturbation strategy where high-frequency components are perturbed relatively more than the low-frequency ones. For the tasks of semantic segmentation (GTAV-to-Real), object detection (Sim10K-to-Real), and object recognition (VisDA-C Syn-to-Real), across a total of 5 syn-to-real shifts, we find that PASTA outperforms more complex state-of-the-art generalization methods while being complementary to the same.


title: Microscopic study of the deformed neutron halo of 31Ne

abstract: The properties of the deformed halo of 31Ne were discussed using the antisymmetrized molecular dynamics plus resonating group method (AMD+RGM). The AMD+RGM calculations describe a large neutron radius for the ground state and reveal that the ground state is dominated by core-excited components. The resonant states were also investigated by applying the analytical continuation of the coupling constant. It was found that the first excited state (the 5/2- state) is also dominated by core-excited components and has a small decay width, whereas the second excited state (the 7/2- state) is dominated by the valence neutron in the $f$-wave coupled to the ground state of 30Ne.


title: QC-StyleGAN -- Quality Controllable Image Generation and Manipulation

abstract: The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs, making them unfit for in-the-wild low-quality (LQ) images, which are common inputs for manipulation. In this work, we bridge this gap by proposing a novel GAN structure that allows for generating images with controllable quality. The network can synthesize various image degradation and restore the sharp image via a quality control code. Our proposed QC-StyleGAN can directly edit LQ images without altering their quality by applying GAN inversion and manipulation techniques. It also provides for free an image restoration solution that can handle various degradations, including noise, blur, compression artifacts, and their mixtures. Finally, we demonstrate numerous other applications such as image degradation synthesis, transfer, and interpolation. The code is available at https://github.com/VinAIResearch/QC-StyleGAN.


title: How to grow an oscillator network with enhanced synchronization

abstract: We study a way to set the natural frequency of a newly added oscillator in a growing network to enhance synchronization. Population growth is one of the typical features of many oscillator systems for which synchronization is required to perform their functions properly. Despite this significance, little has been known about synchronization in growing systems. We suggest effective growing schemes to enhance synchronization as the network grows under a predetermined rule. Specifically, we find that a method based on a link-wise order parameter outperforms that based on the conventional global order parameter. With simple solvable examples, we verify that the results coincide with intuitive expectations. The numerical results demonstrate that the approximate optimal values from the suggested method show a larger synchronization enhancement in comparison to other naive strategies. The results also show that our proposed approach outperforms others over a wide range of coupling strengths.


title: Photo-induced nonlinear band shift and valence transition in SmS

abstract: The photo-induced band structure variation of a rare-earth-based semiconductor, samarium monosulfide (SmS), was investigated using high-harmonic-generation laser-based time-resolved photoelectron spectroscopy. A nonlinear photo-induced band shift of the Sm 4f multiplets was observed. The first one is a shift to the high-binding-energy side due to a large surface photovoltage (SPV) effect of approximately 93 meV, comparable to the size of the bulk band gap, with a much longer relaxation time than 0.1 ms. The second one is an ultrafast band shift to the low binding energy side, which is in the opposite direction to the SPV shift, suggesting an ultrafast valence transition from divalent to trivalent Sm ions due to photo-excitation. The latter energy shift was approximately 58 meV, which is consistent with the energy gap shift from ambient pressure to the boundary between the black insulator and golden metallic phase with the application of pressure. This suggests that the photo-induced valence transition can reach the phase boundary, but other effects are necessary to realize the golden metallic phase.


title: Fully Data-driven Normalized and Exponentiated Kernel Density Estimator with Hyv\"arinen Score

abstract: We introduce a new deal of kernel density estimation using an exponentiated form of kernel density estimators. The density estimator has two hyperparameters flexibly controlling the smoothness of the resulting density. We tune them in a data-driven manner by minimizing an objective function based on the Hyv\"arinen score to avoid the optimization involving the intractable normalizing constant due to the exponentiation. We show the asymptotic properties of the proposed estimator and emphasize the importance of including the two hyperparameters for flexible density estimation. Our simulation studies and application to income data show that the proposed density estimator is appealing when the underlying density is multi-modal or observations contain outliers.


title: A comparative analysis of several multivariate zero-inflated and zero-modified models with applications in insurance

abstract: Claim frequency data in insurance records the number of claims on insurance policies during a finite period of time. Given that insurance companies operate with multiple lines of insurance business where the claim frequencies on different lines of business are often correlated, multivariate count modeling with dependence for claim frequency is therefore essential. Due in part to the operation of bonus-malus systems, claims data in automobile insurance are often characterized by an excess of common zeros. This feature is referred to as multivariate zero-inflation. In this paper, we establish two ways of dealing with this feature. The first is to use a multivariate zero-inflated model, where we artificially augment the probability of common zeros based on standard multivariate count distributions. The other is to apply a multivariate zero-modified model, which deals with the common zeros and the number of claims incurred in each line, given that at least one claim occurs separately. A comprehensive comparative analysis of several models under these two frameworks is conducted using the data of an automobile insurance portfolio from a major insurance company in Spain. A less common situation in insurance is the absence of some common zeros resulting from incomplete records. This feature of these data is known as multivariate zero-deflation. In this case, our proposed multivariate zero-modified model still works, as shown by the second empirical study.


title: Masked Contrastive Pre-Training for Efficient Video-Text Retrieval

abstract: We present a simple yet effective end-to-end Video-language Pre-training (VidLP) framework, Masked Contrastive Video-language Pretraining (MAC), for video-text retrieval tasks. Our MAC aims to reduce video representation's spatial and temporal redundancy in the VidLP model by a mask sampling mechanism to improve pre-training efficiency. Comparing conventional temporal sparse sampling, we propose to randomly mask a high ratio of spatial regions and only feed visible regions into the encoder as sparse spatial sampling. Similarly, we adopt the mask sampling technique for text inputs for consistency. Instead of blindly applying the mask-then-prediction paradigm from MAE, we propose a masked-then-alignment paradigm for efficient video-text alignment. The motivation is that video-text retrieval tasks rely on high-level alignment rather than low-level reconstruction, and multimodal alignment with masked modeling encourages the model to learn a robust and general multimodal representation from incomplete and unstable inputs. Coupling these designs enables efficient end-to-end pre-training: reduce FLOPs (60% off), accelerate pre-training (by 3x), and improve performance. Our MAC achieves state-of-the-art results on various video-text retrieval datasets, including MSR-VTT, DiDeMo, and ActivityNet. Our approach is omnivorous to input modalities. With minimal modifications, we achieve competitive results on image-text retrieval tasks.


title: Sparse SPN: Depth Completion from Sparse Keypoints

abstract: Our long term goal is to use image-based depth completion to quickly create 3D models from sparse point clouds, e.g. from SfM or SLAM. Much progress has been made in depth completion. However, most current works assume well distributed samples of known depth, e.g. Lidar or random uniform sampling, and perform poorly on uneven samples, such as from keypoints, due to the large unsampled regions. To address this problem, we extend CSPN with multiscale prediction and a dilated kernel, leading to much better completion of keypoint-sampled depth. We also show that a model trained on NYUv2 creates surprisingly good point clouds on ETH3D by completing sparse SfM points.


title: Synchronization in repulsively coupled oscillators

abstract: A long-standing expectation is that two repulsively coupled oscillators tend to oscillate in opposite directions. It has been difficult to achieve complete synchrony in coupled identical oscillators with purely repulsive coupling. Here, we introduce a general coupling condition based on the linear matrix of dynamical systems for the emergence of the complete synchronization in pure repulsively coupled oscillators. The proposed coupling profiles (coupling matrices) define a bidirectional cross-coupling link that plays the role of indicator for the onset of complete synchrony between identical oscillators. We illustrate the proposed coupling scheme on several paradigmatic two-coupled chaotic oscillators and validate its effectiveness through the linear stability analysis of the synchronous solution based on the master stability function approach. We further demonstrate that the proposed general condition for the selection of coupling profiles to achieve synchronization even works perfectly for a large ensemble of oscillators.


title: Deterministic synthesis of phase pure 2D perovskites via progressive transformation of layer thickness

abstract: Two-dimensional (2D) halide perovskites have emerged as semiconductor platforms for realizing efficient and durable optoelectronic devices. However, the reproducible synthesis of 2D perovskite crystals with desired layer thickness (or n value) greater than 2, has been an enduring challenge due to the lack of kinetic control (temperature, time, stoichiometry) for each layer thickness. Here, we demonstrate a novel method term as the kinetically controlled space confinement (KCSC) for the deterministic growth of phase pure Ruddlesden-Popper (RP) and Dion-Jacobson (DJ) 2D perovskites. The phase-pure growth was achieved by progressively increasing the temperature (fixed time) or the crystallization time (fixed temperature), which allowed for an acute control of the crystallization kinetics. We also observe a systematic transformation from a lower n-value to n=3, 4, 5, 6 in 2D perovskites. In-situ photoluminescence spectroscopy and imaging suggest that the progressive transformation from lower to higher n-value occurs via intercalation of excess precursor ions. These experiments enabled the development of a machine learning assisted multi-parameter phase diagram, which predicts the growth of 2D phase with a specific n-value.


title: Feature Aggregation and Propagation Network for Camouflaged Object Detection

abstract: Camouflaged object detection (COD) aims to detect/segment camouflaged objects embedded in the environment, which has attracted increasing attention over the past decades. Although several COD methods have been developed, they still suffer from unsatisfactory performance due to the intrinsic similarities between the foreground objects and background surroundings. In this paper, we propose a novel Feature Aggregation and Propagation Network (FAP-Net) for camouflaged object detection. Specifically, we propose a Boundary Guidance Module (BGM) to explicitly model the boundary characteristic, which can provide boundary-enhanced features to boost the COD performance. To capture the scale variations of the camouflaged objects, we propose a Multi-scale Feature Aggregation Module (MFAM) to characterize the multi-scale information from each layer and obtain the aggregated feature representations. Furthermore, we propose a Cross-level Fusion and Propagation Module (CFPM). In the CFPM, the feature fusion part can effectively integrate the features from adjacent layers to exploit the cross-level correlations, and the feature propagation part can transmit valuable context information from the encoder to the decoder network via a gate unit. Finally, we formulate a unified and end-to-end trainable framework where cross-level features can be effectively fused and propagated for capturing rich context information. Extensive experiments on three benchmark camouflaged datasets demonstrate that our FAP-Net outperforms other state-of-the-art COD models. Moreover, our model can be extended to the polyp segmentation task, and the comparison results further validate the effectiveness of the proposed model in segmenting polyps. The source code and results will be released at https://github.com/taozh2017/FAPNet.


title: Special Hamiltonian $S^1$-actions on symplectic 4-manifolds

abstract: In this paper we consider symplectic 4-manifolds $(M,\omega)$ with $c_1(M,\omega)=0$ which admit a Hamiltonian $S^1$-action together with an equivariant Maslov condition on orbits of the group action. We call such spaces {\em special Hamiltonian $S^1$-spaces}. It turns out that there are no compact special Hamiltonian $S^1$-spaces. We classify all exact special Hamiltonian $S^1$-spaces and show that all of them admit the structure of a Stein surface.


title: Stable Learning via Sparse Variable Independence

abstract: The problem of covariate-shift generalization has attracted intensive research attention. Previous stable learning algorithms employ sample reweighting schemes to decorrelate the covariates when there is no explicit domain information about training data. However, with finite samples, it is difficult to achieve the desirable weights that ensure perfect independence to get rid of the unstable variables. Besides, decorrelating within stable variables may bring about high variance of learned models because of the over-reduced effective sample size. A tremendous sample size is required for these algorithms to work. In this paper, with theoretical justification, we propose SVI (Sparse Variable Independence) for the covariate-shift generalization problem. We introduce sparsity constraint to compensate for the imperfectness of sample reweighting under the finite-sample setting in previous methods. Furthermore, we organically combine independence-based sample reweighting and sparsity-based variable selection in an iterative way to avoid decorrelating within stable variables, increasing the effective sample size to alleviate variance inflation. Experiments on both synthetic and real-world datasets demonstrate the improvement of covariate-shift generalization performance brought by SVI.


title: Observed Rate Variation in Superflaring G-type Stars

abstract: Flare occurrence on the Sun is highly variable, exhibiting both short term variation due to the emergence and evolution of active regions, and long-term variation from the solar cycle. On solar-like stars, much larger stellar flares (superflares) have been observed, and it is of interest to determine whether observed rates of superflare occurrence exhibit similar variability to solar flares. We analyse 274 G-type stars using data from the Transiting Exoplanet Survey Satellite (TESS) and identify seven stars which exhibit statistically significant changes in the rate of superflare occurrence by fitting a piecewise constant-rate model with the Bayesian Blocks algorithm (Scargle et al 2012; arXiv:1207.5578). We investigate the properties of these stars and their flaring rates, and discuss the possible reasons for the low number of stars with detectable rate variation.


title: Knowledge Graph Quality Evaluation under Incomplete Information

abstract: Knowledge graphs (KGs) have attracted more and more attentions because of their fundamental roles in many tasks. Quality evaluation for KGs is thus crucial and indispensable. Existing methods in this field evaluate KGs by either proposing new quality metrics from different dimensions or measuring performances at KG construction stages. However, there are two major issues with those methods. First, they highly rely on raw data in KGs, which makes KGs' internal information exposed during quality evaluation. Second, they consider more about the quality at data level instead of ability level, where the latter one is more important for downstream applications. To address these issues, we propose a knowledge graph quality evaluation framework under incomplete information (QEII). The quality evaluation task is transformed into an adversarial Q&A game between two KGs. Winner of the game is thus considered to have better qualities. During the evaluation process, no raw data is exposed, which ensures information protection. Experimental results on four pairs of KGs demonstrate that, compared with baselines, the QEII implements a reasonable quality evaluation at ability level under incomplete information.


title: Finite Splittings of Differential Matrix Algebras

abstract: It is well known that central simple algebras are split by suitable finite Galois extensions of their centers. A counterpart of this result was studied by Juan and Magid in the set up of differential matrix algebras, wherein Picard-Vessiot extensions that split matrix differential algebras were constructed. In this article, we exhibit instances of differential matrix algebras which are split by finite extensions. In some cases, we relate the existence of finite splitting extensions of a differential matrix algebra to the triviality of its tensor powers, and show in these cases, that orders of differential matrix algebras divide their degrees.


title: Clustering through Feature Space Sequence Discovery and Analysis

abstract: Identifying high-dimensional data patterns without a priori knowledge is an important task of data science. This paper proposes a simple and efficient noparametric algorithm: Data Convert to Sequence Analysis, DCSA, which dynamically explore each point in the feature space without repetition, and a Directed Hamilton Path will be found. Based on the change point analysis theory, The sequence corresponding to the path is cut into several fragments to achieve clustering. The experiments on real-world datasets from different fields with dimensions ranging from 4 to 20531 confirm that the method in this work is robust and has visual interpretability in result analysis.


title: A promising formation channel for symbiotic X-ray binaries: cases of IGR J17329-2731 and 4U 1700+24

abstract: Recent observations demonstrate that the symbiotic X-ray binary (SyXB) IGR J17329-2731 contains a highly magnetized neutron star (NS) which accretes matter through the wind from its giant star companion, and suggest that 4U 1700+24 may also have a highly magnetized NS. Accretion-induced collapse (AIC) from oxygen-neon-magnesium white dwarf (ONeMg WD) + red giant (RG) star binaries is one promising channel to form these SyXBs, while other long standing formation channels have difficulties to produce these SyXBs. By considering non-magnetic and magnetic ONeMg WDs, I investigate the evolution of ONeMg WD + RG binaries with the MESA stellar evolution code for producing SyXBs with non-magnetic or magnetized NSs. In the pre-AIC evolution with magnetic confinement, the mass accumulation efficiency of the accreting WD is increased at low mass transfer rate compared to the non-magnetic case. The newborn NSs formed via AIC of highly magnetized WDs could inherit the large magnetic field through conservation of magnetic flux, and the systems could have a long age compatible with that of the red giant companions. These young and highly magnetized NSs could accrete matters from the stellar wind of the giant companions to that shine as those observed SyXBs, and could preserve their high magnetic field during this time. The MESA calculation results show that the initial parameter (initial RG mass and orbital period) space for the AIC with magnetic confinement to form SyXBs with highly magnetized NSs shifts to be lower and narrower compared to that of the no magnetic confinement case.


title: Credit Assignment for Trained Neural Networks Based on Koopman Operator Theory

abstract: Credit assignment problem of neural networks refers to evaluating the credit of each network component to the final outputs. For an untrained neural network, approaches to tackling it have made great contributions to parameter update and model revolution during the training phase. This problem on trained neural networks receives rare attention, nevertheless, it plays an increasingly important role in neural network patch, specification and verification. Based on Koopman operator theory, this paper presents an alternative perspective of linear dynamics on dealing with the credit assignment problem for trained neural networks. Regarding a neural network as the composition of sub-dynamics series, we utilize step-delay embedding to capture snapshots of each component, characterizing the established mapping as exactly as possible. To circumvent the dimension-difference problem encountered during the embedding, a composition and decomposition of an auxiliary linear layer, termed minimal linear dimension alignment, is carefully designed with rigorous formal guarantee. Afterwards, each component is approximated by a Koopman operator and we derive the Jacobian matrix and its corresponding determinant, similar to backward propagation. Then, we can define a metric with algebraic interpretability for the credit assignment of each network component. Moreover, experiments conducted on typical neural networks demonstrate the effectiveness of the proposed method.


title: Information Retrieval from the Digitized Books

abstract: Extracting the relevant information out of a large number of documents is a challenging and tedious task. The quality of results generated by the traditionally available full-text search engine and text-based image retrieval systems is not optimal. Information retrieval (IR) tasks become more challenging with the nontraditional language scripts, as in the case of Indic scripts. The authors have developed OCR (Optical Character Recognition) Search Engine to make an Information Retrieval & Extraction (IRE) system that replicates the current state-of-the-art methods using the IRE and Natural Language Processing (NLP) techniques. Here we have presented the study of the methods used for performing search and retrieval tasks. The details of this system, along with the statistics of the dataset (source: National Digital Library of India or NDLI), is also presented. Additionally, the ideas to further explore and add value to research in IRE are also discussed.


title: A Dynamical Systems Analysis of the Effects of the Launch Rate Distribution on the Stability of a Source-Sink Orbital Debris Model

abstract: Future launches are projected to significantly increase both the number of active satellites and aggregate collision risk in Low Earth Orbit (LEO). In this paper, a dynamical systems theory approach is used to analyze the effect of launch rate distribution on the stability of the LEO environment. A multi-shell, three-species source-sink model of the LEO environment, referred to as MOCAT-3 for MIT Orbital Capacity Assessment Tool 3 Species, is used to study the evolution of the species populations. The three species included in the model are active satellites, derelict satellites, and debris. The model's coefficients represent atmospheric drag, collision rate, mean satellite lifetime, post-mission disposal probability, and active debris removal rate. Solutions of the system of differential equations are computed, and an analysis of the stability of the equilibrium points is conducted for numerous launch rate distributions. The stability of the equilibrium points is used to test the sensitivity of the environment to run-away debris growth, known as Kessler syndrome, that occurs at the instability threshold. An analysis of the environment's response to perturbations in launch rate and debris population is conducted. The maximum perturbation in the debris population from the equilibrium state, for which the system remains in a stable configuration, is calculated. Plots of the phase space about the equilibrium points are generated. The results will help to better understand the orbital capacity of LEO and the stability of the space environment, as well as provide improved guidelines on future launch plans to avoid detrimental congestion of LEO.


title: Wave-packet and entanglement dynamics in a non-Hermitian many-body system

abstract: The static and dynamical properties of a one-dimensional quantum system described by a non-Hermitian Hamiltonian of the so-called Hatano-Nelson type; a tight-binding model with asymmetric (or non-reciprocal) hopping, are studied. The static properties of the model have been much studied; the complex spectrum, skin effect and its topological interpretation, etc. Effects of disorder and inter-particle interaction, especially, when they coexist, may be less understood. Here, we will also focus on its dynamical properties and reveal some unique features in the wave-packet and entanglement (entropy) dynamics. For that some latest (original) results based on improved numerics (with this a system of larger system size $L$ becomes accessible) are shown.


title: Automatic Depth-Optimized Quantum Circuit Synthesis for Diagonal Unitary Matrices with Asymptotically Optimal Gate Count

abstract: Current noisy intermediate-scale quantum (NISQ) devices can only execute small circuits with shallow depth, as they are still constrained by the presence of noise: quantum gates have error rates and quantum states are fragile due to decoherence. Hence, it is of great importance to optimize the depth/gate-count when designing quantum circuits for specific tasks. Diagonal unitary matrices are well-known to be key building blocks of many quantum algorithms or quantum computing procedures. Prior work has discussed the synthesis of diagonal unitary matrices over the primitive gate set $\{\text{CNOT}, R_Z\}$. However, the problem has not yet been fully understood, since the existing synthesis methods have not optimized the circuit depth. In this paper, we propose a depth-optimized synthesis algorithm that automatically produces a quantum circuit for any given diagonal unitary matrix. Specially, it not only ensures the asymptotically optimal gate-count, but also nearly halves the total circuit depth compared with the previous method. Technically, we discover a uniform circuit rewriting rule well-suited for reducing the circuit depth. The performance of our synthesis algorithm is both theoretically analyzed and experimentally validated by evaluations on two examples. First, we achieve a nearly 50\% depth reduction over Welch's method for synthesizing random diagonal unitary matrices with up to 16 qubits. Second, we achieve an average of 22.05\% depth reduction for resynthesizing the diagonal part of specific quantum approximate optimization algorithm (QAOA) circuits with up to 14 qubits.


title: Broadband mHz QPOs and spectral study of LMC X$-$4 with AstroSat

abstract: We report the results of broadband timing and spectral analysis of data from an AstroSat observation of the High Mass X-ray binary LMC X$-$4. The Large Area X-ray Proportional Counter (LAXPC) and Soft X-ray Telescope (SXT) instruments on-board the AstroSat observed the source in August 2016. A complete X-ray eclipse was detected with the LAXPC. The 3$-$40 keV power density spectrum showed the presence of coherent pulsations along with a $\sim 26$ mHz quasi-periodic oscillation feature. The spectral properties of LMC X$-$4 were derived from a joint analysis of the SXT and LAXPC spectral data. The 0.5$-$25 keV persistent spectrum comprised of an absorbed high energy cutoff power law with photon index of $\Gamma \sim$ 0.8 and cutoff at $\sim$16 keV, a soft thermal component with kT$_{BB} \sim$ 0.14 keV and Gaussian components corresponding to Fe K$_\alpha$, Ne \textsc{ix} and Ne \textsc{x} emission lines. Assuming a source distance of 50 kpc, we determined 0.5--25 keV luminosity to be $\sim 2 \times 10^{38}$ erg s$^{-1}$.


title: Planogram Compliance Control via Object Detection, Sequence Alignment, and Focused Iterative Search

abstract: Smart retail stores are becoming the fact of our lives. Several computer vision and sensor based systems are working together to achieve such a complex and automated operation. Besides, the retail sector already has several open and challenging problems which can be solved with the help of pattern recognition and computer vision methods. One important problem to be tackled is the planogram compliance control. In this study, we propose a novel method to solve it. The proposed method is based on object detection, planogram compliance control, and focused and iterative search steps. The object detection step is formed by local feature extraction and implicit shape model formation. The planogram compliance control step is formed by sequence alignment via the modified Needleman-Wunsch algorithm. The focused and iterative search step aims to improve the performance of the object detection and planogram compliance control steps. We tested all three steps on two different datasets. Based on these tests, we summarize the key findings as well as strengths and weaknesses of the proposed method.


title: AGO: Boosting Mobile AI Inference Performance by Removing Constraints on Graph Optimization

abstract: Traditional deep learning compilers rely on heuristics for subgraph generation, which impose extra constraints on graph optimization, e.g., each subgraph can only contain at most one complex operator. In this paper, we propose AGO, a framework for graph optimization with arbitrary structures to boost the inference performance of deep models by removing such constraints. To create new optimization opportunities for complicated subgraphs, we propose intensive operator fusion, which can effectively stitch multiple complex operators together for better performance. Further, we design a graph partitioning scheme that allows an arbitrary structure for each subgraph while guaranteeing the acyclic property among all generated subgraphs. Additionally, to enable efficient performance tuning on complicated subgraphs, we devise a novel divide-and-conquer tuning mechanism to orchestrate different system components. Through extensive experiments on various neural networks and mobile devices, we show that our system can improve the inference performance by up to 3.3x when compared with state-of-the-art deep compilers.


title: Self-supervised On-device Federated Learning from Unlabeled Streams

abstract: The ubiquity of edge devices has led to a growing amount of unlabeled data produced at the edge. Deep learning models deployed on edge devices are required to learn from these unlabeled data to continuously improve accuracy. Self-supervised representation learning has achieved promising performances using centralized unlabeled data. However, the increasing awareness of privacy protection limits centralizing the distributed unlabeled image data on edge devices. While federated learning has been widely adopted to enable distributed machine learning with privacy preservation, without a data selection method to efficiently select streaming data, the traditional federated learning framework fails to handle these huge amounts of decentralized unlabeled data with limited storage resources on edge. To address these challenges, we propose a Self-supervised On-device Federated learning framework with coreset selection, which we call SOFed, to automatically select a coreset that consists of the most representative samples into the replay buffer on each device. It preserves data privacy as each client does not share raw data while learning good visual representations. Experiments demonstrate the effectiveness and significance of the proposed method in visual representation learning.


title: Compound Batch Normalization for Long-tailed Image Classification

abstract: Significant progress has been made in learning image classification neural networks under long-tail data distribution using robust training algorithms such as data re-sampling, re-weighting, and margin adjustment. Those methods, however, ignore the impact of data imbalance on feature normalization. The dominance of majority classes (head classes) in estimating statistics and affine parameters causes internal covariate shifts within less-frequent categories to be overlooked. To alleviate this challenge, we propose a compound batch normalization method based on a Gaussian mixture. It can model the feature space more comprehensively and reduce the dominance of head classes. In addition, a moving average-based expectation maximization (EM) algorithm is employed to estimate the statistical parameters of multiple Gaussian distributions. However, the EM algorithm is sensitive to initialization and can easily become stuck in local minima where the multiple Gaussian components continue to focus on majority classes. To tackle this issue, we developed a dual-path learning framework that employs class-aware split feature normalization to diversify the estimated Gaussian distributions, allowing the Gaussian components to fit with training samples of less-frequent classes more comprehensively. Extensive experiments on commonly used datasets demonstrated that the proposed method outperforms existing methods on long-tailed image classification.


title: Alternative $M_2$-algebras and ${\mit \Gamma}$-algebras

abstract: Recently V.H.L\'opez Sol\'is and I.Shestakov solved an old problem by N.Jacobson on describing of unital alternative algebras containing the $2\times 2$ matrix algebra $M_2$ as a unital subalgebra. Here we give another description of $M_2$-algebras via the 6-dimensional alternative superalgebra $B(4,2)$ and an auxiliar $\mathbf {\mit Z}_2$-graded algebra $\mit\Gamma$. It occurs that the category of alternative $M_2$-algebras is isomorphic to the category of $\mit\Gamma$-algebras. For any associative and commutative algebra $A$, we give a construction of a ${\mit \Gamma}$-algebra $\mit\Gamma(A)$, which turns to be a Jordan superalgebra; if $A$ is a domain then $\mit\Gamma(A)$ is a prime superalgebra. We describe also the free $\mit\Gamma$-algebras and construct their bases.


title: Metasurface-Based Free-Space Multi-port Beam Splitter with Arbitrary Power Ratio

abstract: A beam splitter (BS) is one of the most critical building blocks in optical systems. Despite various attempts of flat-type BSs to miniaturize the conventional cube BS reported, it remains a challenge to realize an ultrathin optical BS with multi-port output, non-uniform splitting ratio and steerable outgoing directions. Herein, we have demonstrated a free-space optical multi-port beam splitter (MPBS) based on a polarization-independent all-dielectric metasurface. By applying an optimized phase-pattern paradigm via a gradient-descent-based iterative algorithm to amorphous silicon (a-Si) metasurfaces, we have prepared a variety of MPBS samples with arbitrarily predetermined output port number (2~7), power ratio and spatial distribution of output beams. The experimental results reveal that the fabricated MPBSs could achieve high total splitting efficiency (TSE, above 74.7%) and beam-splitting fidelity (similarity, above 78.4%) within the bandwidth of 100 nm (1500~1600 nm). We envision that such MPBS could provide fabulous flexibility for optical integrated system and diverse applications.


title: A machine-learning based closed orbit feedback for the SSRF storage ring

abstract: In order to improve the stability of synchrotron radiation, we developed a new method of machine learning-based closed orbit feedback and piloted it in the storage ring of the Shanghai Synchrotron Radiation Facility (SSRF). In our experiments, not only can the machine learning-based closed orbit feedback carry out horizontal, vertical and RF frequency feedback simultaneously, but it also has better convergence and convergence speed than the traditional Slow Orbit Feed Back (SOFB) system. What's more, the residual values of the correctors' currents variations after correction can be almost ignored. This machine learning-based new method is expected to establish a new closed orbit feedback system and improve the orbit stability of the storage ring in daily operation.


title: CLeBPI: Contrastive Learning for Bug Priority Inference

abstract: Automated bug priority inference can reduce the time overhead of bug triagers for priority assignments, improving the efficiency of software maintenance. Currently, there are two orthogonal lines for this task, i.e., traditional machine learning based (TML-based) and neural network based (NN-based) approaches. Although these approaches achieve competitive performance, our observation finds that existing approaches face the following two issues: 1) TML-based approaches require much manual feature engineering and cannot learn the semantic information of bug reports; 2) Both TML-based and NN-based approaches cannot effectively address the label imbalance problem because they are difficult to distinguish the semantic difference between bug reports with different priorities. In this paper, we propose CLeBPI (Contrastive Learning for Bug Priority Inference), which leverages pre-trained language model and contrastive learning to tackle the above-mentioned two issues. Specifically, CLeBPI is first pre-trained on a large-scale bug report corpus in a self-supervised way, thus it can automatically learn contextual representations of bug reports without manual feature engineering. Afterward, it is further pre-trained by a contrastive learning objective, which enables it to distinguish semantic differences between bug reports, learning more precise contextual representations for each bug report. When finishing pre-training, we can connect a classification layer to CLeBPI and fine-tune it for bug priority inference in a supervised way. To verify the effectiveness of CLeBPI, we choose four baseline approaches and conduct comparison experiments on a public dataset. The experimental results show that CLeBPI outperforms all baseline approaches by 23.86%-77.80% in terms of weighted average F1-score, showing its effectiveness.


title: Injecting Spatial Information for Monaural Speech Enhancement via Knowledge Distillation

abstract: Monaural speech enhancement (SE) provides a versatile and cost-effective approach to SE tasks by utilizing recordings from a single microphone. However, the monaural SE lags performance behind multi-channel SE as the monaural SE methods are unable to extract spatial information from one-channel recordings, which greatly limits their application scenarios. To address this issue, we inject spatial information into the monaural SE model and propose a knowledge distillation strategy to enable the monaural SE model to learn binaural speech features from the binaural SE model, which makes monaural SE model possible to reconstruct higher intelligibility and quality enhanced speeches under low signal-to-noise ratio (SNR) conditions. Extensive experiments show that our proposed monaural SE model by injecting spatial information via knowledge distillation achieves favorable performance against other monaural SE models with fewer parameters.