title: Feature Space Exploration For Planning Initial Benthic AUV Surveys

abstract: Special-purpose Autonomous Underwater Vehicles (AUVs) are utilised for benthic (seafloor) surveys, where the vehicle collects optical imagery of the seafloor. Due to the small-sensor footprint of the cameras and the vast areas to be surveyed, these AUVs can not feasibly collect full coverage imagery of areas larger than a few tens of thousands of square meters. Therefore it is necessary for AUV paths to sample the surveys areas sparsely, yet effectively. Broad-scale acoustic bathymetric data is readily available over large areas, and is often a useful prior of seafloor cover. As such, prior bathymetry can be used to guide AUV data collection. This research proposes methods for planning initial AUV surveys that efficiently explore a feature space representation of the bathymetry, in order to sample from a diverse set of bathymetric terrain. This will enable the AUV to visit areas that likely contain unique habitats and are representative of the entire survey site. We propose several information gathering planners that utilise a feature space exploration reward, to plan freeform paths or to optimise the placement of a survey template. The suitability of these methods to plan AUV surveys is evaluated based on the coverage of the feature space and also the ability to visit all classes of benthic habitat on the initial dive. Informative planners based on Rapidly-expanding Random Trees (RRT) and Monte-Carlo Tree Search (MCTS) were found to be the most effective. This is a valuable tool for AUV surveys as it increases the utility of initial dives. It also delivers a comprehensive training set to learn a relationship between acoustic bathymetry and visually-derived seafloor classifications.


title: Multi-view 3D Reconstruction of a Texture-less Smooth Surface of Unknown Generic Reflectance

abstract: Recovering the 3D geometry of a purely texture-less object with generally unknown surface reflectance (e.g. non-Lambertian) is regarded as a challenging task in multi-view reconstruction. The major obstacle revolves around establishing cross-view correspondences where photometric constancy is violated. This paper proposes a simple and practical solution to overcome this challenge based on a co-located camera-light scanner device. Unlike existing solutions, we do not explicitly solve for correspondence. Instead, we argue the problem is generally well-posed by multi-view geometrical and photometric constraints, and can be solved from a small number of input views. We formulate the reconstruction task as a joint energy minimization over the surface geometry and reflectance. Despite this energy is highly non-convex, we develop an optimization algorithm that robustly recovers globally optimal shape and reflectance even from a random initialization. Extensive experiments on both simulated and real data have validated our method, and possible future extensions are discussed.


title: Time-reversal symmetry breaking in Re-based superconductors: Recent developments

abstract: In the recent search for unconventional- and topological superconductivity, noncentrosymmetric superconductors (NCSCs) rank among the most promising candidate materials. Surprisingly, some of them -- especially those containing rhenium -- seem to exhibit also time-reversal symmetry (TRS) breaking in their superconducting state, while TRS is preserved in many other isostructural NCSCs. To date, a satisfactory explanation for such discrepant behavior, albeit crucial for understanding the unconventional superconductivity of these materials, is still missing. Here we review the most recent developments regarding the Re-based class, where the muon-spin relaxation ($\mu$SR) technique plays a key role due to its high sensitivity to the weak internal fields associated with the TRS breaking phenomenon. We discuss different cases of Re-containing superconductors, comprising both centrosymmetric- and noncentrosymmetric crystal structures and ranging from pure rhenium, to Re$T$ ($T$ = 3$d$-5$d$ early transition metals), to the dilute-Re case of ReBe$_{22}$. $\mu$SR results suggest that the rhenium presence and its amount are two key factors for the appearance and the extent of TRS breaking in Re-based superconductors. Besides summarizing the existing findings, we also put forward future research ideas regarding the exciting field of materials showing TRS breaking.


title: Personalized Transformer for Explainable Recommendation

abstract: Personalization of natural language generation plays a vital role in a large spectrum of tasks, such as explainable recommendation, review summarization and dialog systems. In these tasks, user and item IDs are important identifiers for personalization. Transformer, which is demonstrated with strong language modeling capability, however, is not personalized and fails to make use of the user and item IDs since the ID tokens are not even in the same semantic space as the words. To address this problem, we present a PErsonalized Transformer for Explainable Recommendation (PETER), on which we design a simple and effective learning objective that utilizes the IDs to predict the words in the target explanation, so as to endow the IDs with linguistic meanings and to achieve personalized Transformer. Besides generating explanations, PETER can also make recommendations, which makes it a unified model for the whole recommendation-explanation pipeline. Extensive experiments show that our small unpretrained model outperforms fine-tuned BERT on the generation task, in terms of both effectiveness and efficiency, which highlights the importance and the nice utility of our design.


title: HIN-RNN: A Graph Representation Learning Neural Network for Fraudster Group Detection With No Handcrafted Features

abstract: Social reviews are indispensable resources for modern consumers' decision making. For financial gain, companies pay fraudsters preferably in groups to demote or promote products and services since consumers are more likely to be misled by a large number of similar reviews from groups. Recent approaches on fraudster group detection employed handcrafted features of group behaviors without considering the semantic relation between reviews from the reviewers in a group. In this paper, we propose the first neural approach, HIN-RNN, a Heterogeneous Information Network (HIN) Compatible RNN for fraudster group detection that requires no handcrafted features. HIN-RNN provides a unifying architecture for representation learning of each reviewer, with the initial vector as the sum of word embeddings of all review text written by the same reviewer, concatenated by the ratio of negative reviews. Given a co-review network representing reviewers who have reviewed the same items with the same ratings and the reviewers' vector representation, a collaboration matrix is acquired through HIN-RNN training. The proposed approach is confirmed to be effective with marked improvement over state-of-the-art approaches on both the Yelp (22% and 12% in terms of recall and F1-value, respectively) and Amazon (4% and 2% in terms of recall and F1-value, respectively) datasets.


title: IGO-QNN: Quantum Neural Network Architecture for Inductive Grover Oracularization

abstract: We propose a novel paradigm of integration of Grover's algorithm in a machine learning framework: the inductive Grover oracular quantum neural network (IGO-QNN). The model defines a variational quantum circuit with hidden layers of parameterized quantum neurons densely connected via entangle synapses to encode a dynamic Grover's search oracle that can be trained from a set of database-hit training examples. This widens the range of problem applications of Grover's unstructured search algorithm to include the vast majority of problems lacking analytic descriptions of solution verifiers, allowing for quadratic speed-up in unstructured search for the set of search problems with relationships between input and output spaces that are tractably underivable deductively. This generalization of Grover's oracularization may prove particularly effective in deep reinforcement learning, computer vision, and, more generally, as a feature vector classifier at the top of an existing model.


title: Limit Weierstrass Points on the Kenyon-Smillie Family of Plane Quartics

abstract: Costantini and Kappes gave an algebraic equation of the universal family over the Kenyon-Smillie (2,3,4)-Teichm\"uller curve. This equation gives rise to a family of projective plane quartic curves with three singular members. These singular curves are: (1) an integral nodal quartic, (2) the union of a line and a nodal cubic, and (3) a quadruple line. We determine the limit Weierstrass points on these singular curves.


title: TransLoc3D : Point Cloud based Large-scale Place Recognition using Adaptive Receptive Fields

abstract: Place recognition plays an essential role in the field of autonomous driving and robot navigation. Point cloud based methods mainly focus on extracting global descriptors from local features of point clouds. Despite having achieved promising results, existing solutions neglect the following aspects, which may cause performance degradation: (1) huge size difference between objects in outdoor scenes; (2) moving objects that are unrelated to place recognition; (3) long-range contextual information. We illustrate that the above aspects bring challenges to extracting discriminative global descriptors. To mitigate these problems, we propose a novel method named TransLoc3D, utilizing adaptive receptive fields with a point-wise reweighting scheme to handle objects of different sizes while suppressing noises, and an external transformer to capture long-range feature dependencies. As opposed to existing architectures which adopt fixed and limited receptive fields, our method benefits from size-adaptive receptive fields as well as global contextual information, and outperforms current state-of-the-arts with significant improvements on popular datasets.


title: Centimeter-Wave Free-Space Time-of-Flight Imaging

abstract: Depth cameras are emerging as a cornerstone modality with diverse applications that directly or indirectly rely on measured depth, including personal devices, robotics, and self-driving vehicles. Although time-of-flight (ToF) methods have fueled these applications, the precision and robustness of ToF methods is limited by relying on photon time-tagging or modulation after photo-conversion. Successful optical modulation approaches have been restricted fiber-coupled modulation with large coupling losses or interferometric modulation with sub-cm range, and the precision gap between interferometric methods and ToF methods is more than three orders of magnitudes. In this work, we close this gap and propose a computational imaging method for all-optical free-space correlation before photo-conversion that achieves micron-scale depth resolution with robustness to surface reflectance and ambient light with conventional silicon intensity sensors. To this end, we solve two technical challenges: modulating at GHz rates and computational phase unwrapping. We propose an imaging approach with resonant polarization modulators and devise a novel optical dual-pass frequency-doubling which achieves high modulation contrast at more than 10GHz. At the same time, centimeter-wave modulation together with a small modulation bandwidth render existing phase unwrapping methods ineffective. We tackle this problem with a neural phase unwrapping method that exploits that adjacent wraps are often highly correlated. We validate the proposed method in simulation and experimentally, where it achieves micron-scale depth precision. We demonstrate precise depth sensing independently of surface texture and ambient light and compare against existing analog demodulation methods, which we outperform across all tested scenarios.


title: MP3 White Paper 2021 -- Research Opportunities Enabled by Co-locating Multi-Petawatt Lasers with Dense Ultra-Relativistic Electron Beams

abstract: Novel emergent phenomena are expected to occur under conditions exceeding the QED critical electric field, where the vacuum becomes unstable to electron-positron pair production. The required intensity to reach this regime, $\sim10^{29}\,\mathrm{Wcm^{-2}}$, cannot be achieved even with the most intense lasers now being planned/constructed without a sizeable Lorentz boost provided by interactions with ultrarelativistic particles. Seeded laser-laser collisions may access this strong-field QED regime at laser intensities as low as $\sim10^{24}\,\mathrm{Wcm^{-2}}$. Counterpropagating e-beam--laser interactions exceed the QED critical field at still lower intensities ($\sim10^{20}\,\mathrm{Wcm^{-2}}$ at $\sim10\,\mathrm{GeV}$). Novel emergent phenomena are predicted to occur in the "QED plasma regime", where strong-field quantum and collective plasma effects play off one another. Here the electron beam density becomes a decisive factor. Thus, the challenge is not just to exceed the QED critical field, but to do so with high quality, approaching solid-density electron beams. Even though laser wakefield accelerators (LWFA) represent a very promising research field, conventional accelerators still provide orders of magnitude higher charge densities at energies $\gtrsim10\,\mathrm{GeV}$. Co-location of extremely dense and highly energetic electron beams with a multi-petawatt laser system would therefore enable seminal research opportunities in high-field physics and laboratory astrophysics. This white paper elucidates the potential scientific impact of multi-beam capabilities that combine a multi-PW optical laser, high-energy/density electron beam, and high-intensity x rays and outlines how to achieve such capabilities by co-locating a 3-10 PW laser with a state-of-the-art linear accelerator.


title: Metric results for numbers with multiple $q$-expansions

abstract: Let $M$ be a positive integer and $q\in (1, M+1]$. A $q$-expansion of a real number $x$ is a sequence $(c_i)=c_1c_2\cdots$ with $c_i\in \{0,1,\ldots, M\}$ such that $x=\sum_{i=1}^{\infty}c_iq^{-i}$. In this paper we study the set $\mathcal{U}_q^j$ consisting of those real numbers having exactly $j$ $q$-expansions. Our main result is that for Lebesgue almost every $q\in (q_{KL}, M+1), $ we have $$\dim_{H}\mathcal{U}_{q}^{j}\leq \max\{0, 2\dim_H\mathcal{U}_q-1\}\text{ for all } j\in\{2,3,\ldots\}.$$ Here $q_{KL}$ is the Komornik-Loreti constant. As a corollary of this result, we show that for any $j\in\{2,3,\ldots\},$ the function mapping $q$ to $\dim_{H}\mathcal{U}_{q}^{j}$ is not continuous.


title: Polarimetric Spatio-Temporal Light Transport Probing

abstract: Light emitted from a source into a scene can undergo complex interactions with scene surfaces of different material types before being reflected. During this transport, every surface reflection is encoded in the properties of the photons that reach the detector, including time, direction, intensity, wavelength and polarization. Conventional imaging systems capture intensity by integrating over all other dimensions of the light, hiding this rich scene information. Existing methods are capable of untangling these measurements into their spatial and temporal dimensions, fueling geometric scene understanding tasks. However, examining material properties jointly with geometric properties is an open challenge that could enable unprecedented capabilities beyond geometric scene understanding, allowing for material-dependent scene understanding and imaging through complex transport. In this work, we close this gap, and propose a computational light transport imaging method that captures the spatially- and temporally-resolved complete polarimetric response of a scene. Our method hinges on a 7D tensor theory of light transport. We discover low-rank structure in the polarimetric tensor dimension and propose a data-driven rotating ellipsometry method that learns to exploit redundancy of polarimetric structure. We instantiate our theory with two prototypes: spatio-polarimetric imaging and coaxial temporal-polarimetric imaging. This allows us, for the first time, to decompose scene light transport into temporal, spatial, and complete polarimetric dimensions that unveil scene properties hidden to conventional methods. We validate the applicability of our method on diverse tasks, including shape reconstruction with subsurface scattering, seeing through scattering media, untangling multi-bounce light transport, breaking metamerism, and decomposition of crystals.


title: Unsupervised Scale-consistent Depth Learning from Video

abstract: We propose a monocular depth estimator SC-Depth, which requires only unlabelled videos for training and enables the scale-consistent prediction at inference time. Our contributions include: (i) we propose a geometry consistency loss, which penalizes the inconsistency of predicted depths between adjacent views; (ii) we propose a self-discovered mask to automatically localize moving objects that violate the underlying static scene assumption and cause noisy signals during training; (iii) we demonstrate the efficacy of each component with a detailed ablation study and show high-quality depth estimation results in both KITTI and NYUv2 datasets. Moreover, thanks to the capability of scale-consistent prediction, we show that our monocular-trained deep networks are readily integrated into the ORB-SLAM2 system for more robust and accurate tracking. The proposed hybrid Pseudo-RGBD SLAM shows compelling results in KITTI, and it generalizes well to the KAIST dataset without additional training. Finally, we provide several demos for qualitative evaluation.


title: KnowSR: Knowledge Sharing among Homogeneous Agents in Multi-agent Reinforcement Learning

abstract: Recently, deep reinforcement learning (RL) algorithms have made great progress in multi-agent domain. However, due to characteristics of RL, training for complex tasks would be resource-intensive and time-consuming. To meet this challenge, mutual learning strategy between homogeneous agents is essential, which is under-explored in previous studies, because most existing methods do not consider to use the knowledge of agent models. In this paper, we present an adaptation method of the majority of multi-agent reinforcement learning (MARL) algorithms called KnowSR which takes advantage of the differences in learning between agents. We employ the idea of knowledge distillation (KD) to share knowledge among agents to shorten the training phase. To empirically demonstrate the robustness and effectiveness of KnowSR, we performed extensive experiments on state-of-the-art MARL algorithms in collaborative and competitive scenarios. The results demonstrate that KnowSR outperforms recently reported methodologies, emphasizing the importance of the proposed knowledge sharing for MARL.


title: Complex magnetic textures in Ni/Ir$_{n}$/Pt(111) ultrathin films

abstract: A combined approach using first-principles calculations and spin dynamics simulations is applied to study Ni/Ir$_{n}$/Pt(111) ($n=0,1,2$) films. The lowest-energy states are predicted to be spin-spirals but with a minute (of the order of a few $\mu$eV/atom) energy difference with skyrmionic states. The spontaneous low temperature skyrmions, with $\sim15$ nm to $\sim35$ nm size, arise from a large Dzyaloshinskii-Moriya (DM) and Heisenberg exchange interactions ratio and, in particular, from a large in-plane DM vector component for nearest neighbors. The skyrmions become larger and more dispersed with the enhancement of the Ir buffer thickness. Also, with increasing $n$, the skyrmions stability decrease when an external magnetic field is applied or the temperature is raised. For $n=0$ and $n=1$, we found that metastable skyrmioniums can occur, which are characterized by a slightly lower stability with respect to the external fields and larger critical currents, compared to skyrmions.


title: Twisted arrow categories, operads and Segal conditions

abstract: We introduce twisted arrow categories of operads and of algebras over operads. Up to equivalence of categories, the simplex category $\Delta$, Segal's category $\Gamma$, Connes cyclic category $\Lambda$, Moerdijk-Weiss dendroidal category $\Omega$, and categories similar to graphical categories of Hackney-Robertson-Yau are twisted arrow categories of symmetric or cyclic operads. Twisted arrow categories of operads admit Segal presheaves and 2-Segal presheaves, or decomposition spaces. Twisted arrow category of an operad $P$ is the $(\infty, 1)$-localization of the corresponding category $\Omega/P$ by the boundary preserving morphisms. Under mild assumptions, twisted arrow categories of operads, and closely related universal enveloping categories, are generalized Reedy. We also introduce twisted arrow operads, which are related to Baez--Dolan plus construction.


title: The Trade-off Strategy between Railroads and Customers: A Case Study for Low-frequency Entire Trains

abstract: Some large freight railroads ship a number of shipments over the rail network annually. To reduce unnecessary reclassifications of shipments on their routes, each railroad is willing to operate the entire train for an individual shipment. In other words, the motivation for providing the entire train service lies in a simple realization that door to door transportation (directly from origin to destination) can reduce operating costs by decreasing classification. However, this mode will increase inventory costs for customers when commodities are transported by low frequency entire train services. Thus, this study proposes the trade-off strategy to keep a balance between saving operating costs of railroads and increasing inventory costs of customers. We analyze the revenue and losses after a shipment shifting from the transfer transportation which contains a series of train services to the direct transportation by entire train service.


title: Fluxes and angular momentum

abstract: The Ashtekar-Streubel fluxes give a proposed definition of the angular momentum emitted by an isolated gravitationally radiating system. This was based on identifying a "phase space of radiative modes," independent of any internal degrees of freedom, and using the Hamiltonian functions conjugate to the action of the Bondi-Metzner-Sachs (BMS) group as the energy-momentum, supermomentum and angular momentum. However, there are some difficulties in formulating this phase space so as to get the proper degrees of freedom. I consider how to address this point, and also to identify circumstances in which the radiative modes are sufficiently decoupled that they can be assigned their own angular momentum. Two different phase spaces are considered. One, which seems to reflect what previous workers have done (it leads to the usual formulas for the Ashtekar-Streubel fluxes), is mathematically simpler, but this has unwanted degrees of freedom and is difficult to interpret physically. The second is a quotient of the first; it is better justified (at least in terms of degrees of freedom), and plausibly decouples the radiative angular momentum from internal modes (at least for systems which ultimately become stationary). The symplectic form for this quotient, and the corresponding angular momentum flux, involve highly non-local correlations. Both phase spaces are shown to have Poisson brackets implementing the BMS algebra. For both phase spaces, for axisymmetric space-times vacuum near null infinity, there can be no gravitational radiation of angular momentum about the axis of symmetry, although matter can carry off angular momentum in such cases.


title: Phase transition and cascading collapse in binary decision-making dynamics

abstract: Binary decision-making process is ubiquitous in social life and is of vital significance in many real-world issues, ranging from public health to political campaigns. While continuous opinion evolution independent of discrete choice behavior has been extensively studied, few works unveil how the group binary decision-making result is determined by the coupled dynamics of these two processes. To this end, we propose an agent-based model to study the collective behaviors of individual binary decision-making process through competitive opinion dynamics on social networks. Three key factors are considered: bounded confidence that describes the cognitive scope of the population, stubbornness level that characterizes the opinion updating speed, and the opinion strength that represents the asymmetry power or attractiveness of the two choices. We find that bounded confidence plays an important role in determining competing evolution results. As bounded confidence grows, population opinions experience polarization to consensus, leading to the emergence of phase transition from co-existence to winner-takes-all state under binary decisions. Of particular interest, we show how the combined effects of bounded confidence and asymmetry opinion strength may reverse the initial supportive advantage in competitive dynamics. Notably, our model qualitatively reproduces the important dynamical pattern during a brutal competition, namely, cascading collapse, as observed by real data. Finally and intriguingly, we find that individual cognitive heterogeneity can bring about randomness and unpredictability in binary decision-making process, leading to the emergence of indeterministic oscillation. Our results reveal how the diverse behavioral patterns of binary decision-making can be interpreted by the complicated interactions of the proposed elements, which provides important insights toward competitive dynamics


title: A Comparison of Reward Functions in Q-Learning Applied to a Cart Position Problem

abstract: Growing advancements in reinforcement learning has led to advancements in control theory. Reinforcement learning has effectively solved the inverted pendulum problem and more recently the double inverted pendulum problem. In reinforcement learning, our agents learn by interacting with the control system with the goal of maximizing rewards. In this paper, we explore three such reward functions in the cart position problem. This paper concludes that a discontinuous reward function that gives non-zero rewards to agents only if they are within a given distance from the desired position gives the best results.


title: TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference

abstract: Existing pre-trained language models (PLMs) are often computationally expensive in inference, making them impractical in various resource-limited real-world applications. To address this issue, we propose a dynamic token reduction approach to accelerate PLMs' inference, named TR-BERT, which could flexibly adapt the layer number of each token in inference to avoid redundant calculation. Specially, TR-BERT formulates the token reduction process as a multi-step token selection problem and automatically learns the selection strategy via reinforcement learning. The experimental results on several downstream NLP tasks show that TR-BERT is able to speed up BERT by 2-5 times to satisfy various performance demands. Moreover, TR-BERT can also achieve better performance with less computation in a suite of long-text tasks since its token-level layer number adaption greatly accelerates the self-attention operation in PLMs. The source code and experiment details of this paper can be obtained from https://github.com/thunlp/TR-BERT.


title: A Chandra Survey of $z\geq4.5$ Quasars

abstract: X-ray observations provide a unique probe of the accretion disk corona of supermassive black holes (SMBHs). In this paper, we present a uniform \emph{Chandra} X-ray data analysis of a sample of 152 $z\geq4.5$ quasars. We firmly detect 46 quasars of this sample in 0.5-2~keV above 3~$\sigma$ and calculate the upper limits of the X-ray flux of the remaining. We also estimate the power law photon index of the X-ray spectrum of 31 quasars. 24 of our sample quasars are detected in the FIRST or NVSS radio surveys; all of them are radio-loud. We statistically compare the X-ray properties of our $z\geq4.5$ quasars to other X-ray samples of AGN at different redshifts. The relation between the rest-frame X-ray luminosity and other quasar parameters, such as the bolometric luminosity, UV luminosity, or SMBH mass, show large scatters. These large scatters can be attributed to the narrow luminosity range at the highest redshift, the large measurement error based on relatively poor X-ray data, and the inclusion of radio-loud quasars in the sample. The $L_{\rm X}-L_{\rm UV}$ relationship is significantly sub-linear. We do not find a significant redshift evolution of the $L_{\rm X}-L_{\rm UV}$ relation, expressed either in the slope of this relation, or the departure of individual AGNs from the best-fit $\alpha_{\rm OX}-L_{\rm UV}$ relation ($\Delta\alpha_{\rm OX}$). The median value of the X-ray photon index is $\Gamma\approx1.79$, which does not show redshift evolution from $z=0$ to $z\sim7$. The X-ray and UV properties of the most distant quasars could potentially be used as a standard candle to constrain cosmological models. The large scatter of our sample on the Hubble diagram highlights the importance of future large unbiased deep X-ray and radio surveys in using quasars in cosmological studies.


title: Comparative Synthesis: Learning Near-Optimal Network Designs by Query

abstract: When managing wide-area networks, network architects must decide how to balance multiple conflicting metrics, and ensure fair allocations to competing traffic while prioritizing critical traffic. The state of practice poses challenges since architects must precisely encode their intent into formal optimization models using abstract notions such as utility functions, and ad-hoc manually tuned knobs. In this paper, we present the first effort to synthesize optimal network designs with indeterminate objectives using an interactive program-synthesis-based approach. We make three contributions. First, we present comparative synthesis, an interactive synthesis framework which produces near-optimal programs (network designs) through two kinds of queries (Propose and Compare), without an objective explicitly given. Second, we develop the first learning algorithm for comparative synthesis in which a voting-guided learner picks the most informative query in each iteration. We present theoretical analysis of the convergence rate of the algorithm. Third, we implemented Net10Q, a system based on our approach, and demonstrate its effectiveness on four real-world network case studies using black-box oracles and simulation experiments, as well as a pilot user study comprising network researchers and practitioners. Both theoretical and experimental results show the promise of our approach.


title: Optimal maximum norm estimates for virtual element methods

abstract: The maximum norm error estimations for virtual element methods are studied. To establish the error estimations, we prove higher local regularity based on delicate analysis of Green's functions and high-order local error estimations for the partition of the virtual element solutions. The maximum norm of the exact gradient and the gradient of the projection of the virtual element solutions are proved to achieve optimal convergence results. For high-order virtual element methods, we establish the optimal convergence results in $L^{\infty}$ norm. Our theoretical discoveries are validated by a numerical example on general polygonal meshes.


title: Connect the Dots: In Situ 4D Seismic Monitoring of CO2 Storage with Spatio-temporal CNNs

abstract: 4D seismic imaging has been widely used in CO$_2$ sequestration projects to monitor the fluid flow in the volumetric subsurface region that is not sampled by wells. Ideally, real-time monitoring and near-future forecasting would provide site operators with great insights to understand the dynamics of the subsurface reservoir and assess any potential risks. However, due to obstacles such as high deployment cost, availability of acquisition equipment, exclusion zones around surface structures, only very sparse seismic imaging data can be obtained during monitoring. That leads to an unavoidable and growing knowledge gap over time. The operator needs to understand the fluid flow throughout the project lifetime and the seismic data are only available at a limited number of times. This is insufficient for understanding the reservoir behavior. To overcome those challenges, we have developed spatio-temporal neural-network-based models that can produce high-fidelity interpolated or extrapolated images effectively and efficiently. Specifically, our models are built on an autoencoder, and incorporate the long short-term memory (LSTM) structure with a new loss function regularized by optical flow. We validate the performance of our models using real 4D post-stack seismic imaging data acquired at the Sleipner CO$_2$ sequestration field. We employ two different strategies in evaluating our models. Numerically, we compare our models with different baseline approaches using classic pixel-based metrics. We also conduct a blind survey and collect a total of 20 responses from domain experts to evaluate the quality of data generated by our models. Via both numerical and expert evaluation, we conclude that our models can produce high-quality 2D/3D seismic imaging data at a reasonable cost, offering the possibility of real-time monitoring or even near-future forecasting of the CO$_2$ storage reservoir.


title: Center-of-mass ambiguity for Bondi-Metzner-Sachs charges

abstract: Dray and Streubel proposed a definition of angular momentum in general relativity based on `Bondi-Metzner-Sachs (BMS) charges'. I show here that the natural definition of center of mass in this program has an infinite-dimensional ambiguity. (This seems not to have been noticed before because previous work has tacitly carried over a special-relativistic assumption.) A related point is that the natural definition of spin in this context is translation-, but not supertranslation-, invariant.


title: Self-consistent Stellar Radial Velocities from LAMOST Medium-Resolution Survey (MRS) DR7

abstract: Radial velocity (RV) is among the most fundamental physical quantities obtainable from stellar spectra and is rather important in the analysis of time-domain phenomena. The LAMOST Medium-Resolution Survey (MRS) DR7 contains 5 million single-exposure stellar spectra at spectral resolution $R\sim7\,500$. However, the temporal variation of the RV zero-points (RVZPs) of the MRS survey, which makes the RVs from multiple epochs inconsistent, has not been addressed. In this paper, we measure the RVs of the 3.8 million single-exposure spectra (for 0.6 million stars) with signal-to-noise ratio (SNR) higher than 5 based on cross-correlation function (CCF) method, and propose a robust method to self-consistently determine the RVZPs exposure-by-exposure for each spectrograph with the help of \textit{Gaia} DR2 RVs. Such RVZPs are estimated for 3.6 million RVs and can reach a mean precision of $\sim 0.38\,\mathrm{km\,s}^{-1}$. The result of the temporal variation of RVZPs indicates that our algorithm is efficient and necessary before we use the absolute RVs to perform time-domain analysis. Validating the results with APOGEE DR16 shows that our absolute RVs can reach an overall precision of 0.84/0.80 $\mathrm{km\,s}^{-1}$ in the blue/red arm at $50<\mathrm{SNR}<100$, while 1.26/1.99 $\mathrm{km\,s}^{-1}$ at $5<\mathrm{SNR}<10$. The cumulative distribution function (CDF) of the standard deviations of multiple RVs ($N_\mathrm{obs}\geq 8$) for 678 standard stars reach 0.45/0.54, 1.07/1.39, and 1.45/1.86 $\mathrm{km\,s}^{-1}$ in the blue/red arm at 50\%, 90\%, and 95\% levels, respectively. The catalogs of the RVs, RVZPs, and selected candidate RV standard stars are available at \url{https://github.com/hypergravity/paperdata}.


title: Boosting-GNN: Boosting Algorithm for Graph Networks on Imbalanced Node Classification

abstract: The Graph Neural Network (GNN) has been widely used for graph data representation. However, the existing researches only consider the ideal balanced dataset, and the imbalanced dataset is rarely considered. Traditional methods such as resampling, reweighting, and synthetic samples that deal with imbalanced datasets are no longer applicable in GNN. This paper proposes an ensemble model called Boosting-GNN, which uses GNNs as the base classifiers during boosting. In Boosting-GNN, higher weights are set for the training samples that are not correctly classified by the previous classifier, thus achieving higher classification accuracy and better reliability. Besides, transfer learning is used to reduce computational cost and increase fitting ability. Experimental results indicate that the proposed Boosting-GNN model achieves better performance than GCN, GraphSAGE, GAT, SGC, N-GCN, and most advanced reweighting and resampling methods on synthetic imbalanced datasets, with an average performance improvement of 4.5%


title: A Mathematical Model of COVID-19 Transmission

abstract: Disease transmission is studied through disciplines like epidemiology, applied mathematics, and statistics. Mathematical simulation models for transmission have implications in solving public and personal health challenges. The SIR model uses a compartmental approach including dynamic and nonlinear behavior of transmission through three factors: susceptible, infected, and removed (recovered and deceased) individuals. Using the Lambert W Function, we propose a framework to study solutions of the SIR model. This demonstrates the applications of COVID-19 transmission data to model the spread of a real-world disease. Different models of disease including the SIR, SIRmp and SEIRpqr model are compared with respect to their ability to predict disease spread. Physical distancing impacts and personal protection equipment use are discussed with relevance to the COVID-19 spread.


title: Least-Squares ReLU Neural Network (LSNN) Method For Scalar Nonlinear Hyperbolic Conservation Law

abstract: We introduced the least-squares ReLU neural network (LSNN) method for solving the linear advection-reaction problem with discontinuous solution and showed that the method outperforms mesh-based numerical methods in terms of the number of degrees of freedom. This paper studies the LSNN method for scalar nonlinear hyperbolic conservation law. The method is a discretization of an equivalent least-squares (LS) formulation in the set of neural network functions with the ReLU activation function. Evaluation of the LS functional is done by using numerical integration and conservative finite volume scheme. Numerical results of some test problems show that the method is capable of approximating the discontinuous interface of the underlying problem automatically through the free breaking lines of the ReLU neural network. Moreover, the method does not exhibit the common Gibbs phenomena along the discontinuous interface.


title: TIPCB: A Simple but Effective Part-based Convolutional Baseline for Text-based Person Search

abstract: Text-based person search is a sub-task in the field of image retrieval, which aims to retrieve target person images according to a given textual description. The significant feature gap between two modalities makes this task very challenging. Many existing methods attempt to utilize local alignment to address this problem in the fine-grained level. However, most relevant methods introduce additional models or complicated training and evaluation strategies, which are hard to use in realistic scenarios. In order to facilitate the practical application, we propose a simple but effective end-to-end learning framework for text-based person search named TIPCB (i.e., Text-Image Part-based Convolutional Baseline). Firstly, a novel dual-path local alignment network structure is proposed to extract visual and textual local representations, in which images are segmented horizontally and texts are aligned adaptively. Then, we propose a multi-stage cross-modal matching strategy, which eliminates the modality gap from three feature levels, including low level, local level and global level. Extensive experiments are conducted on the widely-used benchmark dataset (CUHK-PEDES) and verify that our method outperforms the state-of-the-art methods by 3.69%, 2.95% and 2.31% in terms of Top-1, Top-5 and Top-10. Our code has been released in https://github.com/OrangeYHChen/TIPCB.


title: Robust exceptional point of arbitrary order in coupled spinning cylinders

abstract: Exceptional points (EPs), i.e., non-Hermitian degeneracies at which eigenvalues and eigenvectors coalesce, can be realized by tuning the gain/loss contrast of different modes in non-Hermitian systems or by engineering the asymmetric coupling of modes. Here we demonstrate a mechanism that can achieve EPs of arbitrary order by employing the non-reciprocal coupling of spinning cylinders sitting on a dielectric waveguide. The spinning motion breaks the time-reversal symmetry and removes the degeneracy of opposite chiral modes of the cylinders. Under the excitation of a linearly polarized plane wave, the chiral mode of one cylinder can unidirectionally couple to the same mode of the other cylinder via the spin-orbit interaction associated with the evanescent wave of the waveguide. The structure can give rise to arbitrary-order EPs that are robust against spin-flipping perturbations, in contrast to conventional systems relying on spin-selective excitations. In addition, we show that higher-order EPs in the proposed system are accompanied by enhanced optical isolation, which may find applications in designing novel optical isolators, nonreciprocal optical devices, and topological photonics.


title: Dynamic analysis of influential stocks based on conserved networks

abstract: Characterizing temporal evolution of stock markets is a fundamental and challenging problem. The literature on analyzing the dynamics of the markets has focused so far on macro measures with less predictive power. This paper addresses this issue from a micro point of view. Given an investigating period, a series of stock networks are constructed first by the moving-window method and the significance test of stock correlations. Then, several conserved networks are generated to extract different backbones of the market under different states. Finally, influential stocks and corresponding sectors are identified from each conserved network, based on which the longitudinal analysis is performed to describe the evolution of the market. The application of the above procedure to stocks belonging to Standard \& Pool's 500 Index from January 2006 to April 2010 recovers the 2008 financial crisis from the evolutionary perspective.


title: Optical trapping of nanoparticles in superfluid helium

abstract: Optical tweezers, the three-dimensional confinement of a nanoparticle by a strongly focused beam of light, have been widely employed in investigating biomaterial nanomechanics, nanoscopic fluid properties, and ultrasensitive detections in various environments such as inside living cells, at gigapascal pressure, and under high vacuum. However, the cryogenic operation of solid-state-particle optical tweezers is poorly understood. In this study, we demonstrate the optical trapping of metallic and dielectric nanoparticles in superfluid helium below 2 K, which is two orders of magnitude lower than in the previous experiments. We prepare the nanoparticles via in-situ laser ablation. The nanoparticles are stably trapped with a single laser beam tightly focused in the superfluid helium. Our method provides a new approach for studying nanoscopic quantum hydrodynamic effects and interactions between quantum fluids and classical objects.


title: Least-Squares ReLU Neural Network (LSNN) Method For Linear Advection-Reaction Equation

abstract: This paper studies least-squares ReLU neural network method for solving the linear advection-reaction problem with discontinuous solution. The method is a discretization of an equivalent least-squares formulation in the set of neural network functions with the ReLU activation function. The method is capable of approximating the discontinuous interface of the underlying problem automatically through the free hyper-planes of the ReLU neural network and, hence, outperforms mesh-based numerical methods in terms of the number of degrees of freedom. Numerical results of some benchmark test problems show that the method can not only approximate the solution with the least number of parameters, but also avoid the common Gibbs phenomena along the discontinuous interface. Moreover, a three-layer ReLU neural network is necessary and sufficient in order to well approximate a discontinuous solution with an interface in $\mathbb{R}^2$ that is not a straight line.


title: Minimal graph in which the intersection of two longest paths is not a separator

abstract: We prove that for a connected simple graph $G$ with $n\le 10$ vertices, and two longest paths $C$ and $D$ in $G$, the intersection of vertex sets $V(C)\cap V(D)$ is a separator. This shows that the graph found previously with $n=11$, in which the complement of the intersection of vertex sets $V(C)\cap V(D)$ of two longest paths is connected, is minimal.


title: Robust Principal Component Analysis Using a Novel Kernel Related with the L1-Norm

abstract: We consider a family of vector dot products that can be implemented using sign changes and addition operations only. The dot products are energy-efficient as they avoid the multiplication operation entirely. Moreover, the dot products induce the $\ell_1$-norm, thus providing robustness to impulsive noise. First, we analytically prove that the dot products yield symmetric, positive semi-definite generalized covariance matrices, thus enabling principal component analysis (PCA). Moreover, the generalized covariance matrices can be constructed in an Energy Efficient (EEF) manner due to the multiplication-free property of the underlying vector products. We present image reconstruction examples in which our EEF PCA method result in the highest peak signal-to-noise ratios compared to the ordinary $\ell_2$-PCA and the recursive $\ell_1$-PCA.


title: Study of Anisotropy on Ferromagnetic Electrodes of a Magnetic Tunnel Junction (MTJ)-Based Molecular Spintronics Device (MTJMSD)

abstract: Magnetic tunnel junction-based molecular spintronics devices (MTJMSDs) are designed by covalently connecting the paramagnetic molecules across two ferromagnets (FM) electrodes of a magnetic tunnel junction (MTJ). MTJMSD provides opportunities to connect FM electrodes of a vast range of anisotropy properties to a variety of molecules of length scale. Our prior studies showed that the paramagnetic molecules can produce strong antiferromagnetic coupling with FM electrodes. The device properties of MTJMSD depend upon various factors such as anisotropy, spin fluctuation, thermal energy, etc. In this paper, we report a theoretical Monte Carlo Simulation (MCS) study to explain the impact of anisotropy on the MTJMSD equilibrium properties. We studied the energy variation of the MTJMSD system with time as a function of FM electrode anisotropy. Experimentally designed FM electrodes of MTJMSD contain multi-layers of different ferromagnetic materials. These materials possess in-plane and out-of-plane magnetic anisotropy characteristics. To understand the competing effect of in-plane and out-of-plane anisotropy, we have computationally applied anisotropies on the left FM electrode. For the MCS study, the orientation of the device was kept along YZ plane. As a result, the applied anisotropy along the X-direction (\mathbit{A}_{\mathbit{Lx}}) and Y-direction (\mathbit{A}_{\mathbit{Ly}}) represent out-of-plane and in-plane anisotropy, respectively. We found that increasing anisotropy strength starts exhibiting diverse domain structures within an FM electrode. Increasing the magnitude of anisotropy was found to create stripe-shaped domains with opposite spins. These domains represent the different magnetic phases. However, the application of equal magnitude of in-plane and out-of-plane cancels the strip domain formation and lowers the magnetic moment of overall MTJMSD.


title: FILTRA: Rethinking Steerable CNN by Filter Transform

abstract: Steerable CNN imposes the prior knowledge of transformation invariance or equivariance in the network architecture to enhance the the network robustness on geometry transformation of data and reduce overfitting. It has been an intuitive and widely used technique to construct a steerable filter by augmenting a filter with its transformed copies in the past decades, which is named as filter transform in this paper. Recently, the problem of steerable CNN has been studied from aspect of group representation theory, which reveals the function space structure of a steerable kernel function. However, it is not yet clear on how this theory is related to the filter transform technique. In this paper, we show that kernel constructed by filter transform can also be interpreted in the group representation theory. This interpretation help complete the puzzle of steerable CNN theory and provides a novel and simple approach to implement steerable convolution operators. Experiments are executed on multiple datasets to verify the feasibility of the proposed approach.


title: On the weak norm of $\mathscr{U}_p$-residuals of all subgroups of a finite group

abstract: Let $\mathscr{F}$ be a formation and $G$ a finite group. The weak norm of a subgroup $H$ in $G$ with respect to $\mathscr{F}$ is defined by $N_{\mathscr{F}}(G,H)=\underset{T\leq H}{\bigcap}N_G(T^{\mathscr{F}})$. In particular, $N_{\mathscr{F}}(G)=N_{\mathscr{F}}(G,G)$. Let $N^i_{\mathscr{F}}(G)$,$i\geq 1$, be a upper series of $G$ by setting $N^0_{\mathscr{F}}(G)=1$, $N^{i+1}_{\mathscr{F}}(G)/N^i_{\mathscr{F}}(G)=N_{\mathscr{F}}(G/N^i_{\mathscr{F}}(G))$ and denoted by $N^{\infty}_{\mathscr{F}}(G)$ the terminal term of the series. In this paper, for the case $\mathscr{F}\in\{\mathscr{U}_p,\mathscr{U}\}$, where $\mathscr{U}_p$($\mathscr{U}$,respectively) is the class of all finite $p$-supersolvable groups(supersolvable groups,respectively), we characterize the structure of some given finite groups by the properties of weak norm of some subgroups in $G$ with respect to $\mathscr{F}$. Some of our main results may regard as a continuation of many nice previous work.


title: Review of Sulphur Interaction based GaAs Surface Passivation and Its Potential Application in Magnetic Tunnel Junction (MTJ) based Molecular Spintronics Devices (MTJMSD)

abstract: GaAs surface is characterized by a high density of surface states, which preclude the utilization of this semiconducting material for the realization of several advanced devices. Sulfur-based passivation has been found significantly useful in reducing the effect of dangling bonds. In this article first, the problem associated with GaAs surface has been discussed in a tutorial form. Secondly, a brief introduction of a wide variety of surface passivation methods was introduced. Sulfur passivation, the most effective surface state quenching method, has been elaborated. Thirdly, current trends in the field of surface passivation of GaAs surface have been discussed. Our discussion also focusses on utilizing GaAs and alloys for the molecular electronics and molecular spintronics and based on our insights in the GaAs (P. Tyagi, MRS Advances 2 (51), 2915-2920 2017) and molecular spintronics field ((P. Tyagi, D. F. Li, S. M. Holmes and B. J. Hinds, J. Am. Chem. Soc. 129 (16), 4929, 2007) and P. Tyagi, C. Riso, U. Amir, C. Rojas-Dotti and J. Mart\'inez-Lillo, RSC Advances 10 (22), 13006, 2020) ).


title: Interpolating between multi-center microstate geometries

abstract: We study interpolation between two multi-center microstate geometries in 4d/5d that represent Lunin-Mathur geometries with circular profiles. The interpolating solution is a Lunin-Mathur geometry with a helical profile, and is represented by a 2-center solution with a codimension-2 source. The interpolating 2-center solution exhibits interesting features such as some of the charges being delocalized, and some of the charges getting transferred from the codimension-2 center to the other, codimension-3 center as the interpolation proceeds. We also discuss the spectral flow of this entire process and speculate on the relevance of such solutions to understanding general microstates of 3-charge black holes.


title: Safe Model-based Off-policy Reinforcement Learning for Eco-Driving in Connected and Automated Hybrid Electric Vehicles

abstract: Connected and Automated Hybrid Electric Vehicles have the potential to reduce fuel consumption and travel time in real-world driving conditions. The eco-driving problem seeks to design optimal speed and power usage profiles based upon look-ahead information from connectivity and advanced mapping features. Recently, Deep Reinforcement Learning (DRL) has been applied to the eco-driving problem. While the previous studies synthesize simulators and model-free DRL to reduce online computation, this work proposes a Safe Off-policy Model-Based Reinforcement Learning algorithm for the eco-driving problem. The advantages over the existing literature are three-fold. First, the combination of off-policy learning and the use of a physics-based model improves the sample efficiency. Second, the training does not require any extrinsic rewarding mechanism for constraint satisfaction. Third, the feasibility of trajectory is guaranteed by using a safe set approximated by deep generative models. The performance of the proposed method is benchmarked against a baseline controller representing human drivers, a previously designed model-free DRL strategy, and the wait-and-see optimal solution. In simulation, the proposed algorithm leads to a policy with a higher average speed and a better fuel economy compared to the model-free agent. Compared to the baseline controller, the learned strategy reduces the fuel consumption by more than 21\% while keeping the average speed comparable.


title: Searches for continuous gravitational waves from young supernova remnants in the early third observing run of Advanced LIGO and Virgo

abstract: We present results of three wide-band directed searches for continuous gravitational waves from 15 young supernova remnants in the first half of the third Advanced LIGO and Virgo observing run. We use three search pipelines with distinct signal models and methods of identifying noise artifacts. Without ephemerides of these sources, the searches are conducted over a frequency band spanning from 10~Hz to 2~kHz. We find no evidence of continuous gravitational radiation from these sources. We set upper limits on the intrinsic signal strain at 95\% confidence level in sample sub-bands, estimate the sensitivity in the full band, and derive the corresponding constraints on the fiducial neutron star ellipticity and $r$-mode amplitude. The best 95\% confidence constraints placed on the signal strain are $7.7\times 10^{-26}$ and $7.8\times 10^{-26}$ near 200~Hz for the supernova remnants G39.2--0.3 and G65.7+1.2, respectively. The most stringent constraints on the ellipticity and $r$-mode amplitude reach $\lesssim 10^{-7}$ and $ \lesssim 10^{-5}$, respectively, at frequencies above $\sim 400$~Hz for the closest supernova remnant G266.2--1.2/Vela Jr.


title: Fourier majorants that match norms

abstract: Denote the coefficients in the complex form of the Fourier series of a function $f$ on the interval $[-\pi, \pi)$ by $\hat f(n)$. It is known that if $p = 2j/(2j-1)$ for some integer $j>0$, then for each function $f$ in $L^p$ there exists another function $F$ in $L^p$ that majorizes $f$ in the sense that $\hat F(n) \ge |\hat f(n)|$ for all $n$, but that also satisfies $\|F\|_p \le \|f\|_p$. Rescaling $F$ suitably then gives a majorant with the same $L^p$ norm as $f$. We show how that majorant comes from a variant in $L^{2j}$ of the notion of exact majorant in $L^2$.


title: Silica Raman scattering probe for absolute calibration of Thomson scattering spectrometers

abstract: We have developed a solid state probe for an absolute irradiance calibration of the Thomson scattering system on the Large Plasma Device (LAPD), based on Raman scattering off silica. Measurements performed with a triple-grating spectrometer have investigated the intensities of a pulsed laser beam Raman scattered off crystalline and amorphous silica over a range of temperatures of relevance to the LAPD (299 - 498 K). The data were compared with Rayleigh and Raman scattering intensities in gaseous nitrogen. The measurements show that Raman scattering off quartz allows rapid and accurate alignment and calibration of Thomson scattering systems in plasma physics experiments that cannot be calibrated using conventional methods.


title: A Survey on Complex Knowledge Base Question Answering: Methods, Challenges and Solutions

abstract: Knowledge base question answering (KBQA) aims to answer a question over a knowledge base (KB). Recently, a large number of studies focus on semantically or syntactically complicated questions. In this paper, we elaborately summarize the typical challenges and solutions for complex KBQA. We begin with introducing the background about the KBQA task. Next, we present the two mainstream categories of methods for complex KBQA, namely semantic parsing-based (SP-based) methods and information retrieval-based (IR-based) methods. We then review the advanced methods comprehensively from the perspective of the two categories. Specifically, we explicate their solutions to the typical challenges. Finally, we conclude and discuss some promising directions for future research.


title: Feature Space Targeted Attacks by Statistic Alignment

abstract: By adding human-imperceptible perturbations to images, DNNs can be easily fooled. As one of the mainstream methods, feature space targeted attacks perturb images by modulating their intermediate feature maps, for the discrepancy between the intermediate source and target features is minimized. However, the current choice of pixel-wise Euclidean Distance to measure the discrepancy is questionable because it unreasonably imposes a spatial-consistency constraint on the source and target features. Intuitively, an image can be categorized as "cat" no matter the cat is on the left or right of the image. To address this issue, we propose to measure this discrepancy using statistic alignment. Specifically, we design two novel approaches called Pair-wise Alignment Attack and Global-wise Alignment Attack, which attempt to measure similarities between feature maps by high-order statistics with translation invariance. Furthermore, we systematically analyze the layer-wise transferability with varied difficulties to obtain highly reliable attacks. Extensive experiments verify the effectiveness of our proposed method, and it outperforms the state-of-the-art algorithms by a large margin. Our code is publicly available at https://github.com/yaya-cheng/PAA-GAA.


title: Structured Convolutional Kernel Networks for Airline Crew Scheduling

abstract: Motivated by the needs from an airline crew scheduling application, we introduce structured convolutional kernel networks (Struct-CKN), which combine CKNs from Mairal et al. (2014) in a structured prediction framework that supports constraints on the outputs. CKNs are a particular kind of convolutional neural networks that approximate a kernel feature map on training data, thus combining properties of deep learning with the non-parametric flexibility of kernel methods. Extending CKNs to structured outputs allows us to obtain useful initial solutions on a flight-connection dataset that can be further refined by an airline crew scheduling solver. More specifically, we use a flight-based network modeled as a general conditional random field capable of incorporating local constraints in the learning process. Our experiments demonstrate that this approach yields significant improvements for the large-scale crew pairing problem (50,000 flights per month) over standard approaches, reducing the solution cost by 17% (a gain of millions of dollars) and the cost of global constraints by 97%.


title: Spin State of Single Molecular Magnet (SMM) Creating Long Range Ordering on Ferromagnetic Layers of Magnetic Tunnel Junction -A Monte Carlo Study

abstract: Single molecular magnet (SMM) like paramagnetic molecules interacting with the ferromagnetic electrodes of a magnetic tunnel junction (MTJ) produce a new system that differs dramatically from the properties of isolated molecules and ferromagnets. However, it is unknown how far deep in the ferromagnetic electrode the impact of the paramagnetic molecule and ferromagnet interactions can travel for various levels of molecular spin states. Our prior experimental studies showed two types of paramagnetic SMMs, the hexanuclear Mn6 and octanuclear Fe-Ni molecular complexes, covalently bonded to ferromagnets produced unprecedented strong antiferromagnetic coupling between two ferromagnets at room temperature leading to a number of intriguing observations. In this paper, we report Monte Carlo Simulations (MCS) study focusing on the impact of the molecular spin state on cross junction shaped MTJ based molecular spintronics device (MTJMSD). Our MCS study focused on the Heisenberg model of MTJMSD and investigated the impact of various molecular coupling strengths, thermal energy, and molecular spin states. To gauge the impact of the molecular spin state on the region of ferromagnetic electrodes, we examined the spatial distribution of molecule-ferromagnet correlated phases. Our MCS study shows that under a strong coupling regime molecular spin state should be approximately 30 percent of the ferromagnetic electrode atomic spins to create long-range correlated phases.


title: Mechanical response of packings of non-spherical particles: A case study of 2D packings of circulo-lines

abstract: We investigate the mechanical response of jammed packings of circulo-lines, interacting via purely repulsive, linear spring forces, as a function of pressure $P$ during athermal, quasistatic isotropic compression. Prior work has shown that the ensemble-averaged shear modulus for jammed disk packings scales as a power-law, $\langle G(P) \rangle \sim P^{\beta}$, with $\beta \sim 0.5$, over a wide range of pressure. For packings of circulo-lines, we also find robust power-law scaling of $\langle G(P)\rangle$ over the same range of pressure for aspect ratios ${\cal R} \gtrsim 1.2$. However, the power-law scaling exponent $\beta \sim 0.8$-$0.9$ is much larger than that for jammed disk packings. To understand the origin of this behavior, we decompose $\langle G\rangle$ into separate contributions from geometrical families, $G_f$, and from changes in the interparticle contact network, $G_r$, such that $\langle G \rangle = \langle G_f\rangle + \langle G_r \rangle$. We show that the shear modulus for low-pressure geometrical families for jammed packings of circulo-lines can both increase {\it and} decrease with pressure, whereas the shear modulus for low-pressure geometrical families for jammed disk packings only decreases with pressure. For this reason, the geometrical family contribution $\langle G_f \rangle$ is much larger for jammed packings of circulo-lines than for jammed disk packings at finite pressure, causing the increase in the power-law scaling exponent.


title: On Enhancing Ground Surface Detection from Sparse Lidar Point Cloud

abstract: Ground surface detection in point cloud is widely used as a key module in autonomous driving systems. Different from previous approaches which are mostly developed for lidars with high beam resolution, e.g. Velodyne HDL-64, this paper proposes ground detection techniques applicable to much sparser point cloud captured by lidars with low beam resolution, e.g. Velodyne VLP-16. The approach is based on the RANSAC scheme of plane fitting. Inlier verification for plane hypotheses is enhanced by exploiting the point-wise tangent, which is a local feature available to compute regardless of the density of lidar beams. Ground surface which is not perfectly planar is fitted by multiple (specifically 4 in our implementation) disjoint plane regions. By assuming these plane regions to be rectanglar and exploiting the integral image technique, our approach approximately finds the optimal region partition and plane hypotheses under the RANSAC scheme with real-time computational complexity.


title: Using Game Theory to maximize the chance of victory in two-player sports

abstract: Game Theory concepts have been successfully applied in a wide variety of domains over the past decade. Sports and games are one of the popular areas of game theory application owing to its merits and benefits in solving complex scenarios. With recent advancements in technology, the technical and analytical assistance available to players before the match, during game-play and after the match in the form of post-match analysis for any kind of sport has improved to a great extent. In this paper, we propose three novel approaches towards the development of a tool that can assist the players by providing detailed analysis of optimal decisions so that the player is well prepared with the most appropriate strategy which would produce a favourable result for a given opponent's strategy. We also describe how the system changes when we consider real-time game-play wherein the history of the opponent's strategies in the current rally is also taken into consideration while suggesting.


title: Fast and Accurate Scene Parsing via Bi-direction Alignment Networks

abstract: In this paper, we propose an effective method for fast and accurate scene parsing called Bidirectional Alignment Network (BiAlignNet). Previously, one representative work BiSeNet~\cite{bisenet} uses two different paths (Context Path and Spatial Path) to achieve balanced learning of semantics and details, respectively. However, the relationship between the two paths is not well explored. We argue that both paths can benefit each other in a complementary way. Motivated by this, we propose a novel network by aligning two-path information into each other through a learned flow field. To avoid the noise and semantic gaps, we introduce a Gated Flow Alignment Module to align both features in a bidirectional way. Moreover, to make the Spatial Path learn more detailed information, we present an edge-guided hard pixel mining loss to supervise the aligned learning process. Our method achieves 80.1\% and 78.5\% mIoU in validation and test set of Cityscapes while running at 30 FPS with full resolution inputs. Code and models will be available at \url{https://github.com/jojacola/BiAlignNet}.


title: Some classical analysis results for continuous definable mappings

abstract: In this paper, we show that some fundamental results for smooth mappings (e.g., the Brouwer degree formula, the implicit function and inverse function theorems, the mean value theorem, Sard's theorem, Hadamard's global invertibility criteria, Pourciau's surjectivity and openness results) have natural extensions for continuous mappings that are definable in o-minimal structures. The arguments rely on nice properties of definable mappings and sets.


title: Scaling Hierarchical Agglomerative Clustering to Billion-sized Datasets

abstract: Hierarchical Agglomerative Clustering (HAC) is one of the oldest but still most widely used clustering methods. However, HAC is notoriously hard to scale to large data sets as the underlying complexity is at least quadratic in the number of data points and many algorithms to solve HAC are inherently sequential. In this paper, we propose {Reciprocal Agglomerative Clustering (RAC)}, a distributed algorithm for HAC, that uses a novel strategy to efficiently merge clusters in parallel. We prove theoretically that RAC recovers the exact solution of HAC. Furthermore, under clusterability and balancedness assumption we show provable speedups in total runtime due to the parallelism. We also show that these speedups are achievable for certain probabilistic data models. In extensive experiments, we show that this parallelism is achieved on real world data sets and that the proposed RAC algorithm can recover the HAC hierarchy on billions of data points connected by trillions of edges in less than an hour.


title: Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networks

abstract: Spiking Neural Networks (SNNs), as bio-inspired energy-efficient neural networks, have attracted great attentions from researchers and industry. The most efficient way to train deep SNNs is through ANN-SNN conversion. However, the conversion usually suffers from accuracy loss and long inference time, which impede the practical application of SNN. In this paper, we theoretically analyze ANN-SNN conversion and derive sufficient conditions of the optimal conversion. To better correlate ANN-SNN and get greater accuracy, we propose Rate Norm Layer to replace the ReLU activation function in source ANN training, enabling direct conversion from a trained ANN to an SNN. Moreover, we propose an optimal fit curve to quantify the fit between the activation value of source ANN and the actual firing rate of target SNN. We show that the inference time can be reduced by optimizing the upper bound of the fit curve in the revised ANN to achieve fast inference. Our theory can explain the existing work on fast reasoning and get better results. The experimental results show that the proposed method achieves near loss less conversion with VGG-16, PreActResNet-18, and deeper structures. Moreover, it can reach 8.6x faster reasoning performance under 0.265x energy consumption of the typical method. The code is available at https://github.com/DingJianhao/OptSNNConvertion-RNL-RIL.


title: Detectable Gravitational Wave Signals from Affleck-Dine Baryogenesis

abstract: In Affleck-Dine baryogenesis, the observed baryon asymmetry of the Universe is generated through the evolution of the vacuum expectation value (VEV) of a scalar condensate. This scalar condensate generically fragments into non-topological solitons (Q-balls). If they are sufficiently long-lived, they lead to an early matter domination epoch, which enhances the primordial gravitational wave signal for modes that enter the horizon during this epoch. The sudden decay of the Q-balls into fermions results in a rapid transition from matter to radiation domination, producing a sharp peak in the gravitational wave power spectrum. Avoiding the problem of gravitino over-abundance favours scenarios where the peak frequency of the resonance is within the range of the Einstein Telescope and/or Decigo. Therefore, we show this scenario provides an observable signal, providing a mechanism to test Affleck-Dine baryogenesis.


title: An experimental review of open heavy flavor and quarkonium production at RHIC

abstract: Open heavy flavor and quarkonium are unique probes of the hot-dense medium produced in heavy-ion collisions. Their production in p+p collisions also provide important test of QCD. In this paper, we review the selected results on open heavy flavor and quarkonium in p+p and heavy-ion collisions achieved at RHIC. Physics implications are also discussed.


title: Dynamic Dual Sampling Module for Fine-Grained Semantic Segmentation

abstract: Representation of semantic context and local details is the essential issue for building modern semantic segmentation models. However, the interrelationship between semantic context and local details is not well explored in previous works. In this paper, we propose a Dynamic Dual Sampling Module (DDSM) to conduct dynamic affinity modeling and propagate semantic context to local details, which yields a more discriminative representation. Specifically, a dynamic sampling strategy is used to sparsely sample representative pixels and channels in the higher layer, forming adaptive compact support for each pixel and channel in the lower layer. The sampled features with high semantics are aggregated according to the affinities and then propagated to detailed lower-layer features, leading to a fine-grained segmentation result with well-preserved boundaries. Experiment results on both Cityscapes and Camvid datasets validate the effectiveness and efficiency of the proposed approach. Code and models will be available at \url{x3https://github.com/Fantasticarl/DDSM}.


title: Phase Transitions in Ehrenfest Urns Model with Interactions: Coexistence of uniform and non-uniform states

abstract: A model based on the classic non-interacting Ehrenfest urn model with two-urns is generalized to $M$ urns with the introduction of interactions for particles within the same urn. As the inter-particle interaction strength is varied, phases of different levels of non-uniformity emerge and their stabilities are calculated analytically. In particular, coexistence of locally stable uniform and non-uniform phases connected by first-order transition occurs. The phase transition threshold and energy barrier can be derived exactly together with the phase diagram obtained analytically. These analytic results are further confirmed by Monte Carlo simulations.


title: Kernel Knockoffs Selection for Nonparametric Additive Models

abstract: Thanks to its fine balance between model flexibility and interpretability, the nonparametric additive model has been widely used, and variable selection for this type of model has been frequently studied. However, none of the existing solutions can control the false discovery rate (FDR) unless the sample size tends to infinity. The knockoff framework is a recent proposal that can address this issue, but few knockoff solutions are directly applicable to nonparametric models. In this article, we propose a novel kernel knockoffs selection procedure for the nonparametric additive model. We integrate three key components: the knockoffs, the subsampling for stability, and the random feature mapping for nonparametric function approximation. We show that the proposed method is guaranteed to control the FDR for any sample size, and achieves a power that approaches one as the sample size tends to infinity. We demonstrate the efficacy of our method through intensive simulations and comparisons with the alternative solutions. Our proposal thus makes useful contributions to the methodology of nonparametric variable selection, FDR-based inference, as well as knockoffs.


title: Discovery of two infrared objects with strong ice absorption in the AKARI slit-less spectroscopic survey of the Galactic Plane

abstract: We discover two infrared objects that show deep absorption features of H2O, CO2, and CO ices in the AKARI/Infrared Camera (IRC) slit-less spectroscopic survey of the Galactic plane in 2.5--13 micron. Both objects are located neither in known star-forming regions nor in known dense clouds. For one of the objects, Object 1, we successfully extract a spectrum from 2.5 to 13 micron, which also shows several absorption features in 5--13 micron, including deep silicate absorption at 10 micron. For the other object, Object 2, only a spectrum from 3.1 to 5 micron is reliably extracted due to the presence of nearby overlapping objects and faint nebulosity. Both objects show warm (>100 K) CO gas absorption in addition to the ice absorption features, suggesting that they are embedded young stellar objects (YSOs). On the other hand, both objects have spectral energy distributions (SEDs) that peak at around 5 micron and decrease towards longer wavelengths. These characteristics of the SEDs and the presence of deep absorption features cannot easily be accounted for by standard YSO models. They may be explained as background stars behind dense clouds. We discuss possible nature of the objects and implications of the present discovery.


title: Quantum sensing of weak electric and magnetic fields by coherent amplification of energy level shift effects

abstract: A method for measuring small energy level shifts in a qubit by coherent amplification of their effect is proposed. It is based on the repeated application of the same interaction pulse in two manners: with the same phase of each subsequent pulse, and with an alternating phase shift of $\pi$ (i.e. a minus sign) from pulse to pulse. Two specific types of pulses are considered: a resonant $\pi$ pulse and an adiabatic chirped pulse, both of which produce complete population inversion with high fidelity. In the presence of a weak ambient external electric or magnetic field, the ensuing Stark or Zeeman shift leads to an energy level shift and hence a static detuning. In both the resonant and adiabatic approaches, a small level shift does not alter the transition probability very much; however, it can significantly change the dynamical phases in the propagator. The repeated application of the same pulse greatly amplifies the changes in the dynamical phases and maps them onto the populations. Hence the effect of the level shift can be measured with good accuracy. It is found that sequences of pulses with alternating phases deliver much greater error amplification and much steeper excitation profiles around resonance, thereby providing much higher sensitivity to small energy level shifts. Explicit analytic estimates of the sensitivity are derived using the well-known non-crossing Rosen-Zener and Rabi models and the level-crossing Demkov-Kunike model. This recipe provides a simple tool for rapid and accurate sensing of weak electric and magnetic fields by using the same pulse generating an inversion quantum gate, without sophisticated tomography or entangling operations.


title: The Hipparcos-Gaia Catalog of Accelerations: Gaia EDR3 Edition

abstract: We present a cross-calibration of Hipparcos and Gaia EDR3 intended to identify astrometrically accelerating stars and to fit orbits to stars with faint, massive companions. The resulting catalog, the EDR3 edition of the Hipparcos-Gaia Catalog of Accelerations (HGCA), provides three proper motions with calibrated uncertainties on the EDR3 reference frame: the Hipparcos proper motion, the Gaia EDR3 proper motion, and the long-term proper motion given by the difference in position between Hipparcos and Gaia EDR3. Our approach is similar to that for the Gaia DR2 edition of the HGCA, but offers a factor of ~3 improvement in precision thanks to the longer time baseline and improved data processing of Gaia EDR3. We again find that a 60/40 mixture of the two Hipparcos reductions outperforms either reduction individually, and we find strong evidence for locally variable frame rotations between all pairs of proper motion measurements. The substantial global frame rotation seen in DR2 proper motions has been removed in EDR3. We also correct for color- and magnitude-dependent frame rotations at a level of up to ~50 $\mu$as/yr in Gaia EDR3. We calibrate the Gaia EDR3 uncertainties using a sample of radial velocity standard stars without binary companions; we find an error inflation factor (a ratio of total to formal uncertainty) of 1.37. This is substantially lower than the position dependent factor of ~1.7 found for Gaia DR2 and reflects the improved data processing in EDR3. While the catalog should be used with caution, its proper motion residuals provide a powerful tool to measure the masses and orbits of faint, massive companions to nearby stars.

categories: astro-ph.GA astro-ph.EP astro-ph.IM astro-ph.SR


title: On the fluid-structure interaction of a flexible cantilever cylinder at low Reynolds numbers

abstract: We present a numerical study to investigate the fluid-structure interaction of a flexible circular cantilever cylinder in a uniform cross-flow. We employ a fully-coupled fluid-structure solver based on the three-dimensional Navier-Stokes equations and the Euler-Bernoulli beam theory. We examine the dynamics of the cylinder for a wide range of reduced velocities ($U^*$), mass ratios ($m^*$), and Reynolds numbers ($Re$). Of particular interest is to explore the possibility of flow-induced vibrations in a slender cantilever cylinder of aspect ratio $AR=100$ at laminar subcritical $Re$ regime (i.e., no periodic vortex shedding). We assess the extent to which such a flexible cylindrical beam can sustain flow-induced vibrations and characterize the contribution of the beam's flexibility to the stability of the wake at low $Re$. We show that when certain conditions are satisfied, the flexible cantilever cylinder undergoes sustained large-amplitude vibrations. The frequency of the oscillations is found to match the frequency of the periodic fluid forces for a particular range of system parameters. In this range, the frequency of the transverse vibrations is shown to match the first-mode natural frequency of the cylinder, indicating the existence of the lock-in phenomenon. The range of the lock-in regime is shown to have a strong dependence on $Re$ and $m^*$. We discover that unlike the steady wake behind a stationary rigid cylinder, the wake of a low mass ratio flexible cantilever cylinder could lose its stability in the lock-in regime at Reynolds numbers as low as $Re=22$. A combined VIV-galloping type instability is shown to be the possible cause of the wake instability at this $Re$ regime. These findings attempt to generalize our understanding of the flow-induced vibrations in flexible cantilever structures and can have a profound impact on the development of novel flow-measurement sensors.


title: Unified description of cuprate superconductors using four-band $d$-$p$ model

abstract: In the 35 years since the discovery of cuprate superconductors, we have not yet reached a unified understanding of their properties, including their material dependence of the superconducting transition temperature $T_{\text{c}}$. The preceding theoretical and experimental studies have provided an overall picture of the phase diagram, and some important parameters for the $T_{\text{c}}$, such as the contribution of the Cu $d_{z^2}$ orbital to the Fermi surface and the site-energy difference $\Delta_{dp}$ between the Cu $d_{x^2-y^2}$ and O $p$ orbitals. However, they are somewhat empirical and limited in scope, always including exceptions, and do not provide a comprehensive view of the series of cuprates. Here we propose a four-band $d$-$p$ model as a minimal model to study material dependence in cuprates. Using the variational Monte Carlo method, we theoretically investigate the phase diagram for the La$_2$CuO$_4$ and HgBa$_2$CuO$_4$ systems and the correlation between the key parameters and the superconductivity. Our results comprehensively account for the empirical correlation between $T_{\text{c}}$ and model parameters, and thus can provide a guideline for new material design. We also show that the effect of the nearest-neighbor $d$-$d$ Coulomb interaction $V_{dd}$ is actually quite important for the stability of superconductivity and phase competition.


title: A Taxonomy Study on Securing Blockchain-based Industrial Applications: An Overview, Application Perspectives, Requirements, Attacks, Countermeasures, and Open Issues

abstract: Blockchain technology has taken on a leading role in today's industrial applications by providing salient features and showing significant performance since its beginning. Blockchain began its journey from the concept of cryptocurrency and is now part of a range of core applications to achieve resilience and automation between various tasks. With the integration of Blockchain technology into different industrial applications, many application designs, security and privacy challenges present themselves, posing serious threats to users and their data. Although several approaches have been proposed to address the specific security and privacy needs of targeted applications with functional parameters, there is still a need for a research study on the application, security and privacy challenges, and requirements of Blockchain-based industrial applications, along with possible security threats and countermeasures. This study presents a state-of-the-art survey of Blockchain-based Industry 4.0 applications, focusing on crucial application and security and privacy requirements, as well as corresponding attacks on Blockchain systems with potential countermeasures. We also analyse and provide the classification of different security and privacy techniques used in these applications to enhance the advancement of security features. Furthermore, we highlight some open issues in industrial applications that help to design secure Blockchain-based applications as future directions.


title: A Publicly Available Dataset of Out-of-Field Dose Profiles of a 6 MV Linear Accelerator

abstract: An increase in radiotherapy-induced secondary malignancies has led to recent developments in analytical modelling of out-of-field dose. These models must be validated against measurements, but currently available datasets are outdated or limited in scope. This study aimed to address these shortcomings by producing a large dataset of out-of-field dose profiles measured with modern equipment. A novel method was developed with the intention of allowing physicists in all clinics to perform these measurements themselves using commonly available dosimetry equipment. A standard 3D scanning water tank was used to collect 36 extended profiles. Each profile was measured in two sections, with the inner section measured with the beam directly incident on the tank, and the outer section with the beam incident on a water-equivalent phantom abutted next to the tank. The two sections were then stitched using a novel feature-matching approach. The profiles were compared against linac commissioning data and manually inspected for discontinuities in the overlap region. The dataset is presented as a publicly accessible comma separated variable file containing off-axis ratios at a range of off-axis distances. This dataset may be applied to the development and validation of analytical models of out-of-field dose. Additionally, it may be used to inform dose estimates to radiosensitive implants and anatomy. Physicists are encouraged to perform these out-of-field measurements in their own clinics and share their results with the community.


title: Remarks on Liouville type theorems for the steady MHD and Hall-MHD equations

abstract: In this note we investigate Liouville type theorems for the steady three dimensional MHD and Hall-MHD equations, and show that the velocity field $u$ and the magnetic field $B$ are vanishing provided that $B\in L^{6,\infty}(\mathbb{R}^3)$ and $u\in BMO^{-1}(\mathbb{R}^3)$, which state that the velocity field plays an important role. Moreover, the similar result holds in the case of partial viscosity or diffusivity for the three dimensional MHD equations.


title: BoundarySqueeze: Image Segmentation as Boundary Squeezing

abstract: This paper proposes a novel method for high-quality image segmentation of both objects and scenes. Inspired by the dilation and erosion operations in morphological image processing techniques, the pixel-level image segmentation problems are treated as squeezing object boundaries. From this perspective, a novel and efficient \textbf{Boundary Squeeze} module is proposed. This module is used to squeeze the object boundary from both inner and outer directions, which contributes to precise mask representation. A bi-directionally flow-based warping process is proposed to generate such squeezed feature representation, and two specific loss signals are designed to supervise the squeezing process. The Boundary Squeeze module can be easily applied to both instance and semantic segmentation tasks as a plug-and-play module by building on top of some existing methods. Moreover, the proposed module is light-weighted, and thus has potential for practical usage. Experiment results show that our simple yet effective design can produce high-quality results on several different datasets. Besides, several other metrics on the boundary are used to prove the effectiveness of our method over previous work. Our approach yields significant improvement on challenging COCO and Cityscapes datasets for both instance and semantic segmentation, and outperforms previous state-of-the-art PointRend in both accuracy and speed under the same setting. Codes and models will be published at \url{https://github.com/lxtGH/BSSeg}.


title: Analysis of photon characteristics in anticorrelation of a Hong-Ou-Mandel dip for on-demand quantum correlation control

abstract: Over the last several decades, quantum entanglement has been intensively studied for potential applications in quantum information science. The Hong-Ou-Mandel (HOM) dip is the most important test tool for direct proof of entanglement between paired photons, whose coincidence detection results in anticorrelation due to photon bunching on a beam splitter. Although anticorrelation is due to destructive quantum interference between paired photons, a wavelength-sensitive interference fringe has never been observed in any HOM-type experiments. Here, a typical HOM dip is investigated for entangled photon pairs generated by parametric down conversion processes (SPDC) to understand fundamental physics of anticorrelation. In addition, a pure coherence optics-based Hong-Ou-Mandel scheme is proposed and analyzed for general understanding of anticorrelation in an interferometric system. This study sheds light on deterministic quantum correlation control and opens the door to potential applications of on-demand quantum information science.


title: An explicit Maclaurin series solution to a classic non-autonomous abstract evolution equation

abstract: It is well known that the non-autonomous scalar differential equation of evolution has a unique solution given by an elementary exponential function. In general there is no such analogous solution to the corresponding non-autonomous evolution equation for square matrices. In this paper we propose and justify an explicit Maclaurin series solution to a classic non-autonomous abstract evolution equation for bounded linear operators on Banach space.


title: orvara: An Efficient Code to Fit Orbits using Radial Velocity, Absolute, and/or Relative Astrometry

abstract: We present an open-source Python package, Orbits from Radial Velocity, Absolute, and/or Relative Astrometry (orvara), to fit Keplerian orbits to any combination of radial velocity, relative astrometry, and absolute astrometry data from the Hipparcos-Gaia Catalog of Accelerations. By combining these three data types, one can measure precise masses and sometimes orbital parameters even when the observations cover a small fraction of an orbit. orvara achieves its computational performance with an eccentric anomaly solver five to ten times faster than commonly used approaches, low-level memory management to avoid python overheads, and by analytically marginalizing out parallax, barycenter proper motion, and the instrument-specific radial velocity zero points. Through its integration with the Hipparcos and Gaia intermediate astrometry package htof, orvara can properly account for the epoch astrometry measurements of Hipparcos and the measurement times and scan angles of individual Gaia epochs. We configure orvara with modifiable .ini configuration files tailored to any specific stellar or planetary system. We demonstrate orvara with a case study application to a recently discovered white dwarf/main sequence (WD/MS) system, HD 159062. By adding absolute astrometry to literature RV and relative astrometry data, our comprehensive MCMC analysis improves the precision of HD 159062B's mass by more than an order of magnitude to $0.6083^{+0.0083}_{-0.0073}\,M_\odot$. We also derive a low eccentricity and large semimajor axis, establishing HD 159062AB as a system that did not experience Roche lobe overflow.


title: ViBERTgrid: A Jointly Trained Multi-Modal 2D Document Representation for Key Information Extraction from Documents

abstract: Recent grid-based document representations like BERTgrid allow the simultaneous encoding of the textual and layout information of a document in a 2D feature map so that state-of-the-art image segmentation and/or object detection models can be straightforwardly leveraged to extract key information from documents. However, such methods have not achieved comparable performance to state-of-the-art sequence- and graph-based methods such as LayoutLM and PICK yet. In this paper, we propose a new multi-modal backbone network by concatenating a BERTgrid to an intermediate layer of a CNN model, where the input of CNN is a document image and the BERTgrid is a grid of word embeddings, to generate a more powerful grid-based document representation, named ViBERTgrid. Unlike BERTgrid, the parameters of BERT and CNN in our multimodal backbone network are trained jointly. Our experimental results demonstrate that this joint training strategy improves significantly the representation ability of ViBERTgrid. Consequently, our ViBERTgrid-based key information extraction approach has achieved state-of-the-art performance on real-world datasets.


title: Fractal generation in a two-dimensional active-nematic fluid

abstract: Active fluids, composed of individual self-propelled agents, can generate complex large-scale coherent flows. A particularly important laboratory realization of such an active fluid is a system composed of microtubules, aligned in a quasi-two-dimensional (2D) nematic phase, and driven by ATP-fueled kinesin motor proteins. This system exhibits robust chaotic advection and gives rise to a pronounced fractal structure in the nematic contours. We characterize such experimentally derived fractals using the power spectrum and discover that the power spectrum decays as $k^{-\beta}$ for large wavenumbers $k$. The parameter $\beta$ is measured for several experimental realizations. Though $\beta$ is effectively constant in time, it does vary with experimental parameters, indicating differences in the scale-free behavior of the microtubule-based active nematic. Though the fractal patterns generated in this active system are reminiscent of passively advected dye in 2D chaotic flows, the underlying mechanism for fractal generation is more subtle. We provide a simple, physically inspired mathematical model of fractal generation in this system that relies on the material being locally compressible, though the total area of the material is conserved globally. The model also requires that large-scale density variations be injected into the material periodically. The model reproduces the power spectrum decay $k^{-\beta}$ seen in experiments. Linearizing the model of fractal generation about the equilibrium density, we derive an analytic relationship between $\beta$ and a single dimensionless quantity $r$, which characterizes the compressibility.


title: Unbiased Asymmetric Reinforcement Learning under Partial Observability

abstract: In partially observable reinforcement learning, offline training gives access to latent information which is not available during online training and/or execution, such as the system state. Asymmetric actor-critic methods exploit such information by training a history-based policy via a state-based critic. However, many asymmetric methods lack theoretical foundation, and are only evaluated on limited domains. We examine the theory of asymmetric actor-critic methods which use state-based critics, and expose fundamental issues which undermine the validity of a common variant, and limit its ability to address partial observability. We propose an unbiased asymmetric actor-critic variant which is able to exploit state information while remaining theoretically sound, maintaining the validity of the policy gradient theorem, and introducing no bias and relatively low variance into the training process. An empirical evaluation performed on domains which exhibit significant partial observability confirms our analysis, demonstrating that unbiased asymmetric actor-critic converges to better policies and/or faster than symmetric and biased asymmetric baselines.


title: An Upper Limit of Decaying Rate with Respect to Frequency in Deep Neural Network

abstract: Deep neural network (DNN) usually learns the target function from low to high frequency, which is called frequency principle or spectral bias. This frequency principle sheds light on a high-frequency curse of DNNs -- difficult to learn high-frequency information. Inspired by the frequency principle, a series of works are devoted to develop algorithms for overcoming the high-frequency curse. A natural question arises: what is the upper limit of the decaying rate w.r.t. frequency when one trains a DNN? In this work, our theory, confirmed by numerical experiments, suggests that there is a critical decaying rate w.r.t. frequency in DNN training. Below the upper limit of the decaying rate, the DNN interpolates the training data by a function with a certain regularity. However, above the upper limit, the DNN interpolates the training data by a trivial function, i.e., a function is only non-zero at training data points. Our results indicate a better way to overcome the high-frequency curse is to design a proper pre-condition approach to shift high-frequency information to low-frequency one, which coincides with several previous developed algorithms for fast learning high-frequency information. More importantly, this work rigorously proves that the high-frequency curse is an intrinsic difficulty of DNNs.


title: Millimetre-scale magnetocardiography of living rats using a solid-state quantum sensor

abstract: A key challenge in cardiology is the non-invasive imaging of electric current propagation occurring in the cardiovascular system at an intra-cardiac scale. A promising approach for directly mapping the current dynamics is to monitor the associated stray magnetic field. However, in this magnetic field approach, the spatial resolution deteriorates significantly as the standoff distance between the target and the sensor increases. Existing sensors usually remain relatively far from the target and provide only centimetre-scale resolution because their operating temperature is not biocompatible. Here we demonstrate millimetre-scale magnetocardiography of living rats using a solid-state quantum sensor based on nitrogen-vacancy centres in diamond. The essence of the method is a millimetre proximity from the sensor to heart surface, which enhances the cardiac magnetic field to greater than nanoteslas and allows the mapping of these signals with intra-cardiac resolution. From the acquired magnetic images, we also estimate the source electric current vector, flowing from the right atria base via the Purkinje fibre bundle to the left ventricular apex. Our results establish the solid-state quantum sensor's capability to probe cardiac magnetic signals from mammalian animals and reveal their intra-cardiac electrodynamics. This technique will enable the study of the origin and progression of myriad cardiac arrhythmias including flutter, fibrillation, and tachycardia.