title: Adaptive Combination of Randomized and Observational Data

abstract: Data from both a randomized trial and an observational study are sometimes simultaneously available for evaluating the effect of an intervention. The randomized data typically allows for reliable estimation of average treatment effects but may be limited in sample size and patient heterogeneity for estimating conditional average treatment effects for a broad range of patients. Estimates from the observational study can potentially compensate for these limitations, but there may be concerns about whether confounding and treatment effect heterogeneity have been adequately addressed. We propose an approach for combining conditional treatment effect estimators from each source such that it aggressively weights toward the randomized estimator when bias in the observational estimator is detected. This allows the combination to be consistent for a conditional causal effect, regardless of whether assumptions required for consistent estimation in the observational study are satisfied. When the bias is negligible, the estimators from each source are combined for optimal efficiency. We show the problem can be formulated as a penalized least squares problem and consider its asymptotic properties. Simulations demonstrate the robustness and efficiency of the method in finite samples, in scenarios with bias or no bias in the observational estimator. We illustrate the method by estimating the effects of hormone replacement therapy on the risk of developing coronary heart disease in data from the Women's Health Initiative.


title: DeepCQ+: Robust and Scalable Routing with Multi-Agent Deep Reinforcement Learning for Highly Dynamic Networks

abstract: Highly dynamic mobile ad-hoc networks (MANETs) remain as one of the most challenging environments to develop and deploy robust, efficient, and scalable routing protocols. In this paper, we present DeepCQ+ routing protocol which, in a novel manner integrates emerging multi-agent deep reinforcement learning (MADRL) techniques into existing Q-learning-based routing protocols and their variants and achieves persistently higher performance across a wide range of topology and mobility configurations. While keeping the overall protocol structure of the Q-learning-based routing protocols, DeepCQ+ replaces statically configured parameterized thresholds and hand-written rules with carefully designed MADRL agents such that no configuration of such parameters is required a priori. Extensive simulation shows that DeepCQ+ yields significantly increased end-to-end throughput with lower overhead and no apparent degradation of end-to-end delays (hop counts) compared to its Q-learning based counterparts. Qualitatively, and perhaps more significantly, DeepCQ+ maintains remarkably similar performance gains under many scenarios that it was not trained for in terms of network sizes, mobility conditions, and traffic dynamics. To the best of our knowledge, this is the first successful application of the MADRL framework for the MANET routing problem that demonstrates a high degree of scalability and robustness even under environments that are outside the trained range of scenarios. This implies that our MARL-based DeepCQ+ design solution significantly improves the performance of Q-learning based CQ+ baseline approach for comparison and increases its practicality and explainability because the real-world MANET environment will likely vary outside the trained range of MANET scenarios. Additional techniques to further increase the gains in performance and scalability are discussed.


title: Cosmological Inflation in N-Dimensional Gaussian Random Fields with Algorithmic Data Compression

abstract: There is considerable interest in inflationary models with multiple inflaton fields. The inflaton field $\boldsymbol\phi$ that has been postulated to drive accelerating expansion in the very early universe has a corresponding potential $V$, the details of which are free parameters of the theory. We consider a natural hypothesis that $V$ ought to be maximally random. We realize this idea by defining $V$ as a Gaussian random field in some number $N$ of dimensions. Given a model that statistically determines the shape of $V$, we repeatedly evolve $\boldsymbol\phi$ under random potentials, cataloging a representative sample of trajectories associated with that model. On anthropic grounds, we impose a minimum with $V=0$ and only consider trajectories that reach that minimum. We simulate each path evolution stepwise through $\boldsymbol\phi$-space while simultaneously computing $V$ and its derivatives along the path via a Gaussian random process. When $N$ is large, this method significantly reduces computational load as compared to methods that generate the potential landscape all at once. Even so, the covariance matrix of constraints on $V$ can quickly become large and cumbersome. To solve this problem, we present data compression algorithms to prioritize the necessary information already simulated, then keep an arbitrarily large portion. With these optimizations, we simulate thousands of trajectories, extract matter, tensor, and isocurvature spectra from each, and then assemble statistical predictions of these quantities through repeated trials. We find that the Gaussian random potential is a highly versatile inflationary model with a rich volume of parameter space capable of reproducing modern observations.


title: Neural Attention for Image Captioning: Review of Outstanding Methods

abstract: Image captioning is the task of automatically generating sentences that describe an input image in the best way possible. The most successful techniques for automatically generating image captions have recently used attentive deep learning models. There are variations in the way deep learning models with attention are designed. In this survey, we provide a review of literature related to attentive deep learning models for image captioning. Instead of offering a comprehensive review of all prior work on deep image captioning models, we explain various types of attention mechanisms used for the task of image captioning in deep learning models. The most successful deep learning models used for image captioning follow the encoder-decoder architecture, although there are differences in the way these models employ attention mechanisms. Via analysis on performance results from different attentive deep models for image captioning, we aim at finding the most successful types of attention mechanisms in deep models for image captioning. Soft attention, bottom-up attention, and multi-head attention are the types of attention mechanism widely used in state-of-the-art attentive deep learning models for image captioning. At the current time, the best results are achieved from variants of multi-head attention with bottom-up attention.


title: Joint Modeling of Code-Switched and Monolingual ASR via Conditional Factorization

abstract: Conversational bilingual speech encompasses three types of utterances: two purely monolingual types and one intra-sententially code-switched type. In this work, we propose a general framework to jointly model the likelihoods of the monolingual and code-switch sub-tasks that comprise bilingual speech recognition. By defining the monolingual sub-tasks with label-to-frame synchronization, our joint modeling framework can be conditionally factorized such that the final bilingual output, which may or may not be code-switched, is obtained given only monolingual information. We show that this conditionally factorized joint framework can be modeled by an end-to-end differentiable neural network. We demonstrate the efficacy of our proposed model on bilingual Mandarin-English speech recognition across both monolingual and code-switched corpora.


title: Standard Superconductivity in Carbonaceous Sulfur Hydride

abstract: The recently discovered room temperature superconductivity (RTSC) in carbonaceous sulfur hydride reveals the promise of a new superconducting technological era. Since the publication of that report, there has been discussion and debate about this technology. In particular, Hirsch et al. argue that all the recently discovered superconducting hydrides are incorrect, incorrectly interpreted, or point to BCS theory being wrong. A recent publication regarding the RTSC discovery argues that more detailed information about the RTSC discovery is needed. This manuscript aims to respond to this concern by providing the raw data under question as well as providing discussion regarding other aspects of this new RTSC for the sake of the broader scientific community.


title: Hyperspectral Image Segmentation based on Graph Processing over Multilayer Networks

abstract: Hyperspectral imaging is an important sensing technology with broad applications and impact in areas including environmental science, weather, and geo/space exploration. One important task of hyperspectral image (HSI) processing is the extraction of spectral-spatial features. Leveraging on the recent-developed graph signal processing over multilayer networks (M-GSP), this work proposes several approaches to HSI segmentation based on M-GSP feature extraction. To capture joint spectral-spatial information, we first customize a tensor-based multilayer network (MLN) model for HSI, and define a MLN singular space for feature extraction. We then develop an unsupervised HSI segmentation method by utilizing MLN spectral clustering. Regrouping HSI pixels via MLN-based clustering, we further propose a semi-supervised HSI classification based on multi-resolution fusions of superpixels. Our experimental results demonstrate the strength of M-GSP in HSI processing and spectral-spatial information extraction.


title: Non-standard entanglement structure of local unitary self-dual models as a saturated situation of repeatability in general probabilistic theories

abstract: We study the entanglement structure, i.e., the structure of quantum composite system from operational aspects. The structure is not uniquely determined in General Probabilistic Theories (GPTs) even if we impose reasonable postulate about local systems. In this paper, we investigate the possibility that the standard entanglement structure can be determined uniquely by repeatability of measurement processing and its saturated situation called self-duality. Surprisingly, self-duality cannot determine the standard entanglement structure even if we additionally impose local unitary symmetry assumption. In this paper, we show the existence of infinite structures of quantum composite system such that it is self-dual with local unitary symmetry. Besides, we also show the existence of a structure of quantum composite system such that non-orthogonal states in the structure are perfectly distinguishable. In addition, as a byproduct, we derive an sufficient condition to achieve the detection of the entanglement property with a finite number of parameterized minimizations.


title: US-Rule: Discovering Utility-driven Sequential Rules

abstract: Utility-driven mining is an important task in data science and has many applications in real life. High utility sequential pattern mining (HUSPM) is one kind of utility-driven mining. HUSPM aims to discover all sequential patterns with high utility. However, the existing algorithms of HUSPM can not provide an accurate probability to deal with some scenarios for prediction or recommendation. High-utility sequential rule mining (HUSRM) was proposed to discover all sequential rules with high utility and high confidence. There is only one algorithm proposed for HUSRM, which is not enough efficient. In this paper, we propose a faster algorithm, called US-Rule, to efficiently mine high-utility sequential rules. It utilizes rule estimated utility co-occurrence pruning strategy (REUCP) to avoid meaningless computation. To improve the efficiency on dense and long sequence datasets, four tighter upper bounds (LEEU, REEU, LERSU, RERSU) and their corresponding pruning strategies (LEEUP, REEUP, LERSUP, RERSUP) are proposed. Besides, US-Rule proposes rule estimated utility recomputing pruning strategy (REURP) to deal with sparse datasets. At last, a large number of experiments on different datasets compared to the state-of-the-art algorithm demonstrate that US-Rule can achieve better performance in terms of execution time, memory consumption and scalability.


title: A New Paradigm for Fast and Repetitive Chirping of Alfv\'en Eigenmodes

abstract: A novel 2D nonlinear dynamical paradigm is constructed to interpret the fast and repetitive frequency chirping and amplitude oscillation of Alfv\'en eigenmodes excited by energetic particles in fusion plasmas as observed in global gyrokinetic simulations. In this non-perturbative paradigm of the collisionless phase-space dynamics, wave-particle resonant interactions cause the phase-space structure to continuously twist and fold, leading to the repetitive excitation and decay of the Alfv\'en eigenmode. The radial (perpendicular to the dominant wave-particle interaction) dependence of the mode amplitude and toroidal precessional drifts of the energetic particles leads to the 2D dynamics of wave-particle interactions, which is found to be responsible for the repetitive process of formation and destruction of the mode structure.


title: Lattice artefacts on the Landau gauge gluon propagator from hypercubic tensor representations

abstract: Lattice tensor representations are used to investigate the lattice Landau gauge gluon propagator for the 4-dimensional pure SU(3) Yang-Mills gauge theory. Due to the different symmetry structure of hypercubic lattices compared to the continuum space-time, lattice correlation functions are described by different tensor structures. Therefore, form factors describing lattice correlation functions have, in principle, non-trivial relations with the continuum counterparts. The use of several tensor bases respecting lattice symmetries, and the analysis of its completeness allows to quantify the deviations of the lattice results from the continuum theory, and also estimate the theoretical uncertainty in the propagator. Furthermore, our analysis tests continuum based relations with the lattice data and shows that the lattice Landau gauge gluon propagator is suitably described by a unique form factor, as in the continuum formulation. Additionally, we identified classes of kinematic configurations where these deviations are minimal and the continuum description of lattice tensors is improved.


title: Georacle: Enabling Geospatially Aware Smart Contracts

abstract: Smart contracts have enabled a paradigm shift in computing by leveraging decentralized networks of trust to achieve consensus at scale. Oracle networks further extend the power of smart contracts by solving the so-called "oracle problem". Such networks enable smart contracts to make use of the vast amount pre-existing data available on the web today without jeopardizing the integrity of the underlying network of trust. By leveraging oracle networks, smart contracts can make decisions based on data corresponding to the physical world. To this end, we introduce Georacle - an oracle service that enables geospatially aware smart contracts in a way that respects the space constrained nature of blockchain environments. Contracts can query the location of objects in a given area, map between street addresses and coordinates, and retrieve the geometry of a desired region of space while conserving gas consumption and avoiding unnecessary data processing.


title: A Highly Configurable Hardware/Software Stack for DNN Inference Acceleration

abstract: This work focuses on an efficient Agile design methodology for domain-specific accelerators. We employ feature-by-feature enhancement of a vertical development stack and apply it to the TVM/VTA inference accelerator. We have enhanced the VTA design space and enabled end-to-end support for additional workloads. This has been accomplished by augmenting the VTA micro-architecture and instruction set architecture (ISA), as well as by enhancing the TVM compilation stack to support a wide range of VTA configs. The VTA tsim implementation (CHISEL-based) has been enhanced with fully pipelined versions of the ALU/GEMM execution units. In tsim, memory width can now range between 8-64 bytes. Field widths have been made more flexible to support larger scratchpads. New instructions have been added: element-wise 8-bit multiplication to support depthwise convolution, and load with a choice of pad values to support max pooling. Support for more layers and better double buffering has also been added. Fully pipelining ALU/GEMM helps significantly: 4.9x fewer cycles with minimal area change to run ResNet-18 under the default config. Configs featuring a further 11.5x decrease in cycle count at a cost of 12x greater area can be instantiated. Many points on the area-performance pareto curve are shown, showcasing the balance of execution unit sizing, memory interface width, and scratchpad sizing. Finally, VTA is now able to run Mobilenet 1.0 and all layers for ResNets, including the previously disabled pooling and fully connected layers. The TVM/VTA architecture has always featured end-to-end workload evaluation on RTL in minutes. With our modifications, it now offers a much greater number of feasible configurations with a wide range of cost vs. performance. All capabilities mentioned are available in opensource forks while a subset of these capabilities have already been upstreamed.


title: Microscopic analysis of induced nuclear fission dynamics

abstract: The dynamics of low-energy induced fission is explored using a consistent microscopic framework that combines the time-dependent generator coordinate method (TDGCM) and time-dependent nuclear density functional theory (TDDFT). While the former presents a fully quantum mechanical approach that describes the entire fission process as an adiabatic evolution of collective degrees of freedom, the latter models the dissipative dynamics of the final stage of fission by propagating the nucleons independently toward scission and beyond. By combining the two methods, based on the same nuclear energy density functional and pairing interaction, we perform an illustrative calculation of the charge distribution of yields and total kinetic energy for induced fission of $^{240}$Pu. For the saddle-to-scission phase a set of initial points for the TDDFT evolution is selected along an iso-energy curve beyond the outer fission barrier on the deformation energy surface, and the TDGCM is used to calculate the probability that the collective wave function reaches these points at different times. Fission observables are computed with both methods and compared with available data. The relative merits of including quantum fluctuations (TDGCM) and the one-body dissipation mechanism (TDDFT) are discussed.


title: Anomaly Rule Detection in Sequence Data

abstract: Analyzing sequence data usually leads to the discovery of interesting patterns and then anomaly detection. In recent years, numerous frameworks and methods have been proposed to discover interesting patterns in sequence data as well as detect anomalous behavior. However, existing algorithms mainly focus on frequency-driven analytic, and they are challenging to be applied in real-world settings. In this work, we present a new anomaly detection framework called DUOS that enables Discovery of Utility-aware Outlier Sequential rules from a set of sequences. In this pattern-based anomaly detection algorithm, we incorporate both the anomalousness and utility of a group, and then introduce the concept of utility-aware outlier sequential rule (UOSR). We show that this is a more meaningful way for detecting anomalies. Besides, we propose some efficient pruning strategies w.r.t. upper bounds for mining UOSR, as well as the outlier detection. An extensive experimental study conducted on several real-world datasets shows that the proposed DUOS algorithm has a better effectiveness and efficiency. Finally, DUOS outperforms the baseline algorithm and has a suitable scalability.


title: Charging up Boosted Black Holes

abstract: Contrary to a prevailing assumption that black holes would swiftly discharge, we argue that black holes can charge preferentially when boosted through an ambient magnetic field. Though the details are very different, the preference for charge is related to the precipitation of the Wald charge on a spinning black hole in an ambient magnetic field. The gravito-electrodynamics upstage naive arguments about screening electric fields in determining the value of the charge accrued. Charged test particles, which build up the black hole charge, exhibit chaotic behavior as evidenced by fractal basin boundaries between dynamical regions. Charged, boosted black holes will generate their own electromagnetic fields and thereby their own luminous signatures, even if they are initially bare. We therefore add boosted black holes to the growing list of potentially observable black hole signatures, alongside black hole batteries and black hole pulsars. The implications should be relevant for supermassive black holes that are boosted relative to a galactic magnetic field as well as black holes merging with magnetized neutron stars.


title: The Solar Neighborhood XLIX: Nine Giant Planets Orbiting Nearby K Dwarfs, and the CHIRON Spectrograph's Radial Velocity Performance

abstract: We report initial results of a large radial velocity survey of K dwarfs up to a distance of 50 pc from the Solar System, to look for stellar, brown dwarf, and jovian planets using radial velocities from the CHIRON spectrograph on the CTIO/SMARTS 1.5m telescope. We identify three new exoplanet candidates orbiting host stars in the K dwarf survey, and confirm a hot Jupiter from TESS orbiting TOI 129. Our techniques are confirmed via five additional known exoplanet orbiting K dwarfs, bringing the number of orbital solutions presented here to 9, each hosting an exoplanet candidate with a minimum mass of 0.5--3.0 $M_{jup}$. In addition, we provide a list of 186 nearby K dwarfs with no detected close companions that are ideal for more sensitive searches for lower mass planets. This set of stars is used to determine CHIRON's efficiency, stability, and performance for radial velocity work. For K dwarfs with V = 7--12, we reach radial velocity precisions of 5--20 ms$^{-1}$ under a wide range of observing conditions. We demonstrate the stability of CHIRON over hours, weeks, and years using radial velocity standards, and describe instrumental capabilities and operation modes available for potential users.


title: Reinforcement Learning Algorithm for Traffic Steering in Heterogeneous Network

abstract: Heterogeneous radio access networks require efficient traffic steering methods to reach near-optimal results in order to maximize network capacity. This paper aims to propose a novel traffic steering algorithm for usage in HetNets, which utilizes a reinforcement learning algorithm in combination with an artificial neural network to maximize total user satisfaction in the simulated cellular network. The novel algorithm was compared with two reference algorithms using network simulation results. The results prove that the novel algorithm provides noticeably better efficiency in comparison with reference algorithms, especially in terms of the number of served users with limited frequency resources of the radio access network.


title: Rubin Science Platform on Google: the story so far

abstract: We describe Rubin Observatory's experience with offering a data access facility (and associated services including our Science Platform) deployed on Google Cloud infrastructure as part of our pre-Operations Data Preview program.


title: MOTIF: A Large Malware Reference Dataset with Ground Truth Family Labels

abstract: Malware family classification is a significant issue with public safety and research implications that has been hindered by the high cost of expert labels. The vast majority of corpora use noisy labeling approaches that obstruct definitive quantification of results and study of deeper interactions. In order to provide the data needed to advance further, we have created the Malware Open-source Threat Intelligence Family (MOTIF) dataset. MOTIF contains 3,095 malware samples from 454 families, making it the largest and most diverse public malware dataset with ground truth family labels to date, nearly 3x larger than any prior expert-labeled corpus and 36x larger than the prior Windows malware corpus. MOTIF also comes with a mapping from malware samples to threat reports published by reputable industry sources, which both validates the labels and opens new research opportunities in connecting opaque malware samples to human-readable descriptions. This enables important evaluations that are normally infeasible due to non-standardized reporting in industry. For example, we provide aliases of the different names used to describe the same malware family, allowing us to benchmark for the first time accuracy of existing tools when names are obtained from differing sources. Evaluation results obtained using the MOTIF dataset indicate that existing tasks have significant room for improvement, with accuracy of antivirus majority voting measured at only 62.10% and the well-known AVClass tool having just 46.78% accuracy. Our findings indicate that malware family classification suffers a type of labeling noise unlike that studied in most ML literature, due to the large open set of classes that may not be known from the sample under consideration


title: Gravitational collapse of spherical shells of fluid in the isotropic homogeneous universe

abstract: We investigate gravitational collapse of thick shell of fluid in the isotropic homogeneous universe without radiation described by the Einstein gravity with cosmological constant. We construct analytic solutions of this kind interpolating the Friedmann-Lemaitre-Robertson-Walker (FLRW) metric and the de-Sitter Schwarzschild black hole one by the Gullstrand-Painlev\'e one. After determining the scale factor for a perfect fluid coexisting with cosmological constant, we determine the orbit of the collapsing shells of fluid from the continuity condition for density and the perpendicular component of pressure at interface. However the continuity condition cannot fix the orbit when there does not exist a perfect fluid inside the shells. In this case we determine the orbit from an equation of state for the fluid consisting a shell near the surface. Finally we confirm that the total energy defined in arXiv:2005.13233 is independent of the given time evolution in this system.


title: Dispersive analysis of the $\gamma\gamma \to D \bar{D}$ data and the confirmation of the $D \bar{D}$ bound state

abstract: In this paper, we present a data-driven analysis of the $\gamma\gamma\to D^+D^-$ and $\gamma\gamma\to D^0\bar{D}^0$ reactions from threshold up to 4.0 GeV in the $D\bar{D}$ invariant mass. For the $S$-wave contribution, we adopt a partial-wave dispersive representation, which is solved using the $N/D$ ansatz. The left-hand cuts are accounted for using the model-independent conformal expansion. The $D$-wave $\chi_{c2}(3930)$ state is described as a Breit-Wigner resonance. The resulting fits are consistent with the data on the invariant mass distribution of the $e^+e^- \to J/\psi D\bar{D}$ process. Performing an analytic continuation to the complex $s$-plane, we find no evidence of a pole corresponding to the broad resonance $X(3860)$ reported by the Belle Collaboration. Instead, we find a clear bound state below the $D\bar{D}$ threshold at $\sqrt{s_B} = 3695(4)$ MeV, confirming the previous phenomenological and lattice predictions.


title: The operator $\sqrt{-1}\widehat{c}(V)(d+\delta)$ and the Kastler-Kalau-Walze type theorems

abstract: In this paper, we obtain two Lichnerowicz type formulas for the operators $\sqrt{-1}\widehat{c}(V)(d+\delta)$ and $-\sqrt{-1}(d+\delta)\widehat{c}(V)$. And we give the proof of Kastler-Kalau-Walze type theorems for the operators $\sqrt{-1}\widehat{c}(V)(d+\delta)$ and $-\sqrt{-1}(d+\delta)\widehat{c}(V)$ on 3,4-dimensional oriented compact manifolds with (resp.without) boundary.


title: Merging Black Holes in Dwarf Galaxies: Calculating Binary Black Hole Coalescence Timescales from Simulations for LISA Detection

abstract: Supermassive black holes (SMBHs) merging in dwarf galaxies will be detectable by the Laser Interferometer Space Antenna (LISA) in the mid-2030s. Previous cosmological hydrodynamic simulations have shown the prediction of massive black holes merging in dwarf galaxies, but these simulations are limited by their resolution and cannot follow black hole pairs all the way to coalescence. We calculate the delay time between black hole pairing and merger based on the properties of the black holes and their host galaxies, and use these properties to calculate gravitational wave strains for eleven different binary black holes that merge inside dwarf galaxies from eight cosmological simulations. This delay time calculation accounts for dynamical friction due to gas and stars, loss-cone scattering, and hardening of the binary due to gravitational radiation. Out of the eleven black hole mergers in the simulations, five black hole pairs will merge within 0.8 - 8 Gyr of forming a close pair and could be observed by LISA, and the remaining six are unresolved due to resolution limitations of the simulation. As all five of the resolved close pairs merge within a Hubble time, we make the broad estimate that close SMBH pairs in dwarf galaxies will merge and be detectable by LISA, but this estimate depends on either the presence of gas during orbital decay or a solution to the dynamical buoyancy problem in cored potentials.


title: The Benefits of CMB Delensing

abstract: The effects of gravitational lensing of the cosmic microwave background (CMB) have been measured at high significance with existing data and will be measured even more precisely in future surveys. Reversing the effects of lensing on the observed CMB temperature and polarization maps provides a variety of benefits. Delensed CMB spectra have sharper acoustic peaks and more prominent damping tails, allowing for improved inferences of cosmological parameters that impact those features. Delensing reduces $B$-mode power, aiding the search for primordial gravitational waves and allowing for lower variance reconstruction of lensing and other sources of secondary CMB anisotropies. Lensing-induced power spectrum covariances are reduced by delensing, simplifying analyses and improving constraints on primordial non-Gaussianities. Biases that result from incorrectly modeling nonlinear and baryonic feedback effects on the lensing power spectrum are mitigated by delensing. All of these benefits are possible without any changes to experimental or survey design. We develop a self-consistent, iterative, all-orders treatment of CMB delensing on the curved sky and demonstrate the impact that delensing will have with future surveys.


title: CO-SNE: Dimensionality Reduction and Visualization for Hyperbolic Data

abstract: Hyperbolic space can naturally embed hierarchies that often exist in real-world data and semantics. While high-dimensional hyperbolic embeddings lead to better representations, most hyperbolic models utilize low-dimensional embeddings, due to non-trivial optimization and visualization of high-dimensional hyperbolic data. We propose CO-SNE, which extends the Euclidean space visualization tool, t-SNE, to hyperbolic space. Like t-SNE, it converts distances between data points to joint probabilities and tries to minimize the Kullback-Leibler divergence between the joint probabilities of high-dimensional data $X$ and low-dimensional embedding $Y$. However, unlike Euclidean space, hyperbolic space is inhomogeneous: A volume could contain a lot more points at a location far from the origin. CO-SNE thus uses hyperbolic normal distributions for $X$ and hyperbolic \underline{C}auchy instead of t-SNE's Student's t-distribution for $Y$, and it additionally seeks to preserve $X$'s individual distances to the \underline{O}rigin in $Y$. We apply CO-SNE to naturally hyperbolic data and supervisedly learned hyperbolic features. Our results demonstrate that CO-SNE deflates high-dimensional hyperbolic data into a low-dimensional space without losing their hyperbolic characteristics, significantly outperforming popular visualization tools such as PCA, t-SNE, UMAP, and HoroPCA which is also designed for hyperbolic data.


abstract: We give a general procedure to analyze the structure for certain $\mathbb{C}$-Fuchsian subgroups of some non-arithmetic lattices. We will also show that their fundamental domains lie in a complex geodesic, a set homeomorphic to the unit disk.


title: Living-Off-The-Land Command Detection Using Active Learning

abstract: In recent years, enterprises have been targeted by advanced adversaries who leverage creative ways to infiltrate their systems and move laterally to gain access to critical data. One increasingly common evasive method is to hide the malicious activity behind a benign program by using tools that are already installed on user computers. These programs are usually part of the operating system distribution or another user-installed binary, therefore this type of attack is called "Living-Off-The-Land". Detecting these attacks is challenging, as adversaries may not create malicious files on the victim computers and anti-virus scans fail to detect them. We propose the design of an Active Learning framework called LOLAL for detecting Living-Off-the-Land attacks that iteratively selects a set of uncertain and anomalous samples for labeling by a human analyst. LOLAL is specifically designed to work well when a limited number of labeled samples are available for training machine learning models to detect attacks. We investigate methods to represent command-line text using word-embedding techniques, and design ensemble boosting classifiers to distinguish malicious and benign samples based on the embedding representation. We leverage a large, anonymized dataset collected by an endpoint security product and demonstrate that our ensemble classifiers achieve an average F1 score of 0.96 at classifying different attack classes. We show that our active learning method consistently improves the classifier performance, as more training data is labeled, and converges in less than 30 iterations when starting with a small number of labeled instances.


title: X-ray Dissectography Enables Stereotography to Improve Diagnostic Performance

abstract: X-ray imaging is the most popular medical imaging technology. While x-ray radiography is rather cost-effective, tissue structures are superimposed along the x-ray paths. On the other hand, computed tomography (CT) reconstructs internal structures but CT increases radiation dose, is complicated and expensive. Here we propose "x-ray dissectography" to extract a target organ/tissue digitally from few radiographic projections for stereographic and tomographic analysis in the deep learning framework. As an exemplary embodiment, we propose a general X-ray dissectography network, a dedicated X-ray stereotography network, and the X-ray imaging systems to implement these functionalities. Our experiments show that x-ray stereography can be achieved of an isolated organ such as the lungs in this case, suggesting the feasibility of transforming conventional radiographic reading to the stereographic examination of the isolated organ, which potentially allows higher sensitivity and specificity, and even tomographic visualization of the target. With further improvements, x-ray dissectography promises to be a new x-ray imaging modality for CT-grade diagnosis at radiation dose and system cost comparable to that of radiographic or tomosynthetic imaging.


title: Online Learning for Predictive Control with Provable Regret Guarantees

abstract: We study the problem of online learning in predictive control of an unknown linear dynamical system with time varying cost functions which are unknown apriori. Specifically, we study the online learning problem where the control algorithm does not know the true system model and has only access to a fixed-length (that does not grow with the control horizon) preview of the future cost functions. The goal of the online algorithm is to minimize the dynamic regret, defined as the difference between the cumulative cost incurred by the algorithm and that of the best sequence of actions in hindsight. We propose two different online Model Predictive Control (MPC) algorithms to address this problem, namely Certainty Equivalence MPC (CE-MPC) algorithm and Optimistic MPC (O-MPC) algorithm. We show that under the standard stability assumption for the model estimate, the CE-MPC algorithm achieves $\mathcal{O}(T^{2/3})$ dynamic regret. We then extend this result to the setting where the stability assumption holds only for the true system model by proposing the O-MPC algorithm. We show that the O-MPC algorithm also achieves $\mathcal{O}(T^{2/3})$ dynamic regret, at the cost of some additional computation. We also present numerical studies to demonstrate the performance of our algorithm.


title: Sequential Transmission Over Binary Asymmetric Channels With Feedback

abstract: In this paper, we consider the problem of variable-length coding over the class of memoryless binary asymmetric channels (BACs) with noiseless feedback, including the binary symmetric channel (BSC) as a special case. In 2012, Naghshvar et al. introduced an encoding scheme, which we refer to as the small-enough-difference (SED) encoder, which asymptotically achieves both capacity and Burnashev's optimal error exponent for symmetric binary-input channels. Building on the work of Naghshvar et al., this paper extends the SED encoding scheme to the class of BACs and develops a non-asymptotic upper bound on the average blocklength that is shown to achieve both capacity and the optimal error exponent. For the specific case of the BSC, we develop an additional non-asymptotic bound using a two-phase analysis that leverages both a submartingale synthesis and a Markov chain time of first passage analysis. For the BSC with capacity $1/2$, both new achievability bounds exceed the achievability bound of Polyanskiy et al. for a system limited to stop-feedback codes.


title: RailLoMer: Rail Vehicle Localization and Mapping with LiDAR-IMU-Odometer-GNSS Data Fusion

abstract: We present RailLoMer in this article, to achieve real-time accurate and robust odometry and mapping for rail vehicles. RailLoMer receives measurements from two LiDARs, an IMU, train odometer, and a global navigation satellite system (GNSS) receiver. As frontend, the estimated motion from IMU/odometer preintegration de-skews the denoised point clouds and produces initial guess for frame-to-frame LiDAR odometry. As backend, a sliding window based factor graph is formulated to jointly optimize multi-modal information. In addition, we leverage the plane constraints from extracted rail tracks and the structure appearance descriptor to further improve the system robustness against repetitive structures. To ensure a globally-consistent and less blurry mapping result, we develop a two-stage mapping method that first performs scan-to-map in local scale, then utilizes the GNSS information to register the submaps. The proposed method is extensively evaluated on datasets gathered for a long time range over numerous scales and scenarios, and show that RailLoMer delivers decimeter-grade localization accuracy even in large or degenerated environments. We also integrate RailLoMer into an interactive train state and railway monitoring system prototype design, which has already been deployed to an experimental freight traffic railroad.


title: A multi-sensor human gait dataset captured through an optical system and inertial measurement units

abstract: Different technologies can acquire data for gait analysis, such as optical systems and inertial measurement units (IMUs). Each technology has its drawbacks and advantages, fitting best to particular applications. The presented multi-sensor human gait dataset comprises synchronized inertial and optical motion data from 25 subjects free of lower-limb injuries, aged between 18 and 47 years. A smartphone and a custom micro-controlled device with an IMU were attached to one of the subject's legs to capture accelerometer data, and 42 reflexive markers were taped over the whole body to record three-dimensional trajectories. The trajectories and accelerations were simultaneously recorded and synchronized. Participants were instructed to walk on a straight-level walkway at their normal pace. Ten trials for each participant were recorded and pre-processed in each of two sessions, performed on different days. This dataset supports the comparison of gait parameters and properties of inertial and optical capture systems, whereas allows the study of gait characteristics specific for each system.


title: Symmetry analysis of charmonium decays to two-baryon final state

abstract: By virtue of SU(3) flavor symmetry, the effective interaction Hamiltonian is derived in tensor form. The strong and electromagnetic breaking effects are taken into account in a form of "spurion" octet, so that the systematical parametrization of all baryon pair final states is realized on basis of the flavor-singlet principle. As an application, the relative phase between the strong and electromagnetic amplitudes is studied in the light of this scenario. In analyzing the data taken at J/$\psi$ resonance region in $e^+e^-$ collider, the details of experimental effects, such as energy spread and initial state radiative correction are taken into consideration in order to obtain the correct results.


title: A Secure Key Sharing Algorithm Exploiting Phase Reciprocity in Wireless Channels

abstract: This article presents a secure key exchange algorithm that exploits reciprocity in wireless channels to share a secret key between two nodes $A$ and $B$. Reciprocity implies that the channel phases in the links $A\rightarrow B$ and $B\rightarrow A$ are the same. A number of such reciprocal phase values are measured at nodes $A$ and $B$, called shared phase values hereafter. Each shared phase value is used to mask points of a Phase Shift Keying (PSK) constellation. Masking is achieved by rotating each PSK constellation with a shared phase value. Rotation of constellation is equivalent to adding phases modulo-$2\pi$, and as the channel phase is uniformly distributed in $[0,2\pi)$, the result of summation conveys zero information about summands. To enlarge the key size over a static or slow fading channel, the Radio Frequency (RF) propagation path is perturbed to create several independent realizations of multi-path fading, each used to share a new phase value. To eavesdrop a phase value shared in this manner, the Eavesdropper (Eve) will always face an under-determined system of linear equations which will not reveal any useful information about its actual solution value. This property is used to establish a secure key between two legitimate users.


title: Adaptive Gating for Single-Photon 3D Imaging

abstract: Single-photon avalanche diodes (SPADs) are growing in popularity for depth sensing tasks. However, SPADs still struggle in the presence of high ambient light due to the effects of pile-up. Conventional techniques leverage fixed or asynchronous gating to minimize pile-up effects, but these gating schemes are all non-adaptive, as they are unable to incorporate factors such as scene priors and previous photon detections into their gating strategy. We propose an adaptive gating scheme built upon Thompson sampling. Adaptive gating periodically updates the gate position based on prior photon observations in order to minimize depth errors. Our experiments show that our gating strategy results in significantly reduced depth reconstruction error and acquisition time, even when operating outdoors under strong sunlight conditions.


title: xGASS: characterizing the slope and scatter of the stellar mass - angular momentum relation for nearby galaxies

abstract: We present a detailed study of the stellar mass vs. specific angular momentum (AM) relation (Fall relation) for a representative sample of 564 nearby galaxies in the eXtended GALEX Arecibo SDSS Survey (xGASS). We focus on the dependence of the Fall relation's slope on galaxy type and the galaxy properties regulating its scatter. Stellar specific AM is determined by combining single-dish H{\sc i} velocity widths and stellar mass profiles for all H{\sc i} detections in the xGASS sample. At fixed morphology (or bulge-to-total ratio), we find that the power law slope of the Fall relation is consistent with 2/3. However, when all galaxy types are combined, we recover a much shallower slope of $\sim$0.47. We show that this is a consequence of the change in galaxy morphology as a function of mass, highlighting that caution should be taken when using the slope of the Fall relation to constrain galaxy formation models without taking sample selection into account. We quantify the Fall relations scatter and show that H{\sc i} gas fraction is the strongest correlated parameter for low stellar masses (Spearman correlation: $\rho_{s} = 0.61$), while the bulge-to-total ratio becomes slightly more dominant at higher masses ($\rho_{s} = -0.29$). Intriguingly, when only the disc components of galaxies are considered, H{\sc i} gas fraction remains the strongest correlated parameter with the scatter of the relation (regardless of disc stellar mass). Our work provides one of the best characterisations of the Fall relation for a representative sample of galaxies in the local Universe.


title: The Real Schwarz Lemma: The Sequel

abstract: A decade ago, when teaching complex analysis, the third named author posed the question on whether or not there is an analogue to the Schwarz lemma for real analytic functions. This led to the note [MT], indicating that it is possible to have a real analytic automorphism $f$ of $(-1,1)$ with $f'(0)$ arbitrarily large. In this note we provide other families with this property, and moreover show that we can always find such a function so that $f'(0)$ equals any desired real number. We end with some questions on related problems.


title: AssistSR: Task-oriented Video Segment Retrieval for Personal AI Assistant

abstract: It is still a pipe dream that personal AI assistants on the phone and AR glasses can assist our daily life in addressing our questions like ``how to adjust the date for this watch?'' and ``how to set its heating duration? (while pointing at an oven)''. The queries used in conventional tasks (i.e. Video Question Answering, Video Retrieval, Moment Localization) are often factoid and based on pure text. In contrast, we present a new task called Task-oriented Question-driven Video Segment Retrieval (TQVSR). Each of our questions is an image-box-text query that focuses on affordance of items in our daily life and expects relevant answer segments to be retrieved from a corpus of instructional video-transcript segments. To support the study of this TQVSR task, we construct a new dataset called AssistSR. We design novel guidelines to create high-quality samples. This dataset contains 3.2k multimodal questions on 1.6k video segments from instructional videos on diverse daily-used items. To address TQVSR, we develop a simple yet effective model called Dual Multimodal Encoders (DME) that significantly outperforms several baseline methods while still having large room for improvement in the future. Moreover, we present detailed ablation analyses. Code and data are available at \url{https://github.com/StanLei52/TQVSR}.


title: Lower pressure phases and metastable states of superconducting photo-induced carbonaceous sulfur hydride

abstract: Room-temperature superconductivity was recently discovered in carbonaceous sulfur hydride (C-S-H) close to 3\,Mbar. We report significant differences in the superconducting response of C-S-H, with a maximum $T_{C}$ of 191(1)\,K, below a 1\,Mbar. Variations in intensity of the C-H Raman modes reveal carbon content can vary between crystals synthesized with the same photo-induced method. Synchrotron single crystal x-ray diffraction identifies polymorphism with increasing degrees of covalency. These unique metastable states are highly sensitive to thermodynamic pathways.


title: SUPPNet: Neural network for stellar spectrum normalisation

abstract: Precise continuum normalisation of merged \'{e}chelle spectra is a demanding task necessary for various detailed spectroscopic analyses. Automatic methods have limited effectiveness due to the variety of features present in the spectra of stars. This complexity often leads to the necessity of manual normalisation which is a time demanding task. The aim of this work is to develop a fully automated normalisation tool that works with order-merged spectra and offers flexible manual fine-tuning, if necessary. The core of the proposed method uses the novel fully convolutional deep neural network (SUPP Network) that was trained to predict a pseudo-continuum. The post-processing step uses smoothing splines that gives access to regressed knots useful for optional manual corrections. The active learning technique was applied to deal with possible biases that may arise from training with synthetic spectra and to extend the applicability of the proposed method to features absent in this kind of spectra. The developed normalisation method was tested with high-resolution spectra of stars having spectral types from O to G, and gave root mean squared (RMS) error over the set of test stars equal $0.0128$ in the spectral range from $3900\,\r{A}$ to $7000\,\r{A}$ and $0.0081$ in the range from $4200\,\r{A}$ to $7000\,\r{A}$. Experiments with synthetic spectra give RMS of the order of $0.0050$. The proposed method gives results comparable to careful manual normalisation. Additionally, this approach is general and can be used in other fields of astronomy where background modelling or trend removal is a part of data processing. The algorithm is available online at https://git.io/JqJhf.


title: Deep Learning for Enhanced Scratch Input

abstract: The vibrations generated from scratching and tapping on surfaces can be highly expressive and recognizable, and have therefore been proposed as a method of natural user interface (NUI). Previous systems require custom sensor hardware such as contact microphones and have struggled with gesture classification accuracy. We propose a deep learning approach to scratch input. Using smartphones and tablets laid on tabletops or other similar surfaces, our system achieved a gesture classification accuracy of 95.8\%, substantially reducing gesture misclassification from previous works. Further, our system achieved this performance when tested on a wide variety of surfaces, mobile devices, and in high noise environments. The results indicate high potential for the application of deep learning techniques to natural user interface (NUI) systems that can readily convert large unpowered surfaces into a user interface using just a smartphone with no special-purpose sensors or hardware.


title: Artin $L$-functions of diagonal hypersurfaces and generalized hypergeometric functions over finite fields

abstract: We compute the Artin $L$-function of a diagonal hypersurface D_{\lambda} over a finite field associated to a character of a finite group acting on D_{\lambda} , and under some condition, express it in terms of hypergeometric functions and Jacobi sums over the finite field. As an application, we consider the Dwork hypersurfaces and obtain relations among certain hypergeometric functions over different finite fields.


title: Probing the nonequilibrium dynamics of stress, orientation and entanglements in polymer melts with orthogonal interrupted shear simulations

abstract: Both entangled and unentangled polymer melts exhibit stress overshoots when subject to shearing flow. The size of the overshoot depends on the applied shear rate and is related to relaxation mechanisms such as reptation, chain stretch and convective constraint release. Previous experimental work shows that melts subjected to interrupted shear flows exhibit a smaller overshoot when sheared after partial relaxation. This has been shown to be consistent with predictions by constitutive models. Here, we report molecular dynamics simulations of interrupted shear of polymer melts where the shear flow after the relaxation stage is orthogonal to the original applied flow. We observe that, for a given relaxation time, the size of the stress overshoot under orthogonal interrupted shear is larger than observed during parallel interrupted shear, which is not captured by constitutive models. Differences in maxima are also observed for overshoots in the first normal stress and chain end-to-end distance. We also show that measurements of the average number of entanglements per chain and average orientation at different scales along the chain are affected by the change in shear direction, leading to non-monotonic relaxation of the off-diagonal components of orientation and an appearance of a 'double peak' in the average number of entanglements during the transient. We propose that such complex behavior of entanglements is responsible for the increase in the overshoots of stress components, and that models of the dynamics of entanglements might be improved upon by considering a tensorial measurement of entanglements that can be coupled to orientation.


title: Camera Distortion-aware 3D Human Pose Estimation in Video with Optimization-based Meta-Learning

abstract: Existing 3D human pose estimation algorithms trained on distortion-free datasets suffer performance drop when applied to new scenarios with a specific camera distortion. In this paper, we propose a simple yet effective model for 3D human pose estimation in video that can quickly adapt to any distortion environment by utilizing MAML, a representative optimization-based meta-learning algorithm. We consider a sequence of 2D keypoints in a particular distortion as a single task of MAML. However, due to the absence of a large-scale dataset in a distorted environment, we propose an efficient method to generate synthetic distorted data from undistorted 2D keypoints. For the evaluation, we assume two practical testing situations depending on whether a motion capture sensor is available or not. In particular, we propose Inference Stage Optimization using bone-length symmetry and consistency. Extensive evaluation shows that our proposed method successfully adapts to various degrees of distortion in the testing phase and outperforms the existing state-of-the-art approaches. The proposed method is useful in practice because it does not require camera calibration and additional computations in a testing set-up.


title: Multi-period facility location and capacity planning under $\infty$-Wasserstein joint chance constraints in humanitarian logistics

abstract: The key of the post-disaster humanitarian logistics (PD-HL) is to build a good facility location and capacity planning (FLCP) model for delivering relief supplies to affected areas in time. To fully exploit the historical PD data, this paper adopts the data-driven distributionally robust (DR) approach and proposes a novel multi-period FLCP model under the $\infty$-Wasserstein joint chance constraints (MFLCP-W). Specifically, we sequentially decide locations from a candidate set to build facilities with supply capacities, which are expanded if more economical, and use a finite number of historical demand samples in chance constraints to ensure a high probability of on-time delivery. To solve the MFLCP-W model, we equivalently reformulate it as a mixed integer second-order cone program and then solve it by designing an effective outer approximation algorithm with two tailored valid cuts. Finally, a case study under hurricane threats shows that MFLCP-W outperforms its counterparts in the terms of the cost and service quality, and that our algorithm converges significantly faster than the commercial solver CPLEX 12.8 with a better optimality gap.


title: Computing Generalized Rank Invariant for 2-Parameter Persistence Modules via Zigzag Persistence and its Applications

abstract: The notion of generalized rank invariant in the context of multiparameter persistence has become an important ingredient for defining interesting homological structures such as generalized persistence diagrams. Naturally, computing these rank invariants efficiently is a prelude to computing any of these derived structures efficiently. We show that the generalized rank over a finite interval $I$ of a $\mathbb{Z}^2$-indexed persistence module $M$ is equal to the generalized rank of the zigzag module that is induced on a certain path in $I$ tracing mostly its boundary. Hence, we can compute the generalized rank over $I$ by computing the barcode of the zigzag module obtained by restricting the bifiltration inducing $M$ to that path. If the bifiltration and $I$ have at most $t$ simplices and points respectively, this computation takes $O(t^\omega)$ time where $\omega\in[2,2.373)$ is the exponent of matrix multiplication. Among others, we apply this result to obtain an improved algorithm for the following problem. Given a bifiltration inducing a module $M$, determine whether $M$ is interval decomposable and, if so, compute all intervals supporting its summands.


title: Spectrum of the Lam\'{e} operator along $\mathrm{Re}\tau={1}/{2}:$ The genus $3$ case

abstract: In this paper, we study the spectrum $\sigma(L)$ of the Lam\'{e} operator \begin{equation*}L=\frac{d^2}{dx^2}-12\wp(x+z_0;\tau)\quad \text{in}\;\;L^2(\mathbb{R}, \mathbb{C}), \end{equation*} where $\wp(z;\tau)$ is the Weierstrass elliptic function with periods $1$ and $\tau$, and $z_0\in\mathbb{C}$ is chosen such that $L$ has no singularities on $\mathbb{R}$. We prove that a point $\lambda\in \sigma(L)$ is an intersection point of different spectral arcs but not a zero of the spectral polynomial if and only if $\lambda$ is a zero of the following cubic polynomial: \begin{equation*} \frac{4}{15} \lambda^3+\frac{8}{5}\eta_1 \lambda^2-3g_2 \lambda+9g_3-6\eta_1 g_2=0. \end{equation*} We also study the deformation of the spectrum as $\tau=\frac{1}{2}+ib$ with $b>0$ varying. We discover $7$ different types of graphs for the spectrum as $b$ varies around the double zeros of the spectral polynomial.


title: Second-order Approximation of Minimum Discrimination Information in Independent Component Analysis

abstract: Independent Component Analysis (ICA) is intended to recover the mutually independent sources from their linear mixtures, and F astICA is one of the most successful ICA algorithms. Although it seems reasonable to improve the performance of F astICA by introducing more nonlinear functions to the negentropy estimation, the original fixed-point method (approximate Newton method) in F astICA degenerates under this circumstance. To alleviate this problem, we propose a novel method based on the second-order approximation of minimum discrimination information (MDI). The joint maximization in our method is consisted of minimizing single weighted least squares and seeking unmixing matrix by the fixed-point method. Experimental results validate its efficiency compared with other popular ICA algorithms.


title: Phase transition of anisotropic Ginzburg--Landau equation

abstract: We study the effective geometric motions of an anisotropic Ginzburg--Landau equation with a small parameter $\varepsilon>0$ which characterizes the width of the transition layer. For well-prepared initial datum, we show that as $\varepsilon$ tends to zero the solutions will develop a sharp interface limit which evolves under mean curvature flow. The bulk limits of the solutions correspond to a vector field $\mathbf{u}(x,t)$ which is of unit length on one side of the interface, and is zero on the other side. The proof combines the modulated energy method and weak convergence methods. In particular, by a (boundary) blow-up argument we show that $\mathbf{u}$ must be tangent to the sharp interface. Moreover, it solves a geometric evolution equation for the Oseen--Frank model in liquid crystals.


title: A continuous version of multiple zeta functions and multiple zeta values

abstract: In this paper we define a continuous version of multiple zeta functions. They can be analytically continued to meromorphic functions on $\mathbb{C}^r$ with only simple poles at some special hyperplanes. The evaluations of these functions at positive integers (continuous multiple zeta values) satisfy the shuffle product. We give a detailed analysis about the depth structure of continuous multiple zeta values. There are also sum formulas for continuous multiple zeta values. Lastly we calculate some special continuous multiple zeta values in terms of special values of multiple polylogarithms.


title: Online Robust Control of Linear Dynamical Systems with Limited Prediction

abstract: We study the online robust control problem for linear dynamical systems with disturbances and uncertainties in the cost functions, with limited preview of the future disturbances and the cost functions, $N$. Our goal is to find an online control policy that can minimize the disturbance gain, defined as the ratio of the cumulative cost and the cumulative energy in the disturbances over a period of time, in the face of the uncertainties, and characterize its achievable gain in terms of the system relevant parameters. Our goals contrast with prior online control works for the same problem, which either focus on minimizing the static regret, a weaker performance metric, or assume a very large preview of the future uncertainties. Specifically, we consider a class of cost functions characterized by $\beta$ ($\beta < 1$), a number whose inverse bounds the variation of the cost functions. We propose a novel variation of the Receding Horizon Control as the online control policy. We show that, under standard system assumptions, when $N > 4/\beta^3$, the proposed algorithm can achieve a disturbance gain $(2/\beta+\rho(N)) \overline{\gamma}^2$, where $\overline{\gamma}^2$ is the best (minimum) possible disturbance gain for an oracle policy with full knowledge of the cost functions and disturbances, with $\rho(N) = O(1/N)$. We also demonstrate through simulations that the proposed policy satisfies the derived bounds and is consistently better than the standard RHC approach.


title: Hole-robust Wireframe Detection

abstract: "Wireframe" is a line segment based representation designed to well capture large-scale visual properties of regular, structural shaped man-made scenes surrounding us. Unlike the wireframes, conventional edges or line segments focus on all visible edges and lines without particularly distinguishing which of them are more salient to man-made structural information. Existing wireframe detection models rely on supervising the annotated data but do not explicitly pay attention to understand how to compose the structural shapes of the scene. In addition, we often face that many foreground objects occluding the background scene interfere with proper inference of the full scene structure behind them. To resolve these problems, we first time in the field, propose new conditional data generation and training that help the model understand how to ignore occlusion indicated by holes, such as foreground object regions masked out on the image. In addition, we first time combine GAN in the model to let the model better predict underlying scene structure even beyond large holes. We also introduce pseudo labeling to further enlarge the model capacity to overcome small-scale labeled data. We show qualitatively and quantitatively that our approach significantly outperforms previous works unable to handle holes, as well as improves ordinary detection without holes given.


title: An Analysis of the Numerical Stability of the Immersed Boundary Method

abstract: We present a numerical stability analysis of the immersed boundary(IB) method for a special case which is constructed so that Fourier analysis is applicable. We examine the stability of the immersed boundary method with the discrete Fourier transforms defined differently on the fluid grid and the boundary grid. This approach gives accurate theoretical results about the stability boundary since it takes the effects of the spreading kernel of the immersed boundary method on the numerical stability into account. In this paper, the spreading kernel is the standard 4-point IB delta function. A three-dimensional incompressible viscous flow and a no-slip planar boundary are considered. The case of a planar elastic membrane is also analyzed using the same analysis framework and it serves as an example of many possible generalizations of our theory. We present some numerical results and show that the observed stability behaviors are consistent with what are predicted by our theory.


title: Superdiffusion of Cosmic Rays in Compressible Magnetized Turbulence

abstract: Owing to the complexity of turbulent magnetic fields, modeling the diffusion of cosmic rays is challenging. Based on the current understanding of anisotropic magnetohydrodynamic (MHD) turbulence, we use test particles to examine the cosmic rays' superdiffusion in the direction perpendicular to the mean magnetic field. By changing Alfven Mach number $M_A$ and sonic Mach number $M_S$ of compressible MHD simulations, our study covers a wide range of astrophysical conditions including subsonic warm gas phase and supersonic cold molecular gas. We show that freely streaming cosmic rays' perpendicular displacement increases as 3/2 to the power of the time traveled along local magnetic field lines. This power-law index changes to 3/4 if the parallel propagation is diffusive. We find that the cosmic rays' parallel mean free path decreases in a power-law relation of $M_A^{-2}$ in supersonic turbulence. We investigate the energy fraction of slow, fast, and Alfvenic modes and confirm the dominance of Alfvenic modes in the perpendicular superdiffusion. In particular, the energy fraction of fast mode, which is the main agent for pitch-angle scattering, increases with $M_A$ but is insensitive to $M_S \ge 2$. Accordingly, our results suggest that the suppressed diffusion in supersonic molecular clouds arises primarily due to the variations of $M_A$ instead of $M_S$.


title: Caffarelli-Kohn-Nirenberg inequalities for curl-free vector fields and second order derivatives

abstract: The present work has as a first goal to extend the previous results in \cite{CFL20} to weighted uncertainty principles with nontrivial radially symmetric weights applied to curl-free vector fields. Part of these new inequalities generalize the family of Caffarelli-Kohn-Nirenberg (CKN) inequalities studied by Catrina and Costa in \cite{CC} from scalar fields to curl-free vector fields. We will apply a new representation of curl-free vector fields developed by Hamamoto in \cite{HT21}. The newly obtained results are also sharp and minimizers are completely described. Secondly, we prove new sharp second order interpolation functional inequalities for scalar fields with radial weights generalizing the previous results in \cite{CFL20}. We apply new factorization methods being inspired by our recent work \cite{CFL21}. The main novelty in this case is that we are able to find a new independent family of minimizers based on the solutions of Kummer's differential equations. We point out that the two types of weighted inequalities under consideration (first order inequalities for curl-free vector fields vs. second order inequalities for scalar fields) represent independent families of inequalities unless the weights are trivial.


title: MISS: Multi-Interest Self-Supervised Learning Framework for Click-Through Rate Prediction

abstract: CTR prediction is essential for modern recommender systems. Ranging from early factorization machines to deep learning based models in recent years, existing CTR methods focus on capturing useful feature interactions or mining important behavior patterns. Despite the effectiveness, we argue that these methods suffer from the risk of label sparsity (i.e., the user-item interactions are highly sparse with respect to the feature space), label noise (i.e., the collected user-item interactions are usually noisy), and the underuse of domain knowledge (i.e., the pairwise correlations between samples). To address these challenging problems, we propose a novel Multi-Interest Self-Supervised learning (MISS) framework which enhances the feature embeddings with interest-level self-supervision signals. With the help of two novel CNN-based multi-interest extractors,self-supervision signals are discovered with full considerations of different interest representations (point-wise and union-wise), interest dependencies (short-range and long-range), and interest correlations (inter-item and intra-item). Based on that, contrastive learning losses are further applied to the augmented views of interest representations, which effectively improves the feature representation learning. Furthermore, our proposed MISS framework can be used as an plug-in component with existing CTR prediction models and further boost their performances. Extensive experiments on three large-scale datasets show that MISS significantly outperforms the state-of-the-art models, by up to 13.55% in AUC, and also enjoys good compatibility with representative deep CTR models.


title: Maximizing Social Welfare in Selfish Multi-Modal Routing using Strategic Information Design for Quantal Response Travelers

abstract: Traditional selfish routing literature quantifies inefficiency in transportation systems with single-attribute costs using price-of-anarchy (PoA), and provides various technical approaches (e.g. marginal cost pricing) to improve PoA of the overall network. Unfortunately, practical transportation systems have dynamic, multi-attribute costs and the state-of-the-art technical approaches proposed in the literature are infeasible for practical deployment. In this paper, we offer a paradigm shift to selfish routing via characterizing idiosyncratic, multi-attribute costs at boundedly-rational travelers, as well as improving network efficiency using strategic information design. Specifically, we model the interaction between the system and travelers as a Stackelberg game, where travelers adopt multi-attribute logit responses. We model the strategic information design as an optimization problem, and develop a novel approximate algorithm to steer Logit Response travelers towards social welfare using strategic Information design (in short, LoRI). We demonstrate the performance of LoRI on a Wheatstone network with multi-modal route choices at the travelers. In our simulation experiments, we find that LoRI outperforms SSSP in terms of system utility, especially when there is a motive mismatch between the two systems and improves social welfare. For instance, we find that LoRI persuades a traveler towards a socially optimal route for 66.66% of the time on average, when compared to SSSP, when the system has 0.3 weight on carbon emissions. However, we also present a tradeoff between system performance and runtime in our simulation results.


title: Core but not peripheral online social ties is a protective factor against depression: evidence from a nationally representative sample of young adults

abstract: As social interactions are increasingly taking place in the digital environment, online friendship and its effects on various life outcomes from health to happiness attract growing research attention. In most studies, online ties are treated as representing a single type of relationship. However, our online friendship networks are not homogeneous and could include close connections, e.g. a partner, as well as people we have never met in person. In this paper, we investigate the potentially differential effects of online friendship ties on mental health. Using data from a Russian panel study (N = 4,400), we find that - consistently with previous research - the number of online friends correlates with depression symptoms. However, this is true only for networks that do not exceed Dunbar's number in size (N <= 150) and only for core but not peripheral nodes of a friendship network. The findings suggest that online friendship could encode different types of social relationships that should be treated separately while investigating the association between online social integration and life outcomes, in particular well-being or mental health.


title: Communication-Efficient Federated Learning via Quantized Compressed Sensing

abstract: In this paper, we present a communication-efficient federated learning framework inspired by quantized compressed sensing. The presented framework consists of gradient compression for wireless devices and gradient reconstruction for a parameter server (PS). Our strategy for gradient compression is to sequentially perform block sparsification, dimensional reduction, and quantization. Thanks to gradient sparsification and quantization, our strategy can achieve a higher compression ratio than one-bit gradient compression. For accurate aggregation of the local gradients from the compressed signals at the PS, we put forth an approximate minimum mean square error (MMSE) approach for gradient reconstruction using the expectation-maximization generalized-approximate-message-passing (EM-GAMP) algorithm. Assuming Bernoulli Gaussian-mixture prior, this algorithm iteratively updates the posterior mean and variance of local gradients from the compressed signals. We also present a low-complexity approach for the gradient reconstruction. In this approach, we use the Bussgang theorem to aggregate local gradients from the compressed signals, then compute an approximate MMSE estimate of the aggregated gradient using the EM-GAMP algorithm. We also provide a convergence rate analysis of the presented framework. Using the MNIST dataset, we demonstrate that the presented framework achieves almost identical performance with the case that performs no compression, while significantly reducing communication overhead for federated learning.


title: Transition Motion Tensor: A Data-Driven Approach for Versatile and Controllable Agents in Physically Simulated Environments

abstract: This paper proposes the Transition Motion Tensor, a data-driven framework that creates novel and physically accurate transitions outside of the motion dataset. It enables simulated characters to adopt new motion skills efficiently and robustly without modifying existing ones. Given several physically simulated controllers specializing in different motions, the tensor serves as a temporal guideline to transition between them. Through querying the tensor for transitions that best fit user-defined preferences, we can create a unified controller capable of producing novel transitions and solving complex tasks that may require multiple motions to work coherently. We apply our framework on both quadrupeds and bipeds, perform quantitative and qualitative evaluations on transition quality, and demonstrate its capability of tackling complex motion planning problems while following user control directives.


title: Experimental Realization of Weyl Exceptional Rings in a Synthetic Three-Dimensional Non-Hermitian Phononic Crystal

abstract: Weyl points (WPs) are isolated degeneracies carrying quantized topological charges, and are therefore robust against Hermitian perturbations. WPs are predicted to spread to the Weyl exceptional rings (WERs) in the presence of non-Hermiticity. Here, we use a one-dimensional (1D) Aubry-Andre-Harper (AAH) model to construct a Weyl semimetal in a 3D parameter space comprised of one reciprocal dimension and two synthetic dimensions. The inclusion of non-Hermiticity in the form of gain and loss produces a WER. The topology of the WER is characterized by both its topological charge and non-Hermitian winding numbers. The WER is experimentally observed in a 1D phononic crystal with the non-Hermiticity introduced by active acoustic components. In addition, Fermi arcs are observed to survive the presence of non-Hermitian effect. We envision our findings to pave the way for studying the high-dimensional non-Hermitian topological physics in acoustics.


title: Periodicity of Grover walks on bipartite regular graphs with at most five distinct eigenvalues

abstract: We determine connected bipartite regular graphs with four distinct adjacency eigenvalues that induce periodic Grover walks, and show that it is only $C_6$. We also show that there are only three kinds of the second largest eigenvalues of bipartite regular periodic graphs with five distinct eigenvalues. Using walk-regularity, we enumerate feasible spectra for such graphs.


title: A Convex-Nonconvex Strategy for Grouped Variable Selection

abstract: This paper deals with the grouped variable selection problem. A widely used strategy is to augment the negative log-likelihood function with a sparsity-promoting penalty. Existing methods include the group Lasso, group SCAD, and group MCP. The group Lasso solves a convex optimization problem but is plagued by underestimation bias. The group SCAD and group MCP avoid this estimation bias but require solving a nonconvex optimization problem that may be plagued by suboptimal local optima. In this work, we propose an alternative method based on the generalized minimax concave (GMC) penalty, which is a folded concave penalty that maintains the convexity of the objective function. We develop a new method for grouped variable selection in linear regression, the group GMC, that generalizes the strategy of the original GMC estimator. We present an efficient algorithm for computing the group GMC estimator and also prove properties of the solution path to guide its numerical computation and tuning parameter selection in practice. We establish error bounds for both the group GMC and original GMC estimators. A rich set of simulation studies and a real data application indicate that the proposed group GMC approach outperforms existing methods in several different aspects under a wide array of scenarios.


title: Conformal Perturbations of Twisted Dirac Operators and Noncommutative residue

abstract: In this paper, we obtain two kinds of Kastler-Kalau-Walze type theorems for conformal perturbations of twisted Dirac operators and conformal perturbations of signature operators by a vector bundle with a non-unitary connection on six-dimensional manifolds with (respectively without)boundary.


title: Unsupervised Domain Generalization for Person Re-identification: A Domain-specific Adaptive Framework

abstract: Domain generalization (DG) has attracted much attention in person re-identification (ReID) recently. It aims to make a model trained on multiple source domains generalize to an unseen target domain. Although achieving promising progress, existing methods usually need the source domains to be labeled, which could be a significant burden for practical ReID tasks. In this paper, we turn to investigate unsupervised domain generalization for ReID, by assuming that no label is available for any source domains. To address this challenging setting, we propose a simple and efficient domain-specific adaptive framework, and realize it with an adaptive normalization module designed upon the batch and instance normalization techniques. In doing so, we successfully yield reliable pseudo-labels to implement training and also enhance the domain generalization capability of the model as required. In addition, we show that our framework can even be applied to improve person ReID under the settings of supervised domain generalization and unsupervised domain adaptation, demonstrating competitive performance with respect to relevant methods. Extensive experimental study on benchmark datasets is conducted to validate the proposed framework. A significance of our work lies in that it shows the potential of unsupervised domain generalization for person ReID and sets a strong baseline for the further research on this topic.


title: SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches

abstract: Sketch-based image manipulation is an interactive image editing task to modify an image based on input sketches from users. Existing methods typically formulate this task as a conditional inpainting problem, which requires users to draw an extra mask indicating the region to modify in addition to sketches. The masked regions are regarded as holes and filled by an inpainting model conditioned on the sketch. With this formulation, paired training data can be easily obtained by randomly creating masks and extracting edges or contours. Although this setup simplifies data preparation and model design, it complicates user interaction and discards useful information in masked regions. To this end, we investigate a new paradigm of sketch-based image manipulation: mask-free local image manipulation, which only requires sketch inputs from users and utilizes the entire original image. Given an image and sketch, our model automatically predicts the target modification region and encodes it into a structure agnostic style vector. A generator then synthesizes the new image content based on the style vector and sketch. The manipulated image is finally produced by blending the generator output into the modification region of the original image. Our model can be trained in a self-supervised fashion by learning the reconstruction of an image region from the style vector and sketch. The proposed method offers simpler and more intuitive user workflows for sketch-based image manipulation and provides better results than previous approaches. More results, code and interactive demo will be available at \url{https://zengxianyu.github.io/sketchedit}.


title: Triple-charm molecular states composed of $D^*D^*D$ and $D^*D^*D^*$

abstract: Inspired by the newly observed $T_{cc}^+$ state, we systematically investigate the $S$-wave triple-charm molecular states composed of $D^*D^*D$ and $D^*D^*D^*$. We employ the one-boson-exchange model to derive the interactions between $D(D^*)$ and $D^*$ and solve the three-body Schr\"odinger equations with the Gaussian expansion method. The $S$-$D$ mixing and coupled channel effects are carefully assessed in our study. Our results show that the $I(J^P)=\frac{1}{2}(0^-,1^-,2^-)$ $D^*D^*D$ and $I(J^P)=\frac{1}{2}(0^-,1^-,2^-,3^-)$ $D^*D^*D^*$ systems could form bound states, which can be viewed as three-body hadronic molecules. We present not only the binding energies of the three-body bound states, but also the root-mean-square radii of $D $-$D^*$ and $D^*$-$D^*$, which further corroborate the molecular nature of these states. These predictions could be tested in the future at LHC or HL-LHC.


title: SurvODE: Extrapolating Gene Expression Distribution for Early Cancer Identification

abstract: With the increasingly available large-scale cancer genomics datasets, machine learning approaches have played an important role in revealing novel insights into cancer development. Existing methods have shown encouraging performance in identifying genes that are predictive for cancer survival, but are still limited in modeling the distribution over genes. Here, we proposed a novel method that can simulate the gene expression distribution at any given time point, including those that are out of the range of the observed time points. In order to model the irregular time series where each patient is one observation, we integrated a neural ordinary differential equation (neural ODE) with cox regression into our framework. We evaluated our method on eight cancer types on TCGA and observed a substantial improvement over existing approaches. Our visualization results and further analysis indicate how our method can be used to simulate expression at the early cancer stage, offering the possibility for early cancer identification.


title: Topological categories related to Fredholm operators: II. The analytical index

abstract: Naively, the analytic index of a family of self-adjoint Fredholm operators ought to be (an equivalence class of) the family of the kernels of these operators. The present paper is devoted to a rigorous version of this idea based on ideas of Segal as developed by the author in arXiv:2111.14313 [math.KT]. The resulting new definition of the analytic index makes sense under much weaker continuity assumptions than the Atiyah-Singer one and can be easily adjusted to families of operators in fibers of a Hilbert bundle. We prove the correctness of the new definition and show that it agrees with the Atiyah-Singer one when the latter applies. As an illustration, these results are used to clarify some subtle aspects of the notion of spectral sections introduced by Melrose and Piazza. The necessary definitions and results from arXiv:2111.14313 [math.KT] are repeated or reviewed in order to make this paper independent to the extent possible.


title: Application of Equal Local Levels to Improve Q-Q Plot Testing Bands with R Package qqconf

abstract: Quantile-Quantile (Q-Q) plots are often difficult to interpret because it is unclear how large the deviation from the theoretical distribution must be to indicate a lack of fit. Most Q-Q plots could benefit from the addition of meaningful global testing bands, but the use of such bands unfortunately remains rare because of the drawbacks of current approaches and packages. These drawbacks include incorrect global Type I error rate, lack of power to detect deviations in the tails of the distribution, relatively slow computation for large data sets, and limited applicability. To solve these problems, we apply the equal local levels global testing method, which we have implemented in the R Package qqconf, a versatile tool to create Q-Q plots and probability-probability (P-P) plots in a wide variety of settings, with simultaneous testing bands rapidly created using recently-developed algorithms. qqconf can easily be used to add global testing bands to Q-Q plots made by other packages. In addition to being quick to compute, these bands have a variety of desirable properties, including accurate global levels, equal sensitivity to deviations in all parts of the null distribution (including the tails), and applicability to a range of null distributions. We illustrate the use of qqconf in several applications: assessing normality of residuals from regression, assessing accuracy of p values, and use of Q-Q plots in genome-wide association studies.


title: Metal Blossom: Laser Forming Complex and Freeform Metal Structures Imitating Flower Blooming

abstract: For centuries, human civilizations devised metal forming techniques to make tools and items; yet, customized metal forming remains costly and intricate. Laser-forming origami} (lasergami) is a metal forming process where a laser beam cuts and folds a planar metal sheet to form a three-dimensional (3D) shape. Designing foldable structures formable by lasers, however, has long been a trial-and-error practice that requires significant mental effort and hinders the possibility of creating practical structures. This work demonstrates for the first time that lasergami can form a freeform set of metallic structures previously believed to have been impossible to be laser-formed. This technological breakthrough is enabled by new computational origami methods that imitate flower blooming and optimize laser folding instructions. Combined with new ideas that address laser line of sight and minimize fabrication energy, we report a low-cost manufacturing framework that can be readily adopted by hobbyists and professionals alike.


title: Convergence Rate of Multiple-try Metropolis Independent sampler

abstract: The Multiple-try Metropolis (MTM) method is an interesting extension of the classical Metropolis-Hastings algorithm. However, theoretical understandings of its convergence behavior as well as whether and how it may help are still unknown. This paper derives the exact convergence rate for Multiple-try Metropolis Independent sampler (MTM-IS) via an explicit eigen analysis. As a by-product, we prove that MTM-IS is less efficient than the simpler approach of repeated independent Metropolis-Hastings method at the same computational cost. We further explore more variations and find it possible to design more efficient MTM algorithms by creating correlated multiple trials.


title: Relativistic Coulomb Screening in Pulsational Pair Instability Supernovae

abstract: Context. Pulsational pair-instabilitye supernovae (PPISNe) and pair instability supernovae (PISNe) are the result of a thermonuclear runaway in the presence of a background electron-positron pair plasma. As such, their evolution and resultant black hole (BH) masses could possibly be affected by screening corrections due to the electron pair plasma. Aims. Sensitivity of PISNe and PPISNe to relativistic weak screening has been explored. Methods. In this paper a weak screening model that includes effects from relativistic pair production has been developed and applied at temperatures approaching and exceeding the thresh old for pair production. This screening model replaces "classical" screening commonly used in astrophysics. Modifications to the weak screening electron Debye length are incorporated in a computationally tractable analytic form with. Results. In PPISNe the BH masses were found to increase somewhat at high temperatures, though this increase is small. The BH collapse is also found to occur at earlier times, and the pulsational morphology also changes. In addition to the resultant BH mass, the sensitivity to the screening model of the pulsational period, the pulse structure, the PPISN-to-PISN transition, and the shift in the BH mass gap has been analyzed. The dependence of the composition of the ejected mass was also examined.


title: Scalable Semiparametric Spatio-temporal Regression for Large Data Analysis

abstract: With the rapid advances of data acquisition techniques, spatio-temporal data are becoming increasingly abundant in a diverse array of disciplines. Here we develop spatio-temporal regression methodology for analyzing large amounts of spatially referenced data collected over time, motivated by environmental studies utilizing remotely sensed satellite data. In particular, we specify a semiparametric autoregressive model without the usual Gaussian assumption and devise a computationally scalable procedure that enables the regression analysis of large datasets. We estimate the model parameters by quasi maximum likelihood and show that the computational complexity can be reduced from cubic to linear of the sample size. Asymptotic properties under suitable regularity conditions are further established that inform the computational procedure to be efficient and scalable. A simulation study is conducted to evaluate the finite-sample properties of the parameter estimation and statistical inference. We illustrate our methodology by a dataset with over 2.96 million observations of annual land surface temperature and the comparison with an existing state-of-the-art approach highlights the advantages of our method.


title: MAMRL: Exploiting Multi-agent Meta Reinforcement Learning in WAN Traffic Engineering

abstract: Traffic optimization challenges, such as load balancing, flow scheduling, and improving packet delivery time, are difficult online decision-making problems in wide area networks (WAN). Complex heuristics are needed for instance to find optimal paths that improve packet delivery time and minimize interruptions which may be caused by link failures or congestion. The recent success of reinforcement learning (RL) algorithms can provide useful solutions to build better robust systems that learn from experience in model-free settings. In this work, we consider a path optimization problem, specifically for packet routing, in large complex networks. We develop and evaluate a model-free approach, applying multi-agent meta reinforcement learning (MAMRL) that can determine the next-hop of each packet to get it delivered to its destination with minimum time overall. Specifically, we propose to leverage and compare deep policy optimization RL algorithms for enabling distributed model-free control in communication networks and present a novel meta-learning-based framework, MAMRL, for enabling quick adaptation to topology changes. To evaluate the proposed framework, we simulate with various WAN topologies. Our extensive packet-level simulation results show that compared to classical shortest path and traditional reinforcement learning approaches, MAMRL significantly reduces the average packet delivery time even when network demand increases; and compared to a non-meta deep policy optimization algorithm, our results show the reduction of packet loss in much fewer episodes when link failures occur while offering comparable average packet delivery time.


title: A novel multigrid method for elliptic distributed control problems

abstract: Large linear systems of saddle-point type have arisen in a wide variety of applications throughout computational science and engineering. The discretizations of distributed control problems have a saddle-point structure. The numerical solution of saddle-point problems has attracted considerable interest in recent years. In this work, we propose a novel Braess-Sarazin multigrid relaxation scheme for finite element discretizations of the distributed control problems, where we use the stiffness matrix obtained from the five-point finite difference method for the Laplacian to approximate the inverse of the mass matrix arising in the saddle-point system. We apply local Fourier analysis to examine the smoothing properties of the Braess-Sarazin multigrid relaxation. From our analysis, the optimal smoothing factor for Braess-Sarazin relaxation is derived. Numerical experiments validate our theoretical results. The relaxation scheme considered here shows its high efficiency and robustness with respect to the regularization parameter and grid size.


title: X-ray and Radio Studies of the candidate Millisecond Pulsar Binary 4FGL J0935.3+0901

abstract: 4FGL J0935.5+0901, a $\gamma$-ray source recently identified as a candidate redback-type millisecond pulsar binary (MSP), shows an interesting feature of having double-peaked emission lines in its optical spectrum. The feature would further suggest the source as a transitional MSP system in the sub-luminous disk state. We have observed the source with \xmm\ and Five-hundred-meter Aperture Spherical radio Telescope (FAST) at X-ray and radio frequencies respectivelyfor further studies. From the X-ray observation, a bimodal count-rate distribution, which is a distinctive feature of the transitional MSP systems, is not detected, while the properties of X-ray variability and power-law spectrum are determined for the source. These results help establish the consistency of it being a redback in the radio pulsar state. However no radio pulsation signals are found in the FAST observation, resulting an upper limit on the flux density of $\sim 4\,\mu$Jy. Implications of these results are discussed.


title: The Geometric Occam's Razor Implicit in Deep Learning

abstract: In over-parameterized deep neural networks there can be many possible parameter configurations that fit the training data exactly. However, the properties of these interpolating solutions are poorly understood. We argue that over-parameterized neural networks trained with stochastic gradient descent are subject to a Geometric Occam's Razor; that is, these networks are implicitly regularized by the geometric model complexity. For one-dimensional regression, the geometric model complexity is simply given by the arc length of the function. For higher-dimensional settings, the geometric model complexity depends on the Dirichlet energy of the function. We explore the relationship between this Geometric Occam's Razor, the Dirichlet energy and other known forms of implicit regularization. Finally, for ResNets trained on CIFAR-10, we observe that Dirichlet energy measurements are consistent with the action of this implicit Geometric Occam's Razor.


title: Comparison of spin-wave transmission in parallel and antiparallel magnetic configurations

abstract: Parallel (P) and antiparallel (AP) configurations are widely applied in magnetic heterostructures and have significant impacts on the spin-wave transmission in magnonic devices. In the present study, a theoretical investigation was conducted into the transmission of exchange-dominated spin waves with nanoscale wavelengths in a type of heterostructure including two magnetic media, of which the magnetization state can be set to the P (AP) configuration by ferromagnetic (antiferromagnetic) interfacial exchange coupling (IEC). The boundary conditions in P and AP cases were derived, by which the transmission and reflection coefficients of spin waves were analytically given and numerically calculated. In the P configuration, a critical angle $\theta_{\textrm{c}}$ always exists and has a significant influence on the transmission. Spin waves are refracted and reflected when the incident angle $\theta_{\textrm{i}}$ is smaller than the critical angle ($\theta_{\textrm{i}} < \theta_{\textrm{c}}$), while total reflection occurs as $\theta_{\textrm{i}} \geq \theta_{\textrm{c}}$. In the AP configuration, the spin-wave polarizations of medium 1 and 2 are inverse, that is, right-handed (RH) and left-handed (LH), leading to the total reflection being independent of $\theta_{\textrm{i}}$. As demonstrated by the difference in spin-wave transmission properties between the P ($\theta_{\textrm{i}} < \theta_{\textrm{c}}$) and AP cases, there is a polarization-dependent scattering. However, as $\theta_{\textrm{i}}$ exceeds $\theta_{\textrm{c}}$, the P ($\theta_{\textrm{i}} > \theta_{\textrm{c}}$) case exhibits similarities with the AP case, where the transmitted waves are found to be evanescent in medium 2 and their decay lengths are investigated.