title: BiSyn-GAT+: Bi-Syntax Aware Graph Attention Network for Aspect-based Sentiment Analysis

abstract: Aspect-based sentiment analysis (ABSA) is a fine-grained sentiment analysis task that aims to align aspects and corresponding sentiments for aspect-specific sentiment polarity inference. It is challenging because a sentence may contain multiple aspects or complicated (e.g., conditional, coordinating, or adversative) relations. Recently, exploiting dependency syntax information with graph neural networks has been the most popular trend. Despite its success, methods that heavily rely on the dependency tree pose challenges in accurately modeling the alignment of the aspects and their words indicative of sentiment, since the dependency tree may provide noisy signals of unrelated associations (e.g., the "conj" relation between "great" and "dreadful" in Figure 2). In this paper, to alleviate this problem, we propose a Bi-Syntax aware Graph Attention Network (BiSyn-GAT+). Specifically, BiSyn-GAT+ fully exploits the syntax information (e.g., phrase segmentation and hierarchical structure) of the constituent tree of a sentence to model the sentiment-aware context of every single aspect (called intra-context) and the sentiment relations across aspects (called inter-context) for learning. Experiments on four benchmark datasets demonstrate that BiSyn-GAT+ outperforms the state-of-the-art methods consistently.


title: A proper scoring rule for minimum information copulas

abstract: Multi-dimensional distributions whose marginal distributions are uniform are called copulas. Among them, the one that satisfies given constraints on expectation and is closest to the independent distribution in the sense of Kullback-Leibler divergence is called the minimum information copula. The density function of the minimum information copula contains a set of functions called the normalizing functions, which are often difficult to compute. Although a number of proper scoring rules for probability distributions having normalizing constants such as exponential families are proposed, these scores are not applicable to the minimum information copulas due to the normalizing functions. In this paper, we propose the conditional Kullback-Leibler score, which avoids computation of the normalizing functions. The main idea of its construction is to use pairs of observations. We show that the proposed score is strictly proper in the space of copula density functions and therefore the estimator derived from it has asymptotic consistency. Furthermore, the score is convex with respect to the parameters and can be easily optimized by the gradient methods.


title: Fractional Sobolev regularity for fully nonlinear elliptic equations

abstract: We prove higher-order fractional Sobolev regularity for fully nonlinear, uniformly elliptic equations in the presence of unbounded source terms. More precisely, we show the existence of a universal number $0< \varepsilon <1$, depending only on ellipticity constants and dimension, such that if $u$ is a viscosity solution of $F(D^2u) = f(x) \in L^p$, then $u\in W^{1+\varepsilon,p}$, with appropriate estimates. Our strategy suggests a sort of fractional feature of fully nonlinear diffusion processes, as what we actually show is that $F(D^2u) \in L^p \implies (-\Delta)^\theta u \in L^p$, for a universal constant $\frac{1}{2} < \theta <1$. We believe our techniques are flexible and can be adapted to various models and contexts.


title: AutoCOR: Autonomous Condylar Offset Ratio Calculator on TKA-Postoperative Lateral Knee X-ray

abstract: The postoperative range of motion is one of the crucial factors indicating the outcome of Total Knee Arthroplasty (TKA). Although the correlation between range of knee flexion and posterior condylar offset (PCO) is controversial in the literature, PCO maintains its importance on evaluation of TKA. Due to limitations on PCO measurement, two novel parameters, posterior condylar offset ratio (PCOR) and anterior condylar offset ratio (ACOR), were introduced. Nowadays, the calculation of PCOR and ACOR on plain lateral radiographs is done manually by orthopedic surgeons. In this regard, we developed a software, AutoCOR, to calculate PCOR and ACOR autonomously, utilizing unsupervised machine learning algorithm (k-means clustering) and digital image processing techniques. The software AutoCOR is capable of detecting the anterior/posterior edge points and anterior/posterior cortex of the femoral shaft on true postoperative lateral conventional radiographs. To test the algorithm, 50 postoperative true lateral radiographs from Istanbul Kosuyolu Medipol Hospital Database were used (32 patients). The mean PCOR was 0.984 (SD 0.235) in software results and 0.972 (SD 0.164) in ground truth values. It shows strong and significant correlation between software and ground truth values (Pearson r=0.845 p<0.0001). The mean ACOR was 0.107 (SD 0.092) in software results and 0.107 (SD 0.070) in ground truth values. It shows moderate and significant correlation between software and ground truth values (Spearman's rs=0.519 p=0.0001412). We suggest that AutoCOR is a useful tool that can be used in clinical practice.


title: Betelgeuse Constraints on Coupling between Axion-like Particles and Electrons

abstract: Axion-like particles (ALPs) can be produced by thermal processes in a stellar interior, escape from the star and, if sufficiently light, be converted into photons in the external Galactic magnetic field. Such a process could produce a detectable hard X-ray excess in the direction of the star. In this scenario, a promising class of targets is the red supergiants, massive stars which are experiencing the late part of their evolution. We report on a search for ALP-induced X-ray emission from Betelgeuse, produced via the combined processes of Bremsstrahlung, Compton and Primakoff. Using a 50 ks observation of Betelgeuse by the \emph{NuSTAR} satellite telescope, we set 95\% C.L. upper limits on the ALP-electron ($g_{ae}$) and ALP-photon ($g_{a\gamma}$) couplings. For masses ${m_{a}\leq(3.5-5.5)\times10^{-11}}$ eV, we find $g_{a\gamma} \times g_{ae}< (0.4-2.8)\times10^{-24}$ GeV$^{-1}$ (depending on the stellar model and assuming a value of the regular Galactic magnetic field in the direction transverse to Betelgeuse of $B_T$=1.4 $\mu$G). This corresponds to ${g_{ae}<(0.4-2.8) \times10^{-12}}$ for ${g_{a\gamma}>1.0\times10^{-12}}$ GeV$^{-1}$. This analysis supercedes by over an order of magnitude the limit on $g_{ae} \times g_{a\gamma}$ placed by the CAST solar axion experiment and is among the strongest constraints on these couplings.


title: Ogden Material Calibration via Magnetic Resonance Cartography, Parameter Sensitivity, and Variational System Identification

abstract: Contemporary material characterisation techniques that leverage deformation fields and the weak form of the equilibrium equations face challenges in the numerical solution procedure of the inverse characterisation problem. As material models and descriptions differ, so too must the approaches for identifying parameters and their corresponding mechanisms. The widely-used Ogden material model can be comprised of a chosen number of terms of the same mathematical form, which presents challenges of parsimonious representation, interpretability, and stability. Robust techniques for system identification of any material model are important to assess and improve experimental design, in addition to their centrality to forward computations. Using fully 3D displacement fields acquired in silicone elastomers with our recently-developed magnetic resonance cartography (MR-u) technique on the order of $>20,000$ points per sample, we leverage PDE-constrained optimisation as the basis of variational system identification of our material parameters. We incorporate the statistical F-test to maintain parsimony of representation. Using a new, local deformation decomposition locally into mixtures of biaxial and uniaxial tensile states, we evaluate experiments based on an analytical sensitivity metric, and discuss the implications for experimental design.


title: A novel nonconvex, smooth-at-origin penalty for statistical learning

abstract: Nonconvex penalties are utilized for regularization in high-dimensional statistical learning algorithms primarily because they yield unbiased or nearly unbiased estimators for the parameters in the model. Nonconvex penalties existing in the literature such as SCAD, MCP, Laplace and arctan have a singularity at origin which makes them useful also for variable selection. However, in several high-dimensional frameworks such as deep learning, variable selection is less of a concern. In this paper, we present a nonconvex penalty which is smooth at origin. The paper includes asymptotic results for ordinary least squares estimators regularized with the new penalty function, showing asymptotic bias that vanishes exponentially fast. We also conducted an empirical study employing deep neural network architecture on three datasets and convolutional neural network on four datasets. The empirical study showed better performance for the new regularization approach in five out of the seven datasets.


title: Efficient two-dimensional control of barrier crossing

abstract: Driven barrier crossings are pervasive in optical-trapping experiments and steered molecular-dynamics simulations. Despite the high fidelity of control, the freedom in the choice of driving protocol is rarely exploited to improve efficiency. We design protocols that reduce dissipation for rapidly driven barrier crossing under two-dimensional control of a harmonic trapping potential, controlling both trap center and stiffness. For fast driving, the minimum-dissipation protocol jumps halfway between the control-parameter endpoints. For slow driving, the minimum-dissipation protocol generically slows down and tightens the trap as it crosses the barrier, resulting in both significant energy savings and increased flux compared to naive and one-dimensional protocols (that only change trap center). Combining fast and slow results, we design protocols that improve performance at all speeds.


title: Deep transfer learning for system identification using long short-term memory neural networks

abstract: Recurrent neural networks (RNNs) have many advantages over more traditional system identification techniques. They may be applied to linear and nonlinear systems, and they require fewer modeling assumptions. However, these neural network models may also need larger amounts of data to learn and generalize. Furthermore, neural networks training is a time-consuming process. Hence, building upon long-short term memory neural networks (LSTM), this paper proposes using two types of deep transfer learning, namely parameter fine-tuning and freezing, to reduce the data and computation requirements for system identification. We apply these techniques to identify two dynamical systems, namely a second-order linear system and a Wiener-Hammerstein nonlinear system. Results show that compared with direct learning, our method accelerates learning by 10% to 50%, which also saves data and computing resources.


title: Chromospheric Extension of the MURaM Code

abstract: Detailed numerical models of chromosphere and corona are required to understand the heating of the solar atmosphere. An accurate treatment of the solar chromosphere is complicated by the effects arising from Non Local Thermodynamic Equilibrium (NLTE) radiative transfer. A small number of strong, highly scattering lines dominate the cooling and heating in the chromosphere. Additionally, the recombination times of ionised hydrogen are longer than the dynamical timescales, requiring a non-equilibrium (NE) treatment of hydrogen ionisation. The MURaM code is extended to include the physical process required for accurate simulation of the solar chromosphere, as implemented in the Bifrost code. This includes a time-dependent treatment of hydrogen ionisation, a scattering multi-group radiation transfer scheme and approximations for NLTE radiative cooling. The inclusion of NE and NLTE physics has a large impact on the structure of the chromosphere; the NE treatment of hydrogen ionisation leads to a higher ionisation fraction and enhanced populations in the first excited state throughout cold inter-shock regions of the chromosphere. Additionally this prevents hydrogen ioniation from buffering energy fluctuations, leading to hotter shocks and cooler inter-shock regions. The hydrogen populations in the ground and first excited state are enhanced by $10^2-10^3$ in the upper chromosphere and up to $10^9$ near the transition region. Including the necessary NLTE physics leads to significant differences in chromospheric structure and dynamics. The thermodynamics and hydrogen populations calculated using the extended version of the MURaM code are consistent with previous non-equilibrium simulations. The electron number and temperature calculated using the non-equilibrium treatment of the chromosphere are required to accurately synthesise chromospheric spectral lines.


title: The slices of quaternionic Eilenberg-Mac Lane spectra

abstract: We compute the slices and slice spectral sequence of integral suspensions of the equivariant Eilenberg-Mac Lane spectra $H\underline{\mathbb{Z}}$ for the group of equivariance $Q_8$. Along the way, we compute the Mackey functors $\underline{\pi}_{k\rho} H\underline{\mathbb{Z}}$.


title: Sigma Workbook: A Spreadsheet for Cloud Data Warehouses

abstract: Cloud data warehouses (CDWs) bring large-scale data and compute power closer to users in enterprises. However, existing tools for analyzing data in CDWs are either limited in ad-hoc transformations or difficult to use for business users. Here we introduce Sigma Workbook, a new interactive system that enables business users to easily perform a visual analysis of data in CDWs at scale. For this, Sigma Workbook provides an accessible spreadsheet-like interface for analysis through direct manipulation. Sigma Workbook dynamically constructs matching SQL queries from user interactions, building on the versatility and expressivity of SQL. Constructed queries are directly executed on CDWs, leveraging the superior characteristics of the new generation CDWs, including scalability. We demonstrate Sigma Workbook through 3 real-life use cases -- cohort analysis, sessionization, and data augmentation -- and underline Workbook's ease of use, scalability, and expressivity.


title: Principal blocks for different primes, I

abstract: We propose new conjectures about the relationship between the principal blocks of finite groups for different primes and establish evidence for these conjectures.


title: Principal blocks for different primes, II

abstract: If G is a finite group, we have proposed new conjectures on the interaction between different primes and their corresponding Brauer principal blocks. In this paper, we give strong support to the validity of these conjectures.


title: Decorated Defect Construction of Gapless-SPT States

abstract: Symmetry protected topological (SPT) phases are one of the simplest, yet nontrivial, gapped systems that go beyond the Landau paradigm. In this work, we study an extension of the notion of SPT for gapless systems, namely, gapless symmetry protected topological states. We construct several simple gapless-SPT models using the decorated defect construction, which allow analytical understanding of non-trivial topological features including the symmetry charge under twisted boundary conditions, and boundary (quasi)-degeneracy under open boundary conditions. We also comment on the stability of the gapless-SPT models under symmetric perturbations, and apply small-scale exact diagonalization when direct analytic understanding is not available.


title: First-Order Algorithms for Nonlinear Generalized Nash Equilibrium Problems

abstract: We consider the problem of computing an equilibrium in a class of \textit{nonlinear generalized Nash equilibrium problems (NGNEPs)} in which the strategy sets for each player are defined by equality and inequality constraints that may depend on the choices of rival players. While the asymptotic global convergence and local convergence rates of algorithms to solve this problem have been extensively investigated, the analysis of nonasymptotic iteration complexity is still in its infancy. This paper presents two first-order algorithms -- based on the quadratic penalty method (QPM) and augmented Lagrangian method (ALM), respectively -- with an accelerated mirror-prox algorithm as the solver in each inner loop. We establish a global convergence guarantee for solving monotone and strongly monotone NGNEPs and provide nonasymptotic complexity bounds expressed in terms of the number of gradient evaluations. Experimental results demonstrate the efficiency of our algorithms in practice.


title: Bi-fidelity conditional value-at-risk estimation by dimensionally decomposed generalized polynomial chaos expansion

abstract: Digital twin models allow us to continuously assess the possible risk of damage and failure of a complex system. Yet high-fidelity digital twin models can be computationally expensive, making quick-turnaround assessment challenging. Towards this goal, this article proposes a novel bi-fidelity method for estimating the conditional value-at-risk (CVaR) for nonlinear systems subject to dependent and high-dimensional inputs. For models that can be evaluated fast, a method that integrates the dimensionally decomposed generalized polynomial chaos expansion (DD-GPCE) approximation with a standard sampling-based CVaR estimation is proposed. For expensive-to-evaluate models, a new bi-fidelity method is proposed that couples the DD-GPCE with a Fourier-polynomial expansion of the mapping between the stochastic low-fidelity and high-fidelity output data to ensure computational efficiency. The method employs measure-consistent orthonormal polynomials in the random variable of the low-fidelity output to approximate the high-fidelity output. Numerical results for a structural mechanics truss with 36-dimensional (dependent random variable) inputs indicate that the DD-GPCE method provides very accurate CVaR estimates that require much lower computational effort than standard GPCE approximations. A second example considers the realistic problem of estimating the risk of damage to a fiber-reinforced composite laminate. The high-fidelity model is a finite element simulation that is prohibitively expensive for risk analysis, such as CVaR computation. Here, the novel bi-fidelity method can accurately estimate CVaR as it includes low-fidelity models in the estimation procedure and uses only a few high-fidelity model evaluations to significantly increase accuracy.


title: Perception-aware receding horizon trajectory planning for multicopters with visual-inertial odometry

abstract: Visual inertial odometry (VIO) is widely used for the state estimation of multicopters, but it may function poorly in environments with few visual features or in overly aggressive flights. In this work, we propose a perception-aware collision avoidance trajectory planner for multicopters, that may be used with any feature-based VIO algorithm. Our approach is able to fly the vehicle to a goal position at fast speed, avoiding obstacles in an unknown stationary environment while achieving good VIO state estimation accuracy. The proposed planner samples a group of minimum jerk trajectories and finds collision-free trajectories among them, which are then evaluated based on their speed to the goal and perception quality. Both the motion blur of features and their locations are considered for the perception quality. Our novel consideration of the motion blur of features enables automatic adaptation of the trajectory's aggressiveness under environments with different light levels. The best trajectory from the evaluation is tracked by the vehicle and is updated in a receding horizon manner when new images are received from the camera. Only generic assumptions about the VIO are made, so that the planner may be used with various existing systems. The proposed method can run in real-time on a small embedded computer on board. We validated the effectiveness of our proposed approach through experiments in both indoor and outdoor environments. Compared to a perception-agnostic planner, the proposed planner kept more features in the camera's view and made the flight less aggressive, making the VIO more accurate. It also reduced VIO failures, which occurred for the perception-agnostic planner but not for the proposed planner. The ability of the proposed planner to fly through dense obstacles was also validated. The experiment video can be found at https://youtu.be/qO3LZIrpwtQ.


title: Pogorelov type $C^2$ estimates for Sum Hessian equations and a rigidity theorem

abstract: We mainly study Pogorelov type $C^2$ estimates for solutions to the Dirichlet problem of Sum Hessian equations. We establish respectively Pogorelov type $C^2$ estimates for $k$-convex solutions and admissible solutions under some conditions. Furthermore, we apply such estimates to obtain a rigidity theorem for $k$-convex solutions of Sum Hessian equations in Euclidean space.


title: Simplicial Resolutions of Powers of Square-free Monomial Ideals

abstract: The Taylor resolution is almost never minimal for powers of monomial ideals, even in the square-free case. In this paper we introduce a smaller resolution for each power of any square-free monomial ideal, which depends only on the number of generators of the ideal. More precisely, for every pair of fixed integers $r$ and $q$, we construct a simplicial complex that supports a free resolution of the $r$-th power of any square-free monomial ideal with $q$ generators. The resulting resolution is significantly smaller than the Taylor resolution, and is minimal for special cases. Considering the relations on the generators of a fixed ideal allows us to further shrink these resolutions. We also introduce a class of ideals called "extremal ideals", and show that the Betti numbers of powers of all square-free monomial ideals are bounded by Betti numbers of powers of extremal ideals. Our results lead to upper bounds on Betti numbers of powers of any square-free monomial ideal that greatly improve the binomial bounds offered by the Taylor resolution.


title: Classification of events from $\alpha$-induced reactions in the MUSIC detector via statistical and ML methods

abstract: The Multi-Sampling Ionization Chamber (MUSIC) detector is typically used to measure nuclear reaction cross sections relevant for nuclear astrophysics, fusion studies, and other applications. From the MUSIC data produced in one experiment scientists carefully extract an order of $10^3$ events of interest from about $10^{9}$ total events, where each event can be represented by an 18-dimensional vector. However, the standard data classification process is based on expert-driven, manually intensive data analysis techniques that require several months to identify patterns and classify the relevant events from the collected data. To address this issue, we present a method for the classification of events originating from specific $\alpha$-induced reactions by combining statistical and machine learning methods that require significantly less input from the domain scientist, relative to the standard technique. We applied the new method to two experimental data sets and compared our results with those obtained using traditional methods. With few exceptions, the number of events classified by our method agrees within $\pm20\%$ with the results obtained using traditional methods. With the present method, which is the first of its kind for the MUSIC data, we have established the foundation for the automated extraction of physical events of interest from experiments using the MUSIC detector.


title: High-bandwidth CMOS-voltage-level electro-optic modulation of 780 nm light in thin-film lithium niobate

abstract: Integrated photonics operating at visible-near-infrared (VNIR) wavelengths offer scalable platforms for advancing optical systems for addressing atomic clocks, sensors, and quantum computers. The complexity of free-space control optics causes limited addressability of atoms and ions, and this remains an impediment on scalability and cost. Networks of Mach-Zehnder interferometers can overcome challenges in addressing atoms by providing high-bandwidth electro-optic control of multiple output beams. Here, we demonstrate a VNIR Mach-Zehnder interferometer on lithium niobate on sapphire with a CMOS voltage-level compatible full-swing voltage of 4.2 V and an electro-optic bandwidth of 2.7 GHz occupying only 0.35 mm$^2$. Our waveguides exhibit 1.6 dB/cm propagation loss and our microring resonators have intrinsic quality factors of 4.4 $\times$ 10$^5$. This specialized platform for VNIR integrated photonics can open new avenues for addressing large arrays of qubits with high precision and negligible cross-talk.


title: DiffCloud: Real-to-Sim from Point Clouds with Differentiable Simulation and Rendering of Deformable Objects

abstract: Research in manipulation of deformable objects is typically conducted on a limited range of scenarios, because handling each scenario on hardware takes significant effort. Realistic simulators with support for various types of deformations and interactions have the potential to speed up experimentation with novel tasks and algorithms. However, for highly deformable objects it is challenging to align the output of a simulator with the behavior of real objects. Manual tuning is not intuitive, hence automated methods are needed. We view this alignment problem as a joint perception-inference challenge and demonstrate how to use recent neural network architectures to successfully perform simulation parameter inference from real point clouds. We analyze the performance of various architectures, comparing their data and training requirements. Furthermore, we propose to leverage differentiable point cloud sampling and differentiable simulation to significantly reduce the time to achieve the alignment. We employ an efficient way to propagate gradients from point clouds to simulated meshes and further through to the physical simulation parameters, such as mass and stiffness. Experiments with highly deformable objects show that our method can achieve comparable or better alignment with real object behavior, while reducing the time needed to achieve this by more than an order of magnitude. Videos and supplementary material are available at https://tinyurl.com/diffcloud.


title: Off-Policy Evaluation with Online Adaptation for Robot Exploration in Challenging Environments

abstract: Autonomous exploration has many important applications. However, classic information gain-based or frontier-based exploration only relies on the robot current state to determine the immediate exploration goal, which lacks the capability of predicting the value of future states and thus leads to inefficient exploration decisions. This paper presents a method to learn how "good" states are, measured by the state value function, to provide a guidance for robot exploration in real-world challenging environments. We formulate our work as an off-policy evaluation (OPE) problem for robot exploration (OPERE). It consists of offline Monte-Carlo training on real-world data and performs Temporal Difference (TD) online adaptation to optimize the trained value estimator. We also design an intrinsic reward function based on sensor information coverage to enable the robot to gain more information with sparse extrinsic rewards. Results show that our method enables the robot to predict the value of future states so as to better guide robot exploration. The proposed algorithm achieves better prediction and exploration performance compared with the state-of-the-arts. To the best of our knowledge, this work for the first time demonstrates value function prediction on real-world dataset for robot exploration in challenging subterranean and urban environments. More details and demo videos can be found at https://jeffreyyh.github.io/opere/.


title: Adversarial Machine Learning Attacks Against Video Anomaly Detection Systems

abstract: Anomaly detection in videos is an important computer vision problem with various applications including automated video surveillance. Although adversarial attacks on image understanding models have been heavily investigated, there is not much work on adversarial machine learning targeting video understanding models and no previous work which focuses on video anomaly detection. To this end, we investigate an adversarial machine learning attack against video anomaly detection systems, that can be implemented via an easy-to-perform cyber-attack. Since surveillance cameras are usually connected to the server running the anomaly detection model through a wireless network, they are prone to cyber-attacks targeting the wireless connection. We demonstrate how Wi-Fi deauthentication attack, a notoriously easy-to-perform and effective denial-of-service (DoS) attack, can be utilized to generate adversarial data for video anomaly detection systems. Specifically, we apply several effects caused by the Wi-Fi deauthentication attack on video quality (e.g., slow down, freeze, fast forward, low resolution) to the popular benchmark datasets for video anomaly detection. Our experiments with several state-of-the-art anomaly detection models show that the attackers can significantly undermine the reliability of video anomaly detection systems by causing frequent false alarms and hiding physical anomalies from the surveillance system.


title: On the wall-bounded model of fingering double diffusive convection

abstract: Fingering double diffusive convection with real seawater properties is studied by two-dimensional direct numerical simulations for the wall-bounded domain and compared with the results for fully periodic domain. For fixed unstable salinity difference between two horizontal plates, dominant flow structures change from convection rolls to salt fingers as the stable temperature difference increases. Meanwhile the bulk density ratio calculated by the mean scalar gradients exceeds unity. When the bulk thermal Rayleigh number, which is defined by the mean temperature gradient in the bulk and the domain height, is larger than $10^7$, the characteristic height of salt fingers is much smaller than the domain height and the flow enters the free salt-finger regime. In this regime the transport properties agree quantitatively with those obtained in the fully periodic domain (e.g. Traxler et al. J. Fluid Mech., 677, 530-553, 2011). The salt-finger bulk does not spontaneously break into multi-layer staircases probably due to the fact that solid boundary prevents the development of large-scale secondary instabilities. For the limited range of density ratio at the highest salinity Rayleigh number considered here, the multi-layer state is directly established from the initial condition with uniform salinity distribution and vertically linear temperature distribution.


title: Unique electronic structure and the shape-change effect of stage-I graphite intercalation compounds with Thorium, Uranium and Plutonium

abstract: GICs doped with elements containing d and f orbitals have been studied rarely. We control the distribution and density of intercalated actinide metals (Th, U and Pu), and consider the effect of changing the distance of two adjacent carbon layers on the electronic structure so as to infer the physical properties of such materials under high pressure or high temperature - which is of great significance in fundamental research. According to band schemas, those GICs are all metallic. The projected density of states (PDOS) indicates that the metal atoms first undergo hybridization of its s, p, d, and f orbitals, and then bond with the carbon's pz orbitals of the nearest-neighbor octagons. The electron orbital spin up of C and Th is symmetrical with spin down, so there is no electron spin polarization. However, the s, p, d, and f orbitals of U and Pu all exhibit electron spin polarization, which leads to the magnetic properties of the material and make the p orbits of C appear spin polarization around Fermi level. In addition, these three selected elements are the most commonly used raw materials in nuclear fission, so such GICs are expected to become novel nuclear energy storage materials.


title: Exploring Cross-Domain Pretrained Model for Hyperspectral Image Classification

abstract: A pretrain-finetune strategy is widely used to reduce the overfitting that can occur when data is insufficient for CNN training. First few layers of a CNN pretrained on a large-scale RGB dataset are capable of acquiring general image characteristics which are remarkably effective in tasks targeted for different RGB datasets. However, when it comes down to hyperspectral domain where each domain has its unique spectral properties, the pretrain-finetune strategy no longer can be deployed in a conventional way while presenting three major issues: 1) inconsistent spectral characteristics among the domains (e.g., frequency range), 2) inconsistent number of data channels among the domains, and 3) absence of large-scale hyperspectral dataset. We seek to train a universal cross-domain model which can later be deployed for various spectral domains. To achieve, we physically furnish multiple inlets to the model while having a universal portion which is designed to handle the inconsistent spectral characteristics among different domains. Note that only the universal portion is used in the finetune process. This approach naturally enables the learning of our model on multiple domains simultaneously which acts as an effective workaround for the issue of the absence of large-scale dataset. We have carried out a study to extensively compare models that were trained using cross-domain approach with ones trained from scratch. Our approach was found to be superior both in accuracy and in training efficiency. In addition, we have verified that our approach effectively reduces the overfitting issue, enabling us to deepen the model up to 13 layers (from 9) without compromising the accuracy.


title: DeepTensor: Low-Rank Tensor Decomposition with Deep Network Priors

abstract: DeepTensor is a computationally efficient framework for low-rank decomposition of matrices and tensors using deep generative networks. We decompose a tensor as the product of low-rank tensor factors (e.g., a matrix as the outer product of two vectors), where each low-rank tensor is generated by a deep network (DN) that is trained in a self-supervised manner to minimize the mean-squared approximation error. Our key observation is that the implicit regularization inherent in DNs enables them to capture nonlinear signal structures (e.g., manifolds) that are out of the reach of classical linear methods like the singular value decomposition (SVD) and principal component analysis (PCA). Furthermore, in contrast to the SVD and PCA, whose performance deteriorates when the tensor's entries deviate from additive white Gaussian noise, we demonstrate that the performance of DeepTensor is robust to a wide range of distributions. We validate that DeepTensor is a robust and computationally efficient drop-in replacement for the SVD, PCA, nonnegative matrix factorization (NMF), and similar decompositions by exploring a range of real-world applications, including hyperspectral image denoising, 3D MRI tomography, and image classification. In particular, DeepTensor offers a 6dB signal-to-noise ratio improvement over standard denoising methods for signals corrupted by Poisson noise and learns to decompose 3D tensors 60 times faster than a single DN equipped with 3D convolutions.


title: A Modified Net Reclassification Improvement Statistic

abstract: The continuous net reclassification improvement (NRI) statistic is a popular model change measure that was developed to assess the incremental value of new factors in a risk prediction model. Two prominent statistical issues identified in the literature call the utility of this measure into question: (1) it is not a proper scoring function and (2) it has a high false positive rate when testing whether new factors contribute to the risk model. For binary response regression models, these subjects are interrogated and a modification of the continuous NRI, guided by the likelihood-based score residual, is proposed to address these issues. Within a nested model framework, the modified NRI may be viewed as a distance measure between two risk models. An application of the modified NRI is illustrated using prostate cancer data.


title: Visibility phenomena in hypercubes

abstract: We study the set of visible lattice points in multidimensional hypercubes. The problems we investigate mix together geometric, probabilistic and number theoretic tones. For example, we prove that almost all self-visible triangles with vertices in the lattice of points with integer coordinates in $\mathcal W=[0,N]^d$ are almost equilateral having all sides almost equal to $\sqrt{d}N/\sqrt{6}$, and the sine of the typical angle between rays from the visual spectra from the origin of $\mathcal W$ is, in the limit, equal to $\sqrt{7}/4$, as $d$ and $N/d$ tend to infinity. We also show that there exists an interesting number theoretic constant $\Lambda_{d,K}$, which is the limit probability of the chance that a $K$-polytope with vertices in the lattice $\mathcal W$ has all vertices visible from each other.


title: A strong Gram classification of non-negative unit forms of Dynkin type A

abstract: An integral quadratic form q is usually identified with a bilinear form b such that its Gram matrix with respect to the canonical basis is upper triangular. Two integral quadratic forms are called strongly (resp. weakly) Gram congruent if their corresponding upper triangular bilinear forms (resp. their symmetrizations) are equivalent. If q is unitary, such upper triangular bilinear form is unimodular, and one considers the associated Coxeter transformation and its characteristic polynomial, the so-called Coxeter polynomial of q with this identification. Two strongly Gram congruent quadratic unit forms are weakly Gram congruent and have the same Coxeter polynomial. Here we show that the converse of this statement holds for the connected non-negative case of Dynkin type A_r and arbitrary corank, and use this characterization to complete a combinatorial classification of such quadratic forms started in [Fundamenta Informaticae 184(1):49-82, 2021] and [Fundamenta Informaticae 185(3):221-246, 2022].


title: Heavy-Flavor-Conserving Hadronic Weak Decays of Charmed and Bottom Baryons

abstract: Three decades ago, heavy-flavor-conserving (HFC) weak decays of heavy baryons such as $\Xi_Q\to\Lambda_Q\pi$ and $\Omega_Q\to\Xi_Q\pi$ for $Q=c,b$ had been studied within the framework that incorporates both heavy-quark and chiral symmetries. It was pointed out that if the heavy quark in the HFC process behaves as a spectator, then the $P$-wave amplitude of ${\cal B}_{\bar 3}\to {\cal B}_{\bar 3}+\pi$ with ${\cal B}_{\bar 3}$ being an antitriplet heavy baryon will vanish in the heavy quark limit. Indeed, this is the case for $\Xi_b\to\Lambda_b \pi$ decays. For $\Xi_c\to\Lambda_c\pi$ decays, they receive additional nonspectator contributions arising from the $W$-exchange diagrams through the $cs\to dc$ transition. Spectator and nonspectator $W$-exchange contributions to the $S$-wave amplitude of $\Xi_c\to\Lambda_c\pi$ are destructive, rendering the $S$-wave contribution even smaller. However, the nonspectator effect on the $P$-wave amplitude was overlooked in all the previous model calculations until a very recent investigation within the framework of a constituent quark model in which the parity-conserving pole terms were found to be dominant in $\Xi_c\to\Lambda_c\pi$ decays. Since the pion produced in the HFC process is soft, we apply current algebra to study both $S$- and $P$-wave amplitudes and employ the bag and diquark models to estimate the matrix elements of four-quark operators. We confirm that $\Xi_c\to\Lambda_c\pi$ decays are indeed dominated by the parity-conserving transition induced from nonspectator $W$-exchange and that they receive largest contributions from the intermediate $\Sigma_c$ pole terms. We also show that the $S$-wave of $\Omega_b\to \Xi_b \pi$ decays vanishes in the heavy quark limit, while $\Omega_c\to \Xi_c\pi$ receive additional $W$-exchange contributions via $cs\to dc$ transition.


title: Analytic Investigation for Spatio-temporal Patterns Propagation in Spiking Neural Networks

abstract: Based upon the moment closure approach, a Gaussian random field is constructed to quantitatively and analytically characterize the dynamics of a random point field. The approach provides us with a theoretical tool to investigate synchronized spike propagation in a feedforward or recurrent spiking neural network. We show that the balance between the excitation and inhibition postsynaptic potentials is required for the occurrence of synfire chains. In particular, with a balanced network, the critical packet size of invasion and annihilation is observed. We also derive a sufficient analytic condition for the synchronization propagation in an asynchronous environment, which further allows us to disclose the possibility of spatial synaptic structure to sustain a stable synfire chain. Our findings are in good agreement with simulations and help us understand the propagation of spatio-temporal patterns in a random point flied.


title: Stochastic Theory of the Size Distribution of Raindrops

abstract: For over a century, raindrop size distributions have been a subject of extensive scientific study, typically described by models including the Marshall-Palmer exponential equation, gamma, Weibull, lognormal, and other mathematical functions. In this work, we present a theory that integrates deterministic principles from thermodynamics and fluid dynamics with stochastic elements to predict expected raindrop diameters and describe ground-level drop-size distributions. Importantly, our approach avoids assuming specific drop-size dispersion processes or relying on multi-variable empirical data fitting. We derive analytical equations for key raindrop parameters (e.g., median diameter, expected minimum and maximum diameters) and drop-size distributions as functions of rainfall intensity. Our theoretical predictions align well with extensive published experimental data, covering rainfall intensities from 0.4 to 40 mm/h across diverse global locations. Additionally, consistent with observations of super-large raindrops, our theory suggests a maximum ground-level raindrop diameter limit of around 10 mm. We establish analytical expressions for meteorological parameters like the Marshall-Palmer constant and total raindrop concentration, validated against empirical data. The theoretical approach presented here can find broad applications in climate modeling, sprays and aerosol dynamics, bubbles and particles, extraterrestrial rainfall, and paleoclimatology.


title: The FAST Ultra-Deep Survey (FUDS): observational strategy, calibration and data reduction

abstract: The FAST Ultra-Deep Survey (FUDS) is a blind survey that aims for the direct detection of HI in galaxies at redshifts $z<0.42$. The survey uses the multibeam receiver on the Five Hundred Meter Aperture Spherical Telescope (FAST) to map six regions, each of size 0.72 deg$^2$ at high sensitivity ($\sim 50 \mu$Jy) and high frequency resolution (23 kHz). The survey will enable studies of the evolution of galaxies and their HI content with an eventual sample size of $\sim 1000$. We present the science goals, observing strategy, the effects of radio frequency interference (RFI) at the FAST site, our mitigation strategies and the methods for calibration, data reduction and imaging as applied to initial data. The observations and reductions for the first field, FUDS0, are completed, with around 128 HI galaxies detected in a preliminary analysis. Example spectra are given in this paper, including a comparison with data from the overlapping GAL2577 field of Arecibo Ultra-Deep Survey (AUDS).


title: Spectrum of the Transposition graph

abstract: Transposition graph $T_n$ is defined as a Cayley graph over the symmetric group generated by all transpositions. It is known that all eigenvalues of $T_n$ are integers. However, an explicit description of the spectrum is unknown. In this paper we prove that for any integer $k\geqslant 0$ there exists $n_0$ such that for any $n\geqslant n_0$ and any $m \in \{0, \dots, k\}$, $m$ is an eigenvalue of $T_n$. In particular, it is proved that zero is an eigenvalue of $T_n$ for any $n\neq2$, and one is an eigenvalue of $T_n$ for any odd $n\geqslant 7$ and for any even $n \geqslant 14$. We also present exact values of the third and the fourth largest eigenvalues of $T_n$ with their multiplicities.


title: Optimization Models and Interpretations for Three Types of Adversarial Perturbations against Support Vector Machines

abstract: Adversarial perturbations have drawn great attentions in various deep neural networks. Most of them are computed by iterations and cannot be interpreted very well. In contrast, little attentions are paid to basic machine learning models such as support vector machines. In this paper, we investigate the optimization models and the interpretations for three types of adversarial perturbations against support vector machines, including sample-adversarial perturbations (sAP), class-universal adversarial perturbations (cuAP) as well as universal adversarial perturbations (uAP). For linear binary/multi classification support vector machines (SVMs), we derive the explicit solutions for sAP, cuAP and uAP (binary case), and approximate solution for uAP of multi-classification. We also obtain the upper bound of fooling rate for uAP. Such results not only increase the interpretability of the three adversarial perturbations, but also provide great convenience in computation since iterative process can be avoided. Numerical results show that our method is fast and effective in calculating three types of adversarial perturbations.


title: Just-Noticeable-Difference Based Edge Map Quality Measure

abstract: The performance of an edge detector can be improved when assisted with an effective edge map quality measure. Several evaluation methods have been proposed resulting in different performance score for the same candidate edge map. However, an effective measure is the one that can be automated and which correlates with human judgement perceived quality of the edge map. Distance-based edge map measures are widely used for assessment of edge map quality. These methods consider distance and statistical properties of edge pixels to estimate a performance score. The existing methods can be automated; however, they lack perceptual features. This paper presents edge map quality measure based on Just-Noticeable-Difference (JND) feature of human visual system, to compensate the shortcomings of distance-based edge measures. For this purpose, we have designed constant stimulus experiment to measure the JND value for two spatial alternative. Experimental results show that JND based distance calculation outperforms existing distance-based measures according to subjective evaluation.


title: Multi-twisted codes as free modules over principal ideal domains

abstract: We begin this chapter by introducing the simple algebraic structure of cyclic codes over finite fields. This structure undergoes a series of generalizations to present algebraic descriptions of constacyclic, quasi-cyclic (QC), quasi-twisted (QT), generalized quasi-cyclic (GQC), and multi-twisted (MT) codes. The correspondence between these codes and submodules of the free $\mathbb{F}_q[x]$-module $\left(\mathbb{F}_q[x]\right)^\ell$ is established. Thus, any of these codes corresponds to a free linear code over the principal ideal domain (PID) $\mathbb{F}_q[x]$. A basis of this code exists and is used to build a generator matrix with polynomial entries, called the generator polynomial matrix (GPM). The Hermite normal form of matrices over PIDs is exploited to achieve the reduced GPMs of MT codes. Some properties of the reduced GPM are introduced, for example, the identical equation. A formula for a GPM of the dual code $\mathcal{C}^\perp$ of a MT code is given. At this point, special attention is paid to QC codes. For a QC code $\mathcal{C}$, we define its reversed code $\mathcal{R}$. We call $\mathcal{C}$ reversible or self-dual if $\mathcal{R}=\mathcal{C}$ or $\mathcal{C}^\perp=\mathcal{C}$, respectively. A formula for a GPM of $\mathcal{R}$ is given. We characterize GPMs for QC codes that combine reversibility and self-duality/self-orthogonality. For the reader interested in running computer search for optimal codes, we show the existence of binary self-orthogonal reversible QC codes that have the best known parameters as linear codes. These results can be obtained by brute-force search using GPMs that meet the above characterization.


title: Chornobyl radiation spikes are not due to military vehicles disturbing soil

abstract: On 25th February 2022, increased gamma radiation dose rates were reported within the Chornobyl Exclusion Zone (CEZ). This coincided with Russian military vehicles entering the Ukrainian part of the CEZ from neighbouring Belarus. It was speculated that contaminated soil resuspension by vehicle movements or a leak from the Chornobyl Nuclear Power Plant (ChNPP) complex may explain these spikes in radiation dose rates. The gamma dose rate monitoring network in the CEZ provides a crucial early warning system for releases of radioactivity to the environment and is part of the international safeguards for nuclear facilities. With the potential for further military action in the CEZ and concerns over nuclear safety, it is essential that such anomalous readings are investigated. We evaluate the hypotheses suggested to explain the apparent gamma dose rate increases, demonstrating that neither military vehicle-induced soil resuspension nor a leak from the ChNPP are plausible. However, disruption of the Chornobyl base-station's reception of wireless signals from the CRMS network may potentially explain the dose rate increases recorded.


title: Spin sensitive transport in a spin liquid material: revealing a robustness of spin anisotropy

abstract: Alpha-phase (a-) RuCl_3 has emerged as a prime candidate for a quantum spin liquid (QSL) that promises exotic quasiparticles relevant for fault-tolerant quantum computation. Here, we report spin sensitive transport measurements to probe spin correlation in a-RuCl_3 using a proximal spin Hall metal platinum (Pt). Both transverse and longitudinal resistivities exhibit oscillations as function of the angle between an in-plane magnetic field and the current, akin to previously measured spin Hall magnetoresistance (SMR) in antiferromagnet/Pt heterostructures. The oscillations are observed from 1.5 T to 18 T, both within and beyond the magnetic field range where the antiferromagnetic order and QSL state are reported in a-RuCl_3. The SMR oscillations show that spins in a-RuCl3 are largely locked to an in-plane quantization axis transverse to the magnetic field, constituting a continuous-symmetry-broken state that does not necessarily represent a long-range order. This robust anisotropy of spin axis uncovers critical energy scales connected with reported QSL signatures in a-RuCl_3. Simulations suggest a predominantly antiferromagnetic correlation to moderately high magnetic-fields, that may support the SMR oscillations. The coupling of the spin states within a-RuCl_3 and Pt demonstrated in our experiment opens a transport route to exploring exotic spin phases and device functionalities of QSL materials.


title: Hybrid LMC: Hybrid Learning and Model-based Control for Wheeled Humanoid Robot via Ensemble Deep Reinforcement Learning

abstract: Control of wheeled humanoid locomotion is a challenging problem due to the nonlinear dynamics and under-actuated characteristics of these robots. Traditionally, feedback controllers have been utilized for stabilization and locomotion. However, these methods are often limited by the fidelity of the underlying model used, choice of controller, and environmental variables considered (surface type, ground inclination, etc). Recent advances in reinforcement learning (RL) offer promising methods to tackle some of these conventional feedback controller issues, but require large amounts of interaction data to learn. Here, we propose a hybrid learning and model-based controller Hybrid LMC that combines the strengths of a classical linear quadratic regulator (LQR) and ensemble deep reinforcement learning. Ensemble deep reinforcement learning is composed of multiple Soft Actor-Critic (SAC) and is utilized in reducing the variance of RL networks. By using a feedback controller in tandem the network exhibits stable performance in the early stages of training. As a preliminary step, we explore the viability of Hybrid LMC in controlling wheeled locomotion of a humanoid robot over a set of different physical parameters in MuJoCo simulator. Our results show that Hybrid LMC achieves better performance compared to other existing techniques and has increased sample efficiency


title: Comparison of Sub-Grid Scale Models for Large-Eddy Simulation using a High-Order Spectral Element Approximation of the Compressible Navier-Stokes Equations at Low Mach Number

abstract: This study aims to identify the properties, advantages, and drawbacks of some common (and some less common) sub-grid scale (SGS) models for large eddy simulation of low Mach compressible flows using high order spectral elements. The models investigated are the classical constant coefficient Smagorinsky-Lilly, the model by Vreman and two variants of a dynamic SGS (DSGS) model designed to stabilize finite and spectral elements for transport dominated problems. In particular, we compare one variant of DSGS that is based on a time-dependent residual version (R-DSGS) in contrast to a time-independent residual based scheme (T-DSGS). The SGS models are compared against the reference model by Smagorinsky and Lilly for their ability to: (i) stabilize the numerical solution, (ii) minimize undershoots and overshoots, (iii) capture/preserve discontinuities, and (iv) transfer energy across different length scales. These abilities are investigated on problems for: (1) passively advected tracers, (2) coupled, nonlinear system of equations exhibiting discontinuities, (3) gravity-driven flows in a stratified atmosphere, and (4) homogenous, isotropic turbulence. All models were able to preserve sharp discontinuities. Vreman and the R-DSGS models also reduce the undershoots and overshoots in the solution of linear and non-linear advection with sharp gradients. Our analysis shows that the R-DSGS and T-DSGS models are more robust than Vreman and Smagorinsky-Lilly for numerical stabilization of high-order spectral methods. The Smagorinsky and Vreman models are better able to resolve the finer flow structures in shear flows, while the nodal R-DSGS model shows better energy conservation. Overall, the nodal implementation of R-DSGS (in contrast to its element-based counterpart) is shown to outperform the other SGS models in most metrics listed above, and on par with respect to the remaining ones.


title: Flexible Sampling for Long-tailed Skin Lesion Classification

abstract: Most of the medical tasks naturally exhibit a long-tailed distribution due to the complex patient-level conditions and the existence of rare diseases. Existing long-tailed learning methods usually treat each class equally to re-balance the long-tailed distribution. However, considering that some challenging classes may present diverse intra-class distributions, re-balancing all classes equally may lead to a significant performance drop. To address this, in this paper, we propose a curriculum learning-based framework called Flexible Sampling for the long-tailed skin lesion classification task. Specifically, we initially sample a subset of training data as anchor points based on the individual class prototypes. Then, these anchor points are used to pre-train an inference model to evaluate the per-class learning difficulty. Finally, we use a curriculum sampling module to dynamically query new samples from the rest training samples with the learning difficulty-aware sampling probability. We evaluated our model against several state-of-the-art methods on the ISIC dataset. The results with two long-tailed settings have demonstrated the superiority of our proposed training strategy, which achieves a new benchmark for long-tailed skin lesion classification.


title: Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality

abstract: We present a novel task and dataset for evaluating the ability of vision and language models to conduct visio-linguistic compositional reasoning, which we call Winoground. Given two images and two captions, the goal is to match them correctly - but crucially, both captions contain a completely identical set of words, only in a different order. The dataset was carefully hand-curated by expert annotators and is labeled with a rich set of fine-grained tags to assist in analyzing model performance. We probe a diverse range of state-of-the-art vision and language models and find that, surprisingly, none of them do much better than chance. Evidently, these models are not as skilled at visio-linguistic compositional reasoning as we might have hoped. We perform an extensive analysis to obtain insights into how future work might try to mitigate these models' shortcomings. We aim for Winoground to serve as a useful evaluation set for advancing the state of the art and driving further progress in the field. The dataset is available at https://huggingface.co/datasets/facebook/winoground.


title: Low-Dose CT Denoising via Sinogram Inner-Structure Transformer

abstract: Low-Dose Computed Tomography (LDCT) technique, which reduces the radiation harm to human bodies, is now attracting increasing interest in the medical imaging field. As the image quality is degraded by low dose radiation, LDCT exams require specialized reconstruction methods or denoising algorithms. However, most of the recent effective methods overlook the inner-structure of the original projection data (sinogram) which limits their denoising ability. The inner-structure of the sinogram represents special characteristics of the data in the sinogram domain. By maintaining this structure while denoising, the noise can be obviously restrained. Therefore, we propose an LDCT denoising network namely Sinogram Inner-Structure Transformer (SIST) to reduce the noise by utilizing the inner-structure in the sinogram domain. Specifically, we study the CT imaging mechanism and statistical characteristics of sinogram to design the sinogram inner-structure loss including the global and local inner-structure for restoring high-quality CT images. Besides, we propose a sinogram transformer module to better extract sinogram features. The transformer architecture using a self-attention mechanism can exploit interrelations between projections of different view angles, which achieves an outstanding performance in sinogram denoising. Furthermore, in order to improve the performance in the image domain, we propose the image reconstruction module to complementarily denoise both in the sinogram and image domain.


title: A Coronagraph with a Sub-$\lambda/D$ IWA and a Moderate Spectral Bandwidth

abstract: Future high-contrast imaging spectroscopy with a large segmented telescope will be able to detect atmospheric molecules of Earth-like planets around G- or K-type main-sequence stars. Increasing the number of target planets will require a coronagraph with a small inner working angle (IWA), and wide spectral bandwidth is required if we enhance a variety of detectable atmospheric molecules. To satisfy these requirements, in this paper, we present a coronagraphic system that provides an IWA less than 1$\lambda_0 / D$ over a moderate wavelength band, where $\lambda_0$ is the design-center wavelength and $D$ denotes the full width of the rectangular aperture included in the telescope aperture. A performance simulation shows that the proposed system approximately achieves a contrast below $10^{-10}$ at 1$\lambda_0 / D$ over the wavelengths of 650--750nm. In addition, this system has a core throughput $\geq$ 10\% at input separation angles of $\sim$ 0.7--1.4$\lambda_0 / D$; to reduce telescope time, we need prior information on the target's orbit by other observational methods to a precision higher than the width of the field of view. For some types of aberration including tilt aberration, the proposed system has a sensitivity less than ever-proposed coronagraphs that have IWAs of approximately $1\lambda_0/D$. In future observations of Earth-like planets, the proposed coronagraphic system may serve as a supplementary coronagraphic system dedicated to achieving an extremely small IWA.


title: Root-N Krylov-space correction-vectors for spectral functions with the density matrix renormalization group

abstract: We propose a method to compute spectral functions of generic Hamiltonians using the density matrix renormalization group (DMRG) algorithm directly in the frequency domain, based on a modified Krylov space decomposition to compute the correction-vectors. Our approach entails the calculation of the root-N (N=2 is the standard square root) of the Hamiltonian propagator using Krylov space decomposition, and repeating this procedure N times to obtain the actual correction-vector. We show that our method greatly alleviates the burden of keeping a large bond dimension at large target frequencies, a problem found with conventional correction-vector DMRG, while achieving better computational performance at large N. We apply our method to spin and charge spectral functions of t-J and Hubbard models in the challenging two-leg ladder geometry, and provide evidence that the root-N approach reaches a much improved resolution compared to conventional correction-vector.


title: Musical Information Extraction from the Singing Voice

abstract: Music information retrieval is currently an active research area that addresses the extraction of musically important information from audio signals, and the applications of such information. The extracted information can be used for search and retrieval of music in recommendation systems, or to aid musicological studies or even in music learning. Sophisticated signal processing techniques are applied to convert low-level acoustic signal properties to musical attributes which are further embedded in a rule-based or statistical classification framework to link with high-level descriptions such as melody, genre, mood and artist type. Vocal music comprises a large and interesting category of music where the lead instrument is the singing voice. The singing voice is more versatile than many musical instruments and therefore poses interesting challenges to information retrieval systems. In this paper, we provide a brief overview of research in vocal music processing followed by a description of related work at IIT Bombay leading to the development of an interface for melody detection of singing voice in polyphony.


title: Implications of the Non-Observation of ${}^{6}{\rm Li}$ in Halo Stars for the Primordial ${}^{7}{\rm Li}$ Problem

abstract: The primordial Lithium Problem is intimately connected to the assumption that ${}^{7}{\rm Li}$ observed in metal-poor halo stars retains its primordial abundance, which lies significantly below the predictions of standard big-bang nucleosynthesis. Two key lines of evidence have argued that these stars have not significantly depleted their initial ${}^{7}{\rm Li}$: i) the lack of dispersion in Li abundances measured at low metallicity; and ii) the detection of the more fragile ${}^{6}{\rm Li}$ isotope in at least two halo stars. The purported ${}^{6}{\rm Li}$ detections were in good agreement with predictions from cosmic-ray nucleosynthesis which is responsible for the origin of ${}^{6}{\rm Li}$. This concordance left little room for depletion of ${}^{6}{\rm Li}$ depletion, and implied that the more robust ${}^{7}{\rm Li}$ largely evaded destruction. Recent (re)-observations of halo stars challenge the evidence against ${}^{7}{\rm Li}$ depletion: i) lithium abundances now show significant dispersion, and ii) sensitive ${}^{6}{\rm Li}$ searches now reveal only firm upper limits to the ${}^{6}{\rm Li}/{}^{7}{\rm Li}$ ratio. The tight new ${}^{6}{\rm Li}$ upper limits generally fall far below the predictions of cosmic-ray nucleosynthesis, implying that substantial ${}^{6}{\rm Li}$ depletion has occurred--by factors up to 50. We show that in stars with ${}^{6}{\rm Li}$ limits and thus lower bounds on ${}^{6}{\rm Li}$ depletion, an equal amount of ${}^{7}{\rm Li}$ depletion is more than sufficient to resolve the primordial ${}^{7}{\rm Li}$ Problem. This picture is consistent with stellar models in which ${}^{7}{\rm Li}$ is less depleted than ${}^{6}{\rm Li}$, and strengthen the case that the Lithium Problem has an astrophysical solution. We conclude by suggesting future observations that could test these ideas. (abridged)

categories: astro-ph.GA astro-ph.CO astro-ph.SR hep-ph


title: Towards Programming Adaptive Linear Neural Networks Through Chemical Reaction Networks

abstract: This paper is concerned with programming adaptive linear neural networks (ALNNs) using chemical reaction networks (CRNs) equipped with mass-action kinetics. Through individually programming the forward propagation and the backpropagation of ALNNs, and also utilizing the permeation walls technique, we construct a powerful CRN possessing the function of ALNNs, especially having the function of automatic computation. We also provide theoretical analysis and a case study to support our construction. The results will have potential implications for the developments of synthetic biology, molecular computer and artificial intelligence.


title: Magnet-free nonreciprocal metasurface for on-demand bi-directional phase modulation

abstract: Unconstrained by Lorentz reciprocity, nonreciprocal metasurfaces are uniquely capable of encoding distinctive optical functions on forward- and backward-propagating waves. The nonreciprocal metasurfaces reported to date require external electric or magnetic field biasing or rely on nonlinear effects, both of which are challenging to practically implement. Here, we propose and experimentally realize a magnet-free, linear, and passive nonreciprocal metasurface based on self-biased magnetic meta-atoms. Record transmittance up to 77% and operation angle reaching 64 degree are experimentally demonstrated. Moreover, on-demand bidirectional phase modulation in a "LEGO-like" manner is theoretically proposed and experimentally demonstrated, enabling a cohort of nonreciprocal functionalities such as microwave isolation, nonreciprocal beam steering, nonreciprocal focusing, and nonreciprocal holography. The design can also be extended to MHz and optical frequencies, taking advantage of the wide variety of self-biased gyrotropic materials available. We foresee that the nonreciprocal metasurfaces demonstrated in this work will have a significant practical impact for applications ranging from nonreciprocal antennas and radomes to full-duplex wireless communication and radar systems.


title: Decay Rate of $\exp(A^{-1}t)A^{-1}$ on a Hilbert Space and the Crank-Nicolson Scheme with Smooth Initial Data

abstract: This paper is concerned with the decay rate of $e^{A^{-1}t}A^{-1}$ for the generator $A$ of an exponentially stable $C_0$-semigroup on a Hilbert space. To estimate the decay rate of $e^{A^{-1}t}A^{-1}$, we apply a bounded functional calculus. Using this estimate and Lyapunov equations, we also study the quantified asymptotic behavior of the Crank-Nicolson scheme with smooth initial data. A similar argument is applied to a polynomially stable $C_0$-semigroup whose generator is normal.


title: Representations and cohomologies of differential 3-Lie algebras with any weight

abstract: The purpose of the present paper is to study representations and cohomologies of differential 3-Lie algebras with any weight. We introduce the representation of a differential 3-Lie algebra. Moreover,we develop cohomology theory of a differential 3-Lie algebra. We also depict the relationship between the cohomologies of a differential 3-Lie algebra and its associated differential Leibniz algebra with weight zero. The deformation and O-operator of differential 3-Lie algebras are also investigated. Finally, we consider abelian extensions of differential 3-Lie algebras.


title: Representations and cohomolgies of Rota-Baxter 3-Lie algebras

abstract: The goal of the present paper is to investigate representations and cohomologies of Rota-Baxter 3-Lie algebras with any weight. We introduce representations, matched pairs and Manin triples of Rota-Baxter 3-Lie algebras. Furthermore, we discuss cohomology theory of Rota-Baxter 3-Lie algebras. The deformations and central extensions of Rota-Baxter 3-Lie algebras are also studied.


title: Automated Sleep Staging via Parallel Frequency-Cut Attention

abstract: This paper proposes a novel framework for automatically capturing the time-frequency nature of electroencephalogram (EEG) signals of human sleep based on the authoritative sleep medicine guidance. The framework consists of two parts: the first part extracts informative features by partitioning the input EEG spectrograms into a sequence of time-frequency patches. The second part is constituted by an attention-based architecture to efficiently search for the correlation between partitioned time-frequency patches and defining factors of sleep stages in parallel. The proposed pipeline is validated on the Sleep Heart Health Study dataset with new state-of-the-art results for the stages wake, N2, and N3, obtaining respective F1 scores of 0.93, 0.88, and 0.87, with only EEG signals used. The proposed method also has a high inter-rater reliability of 0.80 kappa. We also visualize the correspondence between sleep staging decisions and features extracted by the proposed method, providing strong interpretability for our model.


title: FedCos: A Scene-adaptive Federated Optimization Enhancement for Performance Improvement

abstract: As an emerging technology, federated learning (FL) involves training machine learning models over distributed edge devices, which attracts sustained attention and has been extensively studied. However, the heterogeneity of client data severely degrades the performance of FL compared with that in centralized training. It causes the locally trained models of clients to move in different directions. On the one hand, it slows down or even stalls the global updates, leading to inefficient communication. On the other hand, it enlarges the distances between local models, resulting in an aggregated global model with poor performance. Fortunately, these shortcomings can be mitigated by reducing the angle between the directions that local models move in. Based on this fact, we propose FedCos, which reduces the directional inconsistency of local models by introducing a cosine-similarity penalty. It promotes the local model iterations towards an auxiliary global direction. Moreover, our approach is auto-adapt to various non-IID settings without an elaborate selection of hyperparameters. The experimental results show that FedCos outperforms the well-known baselines and can enhance them under a variety of FL scenes, including varying degrees of data heterogeneity, different number of participants, and cross-silo and cross-device settings. Besides, FedCos improves communication efficiency by 2 to 5 times. With the help of FedCos, multiple FL methods require significantly fewer communication rounds than before to obtain a model with comparable performance.


title: Topological Superconducting Vortex From Trivial Electronic Bands

abstract: Superconducting vortices are promising traps to confine non-Abelian Majorana quasi-particles. It has been widely believed that bulk-state topology, of either normal-state or superconducting ground-state wavefunctions, is crucial for enabling Majorana zero modes in solid-state systems. This common belief has shaped two major search directions for Majorana modes, in either intrinsic topological superconductors or trivially superconducting topological materials. Here we show that Majorana-carrying superconducting vortex is not exclusive to bulk-state topology, but can arise from topologically trivial quantum materials as well. We predict that the trivial bands in superconducting HgTe-class materials are responsible for inducing anomalous vortex topological physics that goes beyond any existing theoretical paradigms. A feasible scheme of strain-controlled Majorana engineering and experimental signatures for vortex Majorana modes are also discussed. Our work provides new guidelines for vortex-based Majorana search in general superconductors.

categories: cond-mat.supr-con cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el


title: Global dynamics below excited solitons for the non-radial NLS with potential

abstract: We consider the global dynamics of solutions to the $3d$ cubic nonlinear Schr\"odinger equation in the presence of an external potential, in the setting in which the equation admits both ground state solitons and excited solitons at small mass. We prove that small mass solutions with energy below that of the excited solitons either scatter to the ground states or grow their $H^1$-norm in time. In particular, we give an extension of the result of Nakanishi [19] from the radial to the non-radial setting.


title: Bayesian vector autoregressive analysis of macroeconomic and transport influences on urban traffic accidents

abstract: The macro influencing factors analysis of urban traffic safety is important to guide the direction of urban development to reduce the frequency of traffic accidents. In this study, a Bayesian vector autoregressive(BVAR) model was developed to exploring the impact of six macro-level economic and transport factors, including population, GDP, private vehicle ownership, bus ownership, subway rail mileage and road average speed on traffic accidents with the small sample size transport annual report data in Beijing. The results show that the BVAR model was suitable for time series analysis of traffic accidents in small sample situations. In macroeconomic factors, GDP growth was considered to reduce the number of traffic accidents in the long term, while population growth had a positive effect on traffic accidents in the short term. With the respect to macro-transport factors, road average speed and private vehicle ownership was perceived to increase traffic accidents in long duration, whereas bus ownership and subway rail mileage had long-term negative effects, with the greatest positive effect for road average speed and the greatest negative effect for subway rail mileage. This study suggests that government departments can reduce the number of traffic accidents by increasing investment in public transportation infrastructures, limiting private vehicles and road speed.


title: 3M: Multi-loss, Multi-path and Multi-level Neural Networks for speech recognition

abstract: Recently, Conformer based CTC/AED model has become a mainstream architecture for ASR. In this paper, based on our prior work, we identify and integrate several approaches to achieve further improvements for ASR tasks, which we denote as multi-loss, multi-path and multi-level, summarized as "3M" model. Specifically, multi-loss refers to the joint CTC/AED loss and multi-path denotes the Mixture-of-Experts(MoE) architecture which can effectively increase the model capacity without remarkably increasing computation cost. Multi-level means that we introduce auxiliary loss at multiple level of a deep model to help training. We evaluate our proposed method on the public WenetSpeech dataset and experimental results show that the proposed method provides 12.2%-17.6% relative CER improvement over the baseline model trained by Wenet toolkit. On our large scale dataset of 150k hours corpus, the 3M model has also shown obvious superiority over the baseline Conformer model. Code is publicly available at https://github.com/tencent-ailab/3m-asr.


title: Cosmological nanolensing by dense gas clouds

abstract: We study the influence of a cosmological population of dense gas clouds on distant sources, with emphasis on quasar optical variability. In addition to gravitational lensing such clouds affect flux measurements via refraction in the neutral gas and via dust extinction, leading to a variety of possible light curves even in the low optical depth limit. We classify and illustrate the types of light curves that can arise. For sources as large as quasars we show that gravitational lensing and extinction are the dominant effects, with gas refraction playing only a minor role. We find that clouds with mass ~10^{-4.5+/-0.5} M_\odot can reproduce the observed distribution of quasar variation amplitudes, but only if such clouds make up a large fraction of the closure density. In that case there may also be substantial extinction of distant optical sources, which can in principle be constrained by data on "standard candles" such as type Ia supernovae. Unfortunately that extinction is essentially grey, even when the material opacity is strongly wavelength dependent, making it difficult to distinguish from the influence of the background geometry. We propose a novel statistical test of the origin of quasar variability, based on the angular structure of the variation timescale for a large number of quasars distributed all over the sky. If quasar variability is primarily due to nanolensing that angular structure is expected to include a quadrupole term of amplitude $\sim5\%$, which ought to be measurable with future data from the Gaia mission.


title: Discovery of Nine Super Li-rich Unevolved Stars from the LAMOST Survey

abstract: Based on the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST) medium-resolution spectroscopic survey (MRS), we report the discovery of nine super Li-rich unevolved stars with A(Li) $>$ 3.8 dex. These objects show unusually high levels of lithium abundances up to three times higher than the meteoritic value of 3.3 dex, which indicates that they must have experienced a history of lithium enrichment. It is found that seven of our program stars are fast rotators with $vsini>9$ km\,s$^{-1}$, which suggests that the accretion of circumstellar matter may be the main contributor to the lithium enhancement of these unevolved stars, however, other sources cannot be excluded.


title: Reaching Consensus in the Byzantine Empire: A Comprehensive Review of BFT Consensus Algorithms

abstract: Byzantine fault-tolerant (BFT) consensus algorithms are at the core of providing safety and liveness guarantees for distributed systems that must operate in the presence of arbitrary failures. Recently, numerous new BFT algorithms have been proposed, not least due to the traction blockchain technologies have garnered in the search for consensus solutions that offer high throughput, low latency, and robust system designs. In this paper, we conduct a systematic survey of selected and distinguished BFT algorithms that have received extensive attention in academia and industry alike. We perform a qualitative comparison among all algorithms we review considering message and time complexities. Furthermore, we decompose each consensus algorithm into its constituent subprotocols for replication and view change backed by intuitive figures to illustrate the message-passing pattern. We also elaborate on the strengths and weaknesses of each algorithm as compared to the state-of-the-art approaches.


title: Supertranslation invariance of angular momentum at null infinity in double null gauge

abstract: The supertranslation invariance of the Chen-Wang-Yau (CWY) angular momentum in the Bondi-Sachs formalism/gauge was ascertained by the authors in \cite{CKWWY_evol, CWWY_atmp}. In this article, we study the corresponding problem in the double null gauge. In particular, supertranslation ambiguity of this gauge is identified and the CWY angular momentum is proven to be free of this ambiguity. A similar result is obtained for the CWY center of mass integral.


title: Muon Electric Dipole Moment as a Probe of Flavor-Diagonal CP Violation

abstract: Electric dipole moments (EDMs) of elementary particles are powerful probes of new physics with flavor-diagonal CP violation. The reported discrepancy in the muon anomalous magnetic moment motivates us to explore to what extent new physics with flavor-diagonal CP violation to address the discrepancy is probed by searches for the muon EDM. As a benchmark, we focus on a CP-violating two-Higgs-doublet model to explain the muon $g-2$ anomaly where the muon exclusively couples to one Higgs doublet. Since contributions to flavor violating processes as well as the electron EDM are suppressed, the muon EDM becomes an essential probe of the model. Our result shows that some viable parameter space leads to the muon EDM of around $d_{\mu} \simeq 6 \times 10^{-23} \, e \, \rm cm$ probed by the PSI experiment and most of the parameter space is covered by the proposed J-PARC experiment.


title: Graphene oxide 2D films integrated with nanowires and ring resonators for enhanced nonlinear optics

abstract: We report enhanced nonlinear optics in nanowires, waveguides, and ring resonators by introducing layered two-dimensional (2D) graphene oxide (GO) films through experimental demonstration. The GO films are integrated on silicon-on-insulator nanowires (SOI), high index doped silica glass, and silicon nitride (SiN) waveguides and microring resonators (MRRs), to demonstrate an improved optical nonlinearity including Kerr nonlinearity and four-wave mixing (FWM). By using a large-area, transfer-free, layer-by-layer GO coating method with photolithography and lift-off processes, we integrate GO films on these complementary metal-oxide-semiconductor (CMOS)-compatible devices. For SOI nanowires, significant spectral broadening of optical pulses in GO-coated SOI nanowires induced by self-phase modulation (SPM) is observed, achieving a high spectral broadening factor of 4.34 for a device with a patterned film including 10 layers of GO. A significant enhancement in the nonlinear figure of merit (FOM) for silicon nanowires by a factor of 20 is also achieved, resulting in a FOM > 5. For Hydex and SiN waveguides, enhanced FWM in the GO-coated waveguides is achieved, where conversion efficiency (CE) enhancements of up to 6.9 dB and 9.1 dB relative to the uncoated waveguides. For MRRs, an increase of up to ~10.3 dB in the FWM CE is achieved due to the resonant enhancement effect. These results reveal the strong potential of GO films to improve the nonlinear optics of nanowires, waveguides, and ring resonators.


title: The Eel Pulsar Wind Nebula: a PeVatron-Candidate Origin for HAWC J1826-128 and HESS J1826-130

abstract: HAWC J1826-128 is one of the brightest Galactic TeV gamma-ray sources detected by the High Altitude Water Cherenkov (HAWC) Observatory, with photon energies extending up to nearly $\sim$100 TeV. This HAWC source spatially coincides with the H.E.S.S. TeV source HESS J1826-130 and the "Eel" pulsar wind nebula (PWN), which is associated with the GeV pulsar PSR J1826-1256. In the X-ray band, Chandra and XMM-Newton revealed that the Eel PWN is composed of both a compact nebula ($\sim$15") and diffuse X-ray emission ($\sim$6'$\times$2') extending away from the pulsar. Our NuSTAR observation detected hard X-ray emission from the compact PWN up to $\sim$20 keV and evidence of the synchrotron burn-off effect. In addition to the spatial coincidence between HESS J1826-130 and the diffuse X-ray PWN, our multi-wavelength spectral energy distribution (SED) analysis using X-ray and gamma-ray data establishes a leptonic origin of the TeV emission associated with the Eel PWN. Furthermore, our evolutionary PWN SED model suggests (1) a low PWN B-field of $\sim$1 $\mu$G, (2) a significantly younger pulsar age ($t \sim5.7$ kyr) than the characteristic age ($\tau= 14.4$ kyr) and (3) a maximum electron energy of $E_{max} = 2$ PeV. The low B-field as well as the putative supersonic motion of the pulsar may account for the asymmetric morphology of the diffuse X-ray emission. Our results suggest that the Eel PWN may be a leptonic PeVatron particle accelerator powered by the $\sim$6-kyr-old pulsar PSR J1826-1256 with a spin-down power of $3.6 \times 10^{36}$ erg s$^{-1}$.


title: Energy-sensitive scatter estimation and correction for spectral x-ray imaging with photon-counting detectors

abstract: As photon counting detectors are being explored for medical and industrial imaging applications, there is a critical need to understand spectral characteristics of scattered x-ray photons. Scattered radiation is detrimental to x-ray imaging by reducing image quality and quantitative accuracy. While various scatter correction techniques have been proposed for x-ray imaging with conventional energy-integrating detectors, additional efforts are required to develop approaches for spectral x-ray imaging with energy-resolving PCDs. We show the benefits of accurate scatter estimation and correction for each energy bin when using a photon counting detector. We propose a scatter estimation model that accounts for the energy-dependent scatter characteristics in projection x-ray imaging. This can then be used to restore quantitative accuracy for spectral x-ray imaging with PCDs. Results are shown in the context of contrast-enhanced spectral mammography using dual-energy subtraction to digitally isolate iodine targets. In the presence of scatter, the projected iodine densities are increasingly underestimated as the object thickness increases. The energysensitive scatter correction improves the iodine density estimation. These results suggest that our scatter estimation model can accurately account for the energy-dependent scatter distribution, which can be an effective tool for scatter compensation in spectral x-ray imaging. Implementing this scatter estimation model does not require any modifications to the acquisition parameters and is transferable to other x-ray imaging applications such as tomosynthesis and CT.


title: Distributed Statistical Min-Max Learning in the Presence of Byzantine Agents

abstract: Recent years have witnessed a growing interest in the topic of min-max optimization, owing to its relevance in the context of generative adversarial networks (GANs), robust control and optimization, and reinforcement learning. Motivated by this line of work, we consider a multi-agent min-max learning problem, and focus on the emerging challenge of contending with worst-case Byzantine adversarial agents in such a setup. By drawing on recent results from robust statistics, we design a robust distributed variant of the extra-gradient algorithm - a popular algorithmic approach for min-max optimization. Our main contribution is to provide a crisp analysis of the proposed robust extra-gradient algorithm for smooth convex-concave and smooth strongly convex-strongly concave functions. Specifically, we establish statistical rates of convergence to approximate saddle points. Our rates are near-optimal, and reveal both the effect of adversarial corruption and the benefit of collaboration among the non-faulty agents. Notably, this is the first paper to provide formal theoretical guarantees for large-scale distributed min-max learning in the presence of adversarial agents.


title: Two flags in a semimodular lattice generate an antimatroid

abstract: A basic property in a modular lattice is that any two flags generate a distributive sublattice. It is shown (Abels 1991, Herscovic 1998) that two flags in a semimodular lattice no longer generate such a good sublattice, whereas shortest galleries connecting them form a relatively good join-sublattice. In this note, we sharpen this investigation to establish an analogue of the two-flag generation theorem for a semimodular lattice. We consider the notion of a modular convex subset, which is a subset closed under the join and meet only for modular pairs, and show that the modular convex hull of two flags in a semimodular lattice of rank $n$ is isomorphic to a union-closed family on $[n]$. This family uniquely determines an antimatroid, which coincides with the join-sublattice of shortest galleries of the two flags.


title: Separation of concerning things: a simpler basis for defining and programming with the C/C++ memory model (extended version)

abstract: The C/C++ memory model provides an interface and execution model for programmers of concurrent (shared-variable) code. It provides a range of mechanisms that abstract from underlying hardware memory models -- that govern how multicore architectures handle concurrent accesses to main memory -- as well as abstracting from compiler transformations. The C standard describes the memory model in terms of cross-thread relationships between events, and has been influenced by several research works that are similarly based. In this paper we provide a thread-local definition of the fundamental principles of the C memory model, which, for concise concurrent code, serves as a basis for relatively straightforward reasoning about the effects of the C ordering mechanisms. We argue that this definition is more practical from a programming perspective and is amenable to analysis by already established techniques for concurrent code. The key aspect is that the memory model definition is separate to other considerations of a rich programming language such as C, in particular, expression evaluation and optimisations, though we show how to reason about those considerations in the presence of C concurrency. A major simplification of our framework compared to the description in the C standard and related work in the literature is separating out considerations around the "lack of multicopy atomicity", a concept that is in any case irrelevant to developers of code for x86, Arm, RISC-V or SPARC architectures. We show how the framework is convenient for reasoning about well-structured code, and for formally addressing unintuitive behaviours such as "out-of-thin-air" writes.


title: Universal Treatment of Reduction for One-Loop Integrals in Projective Space

abstract: Recently a nice work about the understanding of one-loop integrals has been done in [1] using the tricks of the projective space language associated to their Feynman parametrization. We find this language is also very suitable to deal with the reduction problem of one-loop integrals with general tensor structures as well as propagators with arbitrary higher powers. In this paper, we show that how to combine Feynman parametrization and embedding formalism to give a universal treatment of reductions for general one-loop integrals, even including the degenerated cases, such as the vanishing Gram determinant. Results from this method can be written in a compact and symmetric form.


title: Efficient Community Detection in Large-Scale Dynamic Networks Using Topological Data Analysis

abstract: In this paper, we propose a method that extends the persistence-based topological data analysis (TDA) that is typically used for characterizing shapes to general networks. We introduce the concept of the community tree, a tree structure established based on clique communities from the clique percolation method, to summarize the topological structures in a network from a persistence perspective. Furthermore, we develop efficient algorithms to construct and update community trees by maintaining a series of clique graphs in the form of spanning forests, in which each spanning tree is built on an underlying Euler Tour tree. With the information revealed by community trees and the corresponding persistence diagrams, our proposed approach is able to detect clique communities and keep track of the major structural changes during their evolution given a stability threshold. The results demonstrate its effectiveness in extracting useful structural insights for time-varying social networks.


title: Improved proof-by-contraction method and relative homologous entropy inequalities

abstract: The celebrated holographic entanglement entropy triggered investigations on the connections between quantum information theory and quantum gravity. An important achievement is that we have gained more insights into the quantum states. It allows us to diagnose whether a given quantum state is a holographic state, a state whose bulk dual admits semiclassical geometrical description. The effective tool of this kind of diagnosis is holographic entropy cone (HEC), an entropy space bounded by holographic entropy inequalities allowed by the theory. To fix the HEC and to prove a given holographic entropy inequality, a proof-by-contraction technique has been developed. This method heavily depends on a contraction map $f$, which is very difficult to construct especially for more-region ($n\geq 4$) cases. In this work, we develop a general and effective rule to rule out most of the cases such that $f$ can be obtained in a relatively simple way. In addition, we extend the whole framework to relative homologous entropy, a generalization of holographic entanglement entropy that is suitable for characterizing the entanglement of mixed states.


title: MultiAuto-DeepONet: A Multi-resolution Autoencoder DeepONet for Nonlinear Dimension Reduction, Uncertainty Quantification and Operator Learning of Forward and Inverse Stochastic Problems

abstract: A new data-driven method for operator learning of stochastic differential equations(SDE) is proposed in this paper. The central goal is to solve forward and inverse stochastic problems more effectively using limited data. Deep operator network(DeepONet) has been proposed recently for operator learning. Compared to other neural networks to learn functions, it aims at the problem of learning nonlinear operators. However, it can be challenging by using the original model to learn nonlinear operators for high-dimensional stochastic problems. We propose a new multi-resolution autoencoder DeepONet model referred to as MultiAuto-DeepONet to deal with this difficulty with the aid of convolutional autoencoder. The encoder part of the network is designed to reduce the dimensionality as well as discover the hidden features of high-dimensional stochastic inputs. The decoder is designed to have a special structure, i.e. in the form of DeepONet. The first DeepONet in decoder is designed to reconstruct the input function involving randomness while the second one is used to approximate the solution of desired equations. Those two DeepONets has a common branch net and two independent trunk nets. This architecture enables us to deal with multi-resolution inputs naturally. By adding $L_1$ regularization to our network, we found the outputs from the branch net and two trunk nets all have sparse structures. This reduces the number of trainable parameters in the neural network thus making the model more efficient. Finally, we conduct several numerical experiments to illustrate the effectiveness of our proposed MultiAuto-DeepONet model with uncertainty quantification.


title: Equidistribution of non-uniformly stretching translates of shrinking smooth curves and weighted Dirichlet approximation

abstract: We show that under the action of $\mathrm{diag}(e^{nt},e^{-r_1(t)},\ldots,e^{-r_n(t)})\in\mathrm{SL}(n+1,\mathbb{R})$, where $r_i(t)\to\infty$, on the space of unimodular lattices in $\mathbb{R}^{n+1}$, the translates of any fixed-sized piece of a `non-degenerate' smooth curve, or a shrinking piece of size $e^{-t}$ about almost any point of the curve, get equidistributed in the space as $t\to\infty$. From this, it follows that the weighted Dirichlet approximation theorem cannot be improved for almost all points on any non-degenerate $C^{2n}$ curve in $\mathbb{R}^n$. This result extends the corresponding result for analytic curves due to Shah (2009) and answers some questions inspired by the work of Davenport and Schmidt (1969) and Kleinbock and Weiss (2008).


title: 3D Perception based Imitation Learning under Limited Demonstration for Laparoscope Control in Robotic Surgery

abstract: Automatic laparoscope motion control is fundamentally important for surgeons to efficiently perform operations. However, its traditional control methods based on tool tracking without considering information hidden in surgical scenes are not intelligent enough, while the latest supervised imitation learning (IL)-based methods require expensive sensor data and suffer from distribution mismatch issues caused by limited demonstrations. In this paper, we propose a novel Imitation Learning framework for Laparoscope Control (ILLC) with reinforcement learning (RL), which can efficiently learn the control policy from limited surgical video clips. Specially, we first extract surgical laparoscope trajectories from unlabeled videos as the demonstrations and reconstruct the corresponding surgical scenes. To fully learn from limited motion trajectory demonstrations, we propose Shape Preserving Trajectory Augmentation (SPTA) to augment these data, and build a simulation environment that supports parallel RGB-D rendering to reinforce the RL policy for interacting with the environment efficiently. With adversarial training for IL, we obtain the laparoscope control policy based on the generated rollouts and surgical demonstrations. Extensive experiments are conducted in unseen reconstructed surgical scenes, and our method outperforms the previous IL methods, which proves the feasibility of our unified learning-based framework for laparoscope control.