title: System Identification in Multi-Actuator Hard Disk Drives with Colored Noises using Observer/Kalman Filter Identification (OKID) Framework

abstract: Multi Actuator Technology in Hard Disk drives (HDDs) equips drives with two dual stage actuators (DSA) each comprising of a voice coil motor (VCM) actuator and a piezoelectric micro actuator (MA) operating on the same pivot point. Each DSA is responsible for controlling half of the drive's arms. As both the DSAs operate independently on the same pivot timber, the control forces and torques generated by one affect the operation of the other. The feedback controllers might not completely reject these transferred disturbances and a need to design feedforward controllers arises, which require a good model of the disturbance process. The usual system identification techniques produce a biased estimate because of the presence of the runout which is a colored noise. In this paper, we use the OKID framework to estimate this disturbance cross transfer function from the VCM control input of one DSA to the output of the other DSA from the collected time series data corrupted by colored noise.


title: A General Structural Order Parameter for the Amorphous Solidification of a Supercooled Liquid

abstract: The persistent problem posed by the glass transition is to develop a general atomic level description of a solidification process that is not associated with any change in the symmetry of the atomic structure. The answer proposed in this paper is t measure a configuration's capacity to restrain the motion of the constituent atoms. Here we show that the instantaneous normal modes can be used to define a measure of atomic restraint that accounts for the difference between fragile and strong liquids and the collective length scale of the supercooled liquid. These results represent a significant simplification of the description of amorphous solidification and provide a powerful systematic treatment of the influence of microscopic factors on the formation of the amorphous solid.


title: Inferring the shape of data: A probabilistic framework for analyzing experiments in the natural sciences

abstract: A critical step in data analysis for many different types of experiments is the identification of features with theoretically defined shapes in N-dimensional datasets; examples of this process include finding peaks in multi-dimensional molecular spectra or emitters in fluorescence microscopy images. Identifying such features involves determining if the overall shape of the data is consistent with an expected shape, however, it is generally unclear how to quantitatively make this determination. In practice, many analysis methods employ subjective, heuristic approaches, which complicates the validation of any ensuing results - especially as the amount and dimensionality of the data increase. Here, we present a probabilistic solution to this problem by using Bayes' rule to calculate the probability that the data has any one of several potential shapes. This probabilistic approach may be used to objectively compare how well different theories describe a dataset, identify changes between datasets, and detect features within data using a corollary method called Bayesian Inference-based Template Search (BITS); several proof-of-principle examples are provided. Altogether, this mathematical framework serves as an automated 'engine' capable of computationally executing analysis decisions currently made by visual inspection across the sciences.


title: A Markov-Modulated (s, S) Inventory System with Repeated Calls and Blocked Demands

abstract: In this article, we consider a continuous review (s, S) inventory system with failures of demand fulfillment (service) modeled as a Markov-modulated retrial queueing system. The inventory system features a single product that experiences Markovian inter-demand and service intervals with random service interruptions and instantaneous replenishments. A recently developed criterion for the ergodicity of a class of discrete-time level-dependent-quasi-birth-and-death (LDQBD) processes with convergent transition matrix rows is applied to the jump chain of the process in order to elicit a closed-form traffic-intensity formula. An analytic solution for the steady-state average minimum cost is provided.


title: Mathematical properties and finite-population correction for the Wilson score interval

abstract: In this paper we examine the properties of the Wilson score interval, used for inferences for an unknown binomial proportion parameter. We examine monotonicity and consistency properties of the interval and we generalise it to give two alternative forms for inferences undertaken in a finite population. We discuss the nature of the "finite population correction" in these generalised intervals and examine their monotonicity and consistency properties. This analysis gives the appropriate confidence interval for an unknown population proportion or unknown unsampled proportion in a finite or infinite population. We implement the generalised confidence interval forms in a user-friendly function in R.


title: Macroscopic delayed-choice and retrocausality: quantum eraser, Leggett-Garg and dimension witness tests with cat states

abstract: We propose delayed choice experiments carried out with macroscopic qubits, realised as macroscopically-distinct coherent states $|\alpha\rangle$ and $|-\alpha\rangle$. Quantum superpositions of $|\alpha\rangle$ and $|-\alpha\rangle$ are created via a unitary interaction $U(\theta)$ based on a nonlinear Hamiltonian. Macroscopic delayed-choice experiments give a compelling reason to develop interpretations not allowing macroscopic retrocausality (MrC). We therefore consider weak macroscopic realism (wMR), which specifies a hidden variable $\lambda_{\theta}$ to determine the macroscopic qubit value (analogous to 'which-way' information), independent of any future measurement setting $\phi$. Using entangled states, we demonstrate a quantum eraser where the choice to measure a which-way or wave-type property is delayed. Consistency with wMR is possible, if we interpret the macroscopic qubit value to be determined by $\lambda_{\theta}$ without specification of the state at the level of $\hbar$, where fringes manifest. We then demonstrate violations of a delayed-choice Leggett-Garg inequality, and of the dimension witness inequality applied to the Wheeler-Chaves-Lemos-Pienaar experiment, where measurements need only distinguish the macroscopic qubit states. This negates all two-dimensional non-retrocausal models, thereby suggesting MrC. However, one can interpret consistently with wMR, thus avoiding MrC, by noting extra dimensions, and by noting that the violations require further unitary dynamics $U$ for each system. The violations are then explained as failure of deterministic macroscopic realism (dMR), which specifies validity of $\lambda_{\theta}$ prior to the dynamics $U(\theta)$ determining the measurement setting $\theta$. Finally, although there is consistency with wMR for macroscopic observations, we demonstrate EPR paradoxes at a microscopic level.


title: Searching for orbital decay in a heartbeat star system KIC 3766353

abstract: Theory suggests that the orbits of a large fraction of binary systems, including planet-star binary systems, shrink by few orders of magnitude after formation. But so far, only one hot Jupiter with tidally-driven orbital decay has been found by transit timing variations. We propose to search for orbital decay companions in heartbeat star systems because the orbital angular momentum is effectively transferred to the host star causing tidal dissipation. KIC 3766353 is one of the heartbeat stars with tidally excited oscillations. We acquired the primary and the secondary eclipse time variations from the \textit{Kepler} photometric light curves. Timing analysis shows that KIC 3766353 is a hierarchical triple system with a hidden third body and a red dwarf (mass $0.35\ M_{\odot}$, radius $0.34\ R_{\odot}$) in its inner orbit. The minimum mass of the third body is $\sim 0.26 \ M_{\odot}$, and the distance from the inner orbital is $\sim 111.4 \ R_{\odot}$. The period decay rate of the red dwarf is approximately 358 ms yr$^{-1}$. The combined effects of the light-travel time and the orbital decay lead to the observed timing variations. Future monitoring with a long time base-line observations is required to delve into the contributions of these two effects.


title: Observation of high efficiency Betatron radiation from femtosecond petawatt laser irradiated near critical plasmas

abstract: We present an experimental demonstration of high conversion efficiency Betatron x-ray radiation from petawatt laser irradiated near critical plasmas. Direct laser acceleration serves as the dominant regime when laser pulse of ~5e20 W/cm2 intensity is focused into plasmas with electron density of 3e20 /cm3. Electron beam with a charge of ~35 nC is accelerated up to a maximum energy of 70 MeV and emit x-rays when oscillating in the laser field. The deduced energy conversion efficiency from laser to x-rays is up to 1e-4, orders of magnitude higher than other betatron regimes. Enhancement of acceleration and radiation with sharp plasma density boundary is also obtained and further interpretated with 2D particle-in-cell simulations.


title: Symmetry-enforced nodal lines in the band structures of vacancy-engineered graphene

abstract: We elaborate that single-layer graphene with periodic vacancies can have a band structure containing nodal lines or nodal loops, opening the possibility of graphene-based electronic or spintronic devices with novel functionalities. The principle is that by removing carbon atoms such that the lattice becomes nonsymmorphic, every two sublattices in the unit cell will map to each other under glide plane operation. This mapping yields degenerate eigenvalues for the glide plane operation, which guarantees that the energy bands must stick together pairwise at a boundary of the Brillouin zone. Moving away from the Brillouin zone boundary causes the symmetry-enforced nodal lines to split, resulting in accidental nodal lines caused by the crossings of the split bands. Moreover, the density of states at the Fermi level may be dramatically enhanced if the nodal lines crosses the Fermi level. The nodal lines occur a variety of vacancy configurations even in the presence of Rashba spin-orbit coupling. Finally, our theory also explains the nodal loops surrounding the entire Brillouin zone of a chevron-type nanoporous graphene fabricated in a recent experiment.


title: Efficient Force Estimation for Continuum Robot

abstract: External contact force is one of the most significant information for the robots to model, control, and safely interact with external objects. For continuum robots, it is possible to estimate the contact force based on the measurements of robot configurations, which addresses the difficulty of implementing the force sensor feedback on the robot body with strict dimension constraints. In this paper, we use local curvatures measured from fiber Bragg grating sensors (FBGS) to estimate the magnitude and location of single or multiple external contact forces. A simplified mechanics model is derived from Cosserat rod theory to compute continuum robot curvatures. Least-square optimization is utilized to estimate the forces by minimizing errors between computed curvatures and measured curvatures. The results show that the proposed method is able to accurately estimate the contact force magnitude (error: 5.25\% -- 12.87\%) and locations (error: 1.02\% -- 2.19\%). The calculation speed of the proposed method is validated in MATLAB. The results indicate that our approach is 29.0 -- 101.6 times faster than the conventional methods. These results indicate that the proposed method is accurate and efficient for contact force estimations.


title: Singularities of serial robots: Identification and distance computation using geometric algebra

abstract: The singularities of serial robotic manipulators are those configurations in which the robot loses the ability to move in at least one direction. Hence, their identification is fundamental to enhance the performance of current control and motion planning strategies. While classical approaches entail the computation of the determinant of either a 6x n or nxn matrix for an n degrees of freedom serial robot, this work addresses a novel singularity identification method based on modelling the twists defined by the joint axes of the robot as vectors of the six-dimensional and three-dimensional geometric algebras. In particular, it consists of identifying which configurations cause the exterior product of these twists to vanish. In addition, since rotors represent rotations in geometric algebra, once these singularities have been identified, a distance function is defined in the configuration space C such that its restriction to the set of singular configurations S allows us to compute the distance of any configuration to a given singularity. This distance function is used to enhance how the singularities are handled in three different scenarios, namely motion planning, motion control and bilateral teleoperation.


title: Rendering Spatial Sound for Interoperable Experiences in the Audio Metaverse

abstract: Interactive audio spatialization technology previously developed for video game authoring and rendering has evolved into an essential component of platforms enabling shared immersive virtual experiences for future co-presence, remote collaboration and entertainment applications. New wearable virtual and augmented reality displays employ real-time binaural audio computing engines rendering multiple digital objects and supporting the free navigation of networked participants or their avatars through a juxtaposition of environments, real and virtual, often referred to as the Metaverse. These applications require a parametric audio scene programming interface to facilitate the creation and deployment of shared, dynamic and realistic virtual 3D worlds on mobile computing platforms and remote servers. We propose a practical approach for designing parametric 6-degree-of-freedom object-based interactive audio engines to deliver the perceptually relevant binaural cues necessary for audio/visual and virtual/real congruence in Metaverse experiences. We address the effects of room reverberation, acoustic reflectors, and obstacles in both the virtual and real environments, and discuss how such effects may be driven by combinations of pre-computed and real-time acoustic propagation solvers. We envision an open scene description model distilled to facilitate the development of interoperable applications distributed across multiple platforms, where each audio object represents, to the user, a natural sound source having controllable distance, size, orientation, and acoustic radiation properties.


title: Analysis of COVID-19 infection waves in Japan by Avrami equation

abstract: Last time, an attempt was made to analyze the first wave of COVID-19 in Japan from February to May 2020 by the Avrami equation. This time, all infection waves that occurred repeatedly from February 2020 to September 2021 were simulated by developing the last work. The entire waveform was basically simulated by the superposition of five major waves, and the least-squares method was applied to each wave to determine the parameters of the equation. Despite the simulation using the single equation assuming that the parameters were constants, the accuracy of the simulated cumulative infection D was as good as 95%CI / D < 2.5% after the second wave when D exceeded 10,000. Since the simulation was highly accurate, it was effective in predicting the number of infections in the near future and in considering the cause of changes in the number of infections observed as the detailed structure of the waveform.


title: Statically Bounded-Memory Delayed Sampling for Probabilistic Streams

abstract: Probabilistic programming languages aid developers performing Bayesian inference. These languages provide programming constructs and tools for probabilistic modeling and automated inference. Prior work introduced a probabilistic programming language, ProbZelus, to extend probabilistic programming functionality to unbounded streams of data. This work demonstrated that the delayed sampling inference algorithm could be extended to work in a streaming context. ProbZelus showed that while delayed sampling could be effectively deployed on some programs, depending on the probabilistic model under consideration, delayed sampling is not guaranteed to use a bounded amount of memory over the course of the execution of the program. In this paper, we present conditions on a probabilistic program's execution under which delayed sampling will execute in bounded memory. The two conditions are dataflow properties of the core operations of delayed sampling: the $m$-consumed property and the unseparated paths property. A program executes in bounded memory under delayed sampling if, and only if, it satisfies the $m$-consumed and unseparated paths properties. We propose a static analysis that abstracts over these properties to soundly ensure that any program that passes the analysis satisfies these properties, and thus executes in bounded memory under delayed sampling.


title: EllipseNet: Anchor-Free Ellipse Detection for Automatic Cardiac Biometrics in Fetal Echocardiography

abstract: As an important scan plane, four chamber view is routinely performed in both second trimester perinatal screening and fetal echocardiographic examinations. The biometrics in this plane including cardio-thoracic ratio (CTR) and cardiac axis are usually measured by sonographers for diagnosing congenital heart disease. However, due to the commonly existing artifacts like acoustic shadowing, the traditional manual measurements not only suffer from the low efficiency, but also with the inconsistent results depending on the operators' skills. In this paper, we present an anchor-free ellipse detection network, namely EllipseNet, which detects the cardiac and thoracic regions in ellipse and automatically calculates the CTR and cardiac axis for fetal cardiac biometrics in 4-chamber view. In particular, we formulate the network that detects the center of each object as points and regresses the ellipses' parameters simultaneously. We define an intersection-over-union loss to further regulate the regression procedure. We evaluate EllipseNet on clinical echocardiogram dataset with more than 2000 subjects. Experimental results show that the proposed framework outperforms several state-of-the-art methods. Source code will be available at https://git.openi.org.cn/capepoint/EllipseNet .


title: General Theory of Music by Icosahedron 3: Musical invariant and Melakarta raga

abstract: Raga is a central musical concept in South Asia, especially India, and we investigate connections between Western classical music and Melakarta raga that is a raga in Karnatak (south Indian) classical music, through musical icosahedron. In our previous study, we introduced some kinds of musical icosahedra connecting various musical concepts in Western music: chromatic/whole tone musical icosahedra, Pythagorean/whole tone musical icosahedra, and exceptional musical icosahedra. In this paper, first, we introduce kinds of musical icosahedra that connect the above musical icosahedra through two kinds of permutations of 12 tones: inter-permutations and intra-permutations, and we call them intermediate musical icosahedra. Next, we define a neighboring number as a number of pairs of neighboring two tones in a given scale that neighbor each other on a given musical icosahedron, and we also define a musical invariant as a linear combination of the neighboring numbers. We find there exists a pair of a musical invariant and scales that is constant for some musical icosahedra and analyze their mathematical structure. Last, we define an extension of a given scale by the inter-permutations of a given musical icosahedron: the permutation-extension. Then, we show that the permutation-extension of the C major scale by Melakarta raga musical icosahedra that are four of the intermediate musical icosahedra from the type 1 chromatic/whole tone musical icosahedron to the type 1' Pythagorean/whole tone musical icosahedron, is a set of all the scales included in Melakarta raga. There exists a musical invariant that is constant for all the musical icosahedra corresponding to the scales of Melakarta raga, and we obtained a diagram representation of those scales characterizing the musical invariant.


title: Unified Network Equation for Both Normal RLC Circuits and Josephson Junction Circuits

abstract: Josephson junction circuits, such as superconducting quantum interference devices (SQUIDs) and single-flux-quantum (SFQ) circuits, have been successfully applied in both analog and digital electronic domains. They are considered to be distinct from the normal resistor-inductor-capacitor (RLC) circuits, due to the superconducting physics. To bridge the gap between Josephson junction circuits and conventional RLC circuits, we introduce a magnetic-flux-generator (MFG) model to unify the definitions of Josephson junctions and normal noninductive components, and transform their circuits uniformly into MFG networks. A general network equation for both superconducting and normal MFG networks is derived. It shows that, Josephson junction circuits are the superconducting RLC networks modulated by Josephson currents; their analysis and simulation are unified with that of the normal RLC circuits by solving the general network equation.


title: Reputation dependent pricing strategy: analysis based on a Chinese C2C marketplace

abstract: Most online markets establish reputation systems to assist building trust between sellers and buyers. Sellers' reputations not only provide guidelines for buyers but may also inform sellers their optimal pricing strategy. In this research, we assumed two types of buyer: informed buyers and uninformed buyers. Informed buyers know more about the reputation about the seller but may incur a search cost. Then we developed a benchmark model and a competition model. We found that high reputation sellers and low reputation sellers adapt different pricing strategy depending on the informativeness of buyers and the competition among sellers. With a large proportion of informed buyers, high reputation sellers may charge lower price than low reputation sellers, which exists a negative price premium effect, in contrast to conclusions of some previous studies. Empirical findings were in consistence with our theoretical models. We collected data of five categories of products, televisions, laptops, cosmetics, shoes, and beverages, from Taobao, a leading C2C Chinese online market. Negative price premium effect was observed for TVs, laptops, and cosmetics; price premium effect was observed for beverages; no significant trend was observed for shoes. We infer product value and market complexity are the main factors of buyer informativeness.


title: A Poincar\'e-Bendixson theorem for flows with arbitrarily many singular points

abstract: The Poincar\'e-Bendixson theorem is one of the most fundamental tools to capture the limit behaviors of orbits of flows. It was generalized and was applied to various phenomena in dynamical systems, differential equations, foliations, group actions, translation lines, and semi-dynamical systems. On the other hand, though the no-slip boundary condition is a fundamental condition in differential equations and appears in various fluid phenomena and since Lakes of Wada attractors naturally occur in discrete and continuous real dynamical systems and complex dynamics, no generalizations of the Poincar\'e-Bendixson theorem can be applied to any differential equations with no-slip boundary condition on surfaces with boundary and flows with Lakes of Wada attractors. To analyze them, we generalize the Poincar\'e-Bendixson theorem into one for flows with arbitrarily many singular points on possibly non-compact surfaces by using methods of foliation theory and general topology. Moreover, the generalization implies topological characterizations of recurrence, which are generalizations of the Ma{\v \i}er's description of recurrence. In addition, we construct a blow-up operation that makes $\omega$-limit sets not arcwise-connected.


title: A new Lagrange multiplier approach for constructing structure-preserving schemes, II. bound preserving

abstract: In the second part of this series, we use the Lagrange multiplier approach proposed in the first part \cite{CheS21} to construct efficient and accurate bound and/or mass preserving schemes for a class of semi-linear and quasi-linear parabolic equations. We establish stability results under a general setting, and carry out an error analysis for a second-order bound preserving scheme with a hybrid spectral discretization in space. We apply our approach to several typical PDEs which preserve bound and/or mass, also present ample numerical results to validate our approach.


title: Explainability Pitfalls: Beyond Dark Patterns in Explainable AI

abstract: To make Explainable AI (XAI) systems trustworthy, understanding harmful effects is just as important as producing well-designed explanations. In this paper, we address an important yet unarticulated type of negative effect in XAI. We introduce explainability pitfalls(EPs), unanticipated negative downstream effects from AI explanations manifesting even when there is no intention to manipulate users. EPs are different from, yet related to, dark patterns, which are intentionally deceptive practices. We articulate the concept of EPs by demarcating it from dark patterns and highlighting the challenges arising from uncertainties around pitfalls. We situate and operationalize the concept using a case study that showcases how, despite best intentions, unsuspecting negative effects such as unwarranted trust in numerical explanations can emerge. We propose proactive and preventative strategies to address EPs at three interconnected levels: research, design, and organizational.


title: Venc Design and Velocity Estimation for Phase Contrast MRI

abstract: In phase-contrast magnetic resonance imaging (PC-MRI), spin velocity contributes to the phase measured at each voxel. Therefore, estimating velocity from potentially wrapped phase measurements is the task of solving a system of noisy congruence equations. We propose Phase Recovery from Multiple Wrapped Measurements (PRoM) as a fast, approximate maximum likelihood estimator of velocity from multi-coil data with possible amplitude attenuation due to dephasing. The estimator can recover the fullest possible extent of unambiguous velocities, which can greatly exceed twice the highest venc. The estimator uses all pairwise phase differences and the inherent correlations among them to minimize the estimation error. Correlations are directly estimated from multi-coil data without requiring knowledge of coil sensitivity maps, dephasing factors, or the actual per-voxel signal-to-noise ratio. Derivation of the estimator yields explicit probabilities of unwrapping errors and the probability distribution for the velocity estimate; this, in turn, allows for optimized design of the phase-encoded acquisition. These probabilities are also incorporated into spatial post-processing to further mitigate wrapping errors. Simulation, phantom, and in vivo results for three-point PC-MRI acquisitions validate the benefits of reduced estimation error, increased recovered velocity range, optimized acquisition, and fast computation. A phantom study at 1.5T demonstrates 48.5% decrease in root mean squared error using PRoM with post-processing versus a conventional "dual-venc" technique. Simulation and 3T in vivo results likewise demonstrate the proposed benefits.


title: Physics-informed Convolutional Neural Networks for Temperature Field Prediction of Heat Source Layout without Labeled Data

abstract: Recently, surrogate models based on deep learning have attracted much attention for engineering analysis and optimization. As the construction of data pairs in most engineering problems is time-consuming, data acquisition is becoming the predictive capability bottleneck of most deep surrogate models, which also exists in surrogate for thermal analysis and design. To address this issue, this paper develops a physics-informed convolutional neural network (CNN) for the thermal simulation surrogate. The network can learn a mapping from heat source layout to the steady-state temperature field without labeled data, which equals solving an entire family of partial difference equations (PDEs). To realize the physics-guided training without labeled data, we employ the heat conduction equation and finite difference method to construct the loss function. Since the solution is sensitive to boundary conditions, we properly impose hard constraints by padding in the Dirichlet and Neumann boundary conditions. In addition, the neural network architecture is well-designed to improve the prediction precision of the problem at hand, and pixel-level online hard example mining is introduced to overcome the imbalance of optimization difficulty in the computation domain. The experiments demonstrate that the proposed method can provide comparable predictions with numerical method and data-driven deep learning models. We also conduct various ablation studies to investigate the effectiveness of the network component and training methods proposed in this paper.


title: Preliminary analysis on the noise characteristics of MWISP data

abstract: Noise is a significant part within a millimeter-wave molecular line datacube. Analyzing the noise improves our understanding of noise characteristics, and further contributes to scientific discoveries. We measure the noise level of a single datacube from MWISP and perform statistical analyses. We identified major factors which increase the noise level of a single datacube, including bad channels, edge effects, baseline distortion and line contamination. Cleaning algorithms are applied to remove or reduce these noise components. As a result, we obtained the cleaned datacube in which noise follows a positively skewed normal distribution. We further analyzed the noise structure distribution of a 3D mosaicked datacube in the range l = 40{\deg}.7 to 43{\deg}.3 and b = -2{\deg}.3 to 0{\deg}.3 and found that noise in the final mosaicked datacube is mainly characterized by noise fluctuation among the cells.


title: Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimation

abstract: Self-supervised methods play an increasingly important role in monocular depth estimation due to their great potential and low annotation cost. To close the gap with supervised methods, recent works take advantage of extra constraints, e.g., semantic segmentation. However, these methods will inevitably increase the burden on the model. In this paper, we show theoretical and empirical evidence that the potential capacity of self-supervised monocular depth estimation can be excavated without increasing this cost. In particular, we propose (1) a novel data augmentation approach called data grafting, which forces the model to explore more cues to infer depth besides the vertical image position, (2) an exploratory self-distillation loss, which is supervised by the self-distillation label generated by our new post-processing method - selective post-processing, and (3) the full-scale network, designed to endow the encoder with the specialization of depth estimation task and enhance the representational power of the model. Extensive experiments show that our contributions can bring significant performance improvement to the baseline with even less computational overhead, and our model, named EPCDepth, surpasses the previous state-of-the-art methods even those supervised by additional constraints.


title: On the convergence to local limit of nonlocal models with approximated interaction neighborhoods

abstract: Many nonlocal models have adopted Euclidean balls as the nonlocal interaction neighborhoods. When solving them numerically, it is sometimes convenient to adopt polygonal approximations of such balls. A crucial question is, to what extent such approximations affect the nonlocal operators and the corresponding solutions. While recent works have analyzed this issue for a fixed horizon parameter, the question remains open in the case of a small or vanishing horizon parameter, which happens often in many practical applications and has significant impact on the reliability and robustness of nonlocal modeling and simulations. In this work, we are interested in addressing this issue and establishing the convergence of the nonlocal solutions associated with polygonally approximated interaction neighborhoods to the local limit of the original nonlocal solutions. Our finding reveals that the new nonlocal solution does not converge to the correct local limit when the number of sides of polygons is uniformly bounded. On the other hand, if the number of sides tends to infinity, the desired convergence can be established. These results may be used to guide future computational studies of nonlocal models.


title: Realizations of countable Borel equivalence relations

abstract: We study topological realizations of countable Borel equivalence relations, including realizations by continuous actions of countable groups, with additional desirable properties. Some examples include minimal realizations on any perfect Polish space, realizations as $K_\sigma$ relations, and realizations by continuous actions on the Baire space. We also consider questions related to realizations of specific important equivalence relations, like Turing and arithmetical equivalence. We focus in particular on the problem of realization by continuous actions on compact spaces and more specifically subshifts. This leads to the study of properties of subshifts, including universality of minimal subshifts, and a characterization of amenability of a countable group in terms of subshifts. Moreover we consider a natural universal space for actions and equivalence relations and study the descriptive and topological properties in this universal space of various properties, like, e.g., compressibility, amenability or hyperfiniteness.


title: Parallel Refinements for Lexically Constrained Text Generation with BART

abstract: Lexically constrained text generation aims to control the generated text by incorporating some pre-specified keywords into the output. Previous work injects lexical constraints into the output by controlling the decoding process or refining the candidate output iteratively, which tends to generate generic or ungrammatical sentences, and has high computational complexity. To address these challenges, we propose Constrained BART (CBART) for lexically constrained text generation. CBART leverages the pre-trained model BART and transfers part of the generation burden from the decoder to the encoder by decomposing this task into two sub-tasks, thereby improving the sentence quality. Concretely, we extend BART by adding a token-level classifier over the encoder, aiming at instructing the decoder where to replace and insert. Guided by the encoder, the decoder refines multiple tokens of the input in one step by inserting tokens before specific positions and re-predicting tokens with low confidence. To further reduce the inference latency, the decoder predicts all tokens in parallel. Experiment results on One-Billion-Word and Yelp show that CBART can generate plausible text with high quality and diversity while significantly accelerating inference.


title: Deformation characteristics and mechanical properties of a non-rigid square-twist origami structure with rotational symmetry

abstract: Non-rigid origami patterns could provide more versatile performance than their rigid counterparts in the design of mechanical metamaterials owing to the simultaneous deformation of facets and creases, but their complex deformation modes make quantitative characterization and programmability of mechanical properties a challenging task. Here, we investigated the tensile behavior of a non-rigid square-twist origami structure with rotational symmetry by combining biaxial tension experiments and finite element modeling. A three-stage deformation process, including tightening, unlocking, and flattening, of the structure was unveiled through a detailed analysis of facet distortion and crease rotation, and the relationship between structure deformation and several key features in the energy, force, and stiffness curve was obtained. Based on the analysis, an empirical model was built to correlate the geometric and material parameters of the structure and its deformation energy, initial peak force, and maximum stiffness, which were further validated through experiments. Using the model, the mechanical properties of the structure can be accurately predicted and programmed based on specific engineering requirements, thereby serving the development of new programmable mechanical metamaterials based on the family of square-twist origami.


title: Hhsmm: An R package for hidden hybrid Markov/semi-Markov models

abstract: This paper introduces the hhsmm R package, which involves functions for initializing, fitting, and predication of hidden hybrid Markov/semi-Markov models. These models are flexible models with both Markovian and semi-Markovian states, which are applied to situations where the model involves absorbing or macro-states. The left-to-right models and the models with series/parallel networks of states are two models with Markovian and semi-Markovian states. The hhsmm also includes Markov/semi-Markov switching regression model as well as the auto-regressive HHSMM, the nonparametric estimation of the emission distribution using penalized B-splines, prediction of future states and the residual useful lifetime estimation in the predict function. The commercial modular aero-propulsion system simulation (C-MAPSS) data-set is also included in the package, which is used for illustration of the application of the package features. The application of the hhsmm package to the analysis and prediction of the Spain's energy demand is also presented.


title: Anytime Game-Theoretic Planning with Active Reasoning About Humans' Latent States for Human-Centered Robots

abstract: A human-centered robot needs to reason about the cognitive limitation and potential irrationality of its human partner to achieve seamless interactions. This paper proposes an anytime game-theoretic planner that integrates iterative reasoning models, a partially observable Markov decision process, and chance-constrained Monte-Carlo belief tree search for robot behavioral planning. Our planner enables a robot to safely and actively reason about its human partner's latent cognitive states (bounded intelligence and irrationality) in real-time to maximize its utility better. We validate our approach in an autonomous driving domain where our behavioral planner and a low-level motion controller hierarchically control an autonomous car to negotiate traffic merges. Simulations and user studies are conducted to show our planner's effectiveness.


title: Smartphone Data Reveal Neighborhood-Level Racial Disparities in Police Presence

abstract: While extensive, research on policing in America has focused on documented actions such as stops and arrests -- less is known about patrolling and presence. We map the movements of over ten thousand police officers across twenty-one of America's largest cities by combining anonymized smartphone data with station and precinct boundaries. Police spend considerably more time in Black neighborhoods, a disparity which persists after controlling for density, socioeconomics, and crime-driven demand for policing. Our results suggest that roughly half of observed racial disparities in arrests are associated with this exposure disparity, which is lower in cities with more supervisor (but not officer) diversity.


title: ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translation

abstract: Recently, there has been an increasing interest in image editing methods that employ pre-trained unconditional image generators (e.g., StyleGAN). However, applying these methods to translate images to multiple visual domains remains challenging. Existing works do not often preserve the domain-invariant part of the image (e.g., the identity in human face translations), they do not usually handle multiple domains, or do not allow for multi-modal translations. This work proposes an implicit style function (ISF) to straightforwardly achieve multi-modal and multi-domain image-to-image translation from pre-trained unconditional generators. The ISF manipulates the semantics of an input latent code to make the image generated from it lying in the desired visual domain. Our results in human face and animal manipulations show significantly improved results over the baselines. Our model enables cost-effective multi-modal unsupervised image-to-image translations at high resolution using pre-trained unconditional GANs. The code and data are available at: \url{https://github.com/yhlleo/stylegan-mmuit}.


title: Self-Supervised Video Representation Learning by Video Incoherence Detection

abstract: This paper introduces a novel self-supervised method that leverages incoherence detection for video representation learning. It roots from the observation that visual systems of human beings can easily identify video incoherence based on their comprehensive understanding of videos. Specifically, the training sample, denoted as the incoherent clip, is constructed by multiple sub-clips hierarchically sampled from the same raw video with various lengths of incoherence between each other. The network is trained to learn high-level representation by predicting the location and length of incoherence given the incoherent clip as input. Additionally, intra-video contrastive learning is introduced to maximize the mutual information between incoherent clips from the same raw video. We evaluate our proposed method through extensive experiments on action recognition and video retrieval utilizing various backbone networks. Experiments show that our proposed method achieves state-of-the-art performance across different backbone networks and different datasets compared with previous coherence-based methods.


title: Plaskett 1.8 metre Observations of Starlink Satellites

abstract: We present observations of 23 Starlink satellites in the $g'$ bandpass, obtained from the Dominion Astrophysical Observatory's Plaskett 1.8 metre telescope. The targets include a mixture of satellites with and without brightness mitigation measures (i.e., visors). At the time of the observations (16 July 2021), Starlink satellites were sunlight throughout the night, and even with strict elevation and azimuth limits, there were over 800 candidate Starlink arcs. The satellites altogether have a median absolute brightness (550 km) of $\overline{H}_g^{550} =5.3$ mag. Dividing the targets into those without and with visors, their median absolute magnitudes are $\overline{H}_g^{550}(no~visor)=5.1$ and $\overline{H}^{550}_g(visor)=5.7$ mag, respectively. While the visor sample is dimmer in aggregate, the absolute brightness distribution ranged from $H_g^{550}=4.3$ mag to 9.4 mag, with the brightest being a visored satellite and the dimmest a satellite with no mitigation. The intrinsic brightness dispersion among the full sample is $\sigma_g = 0.5$ mag.


title: Mixed Moments of the Riemann Zeta and Dirichlet $L$-Functions

abstract: We prove Motohashi's formula for a mixed second moment of the Riemann zeta function and a Dirichlet $L$-function attached to a primitive Dirichlet character modulo $q \in \mathbb{N}$. If $q$ is an odd prime, our reciprocity formula is consistent with Motohashi's result in the early 1990s. The cubic moment side features two versions of central $L$-values of automorphic forms on $\Gamma_{0}(q) \backslash \mathbb{H}$. The methods involve a blend of analytic number theory and automorphic forms.


title: Explanation of nearby SNRs for primary electron excess and proton spectral bump

abstract: Several groups have reported a possible excess of primary electrons at high energies with the joint fit of the positron fraction and total electron/positron spectra. With the latest release of high-precision electron/positron spectra measured by AMS-02, we further confirm this excess by fitting $\Delta\Phi$ $\rm(i.e., \Phi_{e^-}-\Phi_{e^+})$ data in this work. Then we investigate the contribution of a single nearby supernova remnant to the primary electron excess and find that Monogem can reasonably account for this excess. Moreover, we predict that the electron spectrum may harden again at a few TeVs due to Vela's contribution. DAMPE, which can accurately measure electrons at TeV scale, is expected to provide the robust test of this new spectral feature in the near future. Finally, we fit the proton spectrum data of DAMPE with Monogem or Loop I. We find that both the primary electron excess and the proton spectral bump could be mainly generated by Monogem.


title: Unbiased Single-scale and Multi-scale Quantizers for Distributed Optimization

abstract: Massive amounts of data have led to the training of large-scale machine learning models on a single worker inefficient. Distributed machine learning methods such as Parallel-SGD have received significant interest as a solution to tackle this problem. However, the performance of distributed systems does not scale linearly with the number of workers due to the high network communication cost for synchronizing gradients and parameters. Researchers have proposed techniques such as quantization and sparsification to alleviate this problem by compressing the gradients. Most of the compression schemes result in compressed gradients that cannot be directly aggregated with efficient protocols such as all-reduce. In this paper, we present a set of all-reduce compatible gradient compression schemes which significantly reduce the communication overhead while maintaining the performance of vanilla SGD. We present the results of our experiments with the CIFAR10 dataset and observations derived during the process. Our compression methods perform better than the in-built methods currently offered by the deep learning frameworks. Code is available at the repository: \url{https://github.com/vineeths96/Gradient-Compression}.


title: Short-Term Load Forecasting Using Time Pooling Deep Recurrent Neural Network

abstract: Integration of renewable energy sources and emerging loads like electric vehicles to smart grids brings more uncertainty to the distribution system management. Demand Side Management (DSM) is one of the approaches to reduce the uncertainty. Some applications like Nonintrusive Load Monitoring (NILM) can support DSM, however they require accurate forecasting on high resolution data. This is challenging when it comes to single loads like one residential household due to its high volatility. In this paper, we review some of the existing Deep Learning-based methods and present our solution using Time Pooling Deep Recurrent Neural Network. The proposed method augments data using time pooling strategy and can overcome overfitting problems and model uncertainties of data more efficiently. Simulation and implementation results show that our method outperforms the existing algorithms in terms of RMSE and MAE metrics.


title: PETA: Photo Albums Event Recognition using Transformers Attention

abstract: In recent years the amounts of personal photos captured increased significantly, giving rise to new challenges in multi-image understanding and high-level image understanding. Event recognition in personal photo albums presents one challenging scenario where life events are recognized from a disordered collection of images, including both relevant and irrelevant images. Event recognition in images also presents the challenge of high-level image understanding, as opposed to low-level image object classification. In absence of methods to analyze multiple inputs, previous methods adopted temporal mechanisms, including various forms of recurrent neural networks. However, their effective temporal window is local. In addition, they are not a natural choice given the disordered characteristic of photo albums. We address this gap with a tailor-made solution, combining the power of CNNs for image representation and transformers for album representation to perform global reasoning on image collection, offering a practical and efficient solution for photo albums event recognition. Our solution reaches state-of-the-art results on 3 prominent benchmarks, achieving above 90\% mAP on all datasets. We further explore the related image-importance task in event recognition, demonstrating how the learned attentions correlate with the human-annotated importance for this subjective task, thus opening the door for new applications.


title: Electoral Programs of German Parties 2021: A Computational Analysis Of Their Comprehensibility and Likeability Based On SentiArt

abstract: The electoral programs of six German parties issued before the parliamentary elections of 2021 are analyzed using state-of-the-art computational tools for quantitative narrative, topic and sentiment analysis. We compare different methods for computing the textual similarity of the programs, Jaccard Bag similarity, Latent Semantic Analysis, doc2vec, and sBERT, the representational and computational complexity increasing from the 1st to the 4th method. A new similarity measure for entire documents derived from the Fowlkes Mallows Score is applied to kmeans clustering of sBERT transformed sentences. Using novel indices of the readability and emotion potential of texts computed via SentiArt (Jacobs, 2019), our data shed light on the similarities and differences of the programs regarding their length, main ideas, comprehensibility, likeability, and semantic complexity. Among others, they reveal that the programs of the SPD and CDU have the best chances to be comprehensible and likeable -all other things being equal-, and they raise the important issue of which similarity measure is optimal for comparing texts such as electoral programs which necessarily share a lot of words. While such analyses can not replace qualitative analyses or a deep reading of the texts, they offer predictions that can be verified in empirical studies and may serve as a motivation for changing aspects of future electoral programs potentially making them more comprehensible and/or likeable.


title: On finite multiple zeta values of level two

abstract: We introduce and study a ``level two'' analogue of finite multiple zeta values. We give conjectural bases of the space of finite Euler sums as well as that of usual finite multiple zeta values in terms of these newly defined elements. A kind of ``parity result'' and certain sum formulas are also presented.


title: Self-Supervised Learning for MRI Reconstruction with a Parallel Network Training Framework

abstract: Image reconstruction from undersampled k-space data plays an important role in accelerating the acquisition of MR data, and a lot of deep learning-based methods have been exploited recently. Despite the achieved inspiring results, the optimization of these methods commonly relies on the fully-sampled reference data, which are time-consuming and difficult to collect. To address this issue, we propose a novel self-supervised learning method. Specifically, during model optimization, two subsets are constructed by randomly selecting part of k-space data from the undersampled data and then fed into two parallel reconstruction networks to perform information recovery. Two reconstruction losses are defined on all the scanned data points to enhance the network's capability of recovering the frequency information. Meanwhile, to constrain the learned unscanned data points of the network, a difference loss is designed to enforce consistency between the two parallel networks. In this way, the reconstruction model can be properly trained with only the undersampled data. During the model evaluation, the undersampled data are treated as the inputs and either of the two trained networks is expected to reconstruct the high-quality results. The proposed method is flexible and can be employed in any existing deep learning-based method. The effectiveness of the method is evaluated on an open brain MRI dataset. Experimental results demonstrate that the proposed self-supervised method can achieve competitive reconstruction performance compared to the corresponding supervised learning method at high acceleration rates (4 and 8). The code is publicly available at \url{https://github.com/chenhu96/Self-Supervised-MRI-Reconstruction}.


title: Maximal subgroups of a family of iterated monodromy groups

abstract: The Basilica group is a well-known 2-generated weakly branch, but not branch, group acting on the binary rooted tree. Recently a more general form of the Basilica group has been investigated by Petschick and Rajeev, which is an $s$-generated weakly branch, but not branch, group that acts on the $m$-adic tree, for $s,m > 1$. A larger family of groups, which contains these generalised Basilica groups, is the family of iterated monodromy groups. With the new developments by Francoeur, the study of the existence of maximal subgroups of infinite index has been extended from branch groups to weakly branch groups. Here we show that a subfamily of iterated monodromy groups, which more closely resemble the generalised Basilica groups, have maximal subgroups only of finite index.


title: AdaInject: Injection Based Adaptive Gradient Descent Optimizers for Convolutional Neural Networks

abstract: The convolutional neural networks (CNNs) are generally trained using stochastic gradient descent (SGD) based optimization techniques. The existing SGD optimizers generally suffer with the overshooting of the minimum and oscillation near minimum. In this paper, we propose a new approach, hereafter referred as AdaInject, for the gradient descent optimizers by injecting the second order moment into the first order moment. Specifically, the short-term change in parameter is used as a weight to inject the second order moment in the update rule. The AdaInject optimizer controls the parameter update, avoids the overshooting of the minimum and reduces the oscillation near minimum. The proposed approach is generic in nature and can be integrated with any existing SGD optimizer. The effectiveness of the AdaInject optimizer is explained intuitively as well as through some toy examples. We also show the convergence property of the proposed injection based optimizer. Further, we depict the efficacy of the AdaInject approach through extensive experiments in conjunction with the state-of-the-art optimizers, namely AdamInject, diffGradInject, RadamInject, and AdaBeliefInject on four benchmark datasets. Different CNN models are used in the experiments. A highest improvement in the top-1 classification error rate of $16.54\%$ is observed using diffGradInject optimizer with ResNeXt29 model over the CIFAR10 dataset. Overall, we observe very promising performance improvement of existing optimizers with the proposed AdaInject approach. The code is available at: \url{https://github.com/shivram1987/AdaInject}.


title: Upper Limit on the Proton Lifetime in Minimal Supersymetric SU(5)

abstract: In minimal supersymmetric SU(5) models, the proton can decay through dimension 5 operators. Since this decay depends directly on the supersymmetric soft masses, it will be constrained by other observables which depend on the soft masses, such as the Higgs mass and the dark matter relic density. In this work, we will examine the upper limit on the proton lifetime in minimal supersymmetric SU(5) with constrained minimal supersymmetric (CMSSM) boundary conditions set at the grand unification scale. We perform a random scan over the variables of the (CMSSM), with of order $10^{6}$ points, and find that the proton lifetime is within reach of JUNO and Hyper-Kamiokande's experiment.


title: A Simple Self-calibration Method for The Internal Time Synchronization of MEMS LiDAR

abstract: This paper proposes a simple self-calibration method for the internal time synchronization of MEMS(Micro-electromechanical systems) LiDAR during research and development. Firstly, we introduced the problem of internal time misalignment in MEMS lidar. Then, a robust Minimum Vertical Gradient(MVG) prior is proposed to calibrate the time difference between the laser and MEMS mirror, which can be calculated automatically without any artificial participation or specially designed cooperation target. Finally, actual experiments on MEMS LiDARs are implemented to demonstrate the effectiveness of the proposed method. It should be noted that the calibration can be implemented in a simple laboratory environment without any ranging equipment and artificial participation, which greatly accelerate the progress of research and development in practical applications.


title: Partial to Whole Knowledge Distillation: Progressive Distilling Decomposed Knowledge Boosts Student Better

abstract: Knowledge distillation field delicately designs various types of knowledge to shrink the performance gap between compact student and large-scale teacher. These existing distillation approaches simply focus on the improvement of \textit{knowledge quality}, but ignore the significant influence of \textit{knowledge quantity} on the distillation procedure. Opposed to the conventional distillation approaches, which extract knowledge from a fixed teacher computation graph, this paper explores a non-negligible research direction from a novel perspective of \textit{knowledge quantity} to further improve the efficacy of knowledge distillation. We introduce a new concept of knowledge decomposition, and further put forward the \textbf{P}artial to \textbf{W}hole \textbf{K}nowledge \textbf{D}istillation~(\textbf{PWKD}) paradigm. Specifically, we reconstruct teacher into weight-sharing sub-networks with same depth but increasing channel width, and train sub-networks jointly to obtain decomposed knowledge~(sub-networks with more channels represent more knowledge). Then, student extract partial to whole knowledge from the pre-trained teacher within multiple training stages where cyclic learning rate is leveraged to accelerate convergence. Generally, \textbf{PWKD} can be regarded as a plugin to be compatible with existing offline knowledge distillation approaches. To verify the effectiveness of \textbf{PWKD}, we conduct experiments on two benchmark datasets:~CIFAR-100 and ImageNet, and comprehensive evaluation results reveal that \textbf{PWKD} consistently improve existing knowledge distillation approaches without bells and whistles.


title: LINDA: Multi-Agent Local Information Decomposition for Awareness of Teammates

abstract: In cooperative multi-agent reinforcement learning (MARL), where agents only have access to partial observations, efficiently leveraging local information is critical. During long-time observations, agents can build \textit{awareness} for teammates to alleviate the problem of partial observability. However, previous MARL methods usually neglect this kind of utilization of local information. To address this problem, we propose a novel framework, multi-agent \textit{Local INformation Decomposition for Awareness of teammates} (LINDA), with which agents learn to decompose local information and build awareness for each teammate. We model the awareness as stochastic random variables and perform representation learning to ensure the informativeness of awareness representations by maximizing the mutual information between awareness and the actual trajectory of the corresponding agent. LINDA is agnostic to specific algorithms and can be flexibly integrated to different MARL methods. Sufficient experiments show that the proposed framework learns informative awareness from local partial observations for better collaboration and significantly improves the learning performance, especially on challenging tasks.


title: Deep Exploration for Recommendation Systems

abstract: Modern recommendation systems ought to benefit by probing for and learning from delayed feedback. Research has tended to focus on learning from a user's response to a single recommendation. Such work, which leverages methods of supervised and bandit learning, forgoes learning from the user's subsequent behavior. Where past work has aimed to learn from subsequent behavior, there has been a lack of effective methods for probing to elicit informative delayed feedback. Effective exploration through probing for delayed feedback becomes particularly challenging when rewards are sparse. To address this, we develop deep exploration methods for recommendation systems. In particular, we formulate recommendation as a sequential decision problem and demonstrate benefits of deep exploration over single-step exploration. Our experiments are carried out with high-fidelity industrial-grade simulators and establish large improvements over existing algorithms.


title: Towards Online Optimization for Power Grids

abstract: In this note, we discuss potential advantages in extending distributed optimization frameworks to enhance support for power grid operators managing an influx of online sequential decisions. First, we review the state-of-the-art distributed optimization frameworks for electric power systems, and explain how distributed algorithms deliver scalable solutions. Next, we introduce key concepts and paradigms for online optimization, and present a distributed online optimization framework highlighting important performance characteristics. Finally, we discuss the connection and difference between offline and online distributed optimization, showcasing the suitability of such optimization techniques for power grid applications.


title: Cancer Progression as a Learning Process

abstract: Drug resistance and metastasis - the major complications in cancer - both entail adaptation of cancer cells to stress, whether a drug or a lethal new environment. Intriguingly, these adaptive processes share similar features that cannot be explained by a pure Darwinian scheme, including dormancy, increased heterogeneity, and stress-induced plasticity. Here, we propose that learning theory offers a framework to explain these features and may shed light on these two intricate processes. In this framework, learning is performed at the single cell level, by stress-driven exploratory trial-and-error. Such a process is not contingent on pre-existing pathways but on a random search for a state that diminishes the stress. We review underlying mechanisms that may support this search, and show by using a learning model that such exploratory adaptation is feasible in a high dimensional system as the cell. At the population level, we view the tissue as a network of exploring agents that communicate and restrain cancer formation in health. In this view, disease results from the breakdown of homeostasis between cellular exploratory drive and tissue homeostasis.


title: DemiNet: Dependency-Aware Multi-Interest Network with Self-Supervised Graph Learning for Click-Through Rate Prediction

abstract: In this paper, we propose a novel model named DemiNet (short for DEpendency-Aware Multi-Interest Network) to address the above two issues. To be specific, we first consider various dependency types between item nodes and perform dependency-aware heterogeneous attention for denoising and obtaining accurate sequence item representations. Secondly, for multiple interests extraction, multi-head attention is conducted on top of the graph embedding. To filter out noisy inter-item correlations and enhance the robustness of extracted interests, self-supervised interest learning is introduced to the above two steps. Thirdly, to aggregate the multiple interests, interest experts corresponding to different interest routes give rating scores respectively, while a specialized network assigns the confidence of each score. Experimental results on three real-world datasets demonstrate that the proposed DemiNet significantly improves the overall recommendation performance over several state-of-the-art baselines. Further studies verify the efficacy and interpretability benefits brought by the fine-grained user interest modeling.


title: Generalized multiscale feature extraction for remaining useful life prediction of bearings with generative adversarial networks

abstract: Bearing is a key component in industrial machinery and its failure may lead to unwanted downtime and economic loss. Hence, it is necessary to predict the remaining useful life (RUL) of bearings. Conventional data-driven approaches of RUL prediction require expert domain knowledge for manual feature extraction and may suffer from data distribution discrepancy between training and test data. In this study, we propose a novel generalized multiscale feature extraction method with generative adversarial networks. The adversarial training learns the distribution of training data from different bearings and is introduced for health stage division and RUL prediction. To capture the sequence feature from a one-dimensional vibration signal, we adapt a U-Net architecture that reconstructs features to process them with multiscale layers in the generator of the adversarial network. To validate the proposed method, comprehensive experiments on two rotating machinery datasets have been conducted to predict the RUL. The experimental results show that the proposed feature extraction method can effectively predict the RUL and outperforms the conventional RUL prediction approaches based on deep neural networks. The implementation code is available at https://github.com/opensuh/GMFE.


title: Approaching the Transient Stability Boundary of a Power System: Theory and Applications

abstract: Estimating the stability boundary is a fundamental and challenging problem in transient stability studies. It is known that a proper level set of a Lyapunov function or an energy function can provide an inner approximation of the stability boundary, and the estimation can be expanded by trajectory reversing methods. In this paper, we streamline the theoretical foundation of the expansion methodology, and generalize it by relaxing the request that the initial guess should be a subset of the stability region. We investigate topological characteristics of the expanded boundary, showing how an initial guess can approach the exact stability boundary locally or globally. We apply the theory to transient stability assessment, and propose expansion algorithms to improve the well-known Potential Energy Boundary Surface (PEBS) and Boundary of stability region based Controlling Unstable equilibrium point (BCU) methods. Case studies on the IEEE 39-bus system well verify our results and demonstrate that estimations of the stability boundary and the critical clearing time can be significantly improved with modest computational cost.


title: Distributed Generalized Nash Equilibrium Seeking of N-Coalition Games with Full and Distributive Constraints

abstract: In this work, we investigate the distributed generalized Nash equilibrium (GNE) seeking problems for $N$-coalition games with inequality constraints. First, we study the scenario where each agent in a coalition has full information of all the constraints. A finite-time average consensus-based approach is proposed by using full decision information. It is proven that the algorithm converges to a GNE (specifically, a variational equilibrium) of the game. Then, based on the finite-time consensus tracking, we propose a distributed algorithm by using partial decision information only, where only neighboring action information is needed for each agent. Furthermore, we investigate the scenario where only distributive constraint information is available for the agents. The terminology ``distributive" here refers to the scenario where the constraint information acquisition and processing are conducted across multiple agents in a coalition, and each agent has access to only a subset of constraints, instead of the scenario where each agent has full information of all the constraints. In this case, the multiplier computation and the constraint information required for each individual are reduced. A full decision information algorithm and a partial decision information algorithm for this scenario are proposed, respectively. Numerical examples are given to verify the proposed algorithms.


title: Prioritized Experience-based Reinforcement Learning with Human Guidance for Autonomous Driving

abstract: Reinforcement learning (RL) requires skillful definition and remarkable computational efforts to solve optimization and control problems, which could impair its prospect. Introducing human guidance into reinforcement learning is a promising way to improve learning performance. In this paper, a comprehensive human guidance-based reinforcement learning framework is established. A novel prioritized experience replay mechanism that adapts to human guidance in the reinforcement learning process is proposed to boost the efficiency and performance of the reinforcement learning algorithm. To relieve the heavy workload on human participants, a behavior model is established based on an incremental online learning method to mimic human actions. We design two challenging autonomous driving tasks for evaluating the proposed algorithm. Experiments are conducted to access the training and testing performance and learning mechanism of the proposed algorithm. Comparative results against the state-of-the-art methods suggest the advantages of our algorithm in terms of learning efficiency, performance, and robustness.


title: Dynamic Adaptive Spatio-temporal Graph Convolution for fMRI Modelling

abstract: The characterisation of the brain as a functional network in which the connections between brain regions are represented by correlation values across time series has been very popular in the last years. Although this representation has advanced our understanding of brain function, it represents a simplified model of brain connectivity that has a complex dynamic spatio-temporal nature. Oversimplification of the data may hinder the merits of applying advanced non-linear feature extraction algorithms. To this end, we propose a dynamic adaptive spatio-temporal graph convolution (DAST-GCN) model to overcome the shortcomings of pre-defined static correlation-based graph structures. The proposed approach allows end-to-end inference of dynamic connections between brain regions via layer-wise graph structure learning module while mapping brain connectivity to a phenotype in a supervised learning framework. This leverages the computational power of the model, data and targets to represent brain connectivity, and could enable the identification of potential biomarkers for the supervised target in question. We evaluate our pipeline on the UKBiobank dataset for age and gender classification tasks from resting-state functional scans and show that it outperforms currently adapted linear and non-linear methods in neuroimaging. Further, we assess the generalizability of the inferred graph structure by transferring the pre-trained graph to an independent dataset for the same task. Our results demonstrate the task-robustness of the graph against different scanning parameters and demographics.


title: Dense Coding with Locality Restriction for Decoder: Quantum Encoders vs. Super-Quantum Encoders

abstract: We investigate dense coding by imposing various locality restrictions to our decoder by employing the resource theory of asymmetry framework. In this task, the sender Alice and the receiver Bob share an entangled state. She encodes the classical information into it using a symmetric preserving encoder and sends the encoded state to Bob through a noiseless quantum channel. The decoder is limited to a measurement to satisfy a certain locality condition on the bipartite system composed of the receiving system and the preshared entanglement half. Our contributions are summarized as follows: First, we derive an achievable transmission rate for this task dependently of conditions of encoder and decoder. Surprisingly, we show that the obtained rate cannot be improved even when the decoder is relaxed to local measurements, two-way LOCCs, separable measurements, or partial transpose positive (PPT) measurements for the bipartite system. Moreover, depending on the class of allowed measurements with a locality condition, we relax the class of encoding operations to super-quantum encoders in the framework of general probability theory (GPT). That is, when our decoder is restricted to a separable measurement, theoretically, a positive operation is allowed as an encoding operation. Surprisingly, even under this type of super-quantum relaxation, the transmission rate cannot be improved. This fact highlights the universal validity of our analysis beyond quantum theory.


title: AsySQN: Faster Vertical Federated Learning Algorithms with Better Computation Resource Utilization

abstract: Vertical federated learning (VFL) is an effective paradigm of training the emerging cross-organizational (e.g., different corporations, companies and organizations) collaborative learning with privacy preserving. Stochastic gradient descent (SGD) methods are the popular choices for training VFL models because of the low per-iteration computation. However, existing SGD-based VFL algorithms are communication-expensive due to a large number of communication rounds. Meanwhile, most existing VFL algorithms use synchronous computation which seriously hamper the computation resource utilization in real-world applications. To address the challenges of communication and computation resource utilization, we propose an asynchronous stochastic quasi-Newton (AsySQN) framework for VFL, under which three algorithms, i.e. AsySQN-SGD, -SVRG and -SAGA, are proposed. The proposed AsySQN-type algorithms making descent steps scaled by approximate (without calculating the inverse Hessian matrix explicitly) Hessian information convergence much faster than SGD-based methods in practice and thus can dramatically reduce the number of communication rounds. Moreover, the adopted asynchronous computation can make better use of the computation resource. We theoretically prove the convergence rates of our proposed algorithms for strongly convex problems. Extensive numerical experiments on real-word datasets demonstrate the lower communication costs and better computation resource utilization of our algorithms compared with state-of-the-art VFL algorithms.


title: Entity Linking Meets Deep Learning: Techniques and Solutions

abstract: Entity linking (EL) is the process of linking entity mentions appearing in web text with their corresponding entities in a knowledge base. EL plays an important role in the fields of knowledge engineering and data mining, underlying a variety of downstream applications such as knowledge base population, content analysis, relation extraction, and question answering. In recent years, deep learning (DL), which has achieved tremendous success in various domains, has also been leveraged in EL methods to surpass traditional machine learning based methods and yield the state-of-the-art performance. In this survey, we present a comprehensive review and analysis of existing DL based EL methods. First of all, we propose a new taxonomy, which organizes existing DL based EL methods using three axes: embedding, feature, and algorithm. Then we systematically survey the representative EL methods along the three axes of the taxonomy. Later, we introduce ten commonly used EL data sets and give a quantitative performance analysis of DL based EL methods over these data sets. Finally, we discuss the remaining limitations of existing methods and highlight some promising future directions.


title: On the local times of noise reinforced Bessel processes

abstract: We investigate the effects of noise reinforcement on a Bessel process of dimension $d\in(0,2)$, and more specifically on the asymptotic behavior of its additive functionals. This leads us to introduce a local time process and its inverse. We identify the latter as an increasing self-similar (time-homogeneous) Markov process, and from this, several explicit results can be deduced.


title: Superconducting gap and pseudogap in the surface states of the iron-based superconductor PrFeAsO$_{1-y}$ studied by angle-resolved photoemission spectroscopy

abstract: In order to study the possible superconductivity at the polar surfaces of 1111-type iron-based superconductors, which is doped with a large amount of holes in spite of the electron doping in bulk materials, we have performed angle-resolved photoemission spectroscopy (ARPES) studies on superconducting PrFeAsO$_{1-y}$~crystals. We have indeed observed the opening of a superconducting gap on surface-derived hole pockets as well as on a bulk-derived hole pocket. The superconducting gap is found to open on the surface-derived hole pockets below the bulk $T_c$, which suggests that the surface superconductivity is possibly induced by proximity effect from the bulk. We have also observed the opening of a large pseudogap on the surface-derived hole pockets, which is similar to the pseudogap in 122-type bulk superconductors doped with a smaller amount of holes. This suggests that the opening of a large pseudogap is a characteristic property of hole-doped iron-based superconductors.


title: A Study of Fake News Reading and Annotating in Social Media Context

abstract: The online spreading of fake news is a major issue threatening entire societies. Much of this spreading is enabled by new media formats, namely social networks and online media sites. Researchers and practitioners have been trying to answer this by characterizing the fake news and devising automated methods for detecting them. The detection methods had so far only limited success, mostly due to the complexity of the news content and context and lack of properly annotated datasets. One possible way to boost the efficiency of automated misinformation detection methods, is to imitate the detection work of humans. It is also important to understand the news consumption behavior of online users. In this paper, we present an eye-tracking study, in which we let 44 lay participants to casually read through a social media feed containing posts with news articles, some of which were fake. In a second run, we asked the participants to decide on the truthfulness of these articles. We also describe a follow-up qualitative study with a similar scenario but this time with 7 expert fake news annotators. We present the description of both studies, characteristics of the resulting dataset (which we hereby publish) and several findings.


title: A parallel-in-time preconditioner for Crank-Nicolson discretization of a parabolic optimal control problem

abstract: In this paper, a fast solver is studied for saddle point system arising from a second-order Crank-Nicolson discretization of an initial-valued parabolic PDE constrained optimal control problem, which is indefinite and ill-conditioned. Different from the saddle point system arising from the first-order Euler discretization, the saddle point system arising from Crank-Nicolson discretization has a dense and non-symmetric Schur complement, which brings challenges to fast solver designing. To remedy this, a novel symmetrization technique is applied to the saddle point system so that the new Schur complement is symmetric definite and the well-known matching-Schur-complement (MSC) preconditioner is applicable to the new Schur complement. Nevertheless, the new Schur complement is still a dense matrix and the inversion of the corresponding MSC preconditioner is not parallel-in-time (PinT) and thus time consuming. For this concern, a modified MSC preconditioner for the new Schur complement system. Our new preconditioner can be implemented in a fast and PinT way via a temporal diagonalization technique. Theoretically, the eigenvalues of the preconditioned matrix by our new preconditioner are proven to be lower and upper bounded by positive constants independent of matrix size and the regularization parameter. With such spectrum, the preconditioned conjugate gradient (PCG) solver for the Schur complement system is proven to have a convergence rate independent of matrix size and regularization parameter. To the best of my knowledge, it is the first time to have an iterative solver with problem-independent convergence rate for the saddle point system arising from Crank-Nicolson discretization of the optimal control problem. Numerical results are reported to show that the performance of the proposed preconditioner.


title: Preconditioning for finite element methods with strain smoothing

abstract: Strain smoothing methods such as the smoothed finite element methods (S-FEMs) and the strain-smoothed element~(SSE) method have successfully improved the performance of finite elements, and there have been numerous applications of them in finite element analysis. For the sake of efficient applications to large-scale problems, it is important to develop a mathematically and numerically well-elaborated iterative solver for the strain smoothing methods. In this paper, inspired by the spectral properties of the strain smoothing methods, we propose efficient ways of preconditioning for the methods. First, we analyze the spectrums of the stiffness matrices of the edge-based S-FEM and the SSE method. Then, we propose an improved two-level additive Schwarz preconditioner for the strain smoothing methods by modifying local solvers appropriately. For the sake of convenience of implementation, an alternative form of the preconditioner is also proposed by defining the coarse-scale operation in terms of the standard FEM. We verify our theoretical results through numerical experiments.


title: Adjusting for publication bias in meta-analysis via inverse probability weighting using clinical trial registries

abstract: Publication bias is a major concern in conducting systematic reviews and meta-analyses. Various sensitivity analysis or bias-correction methods have been developed based on selection models and they have some advantages over the widely used bias-correction method of the trim-and-fill method. However, likelihood methods based on selection models may have difficulty in obtaining precise estimates and reasonable confidence intervals or require a complicated sensitivity analysis process. In this paper, we develop a simple publication bias adjustment method utilizing information on conducted but still unpublished trials from clinical trial registries. We introduce an estimating equation for parameter estimation in the selection function by regarding the publication bias issue as a missing data problem under missing not at random. With the estimated selection function, we introduce the inverse probability weighting (IPW) method to estimate the overall mean across studies. Furthermore, the IPW versions of heterogeneity measures such as the between-study variance and the I2 measure are proposed. We propose methods to construct asymptotic confidence intervals and suggest intervals based on parametric bootstrapping as an alternative. Through numerical experiments, we observed that the estimators successfully eliminate biases and the confidence intervals had empirical coverage probabilities close to the nominal level. On the other hand, the asymptotic confidence interval is much wider in some scenarios than the bootstrap confidence interval. Therefore, the latter is recommended for practical use.


title: Scissor-cross ionization injection in laser wakefield accelerators

abstract: We propose to use a frequency doubled pulse colliding with the driving pulse at an acute angle to trigger ionization injection in a laser wakefield accelerator. This scheme effectively reduces the duration that injection occurs, thus high injection quality is obtained. Three-dimensional particle-in-cell simulations show that electron beams with energy of ~500 MeV, charge of ~40 pC, energy spread of ~1% and normalized emittance of a few millimeter milliradian can be produced by ~100 TW laser pulses. By adjusting the angle between the two pulses, the intensity of the trigger pulse and the gas dope ratio, the charge and energy spread of the electron beam can be controlled.


title: Cuts and small extensions of abelian ordered groups

abstract: We classify cuts in (totally) ordered abelian groups $\g$ and compute the coinitiality and cofinality of all cuts in case $\g$ is divisible, in terms of data intrinsically associated to the invariance group of the cut. We relate cuts with small extensions of $\g$ in a natural way, which leads to an explicit construction of a totally ordered real vector space containing realizations of all cuts. This construction is applied to the problem of classifying all extensions of the valuation from a given valued field $K$ to the rational function field $K(x)$.


title: Spin-orbit-coupled spin-1 Bose-Einstein condensates in a toroidal trap: even-petal-number necklacelike state and persistent flow

abstract: Spin-orbit coupling has novel spin-flip symmetries, a spin-1 spinor Bose-Einstein condensate owns meaningful interactions, and a toroidal trap is topologically nontrivial. We incorporate the three together and study the ground-state phase diagram in a Rashba spin-orbit-coupled spin-1 Bose-Einstein condensate with a toroidal trap. The spin-flip symmetries give rise to two different interesting phases: persistent flows with a unit phase winding difference between three components, and necklace states with even petal-number. The existing parameter regimes and properties of these phases are characterized by two-dimension numerical calculations and an azimuthal analytical one-dimension model.


title: Structure-Preserving Image Super-Resolution

abstract: Structures matter in single image super-resolution (SISR). Benefiting from generative adversarial networks (GANs), recent studies have promoted the development of SISR by recovering photo-realistic images. However, there are still undesired structural distortions in the recovered images. In this paper, we propose a structure-preserving super-resolution (SPSR) method to alleviate the above issue while maintaining the merits of GAN-based methods to generate perceptual-pleasant details. Firstly, we propose SPSR with gradient guidance (SPSR-G) by exploiting gradient maps of images to guide the recovery in two aspects. On the one hand, we restore high-resolution gradient maps by a gradient branch to provide additional structure priors for the SR process. On the other hand, we propose a gradient loss to impose a second-order restriction on the super-resolved images, which helps generative networks concentrate more on geometric structures. Secondly, since the gradient maps are handcrafted and may only be able to capture limited aspects of structural information, we further extend SPSR-G by introducing a learnable neural structure extractor (NSE) to unearth richer local structures and provide stronger supervision for SR. We propose two self-supervised structure learning methods, contrastive prediction and solving jigsaw puzzles, to train the NSEs. Our methods are model-agnostic, which can be potentially used for off-the-shelf SR networks. Experimental results on five benchmark datasets show that the proposed methods outperform state-of-the-art perceptual-driven SR methods under LPIPS, PSNR, and SSIM metrics. Visual results demonstrate the superiority of our methods in restoring structures while generating natural SR images. Code is available at https://github.com/Maclory/SPSR.


title: Boundary controllability for a degenerate wave equation in non divergence form with drift

abstract: We consider a degenerate wave equation with drift in presence of a leading operator which is not in divergence form. We provide some conditions for the boundary controllability of the associated Cauchy problem.


title: Embeddings of maximal tori in classical groups, odd degree descent and Hasse principles

abstract: The aim of this paper is to revisit the question of local-global principles for embeddings of \'etale algebras with involution into central simple algebras with involution over global fields of characteristic not 2. A necessary and sufficient condition is given in [BLP 18]. In the present paper, we give a simpler description of the obstruction group. It is also shown that if the etale algebra is a product of pairwise linearly disjoint field extensions, then the Hasse principle holds, and that if an embedding exists after an odd degree extension, then it also exists over the global field itself. An appendix gives a generalization of this later result, in the framework of a question of Burt Totaro.


title: BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models

abstract: Copy mechanisms explicitly obtain unchanged tokens from the source (input) sequence to generate the target (output) sequence under the neural seq2seq framework. However, most of the existing copy mechanisms only consider single word copying from the source sentences, which results in losing essential tokens while copying long spans. In this work, we propose a plug-and-play architecture, namely BioCopy, to alleviate the problem aforementioned. Specifically, in the training stage, we construct a BIO tag for each token and train the original model with BIO tags jointly. In the inference stage, the model will firstly predict the BIO tag at each time step, then conduct different mask strategies based on the predicted BIO label to diminish the scope of the probability distributions over the vocabulary list. Experimental results on two separate generative tasks show that they all outperform the baseline models by adding our BioCopy to the original model structure.


title: Data Summarization via Bilevel Optimization

abstract: The increasing availability of massive data sets poses a series of challenges for machine learning. Prominent among these is the need to learn models under hardware or human resource constraints. In such resource-constrained settings, a simple yet powerful approach is to operate on small subsets of the data. Coresets are weighted subsets of the data that provide approximation guarantees for the optimization objective. However, existing coreset constructions are highly model-specific and are limited to simple models such as linear regression, logistic regression, and $k$-means. In this work, we propose a generic coreset construction framework that formulates the coreset selection as a cardinality-constrained bilevel optimization problem. In contrast to existing approaches, our framework does not require model-specific adaptations and applies to any twice differentiable model, including neural networks. We show the effectiveness of our framework for a wide range of models in various settings, including training non-convex models online and batch active learning.


title: On the Scheduling Policy for Multi-process WNCS under Edge Computing

abstract: This paper considers a multi-process and multi-controller wireless networked control system (WNCS). There are $N$ independent linear time-invariant processes in the system plant which represent different kinds of physical processes. By considering the edge computing, the controllers are played by edge server and cloud server. Each process is measured by a sensor, and the status updates is sent to controller to generate the control command. The link delay of cloud server is longer than that of edge server. The processing time of status update depends on the characteristic of servers and processes. By taking into account such conditions, we mainly investigate how to choose the destination of status updates to minimize the system's average Mean Square Error (MSE), edge server or cloud server? To address this issue, we formulate an infinite horizon average cost Markov Decision Process (MDP) problem and obtain the optimal scheduling policy. The monotonicity of the value function in MDP is characterized and then used to show the threshold structure properties of the optimal scheduling policy. To overcome the curse of dimensionality, we propose a low-complexity suboptimal policy by using additive separable structure of value function. Furthermore, the processing preemption mechanism is considered to handle the status updates more flexible, and the consistency property is proved. On this basis, a numerical example is provided. The simulation results illustrate that the controller selection is related to the timeliness of process and show the performance of the suboptimal policy. We also find that the optimal policy will become a static policy in which the destination of status update is fixed when the wireless channel is error free.


title: Gauge coupling unification in a minimal non-supersymmetric $E_6$ GUT

abstract: We consider a minimal renormalizable non-supersymmetric $E_6$ Grand Unified Theory using fundamental representation $27$ for fermions and scalars. The scalar with adjoint representation ${78}$ is also taken for direct breaking of $E_{6}$ to SM. The proposed model, guided by TeV-scale vector-like fermions and scalar leptoquark offer successful gauge unification even in the absence of any intermediate symmetry. Embedded with threshold corrections, it is shown to be compatible with the present experimental limit on proton decay lifetime. The unique feature of the model shows that, the GUT threshold corrections to the unification mass, is controlled by superheavy gauge bosons only, thereby minimising the uncertainty of the GUT predictions. The scalar leptoquark and vector-like fermions residing in $27$ representation can explain flavor physics anomalies like $R_{D^{(\ast)}}$ as reported by the LHCb collaboration and the muon anomalous magnetic moment reported by the recent muon $g-2$ experiment at Fermilab. The model can also predict a sub-eV scale neutrino at one-loop level via exchange of $W$ and $Z$ gauge bosons through MRIS mechanism.


title: An attempt at axiomatization of extending mechanism of solutions to the fluid dynamical systems

abstract: Note that some classic fluid dynamical systems such as the Navier-Stokes equations, Magnetohydrodynamics (MHD), Boussinesq equations, and etc are observably different from each other but obey some energy inequalities of the similar type. In this paper, we attempt to axiomatize the extending mechanism of solutions to these systems, merely starting from several basic axiomatized conditions such as the local existence, joint property of solutions and some energy inequalities. The results established have nothing to do with the concrete forms of the systems and, thus, give the extending mechanisms in a unified way to all systems obeying the axiomatized conditions. The key tools are several new multiplicative interpolation inequalities of Besov type, which have their own interests.


title: Knot Dynamics

abstract: We examine computer experiments that can be performed to understand the dynamics of knots under self-repulsion. In the course of specific computer exploration we use the knot theory of rational knots and rational tangles to produce classes of unknots with complex initial configurations that we call hard unknots, and corresponding complex configurations that are topologically equivalent to simpler knots. We shall see that these hard unknots and complexified knots give examples that do not reduce in the experimental space of the computer program. That is, we find unknotted configurations that will not reduce to simple circular forms under self-repulsion, and we find complex versions of knots that will not reduce to simpler forms under the self-repulsion. It is clear to us that the phenomena that we have discovered depend very little on the details of the computer program as long as it conforms to a general description of self-repulsion. Thus, we suggest on the basis of our experiments that sufficiently complex examples of hard unknots and sufficiently complex examples of complexified knots will not reduce to global minimal energy states in self-repulsion environments. In the course of the paper we make the character of these examples precise. It is a challenge to other program environments to verify or disprove these assertions.


title: Replica Wormholes from Liouville Theory

abstract: The replica wormholes are a key to the existence of the islands that play a central role in a recent proposal for the resolution of the black hole information paradox. In this paper, we study the replica wormholes in the JT gravity, a model of two-dimensional quantum gravity coupled to a non-dynamical dilaton, by making use of the 2$d$ conformal field theory (CFT) description, namely, the Liouville theory coupled to the $(2,p)$ minimal matter in the $p\to\infty$ limit. In the Liouville CFT description, the replica wormholes are created by the twist operators and the gravitational part of the bulk entanglement entropy can be reproduced from the twist operator correlators. We propose the precise dictionary and show how this correspondence works in detail.


title: Effects of $\bm\la$ hyperons on the deformations of even-even nuclei

abstract: The deformations of multi-$\la$ hypernuclei corresponding to even-even core nuclei ranging from $^8$Be to $^{40}$Ca with 2, 4, 6, and 8 hyperons are studied in the framework of the deformed Skyrme-Hartree-Fock approach. It is found that the deformations are reduced when adding 2 or 8 $\la$ hyperons, but enhanced when adding 4 or 6 $\la$ hyperons. These differences are attributed to the fact that $\la$ hyperons are filled gradually into the three deformed $p$ orbits, of which the [110]1/2$^-$ orbit is prolately deformed and the degenerate [101]1/2$^-$ and [101]3/2$^-$ orbits are oblately deformed.