title: Exploring Tenets of Data Democratization

abstract: Data democratization is an ongoing process that broadens access to data and facilitates employees to find, access, self-analyze, and share data without additional support. This data access management process enables organizations to make informed decisions, which in return enhances organizational performance. Technological advancements and extensive market pressure have mandated organizations to transform their traditional businesses into data-driven organizations, focusing on data democratization as a part of their data governance strategy. This paper explores the tenets of data democratization through an in-depth review of the literature. The analysis identified twelve attributes that enable data democratization based on the literature review. Future work will focus on testing and further empirically investigating these to develop a framework for the data democratization process to overcome the challenges.


title: Learning the policy for mixed electric platoon control of automated and human-driven vehicles at signalized intersection: a random search approach

abstract: The upgrading and updating of vehicles have accelerated in the past decades. Out of the need for environmental friendliness and intelligence, electric vehicles (EVs) and connected and automated vehicles (CAVs) have become new components of transportation systems. This paper develops a reinforcement learning framework to implement adaptive control for an electric platoon composed of CAVs and human-driven vehicles (HDVs) at a signalized intersection. Firstly, a Markov Decision Process (MDP) model is proposed to describe the decision process of the mixed platoon. Novel state representation and reward function are designed for the model to consider the behavior of the whole platoon. Secondly, in order to deal with the delayed reward, an Augmented Random Search (ARS) algorithm is proposed. The control policy learned by the agent can guide the longitudinal motion of the CAV, which serves as the leader of the platoon. Finally, a series of simulations are carried out in simulation suite SUMO. Compared with several state-of-the-art (SOTA) reinforcement learning approaches, the proposed method can obtain a higher reward. Meanwhile, the simulation results demonstrate the effectiveness of the delay reward, which is designed to outperform distributed reward mechanism} Compared with normal car-following behavior, the sensitivity analysis reveals that the energy can be saved to different extends (39.27%-82.51%) by adjusting the relative importance of the optimization goal. On the premise that travel delay is not sacrificed, the proposed control method can save up to 53.64% electric energy.


title: Elementary excitations in a spin-orbit-coupled spin-1 Bose-Einstein condensate

abstract: While a spin-orbit-coupled spin-1 Bose-Einstein condensate has been experimentally observed, its elementary excitations remain unclear in the stripe phase. Here, we systematically study the elementary excitations in three distinct phases of a spin-orbit-coupled spin-1 Bose-Einstein condensate. We find that the excitation spectrum as well as the corresponding static response function and structure factor depend strongly on spin-orbit coupling parameters such as the quadratic Zeeman field and the Rabi frequency. In the stripe phase, besides two gapless Goldstone modes, we show the existence of roton excitations. Finally, we demonstrate that quantum phase transitions between these different phases including the zero-momentum, plane wave and stripe phases are characterized by the sound velocities and the quantum depletion.


title: Quark anomalous magnetic moment leads to the inverse magnetic catalysis phenomena of chiral restoration and deconfinement phase transitions in $\mu_B-T$ plane

abstract: The effect of quark anomalous magnetic moment (AMM) to chiral restoration and deconfinement phase transitions in baryon chemical potential-temperature $(\mu_B-T)$ plane under magnetic fields is investigated in frame of a Pauli-Villars regularized PNJL model. It's found that the quark AMM plays the role of inverse catalysis to the phase transitions, and large quark AMM will change the magnetic catalysis phenomena of phase transitions to inverse magnetic catalysis in the whole $\mu_B-T$ plane. For a fixed magnetic field, the critical temperature $T_c$ and critical baryon chemical potential $\mu_B^c$ decreases with quark AMM. The stronger the magnetic field is, the inverse catalysis effect of AMM becomes more important. For a small AMM $\kappa=\kappa_1$, it shows the magnetic catalysis effect for critical temperature $T_c$ at vanishing $\mu_B$ with increasing magnetic field, and (inverse) magnetic catalysis effect for critical baryon chemical potential $\mu_B^c$ at vanishing $T$ under (weak) strong magnetic field. At finite $T$ and $\mu_B$, there exist some crossings of the phase transition lines with different magnetic field. For a large AMM $\kappa=\kappa_2$, we obtain the inverse magnetic catalysis effect in the whole $\mu_B-T$ plane, and no crossings of phase transition lines happen.


title: SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generation

abstract: We present a StyleGAN2-based deep learning approach for 3D shape generation, called SDF-StyleGAN, with the aim of reducing visual and geometric dissimilarity between generated shapes and a shape collection. We extend StyleGAN2 to 3D generation and utilize the implicit signed distance function (SDF) as the 3D shape representation, and introduce two novel global and local shape discriminators that distinguish real and fake SDF values and gradients to significantly improve shape geometry and visual quality. We further complement the evaluation metrics of 3D generative models with the shading-image-based Fr\'echet inception distance (FID) scores to better assess visual quality and shape distribution of the generated shapes. Experiments on shape generation demonstrate the superior performance of SDF-StyleGAN over the state-of-the-art. We further demonstrate the efficacy of SDF-StyleGAN in various tasks based on GAN inversion, including shape reconstruction, shape completion from partial point clouds, single-view image-based shape generation, and shape style editing. Extensive ablation studies justify the efficacy of our framework design. Our code and trained models are available at https://github.com/Zhengxinyang/SDF-StyleGAN.


title: A new family of nonconforming elements with $\pmb{H}(\mathrm{curl})$-continuity for the three-dimensional quad-curl problem

abstract: We propose and analyze a new family of nonconforming finite elements for the three-dimensional quad-curl problem. The proposed finite element spaces are subspaces of $\pmb{H}(\mathrm{curl})$, but not of $\pmb{H}(\mathrm{grad}~\mathrm{curl})$, which are different from the existing nonconforming ones. The well-posedness of the discrete problem is proved and optimal error estimates in discrete $\pmb{H}(\mathrm{grad}~\mathrm{curl})$ norm, $\pmb{H}(\mathrm{curl})$ norm and $\pmb{L}^2$ norm are derived. Numerical experiments are provided to illustrate the good performance of the method and confirm our theoretical predictions.


title: Single-colored ADO-3 invariant is a specialization of Links-Gould invariant for closures of 5-braids

abstract: We prove that for knots and links that are closures of 5-braids, single-colored ADO-invariant of third order coincides with Links-Gould polynomial with specific choice of variables. We also conjecture that this is true for any knots and links and provide some arguments for that.


title: A central limit theorem for square ice

abstract: We prove that the height function associated with the uniform six-vertex model (or equivalently, the uniform homomorphism height function from $\mathbb Z^2$ to $\mathbb Z$) satisfies a central limit theorem, upon some logarithmic rescaling.


title: Data Augmentation and Squeeze-and-Excitation Network on Multiple Dimension for Sound Event Localization and Detection in Real Scenes

abstract: Performance of sound event localization and detection (SELD) in real scenes is limited by small size of SELD dataset, due to difficulty in obtaining sufficient amount of realistic multi-channel audio data recordings with accurate label. We used two main strategies to solve problems arising from the small real SELD dataset. First, we applied various data augmentation methods on all data dimensions: channel, frequency and time. We also propose original data augmentation method named Moderate Mixup in order to simulate situations where noise floor or interfering events exist. Second, we applied Squeeze-and-Excitation block on channel and frequency dimensions to efficiently extract feature characteristics. Result of our trained models on the STARSS22 test dataset achieved the best ER, F1, LE, and LR of 0.53, 49.8%, 16.0deg., and 56.2% respectively.


title: Dual Power Spectrum Manifold and Toeplitz HPD Manifold: Enhancement and Analysis for Matrix CFAR Detection

abstract: Recently, an innovative matrix CFAR detection scheme based on information geometry, also referred to as the geometric detector, has been developed speedily and exhibits distinct advantages in several practical applications. These advantages benefit from the geometry of the Toeplitz Hermitian positive definite (HPD) manifold $\mathcal{M}_{\mathcal{T}H_{++}}$, but the sophisticated geometry also results in some challenges for geometric detectors, such as the implementation of the enhanced detector to improve the SCR (signal-to-clutter ratio) and the analysis of the detection performance. To meet these challenges, this paper develops the dual power spectrum manifold $\mathcal{M}_{\text{P}}$ as the dual space of $\mathcal{M}_{\mathcal{T}H_{++}}$. For each affine invariant geometric measure on $\mathcal{M}_{\mathcal{T}H_{++}}$, we show that there exists an equivalent function named induced potential function on $\mathcal{M}_{\text{P}}$. By the induced potential function, the measurements of the dissimilarity between two matrices can be implemented on $\mathcal{M}_{\text{P}}$, and the geometric detectors can be reformulated as the form related to the power spectrum. The induced potential function leads to two contributions: 1) The enhancement of the geometric detector, which is formulated as an optimization problem concerning $\mathcal{M}_{\mathcal{T}H_{++}}$, is transformed to an equivalent and simpler optimization on $\mathcal{M}_{\text{P}}$. In the presented example of the enhancement, the closed-form solution, instead of the gradient descent method, is provided through the equivalent optimization. 2) The detection performance is analyzed based on $\mathcal{M}_{\text{P}}$, and the advantageous characteristics, which benefit the detection performance, can be deduced by analyzing the corresponding power spectrum to the maximal point of the induced potential function.


title: On the Infimal Sub-differential Size of Primal-Dual Hybrid Gradient Method and Beyond

abstract: Primal-dual hybrid gradient method (PDHG, a.k.a. Chambolle and Pock method) is a well-studied algorithm for minimax optimization problems with a bilinear interaction term. Recently, PDHG is used as the base algorithm for a new LP solver PDLP that aims to solve large LP instances by taking advantage of modern computing resources, such as GPU and distributed system. Most of the previous convergence results of PDHG are either on duality gap or on distance to the optimal solution set, which are usually hard to compute during the solving process. In this paper, we propose a new progress metric for analyzing PDHG, which we dub infimal sub-differential size (IDS), by utilizing the geometry of PDHG iterates. IDS is a natural extension of the gradient norm of smooth problems to non-smooth problems, and it is tied with KKT error in the case of LP. Compared to traditional progress metrics for PDHG, IDS always has a finite value and can be computed only using information of the current solution. We show that IDS monotonically decays, and it has an $\mathcal O(\frac{1}{k})$ sublinear rate for solving convex-concave primal-dual problems, and it has a linear convergence rate if the problem further satisfies a regularity condition that is satisfied by applications such as linear programming, quadratic programming, TV-denoising model, etc. The simplicity of our analysis and the monotonic decay of IDS suggest that IDS is a natural progress metric to analyze PDHG. As a by-product of our analysis, we show that the primal-dual gap has $\mathcal O(\frac{1}{\sqrt{k}})$ convergence rate for the last iteration of PDHG for convex-concave problems. The analysis and results on PDHG can be directly generalized to other primal-dual algorithms, for example, proximal point method (PPM), alternating direction method of multipliers (ADMM) and linearized alternating direction method of multipliers (l-ADMM).


title: Mobile Devices and Sensors for Physics Teaching

abstract: This Resource Letter provides a guide to the literature on teaching experimental physics using sensors in tablets, smartphones, and some specialized devices. After a general discussion of the hardware (sensors) and the software (apps), we present resources for experiments using mobile-device sensors in many areas of physics education: mechanics, oscillations and waves, optics, electromagnetism, matter, modern physics, and astronomy.


title: Mutual Information-guided Knowledge Transfer for Novel Class Discovery

abstract: We tackle the novel class discovery problem, aiming to discover novel classes in unlabeled data based on labeled data from seen classes. The main challenge is to transfer knowledge contained in the seen classes to unseen ones. Previous methods mostly transfer knowledge through sharing representation space or joint label space. However, they tend to neglect the class relation between seen and unseen categories, and thus the learned representations are less effective for clustering unseen classes. In this paper, we propose a principle and general method to transfer semantic knowledge between seen and unseen classes. Our insight is to utilize mutual information to measure the relation between seen classes and unseen classes in a restricted label space and maximizing mutual information promotes transferring semantic knowledge. To validate the effectiveness and generalization of our method, we conduct extensive experiments both on novel class discovery and general novel class discovery settings. Our results show that the proposed method outperforms previous SOTA by a significant margin on several benchmarks.


title: The sensors of mobile devices: a innovative tool in the teaching of physical sciences

abstract: We show how builtin sensors in mobile devices can be used as portable laboratories at the service of teaching experimental sciences, especially physics, in the last years of high school and first years of university. We describe experiments that previously required expensive apparatus or were not feasible in teaching laboratories. Finally, we discuss some perspectives about the use of sensors in the physics teaching.


title: Eco-driving for Electric Connected Vehicles at Signalized Intersections: A Parameterized Reinforcement Learning approach

abstract: This paper proposes an eco-driving framework for electric connected vehicles (CVs) based on reinforcement learning (RL) to improve vehicle energy efficiency at signalized intersections. The vehicle agent is specified by integrating the model-based car-following policy, lane-changing policy, and the RL policy, to ensure safe operation of a CV. Subsequently, a Markov Decision Process (MDP) is formulated, which enables the vehicle to perform longitudinal control and lateral decisions, jointly optimizing the car-following and lane-changing behaviors of the CVs in the vicinity of intersections. Then, the hybrid action space is parameterized as a hierarchical structure and thereby trains the agents with two-dimensional motion patterns in a dynamic traffic environment. Finally, our proposed methods are evaluated in SUMO software from both a single-vehicle-based perspective and a flow-based perspective. The results show that our strategy can significantly reduce energy consumption by learning proper action schemes without any interruption of other human-driven vehicles (HDVs).


title: Images and photon ring signatures of thick disks around black holes

abstract: High-frequency very-long-baseline interferometry (VLBI) observations can now resolve the horizon-scale emission from sources in the immediate vicinity of nearby supermassive black holes. Future space-VLBI observations will access highly lensed features of black hole images -- photon rings -- that will provide particularly sharp probes of strong-field gravity. Focusing on the particular case of the supermassive black hole M87*, our goal is to explore a wide variety of accretion flows onto a Kerr black hole and to understand their corresponding images and visibilities. We are particularly interested in the visibility on baselines to space, which encodes the photon ring shape and whose measurement could provide a stringent test of the Kerr hypothesis. We develop a fully analytical model of stationary, axisymmetric accretion flows with a variable disk thickness and a matter four-velocity that can smoothly interpolate between purely azimuthal rotation and purely radial infall. We then determine the observational appearance of such flows, taking care to include the effects of thermal synchrotron emission and absorption. Our images generically display a "wedding cake" structure composed of discrete, narrow photon rings (n=1,2,...) stacked on top of broader primary emission that surrounds a central brightness depression of model-dependent size. We find that the "black hole shadow" is a model-dependent phenomenon -- even for diffuse, optically thin sources -- and should not be regarded as a generic prediction of general relativity. At 230 GHz, the n=1 ring is always visible, but the n=2 ring is sometimes suppressed due to absorption. At 345 GHz, the medium is optically thinner and the n=2 ring displays clear signatures in both the image and visibility domains, identifying this frequency as more promising for future space-VLBI measurements of the photon ring shape.


title: Nonzero-Sum Risk-Sensitive Stochastic Differential Games: A Multi-parameter Eigenvalue Problem Approach

abstract: We study nonzero-sum stochastic differential games with risk-sensitive ergodic cost criterion. Under certain conditions, using multi-parameter eigenvalue approach, we establish the existence of a Nash equilibrium in the space of stationary Markov strategies. We achieve our results by studying the relevant systems of coupled HJB equations. Exploiting the stochastic representation of the principal eigenfunctions we completely characterize Nash equilibrium points in the space of stationary Markov strategies.


title: Searching for multiple populations in star clusters using the China Space Station Telescope

abstract: Multiple stellar populations (MPs) in most star clusters older than 2 Gyr, as seen by lots of spectroscopic and photometric studies, have led to a significant challenge to the traditional view of star formation. In this field, space-based instruments, in particular the Hubble Space Telescope (HST), have made a breakthrough as they significantly improved the efficiency of detecting MPs in crowding stellar fields by images. The China Space Station Telescope (CSST) and the HST are sensitive to a similar wavelength interval, but it covers a field of view which is about 5-8 times wider than that of HST. One of its instruments, the Multi-Channel Imager (MCI), will have multiple filters covering a wide wavelength range from NUV to NIR, making the CSST a potentially powerful tool for studying MPs in clusters. In this work, we evaluate the efficiency of the designed filters for the MCI/CSST in revealing MPs in different color-magnitude diagrams (CMDs). We find that CMDs made with MCI/CSST photometry in appropriate UV filters are powerful tools to disentangle stellar populations with different abundances of He, C, N, O and Mg. On the contrary, the traditional CMDs are blind to multiple populations in globular clusters (GCs). We show that CSST has the potential of being the spearhead instrument for investigating MPs in GCs in the next decades.


title: Ultrasensitive Sub-monolayer Palladium Induced Chirality Switching and Topological Evolution of Skyrmions

abstract: Chiral spin textures are fundamentally interesting, with promise for device applications. Stabilizing chirality is conventionally achieved by introducing Dzyaloshinskii-Moriya interaction (DMI) in asymmetric multilayers where the thickness of each layer is at least a few monolayers. Here we report an ultrasensitive chirality switching in (Ni/Co)n multilayer induced by capping with only 0.22 monolayer of Pd. Using spin-polarized low-energy electron microscopy, we monitor the gradual evolution of domain walls from left-handed to right-handed Neel walls and quantify the DMI induced by the Pd capping layer. We also observe the chiral evolution of a skyrmion during the DMI switching, where no significant topological protection is found as the skyrmion winding number varies. This corresponds to a minimum energy cost of < 1 attojoule during the skyrmion chirality switching. Our results demonstrate the detailed chirality evolution within skyrmions during the DMI sign switching, which is relevant to practical applications of skyrmionic devices.


title: New Classes of Binary Sequences with High Merit Factor

abstract: The Merit Factor (MF) measure was first introduced by Golay in 1972. Sequences possessing large values of MF are of great interest to a rich list of disciplines - from physics and chemistry to digital communications, signal processing, and cryptography. Throughout the last half-century, manifold approaches and strategies were proposed for finding such sequences. Referenced as one of the most difficult optimization problems, Golay wrote that it is a "challenging and charming problem". His publications on this problem spanned more than 20 years. Golay himself introduced one beneficial class of sequences, called skew-symmetric sequences, or finite binary sequences with odd lengths with alternate autocorrelation values equal to 0. Their sieving construction greatly reduces the computational efforts of finding binary sequences with odd lengths and high MF. Having this in mind, the majority of papers to be found in the literature are focused solely on this class, preferring them over binary sequences with even lengths. In this work, a new class of finite binary sequences with even lengths with alternate autocorrelation absolute values equal to 1 is presented. We show that the MF values of the new class are closely related to the MF values of adjacent classes of skew-symmetric sequences. We further introduce new sub-classes of sequences using the partition number problem and the notion of potentials, measured by helper ternary sequences. Throughout our experiments, MF records for binary sequences with many lengths less than 225, and all lengths greater than 225, are discovered. Binary sequences of all lengths, odd or even, less than $2^8$ and with MF $>8$, and all lengths, odd or even, less than $2^9$ and with MF $>7$, are now revealed.


title: Contrastive Learning of Features between Images and LiDAR

abstract: Image and Point Clouds provide different information for robots. Finding the correspondences between data from different sensors is crucial for various tasks such as localization, mapping, and navigation. Learning-based descriptors have been developed for single sensors; there is little work on cross-modal features. This work treats learning cross-modal features as a dense contrastive learning problem. We propose a Tuple-Circle loss function for cross-modality feature learning. Furthermore, to learn good features and not lose generality, we developed a variant of widely used PointNet++ architecture for point cloud and U-Net CNN architecture for images. Moreover, we conduct experiments on a real-world dataset to show the effectiveness of our loss function and network structure. We show that our models indeed learn information from both images as well as LiDAR by visualizing the features.


title: On super cluster algebras based on super Pl\"ucker and super Ptolemy relations

abstract: We study super cluster algebra structure arising in examples provided by super Pl\"{u}cker and super Ptolemy relations. We develop the super cluster structure of the super Grassmannians $\Gr_{2|0}(n|1)$ for arbitrary $n$, which was indicated earlier in our joint work with Th. Voronov. For the super Ptolemy relation for the decorated super Teichm\"{u}ller space of Penner-Zeitlin, we show how by a change of variables it can be transformed into the classical Ptolemy relation with the new even variables decoupled from odd variables. We also analyze super Pl\"{u}cker relations for general super Grassmannians and obtain a new simple form of the relations for $\Gr_{r|1}(n|1)$. To this end, we establish properties of Berezinians of certain type matrices (which we call ``wrong'').


title: MaskRange: A Mask-classification Model for Range-view based LiDAR Segmentation

abstract: Range-view based LiDAR segmentation methods are attractive for practical applications due to their direct inheritance from efficient 2D CNN architectures. In literature, most range-view based methods follow the per-pixel classification paradigm. Recently, in the image segmentation domain, another paradigm formulates segmentation as a mask-classification problem and has achieved remarkable performance. This raises an interesting question: can the mask-classification paradigm benefit the range-view based LiDAR segmentation and achieve better performance than the counterpart per-pixel paradigm? To answer this question, we propose a unified mask-classification model, MaskRange, for the range-view based LiDAR semantic and panoptic segmentation. Along with the new paradigm, we also propose a novel data augmentation method to deal with overfitting, context-reliance, and class-imbalance problems. Extensive experiments are conducted on the SemanticKITTI benchmark. Among all published range-view based methods, our MaskRange achieves state-of-the-art performance with $66.10$ mIoU on semantic segmentation and promising results with $53.10$ PQ on panoptic segmentation with high efficiency. Our code will be released.


title: Spin-charge induced scalarization of Kerr-Newman black-hole spacetimes

abstract: It has recently been demonstrated that Reissner-Nordstr\"om black holes in composed Einstein-Maxwell-scalar field theories can support static scalar field configurations with a non-minimal negative coupling to the Maxwell electromagnetic invariant of the charged spacetime. We here reveal the physically interesting fact that scalar field configurations with a non-minimal {\it positive} coupling to the spatially-dependent Maxwell electromagnetic invariant ${\cal F}\equiv F_{\mu\nu}F^{\mu\nu}$ can also be supported in black-hole spacetimes. Intriguingly, it is explicitly proved that the positive-coupling black-hole spontaneous scalarization phenomenon is induced by a non-zero combination $a\cdot Q\neq0$ of {\it both} the spin $a\equiv J/M$ and the electric charge $Q$ of the central supporting black hole. Using analytical techniques we prove that the regime of existence of the positive-coupling spontaneous scalarization phenomenon of Kerr-Newman black holes with horizon radius $r_+(M,a,Q)$ and a non-zero electric charge $Q$ (which, in principle, may be arbitrarily small) is determined by the {\it critical onset line} $(a/r_+)_{\text{critical}}=\sqrt{2}-1$. In particular, spinning and charged Kerr-Newman black holes in the composed Einstein-Maxwell-scalar field theory are spontaneously scalarized by the positively coupled fields in the dimensionless charge regime $0<{{Q}\over{M}}\leq\sqrt{2\sqrt{2}-2}$ if their dimensionless spin parameters lie above the critical onset line ${{a(Q)}\over{M}}\geq \big[{{a(Q)}\over{M}}\big]_{\text{critical}}={{1+\sqrt{1-2(2-\sqrt{2}){(Q/M)}^2}}\over{2\sqrt{2}}}$.


title: Cartesian closed coreflective subcategories of topological spaces determined by monotone convergence classes

abstract: We introduce the notion of an operation $\mathcal{P}$ and a $\mathcal{P}$-determined space. It is shown that a category is a coreflective full subcategory of $\bf Top$ if and only if it is equal to $\bf Top_{\mathcal{P}}$ for some idempotent and consistent operation $\mathcal{P}$, where $\bf Top_{\mathcal{P}}$ is the category of all $\mathcal{P}$-determined spaces. As concrete examples of $\mathcal{P}$-determined spaces, several classes of topological spaces determined by monotone convergence classes are investigated in detail. By the tool of $\mathbb{C}$-generated spaces, it is shown uniformly that categories of these examples of $\mathcal{P}$-determined spaces are all cartesian closed. Moreover, the exponential objects and categorical products of some categories in domain theory are shown to be closely related to those of $\bf DTop$, the category of directed spaces.


title: Synthesizing Rolling Bearing Fault Samples in New Conditions: A framework based on a modified CGAN

abstract: Bearings are one of the vital components of rotating machines that are prone to unexpected faults. Therefore, bearing fault diagnosis and condition monitoring is essential for reducing operational costs and downtime in numerous industries. In various production conditions, bearings can be operated under a range of loads and speeds, which causes different vibration patterns associated with each fault type. Normal data is ample as systems usually work in desired conditions. On the other hand, fault data is rare, and in many conditions, there is no data recorded for the fault classes. Accessing fault data is crucial for developing data-driven fault diagnosis tools that can improve both the performance and safety of operations. To this end, a novel algorithm based on Conditional Generative Adversarial Networks (CGANs) is introduced. Trained on the normal and fault data on any actual fault conditions, this algorithm generates fault data from normal data of target conditions. The proposed method is validated on a real-world bearing dataset, and fault data are generated for different conditions. Several state-of-the-art classifiers and visualization models are implemented to evaluate the quality of the synthesized data. The results demonstrate the efficacy of the proposed algorithm.


abstract: This work is concerned with the Dirac points for the honeycomb lattice with impenetrable obstacles arranged periodically in a homogeneous medium. We consider both the Dirichlet and Neumann eigenvalue problems and prove the existence of Dirac points for both eigenvalue problems at crossing of the lower band surfaces as well as higher band surfaces. Furthermore, we perform quantitative analysis for the eigenvalues and the slopes of two conical dispersion surfaces near each Dirac point based on a combination of the layer potential technique and asymptotic analysis. It is shown that the eigenvalues are in the neighborhood of the singular frequencies associated with the Green's function for the honeycomb lattice, and the slopes of the dispersion surfaces are reciprocal to the eigenvalues.


title: Multimodal sensor data fusion for in-situ classification of animal behavior using accelerometry and GNSS data

abstract: In this paper, we examine the use of data from multiple sensing modes, i.e., accelerometry and global navigation satellite system (GNSS), for classifying animal behavior. We extract three new features from the GNSS data, namely, distance from water point, median speed, and median estimated horizontal position error. We combine the information available from the accelerometry and GNSS data via two approaches. The first approach is based on concatenating the features extracted from both sensor data and feeding the concatenated feature vector into a multi-layer perceptron (MLP) classifier. The second approach is based on fusing the posterior probabilities predicted by two MLP classifiers. The input to each classifier is the features extracted from the data of one sensing mode. We evaluate the performance of the developed multimodal animal behavior classification algorithms using two real-world datasets collected via smart cattle collar tags and ear tags. The leave-one-animal-out cross-validation results show that both approaches improve the classification performance appreciably compared with using data of only one sensing mode. This is more notable for the infrequent but important behaviors of walking and drinking. The algorithms developed based on both approaches require little computational and memory resources hence are suitable for implementation on embedded systems of our collar tags and ear tags. However, the multimodal animal behavior classification algorithm based on posterior probability fusion is preferable to the one based on feature concatenation as it delivers better classification accuracy, has less computational and memory complexity, is more robust to sensor data failure, and enjoys better modularity.


title: On codimension one holomorphic distributions on compact toric orbifolds

abstract: The number of singularities, counted with multiplicity, of a generic codimension one holomorphic distribution on a compact toric orbifold is determined. As a consequence, we give the classification of regular distributions on rational normal scrolls and weighted projective spaces. Under certain conditions, we also prove that the singular set of a codimension one holomorphic foliation on a toric orbifold admits at least one irreducible component of codimension two, and we give a Darboux-Jouanolou type integrability theorem for codimension one holomorphic foliations. We illustrate our results with several examples.


title: Low-energy $^7$Li($n,\gamma$)$^8$Li and $^7$Be($p,\gamma$)$^8$B radiative capture reactions within the Skyrme Hartree-Fock approach

abstract: The electromagnetic dipole transitions in $^7$Be($p,\gamma$)$^8$B and $^7$Li($n,\gamma$)$^8$Li reactions at the keV-energy region were analyzed simultaneously within the Skyrme Hartree-Fock potential model. The Skyrme Hartree-Fock calculation is adopted as a microscopic approach to obtain consistently the single-particle bound and scattering states in the calculation of the radial overlap function within the potential model. All non-resonant and resonant electromagnetic dipole transitions are taken into account. The electric dipole transitions are successfully described with the slightest adjustment. The resonant magnetic dipole transitions at $633$ keV and $2184$ keV of $^7$Be($p,\gamma$)$^8$B reaction, and the one at $222$ keV of $^7$Li($n,\gamma$)$^8$Li are also analyzed. The astrophysical $\mathcal{S}_{17}(0)$ factor of $^7$Be($p,\gamma$)$^8$B reaction is found to be $22.3$ eV\,b.


title: Computationally Efficient PAC RL in POMDPs with Latent Determinism and Conditional Embeddings

abstract: We study reinforcement learning with function approximation for large-scale Partially Observable Markov Decision Processes (POMDPs) where the state space and observation space are large or even continuous. Particularly, we consider Hilbert space embeddings of POMDP where the feature of latent states and the feature of observations admit a conditional Hilbert space embedding of the observation emission process, and the latent state transition is deterministic. Under the function approximation setup where the optimal latent state-action $Q$-function is linear in the state feature, and the optimal $Q$-function has a gap in actions, we provide a \emph{computationally and statistically efficient} algorithm for finding the \emph{exact optimal} policy. We show our algorithm's computational and statistical complexities scale polynomially with respect to the horizon and the intrinsic dimension of the feature on the observation space. Furthermore, we show both the deterministic latent transitions and gap assumptions are necessary to avoid statistical complexity exponential in horizon or dimension. Since our guarantee does not have an explicit dependence on the size of the state and observation spaces, our algorithm provably scales to large-scale POMDPs.


title: Symbolic-Regression Boosting

abstract: Modifying standard gradient boosting by replacing the embedded weak learner in favor of a strong(er) one, we present SyRBo: Symbolic-Regression Boosting. Experiments over 98 regression datasets show that by adding a small number of boosting stages -- between 2--5 -- to a symbolic regressor, statistically significant improvements can often be attained. We note that coding SyRBo on top of any symbolic regressor is straightforward, and the added cost is simply a few more evolutionary rounds. SyRBo is essentially a simple add-on that can be readily added to an extant symbolic regressor, often with beneficial results.


title: Resolving Galactic binaries using a network of space-borne gravitational wave detectors

abstract: Extracting gravitational wave (GW) signals from individual Galactic binaries (GBs) against their self-generated confusion noise is a key data analysis challenge for space-borne detectors operating in the $\approx 0.1$ mHz to $\approx 10$ mHz range. Given the likely prospect that there will be multiple such detectors, namely LISA, Taiji, and Tianqin, with overlapping operational periods in the next decade, it is important to examine the extent to which the joint analysis of their data can benefit GB resolution and parameter estimation. To investigate this, we use realistic simulated LISA and Taiji data containing the set of $30\times 10^6$ GBs used in the first LISA data challenge (Radler), and an iterative source extraction method called GBSIEVER introduced in an earlier work. We find that a coherent network analysis of LISA-Taiji data boosts the number of confirmed sources by $\approx 75\%$ over that from a single detector. The residual after subtracting out the reported sources from the data of any one of the detectors is much closer to the confusion noise expected from an ideal, but infeasible, multisource resolution method that perfectly removes all sources above a given signal-to-noise ratio threshold. While parameter estimation for sources common to both the single detector and network improves broadly in line with the enhanced signal to noise ratio of GW sources in the latter, deviation from the scaling of error variance predicted by Fisher information analysis is observed for a subset of the parameters.


title: Functional Mixed Membership Models

abstract: Mixed membership models, or partial membership models, are a flexible unsupervised learning method that allows each observation to belong to multiple clusters. In this paper, we propose a Bayesian mixed membership model for functional data. By using the multivariate Karhunen-Lo\`eve theorem, we are able to derive a scalable representation of Gaussian processes that maintains data-driven learning of the covariance structure. Within this framework, we establish conditional posterior consistency given a known feature allocation matrix. Compared to previous work on mixed membership models, our proposal allows for increased modeling flexibility, with the benefit of a directly interpretable mean and covariance structure. Our work is motivated by studies in functional brain imaging through electroencephalography (EEG) of children with autism spectrum disorder (ASD). In this context, our work formalizes the clinical notion of "spectrum" in terms of feature membership proportions.


title: Using Host Galaxy Spectroscopy to Explore Systematics in the Standardisation of Type Ia Supernovae

abstract: We use stacked spectra of the host galaxies of photometrically identified type Ia supernovae (SNe Ia) from the Dark Energy Survey (DES) to search for correlations between Hubble diagram residuals and the spectral properties of the host galaxies. Utilising full spectrum fitting techniques on stacked spectra binned by Hubble residual, we find no evidence for trends between Hubble residuals and properties of the host galaxies that rely on spectral absorption features ($< 1.3\sigma$), such as stellar population age, metallicity, and mass-to-light ratio. However, we find significant trends between the Hubble residuals and the strengths of [OII] ($4.4\sigma$) and the Balmer emission lines ($3\sigma$). These trends are weaker than the well known trend between Hubble residuals and host galaxy stellar mass ($7.2\sigma$) that is derived from broad band photometry. After light curve corrections, we see fainter SNe Ia residing in galaxies with larger line strengths. We also find a trend (3$\sigma$) between Hubble residual and the Balmer decrement (a measure of reddening by dust) using H${\beta}$ and H${\gamma}$. The trend, quantified by correlation coefficients, is slightly more significant in the redder SNe Ia, suggesting that bluer SNe Ia are relatively unaffected by dust in the interstellar medium of the host and that dust contributes to current Hubble diagram scatter impacting the measurement of cosmological parameters.


title: On a class of singular Hamiltonian Choquard-type elliptic systems with critical exponential growth

abstract: In this paper, we study the following Hamiltonian Choquard-type elliptic systems involving singular weights \begin{eqnarray*} \begin{aligned}\displaystyle \left\{ \arraycolsep=1.5pt \begin{array}{ll} -\Delta u + V(x)u = \Big(I_{\mu_{1}}\ast \frac{G(v)}{|x|^{\alpha}}\Big)\frac{g(v)}{|x|^{\alpha}} \ \ \ & \mbox{in} \ \mathbb{R}^{2},\\[2mm] -\Delta v + V(x)v = \Big(I_{\mu_{2}}\ast \frac{F(u)}{|x|^{\beta}}\Big)\frac{f(u)}{|x|^{\beta}} \ \ \ & \mbox{in} \ \mathbb{R}^{2}, \end{array} \right. \end{aligned} \end{eqnarray*} where $\mu_{1},\mu_{2}\in(0,2)$, $0<\alpha \leq \frac{\mu_{1}}{2}$, $0<\beta \leq \frac{\mu_{2}}{2}$, $V(x)$ is a continuous positive potential, $I_{\mu_{1}}$ and $I_{\mu_{2}}$ denote the Riesz potential, $\ast$ indicates the convolution operator, $F(s),G(s)$ are the primitive of $f(s),g(s)$ with $f(s),g(s)$ have exponential growth in $\mathbb{R}^{2}$. Using the linking theorem and variational methods, we establish the existence of solutions to the above problem.


title: Knight's paths towards Catalan numbers

abstract: We provide enumerating results for partial knight's paths of a given size. We prove algebraically that zigzag knight's paths of a given size ending on the $x$-axis are enumerated by the generalized Catalan numbers, and we give a constructive bijection with peakless Motzkin paths of a given length. After enumerating partial knight's paths of a given length, we prove that zigzag knight's paths of a given length ending on the $x$-axis are counted by the Catalan numbers. Finally, we give a constructive bijection with Dyck paths of a given length.


title: Classifying Unstructured Clinical Notes via Automatic Weak Supervision

abstract: Healthcare providers usually record detailed notes of the clinical care delivered to each patient for clinical, research, and billing purposes. Due to the unstructured nature of these narratives, providers employ dedicated staff to assign diagnostic codes to patients' diagnoses using the International Classification of Diseases (ICD) coding system. This manual process is not only time-consuming but also costly and error-prone. Prior work demonstrated potential utility of Machine Learning (ML) methodology in automating this process, but it has relied on large quantities of manually labeled data to train the models. Additionally, diagnostic coding systems evolve with time, which makes traditional supervised learning strategies unable to generalize beyond local applications. In this work, we introduce a general weakly-supervised text classification framework that learns from class-label descriptions only, without the need to use any human-labeled documents. It leverages the linguistic domain knowledge stored within pre-trained language models and the data programming framework to assign code labels to individual texts. We demonstrate the efficacy and flexibility of our method by comparing it to state-of-the-art weak text classifiers across four real-world text classification datasets, in addition to assigning ICD codes to medical notes in the publicly available MIMIC-III database.


title: Evolution of Activation Functions for Deep Learning-Based Image Classification

abstract: Activation functions (AFs) play a pivotal role in the performance of neural networks. The Rectified Linear Unit (ReLU) is currently the most commonly used AF. Several replacements to ReLU have been suggested but improvements have proven inconsistent. Some AFs exhibit better performance for specific tasks, but it is hard to know a priori how to select the appropriate one(s). Studying both standard fully connected neural networks (FCNs) and convolutional neural networks (CNNs), we propose a novel, three-population, coevolutionary algorithm to evolve AFs, and compare it to four other methods, both evolutionary and non-evolutionary. Tested on four datasets -- MNIST, FashionMNIST, KMNIST, and USPS -- coevolution proves to be a performant algorithm for finding good AFs and AF architectures.


title: Fragment productions in DJBUU and SQMD: comparative study

abstract: We study $^{208}$Pb+$^{40,48}$Ca reactions at $E_{\rm beam}$ = 50, 100 AMeV with DJBUU and SQMD transport codes. We compare the large primary fragments from the two codes at the end of the simulation time. We observe that overall the two models produce similar fragments. However, we see a noticeable difference between DJBUU and SQMD at $E_{\rm beam}=100$ AMeV with the impact parameter $b$ = 0 fm and discuss this difference in terms of the difference in the equation of state adopted in the two models and the difference in stability inherent to the BUU-type and QMD-type models.


title: Using Differential Geometry to Revisit the Paradoxes of the Instantaneous Frequency

abstract: This paper proposes a general framework to interpret the concept of Instantaneous Frequency (IF) in three-phase systems. The paper first recalls the conventional frequency-domain analysis based on the Fourier transform as well as the definition of IF which is based on the concept of analytic signals. The link between analytic signals and Clarke transform of three-phase voltages of an ac power system is also shown. Then the well-known five paradoxes of the IF are stated. In the second part of the paper, an approach based on a geometric interpretation of the frequency is proposed. This approach serves to revisit the five IF paradoxes and explain them through a common framework. The case study illustrates the features of the proposed framework based on a variety of examples and on a detailed model of the IEEE 39-bus system.


title: Steiner Type Packing Problems in Digraphs: A Survey

abstract: Graph packing problem is one of the central problems in graph theory and combinatorial optimization. The famous Steiner tree packing problem in undirected graphs has become an well-established area. It is natural to extend this problem to digraphs. In this survey we overview known results on several Steiner type packing problems in digraphs. The paper is divided into six sections: introduction, directed Steiner tree packing problem, directed Steiner path packing problem, strong subgraph packing problem, strong arc decomposition problem, directed Steiner cycle packing problem. This survey also contains some conjectures and open problems for further study.


title: An Improved Lattice-Based Ring Signature with Unclaimable Anonymity in the Standard Model

abstract: Ring signatures enable a user to sign messages on behalf of an arbitrary set of users, called the ring, without revealing exactly which member of that ring actually generated the signature. The signer-anonymity property makes ring signatures have been an active research topic. Recently, Park and Sealfon (CRYPTO 19) presented an important anonymity notion named signer-unclaimability and constructed a lattice-based ring signature scheme with unclaimable anonymity in the standard model, however, it did not consider the unforgeable w.r.t. adversarially-chosen-key attack (the public key ring of a signature may contain keys created by an adversary) and the signature size grows quadratically in the size of ring and message. In this work, we propose a new lattice-based ring signature scheme with unclaimable anonymity in the standard model. In particular, our work improves the security and efficiency of Park and Sealfons work, which is unforgeable w.r.t. adversarially-chosen-key attack, and the ring signature size grows linearly in the ring size.


title: Unified BERT for Few-shot Natural Language Understanding

abstract: Even as pre-trained language models share a semantic encoder, natural language understanding suffers from a diversity of output schemas. In this paper, we propose UBERT, a unified bidirectional language understanding model based on BERT framework, which can universally model the training objects of different NLU tasks through a biaffine network. Specifically, UBERT encodes prior knowledge from various aspects, uniformly constructing learning representations across multiple NLU tasks, which is conducive to enhancing the ability to capture common semantic understanding. By using the biaffine to model scores pair of the start and end position of the original text, various classification and extraction structures can be converted into a universal, span-decoding approach. Experiments show that UBERT wins the first price in the 2022 AIWIN - World Artificial Intelligence Innovation Competition, Chinese insurance few-shot multi-task track, and realizes the unification of extensive information extraction and linguistic reasoning tasks.


title: Leverage Ratio: An empirical study of the European banking system

abstract: This paper empirically analyzes a dataset published by the European Banking Authority. Our main aim was to study how the Leverage Ratio is affected by adverse financial scenarios. This was be followed by observing how Leverage Ratio exposures are correlated to various other financial variables and how various regression techniques can be used to explain the correlation.


title: Associativity and the cosmash product in operadic varieties of algebras

abstract: In this article, we characterise the operadic variety of commutative associative algebras over a field via a (categorical) condition: the associativity of the so-called cosmash product. This condition, which is closely related to commutator theory, is quite strong: for example, groups do not satisfy it. However, in the case of commutative associative algebras, the cosmash product is nothing more than the tensor product; which explains why in this case it is associative. We prove that in the setting of operadic varieties of algebras over a field, it is the only example. Further examples in the non-operadic case are also discussed.


title: Deep-Learning-Aided Distributed Clock Synchronization for Wireless Networks

abstract: The proliferation of wireless communications networks over the past decades, combined with the scarcity of the wireless spectrum, have motivated a significant effort towards increasing the throughput of wireless networks. One of the major factors which limits the throughput in wireless communications networks is the accuracy of the time synchronization between the nodes in the network, as a higher throughput requires higher synchronization accuracy. Existing time synchronization schemes, and particularly, methods based on pulse-coupled oscillators (PCOs), which are the focus of the current work, have the advantage of simple implementation and achieve high accuracy when the nodes are closely located, yet tend to achieve poor synchronization performance for distant nodes. In this study, we propose a robust PCO-based time synchronization algorithm which retains the simple structure of existing approaches while operating reliably and converging quickly for both distant and closely located nodes. This is achieved by augmenting PCO-based synchronization with deep learning tools that are trainable in a distributed manner, thus allowing the nodes to train their neural network component of the synchronization algorithm without requiring additional exchange of information or central coordination. The numerical results show that our proposed deep learning-aided scheme is notably robust to propagation delays resulting from deployments over large areas, and to relative clock frequency offsets. It is also shown that the proposed approach rapidly attains full (i.e., clock frequency and phase) synchronization for all nodes in the wireless network, while the classic model-based implementation does not.


title: Light-induced Magnetic Phase Transition in van der Waals Antiferromagnets

abstract: Based on a simple tight-binding model, we propose a general theory of light-induced magnetic phase transition (MPT) in antiferromagnets based on the general conclusion that the bandgap of antiferromagnetic (AFM) phase is usually larger than that of ferromagnetic (FM) one in a given system. Light-induced electronic excitation prefers to stabilize the FM state over the AFM one, and once the critical photocarrier concentration ({\alpha}_c) is reached, an MPT from AFM phase to FM phase takes place. This theory has been confirmed by performing first-principles calculations on a series of two-dimensional (2D) van der Waals (vdW) antiferromagnets and a linear relationship between {\alpha}_c and the intrinsic material parameters is obtained. Importantly, our conclusion is still valid even considering the strong exciton effects during photoexcitation. Our general theory provides new ideas to realize reversible read-write operations for future memory devices.


title: A novel approach for glaucoma classification by wavelet neural networks using graph-based, statisitcal features of qualitatively improved images

abstract: In this paper, we have proposed a new glaucoma classification approach that employs a wavelet neural network (WNN) on optimally enhanced retinal images features. To avoid tedious and error prone manual analysis of retinal images by ophthalmologists, computer aided diagnosis (CAD) substantially aids in robust diagnosis. Our objective is to introduce a CAD system with a fresh approach. Retinal image quality improvement is attempted in two phases. The retinal image preprocessing phase improves the brightness and contrast of the image through quantile based histogram modification. It is followed by the image enhancement phase, which involves multi scale morphological operations using image specific dynamic structuring elements for the retinal structure enrichment. Graph based retinal image features in terms of Local Graph Structures (LGS) and Graph Shortest Path (GSP) statistics are extracted from various directions along with the statistical features from the enhanced retinal dataset. WNN is employed to classify glaucoma retinal images with a suitable wavelet activation function. The performance of the WNN classifier is compared with multilayer perceptron neural networks with various datasets. The results show our approach is superior to the existing approaches.


title: zPROBE: Zero Peek Robustness Checks for Federated Learning

abstract: Privacy-preserving federated learning allows multiple users to jointly train a model with coordination of a central server. The server only learns the final aggregation result, thus the users' (private) training data is not leaked from the individual model updates. However, keeping the individual updates private allows malicious users to perform Byzantine attacks and degrade the accuracy without being detected. Best existing defenses against Byzantine workers rely on robust rank-based statistics, e.g., median, to find malicious updates. However, implementing privacy-preserving rank-based statistics is nontrivial and not scalable in the secure domain, as it requires sorting all individual updates. We establish the first private robustness check that uses high break point rank-based statistics on aggregated model updates. By exploiting randomized clustering, we significantly improve the scalability of our defense without compromising privacy. We leverage our statistical bounds in zero-knowledge proofs to detect and remove malicious updates without revealing the private user updates. Our novel framework, zPROBE, enables Byzantine resilient and secure federated learning. Empirical evaluations demonstrate that zPROBE provides a low overhead solution to defend against state-of-the-art Byzantine attacks while preserving privacy.


title: Do You Know My Emotion? Emotion-Aware Strategy Recognition towards a Persuasive Dialogue System

abstract: Persuasive strategy recognition task requires the system to recognize the adopted strategy of the persuader according to the conversation. However, previous methods mainly focus on the contextual information, little is known about incorporating the psychological feedback, i.e. emotion of the persuadee, to predict the strategy. In this paper, we propose a Cross-channel Feedback memOry Network (CFO-Net) to leverage the emotional feedback to iteratively measure the potential benefits of strategies and incorporate them into the contextual-aware dialogue information. Specifically, CFO-Net designs a feedback memory module, including strategy pool and feedback pool, to obtain emotion-aware strategy representation. The strategy pool aims to store historical strategies and the feedback pool is to obtain updated strategy weight based on feedback emotional information. Furthermore, a cross-channel fusion predictor is developed to make a mutual interaction between the emotion-aware strategy representation and the contextual-aware dialogue information for strategy recognition. Experimental results on \textsc{PersuasionForGood} confirm that the proposed model CFO-Net is effective to improve the performance on M-F1 from 61.74 to 65.41.


title: Ground state selection by magnon interactions in the fcc antiferromagnet

abstract: We study the nearest-neighbor Heisenberg antiferromagnet on a face-centered cubic lattice with arbitrary spin S. The model exhibits degenerate classical ground states including two collinear structures AF1 and AF3 described by different propagation vectors that are prime candidates for the quantum ground state. We compute the energy for each of the two states as a function of S using the spin-wave theory that includes magnon-magnon interaction in a self-consistent way and the numerical coupled cluster method. Our results unambiguously demonstrate that quantum fluctuations stabilize the AF1 state for realistic values of spin. Transition to the harmonic spin-wave result, which predicts the AF3 state, takes place only for S > 10. We also study quantum renormalization of the magnon spectra for both states as a function of spin.


title: Radio evolution of a Type IIb supernova SN 2016gkg

abstract: We present extensive radio monitoring of a type IIb supernova (SN IIb), SN 2016gkg during $t \sim$ 8$-$1429 days post explosion at frequencies $\nu \sim$ 0.33$-$25 GHz. The detailed radio light curves and spectra are broadly consistent with self-absorbed synchrotron emission due to the interaction of the SN shock with the circumstellar medium. The model underpredicts the flux densities at $t \sim$ 299 days post-explosion by a factor of 2, possibly indicating a density enhancement in the CSM due to a non-uniform mass-loss from the progenitor. Assuming a wind velocity $v_{\rm w} \sim$ 200 km s$^{-1}$, we estimate the mass-loss rate to be $\dot{M} \sim$ (2.2, 3.6, 3.8, 12.6, 3.7, and 5.0) $\times$ 10$^{-6}$ $M_{\odot}$ yr$^{-1}$ during $\sim$ 8, 15, 25, 48, 87, and 115 years, respectively before the explosion. The shock wave from SN 2016gkg is expanding from $R \sim$ 0.5 $\times$ 10$^{16}$ to 7 $\times$ 10$^{16}$ cm during $t \sim$ 24$-$492 days post-explosion indicating a shock deceleration index, $m$ $\sim$ 0.8 ($R \propto t^m$), and mean shock velocity $v \sim$ 0.1c. The radio data being inconsistent with free-free absorption model and higher shock velocities are in support of a relatively compact progenitor for SN 2016gkg.


title: On Structural Explanation of Bias in Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have shown satisfying performance in various graph analytical problems. Hence, they have become the \emph{de facto} solution in a variety of decision-making scenarios. However, GNNs could yield biased results against certain demographic subgroups. Some recent works have empirically shown that the biased structure of the input network is a significant source of bias for GNNs. Nevertheless, no studies have systematically scrutinized which part of the input network structure leads to biased predictions for any given node. The low transparency on how the structure of the input network influences the bias in GNN outcome largely limits the safe adoption of GNNs in various decision-critical scenarios. In this paper, we study a novel research problem of structural explanation of bias in GNNs. Specifically, we propose a novel post-hoc explanation framework to identify two edge sets that can maximally account for the exhibited bias and maximally contribute to the fairness level of the GNN prediction for any given node, respectively. Such explanations not only provide a comprehensive understanding of bias/fairness of GNN predictions but also have practical significance in building an effective yet fair GNN model. Extensive experiments on real-world datasets validate the effectiveness of the proposed framework towards delivering effective structural explanations for the bias of GNNs. Open-source code can be found at https://github.com/yushundong/REFEREE.


title: Exponential data encoding for quantum supervised learning

abstract: Reliable quantum supervised learning of a multivariate function mapping depends on the expressivity of the corresponding quantum circuit and measurement resources. We introduce exponential-data-encoding strategies that are hardware-efficient and optimal amongst all non-entangling Pauli-encoded schemes, which is sufficient for a quantum circuit to express general functions having very broad Fourier frequency spectra using only exponentially few encoding gates. We show that such an encoding strategy not only reduces the quantum resources, but also exhibits practical resource advantage during training in contrast with known efficient classical strategies when polynomial-depth training circuits are also employed. When computation resources are constrained, we numerically demonstrate that even exponential-data-encoding circuits with single-layer training modules can generally express functions that lie outside the classically-expressible region, thereby supporting the practical benefits of such a resource advantage. Finally, we illustrate the performance of exponential encoding in learning the potential-energy surface of the ethanol molecule and California's housing prices


title: TreeDRNet:A Robust Deep Model for Long Term Time Series Forecasting

abstract: Various deep learning models, especially some latest Transformer-based approaches, have greatly improved the state-of-art performance for long-term time series forecasting.However, those transformer-based models suffer a severe deterioration performance with prolonged input length, which prohibits them from using extended historical info.Moreover, these methods tend to handle complex examples in long-term forecasting with increased model complexity, which often leads to a significant increase in computation and less robustness in performance(e.g., overfitting). We propose a novel neural network architecture, called TreeDRNet, for more effective long-term forecasting. Inspired by robust regression, we introduce doubly residual link structure to make prediction more robust.Built upon Kolmogorov-Arnold representation theorem, we explicitly introduce feature selection, model ensemble, and a tree structure to further utilize the extended input sequence, which improves the robustness and representation power of TreeDRNet. Unlike previous deep models for sequential forecasting work, TreeDRNet is built entirely on multilayer perceptron and thus enjoys high computational efficiency. Our extensive empirical studies show that TreeDRNet is significantly more effective than state-of-the-art methods, reducing prediction errors by 20% to 40% for multivariate time series. In particular, TreeDRNet is over 10 times more efficient than transformer-based methods. The code will be released soon.


title: Nonconforming finite element approximations and the analysis of Nitsche's method for a singularly perturbed quad-curl problem in three dimensions

abstract: We introduce and analyze a robust nonconforming finite element method for a three dimensional singularly perturbed quad-curl model problem. For the solution of the model problem, we derive proper a priori bounds, based on which, we prove that the proposed finite element method is robust with respect to the singular perturbation parameter $\varepsilon$ and the numerical solution is uniformly convergent with order $h^{1/2}$. In addition, we investigate the effect of treating the second boundary condition weakly by Nitsche's method. We show that such a treatment leads to sharper error estimates than imposing the boundary condition strongly when the parameter $\varepsilon< h$. Finally, numerical experiments are provided to illustrate the good performance of the method and confirm our theoretical predictions.


title: Detection of two new RRATs at 111 MHz

abstract: Two new rotating transients were detected in the 2020 observations carried out on the LPA LPI radio telescope. The dispersion measures of the found transients are DM=21 and 35 pc/cm^3, the pulse half-widths are We=18 and 35 ms for J1550+09 and J2047+13, respectively. The upper estimate of the period RRAT J2047+13 P=2.925s was obtained. The study shows the existence of rotating transients whose pulses appear less frequently than one pulse per 10 hours of observations.


title: Numerical simulation of a drop collision with an obstacle

abstract: The paper considers the dynamics of the spreading liquid droplets after impact on a solid surface. The dynamics of a drop falling on a solid surface is shown using numerical simulation based on the solution of 2D and 3D Navier-Stokes equations for a two-layer liquid-gas system. The results of numerical simulation are compared with experimental data.


title: Learning Augmented Binary Search Trees

abstract: A treap is a classic randomized binary search tree data structure that is easy to implement and supports O(\log n) expected time access. However, classic treaps do not take advantage of the input distribution or patterns in the input. Given recent advances in algorithms with predictions, we propose pairing treaps with machine advice to form a learning-augmented treap. We are the first to propose a learning-augmented data structure that supports binary search tree operations such as range-query and successor functionalities. With the assumption that we have access to advice from a frequency estimation oracle, we assign learned priorities to the nodes to better improve the treap's structure. We theoretically analyze the learning-augmented treap's performance under various input distributions and show that under those circumstances, our learning-augmented treap has stronger guarantees than classic treaps and other classic tree-based data structures. Further, we experimentally evaluate our learned treap on synthetic datasets and demonstrate a performance advantage over other search tree data structures. We also present experiments on real world datasets with known frequency estimation oracles and show improvements as well.


title: Signal Knowledge Graph

abstract: This paper presents an knowledge graph to assist in reasoning over signals for intelligence purposes. We highlight limitations of existing knowledge graphs and reasoning systems for this purpose, using inference of an attack using combined data from microphones, cameras and social media as an example. Rather than acting directly on the received signal, our approach considers attacker behaviour, signal emission, receiver characteristics, and how signals are summarised to support inferring the underlying cause of the signal.


title: Dissecting U-net for Seismic Application: An In-Depth Study on Deep Learning Multiple Removal

abstract: Seismic processing often requires suppressing multiples that appear when collecting data. To tackle these artifacts, practitioners usually rely on Radon transform-based algorithms as post-migration gather conditioning. However, such traditional approaches are both time-consuming and parameter-dependent, making them fairly complex. In this work, we present a deep learning-based alternative that provides competitive results, while reducing its usage's complexity, and hence democratizing its applicability. We observe an excellent performance of our network when inferring complex field data, despite the fact of being solely trained on synthetics. Furthermore, extensive experiments show that our proposal can preserve the inherent characteristics of the data, avoiding undesired over-smoothed results, while removing the multiples. Finally, we conduct an in-depth analysis of the model, where we pinpoint the effects of the main hyperparameters with physical events. To the best of our knowledge, this study pioneers the unboxing of neural networks for the demultiple process, helping the user to gain insights into the inside running of the network.


title: Sequential adaptive design for emulating costly computer codes

abstract: Gaussian processes (GPs) are generally regarded as the gold standard surrogate model for emulating computationally expensive computer-based simulators. However, the problem of training GPs as accurately as possible with a minimum number of model evaluations remains challenging. We address this problem by suggesting a novel adaptive sampling criterion called VIGF (variance of improvement for global fit). The improvement function at any point is a measure of the deviation of the GP emulator from the nearest observed model output. At each iteration of the proposed algorithm, a new run is performed where VIGF is the largest. Then, the new sample is added to the design and the emulator is updated accordingly. A batch version of VIGF is also proposed which can save the user time when parallel computing is available. Additionally, VIGF is extended to the multi-fidelity case where the expensive high-fidelity model is predicted with the assistance of a lower fidelity simulator. This is performed via hierarchical kriging. The applicability of our method is assessed on a bunch of test functions and its performance is compared with several sequential sampling strategies. The results suggest that our method has a superior performance in predicting the benchmark functions in most cases.


title: Partially adjoint discretizations of adjoint operators and nonconforming finite element exterior calculus

abstract: This paper concerns the discretizations in pair of adjoint operators between Hilbert spaces so that the adjoint properties can be preserved. Due to the finite-dimensional essence of discretized operators, a new framework, theory of partially adjoint operators, is motivated and presented in this paper, so that adjoint properties can be figured out for finite-dimensional operators which can not be non-trivially densely defined in other background spaces. A formal methodology is presented under the framework to construct partially adjoint discretizations by a conforming discretization (CD) and an accompanied-by-conforming discretization (ABCD) for each of the operators. Moreover, the methodology leads to an asymptotic uniformity of an infinite family of finite-dimensional operators. The validities of the theoretical framework and the formal construction of discretizations are illustrated by a systematic family of in-pair discretizations of the adjoint exterior differential operators. The adjoint properties concerned in the paper are the closed range theorem and the strong dualities, whose preservations have not been well studied yet. Quantified versions of the closed range theorem are established for both adjoint operators and partially adjoint discretizations. The notion Poincare-Alexander-Lefschetz (P-A-L for short) type duality is borrowed for operator theory, and horizontal and vertical P-A-L dualities are figured out for adjoint operators and their analogues are established for partially adjoint discretizations. Particularly by partially adjoint discretizations of exterior differential operators, the Poincare-Lefschetz duality is preserved as an identity, which was not yet obtained before.


title: Existence of local suitable weak solutions to the Navier-Stokes equations for initial data in $L^{2}_{\rm loc} (\mathbb{R}^3)$

abstract: We consider the Navier-Stokes equations in $\mathbb{R}^3$ subject to the initial condition with initial velocity field in $L^{2}_{\rm loc} (\mathbb{R}^3)$ such that $\limsup_{R \to +\infty } R^{-1} \|u_{0} \|_{ L^{2}(B(R))} < +\infty$. Our aim is to show the local existence of a weak solution, global existence of weak solution if $C=0$ and the partial regularity in the sense of Caffarelli-Kohn-Nirenberg.


title: Approximating 1-Wasserstein Distance with Trees

abstract: Wasserstein distance, which measures the discrepancy between distributions, shows efficacy in various types of natural language processing (NLP) and computer vision (CV) applications. One of the challenges in estimating Wasserstein distance is that it is computationally expensive and does not scale well for many distribution comparison tasks. In this paper, we aim to approximate the 1-Wasserstein distance by the tree-Wasserstein distance (TWD), where TWD is a 1-Wasserstein distance with tree-based embedding and can be computed in linear time with respect to the number of nodes on a tree. More specifically, we propose a simple yet efficient L1-regularized approach to learning the weights of the edges in a tree. To this end, we first show that the 1-Wasserstein approximation problem can be formulated as a distance approximation problem using the shortest path distance on a tree. We then show that the shortest path distance can be represented by a linear model and can be formulated as a Lasso-based regression problem. Owing to the convex formulation, we can obtain a globally optimal solution efficiently. Moreover, we propose a tree-sliced variant of these methods. Through experiments, we demonstrated that the weighted TWD can accurately approximate the original 1-Wasserstein distance.


title: Self Supervised Learning for Few Shot Hyperspectral Image Classification

abstract: Deep learning has proven to be a very effective approach for Hyperspectral Image (HSI) classification. However, deep neural networks require large annotated datasets to generalize well. This limits the applicability of deep learning for HSI classification, where manually labelling thousands of pixels for every scene is impractical. In this paper, we propose to leverage Self Supervised Learning (SSL) for HSI classification. We show that by pre-training an encoder on unlabeled pixels using Barlow-Twins, a state-of-the-art SSL algorithm, we can obtain accurate models with a handful of labels. Experimental results demonstrate that this approach significantly outperforms vanilla supervised learning.


title: How Does Automation Shape the Process of Narrative Visualization: A Survey of Tools

abstract: In recent years, narrative visualization has gained much attention. Researchers have proposed different design spaces for various narrative visualization genres and scenarios to facilitate the creation process. As users' needs grow and automation technologies advance, increasingly more tools have been designed and developed. In this study, we summarized six genres of narrative visualization (annotated charts, infographics, timelines & storylines, data comics, scrollytelling & slideshow, and data videos) based on previous research and four types of tools (design spaces, authoring tools, ML/AI-supported tools and ML/AI-generator tools) based on the intelligence and automation level of the tools. We surveyed 105 papers and tools to study how automation can progressively engage in visualization design and narrative processes to help users easily create narrative visualizations. This research aims to provide an overview of current research and development in the automation involvement of narrative visualization tools. We discuss key research problems in each category and suggest new opportunities to encourage further research in the related domain.


title: The evolution of the H2O maser emission in the accretion burst source G358.93-0.03

abstract: The massive young stellar object (MYSO) G358.93-0.03-MM1 showed an extraordinary near-infrared- to (sub-)millimetre-dark and far-infrared-loud accretion burst, which is closely associated with flares of several class II methanol maser transitions, and, later, a 22 GHz water maser flare. Water maser flares provide an invaluable insight into ejection events associated with accretion bursts. Although the short timescale of the 22 GHz water maser flare made it impossible to carry out a very long baseline interferometry observation, we could track it with the Karl G. Jansky Very Large Array (VLA). The evolution of the spatial structure of the 22 GHz water masers and their association with the continuum sources in the region is studied with the VLA during two epochs, pre- and post-H2O maser flare. A drastic change in the distribution of the water masers is revealed: in contrast to the four maser groups detected during epoch I, only two newly formed clusters are detected during epoch II. The 22 GHz water masers associated with the bursting source MM1 changed in morphology and emission velocity extent. Clear evidence of the influence of the accretion burst on the ejection from G358.93-0.03-MM1 is presented. The accretion event has also potentially affected a region with a radius of ~2'' (~13 500 AU at 6.75 kpc), suppressing water masers associated with other point sources in this region.


title: Photoproduction of $J/\psi$ in d+Au ultraperipheral collisions at the BNL Relativistic Heavy Ion Collider

abstract: We argue that the STAR data on $J/\psi$ photoproduction in $d+Au$ ultraperipheral collisions (UPCs) at the momentum transfer $t \neq 0$ primarily probes elastic and possibly nucleon-dissociative $J/\psi$ photoproduction on quasi-free nucleons, while being essentially insensitive to expectedly weak nuclear modifications of the gluon distribution in the deuteron. Analyzing the STAR detector capabilities for selection of UPC events, we explore the possibility that the contribution of nucleon-dissociative $J/\psi$ photoproduction is negligibly small and obtain a very good description of the $t$ dependence of the STAR total cross section.


title: Is the core-cusp problem a matter of perspective: Jeans Anisotropic Modeling against numerical simulations

abstract: Mock member stars for 28 dwarf galaxies are constructed from the cosmological Auriga simulation, which reflect the dynamical status of realistic stellar tracers. The axis-symmetric Jeans Anisotropic Multi-Gaussian Expansion (JAM) modeling is applied to 6,000 star particles for each system, to recover the underlying matter distribution. The stellar or dark matter component individually is poorly recovered, but the total profile is constrained more reasonably. The mass within the half-mass radius of tracers is recovered the tightest, and the mass between 200 and 300 pc, $M(200-300\mathrm{pc})$, is constrained ensemble unbiasedly, with a scatter of 0.167 dex. If using 2,000 particles and only line-of-sight velocities with typical errors, the scatter in $M(200-300\mathrm{pc})$ is increased by $\sim$50%. Quiescent Sagittarius dSph-like systems and star-forming systems with strong outflows show distinct features, with $M(200-300\mathrm{pc})$ mostly under-estimated for the former, and likely over-estimated for the latter. The biases correlate with the dynamical status, which is a result of contraction motions due to tidal effects in quiescent systems or galactic winds in star-forming systems, driving them out of equilibrium. After including Gaia DR3 proper motion errors, we find proper motions can be as useful as line-of-sight velocities for nearby systems at $<\sim$60 kpc. By extrapolating the actual density profiles and the dynamical constraints down to scales below the resolution, we find the mass within 150 pc can be constrained ensemble unbiasedly, with a scatter of $\sim$0.255 dex. In the end, we show that the contraction of member stars in nearby systems is detectable based on Gaia DR3 proper motion errors.


title: Enhanced low-energy magnetic excitations evidencing the Cu-induced localization in an Fe-based superconductor Fe$_{0.98}$Te$_{0.5}$Se$_{0.5}$

abstract: We have performed inelastic neutron scattering measurements on optimally-doped Fe$_{0.98}$Te$_{0.5}$Se$_{0.5}$ and 10% Cu-doped Fe$_{0.88}$Cu$_{0.1}$Te$_{0.5}$Se$_{0.5}$ to investigate the substitution effects on the spin excitations in the whole energy range up to 300 meV. It is found that substitution of Cu for Fe enhances the low-energy spin excitations ($\le$ 100 meV), especially around the (0.5, 0.5) point, and leaves the high-energy magnetic excitations intact. In contrast to the expectation that Cu with spin 1/2 will dilute the magnetic moments contributed by Fe with a larger spin, we find that the 10% Cu doping enlarges the effective fluctuating moment from 2.85 to 3.13 $\mu_{\rm B}$/Fe, although there is no long- or short-range magnetic order around (0.5, 0.5) and (0.5, 0). The presence of enhanced magnetic excitations in the 10% Cu doped sample which is in the insulating state indicates that the magnetic excitations must have some contributions from the local moments, reflecting the dual nature of the magnetism in iron-based superconductors. We attribute the substitution effects to the localization of the itinerant electrons induced by Cu dopants. These results also indicate that the Cu doping does not act as electron donor as in a rigid-band shift model, but more as scattering centers that localize the system.


title: Some theoretical results on discrete contour trees

abstract: Contour trees have been developed to visualize or encode scalar data in imaging technologies and scientific simulations. Contours are defined on a continuous scalar field. For discrete data, a continuous function is first interpolated, where contours are then defined. In this paper we define a discrete contour tree, called the iso-tree, on a scalar graph, and discuss its properties. We show that the iso-tree model works for data of all dimensions, and develop an axiomatic system formalizing the discrete contour structures. We also report an isomorphism between iso-trees and augmented contour trees, showing that contour tree algorithms can be used to compute discrete contour trees, and vice versa.


title: Towards Effective Depthwise Convolutions on ARMv8 Architecture

abstract: Depthwise convolutions are widely used in lightweight convolutional neural networks (CNNs). The performance of depthwise convolutions is mainly bounded by the memory access rather than the arithmetic operations for classic convolutions so that direct algorithms are often more efficient than indirect ones (matrix multiplication-, Winograd-, and FFT-based convolutions) with additional memory accesses. However, the existing direct implementations of depthwise convolutions on ARMv8 architectures feature a bad trade-off between register-level reuse of different tensors, which usually leads to sub-optimal performance. In this paper, we propose new direct implementations of depthwise convolutions by means of implicit padding, register tiling, etc., which contain forward propagation, backward propagation and weight gradient update procedures. Compared to the existing ones, our new implementations can incur much less communication overhead between registers and cache. Experimental results on two ARMv8 CPUs show that our implementations can averagely deliver 4.88x and 16.4x performance improvement over the existing direct ones in open source libraries and matrix multiplications-based ones in Pytorch, respectively.


title: Signatures of regular black holes from the shadow of Sgr A* and M87*

abstract: With the recent release of the black hole image of Sgr A* alongside the earlier image of M87*, one can now really hope to acquire a better understanding of the gravitational physics at the horizon scale. In this paper, we investigate the prospect of the regular black hole scenario with a Minkowski core in explaining the observed shadow of M87* and Sgr A*. Regular black holes generally appear in Einstein gravity coupled to non-linear electrodynamics and are interesting as they can evade the r = 0 curvature singularity arising in general relativity. Using the previously determined mass and distance we compute the observables associated with the black hole shadow. These when compared with the observed angular diameter reveal that the shadow of M87* and Sgr A* favor the regular black hole scenario with a small but non-zero charge. The implications are discussed.


title: Temporal Attention Unit: Towards Efficient Spatiotemporal Predictive Learning

abstract: Spatiotemporal predictive learning aims to generate future frames by learning from historical frames. In this paper, we investigate existing methods and present a general framework of spatiotemporal predictive learning, in which the spatial encoder and decoder capture intra-frame features and the middle temporal module catches inter-frame correlations. While the mainstream methods employ recurrent units to capture long-term temporal dependencies, they suffer from low computational efficiency due to their unparallelizable architectures. To parallelize the temporal module, we propose the Temporal Attention Unit (TAU), which decomposes the temporal attention into intra-frame statical attention and inter-frame dynamical attention. Moreover, while the mean squared error loss focuses on intra-frame errors, we introduce a novel differential divergence regularization to take inter-frame variations into account. Extensive experiments demonstrate that the proposed method enables the derived model to achieve competitive performance on various spatiotemporal prediction benchmarks.


title: Implicit Channel Learning for Machine Learning Applications in 6G Wireless Networks

abstract: With the deployment of the fifth generation (5G) wireless systems gathering momentum across the world, possible technologies for 6G are under active research discussions. In particular, the role of machine learning (ML) in 6G is expected to enhance and aid emerging applications such as virtual and augmented reality, vehicular autonomy, and computer vision. This will result in large segments of wireless data traffic comprising image, video and speech. The ML algorithms process these for classification/recognition/estimation through the learning models located on cloud servers. This requires wireless transmission of data from edge devices to the cloud server. Channel estimation, handled separately from recognition step, is critical for accurate learning performance. Toward combining the learning for both channel and the ML data, we introduce implicit channel learning to perform the ML tasks without estimating the wireless channel. Here, the ML models are trained with channel-corrupted datasets in place of nominal data. Without channel estimation, the proposed approach exhibits approximately 60% improvement in image and speech classification tasks for diverse scenarios such as millimeter wave and IEEE 802.11p vehicular channels.


title: Excavating RoI Attention for Underwater Object Detection

abstract: Self-attention is one of the most successful designs in deep learning, which calculates the similarity of different tokens and reconstructs the feature based on the attention matrix. Originally designed for NLP, self-attention is also popular in computer vision, and can be categorized into pixel-level attention and patch-level attention. In object detection, RoI features can be seen as patches from base feature maps. This paper aims to apply the attention module to RoI features to improve performance. Instead of employing an original self-attention module, we choose the external attention module, a modified self-attention with reduced parameters. With the proposed double head structure and the Positional Encoding module, our method can achieve promising performance in object detection. The comprehensive experiments show that it achieves promising performance, especially in the underwater object detection dataset. The code will be avaiable in: https://github.com/zsyasd/Excavating-RoI-Attention-for-Underwater-Object-Detection


title: Advancing descriptor search in materials science: feature engineering and selection strategies

abstract: A main goal of data-driven materials research is to find optimal low-dimensional descriptors, allowing us to predict a physical property, and to interpret them in a human-understandable way. In this work, we advance methods to identify descriptors out of a large pool of candidate features by means of compressed sensing. To this extent, we develop schemes for engineering appropriate candidate features that are based on simple basic properties of building blocks that constitute the materials and that are able to represent a multi-component system by scalar numbers. Cross-validation based feature-selection methods are developed for identifying the most relevant features, thereby focusing on high generalizability. We apply our approaches to an \textit{ab initio} dataset of ternary group-IV compounds to obtain a set of descriptors for predicting lattice constants and energies of mixing. In particular, we introduce simple complexity measures in terms of involved algebraic operations as well as the amount of utilized basic properties.


title: Computer based activity to understand proper acceleration using the Rindler observer

abstract: Using elementary knowledge of Special Relativity, we design a computational classroom experiment in excel and python. Here, we show that any inertial observer $\mathcal{B}$ with an arbitrary speed $u_\mathcal{B}$ is associated with a unique event ${E}$ along the worldline of Rindler observer $\mathcal{R}$. The inertial observer $\mathcal{B}$ records the velocity of $\mathcal{R}$ to be non-zero at every instant except at this unique ${E}$ where it is co-moving with $\mathcal{R}$. At this event, $\mathcal{B}$ records a minimized distance to $\mathcal{R}$ and a maximized acceleration of $\mathcal{R}$ along its worldline. Students grasp the concept of proper acceleration when they realise that though an inertial observer measures variable local acceleration but this maxima is the same for all inertial observers. Since the Rindler observer is associated with variable local velocity the time dilation factors are different. Parameterising the Rindler velocity by proper time we graphically present the concept of time dilation. We assume $\mathcal{B}$ to be moving with respect to an inertial observer $\mathcal{A}$ which is at rest and their clocks synchronize to zero when they meet.


title: MVP: Multi-task Supervised Pre-training for Natural Language Generation

abstract: Pre-trained language models (PLMs) have achieved remarkable success in natural language generation (NLG) tasks. Up to now, most NLG-oriented PLMs are pre-trained in an unsupervised manner using the large-scale general corpus. In the meanwhile, an increasing number of models pre-trained with labeled data (i.e. "supervised pre-training") showcase superior performance compared to unsupervised pre-trained models. Motivated by the success of supervised pre-training, we propose Multi-task superVised Pre-training (MVP) for natural language generation. We collect a large-scale natural language generation corpus, MVPCorpus, from $77$ datasets over $11$ diverse NLG tasks. Then we unify these examples into a general text-to-text format to pre-train the text generation model MVP in a supervised manner. For each task, we further pre-train specific soft prompts to stimulate the model's capacity to perform a specific task. Our MVP model can be seen as a practice that utilizes recent instruction tuning on relatively small PLMs. Extensive experiments have demonstrated the effectiveness and generality of our MVP model in a number of NLG tasks, which achieves state-of-the-art performance on $13$ out of $17$ datasets, outperforming BART by $9.3\%$ and Flan-T5 by $5.8\%$.


title: SANE-TTS: Stable And Natural End-to-End Multilingual Text-to-Speech

abstract: In this paper, we present SANE-TTS, a stable and natural end-to-end multilingual TTS model. By the difficulty of obtaining multilingual corpus for given speaker, training multilingual TTS model with monolingual corpora is unavoidable. We introduce speaker regularization loss that improves speech naturalness during cross-lingual synthesis as well as domain adversarial training, which is applied in other multilingual TTS models. Furthermore, by adding speaker regularization loss, replacing speaker embedding with zero vector in duration predictor stabilizes cross-lingual inference. With this replacement, our model generates speeches with moderate rhythm regardless of source speaker in cross-lingual synthesis. In MOS evaluation, SANE-TTS achieves naturalness score above 3.80 both in cross-lingual and intralingual synthesis, where the ground truth score is 3.99. Also, SANE-TTS maintains speaker similarity close to that of ground truth even in cross-lingual inference. Audio samples are available on our web page.


title: On the Nature and Origin of Atmospheric Annual and Semi-annual Oscillations

abstract: This paper proposes a joint analysis of variations of global sea-level pressure and of Earth's rotation (RP), expressed as the coordinates of the rotation pole and length of day. Sea-Level-Pressure (SLP) extracted components are a weak trend, eleven quasi-periodic or periodic components ($\sim$130, 90, 50, 22, 15, 4, 1.8 yr), an annual cycle and its first three harmonics. These periods are characteristic of the space-time evolution of the Earth's rotation axis and are present in many characteristic features of solar and terrestrial physics. We focus mainly on the annual and to a lesser extent semi-annual components. Maps of the first three components of SLP (that together comprise more than 85% of the data variance) reveal interesting symmetries. The trend is very stable and forms a triskel structure that can be modeled as Taylor-Couette flow of mode 3. The annual component is characterized by a large negative anomaly extending over Eurasia in the NH Summer (and the opposite in the NH Winter) and three large positive anomalies over Australia and the southern tips of South America and South Africa in the SH Spring (and the opposite in the SH Autumn) forming a triskel. The semi-annual component is characterized by three positive anomalies (an irregular triskel) in the NH Spring and Autumn (and the opposite in the NH Summer and Winter), and in the SH Spring and Autumn by a strong stable pattern consisting of three large negative anomalies forming a clear triskel within the 40$^{\circ}$-60$^{\circ}$ annulus formed by the southern oceans. A large positive anomaly centered over Antarctica, with its maximum displaced toward Australia, and a smaller one centered over Southern Africa complement the pattern.


title: Capacity Optimal Coded Generalized MU-MIMO

abstract: With the complication of future communication scenarios, most conventional signal processing technologies of multi-user multiple-input multiple-output (MU-MIMO) become unreliable, which are designed based on ideal assumptions, such as Gaussian signaling and independent identically distributed (IID) channel matrices. As a result, this paper considers a generalized MU-MIMO (GMU-MIMO) system with more general assumptions, i.e., arbitrarily fixed input distributions, and general unitarily-invariant channel matrices. However, there is still no accurate capacity analysis and capacity optimal transceiver with practical complexity for GMU-MIMO under the constraint of coding. To address these issues, inspired by the replica method, the constrained sum capacity of coded GMU-MIMO with fixed input distribution is calculated by using the celebrated mutual information and minimum mean-square error (MMSE) lemma and the MMSE optimality of orthogonal/vector approximate message passing (OAMP/VAMP). Then, a capacity optimal multiuser OAMP/VAMP receiver is proposed, whose achievable rate is proved to be equal to the constrained sum capacity. Moreover, a design principle of multi-user codes is presented for the multiuser OAMP/VAMP, based on which a kind of practical multi-user low-density parity-check (MU-LDPC) code is designed. Numerical results show that finite-length performances of the proposed MU-LDPC codes with multi-user OAMP/VAMP are about 2 dB away from the constrained sum capacity and outperform those of the existing state-of-art methods.


title: Extensions and Limits of the Specker-Blatter Theorem

abstract: The original Specker-Blatter Theorem (1983) was formulated for classes of structures $\mathcal{C}$ of one or several binary relations definable in Monadic Second Order Logic MSOL. It states that the number of such structures on the set $[n]$ is modularly C-finite (MC-finite). In previous work we extended this to structures definable in CMSOL, MSOL extended with modular counting quantifiers. The first author also showed that the Specker-Blatter Theorem does not hold for one quaternary relation (2003). If the vocabulary allows a constant symbol $c$, there are $n$ possible interpretations on $[n]$ for $c$. We say that a constant $c$ is {\em hard-wired} if $c$ is always interpreted by the same element $j \in [n]$. In this paper we show: 1. The Specker-Blatter Theorem also holds for CMSOL when hard-wired constants are allowed. The proof method of Specker and Blatter does not work in this case. 2. The Specker-Blatter Theorem does not hold already for $\mathcal{C}$ with one ternary relation definable in First Order Logic FOL. This was left open since 1983. Using hard-wired constants allows us to show MC-finiteness of counting functions of various restricted partition functions which were not known to be MC-finite till now. Among them we have the restricted Bell numbers $B_{r,A}$, restricted Stirling numbers of the second kind $S_{r,A}$ or restricted Lah-numbers $L_{r,A}$. Here $r$ is an non-negative integer and $A$ is an ultimately periodic set of non-negative integers.