title: Normalizing Flows for Knockoff-free Controlled Feature Selection

abstract: Controlled feature selection aims to discover the features a response depends on while limiting the false discovery rate (FDR) to a predefined level. Recently, multiple deep-learning-based methods have been proposed to perform controlled feature selection through the Model-X knockoff framework. We demonstrate, however, that these methods often fail to control the FDR for two reasons. First, these methods often learn inaccurate models of features. Second, the "swap" property, which is required for knockoffs to be valid, is often not well enforced. We propose a new procedure called FlowSelect to perform controlled feature selection that does not suffer from either of these two problems. To more accurately model the features, FlowSelect uses normalizing flows, the state-of-the-art method for density estimation. Instead of enforcing the "swap" property, FlowSelect uses a novel MCMC-based procedure to calculate p-values for each feature directly. Asymptotically, FlowSelect computes valid p-values. Empirically, FlowSelect consistently controls the FDR on both synthetic and semi-synthetic benchmarks, whereas competing knockoff-based approaches do not. FlowSelect also demonstrates greater power on these benchmarks. Additionally, FlowSelect correctly infers the genetic variants associated with specific soybean traits from GWAS data.


title: Minimax Optimal Regression over Sobolev Spaces via Laplacian Regularization on Neighborhood Graphs

abstract: In this paper we study the statistical properties of Laplacian smoothing, a graph-based approach to nonparametric regression. Under standard regularity conditions, we establish upper bounds on the error of the Laplacian smoothing estimator $\widehat{f}$, and a goodness-of-fit test also based on $\widehat{f}$. These upper bounds match the minimax optimal estimation and testing rates of convergence over the first-order Sobolev class $H^1(\mathcal{X})$, for $\mathcal{X}\subseteq \mathbb{R}^d$ and $1 \leq d < 4$; in the estimation problem, for $d = 4$, they are optimal modulo a $\log n$ factor. Additionally, we prove that Laplacian smoothing is manifold-adaptive: if $\mathcal{X} \subseteq \mathbb{R}^d$ is an $m$-dimensional manifold with $m < d$, then the error rate of Laplacian smoothing (in either estimation or testing) depends only on $m$, in the same way it would if $\mathcal{X}$ were a full-dimensional set in $\mathbb{R}^d$.


title: Hearts of Darkness: the inside out probing of black holes

abstract: Classical black holes shield us from the singularities that inevitably appear in general relativity. Being singularity regularization one of the main landmarks for a successful theory of quantum gravity, quantum black holes are not obliged to hide their inner core from the outside world. Notwithstanding the aforesaid, it is often implicitly assumed that quantum gravity effects must remain confined to black hole interiors. In this essay we argue in the opposite direction, discussing theoretical evidence for the existence of strong correlations between the physics inside and outside non-singular black holes. We conclude that astronomical tests of the surroundings of black holes can provide invaluable information about their so-far unexplored interiors.


title: Chiral Selection, Isotopic Abundance Shifts, and Autocatalysis of Meteoritic Amino Acids

abstract: The discovery of amino acids in meteorites has presented two clues to the origin of their processing subsequent to their formation: a slight preference for left-handedness in some of them, and isotopic anomalies in some of their constituent atoms. In this article we present theoretical results from the Supernova Neutrino Amino Acid Processing (SNAAP) model, which uses electron anti-neutrinos and the magnetic fields from source objects such as supernovae or colliding neutron stars to selectively destroy one amino acid chirality and to create isotopic abundance shifts. For plausible magnetic fields and electron anti-neutrino fluxes, non-zero, positive enantiomeric excesses, $ee$s, defined to be the relative left/right asymmetry in an amino acid population, are reviewed for two amino acids, and conditions are suggested that would produce $ee>0$ for all of the $\alpha$-amino acids. The relatively high energy anti-neutrinos that produce the $ee$s would inevitably also produce isotopic anomalies. A nuclear reaction network was developed to describe the reactions resulting from them and the nuclides in the meteorites. At similar anti-neutrino fluxes, assumed recombination of the detritus from the anti-neutrino interactions is shown to produce appreciable isotopic anomalies in qualitative agreement with those observed for D/$^1$H and $^{15}$N/$^{14}$N. The isotopic anomalies for $^{13}$C/$^{12}$C are predicted to be small, as are also observed. Autocatalysis may be necessary for any model to produce the largest $ee$s observed in meteorites. This allows the constraints of the original SNAAP model to be relaxed, increasing the probability of meteoroid survival in sites where amino acid processing is possible. These results have obvious implications for the origin of life on Earth.

categories: astro-ph.EP physics.bio-ph physics.geo-ph physics.space-ph


title: Noise Doesn't Lie: Towards Universal Detection of Deep Inpainting

abstract: Deep image inpainting aims to restore damaged or missing regions in an image with realistic contents. While having a wide range of applications such as object removal and image recovery, deep inpainting techniques also have the risk of being manipulated for image forgery. A promising countermeasure against such forgeries is deep inpainting detection, which aims to locate the inpainted regions in an image. In this paper, we make the first attempt towards universal detection of deep inpainting, where the detection network can generalize well when detecting different deep inpainting methods. To this end, we first propose a novel data generation approach to generate a universal training dataset, which imitates the noise discrepancies exist in real versus inpainted image contents to train universal detectors. We then design a Noise-Image Cross-fusion Network (NIX-Net) to effectively exploit the discriminative information contained in both the images and their noise patterns. We empirically show, on multiple benchmark datasets, that our approach outperforms existing detection methods by a large margin and generalize well to unseen deep inpainting techniques. Our universal training dataset can also significantly boost the generalizability of existing detection methods.


title: Matters Arising on "Breakup of a long-period comet as the origin of the dinosaur extinction" by Siraj & Loeb

abstract: The recent publication by Siraj & Loeb (2021; Nature Scientific Reports 11, 3803) attempts to revive the debate over whether the Chicxulub impactor was a comet or an asteroid. They calculate that ~20% of long-period comets impacting Earth will have first been disrupted by passage inside the Sun's Roche limit, generating thousands of fragments, each the needed size of the Chicxulub impactor. This would increase the impact rate of comets by a factor ~15, making them as likely to hit the Earth as an asteroid. They also argue that a comet would be a factor of 10 more likely to match the geochemical constraints, which indicate the Chicxulub impactor was carbonaceous chondrite-like. These conclusions are based on misinterpretations of the literature. Siraj & Loeb [1] overestimate the number of fragments produced during tidal disruption of a comet: tens of fragments are produced, not thousands. They also conflate 'carbonaceous chondrite' with specific types of carbonaceous chondrite, and ignore the evidence of iridium, making comets seem more likely than asteroids to match the Chicxulub impactor, when in fact they likely can be ruled out. Rather than a comet, an asteroidal impactor similar to CM or CR carbonaceous chondrites is strongly favored.


title: Deconfounded Video Moment Retrieval with Causal Intervention

abstract: We tackle the task of video moment retrieval (VMR), which aims to localize a specific moment in a video according to a textual query. Existing methods primarily model the matching relationship between query and moment by complex cross-modal interactions. Despite their effectiveness, current models mostly exploit dataset biases while ignoring the video content, thus leading to poor generalizability. We argue that the issue is caused by the hidden confounder in VMR, {i.e., temporal location of moments}, that spuriously correlates the model input and prediction. How to design robust matching models against the temporal location biases is crucial but, as far as we know, has not been studied yet for VMR. To fill the research gap, we propose a causality-inspired VMR framework that builds structural causal model to capture the true effect of query and video content on the prediction. Specifically, we develop a Deconfounded Cross-modal Matching (DCM) method to remove the confounding effects of moment location. It first disentangles moment representation to infer the core feature of visual content, and then applies causal intervention on the disentangled multimodal input based on backdoor adjustment, which forces the model to fairly incorporate each possible location of the target into consideration. Extensive experiments clearly show that our approach can achieve significant improvement over the state-of-the-art methods in terms of both accuracy and generalization (Codes: \color{blue}{\url{https://github.com/Xun-Yang/Causal_Video_Moment_Retrieval}}


title: Taming geometric frustration by leveraging structural elasticity

abstract: Geometric frustration appears in a broad range of systems, generally emerging as disordered ground configurations, thereby impeding understanding of the phenomenon's underlying mechanics. We report on a continuum system featuring locally bistable units that allows for the controlled and self-sustained manifestation of macroscopic geometric frustration. The patterning of the units encodes a finite set of ordered ground configurations (spin-ice states) and a unique family of co-existing higher-order frustrated states (spin-liquid states), which are both activated upon unit inversion. We present a strategy for accessing any globally frustrated state on-demand by controlling the constitutive units' inversion sequence. This control strategy allows for observing the unfolding of geometric frustration as the microstructural features evolve due to the energy minimization of the constitutive units' interactions. More broadly, our model system offers a blueprint for "taming" macroscopic geometric frustration, enabling novel applications such as path-driven computation and solving optimisation problems using structural systems.


title: BERT meets LIWC: Exploring State-of-the-Art Language Models for Predicting Communication Behavior in Couples' Conflict Interactions

abstract: Many processes in psychology are complex, such as dyadic interactions between two interacting partners (e.g. patient-therapist, intimate relationship partners). Nevertheless, many basic questions about interactions are difficult to investigate because dyadic processes can be within a person and between partners, they are based on multimodal aspects of behavior and unfold rapidly. Current analyses are mainly based on the behavioral coding method, whereby human coders annotate behavior based on a coding schema. But coding is labor-intensive, expensive, slow, focuses on few modalities. Current approaches in psychology use LIWC for analyzing couples' interactions. However, advances in natural language processing such as BERT could enable the development of systems to potentially automate behavioral coding, which in turn could substantially improve psychological research. In this work, we train machine learning models to automatically predict positive and negative communication behavioral codes of 368 German-speaking Swiss couples during an 8-minute conflict interaction on a fine-grained scale (10-seconds sequences) using linguistic features and paralinguistic features derived with openSMILE. Our results show that both simpler TF-IDF features as well as more complex BERT features performed better than LIWC, and that adding paralinguistic features did not improve the performance. These results suggest it might be time to consider modern alternatives to LIWC, the de facto linguistic features in psychology, for prediction tasks in couples research. This work is a further step towards the automated coding of couples' behavior which could enhance couple research and therapy, and be utilized for other dyadic interactions as well.


title: Stanley-Reisner's ring and the occurrence of the Steinberg representation in the hit problem

abstract: G. Walker and R. Wood proved that in degree $2^n-1-n$, the space of indecomposable elements of $\Bbb F_2[x_1,\ldots,x_n]$, considered as a module over the mod 2 Steenrod algebra, is isomorphic to the Steinberg representation of $GL_n(\Bbb F_2)$. We generalize this result to all finite fields by analyzing certain finite quotients of $\Bbb F_q[x_1,\ldots,x_n]$ which come from the Stanley-Reisner rings of some matroid complexes. Our method also shows that the space of indecomposable elements in degree $q^{n-1}-n$ has the dimension equal to that of a complex cuspidal representation of $GL_n(\Bbb F_q)$. As a by product, over the prime field $\Bbb F_2$, we give a decomposition of the Steinberg summand of one of these quotients into a direct sum of suspensions of Brown-Gitler modules. This decomposition suggests the existence of a stable decomposition derived from the Steinberg module of a certain topological space into a wedge of suspensions of Brown-Gitler spectra.


title: PDPGD: Primal-Dual Proximal Gradient Descent Adversarial Attack

abstract: State-of-the-art deep neural networks are sensitive to small input perturbations. Since the discovery of this intriguing vulnerability, many defence methods have been proposed that attempt to improve robustness to adversarial noise. Fast and accurate attacks are required to compare various defence methods. However, evaluating adversarial robustness has proven to be extremely challenging. Existing norm minimisation adversarial attacks require thousands of iterations (e.g. Carlini & Wagner attack), are limited to the specific norms (e.g. Fast Adaptive Boundary), or produce sub-optimal results (e.g. Brendel & Bethge attack). On the other hand, PGD attack, which is fast, general and accurate, ignores the norm minimisation penalty and solves a simpler perturbation-constrained problem. In this work, we introduce a fast, general and accurate adversarial attack that optimises the original non-convex constrained minimisation problem. We interpret optimising the Lagrangian of the adversarial attack optimisation problem as a two-player game: the first player minimises the Lagrangian wrt the adversarial noise; the second player maximises the Lagrangian wrt the regularisation penalty. Our attack algorithm simultaneously optimises primal and dual variables to find the minimal adversarial perturbation. In addition, for non-smooth $l_p$-norm minimisation, such as $l_{\infty}$-, $l_1$-, and $l_0$-norms, we introduce primal-dual proximal gradient descent attack. We show in the experiments that our attack outperforms current state-of-the-art $l_{\infty}$-, $l_2$-, $l_1$-, and $l_0$-attacks on MNIST, CIFAR-10 and Restricted ImageNet datasets against unregularised and adversarially trained models.


title: Perfect Roman domination in middle graphs

abstract: The middle graph $M(G)$ of a graph $G$ is the graph obtained by subdividing each edge of $G$ exactly once and joining all these newly introduced vertices of adjacent edges of $G$. A perfect Roman dominating function on a graph $G$ is a function $f : V(G) \rightarrow \{0, 1, 2\}$ satisfying the condition that every vertex $v$ with $f(v)=0$ is adjacent to exactly one vertex $u$ for which $f(u)=2$. The weight of a perfect Roman dominating function $f$ is the sum of weights of vertices. The perfect Roman domination number is the minimum weight of a perfect Roman dominating function on $G$. In this paper, we give a characterization of middle graphs with equal Roman domination and perfect Roman domination numbers.


title: Luna: Linear Unified Nested Attention

abstract: The quadratic computational and memory complexities of the Transformer's attention mechanism have limited its scalability for modeling long sequences. In this paper, we propose Luna, a linear unified nested attention mechanism that approximates softmax attention with two nested linear attention functions, yielding only linear (as opposed to quadratic) time and space complexity. Specifically, with the first attention function, Luna packs the input sequence into a sequence of fixed length. Then, the packed sequence is unpacked using the second attention function. As compared to a more traditional attention mechanism, Luna introduces an additional sequence with a fixed length as input and an additional corresponding output, which allows Luna to perform attention operation linearly, while also storing adequate contextual information. We perform extensive evaluations on three benchmarks of sequence modeling tasks: long-context sequence modeling, neural machine translation and masked language modeling for large-scale pretraining. Competitive or even better experimental results demonstrate both the effectiveness and efficiency of Luna compared to a variety


title: MPC-BERT: A Pre-Trained Language Model for Multi-Party Conversation Understanding

abstract: Recently, various neural models for multi-party conversation (MPC) have achieved impressive improvements on a variety of tasks such as addressee recognition, speaker identification and response prediction. However, these existing methods on MPC usually represent interlocutors and utterances individually and ignore the inherent complicated structure in MPC which may provide crucial interlocutor and utterance semantics and would enhance the conversation understanding process. To this end, we present MPC-BERT, a pre-trained model for MPC understanding that considers learning who says what to whom in a unified model with several elaborated self-supervised tasks. Particularly, these tasks can be generally categorized into (1) interlocutor structure modeling including reply-to utterance recognition, identical speaker searching and pointer consistency distinction, and (2) utterance semantics modeling including masked shared utterance restoration and shared node detection. We evaluate MPC-BERT on three downstream tasks including addressee recognition, speaker identification and response selection. Experimental results show that MPC-BERT outperforms previous methods by large margins and achieves new state-of-the-art performance on all three downstream tasks at two benchmarks.


title: Cosmic ray radiography of a human phantom

abstract: Cosmic ray muons, that reach the earth's surface, provide a natural source of radiation that is used for radiography. In this paper, we show that radiography using cosmic radiation background provides a method that can be used to monitor bulk aspects of human anatomy. We describe a method that can be used to measure changes in patients as a function of time by radiographing them using cosmic-ray muons. This could provide hourly readouts of parameters such as lung density with sufficient sensitivity to detect time changes in inflammation of the lungs in, e.g., Covid patients.


title: Ver: View Discovery in the Wild

abstract: We present Ver, a data discovery system that identifies project-join views over large repositories of tables that do not contain join path information, and even when input queries are inaccurate. Ver implements a reference architecture to solve both the technical (scale and search) and human (semantic ambiguity, navigating a large number of results) problems of view discovery. We demonstrate users find the view they want when using Ver with a user study and we demonstrate its performance with large-scale end-to-end experiments on real-world datasets containing tens of millions of join paths.


title: SSMD: Semi-Supervised Medical Image Detection with Adaptive Consistency and Heterogeneous Perturbation

abstract: Semi-Supervised classification and segmentation methods have been widely investigated in medical image analysis. Both approaches can improve the performance of fully-supervised methods with additional unlabeled data. However, as a fundamental task, semi-supervised object detection has not gained enough attention in the field of medical image analysis. In this paper, we propose a novel Semi-Supervised Medical image Detector (SSMD). The motivation behind SSMD is to provide free yet effective supervision for unlabeled data, by regularizing the predictions at each position to be consistent. To achieve the above idea, we develop a novel adaptive consistency cost function to regularize different components in the predictions. Moreover, we introduce heterogeneous perturbation strategies that work in both feature space and image space, so that the proposed detector is promising to produce powerful image representations and robust predictions. Extensive experimental results show that the proposed SSMD achieves the state-of-the-art performance at a wide range of settings. We also demonstrate the strength of each proposed module with comprehensive ablation studies.


title: Deep learning based on PINN for solving 2 D0F vortex induced vibration of cylinder with high Reynolds number

abstract: Vortex-induced vibration (VIV) exists widely in natural and industrial fields. The main approaches for solving VIV problems are numerical simulations and experimental methods. However, experiment methods are difficult to obtain the whole flow field information and also high-cost while numerical simulation is extraordinary time-consuming and limited in low Reynolds number and simple geometric configuration. In addition, numerical simulations are difficult to handle the moving mesh technique. In this paper, physics informed neural network (PINN) is proposed to solve the VIV and wake-induced vibration (WIV) of cylinder with high Reynolds number. Compared to tradition data-driven neural network, the Reynolds Average Navier-Stokes (RANS) equation, by implanting an additional turbulent eddy viscosity, coupled with structure's dynamic motion equation are also embedded into the loss function. Training and validation data is obtained by computational fluid dynamic (CFD) technique. Three scenarios are proposed to validate the performance of PINN in solving VIV and WIV of cylinders. In the first place, the stiffness parameter and damping parameter are calculated via limited force data and displacement data; secondly, the flow field and lifting force/drag force are inferred by scattered velocity information; eventually, the displacement can be directly predicted only through lifting forces and drag forces based on LSTM. Results demonstrate that,compared with traditional neural network, PINN method is more effective in inferring and re-constructing the unknown parameters and flow field with high Reynolds number under VIV and WIV circumstances.


title: Global propagation of singularities for discounted Hamilton-Jacobi equations

abstract: The main purpose of this paper is to study the global propagation of singularities of viscosity solution to discounted Hamilton-Jacobi equation \begin{equation}\label{eq:discount 1}\tag{HJ$_\lambda$} \lambda v(x)+H( x, Dv(x) )=0 , \quad x\in \mathbb{R}^n. \end{equation} We reduce the problem for equation \eqref{eq:discount 1} into that for a time-dependent evolutionary Hamilton-Jacobi equation. We proved that the singularities of the viscosity solution of \eqref{eq:discount 1} propagate along locally Lipschitz singular characteristics which can extend to $+\infty$. We also obtained the homotopy equivalence between the singular set and the complement of associated the Aubry set with respect to the viscosity solution of equation \eqref{eq:discount 1}.


title: The local behavior of positive solutions for higher order equation with isolated singularity

abstract: We use blow up analysis for local integral equations to provide a blow up rates of solutions of higher order Hardy-Henon equation in a bounded domain with an isolated singularity, and show the asymptotic radial symmetry of the solutions near the singularity. This work generalizes the correspondence results of Jin-Xiong [8] on higher order conformally invariant equations with an isolated singularity.


title: When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations

abstract: Vision Transformers (ViTs) and MLPs signal further efforts on replacing hand-wired features or inductive biases with general-purpose neural architectures. Existing works empower the models by massive data, such as large-scale pre-training and/or repeated strong data augmentations, and still report optimization-related problems (e.g., sensitivity to initialization and learning rates). Hence, this paper investigates ViTs and MLP-Mixers from the lens of loss geometry, intending to improve the models' data efficiency at training and generalization at inference. Visualization and Hessian reveal extremely sharp local minima of converged models. By promoting smoothness with a recently proposed sharpness-aware optimizer, we substantially improve the accuracy and robustness of ViTs and MLP-Mixers on various tasks spanning supervised, adversarial, contrastive, and transfer learning (e.g., +5.3\% and +11.0\% top-1 accuracy on ImageNet for ViT-B/16 and Mixer-B/16, respectively, with the simple Inception-style preprocessing). We show that the improved smoothness attributes to sparser active neurons in the first few layers. The resultant ViTs outperform ResNets of similar size and throughput when trained from scratch on ImageNet without large-scale pre-training or strong data augmentations. Model checkpoints are available at \url{https://github.com/google-research/vision_transformer}.


title: Waveform Design for Joint Sensing and Communications in Millimeter-Wave and Low Terahertz Bands

abstract: The convergence of sensing and communication in the millimeter-wave (mmWave) and low terahertz (THz) bands has been envisioned as a promising technology, since it incorporates high-rate data transmission of hundreds of Gbps and mm-level radar sensing in a spectrum- and cost-efficient manner, by sharing both the frequency and hardware resources. However, the joint radar sensing and communication (JRC) system faces considerable challenges in the mmWave and low-THz scale, due to the peculiarities of the propagation channel and radio-frequency (RF) front ends. To this end, the waveform design for the JRC systems in mmWave and low-THz bands with ultra-broad bandwidth is investigated in this paper. Firstly, by considering the JRC design based on the co-existence concept, where both functions operate in a time-domain duplex (TDD) manner, a novel multi-subband quasi-perfect (MS-QP) sequence, composed of multiple perfect subsequences on different subbands, is proposed for target sensing, which achieves accurate target ranging and velocity estimation, whilst only requiring cost-efficient low-rate analog-to-digital converters (A/Ds) for sequence detection. Furthermore, the root index of each perfect subsequence is designed to eliminate the influence of strong Doppler shift on radar sensing. Finally, a data-embedded MS-QP (DE-MS-QP) waveform is constructed through time-domain extension of the MS-QP sequence, generating null frequency points on each subband for data transmission. Unlike the co-existence-based JRC system in TDD manner, the proposed DE-MS-QP waveform enables simultaneous interference-free sensing and communication, whilst inheriting all the merits from MS-QP sequences. Numerical results validate the superiority of the proposed waveforms regarding the communication and sensing performances, hardware cost as well as flexibility of the resource allocation between the dual functions.


title: Greenberger-Horne-Zeilinger States: Their Identifications and Robust Violations

abstract: The $N$-qubit Greenberger-Horne-Zeilinger (GHZ) states are the maximally entangled states of $N$ qubits, which have had many important applications in quantum information processing, such as quantum key distribution and quantum secret sharing. Thus how to distinguish the GHZ states from other quantum states becomes a significant problem. In this work, by presenting a family of the generalized Clauser-Horne-Shimony-Holt (CHSH) inequality, we show that the $N$-qubit GHZ states can be indeed identified by the maximal violations of the generalized CHSH inequality under some specific measurement settings. The generalized CHSH inequality is simple and contains only four correlation functions for any $N$-qubit system, thus has the merit of facilitating experimental verification. Furthermore, we present a quantum phenomenon of robust violations of the generalized CHSH inequality, in which the maximal violation of Bell's inequality can be robust under some specific noises adding to the $N$-qubit GHZ states.


title: Matching-Theory-Based Multi-User Cooperative Computing Framework

abstract: In this paper, we propose a matching theory based multi-user cooperative computing (MUCC) scheme to minimize the overall energy consumption of a group of user equipments (UEs), where the UEs can be classified into the following roles: resource demander (RD), resource provider (RP), and standalone UE (SU). We first determine the role of each UE by leveraging the roommate matching method. Then, we propose the college admission based algorithm to divide the UEs into multiple cooperation groups, each consisting of one RP and multiple RDs. Next, we propose the rotation swap operation to further improve the performance without deteriorating the system stability. Finally, we present an effective task offloading algorithm to minimize the energy consumption of all the cooperation groups. The simulation results verify the effectiveness of the proposed scheme.


title: Uncertainty Quantification of a Computer Model for Binary Black Hole Formation

abstract: In this paper, a fast and parallelizable method based on Gaussian Processes (GPs) is introduced to emulate computer models that simulate the formation of binary black holes (BBHs) through the evolution of pairs of massive stars. Two obstacles that arise in this application are the a priori unknown conditions of BBH formation and the large scale of the simulation data. We address them by proposing a local emulator which combines a GP classifier and a GP regression model. The resulting emulator can also be utilized in planning future computer simulations through a proposed criterion for sequential design. By propagating uncertainties of simulation input through the emulator, we are able to obtain the distribution of BBH properties under the distribution of physical parameters.


title: Spline Positional Encoding for Learning 3D Implicit Signed Distance Fields

abstract: Multilayer perceptrons (MLPs) have been successfully used to represent 3D shapes implicitly and compactly, by mapping 3D coordinates to the corresponding signed distance values or occupancy values. In this paper, we propose a novel positional encoding scheme, called Spline Positional Encoding, to map the input coordinates to a high dimensional space before passing them to MLPs, for helping to recover 3D signed distance fields with fine-scale geometric details from unorganized 3D point clouds. We verified the superiority of our approach over other positional encoding schemes on tasks of 3D shape reconstruction from input point clouds and shape space learning. The efficacy of our approach extended to image reconstruction is also demonstrated and evaluated.


title: Solvatochromism of (-)-Epigallocatechin 3-O-Gallate (EGCG) Fluorescence: Dependence on Solvent Protonicity

abstract: Health benefits of EGCG are well established; however, the mechanisms of EGCG action are not completely understood. In our previous study we discovered solvatochromism of EGCG fluorescence and described the dependence of fluorescence maxima on solvent polarity. We also noted that fluorescence intensity (FI) depends on solvent. The goal of this study was to gain insights into how the protonic properties of the environment affect FI. We demonstrate that 1) FI of EGCG inversely correlates with the autoprotolysis constant (Kap) of the solvents, 2) HCl decreases, and NaOH increases FI of EGCG in water, and 3) NaOH evokes slow (~10 min time scale) transient changes in FI of EGCG. We conclude that EGCG fluorescence depends on Kap, i.e. protonicity of the environment, that is useful for differentiating EGCG in protic aqueous environment at physiological pH~7.0{\div}7.4, where EGCG fluorescence is substantially quenched, from EGCG in aprotic environments, where EGCG fluorescence significantly increases. Thus, this property of EGCG fluorescence is useful for investigation of specific EGCG interactions within more aprotic protein binding sites.


title: Comparing Acoustic-based Approaches for Alzheimer's Disease Detection

abstract: Robust strategies for Alzheimer's disease (AD) detection are important, given the high prevalence of AD. In this paper, we study the performance and generalizability of three approaches for AD detection from speech on the recent ADReSSo challenge dataset: 1) using conventional acoustic features 2) using novel pre-trained acoustic embeddings 3) combining acoustic features and embeddings. We find that while feature-based approaches have a higher precision, classification approaches relying on pre-trained embeddings prove to have a higher, and more balanced cross-validated performance across multiple metrics of performance. Further, embedding-only approaches are more generalizable. Our best model outperforms the acoustic baseline in the challenge by 2.8%.


title: Low-efficiency long gamma-ray bursts: A case study with AT2020blt

abstract: The Zwicky Transient Facility recently announced the detection of an optical transient AT2020blt at redshift $z=2.9$, consistent with the afterglow of an on-axis gamma-ray burst. However, no prompt emission was observed. We analyse AT2020blt with detailed models, showing the data are best explained as the afterglow of an on-axis long gamma-ray burst, ruling out other hypotheses such as a cocoon and a low-Lorentz factor jet. We search \textit{Fermi} data for prompt emission, setting deeper upper limits on the prompt emission than in the original detection paper. Together with KONUS-\textit{Wind} observations, we show that the gamma-ray efficiency of AT2020blt is $\lesssim 0.3 - 4.5\%$. We speculate that AT2020blt and AT2021any belong to the low-efficiency tail of long gamma-ray burst distributions that are beginning to be readily observed due to the capabilities of new observatories like the Zwicky Transient Facility.


title: Mesoscopic Lattice Boltzmann Modeling of the Liquid-Vapor Phase Transition

abstract: We develop a mesoscopic lattice Boltzmann model for liquid-vapor phase transition by handling the microscopic molecular interaction. The short-range molecular interaction is incorporated by recovering an equation of state for dense gases, and the long-range molecular interaction is mimicked by introducing a pairwise interaction force. Double distribution functions are employed, with the density distribution function for the mass and momentum conservation laws and an innovative total kinetic energy distribution function for the energy conservation law. The recovered mesomacroscopic governing equations are fully consistent with kinetic theory, and thermodynamic consistency is naturally satisfied.


title: The Growth of Protoplanets via the Accretion of Small Bodies in Disks Perturbed by the Planetary Gravity

abstract: Planets grow via the collisional accretion of small bodies in a protoplanetary disk. Such small bodies feel strong gas drag and their orbits are significantly affected by the gas flow and atmospheric structure around the planet. We investigate the gas flow in the protoplanetary disk perturbed by the gravity of the planet by three-dimensional hydrodynamic simulation. We then calculate the orbital evolutions of particles in the gas structure obtained from the hydrodynamic simulation. Based on the orbital calculations, we obtain the collision rate between the planet and centimeter to kilometer sized particles. Our results show that meter-sized or larger particles effectively collide with the planet due to the atmospheric gas drag, which significantly enhances the collision rate. On the other hand, the gas flow plays an important role for smaller particles. Finally, considering the effects of the atmosphere and gas flow, we derive the new analytic formula for the collision rate, which is in good agreement with our simulations. We estimate the growth timescale and accretion efficiency of drifting bodies for the formation of a gas-giant solid core using the formula. We find the accretion of sub-kilometer sized bodies achieve a short growth timescale (~0.005 Myr) and a high accretion efficiency (~1) for the core formation at 5 au in the minimum mass solar nebula model.


title: Adjacency List Oriented Relational Fact Extraction via Adaptive Multi-task Learning

abstract: Relational fact extraction aims to extract semantic triplets from unstructured text. In this work, we show that all of the relational fact extraction models can be organized according to a graph-oriented analytical perspective. An efficient model, aDjacency lIst oRiented rElational faCT (DIRECT), is proposed based on this analytical framework. To alleviate challenges of error propagation and sub-task loss equilibrium, DIRECT employs a novel adaptive multi-task learning strategy with dynamic sub-task loss balancing. Extensive experiments are conducted on two benchmark datasets, and results prove that the proposed model outperforms a series of state-of-the-art (SoTA) models for relational triplet extraction.


title: CitationIE: Leveraging the Citation Graph for Scientific Information Extraction

abstract: Automatically extracting key information from scientific documents has the potential to help scientists work more efficiently and accelerate the pace of scientific progress. Prior work has considered extracting document-level entity clusters and relations end-to-end from raw scientific text, which can improve literature search and help identify methods and materials for a given problem. Despite the importance of this task, most existing works on scientific information extraction (SciIE) consider extraction solely based on the content of an individual paper, without considering the paper's place in the broader literature. In contrast to prior work, we augment our text representations by leveraging a complementary source of document context: the citation graph of referential links between citing and cited papers. On a test set of English-language scientific documents, we show that simple ways of utilizing the structure and content of the citation graph can each lead to significant gains in different scientific information extraction tasks. When these tasks are combined, we observe a sizable improvement in end-to-end information extraction over the state-of-the-art, suggesting the potential for future work along this direction. We release software tools to facilitate citation-aware SciIE development.


title: Can Generative Pre-trained Language Models Serve as Knowledge Bases for Closed-book QA?

abstract: Recent work has investigated the interesting question using pre-trained language models (PLMs) as knowledge bases for answering open questions. However, existing work is limited in using small benchmarks with high test-train overlaps. We construct a new dataset of closed-book QA using SQuAD, and investigate the performance of BART. Experiments show that it is challenging for BART to remember training facts in high precision, and also challenging to answer closed-book questions even if relevant knowledge is retained. Some promising directions are found, including decoupling the knowledge memorizing process and the QA finetune process, forcing the model to recall relevant knowledge when question answering.


title: Discriminative Reasoning for Document-level Relation Extraction

abstract: Document-level relation extraction (DocRE) models generally use graph networks to implicitly model the reasoning skill (i.e., pattern recognition, logical reasoning, coreference reasoning, etc.) related to the relation between one entity pair in a document. In this paper, we propose a novel discriminative reasoning framework to explicitly model the paths of these reasoning skills between each entity pair in this document. Thus, a discriminative reasoning network is designed to estimate the relation probability distribution of different reasoning paths based on the constructed graph and vectorized document contexts for each entity pair, thereby recognizing their relation. Experimental results show that our method outperforms the previous state-of-the-art performance on the large-scale DocRE dataset. The code is publicly available at https://github.com/xwjim/DRN.


title: Well-posedness in Sobolev spaces of the two-dimensional MHD Boundary layer equations without viscosity

abstract: We consider the two-dimensional MHD Boundary layer system without hydrodynamic viscosity, and establish the existence and uniqueness of solutions in Sobolev spaces under the assumption that the tangential component of magnetic fields dominates. This gives a complement to the previous works of Liu-Xie-Yang [Comm. Pure Appl. Math. 72 (2019)] and Liu-Wang-Xie-Yang [J. Funct. Anal. 279 (2020)], where the well-posedness theory was established for the MHD boundary layer systems with both viscosity and resistivity and with viscosity only, respectively. We use the pseudo-differential calculation, to overcome a new difficulty arising from the treatment of boundary integrals due to the absence of the diffusion property for the velocity.


title: Stein's method, smoothing and functional approximation

abstract: Stein's method for Gaussian process approximation can be used to bound the differences between the expectations of smooth functionals $h$ of a c\`adl\`ag random process $X$ of interest and the expectations of the same functionals of a well understood target random process $Z$ with continuous paths. Unfortunately, the class of smooth functionals for which this is easily possible is very restricted. Here, we prove an infinite dimensional Gaussian smoothing inequality, which enables the class of functionals to be greatly expanded -- examples are Lipschitz functionals with respect to the uniform metric, and indicators of arbitrary events -- in exchange for a loss of precision in the bounds. Our inequalities are expressed in terms of the smooth test function bound, an expectation of a functional of $X$ that is closely related to classical tightness criteria, a similar expectation for $Z$, and, for the indicator of a set $K$, the probability $\mathbb{P}(Z \in K^\theta \setminus K^{-\theta})$ that the target process is close to the boundary of $K$.


title: Axion-like dark matter clouds around rotating black holes

abstract: Numerical analysis of dark matter axion-like cloud in the vicinity of rotating black hole has been performed. The model where axion-like scalar field is non-trivially coupled to Maxwell field is studied in the spacetime of Kerr black hole in uniform magnetic field and in Kerr-Newman one. The dependence of scalar mass and black hole angular momentum on accumulation of axion dark matter cloud was given. It was revealed that condensation of the dark matter clouds is preferable for a very small mass of axion.


title: Ionization induced plasma grating and its applications in strong-field ionization measurements

abstract: An ionization-induced plasma grating can be formed by spatially selective ionization of gases by the interference of two intersecting ultra-short laser pulses. The density modulation of a plasma grating can approach unity since the plasma is produced only where the two pulses constructively interfere and ionization does not occur in destructive interference regions. Such a large density modulation leads to efficient Thomson scattering of a second ultra-short probe pulse once the Bragg condition is satisfied. By measuring the scattering efficiency, it is possible to determine the absolute electron density in the plasma grating and thereby deduce the ionization degree for a given neutral gas density. In this paper, we demonstrate the usefulness of this concept by showing two applications: ionization degree measurement of strong-field ionization of atoms and molecules and characterization of extremely low-density gas jets. The former application is of particular interest for ionization physics studies in dense gases where the collision of the ionized electron with neighboring neutrals may become important-sometimes referred to as many-body ionization, and the latter is useful for plasma-based acceleration that requires extremely low-density plasmas.


title: Deterministic Weighted Expander Decomposition in Almost-linear Time

abstract: In this note, we study the expander decomposition problem in a more general setting where the input graph has positively weighted edges and nonnegative demands on its vertices. We show how to extend the techniques of Chuzhoy et al. (FOCS 2020) to this wider setting, obtaining a deterministic algorithm for the problem in almost-linear time.


title: Global solutions of 2D isentropic compressible Navier-Stokes equations with one slow variable

abstract: Motivated by \cite{CG10,CZ6}, we prove the global existence of solutions to the two-dimensional isentropic compressible Navier-Stokes equations with smooth initial data which are slowly varying in one direction and with initial density being away from vacuum. In particular, we present examples of initial data which generate unique global smooth solutions to 2D compressible Navier-Stokes equations with constant viscosity and with initial data which are neither small perturbation of some constant equilibrium state nor of small energy.


title: Global Regularity for Nernst-Planck-Navier-Stokes Systems with Mixed Boundary Conditions

abstract: We consider electrodiffusion of ions in fluids, described by the Nernst-Planck-Navier-Stokes system, in three dimensional bounded domains, with mixed blocking (no-flux) and selective (Dirichlet) boundary conditions for the ionic concentrations and Robin boundary conditions for the electric potential, representing the presence of an electrical double layer. We prove global existence of strong solutions for large initial data in the case of two oppositely charged ionic species. The result hold unconditionally in the case where fluid flow is described by the Stokes equations. In the case of Navier-Stokes coupling, the result holds conditionally on Navier-Stokes regularity. We use a simplified argument to also establish global regularity for the case of purely blocking boundary conditions for the ionic concentrations for two oppositely charged ionic species and also for more than two species if the diffusivities are equal and the magnitudes of the valences are also equal.


title: Subset Node Representation Learning over Large Dynamic Graphs

abstract: Dynamic graph representation learning is a task to learn node embeddings over dynamic networks, and has many important applications, including knowledge graphs, citation networks to social networks. Graphs of this type are usually large-scale but only a small subset of vertices are related in downstream tasks. Current methods are too expensive to this setting as the complexity is at best linear-dependent on both the number of nodes and edges. In this paper, we propose a new method, namely Dynamic Personalized PageRank Embedding (\textsc{DynamicPPE}) for learning a target subset of node representations over large-scale dynamic networks. Based on recent advances in local node embedding and a novel computation of dynamic personalized PageRank vector (PPV), \textsc{DynamicPPE} has two key ingredients: 1) the per-PPV complexity is $\mathcal{O}(m \bar{d} / \epsilon)$ where $m,\bar{d}$, and $\epsilon$ are the number of edges received, average degree, global precision error respectively. Thus, the per-edge event update of a single node is only dependent on $\bar{d}$ in average; and 2) by using these high quality PPVs and hash kernels, the learned embeddings have properties of both locality and global consistency. These two make it possible to capture the evolution of graph structure effectively. Experimental results demonstrate both the effectiveness and efficiency of the proposed method over large-scale dynamic networks. We apply \textsc{DynamicPPE} to capture the embedding change of Chinese cities in the Wikipedia graph during this ongoing COVID-19 pandemic (https://en.wikipedia.org/wiki/COVID-19_pandemic). Our results show that these representations successfully encode the dynamics of the Wikipedia graph.


title: Morphological classification of galaxies with deep learning: comparing 3-way and 4-way CNNs

abstract: Classifying the morphologies of galaxies is an important step in understanding their physical properties and evolutionary histories. The advent of large-scale surveys has hastened the need to develop techniques for automated morphological classification. We train and test several convolutional neural network architectures to classify the morphologies of galaxies in both a 3-class (elliptical, lenticular, spiral) and 4-class (+irregular/miscellaneous) schema with a dataset of 14034 visually-classified SDSS images. We develop a new CNN architecture that outperforms existing models in both 3 and 4-way classification, with overall classification accuracies of 83% and 81% respectively. We also compare the accuracies of 2-way / binary classifications between all four classes, showing that ellipticals and spirals are most easily distinguished (>98% accuracy), while spirals and irregulars are hardest to differentiate (78% accuracy). Through an analysis of all classified samples, we find tentative evidence that misclassifications are physically meaningful, with lenticulars misclassified as ellipticals tending to be more massive, among other trends. We further combine our binary CNN classifiers to perform a hierarchical classification of samples, obtaining comparable accuracies (81%) to the direct 3-class CNN, but considerably worse accuracies in the 4-way case (65%). As an additional verification, we apply our networks to a small sample of Galaxy Zoo images, obtaining accuracies of 92%, 82% and 77% for the binary, 3-way and 4-way classifications respectively.


title: Analytical Studies of the Magnetic Domain Wall Structure in the presence of Non-uniform Exchange Bias

abstract: The pinning phenomena of the domain wall in the presence of exchange bias is studied analytically. The analytic solution of the domain wall spin configuration is presented. Unlike the traditional solution which is symmetric, our new solution could exhibit the asymmetry of the domain wall spin profile. Using the solution, the domain wall position, its width, its stability, and the depinning field are discussed analytically.


title: Irregularly Clipped Sparse Regression Codes

abstract: Recently, it was found that clipping can significantly improve the section error rate (SER) performance of sparse regression (SR) codes if an optimal clipping threshold is chosen. In this paper, we propose irregularly clipped SR codes, where multiple clipping thresholds are applied to symbols according to a distribution, to further improve the SER performance of SR codes. Orthogonal approximate message passing (OAMP) algorithm is used for decoding. Using state evolution, the distribution of irregular clipping thresholds is optimized to minimize the SER of OAMP decoding. As a result, optimized irregularly clipped SR codes achieve a better tradeoff between clipping distortion and noise distortion than regularly clipped SR codes. Numerical results demonstrate that irregularly clipped SR codes achieve 0.4 dB gain in signal-to-noise-ratio (SNR) over regularly clipped SR codes at code length$\,\approx2.5\!\times\! 10^4$ and SER$\,\approx10^{-5}$. We further show that irregularly clipped SR codes are robust over a wide range of code rates.


title: Multiple Imputation Through XGBoost

abstract: The use of multiple imputation (MI) is becoming increasingly popular for addressing missing data. Although some conventional MI approaches have been well studied and have shown empirical validity, they have limitations when processing large datasets with complex data structures. Their imputation performances usually rely on the proper specification of imputation models, which requires expert knowledge of the inherent relations among variables. Moreover, these standard approaches tend to be computationally inefficient for medium and large datasets. In this paper, we propose a scalable MI framework mixgb, which is based on XGBoost, subsampling, and predictive mean matching. Our approach leverages the power of XGBoost, a fast implementation of gradient boosted trees, to automatically capture interactions and non-linear relations while achieving high computational efficiency. In addition, we incorporate subsampling and predictive mean matching to reduce bias and better account for appropriate imputation variability. The proposed framework is implemented in an R package mixgb. Supplementary materials for this article are available online.


title: On generalized Fermat Diophantine functional and partial differential equations in $\mathbf{C}^2$

abstract: In this paper, we characterize meromorphic solutions $f(z_1,z_2),g(z_1,z_2)$ to the generalized Fermat Diophantine functional equations $h(z_1,z_2)f^m+k(z_1,z_2)g^n=1$ in $\mathbf{C}^2$ for integers $m,n\geq2$ and nonzero meromorphic functions $h(z_1,z_2),k(z_1,z_2)$ in $\mathbf{C}^2$. Meromorphic solutions to associated partial differential equations are also studied.


title: Real-time observation of charge-spin cooperative dynamics driven by a nonequilibrium phonon environment

abstract: Quantum dots are recognized as a suitable platform for studying thermodynamic phenomena involving single electronic charges and spins in nano-scale devices. However, such a thermodynamic system is usually driven by electron reservoirs at different temperatures, not by a lattice temperature gradient. We report on experimental observations of charge-spin cooperative dynamics in transitions of two-electron spin states in a GaAs double quantum dot located in a non-equilibrium phonon environment. Enhancements in the spin-flip processes are observed, originating from phonon excitation combined with the spin-orbit interaction. In addition, due to the spatial gradient of phonon density between the dots, the spin-flip rate during an inter-dot electron tunnel from a hot to a cold dot is more enhanced than in the other direction, resulting in accumulation of parallel spin states in the double dot.


title: A Provably-Efficient Model-Free Algorithm for Constrained Markov Decision Processes

abstract: This paper presents the first model-free, simulator-free reinforcement learning algorithm for Constrained Markov Decision Processes (CMDPs) with sublinear regret and zero constraint violation. The algorithm is named Triple-Q because it includes three key components: a Q-function (also called action-value function) for the cumulative reward, a Q-function for the cumulative utility for the constraint, and a virtual-Queue that (over)-estimates the cumulative constraint violation. Under Triple-Q, at each step, an action is chosen based on the pseudo-Q-value that is a combination of the three "Q" values. The algorithm updates the reward and utility Q-values with learning rates that depend on the visit counts to the corresponding (state, action) pairs and are periodically reset. In the episodic CMDP setting, Triple-Q achieves $\tilde{\cal O}\left(\frac{1 }{\delta}H^4 S^{\frac{1}{2}}A^{\frac{1}{2}}K^{\frac{4}{5}} \right)$ regret, where $K$ is the total number of episodes, $H$ is the number of steps in each episode, $S$ is the number of states, $A$ is the number of actions, and $\delta$ is Slater's constant. Furthermore, Triple-Q guarantees zero constraint violation, both on expectation and with a high probability, when $K$ is sufficiently large. Finally, the computational complexity of Triple-Q is similar to SARSA for unconstrained MDPs and is computationally efficient.


title: Introductory Tutorial for SPSA and the Quantum Approximation Optimization Algorithm

abstract: This short tutorial provides an introduction to the Quantum Approximation Optimization Algorithm (QAOA). Specifically, how to use QAOA with the Simultaneous Perturbation Stochastic Approximation (SPSA) algorithm to solve the Max-Cut problem. All steps of the algorithm are explicitly shown and no theory or complex mathematics are used. The focus is entirely on setting up a practical implementation. Fully functional examples in both R and python (using Qiskit) are provided, both using roughly 100 lines of code.


title: High-order flux reconstruction method for the hyperbolic formulation of the incompressible Navier-Stokes equations on unstructured grids

abstract: A high-order Flux reconstruction implementation of the hyperbolic formulation for the incompressible Navier-Stokes equation is presented. The governing equations employ Chorin's classical artificial compressibility (AC) formulation cast in hyperbolic form. Instead of splitting the second-order conservation law into two equations, one for the solution and another for the gradient, the Navier-Stokes equation is cast into a first-order hyperbolic system of equations. Including the gradients in the AC iterative process results in a significant improvement in accuracy for the pressure, velocity, and its gradients. Furthermore, this treatment allows for taking larger time-steps since the hyperbolic formulation eliminates the restriction due to diffusion. Tests using the method of manufactured solutions show that solving the conventional form of the Navier-Stokes equation lowers the order of accuracy for gradients, while the hyperbolic method is shown to provide equal orders of accuracy for both the velocity and its gradients which may be beneficial in several applications. Two- and three-dimensional benchmark tests demonstrate the superior accuracy and computational efficiency of the developed solver in comparison to the conventional method and other published works. This study shows that the developed high-order hyperbolic solver for incompressible flows is attractive due to its accuracy, stability and efficiency in solving diffusion dominated problems.


title: The Limitations of Limited Context for Constituency Parsing

abstract: Incorporating syntax into neural approaches in NLP has a multitude of practical and scientific benefits. For instance, a language model that is syntax-aware is likely to be able to produce better samples; even a discriminative model like BERT with a syntax module could be used for core NLP tasks like unsupervised syntactic parsing. Rapid progress in recent years was arguably spurred on by the empirical success of the Parsing-Reading-Predict architecture of (Shen et al., 2018a), later simplified by the Order Neuron LSTM of (Shen et al., 2019). Most notably, this is the first time neural approaches were able to successfully perform unsupervised syntactic parsing (evaluated by various metrics like F-1 score). However, even heuristic (much less fully mathematical) understanding of why and when these architectures work is lagging severely behind. In this work, we answer representational questions raised by the architectures in (Shen et al., 2018a, 2019), as well as some transition-based syntax-aware language models (Dyer et al., 2016): what kind of syntactic structure can current neural approaches to syntax represent? Concretely, we ground this question in the sandbox of probabilistic context-free-grammars (PCFGs), and identify a key aspect of the representational power of these approaches: the amount and directionality of context that the predictor has access to when forced to make parsing decision. We show that with limited context (either bounded, or unidirectional), there are PCFGs, for which these approaches cannot represent the max-likelihood parse; conversely, if the context is unlimited, they can represent the max-likelihood parse of any PCFG.


title: To Point or Not to Point: Understanding How Abstractive Summarizers Paraphrase Text

abstract: Abstractive neural summarization models have seen great improvements in recent years, as shown by ROUGE scores of the generated summaries. But despite these improved metrics, there is limited understanding of the strategies different models employ, and how those strategies relate their understanding of language. To understand this better, we run several experiments to characterize how one popular abstractive model, the pointer-generator model of See et al. (2017), uses its explicit copy/generation switch to control its level of abstraction (generation) vs extraction (copying). On an extractive-biased dataset, the model utilizes syntactic boundaries to truncate sentences that are otherwise often copied verbatim. When we modify the copy/generation switch and force the model to generate, only simple paraphrasing abilities are revealed alongside factual inaccuracies and hallucinations. On an abstractive-biased dataset, the model copies infrequently but shows similarly limited abstractive abilities. In line with previous research, these results suggest that abstractive summarization models lack the semantic understanding necessary to generate paraphrases that are both abstractive and faithful to the source document.


title: Two-Dimensional Bipolar Magnetic Semiconductor with High Curie Temperature and Electrically Controllable Spin Polarization Realized in Exfoliated Cr(pyrazine)$_2$ Monolayer

abstract: Exploring two-dimensional (2D) magnetic semiconductors with room temperature magnetic ordering and electrically controllable spin polarization is a highly desirable but challenging task for nanospintronics. Here, through first principles calculations, we propose to realize such a material by exfoliating the recently synthesized organometallic layered crystal Li$_{0.7}$[Cr(pyz)$_2$]Cl$_{0.7}$0.25$\cdot$(THF) (pyz = pyrazine, THF = tetrahydrofuran) [Science 370, 587 (2020)]. The feasibility of exfoliation is confirmed by the rather low exfoliation energy of 0.27 J/m$^2$, even smaller than that of graphite. In exfoliated Cr(pyz)$_2$ monolayer, each pyrazine ring grabs one electron from the Cr atom to become a radical anion, then a strong $d$-$p$ direct exchange magnetic interaction emerges between Cr cations and pyrazine radicals, resulting in room temperature ferrimagnetism with a Curie temperature of 342 K. Moreover, Cr(pyz)$_2$ monolayer is revealed to be an intrinsic bipolar magnetic semiconductor where electrical doping can induce half-metallic conduction with controllable spin-polarization direction.


title: Cross-Network Learning with Partially Aligned Graph Convolutional Networks

abstract: Graph neural networks have been widely used for learning representations of nodes for many downstream tasks on graph data. Existing models were designed for the nodes on a single graph, which would not be able to utilize information across multiple graphs. The real world does have multiple graphs where the nodes are often partially aligned. For examples, knowledge graphs share a number of named entities though they may have different relation schema; collaboration networks on publications and awarded projects share some researcher nodes who are authors and investigators, respectively; people use multiple web services, shopping, tweeting, rating movies, and some may register the same email account across the platforms. In this paper, I propose partially aligned graph convolutional networks to learn node representations across the models. I investigate multiple methods (including model sharing, regularization, and alignment reconstruction) as well as theoretical analysis to positively transfer knowledge across the (small) set of partially aligned nodes. Extensive experiments on real-world knowledge graphs and collaboration networks show the superior performance of our proposed methods on relation classification and link prediction.


title: A Subspace-based Approach for Dimensionality Reduction and Important Variable Selection

abstract: An analysis of high-dimensional data can offer a detailed description of a system but is often challenged by the curse of dimensionality. General dimensionality reduction techniques can alleviate such difficulty by extracting a few important features, but they are limited due to the lack of interpretability and connectivity to actual decision making associated with each physical variable. Variable selection techniques, as an alternative, can maintain the interpretability, but they often involve a greedy search that is susceptible to failure in capturing important interactions or a metaheuristic search that requires extensive computations. This research proposes a new method that produces subspaces, reduced-dimensional physical spaces, based on a randomized search and leverages an ensemble of critical subspace-based models, achieving dimensionality reduction and variable selection. When applied to high-dimensional data collected from the failure prediction of a composite/metal hybrid structure exhibiting complex progressive damage failure under loading, the proposed method outperforms the existing and potential alternatives in prediction and important variable selection.


title: Exponential mixing, KAM and smooth local rigidity

abstract: Consider actions of $\Z ^r$ by ergodic automorphisms on a compact nilmanifolds for $r \geq 2$. We show that small $C^k$ perturbations of such higher rank partially hyperbolic actions are smoothly conjugate to the original action, using a KAM scheme. The driving force for convergence of this iteration is the exponential mixing of the original action.


title: A Systematic Investigation of KB-Text Embedding Alignment at Scale

abstract: Knowledge bases (KBs) and text often contain complementary knowledge: KBs store structured knowledge that can support long range reasoning, while text stores more comprehensive and timely knowledge in an unstructured way. Separately embedding the individual knowledge sources into vector spaces has demonstrated tremendous successes in encoding the respective knowledge, but how to jointly embed and reason with both knowledge sources to fully leverage the complementary information is still largely an open problem. We conduct a large-scale, systematic investigation of aligning KB and text embeddings for joint reasoning. We set up a novel evaluation framework with two evaluation tasks, few-shot link prediction and analogical reasoning, and evaluate an array of KB-text embedding alignment methods. We also demonstrate how such alignment can infuse textual information into KB embeddings for more accurate link prediction on emerging entities and events, using COVID-19 as a case study.


title: An Information Theoretic approach to identify Dominant Voltage Influencers for Unbalanced Distribution Systems

abstract: Smart distribution grid with multiple renewable energy sources can experience random voltage fluctuations due to variable generation, which may result in voltage violations. Traditional voltage control algorithms are inadequate to handle fast voltage variations. Therefore, new dynamic control methods are being developed that can significantly benefit from the knowledge of dominant voltage influencer (DVI) nodes. DVI nodes for a particular node of interest refer to nodes that have a relatively high impact on the voltage fluctuations at that node. Conventional power flow-based algorithms to identify DVI nodes are computationally complex, which limits their use in real-time applications. This paper proposes a novel information theoretic voltage influencing score (VIS) that quantifies the voltage influencing capacity of nodes with DERs/active loads in a three phase unbalanced distribution system. VIS is then employed to rank the nodes and identify the DVI set. VIS is derived analytically in a computationally efficient manner and its efficacy to identify DVI nodes is validated using the IEEE 37-node test system. It is shown through experiments that KL divergence and Bhattacharyya distance are effective indicators of DVI nodes with an identifying accuracy of more than 90%. The computation burden is also reduced by an order of 5, thus providing the foundation for efficient voltage control.


title: Resource-Aware Cost-Sharing Mechanisms with Priors

abstract: In a decentralized system with $m$ machines, we study the selfish scheduling problem where each user strategically chooses which machine to use. Each machine incurs a cost, which is a function of the total load assigned to it, and some cost-sharing mechanism distributes this cost among the machine's users. The users choose a machine aiming to minimize their own share of the cost, so the cost-sharing mechanism induces a game among them. We approach this problem from the perspective of a designer who can select which cost-sharing mechanism to use, aiming to minimize the price of anarchy (PoA) of the induced games. Recent work introduced the class of \emph{resource-aware} cost-sharing mechanisms, whose decisions can depend on the set of machines in the system, but are oblivious to the total number of users. These mechanisms can guarantee low PoA bounds for instances where the cost functions of the machines are all convex or concave, but can suffer from very high PoA for cost functions that deviate from these families. In this paper we show that if we enhance the class of resource-aware mechanisms with some prior information regarding the users, then they can achieve low PoA for a much more general family of cost functions. We first show that, as long as the mechanism knows just two of the participating users, then it can assign special roles to them and ensure a constant PoA. We then extend this idea to settings where the mechanism has access to the probability with which each user is present in the system. For all these instances, we provide a mechanism that achieves an expected PoA that is logarithmic in the expected number of users.


title: The Emotion coding and Propagation based on improved Genetic algorithm

abstract: Computational communication research on information has been prevalent in recent years, as people are progressively inquisitive in social behavior and public opinion. Nevertheless, it is of great significance to analyze the direction of predominant sentiment from the sentiment communication perspective. In this paper, the information emotion propagation model is established by introducing revamp genetic algorithms into information emotion. In the process of information dissemination, both the information emotions and the network emotions are dynamic. For this model, the information emotions and the network nodes emotions are quantified as binary codes. The convergence effects, crossover and mutation algorithms are introduced. These factors all act on the transmission process via dynamic propagation rate, and the improved genetic algorithm also acts on the emotion transmission. In particular, the latter two algorithms are different from the existing biological domain. Based on the existing research results in other manuscripts, we perform simulation described above on the hybrid network. The simulation results demonstrate that the trend approximate to the actual data. As a result, our work can prove that our proposed model is essentially consistent with the actual emotion transmission phenomenon.


title: SIMLR: Machine Learning inside the SIR model for COVID-19 Forecasting

abstract: Accurate forecasts of the number of newly infected people during an epidemic are critical for making effective timely decisions. This paper addresses this challenge using the SIMLR model, which incorporates machine learning (ML) into the epidemiological SIR model. For each region, SIMLR tracks the changes in the policies implemented at the government level, which it uses to estimate the time-varying parameters of an SIR model for forecasting the number of new infections 1- to 4-weeks in advance.It also forecasts the probability of changes in those government policies at each of these future times, which is essential for the longer-range forecasts. We applied SIMLR to data from regions in Canada and in the United States,and show that its MAPE (mean average percentage error) performance is as good as SOTA forecasting models, with the added advantage of being an interpretable model. We expect that this approach will be useful not only for forecasting COVID-19 infections, but also in predicting the evolution of other infectious diseases.


title: Anomaly and Superconnection

abstract: We study anomalies of fermions with spacetime dependent mass. Using Fujikawa's method, it is found that the anomalies associated with the $U(N)_+\times U(N)_-$ chiral symmetry and $U(N)$ flavor symmetry for even and odd dimensions, respectively, can be written in terms of superconnections. In particular, the anomaly for a vector-like $U(1)$ symmetry is given by the Chern character of the superconnection in both even and odd dimensional cases. It is also argued that the non-Abelian anomaly for a system in D-dimensional spacetime is characterized by a (D+2)-form part of the Chern character of the superconnection which generalizes the usual anomaly polynomial for the massless case. These results enable us to analyze anomalies in the systems with interfaces and spacetime boundaries in a unified way. Applications to index theorems, including Atiyah-Patodi-Singer index theorem and Callias-type index theorem, are also discussed. In addition, we give a natural string theory interpretation of these results.


title: Data-Driven Design-by-Analogy: State of the Art and Future Directions

abstract: Design-by-Analogy (DbA) is a design methodology wherein new solutions, opportunities or designs are generated in a target domain based on inspiration drawn from a source domain; it can benefit designers in mitigating design fixation and improving design ideation outcomes. Recently, the increasingly available design databases and rapidly advancing data science and artificial intelligence technologies have presented new opportunities for developing data-driven methods and tools for DbA support. In this study, we survey existing data-driven DbA studies and categorize individual studies according to the data, methods, and applications in four categories, namely, analogy encoding, retrieval, mapping, and evaluation. Based on both nuanced organic review and structured analysis, this paper elucidates the state of the art of data-driven DbA research to date and benchmarks it with the frontier of data science and AI research to identify promising research opportunities and directions for the field. Finally, we propose a future conceptual data-driven DbA system that integrates all propositions.


title: On definable open continuous mappings

abstract: For a definable continuous mapping $f$ from a definable connected open subset $\Omega$ of $\mathbb R^n$ into $\mathbb R^n,$ we show that the following statements are equivalent: (i) The mapping $f$ is open. (ii) The fibers of $f$ are finite and the Jacobian of $f$ does not change sign on the set of points at which $f$ is differentiable. (iii) The fibers of ${f}$ are finite and the set of points at which $f$ is not a local homeomorphism has dimension at most $n - 2.$ As an application, we prove that Whyburn's conjecture is true for definable mappings: A definable open continuous mapping of one closed ball into another which maps boundary homeomorphically onto boundary is necessarily a homeomorphism.


title: Towards Robust GNSS Positioning and Real-time Kinematic Using Factor Graph Optimization

abstract: Global navigation satellite systems (GNSS) are one of the utterly popular sources for providing globally referenced positioning for autonomous systems. However, the performance of the GNSS positioning is significantly challenged in urban canyons, due to the signal reflection and blockage from buildings. Given the fact that the GNSS measurements are highly environmentally dependent and time-correlated, the conventional filtering-based method for GNSS positioning cannot simultaneously explore the time-correlation among historical measurements. As a result, the filtering-based estimator is sensitive to unexpected outlier measurements. In this paper, we present a factor graph-based formulation for GNSS positioning and real-time kinematic (RTK). The formulated factor graph framework effectively explores the time-correlation of pseudorange, carrier-phase, and doppler measurements, and leads to the non-minimal state estimation of the GNSS receiver. The feasibility of the proposed method is evaluated using datasets collected in challenging urban canyons of Hong Kong and significantly improved positioning accuracy is obtained, compared with the filtering-based estimator.


title: Position Heaps for Cartesian-tree Matching on Strings and Tries

abstract: The Cartesian-tree pattern matching is a recently introduced scheme of pattern matching that detects fragments in a sequential data stream which have a similar structure as a query pattern. Formally, Cartesian-tree pattern matching seeks all substrings $S'$ of the text string $S$ such that the Cartesian tree of $S'$ and that of a query pattern $P$ coincide. In this paper, we present a new indexing structure for this problem called the Cartesian-tree Position Heap (CPH). Let $n$ be the length of the input text string $S$, $m$ the length of a query pattern $P$, and $\sigma$ the alphabet size. We show that the CPH of $S$, denoted $\mathsf{CPH}(S)$, supports pattern matching queries in $O(m (\sigma + \log (\min\{h, m\})) + occ)$ time with $O(n)$ space, where $h$ is the height of the CPH and $occ$ is the number of pattern occurrences. We show how to build $\mathsf{CPH}(S)$ in $O(n \log \sigma)$ time with $O(n)$ working space. Further, we extend the problem to the case where the text is a labeled tree (i.e. a trie). Given a trie $T$ with $N$ nodes, we show that the CPH of $T$, denoted $\mathsf{CPH}(T)$, supports pattern matching queries on the trie in $O(m (\sigma^2 + \log (\min\{h, m\})) + occ)$ time with $O(N \sigma)$ space. We also show a construction algorithm for $\mathsf{CPH}(T)$ running in $O(N \sigma)$ time and $O(N \sigma)$ working space.


title: Semantic-Aware Contrastive Learning for Multi-object Medical Image Segmentation

abstract: Medical image segmentation, or computing voxelwise semantic masks, is a fundamental yet challenging task to compute a voxel-level semantic mask. To increase the ability of encoder-decoder neural networks to perform this task across large clinical cohorts, contrastive learning provides an opportunity to stabilize model initialization and enhance encoders without labels. However, multiple target objects (with different semantic meanings) may exist in a single image, which poses a problem for adapting traditional contrastive learning methods from prevalent 'image-level classification' to 'pixel-level segmentation'. In this paper, we propose a simple semantic-aware contrastive learning approach leveraging attention masks to advance multi-object semantic segmentation. Briefly, we embed different semantic objects to different clusters rather than the traditional image-level embeddings. We evaluate our proposed method on a multi-organ medical image segmentation task with both in-house data and MICCAI Challenge 2015 BTCV datasets. Compared with current state-of-the-art training strategies, our proposed pipeline yields a substantial improvement of 5.53% and 6.09% on Dice score for both medical image segmentation cohorts respectively (p-value<0.01). The performance of the proposed method is further assessed on natural images via the PASCAL VOC 2012 dataset, and achieves a substantial improvement of 2.75% on mIoU (p-value<0.01).


title: ZmBART: An Unsupervised Cross-lingual Transfer Framework for Language Generation

abstract: Despite the recent advancement in NLP research, cross-lingual transfer for natural language generation is relatively understudied. In this work, we transfer supervision from high resource language (HRL) to multiple low-resource languages (LRLs) for natural language generation (NLG). We consider four NLG tasks (text summarization, question generation, news headline generation, and distractor generation) and three syntactically diverse languages, i.e., English, Hindi, and Japanese. We propose an unsupervised cross-lingual language generation framework (called ZmBART) that does not use any parallel or pseudo-parallel/back-translated data. In this framework, we further pre-train mBART sequence-to-sequence denoising auto-encoder model with an auxiliary task using monolingual data of three languages. The objective function of the auxiliary task is close to the target tasks which enriches the multi-lingual latent representation of mBART and provides good initialization for target tasks. Then, this model is fine-tuned with task-specific supervised English data and directly evaluated with low-resource languages in the Zero-shot setting. To overcome catastrophic forgetting and spurious correlation issues, we applied freezing model component and data argumentation approaches respectively. This simple modeling approach gave us promising results.We experimented with few-shot training (with 1000 supervised data points) which boosted the model performance further. We performed several ablations and cross-lingual transferability analyses to demonstrate the robustness of ZmBART.


title: Automatically Detecting Cyberbullying Comments on Online Game Forums

abstract: Online game forums are popular to most of game players. They use it to communicate and discuss the strategy of the game, or even to make friends. However, game forums also contain abusive and harassment speech, disturbing and threatening players. Therefore, it is necessary to automatically detect and remove cyberbullying comments to keep the game forum clean and friendly. We use the Cyberbullying dataset collected from World of Warcraft (WoW) and League of Legends (LoL) forums and train classification models to automatically detect whether a comment of a player is abusive or not. The result obtains 82.69% of macro F1-score for LoL forum and 83.86% of macro F1-score for WoW forum by the Toxic-BERT model on the Cyberbullying dataset.


title: Universal form of thermodynamic uncertainty relation for Langevin dynamics

abstract: Thermodynamic uncertainty relation (TUR) provides a stricter bound for entropy production (EP) than that of the thermodynamic second law. This stricter bound can be utilized to infer the EP and derive other trade-off relations. Though the validity of the TUR has been verified in various stochastic systems, its application to general Langevin dynamics has not been successful in a unified way, especially for underdamped Langevin dynamics, where odd parity variables in time-reversal operation such as velocity get involved. Previous TURs for underdamped Langevin dynamics is neither experimentally accessible nor reduced to the original form of the overdamped Langevin dynamics in the zero-mass limit. Here, we find an operationally accessible TUR for underdamped Langevin dynamics with an arbitrary time-dependent protocol. We show that the original TUR is a consequence of our underdamped TUR in the zero-mass limit. This indicates that the TUR formulation presented here can be regarded as the universal form of the TUR for general Langevin dynamics. The validity of our result is examined and confirmed for three prototypical underdamped Langevin systems and their zero-mass limits; free diffusion dynamics, charged Brownian particle in a magnetic field, and molecular refrigerator.


title: Nonlinear circular valley photogalvanic effect

abstract: We develop a theory of circular photogalvanic effect in non-gyrotropic two-dimensional transition metal dichalcogenide monolayers under interband optical transitions. Oblique incidence of circularly-polarized electromagnetic field or normal incidence of elliptically polarized electromagnetic field is assumed. In contrast to the linear-in-intensity conventional photogalvanic effect, the effect considered here arises in the second intensity order. The effect is conditioned by i) the predominant population of the valleys by the circular in-plane electromagnetic field component and ii) the direct drift of the photo-excited carriers by the linear-polarized in-plane electromagnetic field component in the presence of trigonal valley asymmetry.


title: Men Are Elected, Women Are Married: Events Gender Bias on Wikipedia

abstract: Human activities can be seen as sequences of events, which are crucial to understanding societies. Disproportional event distribution for different demographic groups can manifest and amplify social stereotypes, and potentially jeopardize the ability of members in some groups to pursue certain goals. In this paper, we present the first event-centric study of gender biases in a Wikipedia corpus. To facilitate the study, we curate a corpus of career and personal life descriptions with demographic information consisting of 7,854 fragments from 10,412 celebrities. Then we detect events with a state-of-the-art event detection model, calibrate the results using strategically generated templates, and extract events that have asymmetric associations with genders. Our study discovers that the Wikipedia pages tend to intermingle personal life events with professional events for females but not for males, which calls for the awareness of the Wikipedia community to formalize guidelines and train the editors to mind the implicit biases that contributors carry. Our work also lays the foundation for future works on quantifying and discovering event biases at the corpus level.


title: The SIR model towards he data. One year of Covid-19 pandemic in Italy case study and plausible "real" numbers

abstract: In this work, the SIR epidemiological model is reformulated so to highlight the important {\em effective reproduction number}, as well as to account for the {\em generation time}, inverse of the {\em incidence rate}, and the {\em infectious period} (or {\em removal period}), inverse of the {\em removal rate}. The aim is to check whether the relationships the model poses among the various observables are actually found in the data. The study case of the second through the third wave of the Covid-19 pandemic in Italy is taken. Given its scale invariance, initially the model is tested with reference to the curve of swab-confirmed infectious individuals only. It is found to match the data if the given curve of the {\em removed} (that is healed or deceased) individuals is assumed underestimated by a factor of about 3 together with other related curves. Contextually, the {\em generation time} and the {\em removal period}, as well as the {\em effective reproduction number}, are obtained fitting the SIR equations to the data; the outcomes prove to be in good agreement with those of other works. Then, using knowledge of the proportion of Covid-19 transmissions likely occurring from individuals who didn't develop symptoms, thus mainly undetected, an estimate of the {\em "true numbers"} of the epidemic is obtained, looking also in good agreement with results from other, completely different works. The line of this work is new and the procedures are computationally really inexpensive.


title: CT-Net: Channel Tensorization Network for Video Classification

abstract: 3D convolution is powerful for video classification but often computationally expensive, recent studies mainly focus on decomposing it on spatial-temporal and/or channel dimensions. Unfortunately, most approaches fail to achieve a preferable balance between convolutional efficiency and feature-interaction sufficiency. For this reason, we propose a concise and novel Channel Tensorization Network (CT-Net), by treating the channel dimension of input feature as a multiplication of K sub-dimensions. On one hand, it naturally factorizes convolution in a multiple dimension way, leading to a light computation burden. On the other hand, it can effectively enhance feature interaction from different channels, and progressively enlarge the 3D receptive field of such interaction to boost classification accuracy. Furthermore, we equip our CT-Module with a Tensor Excitation (TE) mechanism. It can learn to exploit spatial, temporal and channel attention in a high-dimensional manner, to improve the cooperative power of all the feature dimensions in our CT-Module. Finally, we flexibly adapt ResNet as our CT-Net. Extensive experiments are conducted on several challenging video benchmarks, e.g., Kinetics-400, Something-Something V1 and V2. Our CT-Net outperforms a number of recent SOTA approaches, in terms of accuracy and/or efficiency. The codes and models will be available on https://github.com/Andy1621/CT-Net.


title: Noisy student-teacher training for robust keyword spotting

abstract: We propose self-training with noisy student-teacher approach for streaming keyword spotting, that can utilize large-scale unlabeled data and aggressive data augmentation. The proposed method applies aggressive data augmentation (spectral augmentation) on the input of both student and teacher and utilize unlabeled data at scale, which significantly boosts the accuracy of student against challenging conditions. Such aggressive augmentation usually degrades model performance when used with supervised training with hard-labeled data. Experiments show that aggressive spec augmentation on baseline supervised training method degrades accuracy, while the proposed self-training with noisy student-teacher training improves accuracy of some difficult-conditioned test sets by as much as 60%.


title: $\widehat{sl(2)}$ decomposition of denominator formulae of some BKM Lie superalgebras

abstract: We study a family of Siegel modular forms that are constructed using Jacobi forms that arise in Umbral moonshine. All but one of them arise as the Weyl-Kac-Borcherds denominator formula of some Borcherds-Kac-Moody (BKM) Lie superalgebras. These Lie superalgebras have a $\widehat{sl(2)}$ subalgebra which we use to study the Siegel modular forms. We show that the expansion of the Umbral Jacobi forms in terms of $\widehat{sl(2)}$ characters leads to vector-valued modular forms. We obtain closed formulae for these vector-valued modular forms. In the Lie algebraic context, the Fourier coefficients of these vector-valued modular forms are related to multiplicities of roots appearing on the sum side of the Weyl-Kac-Borcherds denominator formulae.


title: Exploring Memorization in Adversarial Training

abstract: Deep learning models have a propensity for fitting the entire training set even with random labels, which requires memorization of every training sample. In this paper, we explore the memorization effect in adversarial training (AT) for promoting a deeper understanding of model capacity, convergence, generalization, and especially robust overfitting of the adversarially trained models. We first demonstrate that deep networks have sufficient capacity to memorize adversarial examples of training data with completely random labels, but not all AT algorithms can converge under the extreme circumstance. Our study of AT with random labels motivates further analyses on the convergence and generalization of AT. We find that some AT approaches suffer from a gradient instability issue and most recently suggested complexity measures cannot explain robust generalization by considering models trained on random labels. Furthermore, we identify a significant drawback of memorization in AT that it could result in robust overfitting. We then propose a new mitigation algorithm motivated by detailed memorization analyses. Extensive experiments on various datasets validate the effectiveness of the proposed method.


title: Grounding Complex Navigational Instructions Using Scene Graphs

abstract: Training a reinforcement learning agent to carry out natural language instructions is limited by the available supervision, i.e. knowing when the instruction has been carried out. We adapt the CLEVR visual question answering dataset to generate complex natural language navigation instructions and accompanying scene graphs, yielding an environment-agnostic supervised dataset. To demonstrate the use of this data set, we map the scenes to the VizDoom environment and use the architecture in \citet{gatedattention} to train an agent to carry out these more complex language instructions.


title: A Discussion On the Validity of Manifold Learning

abstract: Dimensionality reduction (DR) and manifold learning (ManL) have been applied extensively in many machine learning tasks, including signal processing, speech recognition, and neuroinformatics. However, the understanding of whether DR and ManL models can generate valid learning results remains unclear. In this work, we investigate the validity of learning results of some widely used DR and ManL methods through the chart mapping function of a manifold. We identify a fundamental problem of these methods: the mapping functions induced by these methods violate the basic settings of manifolds, and hence they are not learning manifold in the mathematical sense. To address this problem, we provide a provably correct algorithm called fixed points Laplacian mapping (FPLM), that has the geometric guarantee to find a valid manifold representation (up to a homeomorphism). Combining one additional condition(orientation preserving), we discuss a sufficient condition for an algorithm to be bijective for any d-simplex decomposition result on a d-manifold. However, constructing such a mapping function and its computational method satisfying these conditions is still an open problem in mathematics.


title: Tail-to-Tail Non-Autoregressive Sequence Prediction for Chinese Grammatical Error Correction

abstract: We investigate the problem of Chinese Grammatical Error Correction (CGEC) and present a new framework named Tail-to-Tail (\textbf{TtT}) non-autoregressive sequence prediction to address the deep issues hidden in CGEC. Considering that most tokens are correct and can be conveyed directly from source to target, and the error positions can be estimated and corrected based on the bidirectional context information, thus we employ a BERT-initialized Transformer Encoder as the backbone model to conduct information modeling and conveying. Considering that only relying on the same position substitution cannot handle the variable-length correction cases, various operations such substitution, deletion, insertion, and local paraphrasing are required jointly. Therefore, a Conditional Random Fields (CRF) layer is stacked on the up tail to conduct non-autoregressive sequence prediction by modeling the token dependencies. Since most tokens are correct and easily to be predicted/conveyed to the target, then the models may suffer from a severe class imbalance issue. To alleviate this problem, focal loss penalty strategies are integrated into the loss functions. Moreover, besides the typical fix-length error correction datasets, we also construct a variable-length corpus to conduct experiments. Experimental results on standard datasets, especially on the variable-length datasets, demonstrate the effectiveness of TtT in terms of sentence-level Accuracy, Precision, Recall, and F1-Measure on tasks of error Detection and Correction.


title: Resonant and first-order dipolar interactions between ultracold molecules in static and microwave electric fields

abstract: We theoretically study collisions between ultracold polar molecules that are polarized by microwave or static electric fields. We systematically study the dependence on field strength, microwave polarization, and detuning from rotational transitions. We calculate the loss in two-body collisions that is observable experimentally and compare to the results expected for purely first-order dipolar interactions. For ground state molecules polarized by a static electric field, the dynamics are accurately described by first-order dipolar interactions. For microwave dressing, instead, resonant dipolar collisions dominate the collision process, in which molecules reorient along the intermolecular axis and interact with the full strength of the transition dipole. For red detuning, reorientation can only be suppressed at extreme Rabi frequencies. For blue detuned microwaves, resonant dipolar interactions dominate even for high Rabi frequencies, leading to microwave shielding for circular polarization and structured losses due to resonances for linear polarization. The results are presented numerically for fermionic $^{23}$Na$^{40}$K and bosonic $^{23}$Na$^{39}$K molecules.