title: Understanding $P_{cs}(4459)$ as a hadronic molecule in the $\Xi_b^-\to J/\psi \Lambda K^-$ decay

abstract: Recently, the LHCb Collaboration reported on the evidence for a hidden charm pentaquark state with strangeness, i.e., $P_{cs}(4459)$, in the $J/\psi\Lambda$ invariant mass distribution of the $\Xi_b^-\to J/\psi \Lambda K^-$ decay. In this work, assuming that $P_{cs}(4459)$ is a $\bar{D}^*\Xi_c$ molecular state, we study this decay via triangle diagrams $\Xi_b\rightarrow \bar{D}_s^{(*)}\Xi_c\to (\bar{D}^{(*)}\bar{K})\Xi_c\to P_{cs} \bar{K}\to (J/\psi\Lambda) \bar{K}$. Our study shows that the production yield of a spin 3/2 $\bar{D}^*\Xi_c$ state is approximately one order of magnitude larger than that of a spin $1/2$ state due to the interference of $\bar{D}_s\Xi_c$ and $\bar{D}_s^*\Xi_c$ intermediate states. We obtain a model independent constraint on the product of couplings $g_{P_{cs}\bar{D}^*\Xi_c}$ and $g_{P_{cs}J/\psi\Lambda}$. With the predictions of two particular molecular models as inputs, we calculate the branching ratio of $\Xi_b^-\to (P_{cs}\to)J/\psi\Lambda K^- $ and compare it with the experimental measurement. We further predict the lineshape of this decay which could be useful to future experimental studies.


title: Spherical conical metrics and harmonic maps to spheres

abstract: A spherical conical metric $g$ on a surface $\Sigma$ is a metric of constant curvature $1$ with finitely many isolated conical singularities. The uniformization problem for such metrics remains largely open when at least one of the cone angles exceeds $2\pi$. The eigenfunctions of the Friedrichs Laplacian $\Delta_g$ with eigenvalue $\lambda=2$ play a special role in this problem, as they represent local obstructions to deformations of the metric $g$ in the class of spherical conical metrics. In the present paper we apply the theory of multivalued harmonic maps to spheres to the question of existence of such eigenfunctions. In the first part we establish a new criterion for the existence of $2$-eigenfunctions, given in terms of a certain meromorphic data on $\Sigma$. As an application we give a description of all $2$-eigenfunctions for metrics on the sphere with at most three conical singularities. The second part is an algebraic construction of metrics with large number of $2$-eigenfunctions via the deformation of multivalued harmonic maps. We provide new explicit examples of metrics with many $2$-eigenfunctions via both approaches, and describe the general algorithm to find metrics with arbitrarily large number of $2$-eigenfunctions.


title: Gravitational wave propagation in $f(R)$ models: New parametrizations and observational constraints

abstract: Modified gravity (MG) theories predict, in general, that the ratio of gravitational wave (GW) to electromagnetic (EM) luminosity distances, $\Xi$, differs from its general relativity (GR) value of unity at cosmological scales, thus providing another perturbative probe to MG. In this paper, we introduce new phenomenological parametrizations for both the Friedmann-Lema\^itre-Robertson-Walker (FLRW) background evolution of $f(R)$ models, via the dark energy equation of state parameter, $w_{\text{DE}}$, and for $\Xi$ in this class of theories. We simulate a mock dataset for the Einstein Telescope (ET) of 1000 GW signals from binary neutron star (BNS) mergers and redshift information from their EM counterpart, exploring the consequent constraints on the relevant gravitational, cosmological and phenomenological parameters. As a model of particular interest, we take $\gamma$-gravity theory and investigate whether it could be distinguished from GR's $\Lambda$CDM model. We then combine our results with actual data from type Ia supernovae (SNIa) and combined baryon acoustic oscillations (BAO) and cosmic microwave background (CMB) observations. Additionally, we also investigate the potential bounds to $f_{R0}$ for any viable $f(R)$ whose background evolution is indistinguishable from the standard model of cosmology above a certain redshift, showing that, for a $\Lambda$CDM fiducial model, ET data would provide $|f_{R0}|<10^{-2}$ at a 95\% level. We conclude altogether that probing the redshift evolution of the GW luminosity distance from detections of the ET in its first running decade will not substantially help constraining $f(R)$ theories of gravity.


title: Modulation instability, conservation laws and localized waves for the generalized coupled Fokas-Lenells equation

abstract: This paper focuses on the modulation instability, conservation laws and localized wave solutions of the generalized coupled Fokas-Lenells equation. Based on the theory of linear stability analysis, distribution pattern of modulation instability gain G in the (K,k) frequency plane is depicted, and the constraints for the existence of rogue waves are derived. Subsequently, we construct the infinitely many conservation laws for the generalized coupled Fokas-Lenells equation from the Riccati-type formulas of the Lax pair. In addition, the compact determinant expressions of the N-order localized wave solutions are given via generalized Darboux transformation, including higher-order rogue waves and interaction solutions among rogue waves with bright-dark solitons or breathers. These solutions are parameter controllable: (m_i,n_i) and (\alpha,\beta) control the structure and ridge deflection of solution respectively, while the value of |d| controls the strength of interaction to realize energy exchange. Especially, when d=0, the interaction solutions degenerate into the corresponding order of rogue waves.


title: Analyzing the Effect of Persistent Asset Switches on a Class of Hybrid-Inspired Optimization Algorithms

abstract: Convex optimization challenges are currently pervasive in many science and engineering domains. In many applications of convex optimization, such as those involving multi-agent systems and resource allocation, the objective function can persistently switch during the execution of an optimization algorithm. Motivated by such applications, we analyze the effect of persistently switching objectives in continuous-time optimization algorithms. In particular, we take advantage of existing robust stability results for switched systems with distinct equilibria and extend these results to systems described by differential inclusions, making the results applicable to recent optimization algorithms that employ differential inclusions for improving efficiency and/or robustness. Within the framework of hybrid systems theory, we provide an accurate characterization, in terms of Omega-limit sets, of the set to which the optimization dynamics converge. Finally, by considering the switching signal to be constrained in its average dwell time, we establish semi-global practical asymptotic stability of these sets with respect to the dwell-time parameter.


title: Evaluation of two-particle properties within finite-temperature self-consistent one-particle Green's function methods: theory and application to GW and GF2

abstract: One-particle Green's function methods can model molecular and solid spectra at zero or non-zero temperatures. One-particle Green's functions directly provide electronic energies and one-particle properties, such as dipole moment. However, the evaluation of two-particle properties, such as $\langle{S^2}\rangle$ and $\langle{N^2}\rangle$ can be challenging, because they require a solution of the computationally expensive Bethe--Salpeter equation to find two-particle Green's functions. We demonstrate that the solution of the Bethe--Salpeter equation can be complitely avoided. Applying the thermodynamic Hellmann--Feynman theorem to self-consistent one-particle Green's function methods, we derive expressions for two-particle density matrices in a general case and provide explicit expressions for GF2 and GW methods. Such density matrices can be decomposed into an antisymmetrized product of correlated one-electron density matrices and the two-particle electronic cumulant of the density matrix. Cumulant expressions reveal a deviation from ensemble representability for GW, explaining its known deficiencies. We analyze the temperature dependence of $\langle{S^2}\rangle$ and $\langle{N^2}\rangle$ for a set of small closed-shell systems. Interestingly, both GF2 and GW show a non-zero spin contamination and a non-zero fluctuation of the number of particles for closed-shell systems at the zero-temperature limit.


title: Continuous Phase Transition of the higher-dimensional topological de-Sitter Spacetime with the Non-linear Source

abstract: For the higher-dimensional dS spacetime embedded with black holes with non-linear charges, there are two horizons with different radiation temperatures. By introducing the interplay between two horizons this system can be regarded as an ordinary thermodynamic system in the thermodynamic equilibrium described by the thermodynamic quantities ($T_{eff},~P_{eff},~V,~S,~\Phi_{eff}$). In this work, our focus is on the thermodynamic properties of phase transition for the four-dimensional dS spacetime with different values of the charge correction $\bar\phi$. We find that with the increasing of the non-linear charge correction the two horizons get closer and closer, and the correction entropy is negative which indicates the interaction between the two horizons stronger and stronger. Furthermore, the heat capacity at constant pressure, isobaric expansion coefficient, and the isothermal compression coefficient have the schottky peak at the critical point. However, the heat capacity as constant volume for the dS spacetime is nonzero. Finally, the dynamical properties of phase transition for this system have investigated based on Gibbs free energy, where exists the different behavior with that for AdS black holes.


title: A hybrid method for overcoming thermal shock of non-contact infrared thermometers

abstract: The non-contact infrared thermometer (NCIT) is an important basic tool for fever screening and self-health monitoring. However, it is susceptible to the thermal shock when working in a low temperature environment, which will cause a time-consuming and inaccurate human body temperature measurements. To overcome the effects of thermal shock, a hybrid temperature compensation method combining hardware and algorithm is proposed. Firstly, the principle of infrared temperature measurement is described and the influence of thermal shock on infrared thermometer is analyzed. Then, the hybrid temperature compensation scheme is constructed by mounting a heating ring on the infrared sensor shell, and using the proportional integral derivative (PID) algorithm and the pulse width modulation (PWM) technology to control it heating. In this way, the internal ambient temperature of infrared sensor can be raised rapidly closing to the external ambient temperature, and the stable outputs of the infrared sensor are also accelerated. Finally, some experiments are carried out in a laboratory. The results show that the proposed method can quickly and accurately measure the temperature of standard black body when the ambient temperatures are 5 , 15 and 25 Celsius respectively, the measurement error is only 0.2 Celsius , and the measurement time is less than 2 seconds. This study would be beneficial to improve performance of NCIT, especially the infrared ear thermometer.


title: Big Bang Nucleosynthesis Initial Conditions: Revisiting Wagoner et al. (1967)

abstract: We revisit Wagoner et al. (1967), a classic contribution in the development of Big Bang Nucleosynthesis. We demonstrate that it presents an incorrect expression for the temperature of the early universe as a function of time in the high temperature limit, $T \gtrsim 10^{10}$K. As this incorrect expression has been reproduced elsewhere, we present a corrected form for the initial conditions required for calculating the formation of the primordial elements in the Big Bang.


title: Nontriviality of Riesz--Morrey Spaces

abstract: In this article, the authors completely answer an open question, presented in [Banach J. Math. Anal. 15 (2021), no. 1, 20], via showing that the Riesz--Morrey space is truly a new space larger than a particular Lebesgue space with critical index. Indeed, this Lebesgue space is just the real interpolation space of the Riesz--Morrey space for suitable indices. Moreover, the authors further show the aforementioned inclusion is also proper, namely, this embedding is sharp in some sense, via constructing two nontrivial spare functions, respectively, on $\mathbb{R}^n$ and any given cube $Q_0$ of $\mathbb{R}^n$ with finite side length. The latter constructed function is inspired by the striking function constructed by Dafni et al. [J. Funct. Anal. 275 (2018), 577--603]. All the proofs of these results strongly depend on some exquisite geometrical analysis on cubes of $\mathbb{R}^n$. As an application, the relationship between Riesz--Morrey spaces and Lebesgue spaces is completely clarified on all indices.


title: Distributed Cooperative Driving in Multi-Intersection Road Networks

abstract: Cooperative driving at isolated intersections attracted great interest and had been well discussed in recent years. However, cooperative driving in multi-intersection road networks remains to be further investigated, because many algorithms for isolated intersection cannot be directly adopted for road networks. In this paper, we propose a distributed strategy to appropriately decompose the problem into small-scale sub-problems that address vehicle cooperation within limited temporal-spatial areas and meanwhile assure appropriate coordination between adjacent areas by specially designed information exchange. Simulation results demonstrate the efficiency-complexity balanced advantage of the proposed strategy under various traffic demand settings.


title: Efficient Sparse Coding using Hierarchical Riemannian Pursuit

abstract: Sparse coding is a class of unsupervised methods for learning a sparse representation of the input data in the form of a linear combination of a dictionary and a sparse code. This learning framework has led to state-of-the-art results in various image and video processing tasks. However, classical methods learn the dictionary and the sparse code based on alternating optimizations, usually without theoretical guarantees for either optimality or convergence due to non-convexity of the problem. Recent works on sparse coding with a complete dictionary provide strong theoretical guarantees thanks to the development of the non-convex optimization. However, initial non-convex approaches learn the dictionary in the sparse coding problem sequentially in an atom-by-atom manner, which leads to a long execution time. More recent works seek to directly learn the entire dictionary at once, which substantially reduces the execution time. However, the associated recovery performance is degraded with a finite number of data samples. In this paper, we propose an efficient sparse coding scheme with a two-stage optimization. The proposed scheme leverages the global and local Riemannian geometry of the two-stage optimization problem and facilitates fast implementation for superb dictionary recovery performance by a finite number of samples without atom-by-atom calculation. We further prove that, with high probability, the proposed scheme can exactly recover any atom in the target dictionary with a finite number of samples if it is adopted to recover one atom of the dictionary. An application on wireless sensor data compression is also proposed. Experiments on both synthetic and real-world data verify the efficiency and effectiveness of the proposed scheme.


title: Visual Analysis Motivated Rate-Distortion Model for Image Coding

abstract: Optimized for pixel fidelity metrics, images compressed by existing image codec are facing systematic challenges when used for visual analysis tasks, especially under low-bitrate coding. This paper proposes a visual analysis-motivated rate-distortion model for Versatile Video Coding (VVC) intra compression. The proposed model has two major contributions, a novel rate allocation strategy and a new distortion measurement model. We first propose the region of interest for machine (ROIM) to evaluate the degree of importance for each coding tree unit (CTU) in visual analysis. Then, a novel CTU-level bit allocation model is proposed based on ROIM and the local texture characteristics of each CTU. After an in-depth analysis of multiple distortion models, a visual analysis friendly distortion criteria is subsequently proposed by extracting deep feature of each coding unit (CU). To alleviate the problem of lacking spatial context information when calculating the distortion of each CU, we finally propose a multi-scale feature distortion (MSFD) metric using different neighboring pixels by weighting the extracted deep features in each scale. Extensive experimental results show that the proposed scheme could achieve up to 28.17\% bitrate saving under the same analysis performance among several typical visual analysis tasks such as image classification, object detection, and semantic segmentation.


title: Synchronized oscillations in swarms of nematode Turbatrix aceti

abstract: There is a recent surge of interest in the behavior of active particles that can at the same time align their direction of movement and synchronize their oscillations, known as swarmalators. While theoretical and numerical models of such systems are now abundant, no real-life examples have been shown to date. We present an experimental investigation of the collective motion of the nematode Turbatrix aceti that self-propel by body undulation. We discover that these nematodes can synchronize their body oscillations, forming striking traveling metachronal waves, which produces strong fluid flows. We uncover that the location and strength of this collective state can be controlled through the shape of the confining structure; in our case the contact angle of a droplet. This opens a way for producing controlled work such as on-demand flows or displacement of objects. We illustrate this by showing that the force generated by this state is sufficient to change the physics of evaporation of fluid droplets, by counteracting the surface-tension force, which allow us to estimate its strength. The relatively large size and ease of culture make Turbatrix aceti a promising model organism for experimental investigation of swarming and oscillating active matter capable of producing controllable work.


title: Diverse and Specific Clarification Question Generation with Keywords

abstract: Product descriptions on e-commerce websites often suffer from missing important aspects. Clarification question generation (CQGen) can be a promising approach to help alleviate the problem. Unlike traditional QGen assuming the existence of answers in the context and generating questions accordingly, CQGen mimics user behaviors of asking for unstated information. The generated CQs can serve as a sanity check or proofreading to help e-commerce merchant to identify potential missing information before advertising their product, and improve consumer experience consequently. Due to the variety of possible user backgrounds and use cases, the information need can be quite diverse but also specific to a detailed topic, while previous works assume generating one CQ per context and the results tend to be generic. We thus propose the task of Diverse CQGen and also tackle the challenge of specificity. We propose a new model named KPCNet, which generates CQs with Keyword Prediction and Conditioning, to deal with the tasks. Automatic and human evaluation on 2 datasets (Home & Kitchen, Office) showed that KPCNet can generate more specific questions and promote better group-level diversity than several competing baselines.


title: Robust shape estimation with false-positive contact detection

abstract: We propose a means of omni-directional contact detection using accelerometers instead of tactile sensors for object shape estimation using touch. Unlike tactile sensors, our contact-based detection method tends to induce a degree of uncertainty with false-positive contact data because the sensors may react not only to actual contact but also to the unstable behavior of the robot. Therefore, it is crucial to consider a robust shape estimation method capable of handling such false-positive contact data. To realize this, we introduce the concept of heteroscedasticity into the contact data and propose a robust shape estimation algorithm based on Gaussian process implicit surfaces (GPIS). We confirmed that our algorithm not only reduces shape estimation errors caused by false-positive contact data but also distinguishes false-positive contact data more clearly than the GPIS through simulations and actual experiments using a quadcopter.


title: Evidential Cyber Threat Hunting

abstract: A formal cyber reasoning framework for automating the threat hunting process is described. The new cyber reasoning methodology introduces an operational semantics that operates over three subspaces -- knowledge, hypothesis, and action -- to enable human-machine co-creation of threat hypotheses and protective recommendations. An implementation of this framework shows that the approach is practical and can be used to generalize evidence-based multi-criteria threat investigations.


title: Feedback Stabilization and Output Tracking for Discrete-Time Lipschitz Nonlinear Systems via Iterative Convex Approximations

abstract: The stabilization of unstable nonlinear systems and tracking control are challenging engineering problems due to the encompassed nonlinearities in dynamic systems and their scale. In the past decades, numerous observer-based control designs for dynamic systems in which the nonlinearity belongs to Lipschitz functions have been proposed. However, most of them only focus on output feedback and consequently, state feedback design remains less developed. To that end, this paper is dedicated to the problem of full-state feedback controller design for discrete-time Lipschitz nonlinear systems. In addition, we present a simple iterative method for improving the convergence of the closed-loop performance. It is later demonstrated that our approach can be conveniently extended and utilized for output tracking.


title: Secure Quantum Secret Sharing without Signal Disturbance Monitoring

abstract: Quantum secret sharing (QSS) is an essential primitive for the future quantum internet, which promises secure multiparty communication. However, developing a large-scale QSS network is a huge challenge due to the channel loss and the requirement of multiphoton interference or high-fidelity multipartite entanglement distribution. Here, we propose a three-user QSS protocol without monitoring signal disturbance, which is capable of ensuring the unconditional security. The final key rate of our protocol can be demonstrated to break the Pirandola-Laurenza-Ottaviani-Banchi bound of quantum channel and its simulated transmission distance can approach over 600 km using current techniques. Our results pave the way to realizing high-rate and large-scale QSS networks.


title: Gradient Masked Federated Optimization

abstract: Federated Averaging (FedAVG) has become the most popular federated learning algorithm due to its simplicity and low communication overhead. We use simple examples to show that FedAVG has the tendency to sew together the optima across the participating clients. These sewed optima exhibit poor generalization when used on a new client with new data distribution. Inspired by the invariance principles in (Arjovsky et al., 2019; Parascandolo et al., 2020), we focus on learning a model that is locally optimal across the different clients simultaneously. We propose a modification to FedAVG algorithm to include masked gradients (AND-mask from (Parascandolo et al., 2020)) across the clients and uses them to carry out an additional server model update. We show that this algorithm achieves better accuracy (out-of-distribution) than FedAVG, especially when the data is non-identically distributed across clients.


title: On assuring the accurate alignment of laser sheets for planar and stereoscopic PIV

abstract: Several calibration techniques have been proposed in the literature for the calibration of two-component two-dimensional (2C-2D) particle image velocimetry (PIV) and three-component two-dimensional (3C-2D) stereoscopic PIV (SPIV) systems. These techniques generally involve the use of a calibration target that is assumed to be at the exact centre of the laser sheet within the field of view (FOV), which in practice is very difficult to achieve. In 3C-2D SPIV, several methods offer different correction schemes based on the computation of a disparity map, which are aimed at correcting errors produced due to this misalignment. These techniques adjust the calibration of individual cameras to reduce the disparity error, but in doing so can create unintended errors in the measurement position and/or the velocity measurements, such as introducing a bias in the measured three-component (3-C) displacements. This paper introduces a novel method to ensure accurate alignment of the laser sheet with the calibration target so that the uncertainty in displacement measurements is less than or equal to the uncertainty inherent to the PIV and hence, no correction scheme is required. The proposed method has been validated with a simple experiment in which true displacements are given to a particle container (illuminated by an aligned laser sheet) and the measured 3C displacements are compared with the given true displacements. An uncertainty of less than 7.6 micrometres (equivalent to 0.114 pixels) in the measured 3C displacements demonstrates the effectiveness of the new alignment method and eliminates the need for any ad hoc post-correction scheme.


title: Gauged Lepton Number, Dirac Neutrinos, Dark Matter, and Muon $g-2$

abstract: Lepton number is promoted to an $U(1)_L$ gauge symmetry in a simple extension of the standard model. The spontaneous breaking of $U(1)_L$ by three units allows a conserved $Z_3^L$ lepton symmetry to remain, guaranteeing that neutrinos are Dirac fermions, which acquire naturally small masses from a previously proposed mechanism. Dark matter appears as a singlet scalar, with dark symmetry $Z_3^D$ derivable from $Z_3^L$. Muon $g-2$ may be explained.


title: SRWarp: Generalized Image Super-Resolution under Arbitrary Transformation

abstract: Deep CNNs have achieved significant successes in image processing and its applications, including single image super-resolution (SR). However, conventional methods still resort to some predetermined integer scaling factors, e.g., x2 or x4. Thus, they are difficult to be applied when arbitrary target resolutions are required. Recent approaches extend the scope to real-valued upsampling factors, even with varying aspect ratios to handle the limitation. In this paper, we propose the SRWarp framework to further generalize the SR tasks toward an arbitrary image transformation. We interpret the traditional image warping task, specifically when the input is enlarged, as a spatially-varying SR problem. We also propose several novel formulations, including the adaptive warping layer and multiscale blending, to reconstruct visually favorable results in the transformation process. Compared with previous methods, we do not constrain the SR model on a regular grid but allow numerous possible deformations for flexible and diverse image editing. Extensive experiments and ablation studies justify the necessity and demonstrate the advantage of the proposed SRWarp method under various transformations.


title: A Structure-Aware Relation Network for Thoracic Diseases Detection and Segmentation

abstract: Instance level detection and segmentation of thoracic diseases or abnormalities are crucial for automatic diagnosis in chest X-ray images. Leveraging on constant structure and disease relations extracted from domain knowledge, we propose a structure-aware relation network (SAR-Net) extending Mask R-CNN. The SAR-Net consists of three relation modules: 1. the anatomical structure relation module encoding spatial relations between diseases and anatomical parts. 2. the contextual relation module aggregating clues based on query-key pair of disease RoI and lung fields. 3. the disease relation module propagating co-occurrence and causal relations into disease proposals. Towards making a practical system, we also provide ChestX-Det, a chest X-Ray dataset with instance-level annotations (boxes and masks). ChestX-Det is a subset of the public dataset NIH ChestX-ray14. It contains ~3500 images of 13 common disease categories labeled by three board-certified radiologists. We evaluate our SAR-Net on it and another dataset DR-Private. Experimental results show that it can enhance the strong baseline of Mask R-CNN with significant improvements. The ChestX-Det is released at https://github.com/Deepwise-AILab/ChestX-Det-Dataset.


title: Electronic Structure of Mononuclear Cu-based Molecule from Density-Functional Theory with Self-Interaction Correction

abstract: We investigate the electronic structure of a planar mononuclear Cu-based molecule [Cu(C$_6$H$_4$S$_2$)$_2$]$^z$ in two oxidation states ($z$$=$$-2$, $-$1) using density-functional theory (DFT) with Fermi-L\"owdin orbital (FLO) self-interaction correction (SIC). The dianionic Cu-based molecule was proposed to be a promising qubit candidate. Self-interaction error within approximate DFT functionals renders severe delocalization of electron and spin densities arising from 3$d$ orbitals. The FLO-SIC method relies on optimization of Fermi-L\"owdin orbital descriptors (FODs) with which localized occupied orbitals are constructed to create the SIC potentials. Starting with many initial sets of FODs, we employ a frozen-density loop algorithm within the FLO-SIC method to study the Cu-based molecule. We find that the electronic structure of the molecule remains unchanged despite somewhat different final FOD configurations. In the dianionic state (spin $S=1/2$), FLO-SIC spin density originates from the Cu $d$ and S $p$ orbitals with an approximate ratio of 2:1, in quantitative agreement with multireference calculations, while in the case of SIC-free DFT, the orbital ratio is reversed. Overall, FLO-SIC lowers the energies of the occupied orbitals and in particular the 3$d$ orbitals unhybridized with the ligands significantly, which substantially increases the energy gap between the highest occupied molecular orbital (HOMO) and the lowest unoccupied molecular orbital (LUMO) compared to SIC-free DFT results. The FLO-SIC HOMO-LUMO gap of the dianionic state is larger than that of the monoionic state, which is consistent with experiment. Our results suggest a positive outlook of the FLO-SIC method in the description of magnetic exchange coupling within 3$d$-element based systems.


title: Label-Synchronous Speech-to-Text Alignment for ASR Using Forward and Backward Transformers

abstract: This paper proposes a novel label-synchronous speech-to-text alignment technique for automatic speech recognition (ASR). The speech-to-text alignment is a problem of splitting long audio recordings with un-aligned transcripts into utterance-wise pairs of speech and text. Unlike conventional methods based on frame-synchronous prediction, the proposed method re-defines the speech-to-text alignment as a label-synchronous text mapping problem. This enables an accurate alignment benefiting from the strong inference ability of the state-of-the-art attention-based encoder-decoder models, which cannot be applied to the conventional methods. Two different Transformer models named forward Transformer and backward Transformer are respectively used for estimating an initial and final tokens of a given speech segment based on end-of-sentence prediction with teacher-forcing. Experiments using the corpus of spontaneous Japanese (CSJ) demonstrate that the proposed method provides an accurate utterance-wise alignment, that matches the manually annotated alignment with as few as 0.2% errors. It is also confirmed that a Transformer-based hybrid CTC/Attention ASR model using the aligned speech and text pairs as an additional training data reduces character error rates relatively up to 59.0%, which is significantly better than 39.0% reduction by a conventional alignment method based on connectionist temporal classification model.


title: Deep Transform and Metric Learning Networks

abstract: Based on its great successes in inference and denosing tasks, Dictionary Learning (DL) and its related sparse optimization formulations have garnered a lot of research interest. While most solutions have focused on single layer dictionaries, the recently improved Deep DL methods have also fallen short on a number of issues. We hence propose a novel Deep DL approach where each DL layer can be formulated and solved as a combination of one linear layer and a Recurrent Neural Network, where the RNN is flexibly regraded as a layer-associated learned metric. Our proposed work unveils new insights between the Neural Networks and Deep DL, and provides a novel, efficient and competitive approach to jointly learn the deep transforms and metrics. Extensive experiments are carried out to demonstrate that the proposed method can not only outperform existing Deep DL, but also state-of-the-art generic Convolutional Neural Networks.


title: BADet: Boundary-Aware 3D Object Detection from Point Clouds

abstract: Currently, existing state-of-the-art 3D object detectors are in two-stage paradigm. These methods typically comprise two steps: 1) Utilize a region proposal network to propose a handful of high-quality proposals in a bottom-up fashion. 2) Resize and pool the semantic features from the proposed regions to summarize RoI-wise representations for further refinement. Note that these RoI-wise representations in step 2) are considered individually as uncorrelated entries when fed to following detection headers. Nevertheless, we observe these proposals generated by step 1) offset from ground truth somehow, emerging in local neighborhood densely with an underlying probability. Challenges arise in the case where a proposal largely forsakes its boundary information due to coordinate offset while existing networks lack corresponding information compensation mechanism. In this paper, we propose $BADet$ for 3D object detection from point clouds. Specifically, instead of refining each proposal independently as previous works do, we represent each proposal as a node for graph construction within a given cut-off threshold, associating proposals in the form of local neighborhood graph, with boundary correlations of an object being explicitly exploited. Besides, we devise a lightweight Region Feature Aggregation Module to fully exploit voxel-wise, pixel-wise, and point-wise features with expanding receptive fields for more informative RoI-wise representations. We validate BADet both on widely used KITTI Dataset and highly challenging nuScenes Dataset. As of Apr. 17th, 2021, our BADet achieves on par performance on KITTI 3D detection leaderboard and ranks $1^{st}$ on $Moderate$ difficulty of $Car$ category on KITTI BEV detection leaderboard. The source code is available at https://github.com/rui-qian/BADet.


title: An Explicit Algorithm of Rigged Configuration Bijection for the Adjoint Crystal of Type $G_{2}^{(1)}$

abstract: We construct an explicit algorithm of the static-preserving bijection between the rigged configurations and the highest weight paths of the form $(B^{2,1})^{\otimes L}$ in the $G_{2}^{(1)}$ adjoint crystals.


title: Unit-Lapse Forms of Various Spacetimes

abstract: Every spacetime is defined by its metric, the mathematical object which further defines the spacetime curvature. From the relativity principle, we have the freedom to choose which coordinate system to write our metric in. Some coordinate systems, however, are better than others. In this text, we begin with a brief introduction into general relativity, Einstein's masterpiece theory of gravity. We then discuss some physically interesting spacetimes and the coordinate systems that the metrics of these spacetimes can be expressed in. More specifically, we discuss the existence of the rather useful unit-lapse forms of these spacetimes. Using the metric written in this form then allows us to conduct further analysis of these spacetimes, which we discuss.


title: Extracting the pole and Breit-Wigner properties of nucleon and $\Delta$ resonances from the $\gamma N\to K\Sigma$ photoproduction

abstract: We have developed a covariant isobar model to phenomenologically explain the four possible isospin channels of $K\Sigma$ photoproduction. To obtain a consistent reaction amplitude, which is free from the lower-spin background problem, we used the consistent electromagnetic and hadronic interactions described in our previous report. We used all available experimental data, including the recent MAMI A2 2018 data obtained for the $K^0\Sigma^+$ and $K^0\Sigma^0$ isospin channels. By fitting the calculated observables to these data we extract the resonance properties, including their Breit-Wigner and pole parameters. Comparison of the extracted parameters with those listed by the Particle Data Group yields a nice agreement. An extensive comparison of the calculated observables with experimental data is also presented. By using the model we investigated the effects of three different form factors used in the hadronic vertex of each diagram. A brief discussion on the form factors is given.


title: Automatic Double Machine Learning for Continuous Treatment Effects

abstract: In this paper, we introduce and prove asymptotic normality for a new nonparametric estimator of continuous treatment effects. Specifically, we estimate the average dose-response function - the expected value of an outcome of interest at a particular level of the treatment level. We utilize tools from both the double debiased machine learning (DML) and the automatic double machine learning (ADML) literatures to construct our estimator. Our estimator utilizes a novel debiasing method that leads to nice theoretical stability and balancing properties. In simulations our estimator performs well compared to current methods.


title: Optimal Bayesian Smoothing of Functional Observations over a Large Graph

abstract: In modern contexts, some types of data are observed in high-resolution, essentially continuously in time. Such data units are best described as taking values in a space of functions. Subject units carrying the observations may have intrinsic relations among themselves, and are best described by the nodes of a large graph. It is often sensible to think that the underlying signals in these functional observations vary smoothly over the graph, in that neighboring nodes have similar underlying signals. This qualitative information allows borrowing of strength over neighboring nodes and consequently leads to more accurate inference. In this paper, we consider a model with Gaussian functional observations and adopt a Bayesian approach to smoothing over the nodes of the graph. We characterize the minimax rate of estimation in terms of the regularity of the signals and their variation across nodes quantified in terms of the graph Laplacian. We show that an appropriate prior constructed from the graph Laplacian can attain the minimax bound, while using a mixture prior, the minimax rate up to a logarithmic factor can be attained simultaneously for all possible values of functional and graphical smoothness. We also show that in the fixed smoothness setting, an optimal sized credible region has arbitrarily high frequentist coverage. A simulation experiment demonstrates that the method performs better than potential competing methods like the random forest. The method is also applied to a dataset on daily temperatures measured at several weather stations in the US state of North Carolina.


title: MagicPai at SemEval-2021 Task 7: Method for Detecting and Rating Humor Based on Multi-Task Adversarial Training

abstract: This paper describes MagicPai's system for SemEval 2021 Task 7, HaHackathon: Detecting and Rating Humor and Offense. This task aims to detect whether the text is humorous and how humorous it is. There are four subtasks in the competition. In this paper, we mainly present our solution, a multi-task learning model based on adversarial examples, for task 1a and 1b. More specifically, we first vectorize the cleaned dataset and add the perturbation to obtain more robust embedding representations. We then correct the loss via the confidence level. Finally, we perform interactive joint learning on multiple tasks to capture the relationship between whether the text is humorous and how humorous it is. The final result shows the effectiveness of our system.


title: Local data of rational elliptic curves with non-trivial torsion

abstract: By Mazur's Torsion Theorem, there are fourteen possibilities for the non-trivial torsion subgroup $T$ of a rational elliptic curve. For each $T$, such that $E$ may have additive reduction at a prime $p$, we consider a parameterized family $E_T$ of elliptic curves with the property that they parameterize all elliptic curves $E/\mathbb{Q}$ which contain $T$ in their torsion subgroup. Using these parameterized families, we explicitly classify the Kodaira-N\'{e}ron type, the conductor exponent, and the local Tamagawa number at each prime $p$ where $E/\mathbb{Q}$ has additive reduction. As a consequence, we find all rational elliptic curves with a $2$-torsion or a $3$-torsion point that have global Tamagawa number $1$.


title: Shadow Generation for Composite Image in Real-world Scenes

abstract: Image composition targets at inserting a foreground object into a background image. Most previous image composition methods focus on adjusting the foreground to make it compatible with background while ignoring the shadow effect of foreground on the background. In this work, we focus on generating plausible shadow for the foreground object in the composite image. First, we contribute a real-world shadow generation dataset DESOBA by generating synthetic composite images based on paired real images and deshadowed images. Then, we propose a novel shadow generation network SGRNet, which consists of a shadow mask prediction stage and a shadow filling stage. In the shadow mask prediction stage, foreground and background information are thoroughly interacted to generate foreground shadow mask. In the shadow filling stage, shadow parameters are predicted to fill the shadow area. Extensive experiments on our DESOBA dataset and real composite images demonstrate the effectiveness of our proposed method. Our dataset and code are available at https://github.com/bcmi/Object-Shadow-Generation-Dataset-DESOBA.


title: Discriminative Self-training for Punctuation Prediction

abstract: Punctuation prediction for automatic speech recognition (ASR) output transcripts plays a crucial role for improving the readability of the ASR transcripts and for improving the performance of downstream natural language processing applications. However, achieving good performance on punctuation prediction often requires large amounts of labeled speech transcripts, which is expensive and laborious. In this paper, we propose a Discriminative Self-Training approach with weighted loss and discriminative label smoothing to exploit unlabeled speech transcripts. Experimental results on the English IWSLT2011 benchmark test set and an internal Chinese spoken language dataset demonstrate that the proposed approach achieves significant improvement on punctuation prediction accuracy over strong baselines including BERT, RoBERTa, and ELECTRA models. The proposed Discriminative Self-Training approach outperforms the vanilla self-training approach. We establish a new state-of-the-art (SOTA) on the IWSLT2011 test set, outperforming the current SOTA model by 1.3% absolute gain on F$_1$.


title: CVLight: Decentralized Learning for Adaptive Traffic Signal Control with Connected Vehicles

abstract: This paper develops a decentralized reinforcement learning (RL) scheme for multi-intersection adaptive traffic signal control (TSC), called "CVLight", that leverages data collected from connected vehicles (CVs). The state and reward design facilitates coordination among agents and considers travel delays collected by CVs. A novel algorithm, Asymmetric Advantage Actor-critic (Asym-A2C), is proposed where both CV and non-CV information is used to train the critic network, while only CV information is used to execute optimal signal timing. Comprehensive experiments show the superiority of CVLight over state-of-the-art algorithms under a 2-by-2 synthetic road network with various traffic demand patterns and penetration rates. The learned policy is then visualized to further demonstrate the advantage of Asym-A2C. A pre-train technique is applied to improve the scalability of CVLight, which significantly shortens the training time and shows the advantage in performance under a 5-by-5 road network. A case study is performed on a 2-by-2 road network located in State College, Pennsylvania, USA, to further demonstrate the effectiveness of the proposed algorithm under real-world scenarios. Compared to other baseline models, the trained CVLight agent can efficiently control multiple intersections solely based on CV data and achieve the best performance, especially under low CV penetration rates.


title: On the absoluteness of $\aleph_1$-freeness

abstract: $\aleph_1$-free groups, abelian groups for which every countable subgroup is free, exhibit a number of interesting algebraic and set-theoretic properties. In this paper, we give a complete proof that the property of being $\aleph_1$-free is absolute; that is, if an abelian group $G$ is $\aleph_1$-free in some transitive model $\textbf{M}$ of ZFC, then it is $\aleph_1$-free in any transitive model of ZFC containing $G$. The absoluteness of $\aleph_1$-freeness has the following remarkable consequence: an abelian group $G$ is $\aleph_1$-free in some transitive model of ZFC if and only if it is (countable and) free in some model extension. This set-theoretic characterization will be the starting point for further exploring the relationship between the set-theoretic and algebraic properties of $\aleph_1$-free groups. In particular, this paper will demonstrate how proofs may be dramatically simplified using model extensions for $\aleph_1$-free groups.


title: A Novel GCN based Indoor Localization System with Multiple Access Points

abstract: With the rapid development of indoor location-based services (LBSs), the demand for accurate localization keeps growing as well. To meet this demand, we propose an indoor localization algorithm based on graph convolutional network (GCN). We first model access points (APs) and the relationships between them as a graph, and utilize received signal strength indication (RSSI) to make up fingerprints. Then the graph and the fingerprint will be put into GCN for feature extraction, and get classification by multilayer perceptron (MLP).In the end, experiments are performed under a 2D scenario and 3D scenario with floor prediction. In the 2D scenario, the mean distance error of GCN-based method is 11m, which improves by 7m and 13m compare with DNN-based and CNN-based schemes respectively. In the 3D scenario, the accuracy of predicting buildings and floors are up to 99.73% and 93.43% respectively. Moreover, in the case of predicting floors and buildings correctly, the mean distance error is 13m, which outperforms DNN-based and CNN-based schemes, whose mean distance errors are 34m and 26m respectively.


title: Sensitivity as a Complexity Measure for Sequence Classification Tasks

abstract: We introduce a theoretical framework for understanding and predicting the complexity of sequence classification tasks, using a novel extension of the theory of Boolean function sensitivity. The sensitivity of a function, given a distribution over input sequences, quantifies the number of disjoint subsets of the input sequence that can each be individually changed to change the output. We argue that standard sequence classification methods are biased towards learning low-sensitivity functions, so that tasks requiring high sensitivity are more difficult. To that end, we show analytically that simple lexical classifiers can only express functions of bounded sensitivity, and we show empirically that low-sensitivity functions are easier to learn for LSTMs. We then estimate sensitivity on 15 NLP tasks, finding that sensitivity is higher on challenging tasks collected in GLUE than on simple text classification tasks, and that sensitivity predicts the performance both of simple lexical classifiers and of vanilla BiLSTMs without pretrained contextualized embeddings. Within a task, sensitivity predicts which inputs are hard for such simple models. Our results suggest that the success of massively pretrained contextual representations stems in part because they provide representations from which information can be extracted by low-sensitivity decoders.


title: Improving Biomedical Pretrained Language Models with Knowledge

abstract: Pretrained language models have shown success in many natural language processing tasks. Many works explore incorporating knowledge into language models. In the biomedical domain, experts have taken decades of effort on building large-scale knowledge bases. For example, the Unified Medical Language System (UMLS) contains millions of entities with their synonyms and defines hundreds of relations among entities. Leveraging this knowledge can benefit a variety of downstream tasks such as named entity recognition and relation extraction. To this end, we propose KeBioLM, a biomedical pretrained language model that explicitly leverages knowledge from the UMLS knowledge bases. Specifically, we extract entities from PubMed abstracts and link them to UMLS. We then train a knowledge-aware language model that firstly applies a text-only encoding layer to learn entity representation and applies a text-entity fusion encoding to aggregate entity representation. Besides, we add two training objectives as entity detection and entity linking. Experiments on the named entity recognition and relation extraction from the BLURB benchmark demonstrate the effectiveness of our approach. Further analysis on a collected probing dataset shows that our model has better ability to model medical knowledge.


title: Measuring economic activity from space: a case study using flying airplanes and COVID-19

abstract: This work introduces a novel solution to measure economic activity through remote sensing for a wide range of spatial areas. We hypothesized that disturbances in human behavior caused by major life-changing events leave signatures in satellite imagery that allows devising relevant image-based indicators to estimate their impacts and support decision-makers. We present a case study for the COVID-19 coronavirus outbreak, which imposed severe mobility restrictions and caused worldwide disruptions, using flying airplane detection around the 30 busiest airports in Europe to quantify and analyze the lockdown's effects and post-lockdown recovery. Our solution won the Rapid Action Coronavirus Earth observation (RACE) upscaling challenge, sponsored by the European Space Agency and the European Commission, and now integrates the RACE dashboard. This platform combines satellite data and artificial intelligence to promote a progressive and safe reopening of essential activities. Code and CNN models are available at https://github.com/maups/covid19-custom-script-contest


title: Two Identities

abstract: In the process of studying a conjecture of Holly M. Green and Martin W. Liebeck, we obtain two interesting identities by elementary methods, one is a combinatorial identity, and the other is a number theoretic identity.


title: A class of network models recoverable by spectral clustering

abstract: Finding communities in networks is a problem that remains difficult, in spite of the amount of attention it has recently received. The Stochastic Block-Model (SBM) is a generative model for graphs with "communities" for which, because of its simplicity, the theoretical understanding has advanced fast in recent years. In particular, there have been various results showing that simple versions of spectral clustering using the Normalized Laplacian of the graph can recover the communities almost perfectly with high probability. Here we show that essentially the same algorithm used for the SBM and for its extension called Degree-Corrected SBM, works on a wider class of Block-Models, which we call Preference Frame Models, with essentially the same guarantees. Moreover, the parametrization we introduce clearly exhibits the free parameters needed to specify this class of models, and results in bounds that expose with more clarity the parameters that control the recovery error in this model class.


title: Fixed-Point and Objective Convergence of Plug-and-Play Algorithms

abstract: A standard model for image reconstruction involves the minimization of a data-fidelity term along with a regularizer, where the optimization is performed using proximal algorithms such as ISTA and ADMM. In plug-and-play (PnP) regularization, the proximal operator (associated with the regularizer) in ISTA and ADMM is replaced by a powerful image denoiser. Although PnP regularization works surprisingly well in practice, its theoretical convergence -- whether convergence of the PnP iterates is guaranteed and if they minimize some objective function -- is not completely understood even for simple linear denoisers such as nonlocal means. In particular, while there are works where either iterate or objective convergence is established separately, a simultaneous guarantee on iterate and objective convergence is not available for any denoiser to our knowledge. In this paper, we establish both forms of convergence for a special class of linear denoisers. Notably, unlike existing works where the focus is on symmetric denoisers, our analysis covers non-symmetric denoisers such as nonlocal means and almost any convex data-fidelity. The novelty in this regard is that we make use of the convergence theory of averaged operators and we work with a special inner product (and norm) derived from the linear denoiser; the latter requires us to appropriately define the gradient and proximal operators associated with the data-fidelity term. We validate our convergence results using image reconstruction experiments.


title: Star Formation in Nuclear Rings with the TIGRESS Framework

abstract: Nuclear rings are sites of intense star formation at the centers of barred galaxies. To understand what determines the structure and star formation rate (SFR; $\dot{M}_{\rm SF}$) of nuclear rings, we run semi-global, hydrodynamic simulations of nuclear rings subject to constant mass inflow rates $\dot{M}_{\rm in}$. We adopt the TIGRESS framework of Kim \& Ostriker to handle radiative heating and cooling, star formation, and related supernova (SN) feedback. We find that the SN feedback is never strong enough to destroy the ring or quench star formation everywhere in the ring. Under the constant $\dot{M}_{\rm in}$, the ring star formation is very steady and persistent, with the SFR exhibiting only mild temporal fluctuations. The ring SFR is tightly correlated with the inflow rate as $\dot{M}_{\rm SF}\approx 0.8\dot{M}_{\rm in}$, for a range of $\dot{M}_{\rm in}=0.125-8\,M_\odot\,{\rm yr}^{-1}$. Within the ring, vertical dynamical equilibrium is maintained, with the midplane pressure (powered by SN feedback) balancing the weight of the overlying gas. The SFR surface density is correlated nearly linearly with the midplane pressure, as predicted by the pressure-regulated, feedback-modulated star formation theory. Based on our results, we argue that the ring SFR is causally controlled by $\dot{M}_\text{in}$, while the ring gas mass adapts to the SFR to maintain the vertical dynamical equilibrium under the gravitational field arising from both gas and stars.


title: Carbon Emissions and Large Neural Network Training

abstract: The computation demand for machine learning (ML) has grown rapidly recently, which comes with a number of costs. Estimating the energy cost helps measure its environmental impact and finding greener strategies, yet it is challenging without detailed information. We calculate the energy use and carbon footprint of several recent large models-T5, Meena, GShard, Switch Transformer, and GPT-3-and refine earlier estimates for the neural architecture search that found Evolved Transformer. We highlight the following opportunities to improve energy efficiency and CO2 equivalent emissions (CO2e): Large but sparsely activated DNNs can consume <1/10th the energy of large, dense DNNs without sacrificing accuracy despite using as many or even more parameters. Geographic location matters for ML workload scheduling since the fraction of carbon-free energy and resulting CO2e vary ~5X-10X, even within the same country and the same organization. We are now optimizing where and when large models are trained. Specific datacenter infrastructure matters, as Cloud datacenters can be ~1.4-2X more energy efficient than typical datacenters, and the ML-oriented accelerators inside them can be ~2-5X more effective than off-the-shelf systems. Remarkably, the choice of DNN, datacenter, and processor can reduce the carbon footprint up to ~100-1000X. These large factors also make retroactive estimates of energy cost difficult. To avoid miscalculations, we believe ML papers requiring large computational resources should make energy consumption and CO2e explicit when practical. We are working to be more transparent about energy use and CO2e in our future research. To help reduce the carbon footprint of ML, we believe energy usage and CO2e should be a key metric in evaluating models, and we are collaborating with MLPerf developers to include energy usage during training and inference in this industry standard benchmark.


title: Improving Weakly-supervised Object Localization via Causal Intervention

abstract: The recent emerged weakly supervised object localization (WSOL) methods can learn to localize an object in the image only using image-level labels. Previous works endeavor to perceive the interval objects from the small and sparse discriminative attention map, yet ignoring the co-occurrence confounder (e.g., bird and sky), which makes the model inspection (e.g., CAM) hard to distinguish between the object and context. In this paper, we make an early attempt to tackle this challenge via causal intervention (CI). Our proposed method, dubbed CI-CAM, explores the causalities among images, contexts, and categories to eliminate the biased co-occurrence in the class activation maps thus improving the accuracy of object localization. Extensive experiments on several benchmarks demonstrate the effectiveness of CI-CAM in learning the clear object boundaries from confounding contexts. Particularly, in CUB-200-2011 which severely suffers from the co-occurrence confounder, CI-CAM significantly outperforms the traditional CAM-based baseline (58.39% vs 52.4% in top-1 localization accuracy). While in more general scenarios such as ImageNet, CI-CAM can also perform on par with the state of the arts.


title: Control Contraction Metric Synthesis for Discrete-time Nonlinear Systems

abstract: Flexible manufacturing has been the trend in the area of the modern chemical process nowadays. One of the essential characteristics of flexible manufacturing is to track time-varying target trajectories (e.g. diversity and quantity of products). A possible tool to achieve time-varying targets is contraction theory. However, the contraction theory was developed for continuous time systems and there lacks analysis and synthesis tools for discrete-time systems. This article develops a systematic approach to discrete-time contraction analysis and control synthesis using Discrete-time Control Contraction Metrics (DCCM) which can be implemented using Sum of Square (SOS) programming. The proposed approach is demonstrated by illustrative example.


title: Temporal Knowledge Graph Reasoning Based on Evolutional Representation Learning

abstract: Knowledge Graph (KG) reasoning that predicts missing facts for incomplete KGs has been widely explored. However, reasoning over Temporal KG (TKG) that predicts facts in the future is still far from resolved. The key to predict future facts is to thoroughly understand the historical facts. A TKG is actually a sequence of KGs corresponding to different timestamps, where all concurrent facts in each KG exhibit structural dependencies and temporally adjacent facts carry informative sequential patterns. To capture these properties effectively and efficiently, we propose a novel Recurrent Evolution network based on Graph Convolution Network (GCN), called RE-GCN, which learns the evolutional representations of entities and relations at each timestamp by modeling the KG sequence recurrently. Specifically, for the evolution unit, a relation-aware GCN is leveraged to capture the structural dependencies within the KG at each timestamp. In order to capture the sequential patterns of all facts in parallel, the historical KG sequence is modeled auto-regressively by the gate recurrent components. Moreover, the static properties of entities such as entity types, are also incorporated via a static graph constraint component to obtain better entity representations. Fact prediction at future timestamps can then be realized based on the evolutional entity and relation representations. Extensive experiments demonstrate that the RE-GCN model obtains substantial performance and efficiency improvement for the temporal reasoning tasks on six benchmark datasets. Especially, it achieves up to 11.46\% improvement in MRR for entity prediction with up to 82 times speedup comparing to the state-of-the-art baseline.


title: Observational constraints on the cosmological expansion rate and spatial curvature

abstract: Observations conducted over the last few decades show that the expansion of the Universe is accelerating. In the standard model of cosmology, this accelerated expansion is attributed to a dark energy in the form of a cosmological constant. It is conceivable, however, for the dark energy to exhibit mild dynamics (so that its energy density changes with time rather than having a constant value), or for the accelerated expansion of the Universe to be caused by some mechanism other than dark energy. In this work I will investigate both of these possibilities by using observational data to place constraints on the parameters of simple models of dynamical dark energy as well as cosmological models without dark energy. I find that these data favor the standard model while leaving some room for dynamical dark energy. The standard model also holds that the Universe is flat on large spatial scales. The same observational data used to test dark energy dynamics can be used to constrain the large-scale curvature of the Universe, and these data generally favor spatial flatness, with some mild preference for spatial curvature in some data combinations.


title: Revisiting Document Representations for Large-Scale Zero-Shot Learning

abstract: Zero-shot learning aims to recognize unseen objects using their semantic representations. Most existing works use visual attributes labeled by humans, not suitable for large-scale applications. In this paper, we revisit the use of documents as semantic representations. We argue that documents like Wikipedia pages contain rich visual information, which however can easily be buried by the vast amount of non-visual sentences. To address this issue, we propose a semi-automatic mechanism for visual sentence extraction that leverages the document section headers and the clustering structure of visual sentences. The extracted visual sentences, after a novel weighting scheme to distinguish similar classes, essentially form semantic representations like visual attributes but need much less human effort. On the ImageNet dataset with over 10,000 unseen classes, our representations lead to a 64% relative improvement against the commonly used ones.


title: General Low-rank Matrix Optimization: Geometric Analysis and Sharper Bounds

abstract: This paper considers the global geometry of general low-rank minimization problems via the Burer-Monterio factorization approach. For the rank-$1$ case, we prove that there is no spurious second-order critical point for both symmetric and asymmetric problems if the rank-$2$ RIP constant $\delta$ is less than $1/2$. Combining with a counterexample with $\delta=1/2$, we show that the derived bound is the sharpest possible. For the arbitrary rank-$r$ case, the same property is established when the rank-$2r$ RIP constant $\delta$ is at most $1/3$. We design a counterexample to show that the non-existence of spurious second-order critical points may not hold if $\delta$ is at least $1/2$. In addition, for any problem with $\delta$ between $1/3$ and $1/2$, we prove that all second-order critical points have a positive correlation to the ground truth. Finally, the strict saddle property, which can lead to the polynomial-time global convergence of various algorithms, is established for both the symmetric and asymmetric problems when the rank-$2r$ RIP constant $\delta$ is less than $1/3$. The results of this paper significantly extend several existing bounds in the literature.


title: Pre-training for Spoken Language Understanding with Joint Textual and Phonetic Representation Learning

abstract: In the traditional cascading architecture for spoken language understanding (SLU), it has been observed that automatic speech recognition errors could be detrimental to the performance of natural language understanding. End-to-end (E2E) SLU models have been proposed to directly map speech input to desired semantic frame with a single model, hence mitigating ASR error propagation. Recently, pre-training technologies have been explored for these E2E models. In this paper, we propose a novel joint textual-phonetic pre-training approach for learning spoken language representations, aiming at exploring the full potentials of phonetic information to improve SLU robustness to ASR errors. We explore phoneme labels as high-level speech features, and design and compare pre-training tasks based on conditional masked language model objectives and inter-sentence relation objectives. We also investigate the efficacy of combining textual and phonetic information during fine-tuning. Experimental results on spoken language understanding benchmarks, Fluent Speech Commands and SNIPS, show that the proposed approach significantly outperforms strong baseline models and improves robustness of spoken language understanding to ASR errors.


title: Wadge Degrees of Classes of omega-Regular k-Partitions

abstract: We develop a theory of k-partitions of the set of infinite words recognizable by classes of finite automata. The theory enables to complete proofs of existing results about topological classifications of the (aperiodic) omega-regular k-partitions and provides tools for dealing with other similar questions. In particular, we characterize the structure of Wadge degrees of (aperiodic) omega-regular $k$-partitions, prove the decidability of many related problems, and discuss their complexity.


title: Improving the doping efficiency of Al in 4H-SiC by co-doping group-IVB elements

abstract: The p-type doping efficiency of 4H silicon carbide (4H-SiC) is rather low due to the large ionization energies of p-type dopants. Such an issue impedes the exploration of the full advantage of 4H-SiC for semiconductor devices. In this letter, we show that co-doping group-IVB elements effectively decreases the ionization energy of the most widely used p-type dopant, i. e., aluminum (Al), through the Coulomb repulsion between the energy levels of group-IVB elements and that of Al in 4H-SiC. Among group-IVB elements Ti has the most prominent effectiveness. Ti decreases the ionization energy of Al by nearly 50%, leading to a value as low as ~ 0.13 eV. As a result, the ionization rate of Al with Ti co-doping is up to ~ 5 times larger than that without co-doping at room temperature when the doping concentration is up to 1018 cm-3. This work may encourage the experimental co-doping of group-IB elements such as Ti and Al to significantly improve the p-type doping efficiency of 4H-SiC.


title: Improving Test Distance for Failure Clustering with Hypergraph Modelling

abstract: Automated debugging techniques, such as Fault Localisation (FL) or Automated Program Repair (APR), are typically designed under the Single Fault Assumption (SFA). However, in practice, an unknown number of faults can independently cause multiple test case failures, making it difficult to allocate resources for debugging and to use automated debugging techniques. Clustering algorithms have been applied to group the test failures according to their root causes, but their accuracy can often be lacking due to the inherent limits in the distance metrics for test cases. We introduce a new test distance metric based on hypergraphs and evaluate their accuracy using multi-fault benchmarks that we have built on top of Defects4J and SIR. Results show that our technique, Hybiscus, can automatically achieve perfect clustering (i.e., the same number of clusters as the ground truth number of root causes, with all failing tests with the same root cause grouped together) for 418 out of 605 test runs with multiple test failures. Better failure clustering also allows us to separate different root causes and apply FL techniques under SFA, resulting in saving up to 82% of the total wasted effort when compared to the state-of-the-art technique for multiple fault localisation.


title: Measurements of branching fractions and asymmetry parameters of $\Xi^0_c\to \Lambda\bar K^{*0}$, $\Xi^0_c\to \Sigma^0\bar K^{*0}$, and $\Xi^0_c\to \Sigma^+K^{*-}$ decays at Belle

abstract: Using a data sample of 980 fb$^{-1}$ collected with the Belle detector at the KEKB asymmetric-energy $e^+e^-$ collider, we study the processes of $\Xi^0_c\to \Lambda\bar K^{*0}$, $\Xi^0_c\to \Sigma^0\bar K^{*0}$, and $\Xi^0_c\to \Sigma^+K^{*-}$ for the first time. The relative branching ratios to the normalization mode of $\Xi^0_c\to\Xi^-\pi^+$ are measured to be $${\cal B}(\Xi^0_c\to \Lambda\bar K^{*0})/{\cal B}(\xic\to \Xi^-\pi^+)=0.18\pm0.02({\rm stat.})\pm0.01({\rm syst.}),$$ $${\cal B}(\Xi^0_c\to \Sigma^0\bar K^{*0})/{\cal B}(\xic\to \Xi^-\pi^+)=0.69\pm0.03({\rm stat.})\pm0.03({\rm syst.}),$$ $${\cal B}(\Xi^0_c\to \Sigma^+K^{*-})/{\cal B}(\xic\to \Xi^-\pi^+)=0.34\pm0.06({\rm stat.})\pm0.02({\rm syst.}),$$ where the uncertainties are statistical and systematic, respectively. We obtain %measure the branching fractions of $\Xi^0_c\to \Lambda\bar K^{*0}$, $\Xi^0_c\to \Sigma^0\bar K^{*0}$, and $\Xi^0_c\to \Sigma^+K^{*-}$ to be $${\cal B}(\Xi^0_c\to \Lambda\bar K^{*0})=(3.3\pm0.3({\rm stat.})\pm0.2({\rm syst.})\pm1.0({\rm ref.}))\times10^{-3},$$ $${\cal B}(\Xi^0_c\to \Sigma^0\bar K^{*0})=(12.4\pm0.5({\rm stat.})\pm0.5({\rm syst.})\pm3.6({\rm ref.}))\times10^{-3},$$ $${\cal B}(\Xi^0_c\to \Sigma^+K^{*-})=(6.1\pm1.0({\rm stat.})\pm0.4({\rm syst.})\pm1.8({\rm ref.}))\times10^{-3},$$ where the uncertainties are statistical, systematic, and from ${\cal B}(\xic \to \Xi^-\pi^+)$, respectively. The asymmetry parameters $\alpha(\Xi^0_c\to \Lambda\bar K^{*0})$ and $\alpha(\Xi^0_c\to \Sigma^+K^{*-})$ are $0.15\pm0.22({\rm stat.})\pm0.04({\rm syst.})$ and $-0.52\pm0.30({\rm stat.})\pm0.02({\rm syst.})$, respectively, where the uncertainties are statistical followed by systematic.


title: Reducible Abelian varieties and Lax matrices for Euler's problem of two fixed centres

abstract: Abel's quadratures for integrable Hamiltonian systems are defined up to a group law of the corresponding Abelian variety $A$. If $A$ is isogenous to a direct product of Abelian varieties $A\cong A_1\times\cdots\times A_k$, the group law can be used to construct various Lax matrices on the factors $A_1,\ldots,A_k$. As an example, we discuss 2-dimensional reducible Abelian variety $A=E_+\times E_-$, which is a product of 1-dimensional varieties $E_\pm$ obtained by Euler in his study of the two fixed centres problem, and the Lax matrices on the factors $E_\pm$.


title: Reservoir-engineered spin squeezing: macroscopic even-odd effects and hybrid-systems implementations

abstract: We revisit the dissipative approach to producing and stabilizing spin-squeezed states of an ensemble of $N$ two-level systems, providing a detailed analysis of two surprising yet generic features of such protocols. The first is a macroscopic sensitivity of the steady state to whether $N$ is even or odd. We discuss how this effect can be avoided (if the goal is parity-insensitive squeezing), or could be exploited as a new kind of sensing modality to detect the addition or removal of a single spin. The second effect is an anomalous emergent long timescale and a "prethermalized" regime that occurs for even weak single-spin dephasing. This effect allows one to have strong spin squeezing over a long transient time even though the level of spin squeezing in the steady state is very small. We also discuss a general hybrid-systems approach for implementing dissipative spin squeezing that does not require squeezed input light or complex multi-level atoms, but instead makes use of bosonic reservoir-engineering ideas. Our protocol is compatible with a variety of platforms, including trapped ions, NV defect spins coupled to diamond optomechanical crystals, and spin ensembles coupled to superconducting microwave circuits.


title: Photonic Topological Anderson Insulators

abstract: The hallmark property of two-dimensional topological materials is the incredible robustness of the quantized Hall conductivity to disorder. That robustness arises from the fact that in the topological band gap, transport can occur only along the edges modes, which are immune to scattering. However, for sufficiently strong disorder, the band gap closes and the system becomes topologically trivial as all states become localized, such that all transport vanishes -- in accordance with Anderson localization. It therefore came as a surprise when it was suggested that, for a two-dimensional quantum spin-Hall topological system, the opposite could occur. In so-called topological Anderson insulators, the emergence of protected edge states and quantized transport is caused by the introduction of disorder. However, to date, the observation of the topological Anderson insulator phase has been elusive. In this article, we report the first experimental demonstration of a topological Anderson insulator. We do that in a photonic implementation: an array of helical, evanescently-coupled waveguides in a detuned honeycomb geometry. Under proper conditions, adding on-site disorder, in the form of random variations in the refractive index contrast defining the waveguides, drives the system from a trivial phase into a topological state.


title: Identification of Peer Effects with Miss-specified Peer Groups: Missing Data and Group Uncertainty

abstract: We consider identification of peer effects under peer group miss-specification. Two leading cases are missing data and peer group uncertainty. Missing data can take the form of some individuals being entirely absent from the data. The researcher need not have any information on missing individuals and need not even know that they are missing. We show that peer effects are nevertheless identifiable under mild restrictions on the probabilities of observing individuals, and propose a GMM estimator to estimate the peer effects. In practice this means that the researcher need only have access to an individual level sample with group identifiers. Group uncertainty arises when the relevant peer group for the outcome under study is unknown. We show that peer effects are nevertheless identifiable if the candidate groups are nested within one another and propose a non-linear least squares estimator. We conduct a Monte-Carlo experiment to demonstrate our identification results and the performance of the proposed estimators, and apply our method to study peer effects in the career decisions of junior lawyers.


title: Sattiy at SemEval-2021 Task 9: An Ensemble Solution for Statement Verification and Evidence Finding with Tables

abstract: Question answering from semi-structured tables can be seen as a semantic parsing task and is significant and practical for pushing the boundary of natural language understanding. Existing research mainly focuses on understanding contents from unstructured evidence, e.g., news, natural language sentences, and documents. The task of verification from structured evidence, such as tables, charts, and databases, is still less explored. This paper describes sattiy team's system in SemEval-2021 task 9: Statement Verification and Evidence Finding with Tables (SEM-TAB-FACT). This competition aims to verify statements and to find evidence from tables for scientific articles and to promote the proper interpretation of the surrounding article. In this paper, we exploited ensemble models of pre-trained language models over tables, TaPas and TaBERT, for Task A and adjust the result based on some rules extracted for Task B. Finally, in the leaderboard, we attain the F1 scores of 0.8496 and 0.7732 in Task A for the 2-way and 3-way evaluation, respectively, and the F1 score of 0.4856 in Task B.


title: Bipedal Walking on Constrained Footholds: Momentum Regulation via Vertical COM Control

abstract: This paper presents an online walking synthesis methodology to enable dynamic and stable walking on constrained footholds for underactuated bipedal robots. Our approach modulates the change of angular momentum about the foot-ground contact pivot at discrete impact using pre-impact vertical center of mass (COM) velocity. To this end, we utilize the underactuated Linear Inverted Pendulum (LIP) model for approximating the underactuated walking dynamics to provide the desired post-impact angular momentum for each step. Desired outputs are constructed via online optimization combined with closed-form polynomials and tracked via a quadratic program (QP) based controller. This method is demonstrated on two robots, AMBER and 3D Cassie, for which stable walking behaviors with constrained footholds are realized on flat ground, stairs, and randomly located stepping stones.


title: A fabrication of low power distribution system for muon $g-2$/EDM experiment at J-PARC

abstract: The J-PARC muon $g - 2$/EDM experiment aims to measure the muon magnetic moment anomaly $a_{\mu} = (g -2) / 2 ~ $ and the muon electric dipole moment (EDM) $d_{\mu}$. The target sensitivity for $a_{\mu}$ is a statistical uncertainty of $450 \times 10^{-9}$, and for $d_{\mu}$ it is $1.5 \times 10^{-21}$ $e \cdot \rm{cm}$. The readout electronics require a DC to DC converter to provide 1.5 V and 3.3 V electric voltage within a specific environment. To capture the positron decay from the muon, the detector components are placed in the muon storage area where a 3 T magnetic field is applied in a vacuum. The extra magnetic field from the converter should be less than 30 $\mu$T to reach the aforementioned sensitivity on $a_{\mu}$. In addition, the electric field produced by the converter has to be as small as 1 V/m to also reach the target sensitivity on $d_{\mu}$. For this purpose, we develop a step-down converter. We discuss the development process and the performance of our DC to DC converter for the J-PARC muon $g - 2$/EDM experiment.


title: Improvement of Normal Estimation for PointClouds via Simplifying Surface Fitting

abstract: With the burst development of neural networks in recent years, the task of normal estimation has once again become a concern. By introducing the neural networks to classic methods based on problem-specific knowledge, the adaptability of the normal estimation algorithm to noise and scale has been greatly improved. However, the compatibility between neural networks and the traditional methods has not been considered. Similar to the principle of Occam's razor, that is, the simpler is better. We observe that a more simplified process of surface fitting can significantly improve the accuracy of the normal estimation. In this paper, two simple-yet-effective strategies are proposed to address the compatibility between the neural networks and surface fitting process to improve normal estimation. Firstly, a dynamic top-k selection strategy is introduced to better focus on the most critical points of a given patch, and the points selected by our learning method tend to fit a surface by way of a simple tangent plane, which can dramatically improve the normal estimation results of patches with sharp corners or complex patterns. Then, we propose a point update strategy before local surface fitting, which smooths the sharp boundary of the patch to simplify the surface fitting process, significantly reducing the fitting distortion and improving the accuracy of the predicted point normal. The experiments analyze the effectiveness of our proposed strategies and demonstrate that our method achieves SOTA results with the advantage of higher estimation accuracy over most existed approaches.


title: Optical and Ultraviolet Monitoring of the Black Hole X-ray Binary MAXI J1820+070/ASASSN-18ey for 18 Months

abstract: MAXI J1820+070 is a low-mass black hole X-ray binary system with high luminosity in both optical and X-ray bands during the outburst periods. We present extensive photometry in X-ray, ultraviolet, and optical bands, as well as densely-cadenced optical spectra, covering the phase from the beginning of optical outburst to $\sim$550 days. During the rebrightening process, the optical emission preceded the X-ray by 20.80 $\pm$ 2.85 days. The spectra are characterized by blue continua and emission features of Balmer series, He I, He II lines and broad Bowen blend. The pseudo equivalent width (pEW) of emission lines are found to show anticorrelations with the X-ray flux measured at comparable phases, which is due to the increased suppression by the optical continuum. At around the X-ray peak, the full width at half maximums (FWHMs) of H$_{\beta}$ and He II $\lambda$4686 tend to stabilize at 19.4 Angstrom and 21.8 Angstrom, which corresponds to the line forming region at a radius of 1.7 and 1.3 R_sun within the disk. We further analyzed the absolute fluxes of the lines and found that the fluxes of H$_{\beta}$ and He II $\lambda$4686 show positive correlations with the X-ray flux, favoring that the irradiation model is responsible for the optical emission. However, the fact that X-ray emission experiences a dramatic flux drop at t$\sim$200 days after the outburst, while the optical flux only shows little variations suggests that additional energy such as viscous energy may contribute to the optical radiation in addition to the X-ray irradiation.


title: Trends of higher-order exchange interactions in transition-metal trilayers

abstract: We present a systematic study of higher-order exchange interactions beyond the pair-wise Heisenberg exchange in transition-metal trilayers based on density functional theory calculations. We show that these terms can play an important role in magnetic trilayers composed of a single hexagonal Fe or Co atomic layer sandwiched between $4d$ and $5d$ transition-metal layers. We study the dependence of the biquadratic and the three-site and four-site four spin interaction on the band filling of the $4d$ and $5d$ layers as well as the stacking sequence, i.e. fcc vs. hcp stacking. Our calculations reveal relatively small higher-order interactions for Co based trilayers. For Fe based trilayers with a Rh or Ir layer the higher-order terms can be on the same order of magnitude as pair-wise Heisenberg exchange. The trends obtained for freestanding trilayers are used to understand the higher-order interactions in ultrathin film systems on surfaces that are experimentally accessible. It is shown that hcp Rh/Fe/Ir(111) and hcp-Rh/Fe/Rh(111) exhibit the largest values for the biquadratic and the three-site four spin interaction of all systems under study. We further demonstrate that the three-site four spin interaction is responsible for the experimentally observed change of the magnetic ground state of Rh/Fe/Ir(111) from a spin spiral (single-Q) for fcc-Rh to a 2Q state for hcp-Rh. We find similar trends for Rh/Fe/Rh(111), i.e. replacing the Ir surface by the isoelectronic Rh surface. For Rh/Co/Ir(111), we obtain a negative value for the four-site four spin interaction which will lead to a reduced stability of magnetic skyrmions which are metastable in this film at zero magnetic field. In contrast, for Pd/Fe/Ir(111), the four-site four spin interaction is positive which leads to an enhanced stability of skyrmions.


title: Short proofs of refined sharp Caffarelli-Kohn-Nirenberg inequalities

abstract: This note relies mainly on a refined version of the main results of the paper by F. Catrina and D. Costa (J. Differential Equations 2009). We provide very short and self-contained proofs. Our results are sharp and minimizers are obtained in suitable functional spaces. As main tools we use the so-called \textit{expand of squares} method to establish sharp weighted $L^{2}$-Caffarelli-Kohn-Nirenberg (CKN) inequalities and density arguments.


title: Unconventional light-induced states visualized by ultrafast electron diffraction and microscopy

abstract: Exciting electrons in solids with intense light pulses offers the possibility of generating new states of matter through nonthermal means and controlling their macroscopic properties on femto- to picosecond timescales. One way to manipulate a solid is by altering its lattice structure, which often underlies the electronic, magnetic and other phases. Here, we review how structures of solids are affected by photoexcitation and how their ultrafast dynamics are captured with time-resolved electron diffraction and microscopy. Specifically, we survey how a strong light pulse has been used to tailor the nonequilibrium characteristics to yield on-demand properties in various material classes. In the existing literature, four main routes have been exploited to control material structures: (i) phase competition, (ii) electronic correlations, (iii) excitation of coherent modes, and (iv) defect generation. In this review, we discuss experiments relevant to all four schemes and finish by speculating about future directions.


title: Integral generalized equivariant cohomologies of weighted Grassmann orbifolds

abstract: We introduce a new definition of weighted Grassmann orbifolds. We study their several invariant $q$-cell structures and the orbifold singularities on these $q$-cells. We discuss when the integral cohomology of a weighted Grassmann orbifold has no $p$-torsion. We compute the equivariant $K$-theory ring of weighted Grassmann orbifolds with rational coefficients. We introduce divisive weighted Grassmann orbifolds and show that they have invariant cell structures. We calculate the equivariant cohomology ring, equivariant $K$-theory ring and equivariant cobordism ring of a divisive weighted Grassmann orbifold with integer coefficients. We discuss how to compute the weighted structure constants for the integral equivariant cohomology ring of a divisive weighted Grassmann orbifold.


title: PALI at SemEval-2021 Task 2: Fine-Tune XLM-RoBERTa for Word in Context Disambiguation

abstract: This paper presents the PALI team's winning system for SemEval-2021 Task 2: Multilingual and Cross-lingual Word-in-Context Disambiguation. We fine-tune XLM-RoBERTa model to solve the task of word in context disambiguation, i.e., to determine whether the target word in the two contexts contains the same meaning or not. In the implementation, we first specifically design an input tag to emphasize the target word in the contexts. Second, we construct a new vector on the fine-tuned embeddings from XLM-RoBERTa and feed it to a fully-connected network to output the probability of whether the target word in the context has the same meaning or not. The new vector is attained by concatenating the embedding of the [CLS] token and the embeddings of the target word in the contexts. In training, we explore several tricks, such as the Ranger optimizer, data augmentation, and adversarial training, to improve the model prediction. Consequently, we attain first place in all four cross-lingual tasks.


title: Towards Corruption-Agnostic Robust Domain Adaptation

abstract: Big progress has been achieved in domain adaptation in decades. Existing works are always based on an ideal assumption that testing target domain are i.i.d. with training target domains. However, due to unpredictable corruptions (e.g., noise and blur) in real data like web images, domain adaptation methods are increasingly required to be corruption robust on target domains. In this paper, we investigate a new task, Corruption-agnostic Robust Domain Adaptation (CRDA): to be accurate on original data and robust against unavailable-for-training corruptions on target domains. This task is non-trivial due to large domain discrepancy and unsupervised target domains. We observe that simple combinations of popular methods of domain adaptation and corruption robustness have sub-optimal CRDA results. We propose a new approach based on two technical insights into CRDA: 1) an easy-to-plug module called Domain Discrepancy Generator (DDG) that generates samples that enlarge domain discrepancy to mimic unpredictable corruptions; 2) a simple but effective teacher-student scheme with contrastive loss to enhance the constraints on target domains. Experiments verify that DDG keeps or even improves performance on original data and achieves better corruption robustness that baselines.


title: Dual Head Adversarial Training

abstract: Deep neural networks (DNNs) are known to be vulnerable to adversarial examples/attacks, raising concerns about their reliability in safety-critical applications. A number of defense methods have been proposed to train robust DNNs resistant to adversarial attacks, among which adversarial training has so far demonstrated the most promising results. However, recent studies have shown that there exists an inherent tradeoff between accuracy and robustness in adversarially-trained DNNs. In this paper, we propose a novel technique Dual Head Adversarial Training (DH-AT) to further improve the robustness of existing adversarial training methods. Different from existing improved variants of adversarial training, DH-AT modifies both the architecture of the network and the training strategy to seek more robustness. Specifically, DH-AT first attaches a second network head (or branch) to one intermediate layer of the network, then uses a lightweight convolutional neural network (CNN) to aggregate the outputs of the two heads. The training strategy is also adapted to reflect the relative importance of the two heads. We empirically show, on multiple benchmark datasets, that DH-AT can bring notable robustness improvements to existing adversarial training methods. Compared with TRADES, one state-of-the-art adversarial training method, our DH-AT can improve the robustness by 3.4% against PGD40 and 2.3% against AutoAttack, and also improve the clean accuracy by 1.8%.


title: Wireless Sensing With Deep Spectrogram Network and Primitive Based Autoregressive Hybrid Channel Model

abstract: Human motion recognition (HMR) based on wireless sensing is a low-cost technique for scene understanding. Current HMR systems adopt support vector machines (SVMs) and convolutional neural networks (CNNs) to classify radar signals. However, whether a deeper learning model could improve the system performance is currently not known. On the other hand, training a machine learning model requires a large dataset, but data gathering from experiment is cost-expensive and time-consuming. Although wireless channel models can be adopted for dataset generation, current channel models are mostly designed for communication rather than sensing. To address the above problems, this paper proposes a deep spectrogram network (DSN) by leveraging the residual mapping technique to enhance the HMR performance. Furthermore, a primitive based autoregressive hybrid (PBAH) channel model is developed, which facilitates efficient training and testing dataset generation for HMR in a virtual environment. Experimental results demonstrate that the proposed PBAH channel model matches the actual experimental data very well and the proposed DSN achieves significantly smaller recognition error than that of CNN.


title: A Calculus for Flow-Limited Authorization

abstract: Real-world applications routinely make authorization decisions based on dynamic computation. Reasoning about dynamically computed authority is challenging. Integrity of the system might be compromised if attackers can improperly influence the authorizing computation. Confidentiality can also be compromised by authorization, since authorization decisions are often based on sensitive data such as membership lists and passwords. Previous formal models for authorization do not fully address the security implications of permitting trust relationships to change, which limits their ability to reason about authority that derives from dynamic computation. Our goal is an approach to constructing dynamic authorization mechanisms that do not violate confidentiality or integrity. The Flow-Limited Authorization Calculus (FLAC) is a simple, expressive model for reasoning about dynamic authorization as well as an information flow control language for securely implementing various authorization mechanisms. FLAC combines the insights of two previous models: it extends the Dependency Core Calculus with features made possible by the Flow-Limited Authorization Model. FLAC provides strong end-to-end information security guarantees even for programs that incorporate and implement rich dynamic authorization mechanisms. These guarantees include noninterference and robust declassification, which prevent attackers from influencing information disclosures in unauthorized ways. We prove these security properties formally for all FLAC programs and explore the expressiveness of FLAC with several examples.


title: End-to-end Speech Translation via Cross-modal Progressive Training

abstract: End-to-end speech translation models have become a new trend in research due to their potential of reducing error propagation. However, these models still suffer from the challenge of data scarcity. How to effectively use unlabeled or other parallel corpora from machine translation is promising but still an open problem. In this paper, we propose Cross Speech-Text Network (XSTNet), an end-to-end model for speech-to-text translation. XSTNet takes both speech and text as input and outputs both transcription and translation text. The model benefits from its three key design aspects: a self-supervised pre-trained sub-network as the audio encoder, a multi-task training objective to exploit additional parallel bilingual text, and a progressive training procedure. We evaluate the performance of XSTNet and baselines on the MuST-C En-X and LibriSpeech En-Fr datasets. In particular, XSTNet achieves state-of-the-art results on all language directions with an average BLEU of 28.8, outperforming the previous best method by 3.2 BLEU. Code, models, cases, and more detailed analysis are available at https://github.com/ReneeYe/XSTNet.


title: Electrically driven programmable phase-change meta-switch reaching 80% efficiency

abstract: Despite recent advances in active metaoptics, wide dynamic range combined with high-speed reconfigurable solutions is still elusive. Phase-change materials (PCMs) offer a compelling platform for metasurface optical elements, owing to the large index contrast and fast yet stable phase transition properties. Here, we experimentally demonstrate an in situ electrically-driven reprogrammable metasurface by harnessing the unique properties of a phase-change chalcogenide alloy, Ge$_{2}$Sb$_{2}$Te$_{5}$ (GST), in order to realize fast, non-volatile, reversible, multilevel, and pronounced optical modulation in the near-infrared spectral range. Co-optimized through a multiphysics analysis, we integrate an efficient heterostructure resistive microheater that indirectly heats and transforms the embedded GST film without compromising the optical performance of the metasurface even after several reversible phase transitions. A hybrid plasmonic-PCM meta-switch with a record electrical modulation of the reflectance over eleven-fold (an absolute reflectance contrast reaching 80%), unprecedented quasi-continuous spectral tuning over 250 nm, and switching speed that can potentially reach a few kHz is presented. Our work represents a significant step towards the development of fully integrable dynamic metasurfaces and their potential for beamforming applications.


title: Emerging chiral optics from chiral interfaces

abstract: Twisted atomic bilayers are emerging platforms for manipulating chiral light-matter interaction at the extreme nanoscale, due to their inherent magnetoelectric responses induced by the finite twist angle and quantum interlayer coupling between the atomic layers. Recent studies have reported the direct correspondence between twisted atomic bilayers and chiral metasurfaces, which features a chiral surface conductivity, in addition to the electric and magnetic surface conductivities. However, far-field chiral optics in light of these consitututive conductivities remains unexplored. Within the framework of the full Maxwell equations, we find that the chiral surface conductivity can be exploited to realize perfect polarization transformation between linearly polarized light. Remarkably, such an exotic chiral phenomenon can occur either for the reflected or transmitted light.