title: FairFil: Contrastive Neural Debiasing Method for Pretrained Text Encoders

abstract: Pretrained text encoders, such as BERT, have been applied increasingly in various natural language processing (NLP) tasks, and have recently demonstrated significant performance gains. However, recent studies have demonstrated the existence of social bias in these pretrained NLP models. Although prior works have made progress on word-level debiasing, improved sentence-level fairness of pretrained encoders still lacks exploration. In this paper, we proposed the first neural debiasing method for a pretrained sentence encoder, which transforms the pretrained encoder outputs into debiased representations via a fair filter (FairFil) network. To learn the FairFil, we introduce a contrastive learning framework that not only minimizes the correlation between filtered embeddings and bias words but also preserves rich semantic information of the original sentences. On real-world datasets, our FairFil effectively reduces the bias degree of pretrained text encoders, while continuously showing desirable performance on downstream tasks. Moreover, our post-hoc method does not require any retraining of the text encoders, further enlarging FairFil's application space.


title: Quantitative homogenization theory for random suspensions in steady Stokes flow

abstract: This work develops a quantitative homogenization theory for random suspensions of rigid particles in a steady Stokes flow, and completes recent qualitative results. More precisely, we establish a large-scale regularity theory for this Stokes problem, and we prove moment bounds for the associated correctors and optimal estimates on the homogenization error; the latter further requires a quantitative ergodicity assumption on the random suspension. Compared to the corresponding quantitative homogenization theory for divergence-form linear elliptic equations, substantial difficulties arise from the analysis of the fluid incompressibility and the particle rigidity constraints. Our analysis further applies to the problem of stiff inclusions in (compressible or incompressible) linear elasticity and in electrostatics; it is also new in those cases, even in the periodic setting.


title: A strongly coupled immersed boundary method for fluid-structure interaction that mimics the efficiency of stationary body methods

abstract: Strongly coupled immersed boundary (IB) methods solve the nonlinear fluid and structural equations of motion simultaneously for strongly enforcing the no-slip constraint on the body. Handling this constraint requires solving several large dimensional systems that scale by the number of grid points in the flow domain even though the nonlinear constraints scale only by the small number of points used to represent the fluid-structure interface. These costly large scale operations for determining only a small number of unknowns at the interface creates a bottleneck to efficiently time-advancing strongly coupled IB methods. In this manuscript, we present a remedy for this bottleneck that is motivated by the efficient strategy employed in stationary-body IB methods while preserving the favorable stability properties of strongly coupled algorithms -- we precompute a matrix that encapsulates the large dimensional system so that the prohibitive large scale operations need not be performed at every time step. This precomputation process yields a modified system of small-dimensional constraint equations that is solved at minimal computational cost while time advancing the equations. We also present a parallel implementation that scales favorably across multiple processors. The accuracy, computational efficiency and scalability of our approach are demonstrated on several two dimensional flow problems. Although the demonstration problems consist of a combination of rigid and torsionally mounted bodies, the formulation is derived in a more general setting involving an arbitrary number of rigid, torsionally mounted, and continuously deformable bodies.


title: Some q-supercongruences from Rahman's summation formula

abstract: Inspired by the recent work on $q$-congruences and the quadratic summation formula of Rahman, we provide some new $q$-supercongruences. By taking $q\to 1$ in one of our results, we obtain a new Ramanujan-type supercongruence, which has the same right-hand side as Van Hamme's (G.2) supercongruence for $p\equiv 1 \pmod 4$. We also formulate some related challenging conjectures on supercongruences and $q$-supercongruences.


title: 3D Head-Position Prediction in First-Person View by Considering Head Pose for Human-Robot Eye Contact

abstract: For a humanoid robot to make eye contact and initiate communication with a person, it is necessary to estimate the person's head position. However, eye contact becomes difficult due to the mechanical delay of the robot when the person is moving. Owing to these issues, it is important to conduct a head-position prediction to mitigate the effect of the delay in the robot motion. Based on the fact that humans turn their heads before changing direction while walking, we hypothesized that the accuracy of three-dimensional (3D) head-position prediction from a first-person view can be improved by considering the head pose. We compared our method with a conventional Kalman filter-based approach, and found our method to be more accurate. The experiment results show that considering the head pose helps improve the accuracy of 3D head-position prediction.


title: LightMBERT: A Simple Yet Effective Method for Multilingual BERT Distillation

abstract: The multilingual pre-trained language models (e.g, mBERT, XLM and XLM-R) have shown impressive performance on cross-lingual natural language understanding tasks. However, these models are computationally intensive and difficult to be deployed on resource-restricted devices. In this paper, we propose a simple yet effective distillation method (LightMBERT) for transferring the cross-lingual generalization ability of the multilingual BERT to a small student model. The experiment results empirically demonstrate the efficiency and effectiveness of LightMBERT, which is significantly better than the baselines and performs comparable to the teacher mBERT.


title: SAR-U-Net: squeeze-and-excitation block and atrous spatial pyramid pooling based residual U-Net for automatic liver segmentation in Computed Tomography

abstract: Background and objective: In this paper, a modified U-Net based framework is presented, which leverages techniques from Squeeze-and-Excitation (SE) block, Atrous Spatial Pyramid Pooling (ASPP) and residual learning for accurate and robust liver CT segmentation, and the effectiveness of the proposed method was tested on two public datasets LiTS17 and SLiver07. Methods: A new network architecture called SAR-U-Net was designed. Firstly, the SE block is introduced to adaptively extract image features after each convolution in the U-Net encoder, while suppressing irrelevant regions, and highlighting features of specific segmentation task; Secondly, ASPP was employed to replace the transition layer and the output layer, and acquire multi-scale image information via different receptive fields. Thirdly, to alleviate the degradation problem, the traditional convolution block was replaced with the residual block and thus prompt the network to gain accuracy from considerably increased depth. Results: In the LiTS17 experiment, the mean values of Dice, VOE, RVD, ASD and MSD were 95.71, 9.52, -0.84, 1.54 and 29.14, respectively. Compared with other closely related 2D-based models, the proposed method achieved the highest accuracy. In the experiment of the SLiver07, the mean values of Dice, VOE, RVD, ASD and MSD were 97.31, 5.37, -1.08, 1.85 and 27.45, respectively. Compared with other closely related models, the proposed method achieved the highest segmentation accuracy except for the RVD. Conclusion: The proposed model enables a great improvement on the accuracy compared to 2D-based models, and its robustness in circumvent challenging problems, such as small liver regions, discontinuous liver regions, and fuzzy liver boundaries, is also well demonstrated and validated.


title: Estimation of Conditional Mean Operator under the Bandable Covariance Structure

abstract: We consider high-dimensional multivariate linear regression models, where the joint distribution of covariates and response variables is a multivariate normal distribution with a bandable covariance matrix. The main goal of this paper is to estimate the regression coefficient matrix, which is a function of the bandable covariance matrix. Although the tapering estimator of covariance has the minimax optimal convergence rate for the class of bandable covariances, we show that it has a sub-optimal convergence rate for the regression coefficient; that is, a minimax estimator for the class of bandable covariances may not be a minimax estimator for its functionals. We propose the blockwise tapering estimator of the regression coefficient, which has the minimax optimal convergence rate for the regression coefficient under the bandable covariance assumption. We also propose a Bayesian procedure called the blockwise tapering post-processed posterior of the regression coefficient and show that the proposed Bayesian procedure has the minimax optimal convergence rate for the regression coefficient under the bandable covariance assumption. We show that the proposed methods outperform the existing methods via numerical studies.


title: BaySize: Bayesian Sample Size Planning for Phase I Dose-Finding Trials

abstract: We propose BaySize, a sample size calculator for phase I clinical trials using Bayesian models. BaySize applies the concept of effect size in dose finding, assuming the MTD is defined based on an equivalence interval. Leveraging a decision framework that involves composite hypotheses, BaySize utilizes two prior distributions, the fitting prior (for model fitting) and sampling prior (for data generation), to conduct sample size calculation under desirable statistical power. Look-up tables are generated to facilitate practical applications. To our knowledge, BaySize is the first sample size tool that can be applied to a broad range of phase I trial designs.


title: Holistic 3D Scene Understanding from a Single Image with Implicit Representation

abstract: We present a new pipeline for holistic 3D scene understanding from a single image, which could predict object shapes, object poses, and scene layout. As it is a highly ill-posed problem, existing methods usually suffer from inaccurate estimation of both shapes and layout especially for the cluttered scene due to the heavy occlusion between objects. We propose to utilize the latest deep implicit representation to solve this challenge. We not only propose an image-based local structured implicit network to improve the object shape estimation, but also refine the 3D object pose and scene layout via a novel implicit scene graph neural network that exploits the implicit local object features. A novel physical violation loss is also proposed to avoid incorrect context between objects. Extensive experiments demonstrate that our method outperforms the state-of-the-art methods in terms of object shape, scene layout estimation, and 3D object detection.


title: Particle Creation in some LRS Bianchi I models

abstract: In this work we consider particle creation by the expansion of the universe, using two Bianchi type I anisotropic models. The particles studied are of spin 0 and 1/2. The cosmological models have rotational symmetry, which allows us to solve exactly the equations of motion. The number density of the created particles is calculated with the method of Bogolubov transformations.


title: Dynamic Network Service Selection in Intelligent Reflecting Surface-Enabled Wireless Systems: Game Theory Approaches

abstract: In this paper, we address dynamic network selection problems of mobile users in an Intelligent Reflecting Surface (IRS)-enabled wireless network. In particular, the users dynamically select different Service Providers (SPs) and network services over time. The network services are composed of IRS resources and transmit power resources. To formulate the SP and network service selection, we adopt an evolutionary game in which the users are able to adapt their network selections depending on the utilities that they achieve. For this, the replicator dynamics is used to model the service selection adaptation of the users. To allow the users to take their past service experiences into account their decisions, we further adopt an enhanced version of the evolutionary game, namely fractional evolutionary game, to study the SP and network service selection. The fractional evolutionary game incorporates the memory effect that captures the users' memory on their decisions. We theoretically prove that both the game approaches have a unique equilibrium. Finally, we provide numerical results to demonstrate the effectiveness of our proposed game approaches. In particular, we have reveal some important finding, for instance, with the memory effect, the users can achieve the utility higher than that without the memory effect


title: Automated segmentation of choroidal layers from 3-dimensional macular optical coherence tomography scans

abstract: Background: Changes in choroidal thickness are associated with various ocular diseases and the choroid can be imaged using spectral-domain optical coherence tomography (SDOCT) and enhanced depth imaging OCT (EDIOCT). New Method: Eighty macular SDOCT volumes from 80 patients were obtained using the Zeiss Cirrus machine. Eleven additional control subjects had two Cirrus scans done in one visit along with EDIOCT using the Heidelberg Spectralis machine. To automatically segment choroidal layers from the OCT volumes, our graph-theoretic approach was utilized. The segmentation results were compared with reference standards from two graders, and the accuracy of automated segmentation was calculated using unsigned to signed border positioning thickness errors and Dice similarity coefficient (DSC). The repeatability and reproducibility of our choroidal thicknesses were determined by intraclass correlation coefficient (ICC), coefficient of variation (CV), and repeatability coefficient (RC). Results: The mean unsigned to signed border positioning errors for the choroidal inner and outer surfaces are 3.39plusminus1.26microns (mean plusminus SD) to minus1.52 plusminus 1.63microns and 16.09 plusminus 6.21microns to 4.73 plusminus 9.53microns, respectively. The mean unsigned to signed choroidal thickness errors are 16.54 plusminus 6.47microns to 6.25 plusminus 9.91microns, and the mean DSC is 0.949 plusminus 0.025. The ICC (95% CI), CV, RC values are 0.991 (0.977 to 0.997), 2.48%, 3.15microns for the repeatability and 0.991 (0.977 to 0.997), 2.49%, 0.53microns for the reproducibility studies, respectively. Comparison with Existing Method(s): The proposed method outperformed our previous method using choroidal vessel segmentation and inter-grader variability. Conclusions: This automated segmentation method can reliably measure choroidal thickness using different OCT platforms.


title: XDO: A Double Oracle Algorithm for Extensive-Form Games

abstract: Policy Space Response Oracles (PSRO) is a reinforcement learning (RL) algorithm for two-player zero-sum games that has been empirically shown to find approximate Nash equilibria in large games. Although PSRO is guaranteed to converge to an approximate Nash equilibrium and can handle continuous actions, it may take an exponential number of iterations as the number of information states (infostates) grows. We propose Extensive-Form Double Oracle (XDO), an extensive-form double oracle algorithm for two-player zero-sum games that is guaranteed to converge to an approximate Nash equilibrium linearly in the number of infostates. Unlike PSRO, which mixes best responses at the root of the game, XDO mixes best responses at every infostate. We also introduce Neural XDO (NXDO), where the best response is learned through deep RL. In tabular experiments on Leduc poker, we find that XDO achieves an approximate Nash equilibrium in a number of iterations an order of magnitude smaller than PSRO. Experiments on a modified Leduc poker game and Oshi-Zumo show that tabular XDO achieves a lower exploitability than CFR with the same amount of computation. We also find that NXDO outperforms PSRO and NFSP on a sequential multidimensional continuous-action game. NXDO is the first deep RL method that can find an approximate Nash equilibrium in high-dimensional continuous-action sequential games. Experiment code is available at https://github.com/indylab/nxdo.


title: Recursive contact tracing in Reed-Frost epidemic models

abstract: We introduce a Reed-Frost epidemic model with recursive contact tracing and asymptomatic transmission. This generalizes the branching-process model introduced by the authors in a previous work [arxiv:2004.07237] to finite populations and general contact networks. We simulate the model numerically for two representative examples, the complete graph and the square lattice. On both networks, we observe clear signatures of a contact-tracing phase transition from an "epidemic phase" to an "immune phase" as contact-network coverage is increased. We verify that away from the singular line of perfect tracing, the finite-size scaling of the contact-tracing phase transition on each network lies in the corresponding percolation universality class. Finally, we use the model to quantify the efficacy of recursive contact-tracing in regimes where epidemic spread is not contained.


abstract: We aim to provably complete a sparse and highly-missing tensor in the presence of covariate information along tensor modes. Our motivation comes from online advertising where users click-through-rates (CTR) on ads over various devices form a CTR tensor that has about 96% missing entries and has many zeros on non-missing entries, which makes the standalone tensor completion method unsatisfactory. Beside the CTR tensor, additional ad features or user characteristics are often available. In this paper, we propose Covariate-assisted Sparse Tensor Completion (COSTCO) to incorporate covariate information for the recovery of the sparse tensor. The key idea is to jointly extract latent components from both the tensor and the covariate matrix to learn a synthetic representation. Theoretically, we derive the error bound for the recovered tensor components and explicitly quantify the improvements on both the reveal probability condition and the tensor recovery accuracy due to covariates. Finally, we apply COSTCO to an advertisement dataset consisting of a CTR tensor and ad covariate matrix, leading to 23% accuracy improvement over the baseline. An important by-product is that ad latent components from COSTCO reveal interesting ad clusters, which are useful for better ad targeting.


title: Proposal for a Bell test in cavity optomagnonics

abstract: We present a proposal to test Bell inequality in the emerging field of cavity optomagnonics, where a sphere of ferromagnetic crystal supports two optical whispering gallery modes and one magnon mode. The two optical modes are driven by two laser pulses, respectively. Entanglement between magnon mode and one of the two optical modes will be generated by the first pulse, and the state of magnon mode is subsequently mapped into another optical mode via the second pulse. Hence correlated photon-photon pairs is created out of the cavity. A Bell test can be implemented using these pairs, which enables us to test local hidden-variable models at macroscopic optomagnonical system. Our results show that a significant violation of Bell inequality can be obtained in the experimentally relevant weak-coupling regime. The violation of Bell inequality not only verifies the entanglement between magnons and photons, but also implies that cavity optomagnonics is a promising platform for quantum information processing tasks.


title: A phase field model for mass transport with semi-permeable interfaces

abstract: In this paper, a thermal-dynamical consistent model for mass transfer across permeable moving interfaces is proposed by using the energy variation method. We consider a restricted diffusion problem where the flux across the interface depends on its conductance and the difference of the concentration on each side. The diffusive interface phase-field framework used here has several advantages over the sharp interface method. First of all, explicit tracking of the interface is no longer necessary. Secondly, the interfacial condition can be incorporated with a variable diffusion coefficient. A detailed asymptotic analysis confirms the diffusive interface model converges to the existing sharp interface model as the interface thickness goes to zero. A decoupled energy stable numerical scheme is developed to solve this system efficiently. Numerical simulations first illustrate the consistency of theoretical results on the sharp interface limit. Then a convergence study and energy decay test are conducted to ensure the efficiency and stability of the numerical scheme. To illustrate the effectiveness of our phase-field approach, several examples are provided, including a study of a two-phase mass transfer problem where drops with deformable interfaces are suspended in a moving fluid.


title: A Survey of Video Game Testing

abstract: Video-game projects are notorious for having day-one bugs, no matter how big their budget or team size. The quality of a game is essential for its success. This quality could be assessed and ensured through testing. However, to the best of our knowledge, little is known about video-game testing. In this paper, we want to understand how game developers perform game testing. We investigate, through a survey, the academic and gray literature to identify and report on existing testing processes and how they could automate them. We found that game developers rely, almost exclusively, upon manual play-testing and the testers' intrinsic knowledge. We conclude that current testing processes fall short because of their lack of automation, which seems to be the natural next step to improve the quality of games while maintaining costs. However, the current game-testing techniques may not generalize to different types of games.


title: Robust 2D/3D Vehicle Parsing in CVIS

abstract: We present a novel approach to robustly detect and perceive vehicles in different camera views as part of a cooperative vehicle-infrastructure system (CVIS). Our formulation is designed for arbitrary camera views and makes no assumptions about intrinsic or extrinsic parameters. First, to deal with multi-view data scarcity, we propose a part-assisted novel view synthesis algorithm for data augmentation. We train a part-based texture inpainting network in a self-supervised manner. Then we render the textured model into the background image with the target 6-DoF pose. Second, to handle various camera parameters, we present a new method that produces dense mappings between image pixels and 3D points to perform robust 2D/3D vehicle parsing. Third, we build the first CVIS dataset for benchmarking, which annotates more than 1540 images (14017 instances) from real-world traffic scenarios. We combine these novel algorithms and datasets to develop a robust approach for 2D/3D vehicle parsing for CVIS. In practice, our approach outperforms SOTA methods on 2D detection, instance segmentation, and 6-DoF pose estimation, by 4.5%, 4.3%, and 2.9%, respectively. More details and results are included in the supplement. To facilitate future research, we will release the source code and the dataset on GitHub.


title: A high-sensitivity charge sensor for silicon qubits above one kelvin

abstract: Recent studies of silicon spin qubits at temperatures above 1 K are encouraging demonstrations that the cooling requirements for solid-state quantum computing can be considerably relaxed. However, qubit readout mechanisms that rely on charge sensing with a single-island single-electron transistor (SISET) quickly lose sensitivity due to thermal broadening of the electron distribution in the reservoirs. Here we exploit the tunneling between two quantised states in a double-island SET (DISET) to demonstrate a charge sensor with an improvement in signal-to-noise by an order of magnitude compared to a standard SISET, and a single-shot charge readout fidelity above 99 % up to 8 K at a bandwidth > 100 kHz. These improvements are consistent with our theoretical modelling of the temperature-dependent current transport for both types of SETs. With minor additional hardware overheads, these sensors can be integrated into existing qubit architectures for high fidelity charge readout at few-kelvin temperatures.


title: Topical Language Generation using Transformers

abstract: Large-scale transformer-based language models (LMs) demonstrate impressive capabilities in open text generation. However, controlling the generated text's properties such as the topic, style, and sentiment is challenging and often requires significant changes to the model architecture or retraining and fine-tuning the model on new supervised data. This paper presents a novel approach for Topical Language Generation (TLG) by combining a pre-trained LM with topic modeling information. We cast the problem using Bayesian probability formulation with topic probabilities as a prior, LM probabilities as the likelihood, and topical language generation probability as the posterior. In learning the model, we derive the topic probability distribution from the user-provided document's natural structure. Furthermore, we extend our model by introducing new parameters and functions to influence the quantity of the topical features presented in the generated text. This feature would allow us to easily control the topical properties of the generated text. Our experimental results demonstrate that our model outperforms the state-of-the-art results on coherency, diversity, and fluency while being faster in decoding.


title: Population-Based Evolution Optimizes a Meta-Learning Objective

abstract: Meta-learning models, or models that learn to learn, have been a long-desired target for their ability to quickly solve new tasks. Traditional meta-learning methods can require expensive inner and outer loops, thus there is demand for algorithms that discover strong learners without explicitly searching for them. We draw parallels to the study of evolvable genomes in evolutionary systems -- genomes with a strong capacity to adapt -- and propose that meta-learning and adaptive evolvability optimize for the same objective: high performance after a set of learning iterations. We argue that population-based evolutionary systems with non-static fitness landscapes naturally bias towards high-evolvability genomes, and therefore optimize for populations with strong learning ability. We demonstrate this claim with a simple evolutionary algorithm, Population-Based Meta Learning (PBML), that consistently discovers genomes which display higher rates of improvement over generations, and can rapidly adapt to solve sparse fitness and robotic control tasks.


title: The variance of closed geodesics in balls and annuli on the modular surface

abstract: We asymptotically estimate the variance for the distribution of closed geodesics in small random balls or annuli on the modular surface $\Gamma\backslash\mathbb{H}$. A probabilistic model in which closed geodesics are modeled using random geodesic segments is proposed, and we rigorously analyze this model using mixing of the geodesic flow in $\Gamma\backslash\mathbb{H}$. This leads to a conjecture for the asymptotic behavior of the variance, which unlike in previously explored cases is not equal to the expected value. We prove this conjecture for small balls and annuli, resolving a question left open by Humphries and Radziwill.


title: More Robust Estimators for Instrumental-Variable Panel Designs, With An Application to the Effect of Imports from China on US Employment

abstract: We show that first-difference two-stages-least-squares regressions identify non-convex combinations of location-and-period-specific treatment effects. Thus, those regressions could be biased if effects are heterogeneous. We propose an alternative instrumental-variable correlated-random-coefficient (IV-CRC) estimator, that is more robust to heterogeneous effects. We revisit Autor et al. (2013), who use a first-difference two-stages-least-squares regression to estimate the effect of imports from China on US manufacturing employment. Their regression estimates a highly non-convex combination of effects. Our more robust IV-CRC estimator is small and insignificant. Though its confidence interval is wide, it significantly differs from the first-difference two-stages-least-squares estimator.


title: The Curse of Correlations for Robust Fingerprinting of Relational Databases

abstract: Database fingerprinting have been widely adopted to prevent unauthorized sharing of data and identify the source of data leakages. Although existing schemes are robust against common attacks, like random bit flipping and subset attack, their robustness degrades significantly if attackers utilize the inherent correlations among database entries. In this paper, we first demonstrate the vulnerability of existing database fingerprinting schemes by identifying different correlation attacks: column-wise correlation attack, row-wise correlation attack, and the integration of them. To provide robust fingerprinting against the identified correlation attacks, we then develop mitigation techniques, which can work as post-processing steps for any off-the-shelf database fingerprinting schemes. The proposed mitigation techniques also preserve the utility of the fingerprinted database considering different utility metrics. We empirically investigate the impact of the identified correlation attacks and the performance of mitigation techniques using real-world relational databases. Our results show (i) high success rates of the identified correlation attacks against existing fingerprinting schemes (e.g., the integrated correlation attack can distort 64.8\% fingerprint bits by just modifying 14.2\% entries in a fingerprinted database), and (ii) high robustness of the proposed mitigation techniques (e.g., with the mitigation techniques, the integrated correlation attack can only distort $3\%$ fingerprint bits).


title: Equivariant $\mathbb R$-test configurations and semistable limits of $\mathbb Q$-Fano group compactifications

abstract: Let $G$ be a connected, complex reductive group. In this paper, we classify $G\times G$-equivariant normal $\mathbb R$-test configurations of a polarized $G$-compactification. Then for $\mathbb Q$-Fano $G$-compactifications, we express the H-invariant of its equivariant normal $\mathbb R$-test configurations in terms of the combinatory data. Based on \cite{Han-Li}, we compute the semistable limit of a K-unstable Fano $G$-compactification. As an application, we show that for the two K-unstable Fano $SO_4(\mathbb C)$-compactifications, the corresponding semistable limits are indeed the limit spaces of the normalized K\"ahler-Ricci flow.


title: Optimizing Fund Allocation for Game-based Verifiable Computation Outsourcing

abstract: This paper considers the setting where a cloud server services a static set or a dynamic sequence of tasks submitted by multiple clients. Every client wishes to assure honest execution of tasks by additionally employing a trusted third party (TTP) to re-compute the tasks with a certain probability. The cloud server makes a deposit for each task it takes, each client allocates a budget (including the wage for the server and the cost for possibly hiring TTP) for each task submitted, and every party has its limited fund for either deposits or task budgets. We study how to allocate the funds optimally to achieve the three-fold goals: a rational cloud server honestly computes each task; the server's wage is maximized; the overall delay for task verification is minimized. We apply game theory to formulate the optimization problems, and develop the optimal or heuristic solutions for three application scenarios. For each of the solutions, we analyze it through either rigorous proofs or extensive simulations. To the best of our knowledge, this is the first work on optimizing fund allocation for verifiable outsourcing of computation in the setting of one server and multiple clients, based on game theory.


title: Left restriction monoids from left $E$-completions

abstract: Given a monoid $S$ with $E$ any non-empty subset of its idempotents, we present a novel one-sided version of idempotent completion we call left $E$-completion. In general, the construction yields a one-sided variant of a small category called a constellation by Gould and Hollings. Under certain conditions, this constellation is inductive, meaning that its partial multiplication may be extended to give a left restriction semigroup, a type of unary semigroup whose unary operation models domain. We study the properties of those pairs $S,E$ for which this happens, and characterise those left restriction semigroups that arise as such left $E$-completions of their submonoid of elements having domain $1$. As first applications, we decompose the left restriction semigroup of partial functions on the set $X$ and the right restriction semigroup of left total partitions on $X$ as left and right $E$-completions respectively of the transformation semigroup $T_X$ on $X$, and decompose the left restriction semigroup of binary relations on $X$ under demonic composition as a left $E$-completion of the left-total binary relations. In many cases, including these three examples, the construction embeds in a semigroup Zappa-Sz\'{e}p product.


title: Hierarchical Bayesian Model for the Transfer of Knowledge on Spatial Concepts based on Multimodal Information

abstract: This paper proposes a hierarchical Bayesian model based on spatial concepts that enables a robot to transfer the knowledge of places from experienced environments to a new environment. The transfer of knowledge based on spatial concepts is modeled as the calculation process of the posterior distribution based on the observations obtained in each environment with the parameters of spatial concepts generalized to environments as prior knowledge. We conducted experiments to evaluate the generalization performance of spatial knowledge for general places such as kitchens and the adaptive performance of spatial knowledge for unique places such as `Emma's room' in a new environment. In the experiments, the accuracies of the proposed method and conventional methods were compared in the prediction task of location names from an image and a position, and the prediction task of positions from a location name. The experimental results demonstrated that the proposed method has a higher prediction accuracy of location names and positions than the conventional method owing to the transfer of knowledge.


title: Where is your place, Visual Place Recognition?

abstract: Visual Place Recognition (VPR) is often characterized as being able to recognize the same place despite significant changes in appearance and viewpoint. VPR is a key component of Spatial Artificial Intelligence, enabling robotic platforms and intelligent augmentation platforms such as augmented reality devices to perceive and understand the physical world. In this paper, we observe that there are three "drivers" that impose requirements on spatially intelligent agents and thus VPR systems: 1) the particular agent including its sensors and computational resources, 2) the operating environment of this agent, and 3) the specific task that the artificial agent carries out. In this paper, we characterize and survey key works in the VPR area considering those drivers, including their place representation and place matching choices. We also provide a new definition of VPR based on the visual overlap -- akin to spatial view cells in the brain -- that enables us to find similarities and differences to other research areas in the robotics and computer vision fields. We identify numerous open challenges and suggest areas that require more in-depth attention in future works.


title: Specular transmission and diffuse reflection in phonon scattering at grain boundary

abstract: It is widely assumed in the literature that the specularity parameters for phonon transmission (forward scattering) and reflection (backward scattering) at a boundary are identical, i.e., the statistical distributions of the transition probabilities between an incident phonon and the range of outgoing phonon modes are the same for both transmission and reflection. However, it is hypothesized by Li and McGaughey that separate specularity parameters are needed to describe the behavior of transmitted and reflected phonons in superlattices and polycrystalline materials correctly. We test this hypothesis by analyzing the mode-resolved specularity parameters computed separately for transmission and reflection processes at a graphene grain boundary. Our results show that backward scattering is considerably more diffuse than forward scattering at most frequencies and polarizations, providing strong evidence for Li and McGaughey's hypothesis, and shed new light on how surfaces and interfaces modify phonon transport within and between domains in nanostructured materials.


title: Charmonium Properties Using the Discrete Variable Representation (DVR) Method

abstract: The Schr\"odinger equation is solved numerically for charmonium using the discrete variable representation (DVR) method. The Hamiltonian matrix is constructed and diagonalized to obtain the eigenvalues and eigenfunctions. Using these eigenvalues and eigenfunctions, spectra and various decay widths are calculated. The obtained results are in good agreement with other numerical methods and with experiments.


title: Extracting candidate factors affecting long-term trends of student abilities across subjects

abstract: Long-term student achievement data provide useful information to formulate the research question of what types of student skills would impact future trends across subjects. However, few studies have focused on long-term data. This is because the criteria of examinations vary depending on their designers; additionally, it is difficult for the same designer to maintain the coherence of the criteria of examinations beyond grades. To solve this inconsistency issue, we propose a novel approach to extract candidate factors affecting long-term trends across subjects from long-term data. Our approach is composed of three steps: Data screening, time series clustering, and causal inference. The first step extracts coherence data from long-term data. The second step groups the long-term data by shape and value. The third step extracts factors affecting the long-term trends and validates the extracted variation factors using two or more different data sets. We then conducted evaluation experiments with student achievement data from five public elementary schools and four public junior high schools in Japan. The results demonstrate that our approach extracts coherence data, clusters long-term data into interpretable groups, and extracts candidate factors affecting academic ability across subjects. Subsequently, our approach formulates a hypothesis and turns archived achievement data into useful information.


title: Self-Supervised Motion Retargeting with Safety Guarantee

abstract: In this paper, we present self-supervised shared latent embedding (S3LE), a data-driven motion retargeting method that enables the generation of natural motions in humanoid robots from motion capture data or RGB videos. While it requires paired data consisting of human poses and their corresponding robot configurations, it significantly alleviates the necessity of time-consuming data-collection via novel paired data generating processes. Our self-supervised learning procedure consists of two steps: automatically generating paired data to bootstrap the motion retargeting, and learning a projection-invariant mapping to handle the different expressivity of humans and humanoid robots. Furthermore, our method guarantees that the generated robot pose is collision-free and satisfies position limits by utilizing nonparametric regression in the shared latent space. We demonstrate that our method can generate expressive robotic motions from both the CMU motion capture database and YouTube videos.


title: Prescribing Oscillation Behavior of Solutions to the Heat Equation on $\mathbb{R}^n$ via the Initial Data and its Average Integral

abstract: \begin{abstract} Motivated by a classical stabilization result for solution to the Cauchy problem of the heat equation$\ \partial_{t}u=\bigtriangleup u\ $on $\mathbb{R}^{n}$, we consider its oscillation behavior with radial initial data $\varphi\left( x\right) =\varphi\left( \left\vert x\right\vert \right) \in C^{0}\left( \mathbb{R}^{n}\right) \bigcap L^{\infty}\left( \mathbb{R}^{n}\right) .\ $Given four arbitrary finite numbers $r<\alpha <\beta<s,$ one can construct a radial $\varphi\in C^{0}\left( \mathbb{R}% ^{n}\right) \bigcap L^{\infty}\left( \mathbb{R}^{n}\right) $ so that $\varphi\ $together with its corresponding solution$\ u\left( x,t\right) $ satisfy the oscillation behavior: \begin{align*} \liminf_{\tau\rightarrow\infty}\varphi\left( \tau\right) & =r<\liminf _{t\rightarrow\infty}u\left( 0,t\right) =\alpha & <\limsup_{t\rightarrow\infty}u\left( 0,t\right) =\beta<\limsup _{\tau\rightarrow\infty}\varphi\left( \tau\right) =s. \end{align*} Another related topic concerning the oscillation behavior of the average integral of the initial data is also discussed. \end{abstract}


title: Slowly rotating black holes and their scalarization

abstract: We study scalarization of slowly rotating black holes in the Einstein-scalar-Gauss-Bonnet (GB)-Chern-Simons (CS) theory. In the slow rotation approximation of $a\ll1$ with rotation parameter $a$, the GB term is given by a term for Schwarzschild black hole, whereas the CS term takes a linear term of $a$. The tachyonic instability for slowly rotating black holes represents the onset of spontaneous scalarization. We use the (2+1)-dimensional hyperboloidal foliation method to show the tachyonic instability for slowly rotating black holes by considering the time evolution of a spherically symmetric scalar mode. A threshold (existence) curve is obtained from the constant scalar modes under time evolution, which means the boundary between stable and unstable black holes. It is found that the slowly rotating black holes turn out to be unstable against a spherically symmetric scalar-mode propagation for positive coupling $\alpha$. However, we could not find tachyonic instability and any $a$-bound for scalarization for negative coupling $\alpha$.


title: Full Page Handwriting Recognition via Image to Sequence Extraction

abstract: We present a Neural Network based Handwritten Text Recognition (HTR) model architecture that can be trained to recognize full pages of handwritten or printed text without image segmentation. Being based on Image to Sequence architecture, it can extract text present in an image and then sequence it correctly without imposing any constraints regarding orientation, layout and size of text and non-text. Further, it can also be trained to generate auxiliary markup related to formatting, layout and content. We use character level vocabulary, thereby enabling language and terminology of any subject. The model achieves a new state-of-art in paragraph level recognition on the IAM dataset. When evaluated on scans of real world handwritten free form test answers - beset with curved and slanted lines, drawings, tables, math, chemistry and other symbols - it performs better than all commercially available HTR cloud APIs. It is deployed in production as part of a commercial web application.


title: Automorphisms of free braided associative algebras in two variables

abstract: We describe the groups of automorphisms of two generated free braided associative algebras with involutive diagonal braidings over a field of characteristic $\neq 2$. Depending on the form of the diagonal involutive braiding, five different automorphism groups arise as automorphism groups of two generated free braided associative algebras. This list covers all three automorphism groups that arise in the case of quantum planes \cite{AC}.


title: Test elements, excellent rings, and content functions

abstract: Broadening existing results in the literature to much wider classes of rings, we prove among other things: 1. Reduced quotients of excellent regular rings of characteristic $p$ admit big test elements, 2. The set of F-jumping numbers of a principal ideal in a locally excellent regular ring is a discrete subset of $\mathbb Q$, and 3. If $R$ is a quotient of a locally excellent regular ring of prime characteristic, then there is a uniform upper bound on the Hartshorne-Speiser-Lyubeznik numbers of the injective hulls of the residue fields of $R$. To do so, we develop the parallel theories of Ohm-Rush and intersection flat algebras. We show that both properties can be checked locally in flat maps of Noetherian rings. We show that intersection-flatness admits a content theory parallel to that of Ohm-Rush content for Ohm-Rush algebras. We develop descent results for these properties. Using the descent result for intersection flatness, we obtain a local condition under which a faithfully flat map of Noetherian rings must be intersection-flat. The local condition for intersection-flatness allows us to conclude that finitely generated faithfully flat algebras over a Noetherian ring are intersection-flat. Combining the local condition for intersection flatness with results of Kunz and Radu yields the conclusion that the Frobenius endomorphism associated to a locally excellent regular ring of prime characteristic is intersection-flat, thus answering a question of Sharp. Applications of the latter result include the three enumerated results above. We also get applications to tight closure and parameter test ideals.


title: Smartphone Impostor Detection with Behavioral Data Privacy and Minimalist Hardware Support

abstract: Impostors are attackers who take over a smartphone and gain access to the legitimate user's confidential and private information. This paper proposes a defense-in-depth mechanism to detect impostors quickly with simple Deep Learning algorithms, which can achieve better detection accuracy than the best prior work which used Machine Learning algorithms requiring computation of multiple features. Different from previous work, we then consider protecting the privacy of a user's behavioral (sensor) data by not exposing it outside the smartphone. For this scenario, we propose a Recurrent Neural Network (RNN) based Deep Learning algorithm that uses only the legitimate user's sensor data to learn his/her normal behavior. We propose to use Prediction Error Distribution (PED) to enhance the detection accuracy. We also show how a minimalist hardware module, dubbed SID for Smartphone Impostor Detector, can be designed and integrated into smartphones for self-contained impostor detection. Experimental results show that SID can support real-time impostor detection, at a very low hardware cost and energy consumption, compared to other RNN accelerators.


title: Domination by geometric 4-manifolds

abstract: We consider aspects of the question "when is an orientable closed 4-manifold $Y$ dominated by another such manifold $X$", focusing on the cases when $X$ is geometric or fibres non-trivially over an orientable surface.


title: An alternative to the Simon tensor

abstract: The Simon tensor gives rise to a local characterization of the Kerr-NUT family in the stationary class of vacuum spacetimes. We find that a symmetric and traceless tensor in the quotient space of the stationary Killing trajectory offers a useful alternative to the Simon tensor. Our tensor is distinct from the spatial dual of the Simon tensor and illustrates the geometric property of the three dimensional quotient space more manifest. The reconstruction procedure of the metric for which the generalized Simon tensor vanishes is spelled out in detail. We give a four dimensional description of this tensor in terms of the Coulomb part of the imaginary selfdual Weyl tensor, which corresponds to the generalization of the three-index tensor defined by Mars. This allows us to establish a new and simple criterion for the Kerr-NUT family: the gradient of the Ernst potential becomes the non-null eigenvector of the Coulomb part of the imaginary selfdual Weyl tensor. We also discuss the ${\rm SU}(1,2)$ covariant extension of the obstruction tensor into the Einstein-Maxwell system as an intrinsic characterization of the Kerr-Newman-NUT family.


title: Giant Inverse Rashba-Edelstein Effect: Application to Monolayer OsBi$_2$

abstract: We propose that the hybridization between two sets of Rashba bands can lead to an unconventional topology where the two Fermi circles from different bands own in-plane helical spin textures with the same chiralities, and possess group velocities with the same directions. Under the weak spin injection, the two Fermi circles both give the positive contributions to the spin-to-charge conversion and thus induce the giant inverse Rashba-Edelstein Effect with large conversion efficiency, which is very different from the conventional Rashba-Edelstein Effect. More importantly, through the first-principles calculations, we predict that monolayer OsBi2 could be a good candidate to realize the giant inverse Rashba-Edelstein Effect. Our studies not only demonstrate a new mechanism to achieve highly efficient spin-to-charge conversion in spintronics, but also provide a promising material to realize it.


title: All-optical neural network quantum state tomography

abstract: Quantum state tomography (QST) is a crucial ingredient for almost all aspects of experimental quantum information processing. As an analog of the "imaging" technique in the quantum settings, QST is born to be a data science problem, where machine learning techniques, noticeably neural networks, have been applied extensively. In this work, we build an integrated all-optical setup for neural network QST, based on an all-optical neural network (AONN). Our AONN is equipped with built-in nonlinear activation function, which is based on electromagnetically induced transparency. Experiment results demonstrate the validity and efficiency of the all-optical setup, indicating that AONN can mitigate the state-preparation-and-measurement error and predict the phase parameter in the quantum state accurately. Given that optical setups are highly desired for future quantum networks, our all-optical setup of integrated AONN-QST may shed light on replenishing the all-optical quantum network with the last brick.


title: Emergent behaviors of rotation matrix flocks

abstract: We derive an explicit form for the Cucker-Smale (CS) model on the special orthogonal group $\mathrm{SO}(3)$ by identifying closed form expressions for geometric quantities such as covariant derivative and parallel transport in exponential coordinates. We study the emergent dynamics of the model by using a Lyapunov functional approach and La Salle's invariance principle. Specifically, we show that velocity alignment emerges from some admissible class of initial data, under suitable assumptions on the communication weight function. We characterize the $\omega$-limit set of the dynamical system and identify a dichotomy in the asymptotic behavior of solutions. Several numerical examples are provided to support the analytical results.


title: Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings

abstract: Cross-lingual word embeddings (CLWE) have been proven useful in many cross-lingual tasks. However, most existing approaches to learn CLWE including the ones with contextual embeddings are sense agnostic. In this work, we propose a novel framework to align contextual embeddings at the sense level by leveraging cross-lingual signal from bilingual dictionaries only. We operationalize our framework by first proposing a novel sense-aware cross entropy loss to model word senses explicitly. The monolingual ELMo and BERT models pretrained with our sense-aware cross entropy loss demonstrate significant performance improvement for word sense disambiguation tasks. We then propose a sense alignment objective on top of the sense-aware cross entropy loss for cross-lingual model pretraining, and pretrain cross-lingual models for several language pairs (English to German/Spanish/Japanese/Chinese). Compared with the best baseline results, our cross-lingual models achieve 0.52%, 2.09% and 1.29% average performance improvements on zero-shot cross-lingual NER, sentiment classification and XNLI tasks, respectively.


title: Recent Advances on Neural Network Pruning at Initialization

abstract: Neural network pruning typically removes connections or neurons from a pretrained converged model; while a new pruning paradigm, pruning at initialization (PaI), attempts to prune a randomly initialized network. This paper offers the first survey concentrated on this emerging pruning fashion. We first introduce a generic formulation of neural network pruning, followed by the major classic pruning topics. Then, as the main body of this paper, a thorough and structured literature review of PaI methods is presented, consisting of two major tracks (sparse training and sparse selection). Finally, we summarize the surge of PaI compared to PaT and discuss the open problems. Apart from the dedicated literature review, this paper also offers a code base for easy sanity-checking and benchmarking of different PaI methods.


title: Customized quantum annealing schedules

abstract: In a typical quantum annealing protocol, the system starts with a transverse field Hamiltonian which is gradually turned off and replaced by a longitudinal Ising Hamiltonian. The ground state of the Ising Hamiltonian encodes the solution to the computational problem of interest, and the state overlap with this ground state gives the success probability of the annealing protocol. The form of the annealing schedule can have a significant impact on the ground state overlap at the end of the anneal, so precise control over these annealing schedules can be a powerful tool for increasing success probabilities of annealing protocols. Here we show how superconducting circuits, in particular capacitively shunted flux qubits (CSFQs), can be used to construct quantum annealing systems by providing tools for mapping circuit flux biases to Pauli coefficients. We use this mapping to find customized annealing schedules: appropriate circuit control biases that yield a desired annealing schedule, while accounting for the physical limitations of the circuitry. We then provide examples and proposals that utilize this capability to improve quantum annealing performance.


title: Ultra-Steep Spectrum Radio `Jellyfish' Uncovered in Abell 2877

abstract: We report on the discovery of a mysterious ultra-steep spectrum (USS) synchrotron source in the galaxy cluster Abell 2877. We have observed the source with the Murchison Widefield Array at five frequencies across 72-231 MHz and have found the source to exhibit strong spectral curvature over this range as well the steepest known spectra of a synchrotron cluster source, with a spectral index across the central three frequency bands of $\alpha = -5.97^{+0.40}_{-0.48}$. Higher frequency radio observations, including a deep observation with the Australia Telescope Compact Array, fail to detect any of the extended diffuse emission. The source is approximately 370 kpc wide and bears an uncanny resemblance to a jellyfish with two peaks of emission and long tentacles descending south towards the cluster centre. Whilst the `USS Jellyfish' defies easy classification, we here propose that the phenomenon is caused by the reacceleration and compression of multiple aged electron populations from historic active galactic nucleus (AGN) activity, so-called `radio phoenix', by an as yet undetected weak cluster-scale mechanism. The USS Jellyfish adds to a growing number of radio phoenix in cool-core clusters with unknown reacceleration mechanisms; as the first example of a polyphoenix, however, this implies the mechanism is on the scale of the cluster itself. Indeed, we show that in simulations, emission akin to the USS Jellyfish can be produced as a short-lived, transient phase in the evolution of multiple interacting AGN remnants when subject to weak external shocks.


title: Quantum Walks can Unitarily Represent Random Walks on Finite Graphs

abstract: Quantum and random walks have been shown to be equivalent in the following sense: a time-dependent random walk can be constructed such that its vertex distribution at all time instants is identical to the vertex distribution of any discrete-time coined quantum walk on a finite graph. This equivalence establishes a deep connection between the two processes, far stronger than simply considering quantum walks as quantum analogues of classical random walks. The present work strengthens this connection by providing a construction that establishes this equivalence in the reverse direction: a unitary time-dependent quantum walk can be constructed such that its vertex distribution is identical to the vertex distribution of any random walk on a finite graph at all time instants. The construction shown here describes a quantum walk that matches a random walk without measurements at all time steps (an otherwise trivial statement): measurement is performed in a quantum walk that evolved unitarily until a given time $t$ such that its vertex distribution is identical to the random walk at time $t$. The construction procedure is general, covering both homogeneous and non-homogeneous random walks. For homogeneous random walks, unitary evolution implies time dependency for the quantum walk, since homogeneous quantum walks do not converge under arbitrary initial conditions, while a broad class of random walks does. Thus, the absence of convergence demonstrated for quantum walks in its debut comes from both time-homogeneity and unitarity, rather than unitarity alone, and our results shed light on the power of quantum walks to generate samples for arbitrary probability distributions. Finally, the construction here proposed is used to simulate quantum walks that match uniform random walks on the cycle and the torus.


title: Rigidity of Euler Products

abstract: We report a simple rigidity theorem for certain Euler products.


title: Dynamic Grasping with a "Soft" Drone: From Theory to Practice

abstract: Rigid grippers used in existing aerial manipulators require precise positioning to achieve successful grasps and transmit large contact forces that may destabilize the drone. This limits the speed during grasping and prevents "dynamic grasping", where the drone attempts to grasp an object while moving. On the other hand, biological systems (e.g., birds) rely on compliant and soft parts to dampen contact forces and compensate for grasping inaccuracy, enabling impressive feats. This paper presents the first prototype of a soft drone -- a quadrotor where traditional (i.e., rigid) landing gears are replaced with a soft tendon-actuated gripper to enable aggressive grasping. We provide three key contributions. First, we describe our soft drone prototype, including electro-mechanical design, software infrastructure, and fabrication. Second, we review the set of algorithms we use for trajectory optimization and control of the drone and the soft gripper; the algorithms combine state-of-the-art techniques for quadrotor control (i.e., an adaptive geometric controller) with advanced soft robotics models (i.e., a quasi-static finite element model). Finally, we evaluate our soft drone in physics simulations (using SOFA and Unity) and in real tests in a motion-capture room. Our drone is able to dynamically grasp objects of unknown shape where baseline approaches fail. Our physical prototype ensures consistent performance, achieving 91.7% successful grasps across 23 trials. We showcase dynamic grasping results in the video attachment. Video Attachment: https://youtu.be/mqbj8mEyCdk


title: Imitation learning for variable speed motion generation over multiple actions

abstract: Robotic motion generation methods using machine learning have been studied in recent years. Bilateral control-based imitation learning can imitate human motions using force information. By means of this method, variable speed motion generation that considers physical phenomena such as the inertial force and friction can be achieved. However, the previous study only focused on a simple reciprocating motion. To learn the complex relationship between the force and speed more accurately, it is necessary to learn multiple actions using many joints. In this paper, we propose a variable speed motion generation method for multiple motions. We considered four types of neural network models for the motion generation and determined the best model for multiple motions at variable speeds. Subsequently, we used the best model to evaluate the reproducibility of the task completion time for the input completion time command. The results revealed that the proposed method could change the task completion time according to the specified completion time command in multiple motions.


title: Pavement Distress Detection and Segmentation using YOLOv4 and DeepLabv3 on Pavements in the Philippines

abstract: Road transport infrastructure is critical for safe, fast, economical, and reliable mobility within the whole country that is conducive to a productive society. However, roads tend to deteriorate over time due to natural causes in the environment and repeated traffic loads. Pavement Distress (PD) detection is essential in monitoring the current conditions of the public roads to enable targeted rehabilitation and preventive maintenance. Nonetheless, distress detection surveys are still done via manual inspection for developing countries such as the Philippines. This study proposed the use of deep learning for two ways of recording pavement distresses from 2D RGB images - detection and segmentation. YOLOv4 is used for pavement distress detection while DeepLabv3 is employed for pavement distress segmentation on a small dataset of pavement images in the Philippines. This study aims to provide a basis to potentially spark solutions in building a cheap, scalable, and automated end-to-end solution for PD detection in the country.


title: Symbolic powers of multipartite hypergraphs and Waldschmidt constant

abstract: In this paper, we find a criterion to answer when the second symbolic and ordinary powers of the edge ideal of a 3-partite hypergraph are equal. Also, we give the formula to compute the Waldschmidt constant of the path ideals of a cycle.


title: Generalizable Episodic Memory for Deep Reinforcement Learning

abstract: Episodic memory-based methods can rapidly latch onto past successful strategies by a non-parametric memory and improve sample efficiency of traditional reinforcement learning. However, little effort is put into the continuous domain, where a state is never visited twice, and previous episodic methods fail to efficiently aggregate experience across trajectories. To address this problem, we propose Generalizable Episodic Memory (GEM), which effectively organizes the state-action values of episodic memory in a generalizable manner and supports implicit planning on memorized trajectories. GEM utilizes a double estimator to reduce the overestimation bias induced by value propagation in the planning process. Empirical evaluation shows that our method significantly outperforms existing trajectory-based methods on various MuJoCo continuous control tasks. To further show the general applicability, we evaluate our method on Atari games with discrete action space, which also shows a significant improvement over baseline algorithms.


title: Ion-beam-assisted characterization of quinoline-insoluble particles in nuclear graphite

abstract: The irradiation behavior of graphite is essential for its applications in nuclear industry. However, the differences between graphite's behaviors are not well understood because of the very limited knowledge of microstructural differences between graphites. One typical structure, quinoline insoluble (QI) particle, was investigated using IG-110 and NBG-18 graphite. After irradiation, the QI particles on the polished surface were proved to become hillocks and can be easily identified by using a scanning electron microscope (SEM). Thus a method combining ion irradiation and SEM characterization was proposed to study the distribution and concentration of QI particles in graphite. During irradiation, the QI particles were found to evolve into densified spheres which have weak bonding with the surrounding graphite structures, indicating that the densification of QI particles does not contribute obviously to graphite dimensional shrinkage. A much higher concentration of QI particles in NBG-18 than IG-110 was characterized and is suggested to be responsible for the smaller maximum dimensional shrinkage of NBG-18 than IG-110 during irradiation.


title: Causal inference with misspecified exposure mappings: separating definitions and assumptions

abstract: Exposure mappings facilitate investigations of complex causal effects when units interact in experiments. Current methods require experimenters to use the same exposure mappings both to define the effect of interest and to impose assumptions on the interference structure. However, the two roles rarely coincide in practice, and experimenters are forced to make the often questionable assumption that their exposures are correctly specified. This paper argues that the two roles exposure mappings currently serve can, and typically should, be separated, so that exposures are used to define effects without necessarily assuming that they are capturing the complete causal structure in the experiment. The paper shows that this approach is practically viable by providing conditions under which exposure effects can be precisely estimated when the exposures are misspecified. Some important questions remain open.


title: Virtual Reality: A Survey of Enabling Technologies and its Applications in IoT

abstract: Virtual Reality (VR) has shown great potential to revolutionize the market by providing users immersive experiences with freedom of movement. Compared to traditional video streaming, VR is with ultra high-definition and dynamically changes with users' head and eye movements, which poses significant challenges for the realization of such potential. In this paper, we provide a detailed and systematic survey of enabling technologies of virtual reality and its applications in Internet of Things (IoT). We identify major challenges of virtual reality on system design, view prediction, computation, streaming, and quality of experience evaluation. We discuss each of them by extensively surveying and reviewing related papers in the recent years. We also introduce several use cases of VR for IoT. Last, issues and future research directions are also identified and discussed.


title: Multi-Task Federated Reinforcement Learning with Adversaries

abstract: Reinforcement learning algorithms, just like any other Machine learning algorithm pose a serious threat from adversaries. The adversaries can manipulate the learning algorithm resulting in non-optimal policies. In this paper, we analyze the Multi-task Federated Reinforcement Learning algorithms, where multiple collaborative agents in various environments are trying to maximize the sum of discounted return, in the presence of adversarial agents. We argue that the common attack methods are not guaranteed to carry out a successful attack on Multi-task Federated Reinforcement Learning and propose an adaptive attack method with better attack performance. Furthermore, we modify the conventional federated reinforcement learning algorithm to address the issue of adversaries that works equally well with and without the adversaries. Experimentation on different small to mid-size reinforcement learning problems show that the proposed attack method outperforms other general attack methods and the proposed modification to federated reinforcement learning algorithm was able to achieve near-optimal policies in the presence of adversarial agents.


title: Metapaths guided Neighbors aggregated Network for?Heterogeneous Graph Reasoning

abstract: Most real-world datasets are inherently heterogeneous graphs, which involve a diversity of node and relation types. Heterogeneous graph embedding is to learn the structure and semantic information from the graph, and then embed it into the low-dimensional node representation. Existing methods usually capture the composite relation of a heterogeneous graph by defining metapath, which represent a semantic of the graph. However, these methods either ignore node attributes, or discard the local and global information of the graph, or only consider one metapath. To address these limitations, we propose a Metapaths-guided Neighbors-aggregated Heterogeneous Graph Neural Network(MHN) to improve performance. Specially, MHN employs node base embedding to encapsulate node attributes, BFS and DFS neighbors aggregation within a metapath to capture local and global information, and metapaths aggregation to combine different semantics of the heterogeneous graph. We conduct extensive experiments for the proposed MHN on three real-world heterogeneous graph datasets, including node classification, link prediction and online A/B test on Alibaba mobile application. Results demonstrate that MHN performs better than other state-of-the-art baselines.


title: Finite dimensional Nichols algebras over Suzuki algebra II: over simple Yetter-Drinfeld modules of $A_{N\,2n+1}^{\mu\lambda}$

abstract: In this paper, the author gives a complete set of simple Yetter-Drinfeld modules over Suzuki algebra $A_{N\,2n+1}^{\mu\lambda}$ and investigates the Nichols algebras over those irreducible Yetter-Drinfeld modules. The finite dimensional Nichols algebras of diagonal type are of Cartan type $A_1$, $A_1\times A_1$, $A_2$, Super type ${A}_{2}(q;I_2)$ and the Nichols algebra $\mathfrak{ufo}(8)$. And the involved finite dimensional Nichols algebras of non-diagonal type are $12$, $4m$ and $m^2$ dimensional. The left three unsolved cases are set as open problems.


title: Time-uniform central limit theory and asymptotic confidence sequences

abstract: Confidence intervals based on the central limit theorem (CLT) are a cornerstone of classical statistics. Despite being only asymptotically valid, they are ubiquitous because they permit statistical inference under weak assumptions and can often be applied to problems even when nonasymptotic inference is impossible. This paper introduces time-uniform analogues of such asymptotic confidence intervals, adding to the literature on confidence sequences (CS) -- sequences of confidence intervals that are uniformly valid over time -- which provide valid inference at arbitrary stopping times and incur no penalties for "peeking" at the data, unlike classical confidence intervals which require the sample size to be fixed in advance. Existing CSs in the literature are nonasymptotic, enjoying finite-sample guarantees but not the aforementioned broad applicability of asymptotic confidence intervals. This work provides a definition for "asymptotic CSs" and a general recipe for deriving them. Asymptotic CSs forgo nonasymptotic validity for CLT-like versatility and (asymptotic) time-uniform guarantees. While the CLT approximates the distribution of a sample average by that of a Gaussian for a fixed sample size, we use strong invariance principles (stemming from the seminal 1960s work of Strassen) to uniformly approximate the entire sample average process by an implicit Gaussian process. As an illustration, we derive asymptotic CSs for the average treatment effect in observational studies (for which nonasymptotic bounds are essentially impossible to derive even in the fixed-time regime) as well as randomized experiments, enabling causal inference in sequential environments.


title: Mid-infrared observations of the nucleus of comet P/2016 BA14 (PANSTARRS)

abstract: We present mid-infrared observations of comet P/2016 BA14 (PANSTARRS), which were obtained on UT 2016 March 21.3 at heliocentric and geocentric distances of 1.012 au and 0.026 au, respectively, approximately 30 hours before its closest approach to Earth (0.024 au) on UT 2016 March 22.6. Low-resolution ($\lambda$/$\Delta \lambda$~250) spectroscopic observations in the N-band and imaging observations with four narrow-band filters (centered at 8.8, 12.4, 17.7 and 18.8 $\mu$m) in the N- and Q-bands were obtained using the Cooled Mid-Infrared Camera and Spectrometer (COMICS) mounted on the 8.2-m Subaru telescope atop Maunakea, Hawaii. The observed spatial profiles of P/2016 BA14 at different wavelengths are consistent with a point-spread function. Owing to the close approach of the comet to the Earth, the observed thermal emission from the comet is dominated by the thermal emission from its nucleus rather than its dust coma. The observed spectral energy distribution of the nucleus at mid-infrared wavelengths is consistent with a Planck function at temperature T~350 K, with the effective diameter of P/2016 BA14 estimated as ~0.8 km (by assuming an emissivity of 0.97). The normalized emissivity spectrum of the comet exhibits absorption-like features that are not reproduced by the anhydrous minerals typically found in cometary dust coma, such as olivine and pyroxene. Instead, the spectral features suggest the presence of large grains of phyllosilicate minerals and organic materials. Thus, our observations indicate that an inactive small body covered with these processed materials is a possible end state of comets.


title: Deep Multiway Canonical Correlation Analysis for Multi-Subject EEG Normalization

abstract: The normalization of brain recordings from multiple subjects responding to the natural stimuli is one of the key challenges in auditory neuroscience. The objective of this normalization is to transform the brain data in such a way as to remove the inter-subject redundancies and to boost the component related to the stimuli. In this paper, we propose a deep learning framework to improve the correlation of electroencephalography (EEG) data recorded from multiple subjects engaged in an audio listening task. The proposed model extends the linear multi-way canonical correlation analysis (CCA) for audio-EEG analysis using an auto-encoder network with a shared encoder layer. The model is trained to optimize a combined loss involving correlation and reconstruction. The experiments are performed on EEG data collected from subjects listening to natural speech and music. In these experiments, we show that the proposed deep multi-way CCA (DMCCA) based model significantly improves the correlations over the linear multi-way CCA approach with absolute improvements of 0.08 and 0.29 in terms of the Pearson correlation values for speech and music tasks respectively.


title: Lattice reconstruction induced multiple ultra-flat bands in twisted bilayer WSe2

abstract: Moir\'e superlattices in van der Waals heterostructures provide a tunable platform to study emergent properties that are absent in the natural crystal form. Twisted bilayer transition metal dichalcogenides (TB-TMDs) can host moir\'e flat bands over a wide range of twist angles. For twist angle close to 60{\deg}, it was predicted that TB-TMDs undergo a lattice reconstruction which causes the formation of ultra-flat bands. Here, by using scanning tunneling microscopy and spectroscopy, we show the emergence of multiple ultra-flat bands in twisted bilayer WSe2 when the twist angle is larger than 57{\deg}. The bandwidth, manifested as narrow tunneling conductance peaks, is estimated less than 10meV, which is only a fraction of the estimated on-site Coulomb repulsion energy. The number of these ultra-flat bands and spatial distribution of the wavefunctions match the theoretical predictions incredibly well, strongly evidencing that the observed ultra-flat bands are induced by lattice reconstruction. Our work provides a foundation for further study of the exotic correlated phases in TB-TMDs.


title: Robust wavefront dislocations of Friedel oscillations in gapped graphene

abstract: Friedel oscillation is a well-known wave phenomenon, which represents the oscillatory response of electron waves to imperfection. By utilizing the pseudospin-momentum locking in gapless graphene, two recent experiments demonstrate the measurement of the topological Berry phase by corresponding to the unique number of wavefront dislocations in Friedel oscillations. Here, we study the Friedel oscillations in gapped graphene, in which the pseudospin-momentum locking is broken. Unusually, the wavefront dislocations do occur as that in gapless graphene, which expects the immediate verification in the current experimental condition. The number of wavefront dislocations is ascribed to the invariant pseudospin winding number in gaped and gapless graphene. This study deepens the understanding of correspondence between topological quantity and wavefront dislocations in Friedel oscillations, and implies the possibility to observe the wavefront dislocations of Friedel oscillations in intrinsic gapped two-dimensional materials, e.g., transition metal dichalcogenides.


title: Improved explicit upper bounds for the Cap Set Problem

abstract: Ellenberg and Gijswijt gave the best known asymptotic upper bound for the cardinality of subsets of $\mathbb F_q^n$ without 3-term arithmetic progressions. We improve this bound by a factor $\sqrt{n}$. In the case $q=3$, we also obtain more explicit upper bounds for the Cap Set Problem.


title: Dual Labor Market and the "Phillips Curve Puzzle"

abstract: Low inflation was once a welcome to both policy makers and the public. However, Japan's experience during the 1990's changed the consensus view on price of economists and central banks around the world. Facing deflation and zero interest bound at the same time, Bank of Japan had difficulty in conducting effective monetary policy. It made Japan's stagnation unusually prolonged. Too low inflation which annoys central banks today is translated into the "Phillips curve puzzle". In the US and Japan, in the course of recovery from the Great Recession after the 2008 global financial crisis, the unemployment rate had steadily declined to the level which was commonly regarded as lower than the natural rate or NAIRU. And yet, inflation stayed low. In this paper, we consider a minimal model of dual labor market to explore what kind of change in the economy makes the Phillips curve flat. The level of bargaining power of workers, the elasticity of the supply of labor to wage in the secondary market, and the composition of the workforce are the main factors in explaining the flattening of the Phillips curve. We argue that the changes we consider in the model, in fact, has plausibly made the Phillips curve flat in recent years.


title: Convergence of Computed Dynamic Models with Unbounded Shock

abstract: This paper studies the asymptotic convergence of computed dynamic models when the shock is unbounded. Most dynamic economic models lack a closed-form solution. As such, approximate solutions by numerical methods are utilized. Since the researcher cannot directly evaluate the exact policy function and the associated exact likelihood, it is imperative that the approximate likelihood asymptotically converges -- as well as to know the conditions of convergence -- to the exact likelihood, in order to justify and validate its usage. In this regard, Fernandez-Villaverde, Rubio-Ramirez, and Santos (2006) show convergence of the likelihood, when the shock has compact support. However, compact support implies that the shock is bounded, which is not an assumption met in most dynamic economic models, e.g., with normally distributed shocks. This paper provides theoretical justification for most dynamic models used in the literature by showing the conditions for convergence of the approximate invariant measure obtained from numerical simulations to the exact invariant measure, thus providing the conditions for convergence of the likelihood.


title: Robust High-speed Running for Quadruped Robots via Deep Reinforcement Learning

abstract: Deep reinforcement learning has emerged as a popular and powerful way to develop locomotion controllers for quadruped robots. Common approaches have largely focused on learning actions directly in joint space, or learning to modify and offset foot positions produced by trajectory generators. Both approaches typically require careful reward shaping and training for millions of time steps, and with trajectory generators introduce human bias into the resulting control policies. In this paper, we present a learning framework that leads to the natural emergence of fast and robust bounding policies for quadruped robots. The agent both selects and controls actions directly in task space to track desired velocity commands subject to environmental noise including model uncertainty and rough terrain. We observe that this framework improves sample efficiency, necessitates little reward shaping, leads to the emergence of natural gaits such as galloping and bounding, and eases the sim-to-real transfer at running speeds. Policies can be learned in only a few million time steps, even for challenging tasks of running over rough terrain with loads of over 100% of the nominal quadruped mass. Training occurs in PyBullet, and we perform a sim-to-sim transfer to Gazebo and sim-to-real transfer to the Unitree A1 hardware. For sim-to-sim, our results show the quadruped is able to run at over 4 m/s without a load, and 3.5 m/s with a 10 kg load, which is over 83% of the nominal quadruped mass. For sim-to-real, the Unitree A1 is able to bound at 2 m/s with a 5 kg load, representing 42% of the nominal quadruped mass.


title: Monte Carlo Scattering-by-Scattering Simulation of 3-Dimensional Elastic WIMP-Nucleus Scattering Events

abstract: In this paper, as the first part of the third step of our study on developing data analysis procedures for using 3-dimensional information offered by directional direct Dark Matter detection experiments in the future, we present our double-Monte Carlo "scattering-by-scattering" simulation of the 3-dimensional elastic WIMP-nucleus scattering process, which can provide 3-D velocity information (the magnitude, the direction, and the incoming/scattering time) of each incident halo WIMP as well as the recoil direction and the recoil energy of the scattered target nucleus in different celestial coordinate systems. For readers' reference, (animated) simulation plots with different WIMP masses and several frequently used target nuclei for all functionable underground laboratories can be found and downloaded on our online (interactive) demonstration webpage (http://www.tir.tw/phys/hep/dm/amidas-2d/).


title: Simulations of the Angular Recoil-Energy Distribution of WIMP-Scattered Target Nuclei for Directional Dark Matter Detection Experiments

abstract: In this paper, as the second part of the third step of our study on developing data analysis procedures for using 3-dimensional information offered by directional direct Dark Matter detection experiments in the future, we investigate the angular distributions of the recoil direction (flux) and the recoil energy of the Monte Carlo simulated WIMP-scattered target nuclei observed in different celestial coordinate systems. The "anisotropy" and the "directionality" ("annual" modulation) of the angular recoil-direction/energy distributions will be demonstrated. We will also discuss their dependences on the target nucleus and on the mass of incident halo WIMPs. For readers' reference, all simulation plots presented in this paper (and more) can be found "in animation" on our online (interactive) demonstration webpage (http://www.tir.tw/phys/hep/dm/amidas-2d/).


title: DAFAR: Defending against Adversaries by Feedback-Autoencoder Reconstruction

abstract: Deep learning has shown impressive performance on challenging perceptual tasks and has been widely used in software to provide intelligent services. However, researchers found deep neural networks vulnerable to adversarial examples. Since then, many methods are proposed to defend against adversaries in inputs, but they are either attack-dependent or shown to be ineffective with new attacks. And most of existing techniques have complicated structures or mechanisms that cause prohibitively high overhead or latency, impractical to apply on real software. We propose DAFAR, a feedback framework that allows deep learning models to detect/purify adversarial examples in high effectiveness and universality, with low area and time overhead. DAFAR has a simple structure, containing a victim model, a plug-in feedback network, and a detector. The key idea is to import the high-level features from the victim model's feature extraction layers into the feedback network to reconstruct the input. This data stream forms a feedback autoencoder. For strong attacks, it transforms the imperceptible attack on the victim model into the obvious reconstruction-error attack on the feedback autoencoder directly, which is much easier to detect; for weak attacks, the reformation process destroys the structure of adversarial examples. Experiments are conducted on MNIST and CIFAR-10 data-sets, showing that DAFAR is effective against popular and arguably most advanced attacks without losing performance on legitimate samples, with high effectiveness and universality across attack methods and parameters.


title: Strong interlayer charge transfer due to exciton condensation in an electrically-isolated GaAs quantum well bilayer

abstract: We introduce a design of electrically isolated floating bilayer GaAs quantum wells (QW) in which application of a large gating voltage controllably and highly reproducibly induces charges that remain trapped in the bilayer after removal of the gating voltage. At smaller gate voltages, the bilayer is fully electrically isolated from external electrodes by thick insulating barriers. This design permits full control of the total and differential densities of two coupled 2D electron systems. The floating bilayer design provides a unique approach for studying systems inaccessible by simple transport measurements. It also provides the ability to measure the charge transfer between the layers, even when the in-plane resistivities of the 2D systems diverge. We measure the capacitance and inter-layer tunneling spectra of the QW bilayer with independent control of the top and bottom layer electron densities. Our measurements display strongly enhanced inter-layer tunneling current at the total filling factor of 1, a signature of exciton condensation of a strongly interlayer-correlated bilayer system. With fully tunable densities of individual layers, the floating bilayer QW system provides a versatile platform to access previously unavailable information on the quantum phases in electron bilayer systems.


title: The Nichols algebra $\mathfrak{B}(V_{abe})$ and a class of combinatorial numbers

abstract: We investigate the Nichols algebra $\mathfrak{B}(V_{abe})$ which are from the Yetter-Drinfeld category of Suzuki algebras. The $4n$ and $n^2$ dimensional Nichols algebras, first appeared in \cite{Andruskiewitsch2018}, are obtained again via a different method. And the connection between the Nichols algebra $\mathfrak{B}(V_{abe})$ and a class of combinatorial numbers on the subgroups of symmetric groups is established.


title: Active$^2$ Learning: Actively reducing redundancies in Active Learning methods for Sequence Tagging and Machine Translation

abstract: While deep learning is a powerful tool for natural language processing (NLP) problems, successful solutions to these problems rely heavily on large amounts of annotated samples. However, manually annotating data is expensive and time-consuming. Active Learning (AL) strategies reduce the need for huge volumes of labeled data by iteratively selecting a small number of examples for manual annotation based on their estimated utility in training the given model. In this paper, we argue that since AL strategies choose examples independently, they may potentially select similar examples, all of which may not contribute significantly to the learning process. Our proposed approach, Active$\mathbf{^2}$ Learning (A$\mathbf{^2}$L), actively adapts to the deep learning model being trained to eliminate further such redundant examples chosen by an AL strategy. We show that A$\mathbf{^2}$L is widely applicable by using it in conjunction with several different AL strategies and NLP tasks. We empirically demonstrate that the proposed approach is further able to reduce the data requirements of state-of-the-art AL strategies by an absolute percentage reduction of $\approx\mathbf{3-25\%}$ on multiple NLP tasks while achieving the same performance with no additional computation overhead.


title: \'Etale triviality of finite equivariant vector bundles

abstract: Let H be a complex Lie group acting holomorphically on a complex analytic space X such that the restriction to X_{\mathrm{red}} of every H-invariant regular function on X is constant. We prove that an H-equivariant holomorphic vector bundle E over X is $H$-finite, meaning f_1(E)= f_2(E) as H-equivariant bundles for two distinct polynomials f_1 and f_2 whose coefficients are nonnegative integers, if and only if the pullback of E along some H-equivariant finite \'etale covering of X is trivial as an H-equivariant bundle.


title: Preventing Extreme Polarization of Political Attitudes

abstract: Extreme polarization can undermine democracy by making compromise impossible and transforming politics into a zero-sum game. Ideological polarization - the extent to which political views are widely dispersed - is already strong among elites, but less so among the general public (McCarty, 2019, p. 50-68). Strong mutual distrust and hostility between Democrats and Republicans in the U.S., combined with the elites' already strong ideological polarization, could lead to increasing ideological polarization among the public. The paper addresses two questions: (1) Is there a level of ideological polarization above which polarization feeds upon itself to become a runaway process? (2) If so, what policy interventions could prevent such dangerous positive feedback loops? To explore these questions, we present an agent-based model of ideological polarization that differentiates between the tendency for two actors to interact (exposure) and how they respond when interactions occur, positing that interaction between similar actors reduces their difference while interaction between dissimilar actors increases their difference. Our analysis explores the effects on polarization of different levels of tolerance to other views, responsiveness to other views, exposure to dissimilar actors, multiple ideological dimensions, economic self-interest, and external shocks. The results suggest strategies for preventing, or at least slowing, the development of extreme polarization.


title: The complex Ginzburg-Landau equation perturbed by a force localised both in physical and Fourier spaces

abstract: In the paper arXiv:1802.03250, a criterion for exponential mixing is established for a class of random dynamical systems. In that paper, the criterion is applied to PDEs perturbed by a noise localised in the Fourier space. In the present paper, we show that, in the case of the complex Ginzburg-Landau (CGL) equation, that criterion can be used to consider even more degenerate noise that is localised both in physical and Fourier spaces. This is achieved by checking that the linearised equation is almost surely approximately controllable. We also study the problem of controllability of the nonlinear CGL equation. Using Agrachev-Sarychev type arguments, we prove an approximate controllability property in the case of a control force which is again localised in physical and Fourier spaces.


title: Nesterov Acceleration for Equality-Constrained Convex Optimization via Continuously Differentiable Penalty Functions

abstract: We propose a framework to use Nesterov's accelerated method for constrained convex optimization problems. Our approach consists of first reformulating the original problem as an unconstrained optimization problem using a continuously differentiable exact penalty function. This reformulation is based on replacing the Lagrange multipliers in the augmented Lagrangian of the original problem by Lagrange multiplier functions. The expressions of these Lagrange multiplier functions, which depend upon the gradients of the objective function and the constraints, can make the unconstrained penalty function non-convex in general even if the original problem is convex. We establish sufficient conditions on the objective function and the constraints of the original problem under which the unconstrained penalty function is convex. This enables us to use Nesterov's accelerated gradient method for unconstrained convex optimization and achieve a guaranteed rate of convergence which is better than the state-of-the-art first-order algorithms for constrained convex optimization. Simulations illustrate our results.


title: Read Like Humans: Autonomous, Bidirectional and Iterative Language Modeling for Scene Text Recognition

abstract: Linguistic knowledge is of great benefit to scene text recognition. However, how to effectively model linguistic rules in end-to-end deep networks remains a research challenge. In this paper, we argue that the limited capacity of language models comes from: 1) implicitly language modeling; 2) unidirectional feature representation; and 3) language model with noise input. Correspondingly, we propose an autonomous, bidirectional and iterative ABINet for scene text recognition. Firstly, the autonomous suggests to block gradient flow between vision and language models to enforce explicitly language modeling. Secondly, a novel bidirectional cloze network (BCN) as the language model is proposed based on bidirectional feature representation. Thirdly, we propose an execution manner of iterative correction for language model which can effectively alleviate the impact of noise input. Additionally, based on the ensemble of iterative predictions, we propose a self-training method which can learn from unlabeled images effectively. Extensive experiments indicate that ABINet has superiority on low-quality images and achieves state-of-the-art results on several mainstream benchmarks. Besides, the ABINet trained with ensemble self-training shows promising improvement in realizing human-level recognition. Code is available at https://github.com/FangShancheng/ABINet.


title: Measurements of the branching fractions of the semileptonic decays $\Xi_{c}^{0} \to \Xi^{-} \ell^{+} \nu_{\ell}$ and the asymmetry parameter of $\Xi_{c}^{0} \to \Xi^{-} \pi^{+}$

abstract: Using data samples of 89.5 and 711 fb$^{-1}$ recorded at energies of $\sqrt{s}=10.52$ and $10.58$ GeV, respectively, with the Belle detector at the KEKB $e^+e^-$ collider, we report measurements of branching fractions of semileptonic decays $\Xi_{c}^{0} \to \Xi^{-} \ell^{+} \nu_{\ell}$ ($\ell=e$ or $\mu$) and the $CP$-asymmetry parameter of $\Xi_{c}^{0} \to \Xi^{-} \pi^{+}$ decay. The branching fractions are measured to be ${\cal B}(\Xi_{c}^{0} \to \Xi^{-} e^{+} \nu_{e})=(1.31 \pm 0.04 \pm 0.07 \pm 0.38)\%$ and ${\cal B}(\Xi_{c}^{0} \to \Xi^{-} \mu^{+} \nu_{\mu})=(1.27 \pm 0.06 \pm 0.10 \pm 0.37)\%$, and the decay parameter $\alpha_{\Xi\pi}$ is measured to be $0.63 \pm 0.03 \pm 0.01$ with much improved precision compared to the current world average. The corresponding ratio ${\cal B}(\Xi_{c}^{0} \to \Xi^{-} e^{+} \nu_{e})/{\cal B}(\Xi_{c}^{0} \to \Xi^{-} \mu^{+} \nu_{\mu})$ is $1.03 \pm 0.05\pm 0.07$, which is consistent with the expectation of lepton flavor universality. The first measured asymmetry parameter ${\cal A}_{CP} = (\alpha_{\Xi^{-}\pi^{+}} + \alpha_{\bar{\Xi}^{+}\pi^{-}})/(\alpha_{\Xi^{-}\pi^{+}} - \alpha_{\bar{\Xi}^{+}\pi^{-}}) = 0.024 \pm 0.052 \pm 0.014$ is found to be consistent with zero. The first and the second uncertainties above are statistical and systematic, respectively, while the third ones arise due to the uncertainty of the $\Xi_{c}^{0} \to \Xi^{-} \pi^+$ branching fraction.


title: On Synthetic Absorption Line Profiles of Thermally Driven Winds from Active Galactic Nuclei

abstract: The warm absorbers observed in more than half of all nearby active galactic nuclei (AGN) are tracers of ionized outflows located at parsec scale distances from the central engine. If the smallest inferred ionization parameters correspond to plasma at a few $10^4$~K, then the gas undergoes a transition from being bound to unbound provided it is further heated to $\sim 10^6$~K at larger radii. Dannen et al. recently discovered that under these circumstances, thermally driven wind solutions are unsteady and even show very dense clumps due to thermal instability. To explore the observational consequences of these new wind solutions, we compute line profiles based on the one-dimensional simulations of Dannen et al. We show how the line profiles from even a simple steady state wind solution depend on the ionization energy (IE) of absorbing ions, which is a reflection of the wind ionization stratification. To organize the diversity of the line shapes, we group them into four categories: weak Gaussians, saturated boxy profiles with and without an extended blue wing, and broad weak profiles. The lines with profiles in the last two categories are produced by ions with the highest IE that probe the fastest regions. Their maximum blueshifts agree with the highest flow velocities in thermally unstable models, both steady state and clumpy versions. In contrast, the maximum blueshifts of the most high IE lines in thermally stable models can be less than half of the actual solution velocities. Clumpy solutions can additionally imprint distinguishable absorption troughs at widely separated velocities.