title: DA-VSR: Domain Adaptable Volumetric Super-Resolution For Medical Images

abstract: Medical image super-resolution (SR) is an active research area that has many potential applications, including reducing scan time, bettering visual understanding, increasing robustness in downstream tasks, etc. However, applying deep-learning-based SR approaches for clinical applications often encounters issues of domain inconsistency, as the test data may be acquired by different machines or on different organs. In this work, we present a novel algorithm called domain adaptable volumetric super-resolution (DA-VSR) to better bridge the domain inconsistency gap. DA-VSR uses a unified feature extraction backbone and a series of network heads to improve image quality over different planes. Furthermore, DA-VSR leverages the in-plane and through-plane resolution differences on the test data to achieve a self-learned domain adaptation. As such, DA-VSR combines the advantages of a strong feature generator learned through supervised training and the ability to tune to the idiosyncrasies of the test volumes through unsupervised learning. Through experiments, we demonstrate that DA-VSR significantly improves super-resolution quality across numerous datasets of different domains, thereby taking a further step toward real clinical applications.


title: Boosting Adversarial Robustness From The Perspective of Effective Margin Regularization

abstract: The adversarial vulnerability of deep neural networks (DNNs) has been actively investigated in the past several years. This paper investigates the scale-variant property of cross-entropy loss, which is the most commonly used loss function in classification tasks, and its impact on the effective margin and adversarial robustness of deep neural networks. Since the loss function is not invariant to logit scaling, increasing the effective weight norm will make the loss approach zero and its gradient vanish while the effective margin is not adequately maximized. On typical DNNs, we demonstrate that, if not properly regularized, the standard training does not learn large effective margins and leads to adversarial vulnerability. To maximize the effective margins and learn a robust DNN, we propose to regularize the effective weight norm during training. Our empirical study on feedforward DNNs demonstrates that the proposed effective margin regularization (EMR) learns large effective margins and boosts the adversarial robustness in both standard and adversarial training. On large-scale models, we show that EMR outperforms basic adversarial training, TRADES and two regularization baselines with substantial improvement. Moreover, when combined with several strong adversarial defense methods (MART and MAIL), our EMR further boosts the robustness.


title: Exploring CNN-based models for image's aesthetic score prediction with using ensemble

abstract: In this paper, we proposed a framework of constructing two types of the automatic image aesthetics assessment models with different CNN architectures and improving the performance of the image's aesthetic score prediction by the ensemble. Moreover, the attention regions of the models to the images are extracted to analyze the consistency with the subjects in the images. The experimental results verify that the proposed method is effective for improving the AS prediction. Moreover, it is found that the AS classification models trained on XiheAA dataset seem to learn the latent photography principles, although it can't be said that they learn the aesthetic sense.


title: Extension dimensions: derived equivalences and stable equivalences

abstract: We show that the difference of the extension dimensions of two derived equivalent algebras is bounded above by the minimal length of a tilting complex associated with a derived equivalence, and that the extension dimension is an invariant under the stable equivalence. In addition, we provide two sufficient conditions such that the extension dimension is an invariant under particular derived equivalences.


title: Current injection and voltage insertion attacks against the VMG-KLJN secure key exchanger

abstract: In this paper, the vulnerability of the Vadai, Mingesz and Gingl (VMG)- Kirchhoff-Law-Johnson-Noise (KLJN) Key Exchanger (Nature, Science Report 5 (2015) 13653) against two active attacks is demonstrated. The security vulnerability arises from the fact that the effective driving impedances are different between the HL and LH cases for the VMG-KLJN scheme; whereas for the ideal KLJN scheme they are same. Two defense schemes are shown against these attacks but each of them can protect against only one of the attack types; but not against the two attacks simultaneously. The theoretical results are confirmed by computer simulations.


title: Universal cover-time distribution of heterogeneous random walks

abstract: The cover-time problem, i.e., time to visit every site in a system, is one of the key issues of random walks with wide applications in natural, social, and engineered systems. Addressing the full distribution of cover times for random walk on complex structures has been a long-standing challenge and has attracted persistent efforts. Yet, the known results are essentially limited to homogeneous systems, where different sites are on an equal footing and have identical or close mean first-passage times, such as random walks on a torus. In contrast, realistic random walks are prevailingly heterogeneous with diversified mean first-passage times. Does a universal distribution still exist? Here, by considering the most general situations, we uncover a generalized rescaling relation for the cover time, exploiting the diversified mean first-passage times that have not been accounted for before. This allows us to concretely establish a universal distribution of the rescaled cover times for heterogeneous random walks, which turns out to be the Gumbel universality class that is ubiquitous for a large family of extreme value statistics. Our analysis is based on the transfer matrix framework, which is generic that besides heterogeneity, it is also robust against biased protocols, directed links, and self-connecting loops. The finding is corroborated with extensive numerical simulations of diverse heterogeneous non-compact random walks on both model and realistic topological structures. Our new technical ingredient may be exploited for other extreme value or ergodicity problems with nonidentical distributions.


title: Shear Viscosity in Two-Dimensional Dipole Systems

abstract: The results of modeling shear flows in classical two-dimensional dipole systems are presented. We used the method of non-equilibrium molecular dynamics to calculate the viscosity at various shear rates. The coefficients of shear viscosity are given in the limit of low shear rates for various regimes of interparticle correlation from a weakly correlated gaseous state to a strongly non-ideal liquid state near the crystallization point. The effect of shear thinning in 2D dipole systems is reported at small values of the coupling parameter. In addition, it is shown that dipole systems can become both less and more viscous due to the presence of a screening medium, depending on the degree of interparticle correlation. The optimal simulation parameters are discussed within the framework of the method of nonequilibrium molecular dynamics for determining the shear viscosity of two-dimensional dipole systems. Moreover, we present a simple fitting curve which provides universal scaling law for both bare dipole-dipole interaction and screened dipole-dipole interaction.


title: Persistence Diagram Bundles: A Multidimensional Generalization of Vineyards

abstract: I introduce the concept of a persistence diagram (PD) bundle, which is the space of PDs for a fibered filtration function (a set $\{f_p: \mathcal{K}^p \to \mathbb{R}\}_{p \in B}$ of filtrations that is parameterized by a topological space $B$). Special cases include vineyards, the persistent homology transform, and fibered barcodes for multiparameter persistence modules. I prove that if $B$ is a smooth compact manifold, then for a generic fibered filtration function, $B$ is stratified such that within each stratum $Y \subseteq B$, there is a single PD "template" (a list of "birth" and "death" simplices) that can be used to obtain the PD for the filtration $f_p$ for any $p \in Y$. If $B$ is compact, then there are finitely many strata, so the PD bundle for a generic fibered filtration on $B$ is determined by the persistent homology at finitely many points in $B$. I also show that not every local section can be extended to a global section (a continuous map $s$ from $B$ to the total space $E$ of PDs such that $s(p) \in \textrm{PD}(f_p)$ for all $p \in B$). Consequently, a PD bundle is not necessarily the union of "vines" $\gamma: B \to E$; this is unlike a vineyard. When there is a stratification as described above, I construct a cellular sheaf that stores sufficient data to construct sections and determine whether a given local section can be extended to a global section.


title: Human-AI Coordination via Human-Regularized Search and Learning

abstract: We consider the problem of making AI agents that collaborate well with humans in partially observable fully cooperative environments given datasets of human behavior. Inspired by piKL, a human-data-regularized search method that improves upon a behavioral cloning policy without diverging far away from it, we develop a three-step algorithm that achieve strong performance in coordinating with real humans in the Hanabi benchmark. We first use a regularized search algorithm and behavioral cloning to produce a better human model that captures diverse skill levels. Then, we integrate the policy regularization idea into reinforcement learning to train a human-like best response to the human model. Finally, we apply regularized search on top of the best response policy at test time to handle out-of-distribution challenges when playing with humans. We evaluate our method in two large scale experiments with humans. First, we show that our method outperforms experts when playing with a group of diverse human players in ad-hoc teams. Second, we show that our method beats a vanilla best response to behavioral cloning baseline by having experts play repeatedly with the two agents.


title: Tackling Instance-Dependent Label Noise with Dynamic Distribution Calibration

abstract: Instance-dependent label noise is realistic but rather challenging, where the label-corruption process depends on instances directly. It causes a severe distribution shift between the distributions of training and test data, which impairs the generalization of trained models. Prior works put great effort into tackling the issue. Unfortunately, these works always highly rely on strong assumptions or remain heuristic without theoretical guarantees. In this paper, to address the distribution shift in learning with instance-dependent label noise, a dynamic distribution-calibration strategy is adopted. Specifically, we hypothesize that, before training data are corrupted by label noise, each class conforms to a multivariate Gaussian distribution at the feature level. Label noise produces outliers to shift the Gaussian distribution. During training, to calibrate the shifted distribution, we propose two methods based on the mean and covariance of multivariate Gaussian distribution respectively. The mean-based method works in a recursive dimension-reduction manner for robust mean estimation, which is theoretically guaranteed to train a high-quality model against label noise. The covariance-based method works in a distribution disturbance manner, which is experimentally verified to improve the model robustness. We demonstrate the utility and effectiveness of our methods on datasets with synthetic label noise and real-world unknown noise.


title: The Dynamics of Drop Breakup in Breaking Waves

abstract: Breaking surface waves generate drops of a broad range of sizes that have a significant influence on regional and global climates, as well as the identification of ship movements. Characterizing these phenomena requires a fundamental understanding of the underlying mechanisms behind drop production. The interscale nature of these mechanisms also influences the development of models that enable cost-effective computation of large-scale waves. Interscale locality implies the universality of small scales and the suitability of generic subgrid-scale (SGS) models, while interscale nonlocality points to the potential dependence of the small scales on larger-scale geometry configurations and the corresponding need for tailored SGS models instead. A recently developed analysis toolkit combining theoretical population balance models, multiphase numerical simulations, and structure-tracking algorithms is used to probe the nature of drop production and its corresponding interscale mass-transfer characteristics above the surface of breaking waves. The results from the application of this toolkit suggest that while drop breakup is a somewhat scale-nonlocal process, its interscale transfer signature suggests that it is likely capillary-dominated and thus sensitive not to the specific nature of large-scale wave breaking, but rather to the specific geometry of the parent drops.

categories: physics.flu-dyn physics.ao-ph physics.comp-ph stat.AP


title: On fast greedy block Kaczmarz methods for solving large consistent linear systems

abstract: A class of fast greedy block Kaczmarz methods combined with general greedy strategy and average technique are proposed for solving large consistent linear systems. Theoretical analysis of the convergence of the proposed method is given in detail. Numerical experiments show that the proposed methods are efficient and faster than the existing methods.


title: Multi-Object Navigation with dynamically learned neural implicit representations

abstract: Understanding and mapping a new environment are core abilities of any autonomously navigating agent. While classical robotics usually estimates maps in a stand-alone manner with SLAM variants, which maintain a topological or metric representation, end-to-end learning of navigation keeps some form of memory in a neural network. Networks are typically imbued with inductive biases, which can range from vectorial representations to birds-eye metric tensors or topological structures. In this work, we propose to structure neural networks with two neural implicit representations, which are learned dynamically during each episode and map the content of the scene: (i) the Semantic Finder predicts the position of a previously seen queried object; (ii) the Occupancy and Exploration Implicit Representation encapsulates information about explored area and obstacles, and is queried with a novel global read mechanism which directly maps from function space to a usable embedding space. Both representations are leveraged by an agent trained with Reinforcement Learning (RL) and learned online during each episode. We evaluate the agent on Multi-Object Navigation and show the high impact of using neural implicit representations as a memory source.


title: ACRNet: Attention Cube Regression Network for Multi-view Real-time 3D Human Pose Estimation in Telemedicine

abstract: Human pose estimation (HPE) for 3D skeleton reconstruction in telemedicine has long received attention. Although the development of deep learning has made HPE methods in telemedicine simpler and easier to use, addressing low accuracy and high latency remains a big challenge. In this paper, we propose a novel multi-view Attention Cube Regression Network (ACRNet), which regresses the 3D position of joints in real time by aggregating informative attention points on each cube surface. More specially, a cube whose each surface contains uniformly distributed attention points with specific coordinate values is first created to wrap the target from the main view. Then, our network regresses the 3D position of each joint by summing and averaging the coordinates of attention points on each surface after being weighted. To verify our method, we first tested ACRNet on the open-source ITOP dataset; meanwhile, we collected a new multi-view upper body movement dataset (UBM) on the trunk support trainer (TruST) to validate the capability of our model in real rehabilitation scenarios. Experimental results demonstrate the superiority of ACRNet compared with other state-of-the-art methods. We also validate the efficacy of each module in ACRNet. Furthermore, Our work analyzes the performance of ACRNet under the medical monitoring indicator. Because of the high accuracy and running speed, our model is suitable for real-time telemedicine settings. The source code is available at https://github.com/BoceHu/ACRNet


title: The Type II-P Supernova 2019mhm and Constraints on Its Progenitor System

abstract: We present pre- and post-explosion observations of the Type II-P supernova (SN~II-P) 2019mhm located in NGC~6753. Based on optical spectroscopy and photometry, we show that SN\,2019mhm exhibits broad lines of hydrogen with a velocity of $-8500\pm200$~km~s$^{-1}$ and a $111\pm2$~day extended plateau in its luminosity, typical of the Type II-P subclass. We also fit its late-time bolometric light curve and infer that it initially produced a ${}^{56}$Ni mass of $1.3 \times 10^{-2}$~M$_{\odot} \pm 5.5 \times 10^{-4}$~$M_\odot$. Using imaging from the Wide Field Planetary Camera 2 on the {\it Hubble Space Telescope} obtained 19~years before explosion, we aligned to a post-explosion Wide Field Camera 3 image and demonstrate that there is no detected counterpart to the SN to a limit of $>$24.53~mag in F814W, corresponding to an absolute magnitude limit of $M_{\rm F814W} < -7.7$~mag. Comparing to massive-star evolutionary tracks, we determine that the progenitor star had a maximum zero-age main sequence mass $<$17.5~M$_{\odot}$, consistent with other SN~II-P progenitor stars. SN\,2019mhm can be added to the growing population of SNe~II-P with both direct constraints on the brightness of their progenitor stars and well-observed SN properties.


title: Axiomatic field theory and Hida-Colombeau algebras

abstract: An axiomatic quantum field theory applied to the self-interacting boson field is realised in terms of generalised operators that allows us to form products and take derivatives of the fields in simple and mathematically rigorous ways. Various spaces are explored for representation of these operators with this exploration culminating with a Hida-Colombeau algebra. Rigorous well defned Hamiltonians are written using ordinary products of interacting scalar fields that are represented as generalised operators on simplified Hida-Colombeau algebras.


title: Quantum Fibrations: quantum computation on an arbitrary topological space

abstract: Using von Neumann algebras, we extend the theory of quantum computation on a graph to a theory of computation on an arbitrary topological space.

categories: math.OA hep-lat hep-th math-ph math.MP quant-ph


title: Baby universes in 2d and 4d theories of quantum gravity

abstract: The validity of the Coleman mechanism, which automatically tunes the fundamental constants, is examined in two-dimensional and four-dimensional quantum gravity theories. First, we consider two-dimensional Euclidean quantum gravity on orientable closed manifolds coupled to conformal matter of central charge $c \leq1$. The proper time Hamiltonian of this system is known to be written as a field theory of noncritical strings, which can also be viewed as a third quantization in two dimensions. By directly counting the number of random surfaces with various topologies, we find that the contribution of the baby universes is too small to realize the Coleman mechanism. Next, we consider four-dimensional Lorentzian gravity. Based on the difference between the creation of the mother universe from nothing and the annihilation of the mother universe into nothing, we introduce a non-Hermitian effective Hamiltonian for the multiverse. We show that Coleman's idea is satisfied in this model and that the cosmological constant is tuned to be nearly zero. Potential implications for phenomenology are also discussed.


title: X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360$^{\circ} $ Insufficient RGB-D Views

abstract: Neural Radiance Fields (NeRFs), despite their outstanding performance on novel view synthesis, often need dense input views. Many papers train one model for each scene respectively and few of them explore incorporating multi-modal data into this problem. In this paper, we focus on a rarely discussed but important setting: can we train one model that can represent multiple scenes, with 360$^\circ $ insufficient views and RGB-D images? We refer insufficient views to few extremely sparse and almost non-overlapping views. To deal with it, X-NeRF, a fully explicit approach which learns a general scene completion process instead of a coordinate-based mapping, is proposed. Given a few insufficient RGB-D input views, X-NeRF first transforms them to a sparse point cloud tensor and then applies a 3D sparse generative Convolutional Neural Network (CNN) to complete it to an explicit radiance field whose volumetric rendering can be conducted fast without running networks during inference. To avoid overfitting, besides common rendering loss, we apply perceptual loss as well as view augmentation through random rotation on point clouds. The proposed methodology significantly out-performs previous implicit methods in our setting, indicating the great potential of proposed problem and approach. Codes and data are available at https://github.com/HaoyiZhu/XNeRF.


title: Classification based credit risk analysis: The case of Lending Club

abstract: In this paper, we performs a credit risk analysis, on the data of past loan applicants of a company named Lending Club. The calculation required the use of exploratory data analysis and machine learning classification algorithms, namely, Logistic Regression and Random Forest Algorithm. We further used the calculated probability of default to design a credit derivative based on the idea of a Credit Default Swap, to hedge against an event of default. The results on the test set are presented using various performance measures.


title: Controlling nonlinear rogue wave formation using the coherence length of phase noise

abstract: Weak phase noise present on an optical field can be amplified by a self-focusing nonlinearity and form intense "rogue wave" features. Here, we study the effect of the coherence length (or grain size) of this phase noise on the likelihood of rogue wave formation in the presence of a self-focusing nonlinearity. We show that while the likelihood of rogue wave formation increases with laser power when the coherence length is only slightly smaller that the beam diameter, the likelihood is minimally affected by change in laser power when the coherence length is significantly smaller than the beam diameter. Our study provides insight into the interaction of nonlinearity with phase instabilities on a field, and could be useful in applications such as reducing the effect of turbulence-induced breakup of intense laser beams, and developing radiance limiters to reduce the focusable power in a beam.


title: Commitments to Quantum States

abstract: What does it mean to commit to a quantum state? In this work, we propose a simple answer: a commitment to quantum messages is binding if, after the commit phase, the committed state is hidden from the sender's view. We accompany this new definition with several instantiations. We build the first non-interactive succinct quantum state commitments, which can be seen as an analogue of collision-resistant hashing for quantum messages. We also show that hiding quantum state commitments (QSCs) are implied by any commitment scheme for classical messages. All of our constructions can be based on quantum-cryptographic assumptions that are implied by but are potentially weaker than one-way functions. Commitments to quantum states open the door to many new cryptographic possibilities. Our flagship application of a succinct QSC is a quantum-communication version of Kilian's succinct arguments for any language that has quantum PCPs with constant error and polylogarithmic locality. Plugging in the PCP theorem, this yields succinct arguments for NP under significantly weaker assumptions than required classically; moreover, if the quantum PCP conjecture holds, this extends to QMA. At the heart of our security proof is a new rewinding technique for extracting quantum information.


title: Dynamical fluctuations of a tracer coupled to active and passive particles

abstract: We study the induced dynamics of an inertial tracer particle elastically coupled to passive or active Brownian particles. We integrate out the environment degrees of freedom to obtain generalized Langevin equation for the tracer dynamics in both cases. In particular, we find the exact form of the dissipation kernel and effective noise experienced by the tracer and compare it with the phenomenological modeling of active baths used in previous studies. We show that the second fluctuation-dissipation relation (FDR) does not hold at early times for both cases. However, at finite times, the tracer dynamics violate (obeys) the FDR for the active (passive) environment. We calculate the linear response formulas in this regime for both cases and show that the passive medium satisfies an equilibrium fluctuation response relation (FRR), while the active medium does not -- we quantify the extent of this violation explicitly. We show that though the active medium generally renders a nonequilibrium description of the tracer, an effective equilibrium picture emerges asymptotically in the small activity limit of the medium. We also calculate the mean squared velocity and mean squared displacement of the tracer and report how they vary with time.


title: Tracer-Field Cross-Correlations with $k$-Nearest Neighbor Distributions

abstract: In astronomy and cosmology, significant effort is devoted to characterizing and understanding spatial cross-correlations between points - e.g. galaxy positions, high energy neutrino arrival directions, X-ray and AGN sources, and continuous field - e.g. weak lensing and Cosmic Microwave Background (CMB) maps. Recently, we introduced the $k$-nearest neighbor formalism to better characterize the clustering of discrete (point) datasets. Here we extend it to the point-field cross-correlation analysis. It combines $k$NN measurements of the point data set with measurements of the field smoothed on many scales. The resulting statistics are sensitive to all orders in the joint clustering of the points and the field. We demonstrate that this approach, unlike the 2-pt cross-correlation, can measure the statistical dependence of two datasets even when there are no linear (Gaussian) correlations. We further demonstrate that this framework is far more effective than the two-point function in detecting cross-correlations when the continuous field is contaminated by high levels of noise. For a particularly high level of noise, the cross-correlations between halos and the underlying matter field in a cosmological simulation, between $10h^{-1}{\rm Mpc}$ and $30h^{-1}{\rm Mpc}$, is detected at $>5\sigma$ significance using the technique presented here, when the two-point cross-correlation significance is $\sim 1\sigma$. Finally, we show that the $k$NN cross-correlations of halos and the matter field can be well-modeled on quasilinear scales by the Hybrid Effective Field Theory (HEFT) framework, with the same set of bias parameters as are used for the two-point cross-correlations. The substantial improvement in the statistical power of detecting cross-correlations with this method makes it a promising tool for various cosmological applications.


title: On the classification of entire solutions to the critical p-Laplace equation

abstract: Under the assumption of finite energy, positive solutions to the critical p-Laplace equation in $\mathbb{R}^n$ for $1< p<n$ have been classified completely by moving plane method. In this paper, the author provide a new approach to obtain the same classification results for $\frac{n+1}{3}\leq p<n$, without any further assumptions.


title: A Design Method of Distributed Algorithms via Discrete-time Blended Dynamics Theorem

abstract: We develop a discrete-time version of the blended dynamics theorem for the use of designing distributed computation algorithms. The blended dynamics theorem enables to predict the behavior of heterogeneous multi-agent systems. Therefore, once we get a blended dynamics for a particular computational task, design idea of node dynamics for individual heterogeneous agents can easily occur. In the continuous-time case, prediction by blended dynamics was enabled by high coupling gain among neighboring agents. In the discrete-time case, we propose an equivalent action, which we call multi-step coupling in this paper. Compared to the continuous-time case, the blended dynamics can have more variety depending on the coupling matrix. This benefit is demonstrated with three applications; distributed estimation of network size, distributed computation of the PageRank, and distributed computation of the degree sequence of a graph, which correspond to the coupling by doubly-stochastic, column-stochastic, and row-stochastic matrices, respectively.


title: Time-aware topic identification in social media with pre-trained language models: A case study of electric vehicles

abstract: Recent extensively competitive business environment makes companies to keep their eyes on social media, as there is a growing recognition over customer languages (e.g., needs, interests, and complaints) as source of future opportunities. This research avenue analysing social media data has received much attention in academia, but their utilities are limited as most of methods provide retrospective results. Moreover, the increasing number of customer-generated contents and rapidly varying topics have made the necessity of time-aware topic evolution analyses. Recently, several researchers have showed the applicability of pre-trained semantic language models to social media as an input feature, but leaving limitations in understanding evolving topics. In this study, we propose a time-aware topic identification approach with pre-trained language models. The proposed approach consists of two stages: the dynamics-focused function for tracking time-varying topics with language models and the emergence-scoring function to examine future promising topics. Here we apply the proposed approach to reddit data on electric vehicles, and our findings highlight the feasibility of capturing emerging customer topics from voluminous social media in a time-aware manner.


title: Mixture of Attention Heads: Selecting Attention Heads Per Token

abstract: Mixture-of-Experts (MoE) networks have been proposed as an efficient way to scale up model capacity and implement conditional computing. However, the study of MoE components mostly focused on the feedforward layer in Transformer architecture. This paper proposes the Mixture of Attention Heads (MoA), a new architecture that combines multi-head attention with the MoE mechanism. MoA includes a set of attention heads that each has its own set of parameters. Given an input, a router dynamically selects a subset of $k$ attention heads per token. This conditional computation schema allows MoA to achieve stronger performance than the standard multi-head attention layer. Furthermore, the sparsely gated MoA can easily scale up the number of attention heads and the number of parameters while preserving computational efficiency. In addition to the performance improvements, MoA also automatically differentiates heads' utilities, providing a new perspective to discuss the model's interpretability. We conducted experiments on several important tasks, including Machine Translation and Masked Language Modeling. Experiments have shown promising results on several tasks against strong baselines that involve large and very deep models.


title: Retrieval Augmentation for T5 Re-ranker using External Sources

abstract: Retrieval augmentation has shown promising improvements in different tasks. However, whether such augmentation can assist a large language model based re-ranker remains unclear. We investigate how to augment T5-based re-rankers using high-quality information retrieved from two external corpora -- a commercial web search engine and Wikipedia. We empirically demonstrate how retrieval augmentation can substantially improve the effectiveness of T5-based re-rankers for both in-domain and zero-shot out-of-domain re-ranking tasks.


title: CSS: Combining Self-training and Self-supervised Learning for Few-shot Dialogue State Tracking

abstract: Few-shot dialogue state tracking (DST) is a realistic problem that trains the DST model with limited labeled data. Existing few-shot methods mainly transfer knowledge learned from external labeled dialogue data (e.g., from question answering, dialogue summarization, machine reading comprehension tasks, etc.) into DST, whereas collecting a large amount of external labeled data is laborious, and the external data may not effectively contribute to the DST-specific task. In this paper, we propose a few-shot DST framework called CSS, which Combines Self-training and Self-supervised learning methods. The unlabeled data of the DST task is incorporated into the self-training iterations, where the pseudo labels are predicted by a DST model trained on limited labeled data in advance. Besides, a contrastive self-supervised method is used to learn better representations, where the data is augmented by the dropout operation to train the model. Experimental results on the MultiWOZ dataset show that our proposed CSS achieves competitive performance in several few-shot scenarios.


title: Markup-to-Image Diffusion Models with Scheduled Sampling

abstract: Building on recent advances in image generation, we present a fully data-driven approach to rendering markup into images. The approach is based on diffusion models, which parameterize the distribution of data using a sequence of denoising operations on top of a Gaussian noise distribution. We view the diffusion denoising process as a sequential decision making process, and show that it exhibits compounding errors similar to exposure bias issues in imitation learning problems. To mitigate these issues, we adapt the scheduled sampling algorithm to diffusion training. We conduct experiments on four markup datasets: mathematical formulas (LaTeX), table layouts (HTML), sheet music (LilyPond), and molecular images (SMILES). These experiments each verify the effectiveness of the diffusion process and the use of scheduled sampling to fix generation issues. These results also show that the markup-to-image task presents a useful controlled compositional setting for diagnosing and analyzing generative image models.


title: DiffRoll: Diffusion-based Generative Music Transcription with Unsupervised Pretraining Capability

abstract: In this paper we propose a novel generative approach, DiffRoll, to tackle automatic music transcription (AMT). Instead of treating AMT as a discriminative task in which the model is trained to convert spectrograms into piano rolls, we think of it as a conditional generative task where we train our model to generate realistic looking piano rolls from pure Gaussian noise conditioned on spectrograms. This new AMT formulation enables DiffRoll to transcribe, generate and even inpaint music. Due to the classifier-free nature, DiffRoll is also able to be trained on unpaired datasets where only piano rolls are available. Our experiments show that DiffRoll outperforms its discriminative counterpart by 19 percentage points (ppt.) and our ablation studies also indicate that it outperforms similar existing methods by 4.8 ppt. Source code and demonstration are available https://sony.github.io/DiffRoll/.


title: Renewable Learning for Multiplicative Regression with Streaming Datasets

abstract: When large amounts of data continuously arrive in streams, online updating is an effective way to reduce storage and computational burden. The key idea of online updating is that the previous estimators are sequentially updated only using the current data and some summary statistics of historical raw data. In this article, we develop a renewable learning method for a multiplicative regression model with streaming data, where the parameter estimator based on a least product relative error criterion is renewed without revisiting any historical raw data. Under some regularity conditions, we establish the consistency and asymptotic normality of the renewable estimator. Moreover, the theoretical results confirm that the proposed renewable estimator achieves the same asymptotic distribution as the least product relative error estimator with the entire dataset. Numerical studies and two real data examples are provided to evaluate the performance of our proposed method.


title: DHRL: A Graph-Based Approach for Long-Horizon and Sparse Hierarchical Reinforcement Learning

abstract: Hierarchical Reinforcement Learning (HRL) has made notable progress in complex control tasks by leveraging temporal abstraction. However, previous HRL algorithms often suffer from serious data inefficiency as environments get large. The extended components, $i.e.$, goal space and length of episodes, impose a burden on either one or both high-level and low-level policies since both levels share the total horizon of the episode. In this paper, we present a method of Decoupling Horizons Using a Graph in Hierarchical Reinforcement Learning (DHRL) which can alleviate this problem by decoupling the horizons of high-level and low-level policies and bridging the gap between the length of both horizons using a graph. DHRL provides a freely stretchable high-level action interval, which facilitates longer temporal abstraction and faster training in complex tasks. Our method outperforms state-of-the-art HRL algorithms in typical HRL environments. Moreover, DHRL achieves long and complex locomotion and manipulation tasks.


title: UGformer for Robust Left Atrium and Scar Segmentation Across Scanners

abstract: Thanks to the capacity for long-range dependencies and robustness to irregular shapes, vision transformers and deformable convolutions are emerging as powerful vision techniques of segmentation.Meanwhile, Graph Convolution Networks (GCN) optimize local features based on global topological relationship modeling. Particularly, they have been proved to be effective in addressing issues in medical imaging segmentation tasks including multi-domain generalization for low-quality images. In this paper, we present a novel, effective, and robust framework for medical image segmentation, namely, UGformer. It unifies novel transformer blocks, GCN bridges, and convolution decoders originating from U-Net to predict left atriums (LAs) and LA scars. We have identified two appealing findings of the proposed UGformer: 1). an enhanced transformer module with deformable convolutions to improve the blending of the transformer information with convolutional information and help predict irregular LAs and scar shapes. 2). Using a bridge incorporating GCN to further overcome the difficulty of capturing condition inconsistency across different Magnetic Resonance Images scanners with various inconsistent domain information. The proposed UGformer model exhibits outstanding ability to segment the left atrium and scar on the LAScarQS 2022 dataset, outperforming several recent state-of-the-arts.


title: TriangleNet: Edge Prior Augmented Network for Semantic Segmentation through Cross-Task Consistency

abstract: This paper addresses the task of semantic segmentation in computer vision, aiming to achieve precise pixel-wise classification. We investigate the joint training of models for semantic edge detection and semantic segmentation, which has shown promise. However, implicit cross-task consistency learning in multi-task networks is limited. To address this, we propose a novel "decoupled cross-task consistency loss" that explicitly enhances cross-task consistency. Our semantic segmentation network, TriangleNet, achieves a substantial 2.88\% improvement over the Baseline in mean Intersection over Union (mIoU) on the Cityscapes test set. Notably, TriangleNet operates at 77.4\% mIoU/46.2 FPS on Cityscapes, showcasing real-time inference capabilities at full resolution. With multi-scale inference, performance is further enhanced to 77.8\%. Furthermore, TriangleNet consistently outperforms the Baseline on the FloodNet dataset, demonstrating its robust generalization capabilities. The proposed method underscores the significance of multi-task learning and explicit cross-task consistency enhancement for advancing semantic segmentation and highlights the potential of multitasking in real-time semantic segmentation.


title: Understanding the Failure of Batch Normalization for Transformers in NLP

abstract: Batch Normalization (BN) is a core and prevalent technique in accelerating the training of deep neural networks and improving the generalization on Computer Vision (CV) tasks. However, it fails to defend its position in Natural Language Processing (NLP), which is dominated by Layer Normalization (LN). In this paper, we are trying to answer why BN usually performs worse than LN in NLP tasks with Transformer models. We find that the inconsistency between training and inference of BN is the leading cause that results in the failure of BN in NLP. We define Training Inference Discrepancy (TID) to quantitatively measure this inconsistency and reveal that TID can indicate BN's performance, supported by extensive experiments, including image classification, neural machine translation, language modeling, sequence labeling, and text classification tasks. We find that BN can obtain much better test performance than LN when TID keeps small through training. To suppress the explosion of TID, we propose Regularized BN (RBN) that adds a simple regularization term to narrow the gap between batch statistics and population statistics of BN. RBN improves the performance of BN consistently and outperforms or is on par with LN on 17 out of 20 settings, involving ten datasets and two common variants of Transformer Our code is available at https://github.com/wjxts/RegularizedBN.


title: Assessments and developments in constructing a National Health Index for policy making, in the United Kingdom

abstract: Composite indicators are a useful tool to summarize, measure and compare changes among different communities. The UK Office for National Statistics has created an annual England Health Index (starting from 2015) comprised of three main health domains - lives, places and people - to monitor health measures, over time and across different geographical areas (149 Upper Tier Level Authorities, 9 regions and an overall national index) and to evaluate the health of the nation. The composite indicator is defined as a weighted average (linear combination) of indicators within subdomains, subdomains within domains, and domains within the overall index. The Health Index was designed to be comparable over time, geographically harmonized and to serve as a tool for policy implementation and assessment. We evaluated the steps taken in the construction, reviewing the conceptual coherence and statistical requirements on Health Index data for 2015-2018. To assess these, we have focused on three main steps: correlation analysis at different index levels; comparison of the implemented weights derived from factor analysis with two alternative weights from principal components analysis and optimized system weights; a sensitivity and uncertainty analysis to assess to what extent rankings depend on the selected set of methodological choices. Based on the results, we have highlighted features that have improved statistical requirements of the forthcoming UK Health Index.


title: Contrastive Trajectory Similarity Learning with Dual-Feature Attention

abstract: Trajectory similarity measures act as query predicates in trajectory databases, making them the key player in determining the query results. They also have a heavy impact on the query efficiency. An ideal measure should have the capability to accurately evaluate the similarity between any two trajectories in a very short amount of time. Towards this aim, we propose a contrastive learning-based trajectory modeling method named TrajCL. We present four trajectory augmentation methods and a novel dual-feature self-attention-based trajectory backbone encoder. The resultant model can jointly learn both the spatial and the structural patterns of trajectories. Our model does not involve any recurrent structures and thus has a high efficiency. Besides, our pre-trained backbone encoder can be fine-tuned towards other computationally expensive measures with minimal supervision data. Experimental results show that TrajCL is consistently and significantly more accurate than the state-of-the-art trajectory similarity measures. After fine-tuning, i.e., to serve as an estimator for heuristic measures, TrajCL can even outperform the state-of-the-art supervised method by up to 56% in the accuracy for processing trajectory similarity queries.


title: Task-Aware Specialization for Efficient and Robust Dense Retrieval for Open-Domain Question Answering

abstract: Given its effectiveness on knowledge-intensive natural language processing tasks, dense retrieval models have become increasingly popular. Specifically, the de-facto architecture for open-domain question answering uses two isomorphic encoders that are initialized from the same pretrained model but separately parameterized for questions and passages. This bi-encoder architecture is parameter-inefficient in that there is no parameter sharing between encoders. Further, recent studies show that such dense retrievers underperform BM25 in various settings. We thus propose a new architecture, Task-aware Specialization for dense Retrieval (TASER), which enables parameter sharing by interleaving shared and specialized blocks in a single encoder. Our experiments on five question answering datasets show that TASER can achieve superior accuracy, surpassing BM25, while using about 60% of the parameters as bi-encoder dense retrievers. In out-of-domain evaluations, TASER is also empirically more robust than bi-encoder dense retrievers. Our code is available at https://github.com/microsoft/taser.


title: Notes on direct images of pluricanonical bundles

abstract: In this note, we generalize slightly Popa--Schnell's theorem regarding to direct images of pluricanonical bundles to the case when the ample line bundle is not globally generated. We also treat the case of positive characteristic.


title: Reliable Conditioning of Behavioral Cloning for Offline Reinforcement Learning

abstract: Behavioral cloning (BC) provides a straightforward solution to offline RL by mimicking offline trajectories via supervised learning. Recent advances (Chen et al., 2021; Janner et al., 2021; Emmons et al., 2021) have shown that by conditioning on desired future returns, BC can perform competitively to their value-based counterparts, while enjoying much more simplicity and training stability. While promising, we show that these methods can be unreliable, as their performance may degrade significantly when conditioned on high, out-of-distribution (ood) returns. This is crucial in practice, as we often expect the policy to perform better than the offline dataset by conditioning on an ood value. We show that this unreliability arises from both the suboptimality of training data and model architectures. We propose ConserWeightive Behavioral Cloning (CWBC), a simple and effective method for improving the reliability of conditional BC with two key components: trajectory weighting and conservative regularization. Trajectory weighting upweights the high-return trajectories to reduce the train-test gap for BC methods, while conservative regularizer encourages the policy to stay close to the data distribution for ood conditioning. We study CWBC in the context of RvS (Emmons et al., 2021) and Decision Transformers (Chen et al., 2021), and show that CWBC significantly boosts their performance on various benchmarks.


title: Can Language Models Be Specific? How?

abstract: "He is a person", "Paris is located on the earth". Both statements are correct but meaningless - due to lack of specificity. In this paper, we propose to measure how specific the language of pre-trained language models (PLMs) is. To achieve this, we introduce a novel approach to build a benchmark for specificity testing by forming masked token prediction tasks with prompts. For instance, given "Toronto is located in [MASK].", we want to test whether a more specific answer will be better filled in by PLMs, e.g., Ontario instead of Canada. From our evaluations, we show that existing PLMs have only a slight preference for more specific answers. We identify underlying factors affecting the specificity and design two prompt-based methods to improve the specificity. Results show that the specificity of the models can be improved by the proposed methods without additional training. We hope this work can bring to awareness the notion of specificity of language models and encourage the research community to further explore this important but understudied problem.


title: Globular Cluster UVIT legacy Survey (GlobUleS) III. Omega Centauri in Far-Ultraviolet

abstract: We present the first comprehensive study of the most massive globular cluster Omega Centauri in the far-ultraviolet (FUV) extending from the center to ~ 28% of the tidal radius using the Ultraviolet Imaging Telescope aboard AstroSat. A comparison of the FUV-optical color-magnitude diagrams with available canonical models reveals that the horizontal branch (HB) stars bluer than the knee (hHBs) and the white dwarfs (WDs) are fainter in the FUV by ~ 0.5 mag than model predictions. They are also fainter than their counterparts in M13, another massive cluster. We simulated HB with at least five subpopulations, including three He-rich populations with a substantial He enrichment of Y up to 0.43 dex, to reproduce the observed FUV distribution. We find the He-rich younger subpopulations to be radially more segregated than the He-normal older ones, suggesting an in-situ enrichment from older generations. The Omega Cen hHBs span the same effective temperature range as their M13 counterparts, but some have smaller radii and lower luminosities. This may suggest that a fraction of Omega Cen hHBs are less massive than those of M13, similar to the result derived from earlier spectroscopic studies of outer extreme HB stars. The WDs in Omega Cen and M13 have similar luminosity-radius-effective temperature parameters, and 0.44 - 0.46 M$_\odot$ He-core WD model tracks evolving from progenitors with Y = 0.4 dex are found to fit the majority of these. This study provides constraints on the formation models of Omega Cen based on the estimated range in age, [Fe/H] and Y (in particular), for the HB stars.


title: Spectroscopic follow-up of statistically selected extremely metal-poor star candidates from GALAH DR3

abstract: The advent of large-scale stellar spectroscopic surveys naturally leads to the implementation of machine learning techniques to isolate, for example, small sub-samples of potentially interesting stars from the full data set. A recent example is the application of the t-SNE statistical method to $\sim$600,000 stellar spectra from the GALAH survey in order to identify a sample of candidate extremely metal-poor (EMP, [Fe/H] $\leq$ -3) stars. We report the outcome of low-resolution spectroscopic follow-up of 83 GALAH EMP candidates that lack any previous metallicity estimates. Overall, the statistical selection is found to be efficient ($\sim$one-third of the candidates have [Fe/H] $\leq$ -2.75) with low contamination ($<$10% have [Fe/H] $>$ -2), and with a metallicity distribution function that is consistent with previous work. Five stars are found to have [Fe/H] $\leq$ -3.0, one of which is a main sequence turnoff star. Two other stars are revealed as likely carbon-enhanced metal-poor (CEMP) stars of type CEMP-$s$, and a known carbon star is re-identified. The results indicate that the statistical selection approach employed was successful, and therefore it can be applied to forthcoming even larger stellar spectroscopic surveys with the expectation of similar positive outcomes.


title: Estimation methods for elementary chirp model parameters

abstract: In this paper, we propose some estimation techniques to estimate the elementary chirp model parameters, which are encountered in sonar, radar, acoustics, and other areas. We derive asymptotic theoretical properties of least squares estimators and approximate least squares estimators for the one-component elementary chirp model. It is proved that the proposed estimators are strongly consistent and follow the normal distribution asymptotically. We also suggest how to obtain proper initial values for these methods. The problem of finding initial values is a difficult problem when the number of components in the model is large, or when the signal-to-noise ratio is low, or when two frequency rates are close to each other. We propose sequential procedures to estimate the multiple-component elementary chirp model parameters. We prove that the theoretical properties of sequential least squares estimators and sequential approximate least squares estimators coincide with those of least squares estimators and approximate least squares estimators, respectively. To evaluate the performance of the proposed estimators, numerical experiments are performed. It is observed that the proposed sequential estimators perform well even in situations where least squares estimators do not perform well. We illustrate the performance of the proposed sequential algorithm on a bat data.


title: NuSTAR observation of X-ray pulsar 1E 1145.1-6141

abstract: In this paper, we report on the hard X-ray observation of the X-ray pulsar 1E 1145.1-6141 performed with the Nuclear Spectroscopic Telescope Array mission (NuSTAR). The coherent pulsation of the source with a period of $\sim296.653\;\pm\;0.021\;s $ is detected. The source may be in the equilibrium phase, according to the most recent measurements of its pulse period. The pulse profile reveals a mild energy dependence and generally hints at a pencil-beam pattern. The pulse profile have evolved with time. The Pulse fraction is found to depend on energy with a fall in the value at $\sim 32\; keV$. The NuSTAR spectra can be approximated by a composite model with two continuum components, a blackbody emission, cut-off powerlaw, and a discrete component in the form of gaussian to account for the emission line of iron. The estimated absorbed flux of the source is $\sim6\times10^{-10}\;erg\;cm^{-2}\;s^{-1}$ which corresponds to a luminosity of $\sim5\times 10^{36}\;erg\;s^{-1}$. Pulse phase-resolved spectroscopy were performed to understand the evolution of spectral parameters with pulse phase. The estimated blackbody radius is found to be consistent with the size of the theoretical prediction.


title: Tight Error Bounds for the Sign-Constrained Stiefel Manifold

abstract: The sign-constrained Stiefel manifold in $\mathbb{R}^{n\times r}$ is a segment of the Stiefel manifold with fixed signs (nonnegative or nonpositive) for some columns of the matrices. It includes the nonnegative Stiefel manifold as a special case. We present global and local error bounds that provide an inequality with easily computable residual functions and explicit coefficients to bound the distance from matrices in $\mathbb{R}^{n\times r}$ to the sign-constrained Stiefel manifold. Moreover, we show that the error bounds cannot be improved except for the multiplicative constants under some mild conditions, which explains why two square-root terms are necessary in the bounds when $1< r <n$ and why the $\ell_1$ norm can be used in the bounds when $r = n$ or $r = 1$ for the sign constraints and orthogonality, respectively. The error bounds are applied to derive exact penalty methods for minimizing a Lipschitz continuous function with orthogonality and sign constraints.


title: Combining datasets to increase the number of samples and improve model fitting

abstract: For many use cases, combining information from different datasets can be of interest to improve a machine learning model's performance, especially when the number of samples from at least one of the datasets is small. However, a potential challenge in such cases is that the features from these datasets are not identical, even though there are some commonly shared features among the datasets. To tackle this challenge, we propose a novel framework called Combine datasets based on Imputation (ComImp). In addition, we propose a variant of ComImp that uses Principle Component Analysis (PCA), PCA-ComImp in order to reduce dimension before combining datasets. This is useful when the datasets have a large number of features that are not shared between them. Furthermore, our framework can also be utilized for data preprocessing by imputing missing data, i.e., filling in the missing entries while combining different datasets. To illustrate the power of the proposed methods and their potential usages, we conduct experiments for various tasks: regression, classification, and for different data types: tabular data, time series data, when the datasets to be combined have missing data. We also investigate how the devised methods can be used with transfer learning to provide even further model training improvement. Our results indicate that the proposed methods are somewhat similar to transfer learning in that the merge can significantly improve the accuracy of a prediction model on smaller datasets. In addition, the methods can boost performance by a significant margin when combining small datasets together and can provide extra improvement when being used with transfer learning.


title: The monodromy of families of subvarieties on abelian varieties

abstract: Motivated by recent work of Lawrence-Venkatesh and Lawrence-Sawin, we show that non-isotrivial families of subvarieties in abelian varieties have big monodromy when twisted by generic rank one local systems. While Lawrence-Sawin discuss the case of subvarieties of codimension one, our results hold for subvarieties of codimension at least half the dimension of the ambient abelian variety. For the proof, we use a combination of geometric arguments and representation theory to show that the Tannaka groups of intersection complexes on such subvarieties are big.


title: The Fast and Accurate Approach to Detection and Segmentation of Melanoma Skin Cancer using Fine-tuned Yolov3 and SegNet Based on Deep Transfer Learning

abstract: Melanoma is one of the most serious skin cancers that can occur in any part of the human skin. Early diagnosis of melanoma lesions will significantly increase their chances of being cured. Improving melanoma segmentation will help doctors or surgical robots remove the lesion more accurately from body parts. Recently, the learning-based segmentation methods achieved desired results in image segmentation compared to traditional algorithms. This study proposes a new approach to improve melanoma skin lesions detection and segmentation by defining a two-step pipeline based on deep learning models. Our methods were evaluated on ISIC 2018 (Skin Lesion Analysis Towards Melanoma Detection Challenge Dataset) well-known dataset. The proposed methods consist of two main parts for real-time detection of lesion location and segmentation. In the detection section, the location of the skin lesion is precisely detected by the fine-tuned You Only Look Once version 3 (F-YOLOv3) and then fed into the fine-tuned Segmentation Network (F-SegNet). Skin lesion localization helps to reduce the unnecessary calculation of whole images for segmentation. The results show that our proposed F-YOLOv3 performs better at 96% in mean Average Precision (mAP). Compared to state-of-the-art segmentation approaches, our F-SegNet achieves higher performance with 95.16% accuracy.


title: LARF: Two-level Attention-based Random Forests with a Mixture of Contamination Models

abstract: New models of the attention-based random forests called LARF (Leaf Attention-based Random Forest) are proposed. The first idea behind the models is to introduce a two-level attention, where one of the levels is the "leaf" attention and the attention mechanism is applied to every leaf of trees. The second level is the tree attention depending on the "leaf" attention. The second idea is to replace the softmax operation in the attention with the weighted sum of the softmax operations with different parameters. It is implemented by applying a mixture of the Huber's contamination models and can be regarded as an analog of the multi-head attention with "heads" defined by selecting a value of the softmax parameter. Attention parameters are simply trained by solving the quadratic optimization problem. To simplify the tuning process of the models, it is proposed to make the tuning contamination parameters to be training and to compute them by solving the quadratic optimization problem. Many numerical experiments with real datasets are performed for studying LARFs. The code of proposed algorithms can be found in https://github.com/andruekonst/leaf-attention-forest.


title: Protocol for an Observational Study on the Effects of Giving Births from Unintended Pregnancies on Later Life Physical and Mental Health

abstract: There has been increasing interest in studying the effect of giving births to unintended pregnancies on later life physical and mental health. In this article, we provide the protocol for our planned observational study on the long-term mental and physical health consequences for mothers who bear children resulting from unintended pregnancies. We aim to use the data from the Wisconsin Longitudinal Study (WLS) and examine the effect of births from unintended pregnancies on a broad range of outcomes, including mental depression, psychological well-being, physical health, alcohol usage, and economic well-being. To strengthen our causal findings, we plan to address our research questions on two subgroups, Catholics and non-Catholics, and discover the "replicable" outcomes for which the effect of unintended pregnancy is negative (or, positive) in both subgroups. Following the idea of non-random cross-screening, the data will be split according to whether the woman is Catholic or not, and then one part of the data will be used to select the hypotheses and design the corresponding tests for the second part of the data. In past use of cross-screening (automatic cross-screening) there was only one team of investigators that dealt with both parts of the data so that the investigators would need to decide on an analysis plan before looking at the data. In this protocol, we describe plans to carry out a novel flexible cross-screening in which there will be two teams of investigators with access only to one part of data and each team will use their part of the data to decide how to plan the analysis for the second team's data. In addition to the above replicability analysis, we also discuss the plan to test the global null hypothesis that is intended to identify the outcomes which are affected by unintended pregnancy for at least one of the two subgroups of Catholics and non-Catholics.


title: Constructions of cyclic codes and extended primitive cyclic codes with their applications

abstract: Linear codes with a few weights have many nice applications including combinatorial design, distributed storage system, secret sharing schemes and so on. In this paper, we construct two families of linear codes with a few weights based on special polynomials over finite fields. The first family of linear codes are extended primitive cyclic codes which are affine-invariant. The second family of linear codes are reducible cyclic codes. The parameters of these codes and their duals are determined. As the first application, we prove that these two families of linear codes hold $t$-designs, where $t=2,3$. As the second application, the minimum localities of the codes are also determined and optimal locally recoverable codes are derived.


title: Deep Fourier Up-Sampling

abstract: Existing convolutional neural networks widely adopt spatial down-/up-sampling for multi-scale modeling. However, spatial up-sampling operators (\emph{e.g.}, interpolation, transposed convolution, and un-pooling) heavily depend on local pixel attention, incapably exploring the global dependency. In contrast, the Fourier domain obeys the nature of global modeling according to the spectral convolution theorem. Unlike the spatial domain that performs up-sampling with the property of local similarity, up-sampling in the Fourier domain is more challenging as it does not follow such a local property. In this study, we propose a theoretically sound Deep Fourier Up-Sampling (FourierUp) to solve these issues. We revisit the relationships between spatial and Fourier domains and reveal the transform rules on the features of different resolutions in the Fourier domain, which provide key insights for FourierUp's designs. FourierUp as a generic operator consists of three key components: 2D discrete Fourier transform, Fourier dimension increase rules, and 2D inverse Fourier transform, which can be directly integrated with existing networks. Extensive experiments across multiple computer vision tasks, including object detection, image segmentation, image de-raining, image dehazing, and guided image super-resolution, demonstrate the consistent performance gains obtained by introducing our FourierUp.


title: Density profiles near nuclear surface of $^{44,52}$Ti: An indication of $\alpha$ clustering

abstract: We investigate the degree of $\alpha$ ($^4$He nucleus) clustering in the ground-state density profiles of $^{44}$Ti and $^{52}$Ti. Two types of density distributions, shell- and cluster-model configurations, are generated fully microscopically with the antisymmetrized quasi-cluster model, which can describe both the j-j coupling shell and $\alpha$-cluster configurations in a single scheme. Despite both the models reproducing measured charge radius data, we found that the $\alpha$ clustering significantly diffuses the density profiles near the nuclear surface compared to the ideal j-j coupling shell model configuration. The effect is most significant for $^{44}$Ti, while it is less for $^{52}$Ti due to the occupation of the $0f_{7/2}$ orbits in the $^{48}$Ca core. This difference can be detected by measuring proton-nucleus elastic scattering or the total reaction cross section on a carbon target at intermediate energies.


title: On Explainability in AI-Solutions: A Cross-Domain Survey

abstract: Artificial Intelligence (AI) increasingly shows its potential to outperform predicate logic algorithms and human control alike. In automatically deriving a system model, AI algorithms learn relations in data that are not detectable for humans. This great strength, however, also makes use of AI methods dubious. The more complex a model, the more difficult it is for a human to understand the reasoning for the decisions. As currently, fully automated AI algorithms are sparse, every algorithm has to provide a reasoning for human operators. For data engineers, metrics such as accuracy and sensitivity are sufficient. However, if models are interacting with non-experts, explanations have to be understandable. This work provides an extensive survey of literature on this topic, which, to a large part, consists of other surveys. The findings are mapped to ways of explaining decisions and reasons for explaining decisions. It shows that the heterogeneity of reasons and methods of and for explainability lead to individual explanatory frameworks.


title: BoxTeacher: Exploring High-Quality Pseudo Labels for Weakly Supervised Instance Segmentation

abstract: Labeling objects with pixel-wise segmentation requires a huge amount of human labor compared to bounding boxes. Most existing methods for weakly supervised instance segmentation focus on designing heuristic losses with priors from bounding boxes. While, we find that box-supervised methods can produce some fine segmentation masks and we wonder whether the detectors could learn from these fine masks while ignoring low-quality masks. To answer this question, we present BoxTeacher, an efficient and end-to-end training framework for high-performance weakly supervised instance segmentation, which leverages a sophisticated teacher to generate high-quality masks as pseudo labels. Considering the massive noisy masks hurt the training, we present a mask-aware confidence score to estimate the quality of pseudo masks and propose the noise-aware pixel loss and noise-reduced affinity loss to adaptively optimize the student with pseudo masks. Extensive experiments can demonstrate the effectiveness of the proposed BoxTeacher. Without bells and whistles, BoxTeacher remarkably achieves 35.0 mask AP and 36.5 mask AP with ResNet-50 and ResNet-101 respectively on the challenging COCO dataset, which outperforms the previous state-of-the-art methods by a significant margin and bridges the gap between box-supervised and mask-supervised methods. The code and models will be available at https://github.com/hustvl/BoxTeacher.


title: Variability Matters : Evaluating inter-rater variability in histopathology for robust cell detection

abstract: Large annotated datasets have been a key component in the success of deep learning. However, annotating medical images is challenging as it requires expertise and a large budget. In particular, annotating different types of cells in histopathology suffer from high inter- and intra-rater variability due to the ambiguity of the task. Under this setting, the relation between annotators' variability and model performance has received little attention. We present a large-scale study on the variability of cell annotations among 120 board-certified pathologists and how it affects the performance of a deep learning model. We propose a method to measure such variability, and by excluding those annotators with low variability, we verify the trade-off between the amount of data and its quality. We found that naively increasing the data size at the expense of inter-rater variability does not necessarily lead to better-performing models in cell detection. Instead, decreasing the inter-rater variability with the expense of decreasing dataset size increased the model performance. Furthermore, models trained from data annotated with lower inter-labeler variability outperform those from higher inter-labeler variability. These findings suggest that the evaluation of the annotators may help tackle the fundamental budget issues in the histopathology domain


title: Fine-Grained Image Style Transfer with Visual Transformers

abstract: With the development of the convolutional neural network, image style transfer has drawn increasing attention. However, most existing approaches adopt a global feature transformation to transfer style patterns into content images (e.g., AdaIN and WCT). Such a design usually destroys the spatial information of the input images and fails to transfer fine-grained style patterns into style transfer results. To solve this problem, we propose a novel STyle TRansformer (STTR) network which breaks both content and style images into visual tokens to achieve a fine-grained style transformation. Specifically, two attention mechanisms are adopted in our STTR. We first propose to use self-attention to encode content and style tokens such that similar tokens can be grouped and learned together. We then adopt cross-attention between content and style tokens that encourages fine-grained style transformations. To compare STTR with existing approaches, we conduct user studies on Amazon Mechanical Turk (AMT), which are carried out with 50 human subjects with 1,000 votes in total. Extensive evaluations demonstrate the effectiveness and efficiency of the proposed STTR in generating visually pleasing style transfer results.


title: Make Sharpness-Aware Minimization Stronger: A Sparsified Perturbation Approach

abstract: Deep neural networks often suffer from poor generalization caused by complex and non-convex loss landscapes. One of the popular solutions is Sharpness-Aware Minimization (SAM), which smooths the loss landscape via minimizing the maximized change of training loss when adding a perturbation to the weight. However, we find the indiscriminate perturbation of SAM on all parameters is suboptimal, which also results in excessive computation, i.e., double the overhead of common optimizers like Stochastic Gradient Descent (SGD). In this paper, we propose an efficient and effective training scheme coined as Sparse SAM (SSAM), which achieves sparse perturbation by a binary mask. To obtain the sparse mask, we provide two solutions which are based onFisher information and dynamic sparse training, respectively. In addition, we theoretically prove that SSAM can converge at the same rate as SAM, i.e., $O(\log T/\sqrt{T})$. Sparse SAM not only has the potential for training acceleration but also smooths the loss landscape effectively. Extensive experimental results on CIFAR10, CIFAR100, and ImageNet-1K confirm the superior efficiency of our method to SAM, and the performance is preserved or even better with a perturbation of merely 50% sparsity. Code is availiable at https://github.com/Mi-Peng/Sparse-Sharpness-Aware-Minimization.


title: Pre-Training for Robots: Offline RL Enables Learning New Tasks from a Handful of Trials

abstract: Progress in deep learning highlights the tremendous potential of utilizing diverse robotic datasets for attaining effective generalization and makes it enticing to consider leveraging broad datasets for attaining robust generalization in robotic learning as well. However, in practice, we often want to learn a new skill in a new environment that is unlikely to be contained in the prior data. Therefore we ask: how can we leverage existing diverse offline datasets in combination with small amounts of task-specific data to solve new tasks, while still enjoying the generalization benefits of training on large amounts of data? In this paper, we demonstrate that end-to-end offline RL can be an effective approach for doing this, without the need for any representation learning or vision-based pre-training. We present pre-training for robots (PTR), a framework based on offline RL that attempts to effectively learn new tasks by combining pre-training on existing robotic datasets with rapid fine-tuning on a new task, with as few as 10 demonstrations. PTR utilizes an existing offline RL method, conservative Q-learning (CQL), but extends it to include several crucial design decisions that enable PTR to actually work and outperform a variety of prior methods. To our knowledge, PTR is the first RL method that succeeds at learning new tasks in a new domain on a real WidowX robot with as few as 10 task demonstrations, by effectively leveraging an existing dataset of diverse multi-task robot data collected in a variety of toy kitchens. We also demonstrate that PTR can enable effective autonomous fine-tuning and improvement in a handful of trials, without needing any demonstrations. An accompanying overview video can be found in the supplementary material and at thi URL: https://sites.google.com/view/ptr-final/


title: On the homogeneity of measures for binary associations

abstract: Applied researchers often claim that the risk difference is more heterogeneous than the relative risk and the odds ratio. Some also argue that there are theoretical grounds for why this claim is true. In this note, we point out that these arguments reflect certain effect measures are variation independent of a nuisance parameter that is easier to interpret, rather than the homogeneity of these measures.


title: Neurosymbolic Motion and Task Planning for Linear Temporal Logic Tasks

abstract: This paper presents a neurosymbolic framework to solve motion planning problems for mobile robots involving temporal goals. The temporal goals are described using temporal logic formulas such as Linear Temporal Logic (LTL) to capture complex tasks. The proposed framework trains Neural Network (NN)-based planners that enjoy strong correctness guarantees when applying to unseen tasks, i.e., the exact task (including workspace, LTL formula, and dynamic constraints of a robot) is unknown during the training of NNs. Our approach to achieving theoretical guarantees and computational efficiency is based on two insights. First, we incorporate a symbolic model into the training of NNs such that the resulting NN-based planner inherits the interpretability and correctness guarantees of the symbolic model. Moreover, the symbolic model serves as a discrete "memory", which is necessary for satisfying temporal logic formulas. Second, we train a library of neural networks offline and combine a subset of the trained NNs into a single NN-based planner at runtime when a task is revealed. In particular, we develop a novel constrained NN training procedure, named formal NN training, to enforce that each neural network in the library represents a "symbol" in the symbolic model. As a result, our neurosymbolic framework enjoys the scalability and flexibility benefits of machine learning and inherits the provable guarantees from control-theoretic and formal-methods techniques. We demonstrate the effectiveness of our framework in both simulations and on an actual robotic vehicle, and show that our framework can generalize to unknown tasks where state-of-the-art meta-reinforcement learning techniques fail.


title: Sequential change-point detection: Computation versus statistical performance

abstract: Change-point detection studies the problem of detecting the changes in the underlying distribution of the data stream as soon as possible after the change happens. Modern large-scale, high-dimensional, and complex streaming data call for computationally (memory) efficient sequential change-point detection algorithms that are also statistically powerful. This gives rise to a computation versus statistical power trade-off, an aspect less emphasized in the past in classic literature. This tutorial takes this new perspective and reviews several sequential change-point detection procedures, ranging from classic sequential change-point detection algorithms to more recent non-parametric procedures that consider computation, memory efficiency, and model robustness in the algorithm design. Our survey also contains classic performance analysis, which still provides useful techniques for analyzing new procedures.


title: Edge-Cloud Cooperation for DNN Inference via Reinforcement Learning and Supervised Learning

abstract: Deep Neural Networks (DNNs) have been widely applied in Internet of Things (IoT) systems for various tasks such as image classification and object detection. However, heavyweight DNN models can hardly be deployed on edge devices due to limited computational resources. In this paper, an edge-cloud cooperation framework is proposed to improve inference accuracy while maintaining low inference latency. To this end, we deploy a lightweight model on the edge and a heavyweight model on the cloud. A reinforcement learning (RL)-based DNN compression approach is used to generate the lightweight model suitable for the edge from the heavyweight model. Moreover, a supervised learning (SL)-based offloading strategy is applied to determine whether the sample should be processed on the edge or on the cloud. Our method is implemented on real hardware and tested on multiple datasets. The experimental results show that (1) The sizes of the lightweight models obtained by RL-based DNN compression are up to 87.6% smaller than those obtained by the baseline method; (2) SL-based offloading strategy makes correct offloading decisions in most cases; (3) Our method reduces up to 78.8% inference latency and achieves higher accuracy compared with the cloud-only strategy.


title: Self organized criticality of magnetic avalanches in disordered ferrimagnetic material

abstract: We observe multiple step-like jumps in a Dy-Fe-Ga-based ferrimagnetic alloy in its magnetic hysteresis curve at 2 K. The observed jumps have a stochastic character with respect to their magnitude and the critical field of occurrence, and the jumps do not show any temporal effect. The jump size distribution follows a power law variation indicating the scale invariance nature of the jumps. We have invoked a simple two-dimensional random bond Ising-type spin system to model the dynamics. Our computational work can qualitatively reproduce the jumps and their scale invariant character. It also elucidates that the flipping of antiferromagnetically coupled Dy and Fe clusters is responsible for the observed discrete avalanche-like features in the hysteresis loop. These characteristics indicate that the present phenomenon can be well described within the realm of self-organized criticality


title: Size optimization of CNOT circuits on NISQ

abstract: Quantum computers in practice today require strict memory constraints, where 2-qubit operations can only be performed between the qubits closest to each other in a graph structure. So a quantum circuit must undergo a transformation to the graph before it can be implemented. In this paper, we study the optimization of the CNOT circuits on some noisy intermediate-scale quantum(NISQ) devices. Compared with previous works, we decompose it into two sub-problems: optimization with a given initial qubit distribution and optimization without limitations of initial qubit distribution. We find that most of the previous researches focused on the first sub-problem, and ignored the influence of different distribution of qubits in the same topology structure on the optimization results. In this paper, We take both sub-problems into account and give some new optimization algorithms. In short, our method is divided into two steps: matrix optimization and routing optimization. We implement matrix optimization with the algorithm in [XZL+20] and put forward a new heuristic algorithm with MILP method which can solve the second step. We implement our algorithm on IBM20 and some other NISQ devices, the results are better than most other methods in our experiment.


title: Meta-Learning with Self-Improving Momentum Target

abstract: The idea of using a separately trained target model (or teacher) to improve the performance of the student model has been increasingly popular in various machine learning domains, and meta-learning is no exception; a recent discovery shows that utilizing task-wise target models can significantly boost the generalization performance. However, obtaining a target model for each task can be highly expensive, especially when the number of tasks for meta-learning is large. To tackle this issue, we propose a simple yet effective method, coined Self-improving Momentum Target (SiMT). SiMT generates the target model by adapting from the temporal ensemble of the meta-learner, i.e., the momentum network. This momentum network and its task-specific adaptations enjoy a favorable generalization performance, enabling self-improving of the meta-learner through knowledge distillation. Moreover, we found that perturbing parameters of the meta-learner, e.g., dropout, further stabilize this self-improving process by preventing fast convergence of the distillation loss during meta-training. Our experimental results demonstrate that SiMT brings a significant performance gain when combined with a wide range of meta-learning methods under various applications, including few-shot regression, few-shot classification, and meta-reinforcement learning. Code is available at https://github.com/jihoontack/SiMT.


title: Intranight optical variability of low-mass Active Galactic Nuclei: A Pointer to blazar-like activity

abstract: This study aims to characterise, for the first time, intranight optical variability (INOV) of low-mass active galactic nuclei (LMAGN) which host a black hole (BH) of mass $M_{BH} \sim 10^6 M_{\odot}$, i.e., even less massive than the Galactic centre black hole Sgr A* and 2-3 orders of magnitude below the supermassive black holes (SMBH, $M_{BH}$ $\sim$ $10^8 - 10^9 M_{\odot}$) which are believed to power quasars. Thus, LMAGN are a crucial subclass of AGN filling the wide gap between SMBH and stellar-mass BHs of Galactic X-ray binaries. We have carried out a 36-session campaign of intranight optical monitoring of a well-defined, representative sample of 12 LMAGNs already detected in X-ray and radio bands. This set of LMAGN is found to exhibit INOV at a level statistically comparable to that observed for blazars (M$_{BH} \gtrsim$ 10$^{8-9}$ M$_{\odot}$) and for the $\gamma$-ray detected Narrow-line Seyfert1 galaxies (M$_{BH}\sim 10^7$ M$_{\odot}$) which, too, are believed to have relativistic jets. This indicates that the blazar-level activity can even be sustained by central engines with black holes near the upper limit for Intermediate Mass Black Holes ($M_{BH}$ $\sim$ $10^3 - 10^6 M_{\odot}$).


title: Broad-persistent Advice for Interactive Reinforcement Learning Scenarios

abstract: The use of interactive advice in reinforcement learning scenarios allows for speeding up the learning process for autonomous agents. Current interactive reinforcement learning research has been limited to real-time interactions that offer relevant user advice to the current state only. Moreover, the information provided by each interaction is not retained and instead discarded by the agent after a single use. In this paper, we present a method for retaining and reusing provided knowledge, allowing trainers to give general advice relevant to more than just the current state. Results obtained show that the use of broad-persistent advice substantially improves the performance of the agent while reducing the number of interactions required for the trainer.


title: Legal Element-oriented Modeling with Multi-view Contrastive Learning for Legal Case Retrieval

abstract: Legal case retrieval, which aims to retrieve relevant cases given a query case, plays an essential role in the legal system. While recent research efforts improve the performance of traditional ad-hoc retrieval models, legal case retrieval is still challenging since queries are legal cases, which contain hundreds of tokens. Legal cases are much longer and more complicated than keywords queries. Apart from that, the definition of legal relevance is beyond the general definition. In addition to general topical relevance, the relevant cases also involve similar situations and legal elements, which can support the judgment of the current case. In this paper, we propose an interaction-focused network for legal case retrieval with a multi-view contrastive learning objective. The contrastive learning views, including case-view and element-view, aim to overcome the above challenges. The case-view contrastive learning minimizes the hidden space distance between relevant legal case representations produced by a pre-trained language model (PLM) encoder. The element-view builds positive and negative instances by changing legal elements of cases to help the network better compute legal relevance. To achieve this, we employ a legal element knowledge-aware indicator to detect legal elements of cases. We conduct extensive experiments on the benchmark of relevant case retrieval. Evaluation results indicate our proposed method obtains significant improvement over the existing methods.


title: Neural Networks are Decision Trees

abstract: In this manuscript, we show that any neural network with any activation function can be represented as a decision tree. The representation is equivalence and not an approximation, thus keeping the accuracy of the neural network exactly as is. We believe that this work provides better understanding of neural networks and paves the way to tackle their black-box nature. We share equivalent trees of some neural networks and show that besides providing interpretability, tree representation can also achieve some computational advantages for small networks. The analysis holds both for fully connected and convolutional networks, which may or may not also include skip connections and/or normalizations.


title: Analysis of Low $\Delta V$ Spacecraft Missions to Oort Cloud Comet C/2014 UN$_{271}$

abstract: Comet C/2014 UN$_{271}$, alternative designation 'BB' after its discoverers 'Bernardinelli/Bernstein', and commonly referred to as UN$_{271}$, is an extreme case on two fronts, firstly its solar distance on discovery ($>$ 29 au) and secondly the size of its nucleus (137$\pm$ 15 km). With an aphelion distance of $\sim$33,000 au (w.r.t. the solar system barycentre) and an orbital period $\sim$2 million years, it is definitely an object from the solar system's Oort cloud, and also by a good measure the largest Oort cloud object ever observed. In situ observation of UN$_{271}$ would be of considerable scientific importance. Unlike most Oort cloud comets which have been discovered for the first time only as they near the inner solar system, UN$_{271}$ was discovered early enough to provide adequate advanced warning to plan for such a mission. In this paper we describe the various methods for reaching UN$_{271}$ during the period around its perihelion and ecliptic plane passage, with both flyby and rendezvous options; exploiting direct transfers, Jupiter powered gravitational assists (GA) or alternatively a series of GAs of the inner planets. Viable flyby and rendezvous trajectories are found, especially using the NASA Space Launch System (SLS) as the launch vehicle.


title: Global bounded solutions to the Boltzmann equation for a polyatomic gas

abstract: In this paper we consider the Boltzmann equation modelling the motion of a polyatomic gas where the integration collision operator in comparison with the classical one involves an additional internal energy variable $I\in\mathbb{R}_+$ and a parameter $\delta\geq 2$ standing for the degree of freedom. In perturbation framework, we establish the global well-posedness for bounded mild solutions near global equilibria on torus. The proof is based on the $L^2\cap L^\infty$ approach. Precisely, we first study the $L^2$ decay property for the linearized equation, then use the iteration technique for the linear integral operator to get the linear weighted $L^\infty$ decay, and in the end obtain $L^\infty$ bounds as well as exponential time decay of solutions for the nonlinear problem with the help of the Duhamel's principle. Throughout the proof, we present a careful analysis for treating the extra effect of internal energy variable $I$ and the parameter $\delta$.


title: A Theory of Factors Affecting Continuous Experimentation (FACE)

abstract: Continuous experimentation (CE) is used by many companies with internet-facing products to improve their software based on user data. Some companies deliberately adopt an experiment-driven approach to software development while some companies use CE in a more ad-hoc fashion. The goal of the study is to identify factors that explain the variations in the utility and efficacy of CE between different companies. We conducted a multi-case study of 12 companies involved with CE and performed 27 interviewees with practitioners at these companies. Based on that empirical data, we then built a theory of factors at play in CE. We introduce a theory of Factors Affecting Continuous Experimentation (FACE). The theory includes three factors, namely 1) processes and infrastructure for CE, 2) the user problem complexity of the product offering, and 3) incentive structures for CE. It explains how these factors affect the effectiveness of CE and its ability to achieve problem-solution and product-market fit. Our theory can be used by practitioners to assess an organisation's potential for adopting CE, as well as, identifying factors which pose challenges in gaining value from CE practices. Our results also provide a starting point for further research on how contextual factors affect CE and how these may be mitigated.


title: Viterbi Decoding of Directed Acyclic Transformer for Non-Autoregressive Machine Translation

abstract: Non-autoregressive models achieve significant decoding speedup in neural machine translation but lack the ability to capture sequential dependency. Directed Acyclic Transformer (DA-Transformer) was recently proposed to model sequential dependency with a directed acyclic graph. Consequently, it has to apply a sequential decision process at inference time, which harms the global translation accuracy. In this paper, we present a Viterbi decoding framework for DA-Transformer, which guarantees to find the joint optimal solution for the translation and decoding path under any length constraint. Experimental results demonstrate that our approach consistently improves the performance of DA-Transformer while maintaining a similar decoding speedup.


title: New infinite families of near MDS codes holding $t$-designs

abstract: In ``Infinite families of near MDS codes holding $t$-designs, IEEE Trans. Inform. Theory, 2020, 66(9), pp. 5419-5428'', Ding and Tang made a breakthrough in constructing the first two infinite families of NMDS codes holding $2$-designs or $3$-designs. Up to now, there are only a few known infinite families of NMDS codes holding $t$-designs in the literature. The objective of this paper is to construct new infinite families of NMDS codes holding $t$-designs. We determine the weight enumerators of the NMDS codes and prove that the NMDS codes hold $2$-designs or $3$-designs. Compared with known $t$-designs from NMDS codes, ours have different parameters. Besides, several infinite families of optimal locally recoverable codes are also derived via the NMDS codes.


title: Real-time Trajectory Optimization and Control for Ball Bumping with Quadruped Robots

abstract: This paper studies real-time motion planning and control for ball bumping motion with quadruped robots. To enable the quadruped to bump the flying ball with different initializations, we develop a nonlinear trajectory optimization-based planning scheme that jointly identifies the take-off time and state to achieve accurate ball hitting during the flight phase. Such a planning scheme employs a two-dimensional single rigid body model that achieves a satisfactory balance between accuracy and efficiency for the highly time-sensitive task. To precisely execute the planned motion, the tracking controller needs to incorporate the strict time-state constraint imposed on the take-off and ball-hitting events. To this end, we develop an improved model predictive controller that respects the critical time-state constraints. The proposed planning and control framework is validated with a real Aliengo robot. Experiments show that the problem planning approach can be computed in approximately 60ms on average, enabling successful accomplishment of the ball bumping motion with various initializations in real time.


title: DIGAT: Modeling News Recommendation with Dual-Graph Interaction

abstract: News recommendation (NR) is essential for online news services. Existing NR methods typically adopt a news-user representation learning framework, facing two potential limitations. First, in news encoder, single candidate news encoding suffers from an insufficient semantic information problem. Second, existing graph-based NR methods are promising but lack effective news-user feature interaction, rendering the graph-based recommendation suboptimal. To overcome these limitations, we propose dual-interactive graph attention networks (DIGAT) consisting of news- and user-graph channels. In the news-graph channel, we enrich the semantics of single candidate news by incorporating the semantically relevant news information with a semantic-augmented graph (SAG). In the user-graph channel, multi-level user interests are represented with a news-topic graph. Most notably, we design a dual-graph interaction process to perform effective feature interaction between the news and user graphs, which facilitates accurate news-user representation matching. Experiment results on the benchmark dataset MIND show that DIGAT outperforms existing news recommendation methods. Further ablation studies and analyses validate the effectiveness of (1) semantic-augmented news graph modeling and (2) dual-graph interaction.


title: Mixed-modality Representation Learning and Pre-training for Joint Table-and-Text Retrieval in OpenQA

abstract: Retrieving evidences from tabular and textual resources is essential for open-domain question answering (OpenQA), which provides more comprehensive information. However, training an effective dense table-text retriever is difficult due to the challenges of table-text discrepancy and data sparsity problem. To address the above challenges, we introduce an optimized OpenQA Table-Text Retriever (OTTeR) to jointly retrieve tabular and textual evidences. Firstly, we propose to enhance mixed-modality representation learning via two mechanisms: modality-enhanced representation and mixed-modality negative sampling strategy. Secondly, to alleviate data sparsity problem and enhance the general retrieval ability, we conduct retrieval-centric mixed-modality synthetic pre-training. Experimental results demonstrate that OTTeR substantially improves the performance of table-and-text retrieval on the OTT-QA dataset. Comprehensive analyses examine the effectiveness of all the proposed mechanisms. Besides, equipped with OTTeR, our OpenQA system achieves the state-of-the-art result on the downstream QA task, with 10.1% absolute improvement in terms of the exact match over the previous best system. All the code and data are available at https://github.com/Jun-jie-Huang/OTTeR.


title: Optimal geodesics for boundary points of the Gardiner-Masur compactification

abstract: The Gardiner-Masur compactification of Teichm\"uller space is homeomorphic to the horofunction compactification of the Teichm\"uller metric. Let $\xi$ and $\eta$ be a pair of boundary points in the Gardiner-Masur compactification that fill up the surface. We show that there is a unique Teichm\"uller geodesic which is optimal for the horofunctions corresponding to $\xi$ and $\eta$. In particular, when $\xi$ and $\eta$ are Busemann points that fill up the surface, the geodesic converges to $\xi$ in forward direction and to $\eta$ in backward direction. As an application, we show that if $\mathbf{G}_n$ is a sequence of Teichm\"uller geodesics passing through $X_n$ and $Y_n$ such that $X_n \to \xi$ and $Y_n \to \eta$, then $\mathbf{G}_n$ converges to a unique Teichm\"uller geodesic.