title: A novel black-hole mass scaling relation based on coronal gas, and its dependence with the accretion disc

abstract: Using bona-fide black hole (BH) mass estimates from reverberation mapping and the line ratio [SiVI] 1.963$\mu$m/Br$\gamma_{\rm broad}$ as tracer of the AGN ionising continuum, a novel BH-mass scaling relation of the form log($M_{\rm BH}) = (6.40\pm 0.17) - (1.99\pm 0.37) \times$ log ([SiVI]/Br$\gamma_{\rm broad})$, dispersion 0.47 dex, over the BH mass interval, $10^6 - 10^8$ M$_{\odot}$ is found. Following on the geometrically thin accretion disc approximation and after surveying a basic parameter space for coronal lines production, we believe one of main drivers of the relation is the effective temperature of the disc, which is effectively sampled by the [SiVI] 1.963$\mu$m coronal line for the range of BH masses considered. By means of CLOUDY photoionisation models, the observed anti-correlation appears to be formally in line with the thin disc prediction T_disc $\propto {M_{\rm BH}}^{-1/4}$.


title: Simulation of quantum physics with Tensor Processing Units: brute-force computation of ground states and time evolution

abstract: Tensor Processing Units (TPUs) were developed by Google exclusively to support large-scale machine learning tasks. TPUs can, however, also be used to accelerate and scale up other computationally demanding tasks. In this paper we repurpose TPUs for the challenging problem of simulating quantum spin systems. Consider a lattice model made of $N$ spin-$\frac{1}{2}$ quantum spins, or qubits, with a Hamiltonian $H = \sum_i h_i$ that is a sum of local terms $h_i$ and a wavefunction $|\Psi\rangle$ consisting of $2^N$ complex amplitudes. We demonstrate the usage of TPUs for both (i) computing the ground state $|\Psi_{gs}\rangle$ of the Hamiltonian $H$, and (ii) simulating the time evolution $|\Psi(t)\rangle=e^{-itH}|\Psi(0)\rangle$ generated by this Hamiltonian starting from some initial state $|\Psi(0)\rangle$. The bottleneck of the above tasks is computing the product $H |\Psi\rangle$, which can be implemented with remarkable efficiency utilising the native capabilities of TPUs. With a TPU v3 pod, with 2048 cores, we simulate wavefunctions $|\Psi\rangle$ of up to $N=38$ qubits. The dedicated matrix multiplication units (MXUs), the high bandwidth memory (HBM) on each core, and the fast inter-core interconnects (ICIs) together provide performance far beyond the capabilities of general purpose processors.


title: Statistical Analysis Plan for Health Outcomes in Phase 1 of the SEARCH-IPT Study

abstract: This document provides the statistical analytic plan (SAP) for evaluating health outcomes in Phase 1 of the SEARCH-IPT Study, a cluster randomized trial to evaluate whether a multicomponent intervention increases uptake of isoniazid (INH) preventive therapy (IPT) and reduces the incidence of tuberculosis (TB) in Uganda (Clinicaltrials.gov: NCT03315962). The SAP was locked prior to unblinding and effect estimation. This SAP was embargoed until November 19, 2021 when it was submitted to arXiv.


title: Charge radii, moments and masses of mercury isotopes across the N = 126 shell closure

abstract: Combining laser spectroscopy in a Versatile Arc Discharge and Laser Ion Source, with Penning-trap mass spectrometry at the CERN-ISOLDE facility, this work reports on mean-square charge radii of neutron-rich mercury isotopes across the $N = 126$ shell closure, the electromagnetic moments of $^{207}$Hg and more precise mass values of $^{206-208}$Hg. The odd-even staggering (OES) of the mean square charge radii and the kink at $N = 126$ are analyzed within the framework of covariant density functional theory (CDFT), with comparisons between different functionals to investigate the dependence of the results on the underlying single-particle structure. The observed features are defined predominantly in the particle-hole channel in CDFT, since both are present in the calculations without pairing. However, the magnitude of the kink is still affected by the occupation of the $1i_{11/2}$ and $2g_{9/2}$ orbitals with a dependence on the relative energies as well as pairing.


title: On the 3-colorability of triangle-free and fork-free graphs

abstract: A graph $G$ is said to satisfy the Vizing bound if $\chi(G)\leq \omega(G)+1$, where $\chi(G)$ and $\omega(G)$ denote the chromatic number and clique number of $G$, respectively. It was conjectured by Randerath in 1998 that if $G$ is a triangle-free and fork-free graph, where the fork (also known as trident) is obtained from $K_{1,4}$ by subdividing two edges, then $G$ satisfies the Vizing bound. In this paper, we confirm this conjecture.


title: Thermal and driven noise in Brillouin Lasers

abstract: Owing to their highly coherent emission and compact form factor, Brillouin lasers have been identified as a valuable asset for applications including portable atomic clocks, precision sensors, coherent microwave synthesis and energy-efficient approaches to coherent communications. While the fundamental emission linewidth of these lasers can be very narrow, noise within dielectric materials leads to drift in the carrier frequency, posing vexing challenges for applications requiring ultra-stable emission. A unified understanding of Brillouin laser performance may provide critical insights to reach new levels of frequency stability, however existing noise models focus on only one or a few key noise sources, and do not capture the thermo-optic drift in the laser frequency produced by thermal fluctuations or absorbed power. Here, we develop a coupled mode theory of Brillouin laser dynamics that accounts for dominant forms of noise in non-crystalline systems, capturing the salient features of the frequency and intensity noise for a variety of systems. As a result, theory and experiment can be directly compared to identify key sources of noise and the frequency bands they impact, revealing strategies to improve the performance of Brillouin lasers and pave the way for highly-coherent sources of light on a chip.


title: SNPs Filtered by Allele Frequency Improve the Prediction of Hypertension Subtypes

abstract: Hypertension is the leading global cause of cardiovascular disease and premature death. Distinct hypertension subtypes may vary in their prognoses and require different treatments. An individual's risk for hypertension is determined by genetic and environmental factors as well as their interactions. In this work, we studied 911 African Americans and 1,171 European Americans in the Hypertension Genetic Epidemiology Network (HyperGEN) cohort. We built hypertension subtype classification models using both environmental variables and sets of genetic features selected based on different criteria. The fitted prediction models provided insights into the genetic landscape of hypertension subtypes, which may aid personalized diagnosis and treatment of hypertension in the future.


title: Maximizing revenue in the presence of intermediaries

abstract: We study the mechanism design problem of selling $k$ items to unit-demand buyers with private valuations for the items. A buyer either participates directly in the auction or is represented by an intermediary, who represents a subset of buyers. Our goal is to design robust mechanisms that are independent of the demand structure (i.e. how the buyers are partitioned across intermediaries), and perform well under a wide variety of possible contracts between intermediaries and buyers. We first study the case of $k$ identical items where each buyer draws its private valuation for an item i.i.d. from a known $\lambda$-regular distribution. We construct a robust mechanism that, independent of the demand structure and under certain conditions on the contracts between intermediaries and buyers, obtains a constant factor of the revenue that the mechanism designer could obtain had she known the buyers' valuations. In other words, our mechanism's expected revenue achieves a constant factor of the optimal welfare, regardless of the demand structure. Our mechanism is a simple posted-price mechanism that sets a take-it-or-leave-it per-item price that depends on $k$ and the total number of buyers, but does not depend on the demand structure or the downstream contracts. Next we generalize our result to the case when the items are not identical. We assume that the item valuations are separable. For this case, we design a mechanism that obtains at least a constant fraction of the optimal welfare, by using a menu of posted prices. This mechanism is also independent of the demand structure, but makes a relatively stronger assumption on the contracts between intermediaries and buyers, namely that each intermediary prefers outcomes with a higher sum of utilities of the subset of buyers represented by it.


title: A New Estimate of the Cutoff Value in the Bak-Sneppen Model

abstract: We present evidence that the Bak-Sneppen model of evolution on $N$ vertices requires $N^3$ iterates to reach equilibrium. This is substantially more than previous authors suggested (on the order of $N^2$). Based on that estimate, we present a novel algorithm inspired by previous rank-driven analyses of the model allowing for direct simulation of the model with populations of up to $N = 25600$ for $2\cdot N^3$ iterations. These extensive simulations suggest a cutoff value of $x^* = 0.66692 \pm 0.00003$, a value slightly lower than previously estimated yet still distinctly above $2/3$. We also study how the cutoff values $x^*_N$ at finite $N$ approximate the conjectured value $x^*$ at $N=\infty$. Assuming $x^*_N-x^*_\infty \sim N^{-\nu}$, we find that $\nu=0.978\pm 0.025$, which is significantly lower than previous estimates ($\nu\approx 1.4$).


title: Sliding Network Coding for URLLC

abstract: In this paper, we propose a network coding (NC) based approach to ultra-reliable low-latency communication (URLLC) over erasure channels. In transmitting multiple data packets, we demonstrate that the use of random NC can improve the reliability in terms of decoding error probability, while it incurs a longer decoding delay than a well-known K-repetition. To avoid a long decoding delay, we consider a sliding NC (SNC) design that allows a highly reliable transmission of each data packet with a guaranteed decoding delay. A few design examples are derived and their decoding error rates are analyzed. Through the analysis, we can show that the decoding error rate of SNC is much lower than that of K-repetition at the same spectral efficiency, which means a more reliable transmission can be achieved using SNC than K-repetition.


title: Deep Extragalactic VIsible Legacy Survey (DEVILS): DR1 Blended Spectra Search for Candidate Strong Gravitational Lenses

abstract: Here, we present a catalog of blended spectra in Data Release 1 of the Deep Extragalactic VIsible Legacy Survey (DEVILS) on the Anglo-Australian Telescope (AAT). Of the 23197 spectra, 181 showed signs of a blend of redshifts and spectral templates. We examine these blends in detail for signs of either a candidate strong lensing galaxy or a useful overlapping galaxy pair. One of the three DEVILS target fields, COSMOS (D10) is close to complete and it is fully imaged with Hubble Space Telescope Advanced Camera for Surveys (HST/ACS) and we visually examine the 57 blended spectra in this field in the F814W postage stamps. Nine are classical strong lensing candidates with an elliptical as the lens, out to higher redshifts than any previous search with spectroscopic surveys such as SDSS or GAMA. The gravitational lens candidate success rate similar to earlier such searches (0.1%). Strong gravitational lenses identified with blended spectroscopy have typically shown a high success rate (>70%) which make these interesting targets for future higher resolution lensing studies, monitoring for supernovae cosmography, or searches for magnified atomic hydrogen signal.


title: Towards Return Parity in Markov Decision Processes

abstract: Algorithmic decisions made by machine learning models in high-stakes domains may have lasting impacts over time. However, naive applications of standard fairness criterion in static settings over temporal domains may lead to delayed and adverse effects. To understand the dynamics of performance disparity, we study a fairness problem in Markov decision processes (MDPs). Specifically, we propose return parity, a fairness notion that requires MDPs from different demographic groups that share the same state and action spaces to achieve approximately the same expected time-discounted rewards. We first provide a decomposition theorem for return disparity, which decomposes the return disparity of any two MDPs sharing the same state and action spaces into the distance between group-wise reward functions, the discrepancy of group policies, and the discrepancy between state visitation distributions induced by the group policies. Motivated by our decomposition theorem, we propose algorithms to mitigate return disparity via learning a shared group policy with state visitation distributional alignment using integral probability metrics. We conduct experiments to corroborate our results, showing that the proposed algorithm can successfully close the disparity gap while maintaining the performance of policies on two real-world recommender system benchmark datasets.


title: Negative moments of $L$-functions with small shifts over function fields

abstract: We consider negative moments of quadratic Dirichlet $L$--functions over function fields. Summing over monic square-free polynomials of degree $2g+1$ in $\mathbb{F}_q[x]$, we obtain an asymptotic formula for the $k^{\text{th}}$ shifted negative moment of $L(1/2+\beta,\chi_D)$, in certain ranges of $\beta$ (for example, when roughly $\beta \gg \log g/g $ and $k<1$). We also obtain non-trivial upper bounds for the $k^{\text{th}}$ shifted negative moment when $\log(1/\beta) \ll \log g$. Previously, almost sharp upper bounds were obtained in \cite{ratios} in the range $\beta \gg g^{-\frac{1}{2k}+\epsilon}$.


title: A New Model of Intranuclear Neutron-Antineutron Transformations in ${}^{16}_{8}$O

abstract: There has been much work in recent years pertaining to viability studies for the intranuclear observation of neutron-antineutron transformations. These studies begin firstly with the design and implementation of an event generator for the simulation of this rare process, where one hopes to retain as much of the underlying nuclear physics as possible in the initial state, and then studying how these effects may perturb the final state observable particles for detector efficiency studies following simulated reconstruction. There have been several searches for intranuclear neutron-antineutron transformations, primarily utilizing the ${}^{16}_{8}$O nucleus, and completed within large underground water Cherenkov detectors such as Super-Kamiokande. The latest iteration of a generator is presented here for use in such an experiment. This generator includes several new features, including a new radial (position) annihilation probability distribution and related intranuclear suppression factor for ${}^{16}_{8}$O, as well as a highly general, modern nuclear multifragmentation model with photonic de-excitations. The latter of these may allow for improved identification of the signal using large underground detectors such as Super-Kamiokande and the future Hyper-Kamiokande, potentially increasing the overall signal efficiencies of these rare searches. However, it should be noted that certain fast photonic de-excitations may be washed out by $\pi^0$ decays to photons. These new features implemented in these $\bar{n}$\isotope[15][8]{O} simulations increase the overall physical realism of the model, and are easily portable to other future searches such as to extranuclear $\bar{n}{}^{12}_{6}$C for the ESS NNBAR experiment, as well as intranuclear $\bar{n}{}^{39}_{18}$Ar used in DUNE.


title: Non-Fermi Liquids, Strange Metals and Quasi-metaparticles

abstract: We introduce the concept of quasi-metaparticles based on the theory of metaparticles, the zero modes of the metastring. We apply the concept of quasi-metaparticles to the problem of non-Fermi liquids and the properties of strange metals. In particular, we point out that the quasi-metaparticle Green's function interpolates between the canonical quasi-particle Green's function and the result found in the context of the SYK model, which presents an exactly solvable model without quasiparticles. The linear dependence of resistivity with temperature is reproduced in the SYK limit. Also, the Cooper mechanism is possible in the quasi-metaparticle case. Finally, the new parameter that characterizes quasi-metaparticles can be extracted from ARPES data. Thus, the quasi-metaparticle could be a useful new concept in the study of strange metals and high-temperature superconductivity.


title: TransMorph: Transformer for unsupervised medical image registration

abstract: In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the long-range spatial relationships in an image. Recently Vision Transformer architectures have been proposed to address the shortcomings of ConvNets and have produced state-of-the-art performances in many medical imaging applications. Transformers may be a strong candidate for image registration because their substantially larger receptive field enables a more precise comprehension of the spatial correspondence between moving and fixed images. Here, we present TransMorph, a hybrid Transformer-ConvNet model for volumetric medical image registration. This paper also presents diffeomorphic and Bayesian variants of TransMorph: the diffeomorphic variants ensure the topology-preserving deformations, and the Bayesian variant produces a well-calibrated registration uncertainty estimate. We extensively validated the proposed models using 3D medical images from three applications: inter-patient and atlas-to-patient brain MRI registration and phantom-to-CT registration. The proposed models are evaluated in comparison to a variety of existing registration methods and Transformer architectures. Qualitative and quantitative results demonstrate that the proposed Transformer-based model leads to a substantial performance improvement over the baseline methods, confirming the effectiveness of Transformers for medical image registration.


title: PatchCensor: Patch Robustness Certification for Transformers via Exhaustive Testing

abstract: Vision Transformer (ViT) is known to be highly nonlinear like other classical neural networks and could be easily fooled by both natural and adversarial patch perturbations. This limitation could pose a threat to the deployment of ViT in the real industrial environment, especially in safety-critical scenarios. In this work, we propose PatchCensor, aiming to certify the patch robustness of ViT by applying exhaustive testing. We try to provide a provable guarantee by considering the worst patch attack scenarios. Unlike empirical defenses against adversarial patches that may be adaptively breached, certified robust approaches can provide a certified accuracy against arbitrary attacks under certain conditions. However, existing robustness certifications are mostly based on robust training, which often requires substantial training efforts and the sacrifice of model performance on normal samples. To bridge the gap, PatchCensor seeks to improve the robustness of the whole system by detecting abnormal inputs instead of training a robust model and asking it to give reliable results for every input, which may inevitably compromise accuracy. Specifically, each input is tested by voting over multiple inferences with different mutated attention masks, where at least one inference is guaranteed to exclude the abnormal patch. This can be seen as complete-coverage testing, which could provide a statistical guarantee on inference at the test time. Our comprehensive evaluation demonstrates that PatchCensor is able to achieve high certified accuracy (e.g. 67.1% on ImageNet for 2%-pixel adversarial patches), significantly outperforming state-of-the-art techniques while achieving similar clean accuracy (81.8% on ImageNet). Meanwhile, our technique also supports flexible configurations to handle different adversarial patch sizes (up to 25%) by simply changing the masking strategy.


title: Box and Nabla Products that are D-Spaces

abstract: A space $X$ is $D$ if for every assignment, $U$, of an open neighborhood to each point $x$ in $X$ there is a closed discrete $D$ such that $\bigcup \{U(x) : x \in D\}=X$. The box product, $\square X^\omega$, is $X^\omega$ with topology generated by all $\prod_n U_n$, where every $U_n$ is open. The nabla product, $\nabla X^\omega$, is obtained from $\square X^\omega$ by quotienting out mod-finite. The weight of $X$, $w(X)$, is the minimal size of a base, while $\mathfrak{d}=\mathop{cof} \omega^\omega$. It is shown that there are specific compact spaces $X$ such that $\square X^\omega$ and $\nabla X^\omega$ are not $D$, but: (1) $\square X^\omega$ and $\nabla X^\omega$ are hereditarily $D$ if $X$ is scattered and either hereditarily paracompact or of finite scattered height, or if $X$ is metrizable (and $w(X)\le \mathfrak{d}$ for $\square X^\omega$); (2) $\nabla X^\omega$ is hereditarily $D$ if $X$ is first countable and $w(X)\le \omega_1$, or consistently if $X$ is first countable and $|X|\le \mathfrak{c}$, or $w(X)\le \omega_1$; and (3) $\square X^\omega$ is $D$ consistently if $X$ is compact and either first countable or $w(X)\le \omega_1$.


title: Current noise and Keldysh vertex function of an Anderson impurity in the Fermi liquid regime

abstract: We present a complete microscopic Fermi-liquid description for next-to-leading order transport through an Anderson impurity under a finite bias voltage $V$. It is applicable to multilevel quantum dots without particle-hole or time-reversal symmetry, and is constructed based on the nonequilibrium Keldysh formalism, taking into account the current conservation between electrons in the impurity levels and the conduction bands. Specifically, we derive the formula for the current noise generated in the steady flow up to terms of order $(eV)^3$ at zero temperature $T=0$. To this end, we calculate the Keldysh vertex functions $\Gamma_{\sigma\sigma';\sigma'\sigma}^{ \nu_1\nu_2;\nu_3\nu_4} (\omega,\omega'; \omega',\omega)$, which depend on branches $\nu_1, \nu_2, \nu_3$ and $\nu_4$ of the time-loop contour and on spin degrees of freedom $\sigma$ and $\sigma'$, up to linear-order terms with respect to $eV$, $T$, and frequencies $\omega$ and $\omega'$. The coefficients of these linear-order terms are determined by a set of the parameters, defined with respect to the equilibrium ground state: the phase shift, static susceptibilities, and nonlinear three-body susceptibilities of the impurity electrons. The low-energy expressions of the vertex components are shown to satisfy the Ward identities with the Keldysh Green's functions expanded up to terms of order $\omega^2$, $(eV)^2$, and $T^2$. We also find that the imaginary part of the Ward identities can be described in terms of the $eV$-dependent collision integrals for a single-quasiparticle excitation and that for a single quasiparticle-quasihole pair excitation. These collision integrals ensure the current conservation of the next-to-leading order Fermi-liquid transport due to the quasiparticles with a finite damping rate.


title: Inter-Domain Fusion for Enhanced Intrusion Detection in Power Systems: An Evidence Theoretic and Meta-Heuristic Approach

abstract: False alerts due to misconfigured/ compromised IDS in ICS networks can lead to severe economic and operational damage. To solve this problem, research has focused on leveraging deep learning techniques that help reduce false alerts. However, a shortcoming is that these works often require or implicitly assume the physical and cyber sensors to be trustworthy. Implicit trust of data is a major problem with using artificial intelligence or machine learning for CPS security, because during critical attack detection time they are more at risk, with greater likelihood and impact, of also being compromised. To address this shortcoming, the problem is reframed on how to make good decisions given uncertainty. Then, the decision is detection, and the uncertainty includes whether the data used for ML-based IDS is compromised. Thus, this work presents an approach for reducing false alerts in CPS power systems by dealing uncertainty without the knowledge of prior distribution of alerts. Specifically, an evidence theoretic based approach leveraging Dempster Shafer combination rules are proposed for reducing false alerts. A multi-hypothesis mass function model is designed that leverages probability scores obtained from various supervised-learning classifiers. Using this model, a location-cum-domain based fusion framework is proposed and evaluated with different combination rules, that fuse multiple evidence from inter-domain and intra-domain sensors. The approach is demonstrated in a cyber-physical power system testbed with Man-In-The-Middle attack emulation in a large-scale synthetic electric grid. For evaluating the performance, plausibility, belief, pignistic, etc. metrics as decision functions are considered. To improve the performance, a multi-objective based genetic algorithm is proposed for feature selection considering the decision metrics as the fitness function.


title: Tight Bound for Estimating Expectation Values from a System of Linear Equations

abstract: The System of Linear Equations Problem (SLEP) is specified by a complex invertible matrix $A$, the condition number $\kappa$ of $A$, a vector $b$, a Hermitian matrix $M$ and an accuracy $\epsilon$, and the task is to estimate $x^\dagger Mx$, where $x$ is the solution vector to the equation $Ax = b$. We aim to establish a lower bound on the complexity of the end-to-end quantum algorithms for SLEP with respect to $\epsilon$, and devise a quantum algorithm that saturates this bound. To make lower bounds attainable, we consider query complexity in the setting in which a block encoding of $M$ is given, i.e., a unitary black box $U_M$ that contains $M/\alpha$ as a block for some $\alpha \in \mathbb R^+$. We show that the quantum query complexity for SLEP in this setting is $\Theta(\alpha/\epsilon)$. Our lower bound is established by reducing the problem of estimating the mean of a black box function to SLEP. Our $\Theta(\alpha/\epsilon)$ result tightens and proves the common assertion of polynomial accuracy dependence (poly$(1/\epsilon)$) for SLEP, and shows that improvement beyond linear dependence on accuracy is not possible if $M$ is provided via block encoding.


title: Moir\'e circuits: engineering magic-angle behaviors

abstract: Moir\'e superlattices in the twisted bilayer graphene provide an unprecedented platform to investigate a wide range of exotic quantum phenomena. Recently, the twist degree of freedom has been introduced into various classical wave systems, giving rise to new ideas for the wave control. The question is whether twistronics and moir\'e physics can be extended to electronics with potential applications in the twist-enabled signal processing. Here, we demonstrate both in theory and experiment that lots of fascinating moir\'e physics can be engineered using electric circuits with extremely high degrees of freedom. By suitably designing the interlayer coupling and biasing of one sublattice for the twisted bilayer circuit, the low-energy flat bands with large bandgaps away from other states can be realized at various twist angles. Based on the moir\'e circuit with a fixed twist angle, we experimentally demonstrate the effect of band narrowing as well as the localization of electric energy when a magic value of the interlayer coupling is applied. Furthermore, the topological edge states, which originate from the moir\'e potential induced pseudomagnetic field, are also observed for the first time. Our findings suggest a flexible platform to study twistronics beyond natural materials and other classical wave systems, and may have potential applications in the field of intergraded circuit design.


title: Federated Learning with Domain Generalization

abstract: Federated Learning (FL) enables a group of clients to jointly train a machine learning model with the help of a centralized server. Clients do not need to submit their local data to the server during training, and hence the local training data of clients is protected. In FL, distributed clients collect their local data independently, so the dataset of each client may naturally form a distinct source domain. In practice, the model trained over multiple source domains may have poor generalization performance on unseen target domains. To address this issue, we propose FedADG to equip federated learning with domain generalization capability. FedADG employs the federated adversarial learning approach to measure and align the distributions among different source domains via matching each distribution to a reference distribution. The reference distribution is adaptively generated (by accommodating all source domains) to minimize the domain shift distance during alignment. In FedADG, the alignment is fine-grained since each class is aligned independently. In this way, the learned feature representation is supposed to be universal, so it can generalize well on the unseen domains. Intensive experiments on various datasets demonstrate that FedADG has comparable performance with the state-of-the-art.


title: Imitation and Supervised Learning of Compliance for Robotic Assembly

abstract: We present the design of a learning-based compliance controller for assembly operations for industrial robots. We propose a solution within the general setting of learning from demonstration (LfD), where a nominal trajectory is provided through demonstration by an expert teacher. This can be used to learn a suitable representation of the skill that can be generalized to novel positions of one of the parts involved in the assembly, for example the hole in a peg-in-hole (PiH) insertion task. Under the expectation that this novel position might not be entirely accurately estimated by a vision or other sensing system, the robot will need to further modify the generated trajectory in response to force readings measured by means of a force-torque (F/T) sensor mounted at the wrist of the robot or another suitable location. Under the assumption of constant velocity of traversing the reference trajectory during assembly, we propose a novel accommodation force controller that allows the robot to safely explore different contact configurations. The data collected using this controller is used to train a Gaussian process model to predict the misalignment in the position of the peg with respect to the target hole. We show that the proposed learning-based approach can correct various contact configurations caused by misalignment between the assembled parts in a PiH task, achieving high success rate during insertion. We show results using an industrial manipulator arm, and demonstrate that the proposed method can perform adaptive insertion using force feedback from the trained machine learning models.


title: Modeling Design and Control Problems Involving Neural Network Surrogates

abstract: We consider nonlinear optimization problems that involve surrogate models represented by neural networks. We demonstrate first how to directly embed neural network evaluation into optimization models, highlight a difficulty with this approach that can prevent convergence, and then characterize stationarity of such models. We then present two alternative formulations of these problems in the specific case of feedforward neural networks with ReLU activation: as a mixed-integer optimization problem and as a mathematical program with complementarity constraints. For the latter formulation we prove that stationarity at a point for this problem corresponds to stationarity of the embedded formulation. Each of these formulations may be solved with state-of-the-art optimization methods, and we show how to obtain good initial feasible solutions for these methods. We compare our formulations on three practical applications arising in the design and control of combustion engines, in the generation of adversarial attacks on classifier networks, and in the determination of optimal flows in an oil well network.


title: Adaptive State-Space Multitaper Spectral Estimation

abstract: Short-time Fourier transform (STFT) is the most common window-based approach for analyzing the spectrotemporal dynamics of time series. To mitigate the effects of high variance on the spectral estimates due to finite-length, independent STFT windows, state-space multitaper (SSMT) method used a state-space framework to introduce dependency among the spectral estimates. However, the assumed time-invariance of the state-space parameters makes the spectral dynamics difficult to capture when the time series is highly nonstationary. We propose an adaptive SSMT (ASSMT) method as a time-varying extension of SSMT. ASSMT tracks highly nonstationary dynamics by adaptively updating the state parameters and Kalman gains using a heuristic, computationally efficient exponential smoothing technique. In analyses of simulated data and real human electroencephalogram (EEG) recordings, ASSMT showed improved denoising and smoothing properties relative to standard multitaper and SSMT approaches.


title: Malicious Selling Strategies in E-Commerce Livestream: A Case Study of Alibaba's Taobao and ByteDance's TikTok

abstract: Due to the limitations imposed by the COVID-19 pandemic, many users have shifted their shopping patterns from offline to online. Livestream shopping has become popular as one of the online shopping media. However, many streamers' malicious selling behaviors have been reported. In this research, we sought to explore streamers' malicious selling strategies and understand how viewers perceive these strategies. First, we recorded 40 livestream shopping sessions from two popular livestream platforms in China -- Taobao and TikTok (or "Douyin" in Chinese). We identified 16 malicious selling strategies and found that platform designs enhanced these malicious selling strategies. Second, through an interview study with 13 viewers, we provide a rich description of viewers' awareness of malicious selling strategies and the challenges they encountered while trying to overcome malicious selling. We conclude by discussing the policy and design implications of countering malicious selling.


title: Feature selection or extraction decision process for clustering using PCA and FRSD

abstract: This paper concerns the critical decision process of extracting or selecting the features before applying a clustering algorithm. It is not obvious to evaluate the importance of the features since the most popular methods to do it are usually made for a supervised learning technique process. A clustering algorithm is an unsupervised method. It means that there is no known output label to match the input data. This paper proposes a new method to choose the best dimensionality reduction method (selection or extraction) according to the data scientist's parameters, aiming to apply a clustering process at the end. It uses Feature Ranking Process Based on Silhouette Decomposition (FRSD) algorithm, a Principal Component Analysis (PCA) algorithm, and a K-Means algorithm along with its metric, the Silhouette Index (SI). This paper presents 5 use cases based on a smart city dataset. This research also aims to discuss the impacts, the advantages, and the disadvantages of each choice that can be made in this unsupervised learning process.


title: Discrete Representations Strengthen Vision Transformer Robustness

abstract: Vision Transformer (ViT) is emerging as the state-of-the-art architecture for image recognition. While recent studies suggest that ViTs are more robust than their convolutional counterparts, our experiments find that ViTs trained on ImageNet are overly reliant on local textures and fail to make adequate use of shape information. ViTs thus have difficulties generalizing to out-of-distribution, real-world data. To address this deficiency, we present a simple and effective architecture modification to ViT's input layer by adding discrete tokens produced by a vector-quantized encoder. Different from the standard continuous pixel tokens, discrete tokens are invariant under small perturbations and contain less information individually, which promote ViTs to learn global information that is invariant. Experimental results demonstrate that adding discrete representation on four architecture variants strengthens ViT robustness by up to 12% across seven ImageNet robustness benchmarks while maintaining the performance on ImageNet.


title: A Distributed Parallel Optimization Algorithm via Alternating Direction Method of Multipliers

abstract: Alternating Direction Method of Multipliers (ADMM) algorithm has been widely adopted for solving the distributed optimization problem (DOP). In this paper, a new distributed parallel ADMM algorithm is proposed, which allows the agents to update their local states and dual variables in a completely distributed and parallel manner by modifying the existing distributed sequential ADMM. Moreover, the updating rules and storage method for variables are illustrated. It is shown that all the agents can reach a consensus by asymptotically converging to the optimal solution. Besides, the global cost function will converge to the optimal value at a rate of O(1/k). Simulation results on a numerical example are given to show the effectiveness of the proposed algorithm.


title: Planar Hall effect induced spin rectification effect and its strong impact on spin pumping measurements

abstract: Spin pumping is a technique widely used to generate the pure spin current and characterize the spin-charge conversion in various systems. The reversing sign of the symmetric Lorentzian charge current with respect to opposite magnetic field is generally accepted as the key criterion to identify its pure spin current origin. However, we herein find that the rectified voltage due to the planar Hall effect can exhibit similar spurious signal, complicating and even misleading the analysis. The distribution of microwave magnetic field and induction current has strong influence on the magnetic field symmetry and lineshape of the obtained signal. We further demonstrate a geometry where the spin-charge conversion and the rectified voltage can be readily distinguished with a straightforward symmetry analysis.


title: Innovative System Design for Remote Air Traffic Control Simulation Training on and beyond COVID19

abstract: Remote ATC simulation training is an emerging technology in aviation education during COVID. Professional training institutions can learn from others, whereas the experiences of developing remote ATC simulation teaching/training with the Start-up company ByteProTeq will be beneficial for the rest of the world to understand the differences and similarities of current remote training and to improve their performance in building a safe and efficient remote training environment. In this paper, we will present three improvements to our remote ATC training: 1) infrastructure upgrading of hardware and software from an existing stand-alone system to a remote network that considers costs, cyber security, system compatibility, et cetera; 2) quality of remote ATC simulation training, compared with traditional face-to-face training, including students and instructors feedback; 3) enhancement of the current remote training system beyond COVID-19 regarding reliability, cyber security, and capacity. This foundation paper will support understanding of the current stage of remote ATC simulation training development with the Start-up company ByteProTeq, during and beyond the COVID-19 pandemic, thereby providing an excellent example for the rest of the world.


title: Combining Data-driven Supervision with Human-in-the-loop Feedback for Entity Resolution

abstract: The distribution gap between training datasets and data encountered in production is well acknowledged. Training datasets are often constructed over a fixed period of time and by carefully curating the data to be labeled. Thus, training datasets may not contain all possible variations of data that could be encountered in real-world production environments. Tasked with building an entity resolution system - a model that identifies and consolidates data points that represent the same person - our first model exhibited a clear training-production performance gap. In this case study, we discuss our human-in-the-loop enabled, data-centric solution to closing the training-production performance divergence. We conclude with takeaways that apply to data-centric learning at large.


title: An intrinsic topological model in the absence of symmetry

abstract: We study the vibrational spectrum of a constrained classical ring. Due to the presence of 2-order exceptional points, a topologically trivial band at the infinity can make the vibrational band topologically nontrivial. The symmetry, which is believed to be indispensable in topological models, is absent in this model. The fractional boundary states can be found in such classical system. Furthermore, the other aspect of the bulk boundary correspondence is revealed: an extra fractional exceptional point is topologically protected in bulk by the boundary states.


title: Study of Polar Codes Based on Piecewise Gaussian Approximation

abstract: In this paper, we investigate the construction of polar codes by Gaussian approximation (GA) and develop an approach based on piecewise Gaussian approximation (PGA). In particular, with the piecewise approach we obtain a function that replaces the original GA function with a more accurate approximation, which results in significant gain in performance. The proposed PGA construction of polar codes is presented in its integral form as well as an alternative approximation that does not rely on the integral form. Simulations results show that the proposed PGA construction outperforms the standard GA for several examples of polar codes and rates.


title: A Novel Data Segmentation Method for Data-driven Phase Identification

abstract: This paper presents a smart meter phase identification algorithm for two cases: meter-phase-label-known and meter-phase-label-unknown. To improve the identification accuracy, a data segmentation method is proposed to exclude data segments that are collected when the voltage correlation between smart meters on the same phase are weakened. Then, using the selected data segments, a hierarchical clustering method is used to calculate the correlation distances and cluster the smart meters. If the phase labels are unknown, a Connected-Triple-based Similarity (CTS) method is adapted to further improve the phase identification accuracy of the ensemble clustering method. The methods are developed and tested on both synthetic and real feeder data sets. Simulation results show that the proposed phase identification algorithm outperforms the state-of-the-art methods in both accuracy and robustness.


title: Exploring Language Patterns in a Medical Licensure Exam Item Bank

abstract: This study examines the use of natural language processing (NLP) models to evaluate whether language patterns used by item writers in a medical licensure exam might contain evidence of biased or stereotypical language. This type of bias in item language choices can be particularly impactful for items in a medical licensure assessment, as it could pose a threat to content validity and defensibility of test score validity evidence. To the best of our knowledge, this is the first attempt using machine learning (ML) and NLP to explore language bias on a large item bank. Using a prediction algorithm trained on clusters of similar item stems, we demonstrate that our approach can be used to review large item banks for potential biased language or stereotypical patient characteristics in clinical science vignettes. The findings may guide the development of methods to address stereotypical language patterns found in test items and enable an efficient updating of those items, if needed, to reflect contemporary norms, thereby improving the evidence to support the validity of the test scores.


title: CamLiFlow: Bidirectional Camera-LiDAR Fusion for Joint Optical Flow and Scene Flow Estimation

abstract: In this paper, we study the problem of jointly estimating the optical flow and scene flow from synchronized 2D and 3D data. Previous methods either employ a complex pipeline that splits the joint task into independent stages, or fuse 2D and 3D information in an "early-fusion" or "late-fusion" manner. Such one-size-fits-all approaches suffer from a dilemma of failing to fully utilize the characteristic of each modality or to maximize the inter-modality complementarity. To address the problem, we propose a novel end-to-end framework, called CamLiFlow. It consists of 2D and 3D branches with multiple bidirectional connections between them in specific layers. Different from previous work, we apply a point-based 3D branch to better extract the geometric features and design a symmetric learnable operator to fuse dense image features and sparse point features. Experiments show that CamLiFlow achieves better performance with fewer parameters. Our method ranks 1st on the KITTI Scene Flow benchmark, outperforming the previous art with 1/7 parameters. Code is available at https://github.com/MCG-NJU/CamLiFlow.


title: Comparison of Helium Abundance between ICMEs and Solar Wind near 1 AU

abstract: The Helium abundance, defined as $A_{He}=n_{He}/n_{H}\times 100$, is $\sim$8.5 in the photosphere and seldom exceeds 5 in fast solar wind. Previous statistics have demonstrated that $A_{He}$ in slow solar wind correlates tightly with sunspot number. However, less attention is paid to the solar cycle dependence of $A_{He}$ within interplanetary coronal mass ejections (ICMEs) and comparing the $A_{He}$ characteristics of ICMEs and solar wind. In this paper we conduct a statistical comparison of Helium abundance between ICMEs and solar wind near 1 AU with observations of \textit{Advanced Composition Explorer} from 1998 to 2019, and find that the ICME $A_{He}$ also exhibits the obvious solar cycle dependence. Meanwhile, we find that the $A_{He}$ is obviously higher within ICMEs compared to solar wind, and the means within 37\% and 12\% of ICMEs exceed 5 and 8.5, respectively. It is interesting to answer where and how the high Helium abundance originates. Our statistics demonstrate that 21\% (3\%) of ICME (slow wind) $A_{He}$ data points exceed 8.5 around solar maximum, which decreases dramatically near minimum, while no such high $A_{He}$ values appear in the fast wind throughout the whole solar cycle. This indicates that the high $A_{He}$ (e.g., $>$8.5) emanates from active regions as more ICMEs and slow wind originates from active regions around maximum, and supports that both active regions and quiet-Sun regions are the sources of slow wind. We suggest that the high $A_{He}$ from active regions could be explained by means of the magnetic loop confinement model and/or photoionization effect.


title: Effects of context, complexity, and clustering on evaluation for math formula retrieval

abstract: There are now several test collections for the formula retrieval task, in which a system's goal is to identify useful mathematical formulae to show in response to a query posed as a formula. These test collections differ in query format, query complexity, number of queries, content source, and relevance definition. Comparisons among six formula retrieval test collections illustrate that defining relevance based on query and/or document context can be consequential, that system results vary markedly with formula complexity, and that judging relevance after clustering formulas with identical symbol layouts (i.e., Symbol Layout Trees) can affect system preference ordering.


title: Giant Dzyaloshinskii-Moriya interaction and ratchet motion of bimeronic excitations in two-dimensional magnets

abstract: Topological magnetic excitations rooted in Dzyaloshinskii-Moriya interaction (DMI) are promising information carriers for next-generation memory and spintronic devices. The recently discovered two-dimensional (2D) magnets provide fertile new platforms for revealing rich physical phenomena with atomic-scale precision, as exemplified by the enhanced DMI associated with an effective electric field that breaks the inversion symmetry. Here we use first-principles calculations to establish a conceptually difierent compositional engineering approach to induce giant DMI in a representative CrMnI$_6$ 2D magnet, and the underlying mechanism is rooted in the spontaneous inversion symmetry breaking in the bipartite system. Using atomistic magnetics simulations, we further reveal that bimeronic excitations can emerge upon cooling a spin random state or perturbing a ferromagnetic state. Strikingly, the bimeron can exhibit unidirectional soliton-like propagation, and such a ratchet phenomenon is highly desirable for racetrack memories. These findings may prove instrumental in developing novel devices for quantum information based on 2D magnets.


title: Quantum metrology with Bloch Oscillations in Floquet phase space

abstract: Quantum particles performing Bloch oscillations in a spatially periodic potential can be used as a very accurate detector of constant forces. We find that the similar oscillations that can appear in the Floquet phase space of a quantum particle subjected a periodic temporal driving, even in the absence of periodic lattice potential, can likewise be exploited as detectors. Compared with their spatial Bloch analog, however, the Floquet-Bloch oscillations provide significant added flexibility and open the way to a broad range of precision metrology applications. We illustrate this property on the examples of a tachometer and a magnetometer.


title: CDFS-6664: A candidate of Lyman-continuum Emission at z~3.8 detected by HDUV

abstract: We report the detection of Lyman Continuum (LyC) emission from the galaxy, CDFS-6664, at z=3.797 in a sample of Lyman break galaxies with detected [OIII] emission lines. The LyC emission is detected with a significance ~$5\sigma$ in the F336W band of the Hubble Deep UV Legacy Survey, corresponding to the 650-770 Angstrom rest-frame. The light centroid of the LyC emission is offset from the galaxy center by about 0.2" (1.4 pkpc). The Hubble deep images at longer wavelengths show that the emission is unlikely provided by low-redshift interlopers. The photometric and spectroscopic data show that the possible contribution of an active galactic nucleus is quite low. Fitting the spectral energy distribution of this source to stellar population synthesis models, we find that the galaxy is young (~50 Myr) and actively forming stars with a rate of 52.1$\pm$4.9 $M_{\odot}\mathrm{yr^{-1}}$. The significant star formation and the spatially offset LyC emission support a scenario where the ionizing photons escape from the low-density cavities in the ISM excavated by massive young stars. From the nebular model, we estimate the escape fraction of LyC photons to be 38$\pm$7% and the corresponding IGM transmission to be 60%, which deviates more than 3$\sigma$ from the average transmission. The unusually high IGM transmission of LyC photons in CDFS-6664 may be related to a foreground type-2 quasar, CDF-202, at z=3.7, with a projected separation of 1.2' only. The quasar may have photoevaporated optically thick absorbers and enhance the transmission on the sightline of CDFS-6664.


title: Broadband Digital Over-the-Air Computation for Asynchronous Federated Edge Learning

abstract: This paper presents the first broadband digital over-the-air computation (AirComp) system for phase asynchronous OFDM-based federated edge learning systems. Existing analog AirComp systems often assume perfect phase alignment via channel precoding and utilize uncoded analog modulation for model aggregation. In contrast, our digital AirComp system leverages digital modulation and channel codes to overcome phase asynchrony, thereby achieving accurate model aggregation in the asynchronous multi-user OFDM systems. To realize a digital AirComp system, we propose a non-orthogonal multiple access protocol that allows simultaneous transmissions from multiple edge devices, and present a joint channel decoding and aggregation (Jt-CDA) decoder (i.e., full-state joint decoder). To reduce the computation complexity, we further present a reduced-complexity Jt-CDA decoder (i.e., reduced-state joint decoder), and its arithmetic sum bit error rate performance is similar to that of the full-state joint decoder for most signal-to-noise ratio (SNR) regimes. Simulation results on test accuracy (of CIFAR10 dataset) versus SNR show that: 1) analog AirComp systems are sensitive to phase asynchrony under practical setup, and the test accuracy performance exhibits an error floor even at high SNR regime; 2) our digital AirComp system outperforms an analog AirComp system by at least 1.5 times when SNR 9dB, demonstrating the advantage of digital AirComp in asynchronous multi-user OFDM systems.


title: A Generalized Hasegawa-Mima Equation in Curved Magnetic Fields

abstract: We derive a model equation describing electrostatic plasma turbulence in general (inhomogeneous and curved) magnetic fields by analysing the effect of curved geometry on the ion fluid polarization drift velocity. The derived nonlinear equation generalizes the Hasegawa-Mima equation governing drift wave turbulence in a straight homogeneous magnetic field, and may serve as a toy model for the description of turbulent systems such as the core of H-mode plasmas. The equation is most appropriate for configurations with a small ExB drift velocity divergence, or a mild spatial change in ExB drift velocity. We identify the conserved energy of the system, and obtain conditions on magnetic field topology for conservation of generalized enstrophy. Through numerical examples, we further show how the curvature of the magnetic field reshapes self-organized steady turbulent states.


title: Bayesian Learning via Neural Schr\"odinger-F\"ollmer Flows

abstract: In this work we explore a new framework for approximate Bayesian inference in large datasets based on stochastic control (i.e. Schr\"odinger bridges). We advocate stochastic control as a finite time and low variance alternative to popular steady-state methods such as stochastic gradient Langevin dynamics (SGLD). Furthermore, we discuss and adapt the existing theoretical guarantees of this framework and establish connections to already existing VI routines in SDE-based models.


title: Constraint on the equation of state parameter ($\omega$) in non-minimally coupled $f(Q)$ gravity

abstract: We study observational constraints on the modified symmetric teleparallel gravity, the non-metricity $f(Q)$ gravity, which reproduces background expansion of the universe. For this purpose, we use Hubble measurements, Baryonic Acoustic Oscillations (BAO), 1048 Pantheon supernovae type Ia data sample which integrate SuperNova Legacy Survey (SNLS), Sloan Digital Sky Survey (SDSS), Hubble Space Telescope (HST) survey, Panoramic Survey Telescope and Rapid Response System (Pan-STARRS1). We confront our cosmological model against observational samples to set constraints on the parameters using Markov Chain Monte Carlo (MCMC) methods. We find the equation of state parameter $\omega=-0.853^{+0.015}_{-0.020}$ and $\omega= -0.796^{+0.049}_{-0.074}$ for Hubble and Pantheon samples, respectively. As a result, the $f(Q)$ model shows the quintessence behavior and deviates from $\Lambda$CDM.


title: Embedding clique-factors in graphs with low $\ell$-independence number

abstract: The following question was proposed by Nenadov and Pehova and reiterated by Knierim and Su: Given integers $\ell,r$ and $n$ with $n\in r\mathbb{N}$, is it true that every $n$-vertex graph $G$ with $\delta(G) \ge \max \{ \frac{1}{2},\frac{r - \ell}{r} \}n + o(n)$ and $\alpha_{\ell}(G) = o(n) $ contains a $K_{r}$-factor? We give a negative answer for the case when $\ell\ge \frac{3r}{4}$ by giving a family of constructions using the so-called cover thresholds and show that the minimum degree condition given by our construction is asymptotically best possible. That is, for all integers $r,\ell$ with $r > \ell \ge \frac{3}{4}r$ and $\mu >0$, there exist $\alpha > 0$ and $N$ such that for every $n\in r\mathbb{N}$ with $n>N$, every $n$-vertex graph $G$ with $\delta(G) \ge \left( \frac{1}{2-\varrho_{\ell}(r-1)} + \mu \right)n $ and $\alpha_{\ell}(G) \le \alpha n$ contains a $K_{r}$-factor. Here $\varrho_{\ell}(r-1)$ is the Ramsey--Tur\'an density for $K_{r-1}$ under the $\ell$-independence number condition.


title: Data Processing Matters: SRPH-Konvergen AI's Machine Translation System for WMT'21

abstract: In this paper, we describe the submission of the joint Samsung Research Philippines-Konvergen AI team for the WMT'21 Large Scale Multilingual Translation Task - Small Track 2. We submit a standard Seq2Seq Transformer model to the shared task without any training or architecture tricks, relying mainly on the strength of our data preprocessing techniques to boost performance. Our final submission model scored 22.92 average BLEU on the FLORES-101 devtest set, and scored 22.97 average BLEU on the contest's hidden test set, ranking us sixth overall. Despite using only a standard Transformer, our model ranked first in Indonesian to Javanese, showing that data preprocessing matters equally, if not more, than cutting edge model architectures and training techniques.


title: Star Structure Connectivity of Folded hypercubes and Augmented cubes

abstract: The connectivity is an important parameter to evaluate the robustness of a network. As a generalization, structure connectivity and substructure connectivity of graphs were proposed. For connected graphs $G$ and $H$, the $H$-structure connectivity $\kappa(G; H)$ (resp. $H$-substructure connectivity $\kappa^{s}(G; H)$) of $G$ is the minimum cardinality of a set of subgraphs $F$ of $G$ that each is isomorphic to $H$ (resp. to a connected subgraph of $H$) so that $G-F$ is disconnected or the singleton. As popular variants of hypercubes, the $n$-dimensional folded hypercubes $FQ_{n}$ and augmented cubes $AQ_{n}$ are attractive interconnected network prototypes for multiple processor systems. In this paper, we obtain that $\kappa(FQ_{n};K_{1,m})=\kappa^{s}(FQ_{n};K_{1,m})=\lceil\frac{n+1}{2}\rceil$ for $2\leqslant m\leqslant n-1$, $n\geqslant 7$, and $\kappa(AQ_{n};K_{1,m})=\kappa^{s}(AQ_{n};K_{1,m})=\lceil\frac{n-1}{2}\rceil$ for $4\leqslant m\leqslant \frac{3n-15}{4}$.


title: A Swimming Rheometer: Self-propulsion of a freely-suspended swimmer enabled by viscoelastic normal stresses

abstract: Self-propulsion at low Reynolds number is notoriously restricted, a concept that is commonly known as the "scallop theorem". Here we present a truly self-propelled swimmer (force- and torque- free) that, while unable to swim in a Newtonian fluid due to the scallop theorem, propels itself in a non-Newtonian fluid as a result of fluid elasticity. This propulsion mechanism is demonstrated using a robotic swimmer, comprised of a "head" sphere and a "tail" sphere, whose swimming speed is shown to have reasonable agreement with a microhydrodynamic asymptotic theory and numerical simulations. Schlieren imaging demonstrates that propulsion of the swimmer is driven by a strong viscoelastic jet at the tail, which develops due to the fore-aft asymmetry of the swimmer. Optimized cylindrical and conic tail geometries are shown to double the propulsive signal, relative to the optimal spherical tail. Finally, we show that we can use observations of this robot to infer rheological properties of the surrounding fluid. We measure the primary normal stress coefficient at shear rates less than 1 Hz, and show reasonable agreement with extrapolated benchtop measurements (between 0.8 to 1.2 Pa sec2 difference). We also discuss how our swimmer can be used to measure the second normal stress coefficient and other rheological properties. The study experimentally demonstrates the exciting potential for a "swimming rheometer", bringing passive physics-driven fluid sensing to numerous applications in chemical and bioengineering.

categories: physics.flu-dyn physics.app-ph physics.bio-ph physics.ins-det


title: Trivalent ion overcharging on electrified graphene

abstract: The structure of the electrical double layer (EDL) formed near graphene in aqueous environments strongly impacts its performance for a plethora of applications, including capacitive deionization. In particular, adsorption and organization of multivalent counterions near the graphene interface can promote nonclassical behaviors of EDL including overcharging followed by co-ion adsorption. In this paper, we characterize the EDL formed near an electrified graphene interface in dilute aqueous $YCl_3$ solution using in situ high resolution x-ray reflectivity (also known as crystal truncation rod (CTR)) and resonant anomalous x-ray reflectivity (RAXR). These interfacial-specific techniques reveal the electron density profiles with molecular-scale resolution. We find that yttrium ions ($Y^{3+}$) readily adsorb to the negatively charged graphene surface to form an extended ion profile. This ion distribution resembles a classical diffuse layer but with a significantly high ion coverage, i.e., 1 $Y^{3+}$ per 11.4 $\pm$ 1.6 A$^2$, compared to the value calculated from the capacitance measured by cyclic voltammetry (1 $Y^{3+}$ per ~240 A$^2$). Such overcharging can be explained by co-adsorption of chloride that effectively screens the excess positive charge. The adsorbed $Y^{3+}$ profile also shows a molecular-scale gap ($\geq$5 A) from the top graphene surfaces, which is attributed to the presence of intervening water molecules between the adsorbents and adsorbates as well as the lack of inner-sphere surface complexation on chemically inert graphene. We also demonstrate controlled adsorption by varying the applied potential and reveal consistent $Y^{3+}$ ion position with respect to the surface and increasing cation coverage with decreasing applied potential.


title: Light scattering by a subwavelength plasmonic array: anisotropic model

abstract: We calculate the light transmission by a subwavelength plasmonic array using the boundary element method for parallel cylinders with different cross-sections: circular or elliptic with axes ratio 4:1. We demonstrate that the plasmonic resonance is sharper for the case of ellipses with a large horizontal axis. This structure is susceptible to the refractive index variations of media since the high derivative of reflection and transmission coefficients are near the angle of total internal reflection. To obtain an approximate analytical expression, we use the model of a metallic layer. We explore the "sandwich" structure with an anisotropic film between two dielectrics and demonstrate its quantitative agreement with numerical results.


title: Towards Safe, Explainable, and Regulated Autonomous Driving

abstract: There has been recent and growing interest in the development and deployment of autonomous vehicles, encouraged by the empirical successes of powerful artificial intelligence techniques (AI), especially in the applications of deep learning and reinforcement learning. However, as demonstrated by recent traffic accidents, autonomous driving technology is not fully reliable for safe deployment. As AI is the main technology behind the intelligent navigation systems of self-driving vehicles, both the stakeholders and transportation regulators require their AI-driven software architecture to be safe, explainable, and regulatory compliant. In this paper, we propose a design framework that integrates autonomous control, explainable AI (XAI), and regulatory compliance to address this issue, and then provide an initial validation of the framework with a critical analysis in a case study. Moreover, we describe relevant XAI approaches that can help achieve the goals of the framework.


title: Electric Ferro-Axial Moment as Nanometric Rotator and Source of Longitudinal Spin Current

abstract: An electric ferro-axial moment, which is characterized by a nonzero expectation value of a time-reversal-even axial vector, exhibits distinct spatial-inversion and time-reversal properties from conventional ferroelectric, ferromagnetic, and ferro-magnetoelectric orders. Nevertheless, physical properties characteristic of the electric ferro-axial moment have been obscure owing to the absence of its conjugate electromagnetic fields. We theoretically investigate consequences of the presence of the ferro-axial moment on the basis of the symmetry and microscopic model analyses. We show that atomic-scale electric toroidal multipoles are the heart of the ferro-axial moment, which act as a nanometric rotator against external stimuli. Furthermore, we propose an intrinsic generation of a spin current parallel to an applied electric field in both metals and insulators. Our results not only provide a deep microscopic understanding of the role of the ferro-axial moment but also stimulate a new development for functional materials with use of the electric toroidal moment.


title: StylePart: Image-based Shape Part Manipulation

abstract: Due to a lack of image-based "part controllers", shape manipulation of man-made shape images, such as resizing the backrest of a chair or replacing a cup handle is not intuitive. To tackle this problem, we present StylePart, a framework that enables direct shape manipulation of an image by leveraging generative models of both images and 3D shapes. Our key contribution is a shape-consistent latent mapping function that connects the image generative latent space and the 3D man-made shape attribute latent space. Our method "forwardly maps" the image content to its corresponding 3D shape attributes, where the shape part can be easily manipulated. The attribute codes of the manipulated 3D shape are then "backwardly mapped" to the image latent code to obtain the final manipulated image. We demonstrate our approach through various manipulation tasks, including part replacement, part resizing, and viewpoint manipulation, and evaluate its effectiveness through extensive ablation studies.


title: One-Pot Printing of Robust Multimaterial Devices

abstract: Polymer 3D printing is a broad set of manufacturing methods that permit the fabrication of complex architectures, and, as a result, numerous efforts focus on formulating processible chemistries that produce desirable material behavior in printed parts. However, current resin chemistries typically result in a single fixed set of properties once fully polymerized, a fact that poses significant engineering challenges to obtaining multimaterial devices. As an alternative to single-property materials, we introduce a ternary sequential reaction scheme that exhibits diverse multimaterial properties by profoundly altering the polymer microstructure from within a single resin composition. In this system, the photodosage during 3D printing sets both the shape and extent of conversion for each subsequent reaction. This different polymerization mechanisms of the subsequent stages yield disparate crosslink densities and viscoelastic properties. As a result, our materials possess Young's Moduli spanning over three orders of magnitude (400 kPa < E < 1.6 GPa) with smooth transitions between soft and stiff regions. We successfully pattern a 500x change in modulus in under a millimeter while the sequential assembly of our polymer networks ensures robust interfaces and enhances toughness by 10x compared to the single property materials. Most importantly, the final objects remain stable to UV and thermal aging, a key limitation to applications of previous multimaterial chemistries. We demonstrate the ability to 3D print intricate multimaterial architectures by fabricating a soft, wearable braille display.


title: Real-World Semantic Grasp Detection Based on Attention Mechanism

abstract: Recognizing the category of the object and using the features of the object itself to predict grasp configuration is of great significance to improve the accuracy of the grasp detection model and expand its application. Researchers have been trying to combine these capabilities in an end-to-end network to grasping specific objects in a cluttered scene efficiently. In this paper, we propose an end-to-end semantic grasp detection model, which can accomplish both semantic recognition and grasp detection. And we also design a target feature attention mechanism to guide the model focus on the features of target object ontology for grasp prediction according to the semantic information. This method effectively reduces the background features that are weakly correlated to the target object, thus making the features more unique and guaranteeing the accuracy and efficiency of grasp detection. Experimental results show that the proposed method can achieve 98.38% accuracy in Cornell Grasp Dataset. Furthermore, our results on complex multi-object scenarios or more rigorous evaluation metrics show the domain adaptability of our method over the state-of-the-art.


title: Intrusion of liquids into liquid infused surfaces with nanoscale roughness

abstract: We present a theoretical study of the intrusion of an ambient liquid into pores of a nano-corrugated wall w. The pores are prefilled with a liquid lubricant which adheres to the walls of the pores more strongly than the ambient liquid. The two liquids are modeled as a binary mixture of two types of particles, A and B. The mixture can decompose into an A-rich(ambient) liquid, and a B-rich(lubricant) liquid. The wall attracts B particles more strongly than A particles. The ratio of w-A to w-B interaction strengths is changed to tune the contact angle ${\theta}_{AB}$ formed by the A-rich/B-rich liquid interface between the two fluids and the corresponding planar wall. We use classical density functional theory, in order to capture the effects of microscopic details on the intrusion transition as a function of composition and pressure of the ambient liquid, for various values of ${\theta}_{AB}$ and different pit sizes. We also studied the reverse process in which a pore initially filled with the ambient liquid is refilled with the lubricant. For small ${\theta}_{AB}$ ,there is no hysteresis. However, beyond a certain ${\theta}_{AB}$, we find the presence of hysteresis, which increases with increasing ${\theta}_{AB}$. The dependence of location of the intrusion on ${\theta}_{AB}$ and on the pit size, qualitatively follows the corresponding shift of the capillary-coexistence line away from the bulk liquid-liquid coexistence line, as predicted by a macroscopic capillarity model. The quantitative discrepancies become larger for narrower cavities. For the considered geometry, macroscopic capillarity theory predicts an open hysteresis loop above a threshold value of ${\theta}_{AB} = 54.7^\circ$. This threshold, however, shifts to much higher values if widths of the pores become smaller than roughly ten times the diameter of the fluid particles.


title: ACR-Pose: Adversarial Canonical Representation Reconstruction Network for Category Level 6D Object Pose Estimation

abstract: Recently, category-level 6D object pose estimation has achieved significant improvements with the development of reconstructing canonical 3D representations. However, the reconstruction quality of existing methods is still far from excellent. In this paper, we propose a novel Adversarial Canonical Representation Reconstruction Network named ACR-Pose. ACR-Pose consists of a Reconstructor and a Discriminator. The Reconstructor is primarily composed of two novel sub-modules: Pose-Irrelevant Module (PIM) and Relational Reconstruction Module (RRM). PIM tends to learn canonical-related features to make the Reconstructor insensitive to rotation and translation, while RRM explores essential relational information between different input modalities to generate high-quality features. Subsequently, a Discriminator is employed to guide the Reconstructor to generate realistic canonical representations. The Reconstructor and the Discriminator learn to optimize through adversarial training. Experimental results on the prevalent NOCS-CAMERA and NOCS-REAL datasets demonstrate that our method achieves state-of-the-art performance.


title: Universal expansions of scattering amplitudes for gravitons, gluons and Goldstone particles

abstract: Tree-level scattering amplitudes for gravitons, gluons and Goldstone particles in any dimensions are strongly constrained by basic principles, and they are intimately related to each other via various relations. We study two types of "universal expansions" with respect to gauge bosons and Goldstone bosons: the former express tree amplitudes in Einstein gravity (Yang-Mills) as linear combinations of single-trace Einstein-Yang-Mills (Yang-Mills-$\phi^3$) amplitudes with coefficients given by Lorentz products of polarizations and momenta; the latter express tree amplitudes in non-linear sigma model, (Dirac-)Born-Infeld and a special Galileon theory, as linear combinations of single-trace mixed amplitudes with particles of lower "degree of Adler's zero" and coefficients given by products of Mandelstam variables. We trace the origin of gauge-theory expansions to the powerful uniqueness theorem based on gauge invariance, and expansions in effective field theories can be derived from gauge-theory ones via a special dimension reduction.


title: Community Structure and Its Stability on a Face-to-Face Interaction Network in Kyoto City

abstract: As social behavior plays an essential role in people's lives, the features of face-to-face interaction networks must be examined to understand people's social behavior. In this study, we focused on the stable community structure of a face-to-face interaction network because it explains the persistent communities caused by the stationary communication patterns of citizens and visitors in a city. We regarded citizens and visitors as two kinds of particles and the community as a phase and theorized the stability of the community structure using the equilibrium conditions among communities. We formulated the chemical potentials of the communities and examined whether they were in equilibrium under the assumption of a canonical ensemble. We estimated the chemical potentials of persistent communities and found that these values matched within approximately 10% error for each day. This result indicates that the cause of persistent communities is the stability of community structure.


title: Pre-scaling and Codebook Design for Joint Radar and Communication Based on Index Modulation

abstract: This paper develops an efficient index modulation (IM) approach for the joint radar-communication (JRC) system based on a multi-carrier multiple-input multiple-output (MIMO) radar. The communication information is embedded into the transmitted radar pulses by selecting the corresponding indices of the carrier frequencies and antenna allocations, providing two degrees of freedom. Our contribution involves the development of a novel codebook based minimum Euclidean distance (MED) maximization and a constellation randomization pre-scaling (CRPS) scheme for efficient IM-JRC transmission. It can be inferred that the IM approach integrating the CRPS scheme followed by the codebook design maximizes the signal-to-noise ratio gain. The numerical results support the effectiveness of the proposed approach and show enhanced bit error rate performance when compared to the existing baseline.


title: Artin braid groups and spin structures

abstract: We study the action of the Artin braid group B_{2g+2} on the set of spin structures on a hyperelliptic curve of genus g, which reduces to that of the symmetric group. It has been already described in terms of the classical theory of Riemann surfaces. In this paper, we compute the S_{2g+2}-orbits of the spin structures of genus $g$ and the isotropy group G_i of each orbit in a purely combinatorial way.


title: Approximation types describing extensions of valuations to rational function fields

abstract: We introduce the notion of {\it approximation type} for the partial, and in certain cases the total description of extensions of a given valuation from a field $K$ to the rational function field $K(x)$. To every extension, a unique approximation type of $x$ over $K$ is associated, while $x$ may be the limit of many pseudo Cauchy sequences. Approximation types also provide information in cases where the extensions are not immediate, and we prove that they correspond bijectively to the extensions when $K$ is algebraically closed or lies dense in its algebraic closure.


title: Kalman filters as the steady-state solution of gradient descent on variational free energy

abstract: The Kalman filter is an algorithm for the estimation of hidden variables in dynamical systems under linear Gauss-Markov assumptions with widespread applications across different fields. Recently, its Bayesian interpretation has received a growing amount of attention especially in neuroscience, robotics and machine learning. In neuroscience, in particular, models of perception and control under the banners of predictive coding, optimal feedback control, active inference and more generally the so-called Bayesian brain hypothesis, have all heavily relied on ideas behind the Kalman filter. Active inference, an algorithmic theory based on the free energy principle, specifically builds on approximate Bayesian inference methods proposing a variational account of neural computation and behaviour in terms of gradients of variational free energy. Using this ambitious framework, several works have discussed different possible relations between free energy minimisation and standard Kalman filters. With a few exceptions, however, such relations point at a mere qualitative resemblance or are built on a set of very diverse comparisons based on purported differences between free energy minimisation and Kalman filtering. In this work, we present a straightforward derivation of Kalman filters consistent with active inference via a variational treatment of free energy minimisation in terms of gradient descent. The approach considered here offers a more direct link between models of neural dynamics as gradient descent and standard accounts of perception and decision making based on probabilistic inference, further bridging the gap between hypotheses about neural implementation and computational principles in brain and behavioural sciences.

categories: q-bio.NC cs.SY eess.SY math.OC math.ST stat.TH


title: FAMINet: Learning Real-time Semi-supervised Video Object Segmentation with Steepest Optimized Optical Flow

abstract: Semi-supervised video object segmentation (VOS) aims to segment a few moving objects in a video sequence, where these objects are specified by annotation of first frame. The optical flow has been considered in many existing semi-supervised VOS methods to improve the segmentation accuracy. However, the optical flow-based semi-supervised VOS methods cannot run in real time due to high complexity of optical flow estimation. A FAMINet, which consists of a feature extraction network (F), an appearance network (A), a motion network (M), and an integration network (I), is proposed in this study to address the abovementioned problem. The appearance network outputs an initial segmentation result based on static appearances of objects. The motion network estimates the optical flow via very few parameters, which are optimized rapidly by an online memorizing algorithm named relaxed steepest descent. The integration network refines the initial segmentation result using the optical flow. Extensive experiments demonstrate that the FAMINet outperforms other state-of-the-art semi-supervised VOS methods on the DAVIS and YouTube-VOS benchmarks, and it achieves a good trade-off between accuracy and efficiency. Our code is available at https://github.com/liuziyang123/FAMINet.


title: Statistical ensembles for phase coexistence states specified by noncommutative additive observables

abstract: A phase coexistence state cannot be specified uniquely by any intensive parameters, such as the temperature and the magnetic field, because they take the same values over all coexisting phases. It can be specified uniquely only by an appropriate set of additive observables. Hence, to analyze phase coexistence states the statistical ensembles that are specified by additive observables have been employed, such as the microcanonical and restricted ensembles. However, such ensembles are ill-defined or ill-behaved when some of the additive observables do not commute with each other. Here, we solve this fundamental problem by extending a generalized ensemble in such a way that it is applicable to phase coexistence states which are specified by noncommutative additive observables. We prove that this ensemble correctly gives the density matrix corresponding to phase coexistence states of general quantum systems as well as the thermodynamic functions. Furthermore, these ensembles are convenient for practical calculations because of good analytic properties and useful formulas by which temperature and other intensive parameters are directly obtained from the expectation values of the additive observables. As a demonstration, we apply our formulation to a two-dimensional system whose phase coexistence states are specified by an additive observable (order parameter) that does not commute with the Hamiltonian.


title: Temporal-MPI: Enabling Multi-Plane Images for Dynamic Scene Modelling via Temporal Basis Learning

abstract: Novel view synthesis of static scenes has achieved remarkable advancements in producing photo-realistic results. However, key challenges remain for immersive rendering of dynamic scenes. One of the seminal image-based rendering method, the multi-plane image (MPI), produces high novel-view synthesis quality for static scenes. But modelling dynamic contents by MPI is not studied. In this paper, we propose a novel Temporal-MPI representation which is able to encode the rich 3D and dynamic variation information throughout the entire video as compact temporal basis and coefficients jointly learned. Time-instance MPI for rendering can be generated efficiently using mini-seconds by linear combinations of temporal basis and coefficients from Temporal-MPI. Thus novel-views at arbitrary time-instance will be able to be rendered via Temporal-MPI in real-time with high visual quality. Our method is trained and evaluated on Nvidia Dynamic Scene Dataset. We show that our proposed Temporal- MPI is much faster and more compact compared with other state-of-the-art dynamic scene modelling methods.


title: Particle creation by strong fields and quantum anomalies

abstract: Particle creation by strong and time-varying backgrounds is a robust prediction of quantum field theory. Another well-established feature of field theory is that classical symmetries do not always extend to the quantized theory. When this occurs, we speak of quantum anomalies. In this contribution we discuss the entwining relationship between both predictions, relating chiral anomalies with an underlying process of particle creation. Within this context, we will also argue that the symmetry under electric-magnetic duality rotations of the source-free Maxwell theory is anomalous in curved spacetime. This is a quantum effect, and it can be understood as the generalization of the fermion chiral anomaly to fields of spin one. This implies that the net polarization of photons propagating in a gravitational field could change in time.


title: A Neural Network Model of the Entorhinal Cortex and Hippocampus for Event-order Memory Processing

abstract: To solve a navigation task based on experiences, we need a mechanism to associate places with objects and to recall them along the course of action. In a reward-oriented task, if the route to a reward location is simulated in mind after experiencing it once, it might be possible that the reward is gained efficiently. One way to solve it is to incorporate a biologically plausible mechanism. In this study, we propose a neural network that stores a sequence of events associated with a reward. The proposed network recalls the reward location by tracing them in its mind in order. We simulated a virtual mouse that explores a figure-eight maze and recalls the route to the reward location. During the learning period, a sequence of events relating to firing along a passage was temporarily stored in the heteroassociative network, and the sequence of events is consolidated in the synaptic weight matrix when a reward is fed. For retrieval, the sequential activation of conjunctive cue-place cells toward the reward location is internally generated by an impetus input. In the figure-eight maze task, the location of the reward was estimated by mind travel, irrespective of whether the reward is in the counterclockwise or distant clockwise route. The mechanism of efficiently reaching the goal by mind travel in the brain based on experiences is beneficial for mobile service robots that perform autonomous navigation.


title: Quaternion-Based Graph Convolution Network for Recommendation

abstract: Graph Convolution Network (GCN) has been widely applied in recommender systems for its representation learning capability on user and item embeddings. However, GCN is vulnerable to noisy and incomplete graphs, which are common in real world, due to its recursive message propagation mechanism. In the literature, some work propose to remove the feature transformation during message propagation, but making it unable to effectively capture the graph structural features. Moreover, they model users and items in the Euclidean space, which has been demonstrated to have high distortion when modeling complex graphs, further degrading the capability to capture the graph structural features and leading to sub-optimal performance. To this end, in this paper, we propose a simple yet effective Quaternion-based Graph Convolution Network (QGCN) recommendation model. In the proposed model, we utilize the hyper-complex Quaternion space to learn user and item representations and feature transformation to improve both performance and robustness. Specifically, we first embed all users and items into the Quaternion space. Then, we introduce the quaternion embedding propagation layers with quaternion feature transformation to perform message propagation. Finally, we combine the embeddings generated at each layer with the mean pooling strategy to obtain the final embeddings for recommendation. Extensive experiments on three public benchmark datasets demonstrate that our proposed QGCN model outperforms baseline methods by a large margin.


title: $ Ig^*$-closed sets and its certain properties in $ \sigma $-spaces with respect to an ideal

abstract: Here we have introduced and studied the idea of $ Ig^*$-closed set with respect to an ideal and investigated some of its properties in Alexandroff spaces. We have also introduced $ Ig^*$-$T_0 $ axiom, $ Ig^*$-$T_1$ axiom, $ Ig^*$-$T_\omega $ axiom and explored a relation among them


title: Approximation Algorithms for LCS and LIS with Truly Improved Running Times

abstract: Longest common subsequence ($\mathsf{LCS}$) is a classic and central problem in combinatorial optimization. While $\mathsf{LCS}$ admits a quadratic time solution, recent evidence suggests that solving the problem may be impossible in truly subquadratic time. A special case of $\mathsf{LCS}$ wherein each character appears at most once in every string is equivalent to the longest increasing subsequence problem ($\mathsf{LIS}$) which can be solved in quasilinear time. In this work, we present novel algorithms for approximating $\mathsf{LCS}$ in truly subquadratic time and $\mathsf{LIS}$ in truly sublinear time. Our approximation factors depend on the ratio of the optimal solution size over the input size. We denote this ratio by $\lambda$ and obtain the following results for $\mathsf{LCS}$ and $\mathsf{LIS}$ without any prior knowledge of $\lambda$. $\bullet$ A truly subquadratic time algorithm for $\mathsf{LCS}$ with approximation factor $\Omega(\lambda^3)$. $\bullet$A truly sublinear time algorithm for $\mathsf{LIS}$ with approximation factor $\Omega(\lambda^3)$. Triangle inequality was recently used by [Boroujeni, Ehsani, Ghodsi, HajiAghayi and Seddighin SODA 2018] and [Charkraborty, Das, Goldenberg, Koucky and Saks FOCS 2018] to present new approximation algorithms for edit distance. Our techniques for $\mathsf{LCS}$ extend the notion of triangle inequality to non-metric settings.


title: Edge-Enhanced Global Disentangled Graph Neural Network for Sequential Recommendation

abstract: Sequential recommendation has been a widely popular topic of recommender systems. Existing works have contributed to enhancing the prediction ability of sequential recommendation systems based on various methods, such as recurrent networks and self-attention mechanisms. However, they fail to discover and distinguish various relationships between items, which could be underlying factors which motivate user behaviors. In this paper, we propose an Edge-Enhanced Global Disentangled Graph Neural Network (EGD-GNN) model to capture the relation information between items for global item representation and local user intention learning. At the global level, we build a global-link graph over all sequences to model item relationships. Then a channel-aware disentangled learning layer is designed to decompose edge information into different channels, which can be aggregated to represent the target item from its neighbors. At the local level, we apply a variational auto-encoder framework to learn user intention over the current sequence. We evaluate our proposed method on three real-world datasets. Experimental results show that our model can get a crucial improvement over state-of-the-art baselines and is able to distinguish item features.


title: Intermediate Class of Warm Pseudoscalar Inflation

abstract: High dissipative regime of warm pseudoscalar inflation model \cite{Kamali:2019ppi} with an approximately constant value of dissipation parameter $Q$ is studied. { Intermediate solution of the scale-factor related to the accelerated expansion of the Universe which is rolled out by observational data in the context of standard (cold) model of inflation is used.} There is a region of free parameters phase-space of the model which is interestingly compatible with recent observational data. It is discussed that the model is also compatible with the swampland criteria in a broad range of parameters phase-space and TCC in a limited area of parameters.


title: Graph-augmented Learning to Rank for Querying Large-scale Knowledge Graph

abstract: Knowledge graph question answering (KGQA) based on information retrieval aims to answer a question by retrieving answer from a large-scale knowledge graph. Most existing methods first roughly retrieve the knowledge subgraphs (KSG) that may contain candidate answer, and then search for the exact answer in the KSG. However, the KSG may contain thousands of candidate nodes since the knowledge graph involved in querying is often of large scale, thus decreasing the performance of answer selection. To tackle this problem, we first propose to partition the retrieved KSG to several smaller sub-KSGs via a new subgraph partition algorithm and then present a graph-augmented learning to rank model to select the top-ranked sub-KSGs from them. Our proposed model combines a novel subgraph matching networks to capture global interactions in both question and subgraphs, and an Enhanced Bilateral Multi-Perspective Matching model is proposed to capture local interactions. Finally, we apply an answer selection model on the full KSG and the top-ranked sub-KSGs respectively to validate the effectiveness of our proposed graph-augmented learning to rank method. The experimental results on multiple benchmark datasets have demonstrated the effectiveness of our approach.


title: Bootstrapping Globally Optimal Variational Calculus Solutions

abstract: Whereas in a coordinate-dependent setting the Euler-Lagrange equations establish necessary conditions for solving variational problems in which both the integrands of functionals and the resulting paths are assumed to be sufficiently smooth, uniqueness and global optimality are generally hard to prove in the absence of convexity conditions, and often times they may not even exist. This is also true for variational problems on Lie groups, with the Euler-Poincar\'{e} equation establishing necessary conditions. The difficulties compound when integrands and/or the optimal paths are not sufficiently regular, since in this case the classical necessary conditions no longer apply. This article therefore reviews several nonstandard cases where unique globally optimal solutions can be guaranteed, and establishes a ``bootstrapping'' process to build new globally optimal variational solutions on larger spaces from existing ones on smaller spaces. Surprisingly, it is possible to prove global optimality in some nonconvex cases where even the regularity conditions required for classical necessary conditions do not hold. This general theory is then applied to several topics such as optimal framing of curves in three-dimensional Euclidean space, optimal motion interpolation, and optimal reparametrization of video sequences to compare salient actions.


title: Using a nested anomaly detection machine learning algorithm to study the neutral triple gauge couplings at an \texorpdfstring{$e^+e^-$}{e+e-} collider

abstract: Anomaly detection algorithms have been proved to be useful in the search of new physics beyond the Standard Model. However, a prerequisite for using an anomaly detection algorithm is that the signal to be sought is indeed anomalous. This does not always hold true, for example when interference between new physics and the Standard Model becomes important. In this case, the search of new physics is no longer an anomaly detection. To overcome this difficulty, we propose a nested anomaly detection algorithm, which appears to be useful in the study of neutral triple gauge couplings at the CEPC, the ILC and the FCC-ee. Our approach inherits the advantages of the anomaly detection algorithm been nested, while at the same time, it is no longer an anomaly detection algorithm. As a complement to anomaly detection algorithms, it can achieve better results on problems that are no longer anomaly detection.


title: Towards Scalable Unpaired Virtual Try-On via Patch-Routed Spatially-Adaptive GAN

abstract: Image-based virtual try-on is one of the most promising applications of human-centric image generation due to its tremendous real-world potential. Yet, as most try-on approaches fit in-shop garments onto a target person, they require the laborious and restrictive construction of a paired training dataset, severely limiting their scalability. While a few recent works attempt to transfer garments directly from one person to another, alleviating the need to collect paired datasets, their performance is impacted by the lack of paired (supervised) information. In particular, disentangling style and spatial information of the garment becomes a challenge, which existing methods either address by requiring auxiliary data or extensive online optimization procedures, thereby still inhibiting their scalability. To achieve a \emph{scalable} virtual try-on system that can transfer arbitrary garments between a source and a target person in an unsupervised manner, we thus propose a texture-preserving end-to-end network, the PAtch-routed SpaTially-Adaptive GAN (PASTA-GAN), that facilitates real-world unpaired virtual try-on. Specifically, to disentangle the style and spatial information of each garment, PASTA-GAN consists of an innovative patch-routed disentanglement module for successfully retaining garment texture and shape characteristics. Guided by the source person keypoints, the patch-routed disentanglement module first decouples garments into normalized patches, thus eliminating the inherent spatial information of the garment, and then reconstructs the normalized patches to the warped garment complying with the target person pose. Given the warped garment, PASTA-GAN further introduces novel spatially-adaptive residual blocks that guide the generator to synthesize more realistic garment details.


title: Triples-to-Text Generation with Reinforcement Learning Based Graph-augmented Neural Networks

abstract: Considering a collection of RDF triples, the RDF-to-text generation task aims to generate a text description. Most previous methods solve this task using a sequence-to-sequence model or using a graph-based model to encode RDF triples and to generate a text sequence. Nevertheless, these approaches fail to clearly model the local and global structural information between and within RDF triples. Moreover, the previous methods also face the non-negligible problem of low faithfulness of the generated text, which seriously affects the overall performance of these models. To solve these problems, we propose a model combining two new graph-augmented structural neural encoders to jointly learn both local and global structural information in the input RDF triples. To further improve text faithfulness, we innovatively introduce a reinforcement learning (RL) reward based on information extraction (IE). We first extract triples from the generated text using a pretrained IE model and regard the correct number of the extracted triples as the additional RL reward. Experimental results on two benchmark datasets demonstrate that our proposed model outperforms the state-of-the-art baselines, and the additional reinforcement learning reward does help to improve the faithfulness of the generated text.