title: Recurrent neural networks that generalize from examples and optimize by dreaming

abstract: The gap between the huge volumes of data needed to train artificial neural networks and the relatively small amount of data needed by their biological counterparts is a central puzzle in machine learning. Here, inspired by biological information-processing, we introduce a generalized Hopfield network where pairwise couplings between neurons are built according to Hebb's prescription for on-line learning and allow also for (suitably stylized) off-line sleeping mechanisms. Moreover, in order to retain a learning framework, here the patterns are not assumed to be available, instead, we let the network experience solely a dataset made of a sample of noisy examples for each pattern. We analyze the model by statistical-mechanics tools and we obtain a quantitative picture of its capabilities as functions of its control parameters: the resulting network is an associative memory for pattern recognition that learns from examples on-line, generalizes and optimizes its storage capacity by off-line sleeping. Remarkably, the sleeping mechanisms always significantly reduce (up to $\approx 90\%$) the dataset size required to correctly generalize, further, there are memory loads that are prohibitive to Hebbian networks without sleeping (no matter the size and quality of the provided examples), but that are easily handled by the present "rested" neural networks.


title: Vision-Language Pre-Training for Multimodal Aspect-Based Sentiment Analysis

abstract: As an important task in sentiment analysis, Multimodal Aspect-Based Sentiment Analysis (MABSA) has attracted increasing attention in recent years. However, previous approaches either (i) use separately pre-trained visual and textual models, which ignore the crossmodal alignment or (ii) use vision-language models pre-trained with general pre-training tasks, which are inadequate to identify finegrained aspects, opinions, and their alignments across modalities. To tackle these limitations, we propose a task-specific Vision-Language Pre-training framework for MABSA (VLPMABSA), which is a unified multimodal encoder-decoder architecture for all the pretraining and downstream tasks. We further design three types of task-specific pre-training tasks from the language, vision, and multimodal modalities, respectively. Experimental results show that our approach generally outperforms the state-of-the-art approaches on three MABSA subtasks. Further analysis demonstrates the effectiveness of each pretraining task. The source code is publicly released at https://github.com/NUSTM/VLP-MABSA.


title: Incompatibility of observables, channels and instruments in information theories

abstract: Every theory of information, including classical and quantum, can be studied in the framework of operational probabilistic theories--where the notion of test generalizes that of quantum instrument, namely a collection of quantum operations summing to a channel, and simple rules are given for the composition of tests in parallel and in sequence. Here we study the notion of compatibility for tests of an operational probabilistic theory. Following the quantum literature, we first introduce the notion of strong compatibility, and then we illustrate its ultimate relaxation, that we deem weak compatibility. It is shown that the two notions coincide in the case of observation tests--which are the counterpart of quantum POVMs--while there exist weakly compatible channels that are not strongly compatible. We prove necessary and sufficient conditions for a theory to exhibit incompatible tests. We show that a theory admits of incompatible tests if and only if some information cannot be extracted without disturbance.


title: Feasibility study on ground-state cooling and single-phonon readout of trapped electrons using hybrid quantum systems

abstract: Qubits of long coherence time and fast quantum operations are long-sought objectives towards the realization of high-fidelity quantum operations and their applications to the quantum technologies. An electron levitated in a vacuum by a Paul trap is expected to be a good candidate, for its light mass and hence the high secular frequency which allows for the faster gate operations than those in trapped ions. Controlling the motional state of the trapped electron is a crucial issue, for it mediates an interaction between electron spins, intrinsic qubits embedded in electrons, and its decoherence results in degraded fidelity of two-qubit gates. In addition, an efficient readout of the motional state is important, regarding the possibility of detecting spin state by using it. Despite of such an importance, how to achieve the motional ground state and how to efficiently detect it are not reported so far. Here we propose methods addressing these issues by utilizing hybrid quantum systems involving electron-superconducting circuit and electron-ion coupled systems and analyze the feasibility of our schemes. In both systems, we show that the ground-state cooling and the single-phonon readout of the motional state of the trapped electron are possible. Our work shed light on the way to precisely control the motional states of the trapped electrons, that provides an interesting playground for the development of quantum technologies.


title: On an interior-exterior nonoverlapping domain decomposition method for the Poisson--Boltzmann equation

abstract: A nonoverlapping domain decomposition method is studied for the linearized Poisson--Boltzmann equation, which is essentially an interior-exterior transmission problem with bounded interior and unbounded exterior. This problem is different from the classical Schwarz alternating method for bounded nonoverlapping subdomains well studied by Lions in 1990, and is challenging due to the existence of unbounded subdomain. To obtain the convergence, a new concept of interior-exterior Sobolev constant is introduced and a spectral equivalence of related Dirichlet-to-Neumann operators is established afterwards. We prove rigorously that the spectral equivalence results in the convergence of interior-exterior iteration. Some numerical simulations are provided to investigate the optimal stepping parameter of iteration and to verify our convergence analysis.


title: Exploring the potential of neural networks to predict statistics of solar wind turbulence

abstract: Time series datasets often have missing or corrupted entries, which need to be ignored in subsequent data analysis. For example, in the context of space physics, calibration issues, satellite telemetry issues, and unexpected events can make parts of a time series unusable. Various approaches exist to tackle this problem, including mean/median imputation, linear interpolation, and autoregressive modeling. Here we study the utility of artificial neural networks (ANNs) to predict statistics, particularly second-order structure functions, of turbulent time series concerning the solar wind. Using a dataset with artificial gaps, a neural network is trained to predict second-order structure functions and then tested on an unseen dataset to quantify its performance. A small feedforward ANN, with only 20 hidden neurons, can predict the large-scale fluctuation amplitudes better than mean imputation or linear interpolation when the percentage of missing data is high. Although, they perform worse than the other methods when it comes to capturing both the shape and fluctuation amplitude together, their performance is better in a statistical sense for large fractions of missing data. Caveats regarding their utility, the optimisation procedure, and potential future improvements are discussed.


title: A phase field model combined with genetic algorithm for polycrystalline hafnium zirconium oxide ferroelectrics

abstract: Ferroelectric hafnium zirconium oxide (HZO) thin films show significant promise for applications in ferroelectric random-access memory, ferroelectric field-effect transistors, and ferroelectric tunneling junctions. However, there are shortcomings in understanding ferroelectric switching, which is crucial in the operation of these devices. Here a computational model based on phase field method is developed to simulate the switching behavior of polycrystalline HZO thin films. Furthermore, we introduce a novel approach to optimize the effective Landau coefficients describing the free energy of HZO by combining the phase field model with a genetic algorithm. We validate the model by accurately simulating switching curves for HZO thin films with different ferroelectric phase fractions. The simulated domain dynamics during switching also shows amazing similarity to the available experimental observations. The present work also provides fundamental insights into enhancing the ferroelectricity in HZO thin films by controlling grain morphology and crystalline texture. It can potentially be extended to improve the ferroelectric properties of other hafnia based thin films.


title: Higher order log-concavity of the overpartition function and its consequences

abstract: Let $\bar{p}(n)$ denote the overpartition function. In this paper, we study the asymptotic higher order $\log$-concavity property of the overpatition function in a similar framework done by Hou and Zhang for the partition function. This will enable us to move on further in order to prove $\log$-concavity of overpartitions, explicitly by studying the asymptotic expansion of the quotient $\bar{p}(n-1)\bar{p}(n+1)/\bar{p}(n)^2$ upto a certain order so that one can finally ends up with the phenomena of $2$-$\log$-concavity and higher order Tur\'{a}n property of $\bar{p}(n)$ by following a sort of unified approach.


title: An Extendable, Efficient and Effective Transformer-based Object Detector

abstract: Transformers have been widely used in numerous vision problems especially for visual recognition and detection. Detection transformers are the first fully end-to-end learning systems for object detection, while vision transformers are the first fully transformer-based architecture for image classification. In this paper, we integrate Vision and Detection Transformers (ViDT) to construct an effective and efficient object detector. ViDT introduces a reconfigured attention module to extend the recent Swin Transformer to be a standalone object detector, followed by a computationally efficient transformer decoder that exploits multi-scale features and auxiliary techniques essential to boost the detection performance without much increase in computational load. In addition, we extend it to ViDT+ to support joint-task learning for object detection and instance segmentation. Specifically, we attach an efficient multi-scale feature fusion layer and utilize two more auxiliary training losses, IoU-aware loss and token labeling loss. Extensive evaluation results on the Microsoft COCO benchmark dataset demonstrate that ViDT obtains the best AP and latency trade-off among existing fully transformer-based object detectors, and its extended ViDT+ achieves 53.2AP owing to its high scalability for large models. The source code and trained models are available at https://github.com/naver-ai/vidt.


title: AFSC: Adaptive Fourier Space Compression for Anomaly Detection

abstract: Anomaly Detection (AD) on medical images enables a model to recognize any type of anomaly pattern without lesion-specific supervised learning. Data augmentation based methods construct pseudo-healthy images by "pasting" fake lesions on real healthy ones, and a network is trained to predict healthy images in a supervised manner. The lesion can be found by difference between the unhealthy input and pseudo-healthy output. However, using only manually designed fake lesions fail to approximate to irregular real lesions, hence limiting the model generalization. We assume by exploring the intrinsic data property within images, we can distinguish previously unseen lesions from healthy regions in an unhealthy image. In this study, we propose an Adaptive Fourier Space Compression (AFSC) module to distill healthy feature for AD. The compression of both magnitude and phase in frequency domain addresses the hyper intensity and diverse position of lesions. Experimental results on the BraTS and MS-SEG datasets demonstrate an AFSC baseline is able to produce promising detection results, and an AFSC module can be effectively embedded into existing AD methods.


title: Target-Relevant Knowledge Preservation for Multi-Source Domain Adaptive Object Detection

abstract: Domain adaptive object detection (DAOD) is a promising way to alleviate performance drop of detectors in new scenes. Albeit great effort made in single source domain adaptation, a more generalized task with multiple source domains remains not being well explored, due to knowledge degradation during their combination. To address this issue, we propose a novel approach, namely target-relevant knowledge preservation (TRKP), to unsupervised multi-source DAOD. Specifically, TRKP adopts the teacher-student framework, where the multi-head teacher network is built to extract knowledge from labeled source domains and guide the student network to learn detectors in unlabeled target domain. The teacher network is further equipped with an adversarial multi-source disentanglement (AMSD) module to preserve source domain-specific knowledge and simultaneously perform cross-domain alignment. Besides, a holistic target-relevant mining (HTRM) scheme is developed to re-weight the source images according to the source-target relevance. By this means, the teacher network is enforced to capture target-relevant knowledge, thus benefiting decreasing domain shift when mentoring object detection in the target domain. Extensive experiments are conducted on various widely used benchmarks with new state-of-the-art scores reported, highlighting the effectiveness.


title: Entropy-based Active Learning for Object Detection with Progressive Diversity Constraint

abstract: Active learning is a promising alternative to alleviate the issue of high annotation cost in the computer vision tasks by consciously selecting more informative samples to label. Active learning for object detection is more challenging and existing efforts on it are relatively rare. In this paper, we propose a novel hybrid approach to address this problem, where the instance-level uncertainty and diversity are jointly considered in a bottom-up manner. To balance the computational complexity, the proposed approach is designed as a two-stage procedure. At the first stage, an Entropy-based Non-Maximum Suppression (ENMS) is presented to estimate the uncertainty of every image, which performs NMS according to the entropy in the feature space to remove predictions with redundant information gains. At the second stage, a diverse prototype (DivProto) strategy is explored to ensure the diversity across images by progressively converting it into the intra-class and inter-class diversities of the entropy-based class-specific prototypes. Extensive experiments are conducted on MS COCO and Pascal VOC, and the proposed approach achieves state of the art results and significantly outperforms the other counterparts, highlighting its superiority.


title: MRXCAT-CDTI: A Numerical Cardiac Diffusion Tensor Imaging Phantom

abstract: Magnetic Resonance cardiac diffusion tensor imaging (cDTI) and cardiac intravoxel incoherent motion imaging enables probing of in vivo myofiber architecture and myocardial perfusion surrogates. To study the impact of experimental parameters such as resolution, off-resonances and heart-rate variations, we propose a numerical open-source framework called MRXCAT-CDTI. It allows simulating diffusion and perfusion contrast for spin-echo (SE) and stimulated echo acquisition mode (STEAM) cDTI sequences. The Fourier encoder supports in-plane and/or through-slice off-resonance effects, as well as T2* effects during single-shot image encoding. Optional lesions are included to mimic ischemic and infarcted myocardial regions. MRXCAT-CDTI allows assessing realistic influences on data acquisition, and how these affect the data encoding process and subsequent data processing. As an example, heart-rate variations lead to differences in partial saturation and relaxation of magnetization that end up in errors of 9 to 30% for cDTI angle metrics if not accounted for. For SE echo-planar cDTI, in-plane off-resonance effects more adversely affect cDTI metrics compared to through-slice off-resonances. With this work we propose an open-source MRXCAT-CDTI numerical simulation framework that offers realistic image encoding effects found in cardiac diffusion and perfusion data to systematically study influences of data encoding, reconstruction, and post-processing to promote reproducible research.


title: A Survey on Energy Optimization Techniques in UAV-Based Cellular Networks: From Conventional to Machine Learning Approaches

abstract: Wireless communication networks have been witnessing an unprecedented demand due to the increasing number of connected devices and emerging bandwidth-hungry applications. Albeit many competent technologies for capacity enhancement purposes, such as millimeter wave communications and network densification, there is still room and need for further capacity enhancement in wireless communication networks, especially for the cases of unusual people gatherings, such as sport competitions, musical concerts, etc. Unmanned aerial vehicles (UAVs) have been identified as one of the promising options to enhance the capacity due to their easy implementation, pop up fashion operation, and cost-effective nature. The main idea is to deploy base stations on UAVs and operate them as flying base stations, thereby bringing additional capacity to where it is needed. However, because the UAVs mostly have limited energy storage, their energy consumption must be optimized to increase flight time. In this survey, we investigate different energy optimization techniques with a top-level classification in terms of the optimization algorithm employed; conventional and machine learning (ML). Such classification helps understand the state of the art and the current trend in terms of methodology. In this regard, various optimization techniques are identified from the related literature, and they are presented under the above mentioned classes of employed optimization methods. In addition, for the purpose of completeness, we include a brief tutorial on the optimization methods and power supply and charging mechanisms of UAVs. Moreover, novel concepts, such as reflective intelligent surfaces and landing spot optimization, are also covered to capture the latest trend in the literature.


title: Kinematic study of radio-loud CMEs associated with solar flares and DH type II radio emissions during solar cycles 23 and 24

abstract: We have statistically analyzed 379 radio-loud (RL) CMEs and their associated flares during the period 1996 - 2019 covering both solar cycles (SC) 23 and 24. We classified them into two sets of populations based on the observation period: i) 235 events belong to SC 23 (August 1996 - December 2008) and ii) 144 events belong to SC 24 (January 2009 - December 2019). The average residual acceleration of RL CMEs in SC 24 (--17.39 $\pm$ 43.51 m s$^{-2}$) is two times lower than that of the RL CMEs in SC 23 (--8.29 $\pm$ 36.23 m s$^{-2}$), which means that deceleration of RL CMEs in SC 24 is twice as fast as in SC 23. RL CMEs of SC 23 (1443 $\pm$ 504 km s$^{-1}$; 13.82 $\pm$ 7.40 \emph{R}$_{\circledcirc}$) reach their peak speed at higher altitudes than RL CMEs of SC 24 (1920 $\pm$ 649 km s$^{-1}$; 12.51 $\pm$ 7.41 \emph{R}$_{\circledcirc}$).We also observed that the mean apparent widths of RL CMEs in SC 23 are less than in SC 24which is statistically significant. SC 23 has a lower average CME nose height (3.85 \emph{R}$_{\circledcirc}$) at the start time of DH type II bursts than that of SC 24 (3.46 \emph{R}$_{\circledcirc}$). The starting frequencies of DH type II bursts associated with RL CMEs for SC 24 are significantly larger (formed at lower heights) than that of SC 23. We found that there is a good correlation between the drift rates and the mid-frequencies of DH type II radio bursts for both the solar cycles (\emph{R} = 0.80, $\epsilon$ = 1.53). Most of the RL CMEs kinematics and their associated solar flare properties are found similar for SC 23 and SC 24. We concluded that the reduced total pressure in the heliosphere for SC 24 enables RL CMEs to expand wider and decelerate faster, resulting in DH type II radio emissions at lower heights than SC 23.


title: Augmentation Invariance and Adaptive Sampling in Semantic Segmentation of Agricultural Aerial Images

abstract: In this paper, we investigate the problem of Semantic Segmentation for agricultural aerial imagery. We observe that the existing methods used for this task are designed without considering two characteristics of the aerial data: (i) the top-down perspective implies that the model cannot rely on a fixed semantic structure of the scene, because the same scene may be experienced with different rotations of the sensor; (ii) there can be a strong imbalance in the distribution of semantic classes because the relevant objects of the scene may appear at extremely different scales (e.g., a field of crops and a small vehicle). We propose a solution to these problems based on two ideas: (i) we use together a set of suitable augmentation and a consistency loss to guide the model to learn semantic representations that are invariant to the photometric and geometric shifts typical of the top-down perspective (Augmentation Invariance); (ii) we use a sampling method (Adaptive Sampling) that selects the training images based on a measure of pixel-wise distribution of classes and actual network confidence. With an extensive set of experiments conducted on the Agriculture-Vision dataset, we demonstrate that our proposed strategies improve the performance of the current state-of-the-art method.


title: A toy model for the W/Z mass ratio

abstract: The recently reported $7\sigma$ anomaly in measurements of the W/Z mass ratio, if confirmed, will demand an extension of some kind to the standard model of particle physics. In this paper I consider whether some recently proposed models are capable, in principle, of resolving this anomaly, subject to experimental confirmation.


title: On strong avoiding games

abstract: Given an increasing graph property $\cal F$, the strong Avoider-Avoider $\cal F$ game is played on the edge set of a complete graph. Two players, Red and Blue, take turns in claiming previously unclaimed edges with Red going first, and the player whose graph possesses $\cal F$ first loses the game. If the property $\cal F$ is "containing a fixed graph $H$", we refer to the game as the $H$ game. We prove that Blue has a winning strategy in two strong Avoider-Avoider games, $P_4$ game and ${\cal CC}_{>3}$ game, where ${\cal CC}_{>3}$ is the property of having at least one connected component on more than three vertices. We also study a variant, the strong CAvoider-CAvoider games, with additional requirement that the graph of each of the players must stay connected throughout the game. We prove that Blue has a winning strategy in the strong CAvoider-CAvoider games $S_3$ and $P_4$, as well as in the $Cycle$ game, where the players aim at avoiding all cycles.


title: On the Index of Fraser-Sargent-type minimal surfaces

abstract: Fraser-Sargent surfaces are free boundary minimal surfaces in the four-dimensional unit Euclidean ball. Extended infinitely they define immersed minimal surfaces in the Euclidean space. In the present paper we compute the Morse index and the nullity of these extended minimal surfaces. The parts of these surfaces outside the ball are exterior free boundary minimal surfaces. We provide a numerical evidence that they are stable. As a corollary of these results we obtain a lower bound on the index of Fraser-Sargent surfaces inside the ball. The obtained lower bound is not sharp. We provide computational experiments and state a conjecture about an improved index lower bound. Independently of it we also find an upper bound on the index of Fraser-Sargent surfaces inside the ball.


title: Detection of frequency-dependent dispersion measure toward the millisecond pulsar PSR J2241-5236 from contemporaneous wide-band observations

abstract: Making precise measurements of pulsar dispersion measures (DMs) and applying suitable corrections for them is amongst the major challenges in high-precision timing programmes such as pulsar timing arrays (PTAs). While the advent of wide-band pulsar instrumentation can enable more precise DM measurements and thence improved timing precision, it also necessitates doing careful assessments of frequency-dependent (chromatic) DMs that was theorised by Cordes et al. (2016). Here we report the detection of such an effect in broadband observations of the millisecond pulsar PSR J2241-5236, a high-priority target for current and future PTAs. The observations were made contemporaneously using the wide-band receivers and capabilities now available at the Murchison Widefield Array (MWA), the upgraded Giant Metrewave Radio Telescope (uGMRT) and the Parkes telescopes, thus providing an unprecedentedly large frequency coverage from 80 MHz to 4 GHz. Our analysis shows the measurable changes in DM that scale with the observing frequency ($\nu$) as $\rm \delta DM \sim \nu^{2.5 \pm 0.1}$. We discuss the potential implications of such a frequency dependence in the measured DMs, and the likely impact on the timing noise budget, and comment on the usefulness of low-frequency observations in advancing PTA efforts.


title: Anomaly Detection in Autonomous Driving: A Survey

abstract: Nowadays, there are outstanding strides towards a future with autonomous vehicles on our roads. While the perception of autonomous vehicles performs well under closed-set conditions, they still struggle to handle the unexpected. This survey provides an extensive overview of anomaly detection techniques based on camera, lidar, radar, multimodal and abstract object level data. We provide a systematization including detection approach, corner case level, ability for an online application, and further attributes. We outline the state-of-the-art and point out current research gaps.


title: Field-angle dependence reveals odd-parity superconductivity in CeRh$_2$As$_2$

abstract: CeRh$_2$As$_2$ is an unconventional superconductor with multiple superconducting phases and $T_\mathrm{c} = 0.26$ K. When $H\parallel c$, it shows a field-induced transition at $\mu_0H^* = 4$ T from a low-field superconducting state SC1 to a high-field state SC2 with a large critical field of $\mu_0H_\mathrm{c2} = 14$ T. In contrast, for $H\perp c$, only the SC1 with $\mu_0H_\mathrm{c2} = 2$ T is observed. A simple model based on the crystal symmetry was able to reproduce the phase-diagrams and their anisotropy, identifying SC1 and SC2 with even and odd parity superconducting states, respectively. However, additional orders were observed in the normal state which might have an influence on the change of the superconducting state at $H^*$. Here, we present a comprehensive study of the angle dependence of the upper critical fields using magnetic ac-susceptibility, specific heat and torque on single crystals of CeRh$_2$As$_2$. The experiments show that the state SC2 is strongly suppressed when rotating the magnetic field away from the $c$ axis and it disappears for an angle of 35$^{\circ}$. This behavior agrees perfectly with our extended model of a pseudospin triplet state with $\vec{d}$ vector in the plane and hence allows to nail down that SC2 is indeed the suggested odd-parity state.


title: The expected values, variances and limiting distributions of Gutman index, Schultz index, multiplicative degree-Kirchhoff index and additive degree-Kirchhoff index for a class of random chain networks

abstract: There has been an upsurge of research on complex networks in recent years. The purpose of this paper is to study the mathematical properties of the random chain networks PGn with the help of graph theory. We first solve the expected value expressions of the Gutman index, Schultz index, multiplicative degree-Kirchhoff index and additive degree-Kirchhoff index, and then we get the explicit expression formulas of their variances. Finally, we find that their limiting distributions all have the probabilistic and statistical significance of normal distribution.


title: Multiplicities for Strongly Tempered Spherical Varieties

abstract: In this paper, we study the local multiplicity of 10 strongly tempered spherical varieties. We will formulate a uniform epsilon dichotomy conjecture for all these models regarding the unique distinguished element in tempered $L$-packets. Then we will prove this conjecture in many cases, including all the Archimedean cases.


title: Quasi-static magnetic compression of field-reversed configuration plasma: Amended scalings and limits from two-dimensional MHD equilibrium

abstract: In this work, several key scaling laws of the quasi-static magnetic compression of field reversed configuration (FRC) plasma [Spencer, Tuszewski, and Linford, 1983] are amended from a series of 2D FRC MHD equilibriums numerically obtained using the Grad-Shafranov equation solver NIMEQ. Based on the new scaling for the elongation and the magnetic fields at the separatrix and the wall, the empirically stable limits for the compression ratio, the fusion gain, and the neutron yield are evaluated, which may serve as a more accurate estimate for the upper ceiling of performance from the magnetic compression of FRC plasma as a potential fusion energy as well as neutron source devices.


title: Confinement-driven inverse domain scaling in polycrystalline ErMnO3

abstract: The research on topological phenomena in ferroelectric materials has revolutionized the way we understand polar order. Intriguing examples are polar skyrmions, vortex/anti-vortex structures and ferroelectric incommensurabilties, which promote emergent physical properties ranging from electric-field-controllable chirality to negative capacitance effects. Here, we study the impact of topologically protected vortices on the domain formation in improper ferroelectric ErMnO3 polycrystals, demonstrating inverted domain scaling behavior compared to classical ferroelectrics. We observe that as the grain size increases, smaller domains are formed, which we relate to the interaction of the topological vortices with local strain fields. The inversion of the domain scaling behavior has far-reaching implications, providing fundamentally new opportunities for topology-based domain engineering and the tuning of the electromechanical and dielectric performance of ferroelectrics in general.


title: Does Recommend-Revise Produce Reliable Annotations? An Analysis on Missing Instances in DocRED

abstract: DocRED is a widely used dataset for document-level relation extraction. In the large-scale annotation, a \textit{recommend-revise} scheme is adopted to reduce the workload. Within this scheme, annotators are provided with candidate relation instances from distant supervision, and they then manually supplement and remove relational facts based on the recommendations. However, when comparing DocRED with a subset relabeled from scratch, we find that this scheme results in a considerable amount of false negative samples and an obvious bias towards popular entities and relations. Furthermore, we observe that the models trained on DocRED have low recall on our relabeled dataset and inherit the same bias in the training data. Through the analysis of annotators' behaviors, we figure out the underlying reason for the problems above: the scheme actually discourages annotators from supplementing adequate instances in the revision phase. We appeal to future research to take into consideration the issues with the recommend-revise scheme when designing new models and annotation schemes. The relabeled dataset is released at \url{https://github.com/AndrewZhe/Revisit-DocRED}, to serve as a more reliable test set of document RE models.


title: Geometrical scaling of heavy-quark contributions in the low $x$ region

abstract: We describe the determination of the heavy quarks structure functions $F_{2,L}^{\mathcal{Q}\bar{\mathcal{Q}}}$ with help of the scaling properties. We observe that the structure functions for inclusive charm and bottom production exhibits geometric scaling at low $x$. The geometrical scaling means that the heavy quark structure function is a function of only one dimensionless variable $\tau{\equiv}Q^{2}/Q^{2}_{sat}(x)$ including quark mass. These results are valid for any value of $\delta$, being $x^{-\delta}$ the behavior of the parton densities at low $x$. The determination of the heavy quark structure function is presented as a parameterization of the proton structure function $F_{2}(x,Q^{2})$ and its derivative. Analytical expressions for $F_{2,L}^{\mathcal{Q}\bar{\mathcal{Q}}}$ in terms of the effective parameters of the parameterization of $F_{2}(x,Q^{2})$ ,with respect to the BDH and ASW models, are presented. To study the heavy quark production processes, we use the collinear results in DAS approach. Numerical calculations and comparison with HERA data demonstrate that the suggested method provides reliable $F_{2}^{\mathcal{Q}\bar{\mathcal{Q}}}$, $R^{c\bar{c}}$ and $\sigma^{\mathcal{Q}\bar{\mathcal{Q}}}$ at low $x$ in a wide range of the low absolute four-momentum transfers squared ($4~\mathrm{GeV}^{2}<Q^{2}<2000~\mathrm{GeV}^{2}$). Also, in the HERA kinematic range, the ratio of $F_{2}^{c\bar{c}}/F_{2}^{b\bar{b}}$, $F_{2}^{c\bar{c}}/F_{2}^{BDHM}$ and $F_{2}^{b\bar{b}}/F_{2}^{BDHM}$ are obtained. Expanding the method to low and ultra low values of $x$ can be considered in the process analysis of the LHeC and FCC-eh colliders.


title: On the algebraic K-theory of Hecke algebras

abstract: Consider a totally disconnected group G, which is covirtually cyclic, i.e., contains a normal compact open subgroup L such that G/L is infinite cyclic. We establish a Wang sequence, which computes the algebraic K-groups of the Hecke algebra of G in terms of the one of L, and show that all negative K-groups vanish. This confirms the K-theoretic Farrell-Jones Conjecture for the Hecke algebra of G in this special case. Our ultimate long term goal is to prove it for any closed subgroup of any reductive p-adic group. The results of this paper will play a role in the final proof.


title: Chaos bound and its violation in charged Kiselev black hole

abstract: The chaos bound in the near-horizon regions has been studied through the expansions of the metric functions on the horizon. In this paper, we investigate the chaos bound in the the near-horizon region and at a certain distance from the horizon of a charged Kiselev black hole. The value of the Lyapunov exponent is accurately calculated by a Jacobian matrix. The angular momentum of a charged particle around the black hole affects not only the exponent, but also the position of the equilibrium orbit. This position gradually moves away from the horizon with the increase of the angular momentum. We find that the the bound is violated at a certain distance from the horizon and there is no violation in the near-horizon region when the charge mass ratio of the particle is fixed. The small value of the normalization factor is more likely to cause the violation.


title: Two-dimensional shaping of Solov'ev equilibrium with vacuum using external coils

abstract: In this work, we demonstrate a method for constructing the Solov'ev equilibrium with any given 2D shape surrounded by a vacuum region using external poloidal field coils. The computational domain consists of two parts: the plasma region, where the solution is the same as the Solov'ev solution, and the vacuum region, where the magnetic field generated by external coils as well as plasma current is determined using the Green function method through a matching condition near the separatrix. However, the method is not limited to the Solov'ev equilibrium in particular. The accuracy, efficiency, and robustness of such a scheme suggest that this method may be applied to the 2D shaping of tokamak plasma with vacuum region using external coils in general.


title: Reflexive homology

abstract: Reflexive homology is the homology theory associated to the reflexive crossed simplicial group; one of the fundamental crossed simplicial groups. It is the most general way to extend Hochschild homology to detect an order-reversing involution. In this paper we study the relationship between reflexive homology and the $C_2$-equivariant homology of free loop spaces. We define reflexive homology in terms of functor homology. We give a bicomplex for computing reflexive homology together with some calculations, including the reflexive homology of a tensor algebra. We prove that the reflexive homology of a group algebra is isomorphic to the homology of the $C_2$-equivariant Borel construction on the free loop space of the classifying space. We give a direct sum decomposition of the reflexive homology of a group algebra indexed by conjugacy classes of group elements, where the summands are defined in terms of a reflexive analogue of group homology. We define a hyperhomology version of reflexive homology and use it to study the $C_2$-equivariant homology of certain free loop and free loop-suspension spaces. We show that reflexive homology satisfies Morita invariance. We prove that under nice conditions the involutive Hochschild homology studied by Braun and by Fern\`andez-Val\`encia and Giansiracusa coincides with reflexive homology.


title: Penetration trajectory optimization for the hypersonic gliding vehicle encountering two interceptors

abstract: The penetration trajectory optimization problem for the hypersonic gliding vehicle (HGV) encountering two interceptors is investigated. The HGV penetration trajectory optimization problem considering the terminal target area is formulated as a nonconvex optimal control problem. The nonconvex optimal control problem is transformed into a second-order cone programming (SOCP) problem, which can be solved by state-of-the-art interior-point methods. In addition, a penetration strategy that only requires the initial line-of-sight angle information of the interceptors is proposed. The convergent trajectory obtained by the proposed method allows the HGV to evade two interceptors and reach the target area successfully. Furthermore, a successive SOCP method with a variable trust region is presented, which is critical to balancing the trade-off between time consumption and optimality. Finally, the effectiveness and performance of the proposed method are verified by numerical simulations.


title: Fair Classification under Covariate Shift and Missing Protected Attribute -- an Investigation using Related Features

abstract: This study investigated the problem of fair classification under Covariate Shift and missing protected attribute using a simple approach based on the use of importance-weights to handle covariate-shift and, Related Features arXiv:2104.14537 to handle missing protected attribute.


title: Automatic spinal curvature measurement on ultrasound spine images using Faster R-CNN

abstract: Ultrasound spine imaging technique has been applied to the assessment of spine deformity. However, manual measurements of scoliotic angles on ultrasound images are time-consuming and heavily rely on raters experience. The objectives of this study are to construct a fully automatic framework based on Faster R-CNN for detecting vertebral lamina and to measure the fitting spinal curves from the detected lamina pairs. The framework consisted of two closely linked modules: 1) the lamina detector for identifying and locating each lamina pairs on ultrasound coronal images, and 2) the spinal curvature estimator for calculating the scoliotic angles based on the chain of detected lamina. Two hundred ultrasound images obtained from AIS patients were identified and used for the training and evaluation of the proposed method. The experimental results showed the 0.76 AP on the test set, and the Mean Absolute Difference (MAD) between automatic and manual measurement which was within the clinical acceptance error. Meanwhile the correlation between automatic measurement and Cobb angle from radiographs was 0.79. The results revealed that our proposed technique could provide accurate and reliable automatic curvature measurements on ultrasound spine images for spine deformities.


title: Second-order accuracy metrics for scoring models and their practical use

abstract: The paper proposes new second-order accuracy metrics for scoring or rating models, which show the target preference of the model, it is better to diagnose good objects or better to diagnose bad ones for a constant generally accepted predictive power determined by the first order metric that is known as the Gini index. There are two metrics, they have both an integral representation and a numerical one. The numerical representation of metrics is of two types, the first of which is based on binary events to evaluate the model, the second on the default probability given by the model. Comparison of the results of calculating the metrics allows you to validate the calibration settings of the scoring or rating model and reveals its distortions. The article provides examples of calculating second-order accuracy metrics for ratings of several rating agencies, as well as for the well known approach to calibration based on van der Burg's ROC curves.


title: The small index property of the Fra\"iss\'e limit of finite Heyting algebras

abstract: We show that if a subgroup of the automorphism group of the Fraisse limit of finite Heyting algebras has a countable index, then it lies between the pointwise and setwise stabilizer of some finite set.


title: Gibbs measures for hyperbolic attractors defined by densities

abstract: In this article we will describe a new construction for Gibbs measures for hyperbolic attractors generalizing the original construction of Sinai, Bowen and Ruelle of SRB measures. The classical construction of the SRB measure is based on pushing forward the normalized volume on a piece of unstable manifold. By modifying the density at each step appropriately we show that the resulting measure is a prescribed Gibbs measure. This contrasts with, and complements, the construction of Climenhaga-Pesin-Zelerowicz who replace the volume on the unstable manifold by a fixed reference measure. Moreover, the simplicity of our proof, which uses only explicit properties on the growth rate of unstable manifold and entropy estimates, has the additional advantage that it applies in more general settings.


title: One RING to Rule Them All: Radon Sinogram for Place Recognition, Orientation and Translation Estimation

abstract: LiDAR-based global localization is a fundamental problem for mobile robots. It consists of two stages, place recognition and pose estimation, which yields the current orientation and translation, using only the current scan as query and a database of map scans. Inspired by the definition of a recognized place, we consider that a good global localization solution should keep the pose estimation accuracy with a lower place density. Following this idea, we propose a novel framework towards sparse place-based global localization, which utilizes a unified and learning-free representation, Radon sinogram (RING), for all sub-tasks. Based on the theoretical derivation, a translation invariant descriptor and an orientation invariant metric are proposed for place recognition, achieving certifiable robustness against arbitrary orientation and large translation between query and map scan. In addition, we also utilize the property of RING to propose a global convergent solver for both orientation and translation estimation, arriving at global localization. Evaluation of the proposed RING based framework validates the feasibility and demonstrates a superior performance even under a lower place density.


title: Elastic properties of a Sc-Zr-Nb-Ta-Rh-Pd high-entropy alloy superconductor

abstract: We report a comprehensive study on the elastic properties of a hexanary high-entropy alloy superconductor (ScZrNbTa)$_{0.685}$[RhPd]$_{0.315}$ at room and cryogenic temperatures, by Resonant Ultrasound Spectroscopy experiments. The derived elastic constants are bulk modulus $K=132.7$ GPa, Young's modulus $E=121.0$ GPa, shear modulus $G=44.9$ GPa, and Poisson's ratio $\nu$=0.348 for room temperature. The Young's and shear moduli are $\sim 10\%$ larger than those in NbTi superconductor with similar $T_c$, while the ductility is comparable. Moreover, the mechanical performance is further enhanced at cryogenic temperature. Our work confirms the advantageous mechanical properties of high-entropy alloy superconductors and suggests the application prospects.

categories: cond-mat.supr-con cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.other cond-mat.str-el


title: Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base

abstract: Pre-trained language models (PLMs) like BERT have made significant progress in various downstream NLP tasks. However, by asking models to do cloze-style tests, recent work finds that PLMs are short in acquiring knowledge from unstructured text. To understand the internal behaviour of PLMs in retrieving knowledge, we first define knowledge-baring (K-B) tokens and knowledge-free (K-F) tokens for unstructured text and ask professional annotators to label some samples manually. Then, we find that PLMs are more likely to give wrong predictions on K-B tokens and attend less attention to those tokens inside the self-attention module. Based on these observations, we develop two solutions to help the model learn more knowledge from unstructured text in a fully self-supervised manner. Experiments on knowledge-intensive tasks show the effectiveness of the proposed methods. To our best knowledge, we are the first to explore fully self-supervised learning of knowledge in continual pre-training.


title: High-resolution spectroscopy and single-photon Rydberg excitation of reconfigurable ytterbium atom tweezer arrays utilizing a metastable state

abstract: We present an experimental system for Rydberg tweezer arrays with ytterbium (Yb) atoms featuring internal state manipulation between the ground ${}^1$S$_0$ and the metastable ${}^3$P$_2$ states, and single-photon excitation from the ${}^3$P$_2$ to Rydberg states. In the experiments, single Yb atoms are trapped in two-dimensional arrays of optical tweezers and are detected by fluorescence imaging with the intercombination ${}^1$S$_0 \leftrightarrow {}^3$P$_1$ transition, and the defect-free single atom arrays are prepared by the rearrangement with the feedaback. We successfully perform high-resolution ${}^1$S$_0\leftrightarrow {}^3$P$_2$ state spectroscopy for the single atoms, demonstrating the utilities of this ultranarrow transition. We further perform single-photon excitation from the ${}^3$P$_2$ to Rydberg states for the single atoms, which is a key for the efficient Rydberg excitation. We also perform a systematic measurement of a complex energy structure of a series of D states including newly observed ${}^3$D$_3$ states. The developed system shows feasibility of future experiments towards quantum simulations and computations using single Yb atoms.


title: NEQRX: Efficient Quantum Image Encryption with Reduced Circuit Complexity

abstract: Cryptography plays an important role in ensuring data security and authentication within information processing systems. As the prevalence of digital imagery continues to grow, safeguarding this form of data becomes increasingly crucial. However, existing security protocols, reliant on complex mathematical models, exhibit vulnerabilities in effectively protecting information from both internal and external threats. Moreover, the forthcoming advent of quantum computing poses a significant challenge, as it could decrypt data encrypted by classical. In this paper, we propose an efficient implementation scheme for a quantum image encryption algorithm combining the generalized affine transform and logistic map. We evaluated developed quantum circuits using qiskit and quantum devices to validate the encryption technique. Through comprehensive performance analysis, we have demonstrated the efficiency of the chosen encryption algorithm across various criteria. Furthermore, we introduce a hybrid methodology aimed at mitigating circuit complexity and reducing quantum cost. Leveraging the Espresso algorithm and incorporating an ancilla qubit into the circuitry, we achieve a remarkable 50\% reduction in cost while maintaining security and efficiency. Finally, we conducted robustness and security analyses to assess the resilience of our encryption method against diverse noise attacks. The results confirm that our proposed quantum image encryption technique provides a secure solution and offers precise and measurable quantum image processing capabilities.


title: How Fast are Domino Waves?

abstract: The paper is concerned with the problem of toppling propagation velocity in elastic, domino-like mechanical systems. We build on the work of Efthimiou and Johnson, who developed the theory of perfectly elastic collisions of thin rigid dominoes on a frictional foundation. This theory has been criticised for the lack of correspondence with the experimental observations, in particular, prediction of infinite propagation velocity for zero spacing between dominoes, as well as the inability to represent the collective nature of collisions in real domino systems. In our work we consider a more realistic scenario of dominoes of finite stiffness and obtain a theory of fast elastic domino waves, taking into account a limit velocity of the perturbation propagation in the system of dominoes. Moreover, finite collision time allows to extract dynamic quantities of collisions and establish upper and lower borders for domino separations where the theory could still be applied. Our discrete element simulations support our theoretical findings and shed light on the nature of collective interactions in the nearly-elastic domino chains.


title: Critical Angle at a Moving Interface Formed by a Space-Time Modulation Step

abstract: This paper addresses the problem of wave scattering at a moving interface formed by a space-time modulation step. Specifically, it derives, using the technique of frame hopping with Lorentz transformation, the formula for the corresponding critical angle beyond which the transmitted field is evanescent. It shows that this angle is smaller (resp. larger) than $\pi/2$ (position of the interface) for a modulation that is codirectional (resp. contradirectional) to the direction of wave propagation, and that the critical angle versus the modulation velocity function monotonically decreases to zero at the velocity where the incident wave cannot catch up any more with the interface. The theory is illustrated and validated by full-wave FDTD simulation.


title: Introduction of Integrated Image Deep Learning Solution and how it brought laboratorial level heart rate and blood oxygen results to everyone

abstract: The general public and medical professionals recognized the importance of accurately measuring and storing blood oxygen levels and heart rate during the COVID-19 pandemic. The demand for accurate contact-less devices was motivated by the need for cross-infection reduction and the shortage of conventional oximeters, partially due to the global supply chain issue. This paper evaluated a contact-less mini-program HealthyPai's heart rate (HR) and oxygen saturation (SpO2) measurements compared with other wearable devices. In the HR study of 185 samples (81 in the laboratory environment, 104 in the real-life environment), the mean absolute error (MAE) $\pm$ standard deviation was $1.4827 \pm 1.7452$ in the lab, $6.9231 \pm 5.6426$ in the real-life setting. In the SpO2 study of 24 samples, the mean absolute error (MAE) $\pm$ standard deviation of the measurement was $1.0375 \pm 0.7745$. Our results validated that HealthyPai utilizing the Integrated Image Deep Learning Solution (IIDLS) framework can accurately measure HR and SpO2, providing the test quality at least comparable to other FDA-approved wearable devices in the market and surpassing the consumer-grade and research-grade wearable standards.


title: LRH-Net: A Multi-Level Knowledge Distillation Approach for Low-Resource Heart Network

abstract: An electrocardiogram (ECG) monitors the electrical activity generated by the heart and is used to detect fatal cardiovascular diseases (CVDs). Conventionally, to capture the precise electrical activity, clinical experts use multiple-lead ECGs (typically 12 leads). But in recent times, large-size deep learning models have been used to detect these diseases. However, such models require heavy compute resources like huge memory and long inference time. To alleviate these shortcomings, we propose a low-parameter model, named Low Resource Heart-Network (LRH-Net), which uses fewer leads to detect ECG anomalies in a resource-constrained environment. A multi-level knowledge distillation process is used on top of that to get better generalization performance on our proposed model. The multi-level knowledge distillation process distills the knowledge to LRH-Net trained on a reduced number of leads from higher parameter (teacher) models trained on multiple leads to reduce the performance gap. The proposed model is evaluated on the PhysioNet-2020 challenge dataset with constrained input. The parameters of the LRH-Net are 106x less than our teacher model for detecting CVDs. The performance of the LRH-Net was scaled up to 3.2% and the inference time scaled down by 75% compared to the teacher model. In contrast to the compute- and parameter-intensive deep learning techniques, the proposed methodology uses a subset of ECG leads using the low resource LRH-Net, making it eminently suitable for deployment on edge devices.


title: Regular parallelisms on PG(3,R) from generalized line stars: The oriented case

abstract: Using the Klein correspondence, regular parallelisms of PG(3,R) have been described by Betten and Riesinger in terms of a dual object, called a hyperflock determining (hfd) line set. In the special case where this set has a span of dimension 3, a second dualization leads to a more convenient object, called a generalized star of lines. Both constructions have later been simplified by the author. Here we refine our simplified approach in order to obtain similar results for regular parallelisms of oriented lines. As a consequence, we can demonstrate that for oriented parallelisms, as we call them, there are distinctly more possibilities than in the non-oriented case. The proofs require a thorough analysis of orientation in projective spaces (as manifolds and as lattices) and in projective planes and, in particular, in translation planes. This is used in order to handle continuous families of oriented regular spreads in terms of the Klein model of PG(3,R). This turns out to be quite subtle. Even the definition of suitable classes of dual objects modeling oriented parallelisms is not so obvious.


title: Multiplication of freestanding semiconductor membranes from a single wafer by advanced remote epitaxy

abstract: Freestanding single-crystalline membranes are an important building block for functional electronics. Especially, compounds semiconductor membranes such as III-N and III-V offer great opportunities for optoelectronics, high-power electronics, and high-speed computing. Despite huge efforts to produce such membranes by detaching epitaxial layers from donor wafers, however, it is still challenging to harvest epitaxial layers using practical processes. Here, we demonstrate a method to grow and harvest multiple epitaxial membranes with extremely high throughput at the wafer scale. For this, 2D materials are directly formed on III-N and III-V substrates in epitaxy systems, which enables an advanced remote epitaxy scheme comprised of multiple alternating layers of 2D materials and epitaxial layers that can be formed by a single epitaxy run. Each epilayer in the multi-stack structure is then harvested by layer-by-layer peeling, producing multiple freestanding membranes with unprecedented throughput from a single wafer. Because 2D materials allow peeling at the interface without damaging the epilayer or the substrate, wafers can be reused for subsequent membrane production. Therefore, this work represents a meaningful step toward high-throughput and low-cost production of single-crystal membranes that can be heterointegrated.


title: Efficient Circular Polarized Metamaterial RF Energy Harvester for Wi-Fi Applications

abstract: A new metamaterial based, circular polarized electromagnetic energy harvester is presented in this work. The structure, which is multilayer and utilises the well-known to the literature geometry of the spiral split ring resonator, operates at the Wi-Fi frequency band. Based on full electromagnetic analysis, the proposed harvester presents high efficiency (i.e., greater than 90%), adequate angle insensitivity (i.e., 44 deg.) and it is capable of absorbing circular polarised plane waves.


title: Doubly resonant photoacoustic spectroscopy: ultra-high sensitivity meets ultra-wide dynamic range

abstract: Photoacoustic spectroscopy (PAS) based gas sensors with high sensitivity, wide dynamic range, low cost, and small footprint are desirable across a broad range of applications in energy, environment, safety, and public health. However, most works have focused on either acoustic resonator to enhance acoustic wave or optical resonator to enhance optical wave. Herein, we develop a gas sensor based on doubly resonant PAS in which the acoustic and optical waves are simultaneously enhanced using combined optical and acoustic resonators in a centimeter-long configuration. Not only the lower detection limit is enhanced by the double standing waves, but also the upper detection limit is expanded due to the short resonators. As an example, we developed a sensor by detecting acetylene (C2H2), achieving a noise equivalent absorption of 5.7*10-13 cm-1 and a dynamic range of eight orders. Compared to the state-of-the-art PAS gas sensors, the developed sensor increases the sensitivity by two orders of magnitude and extends the dynamic range by three orders of magnitude. Besides, a laser-cavity-molecule locking strategy is proposed to provide additional flexibility of fast gas detection.


title: A Survey on Location-Driven Influence Maximization

abstract: Influence Maximization (IM), which aims to select a set of users from a social network to maximize the expected number of influenced users, is an evergreen hot research topic. Its research outcomes significantly impact real-world applications such as business marketing. The booming location-based network platforms of the last decade appeal to the researchers embedding the location information into traditional IM research. In this survey, we provide a comprehensive review of the existing location-driven IM studies from the perspective of the following key aspects: (1) a review of the application scenarios of these works, (2) the diffusion models to evaluate the influence propagation, and (3) a comprehensive study of the approaches to deal with the location-driven IM problems together with a particular focus on the accelerating techniques. In the end, we draw prospects into the research directions in future IM research.


title: Nested Named Entity Recognition as Holistic Structure Parsing

abstract: As a fundamental natural language processing task and one of core knowledge extraction techniques, named entity recognition (NER) is widely used to extract information from texts for downstream tasks. Nested NER is a branch of NER in which the named entities (NEs) are nested with each other. However, most of the previous studies on nested NER usually apply linear structure to model the nested NEs which are actually accommodated in a hierarchical structure. Thus in order to address this mismatch, this work models the full nested NEs in a sentence as a holistic structure, then we propose a holistic structure parsing algorithm to disclose the entire NEs once for all. Besides, there is no research on applying corpus-level information to NER currently. To make up for the loss of this information, we introduce Point-wise Mutual Information (PMI) and other frequency features from corpus-aware statistics for even better performance by holistic modeling from sentence-level to corpus-level. Experiments show that our model yields promising results on widely-used benchmarks which approach or even achieve state-of-the-art. Further empirical studies show that our proposed corpus-aware features can substantially improve NER domain adaptation, which demonstrates the surprising advantage of our proposed corpus-level holistic structure modeling.


title: Renormalizable and unitary Lorentz invariant model of quantum gravity

abstract: We analyze the R + R2 model of quantum gravity where terms quadratic in the curvature tensor are added to the General Relativity action. This model was recently proved to be a self-consistent quantum theory of gravitation, being both renormalizable and unitary. The model can be made practically indistinguishable from General Relativity at astrophysical and cosmological scales by the proper choice of parameters.


title: A survey of known results on the m-step solvable anabelian geometry for hyperbolic curves

abstract: In this survey, we introduce the three theorems about the m-step solvable Grothendieck conjecture in anabelian geometry of hyperbolic curves by H. Nakamura, S. Mochizuki, and the author. We also give sketches of the proofs of these theorems.


title: WikiOmnia: generative QA corpus on the whole Russian Wikipedia

abstract: The General QA field has been developing the methodology referencing the Stanford Question answering dataset (SQuAD) as the significant benchmark. However, compiling factual questions is accompanied by time- and labour-consuming annotation, limiting the training data's potential size. We present the WikiOmnia dataset, a new publicly available set of QA-pairs and corresponding Russian Wikipedia article summary sections, composed with a fully automated generative pipeline. The dataset includes every available article from Wikipedia for the Russian language. The WikiOmnia pipeline is available open-source and is also tested for creating SQuAD-formatted QA on other domains, like news texts, fiction, and social media. The resulting dataset includes two parts: raw data on the whole Russian Wikipedia (7,930,873 QA pairs with paragraphs for ruGPT-3 XL and 7,991,040 QA pairs with paragraphs for ruT5-large) and cleaned data with strict automatic verification (over 160,000 QA pairs with paragraphs for ruGPT-3 XL and over 3,400,000 QA pairs with paragraphs for ruT5-large).


title: Partial-duals for planar ribbon graphs

abstract: In 2009, Chmutov introduced the partial-duality for a ribbon graph $G$. Recently, Gross, Mansour and Tucker enumerated all possible partial-duals of $G$ by genus and introduced the partial-dual genus polynomial of a ribbon graph $G.$ This paper mainly enumerates partial-duals for planar ribbon graphs. First, we obtain a formula for the maximum partial-dual genus for any planar ribbon graph and give a negative answer to the interpolating conjecture of Gross, Mansour and Tucker. Then we show that there is a recurrence relation between the partial-dual genus polynomials of planar ribbon graphs $G-e$ and $G$. Furthermore, two related results are also given. These recurrence relations give new approaches to calculate the partial-genus dual polynomials for some planar ribbon graphs. In addition, we prove the asymptotic normality for some partial-dual genus distributions.


title: Dynamic attenuation scheme in measurement-device-independent quantum key distribution over turbulent channels

abstract: Measurement-device-independent quantum key distribution (MDI QKD) offers great security in practice because it removes all detector side channels. However, conducting MDI QKD over free-space channels is challenging. One of the largest culprits is the mismatched transmittance of the two independent turbulent channels causing a reduced Hong-Ou-Mandel visibility and thus a lower secret key rate. Here we introduce a dynamic attenuation scheme, where the transmittance of each of the two channels is monitored in real time by transmitting bright light pulses from each users to the measurement device. Based on the measured channel transmittance, a suitable amount of attenuation is introduced to the low-loss channel at the measurement device. Our simulation results show a significant improvement of QKD performance, especially when using short raw keys.


title: Mixed state information theoretic measures in boosted black brane

abstract: In this paper, we study various mixed state information theoretic quantities for a boosted black brane geometry. We have considered two setups, namely, a strip-like subsystem taken parallel and perpendicular to the direction of the boost. The quantities we calculate are the entanglement wedge cross-section, mutual information, entanglement negativity, and purification complexity. In the subsequent analysis, we have incorporated the thin-strip approximation and computed the leading order change (over pure AdS) in the concerned information theoretic quantities due to the boost parameter. We also show the relation of these quantities computed holographically to the energy and pressure of the boundary field theory. We then proceed to calculate the asymmetry ratios of these quantities, and observe that they are independent of the subsystem size. Finally, we proceed to study an interesting limit of the boosted black brane geometry, which is the so called AdS wave geometry. We once again compute all the mixed state information theoretic quantities for this geometry.


title: One-step Method for Material Quantitation using In-line Tomography with Single Scanning

abstract: Objective: Quantitative technique based on In-line phase-contrast computed tomography with single scanning attracts more attention in application due to the flexibility of the implementation. However, the quantitative results usually suffer from artifacts and noise, since the phase retrieval and reconstruction are independent ("two-steps") without feedback from the original data. Our goal is to develop a method for material quantitative imaging based on a priori information specifically for the single-scanning data. Method: An iterative method that directly reconstructs the refractive index decrement delta and imaginary beta of the object from observed data ("one-step") within single object-to-detector distance (ODD) scanning. Simultaneously, high-quality quantitative reconstruction results are obtained by using a linear approximation that achieves material decomposition in the iterative process. Results: By comparing the equivalent atomic number of the material decomposition results in experiments, the accuracy of the proposed method is greater than 97.2%. Conclusion: The quantitative reconstruction and decomposition results are effectively improved, and there are feedback and corrections during the iteration, which effectively reduce the impact of noise and errors. Significance: This algorithm has the potential for quantitative imaging research, especially for imaging live samples and human breast preclinical studies.


title: Finite volume based film flow and ice accretion models on aircraft wings

abstract: The thin runback water films driven by the gas flow, the pressure gradient and the gravity on the iced aircraft surface are investigated in this paper. A three-dimensional film flow model based on Finite Volume Method (FVM) and the lubrication theory is proposed to describe the flow. The depth-averaged velocity of the film is stored in Cartesian coordinates to avoid the appearance of the metric tensors. The governing equations are discretized in the first layer structured grid cell which is selected as the grids for film flow. In order to verify this method, comparisons between numerical results and experimental results of ice shapes on NACA 0012 airfoil and GLC-305 swept wing are presented, both showing a good agreement for rime and glaze ice condition. Overall, this model shows great potential to model ice accretion reasonably under different icing conditions. Besides, the present method doesn't require analytic metric terms, and can be easily coupled to existing finite volume solvers for logically Cartesian meshes.


title: Optimizing Brownian heat engine with shortcut strategy

abstract: Shortcuts to isothermality provide a powerful method to speed up quasistatic thermodynamic processes within finite-time manipulation. We employ the shortcut strategy to design and optimize Brownian heat engines, and formulate a geometric description of the energetics with the thermodynamic length. We obtain a tight and reachable bound of the output power, which is reached by the optimal protocol to vary the control parameters with a proper constant velocity of the thermodynamic length. Our results generalize the previous optimization in the highly underdamped and the overdamped regimes to the general-damped situation, and are applicable for arbitrary finite-time cycles.


title: Observational constraints on nonlinear matter extensions of general relativity: Separable trace power models

abstract: The search for the physical mechanism underlying the observational evidence for the acceleration of the recent universe is a compelling goal of modern fundamental cosmology. Here we quantitatively study a class of homogeneous and isotropic cosmological models in which the matter side of Einstein's equations includes, in addition to the canonical term, a term proportional to the trace of the energy-momentum tensor, $T=\rho-3p$, and constrain these models using low redshift background cosmology data. One may think of these models as extensions of general relativity with a nonlinear matter Lagrangian, and they can be studied either as phenomenological extensions of the standard $\Lambda$CDM model, containing both matter and a cosmological constant, or as direct alternatives to it, where there is no cosmological constant but the additional terms would have to be responsible for accelerating the universe. Overall, our main finding is that parametric extensions of $\Lambda$CDM are tightly constrained, with additional model parameters being constrained to their canonical behaviours to within one standard deviation, while alternative models in this class (which do not have a $\Lambda$CDM limit) are ruled out. This provides some insight on the level of robustness of the $\Lambda$CDM model and on the parameter space still available for phenomenological alternatives and extensions.


title: PiouCrypt: Decentralized Lattice-based Method for Visual Symmetric Cryptography

abstract: In recent years, establishing secure visual communications has turned into one of the essential problems for security engineers and researchers. However, only limited novel solutions are provided for image encryption, and limiting the visual cryptography to only limited schemes can bring up negative consequences, especially with emerging quantum computational systems. This paper presents a novel algorithm for establishing secure private visual communication. The proposed method has a layered architecture with several cohesive components, and corresponded with an NP-hard problem, despite its symmetric structure. This two-step technique is not limited to gray-scale pictures, and furthermore, utilizing a lattice structure causes to proposed method has optimal resistance for the post-quantum era, and is relatively secure from the theoretical dimension.


title: A classification of regular diagonal quadratic forms

abstract: A positive-definite integral quadratic form is called regular if it represents every positive integer which is locally represented. In this article, we classify all regular diagonal quadratic forms of rank greater than 3.


title: Elliptic Loops

abstract: Given a local ring $(R,\mathfrak{m})$ and an elliptic curve $E(R/\mathfrak{m})$, we define elliptic loops as the points of $\mathbb{P}^2(R)$ projecting to $E$ under the canonical modulo-$\mathfrak{m}$ reduction, endowed with an operation that extends the curve's addition. While their subset of points satisfying the curve's Weierstrass equation is a group, these larger objects are proved to be power associative abelian algebraic loops, which are seldom completely associative. When an elliptic loop has no points of order $3$, its affine part is obtained as a stratification of a one-parameter family of elliptic curves defined over $R$, which we call layers. Stronger associativity properties are established when $\mathfrak{m}^e$ vanishes for small values of $e \in \mathbb{Z}$. When the underlying ring is $R = \mathbb{Z}/p^e\mathbb{Z}$, the infinity part of an elliptic loop is generated by two elements, the group structure of layers may be established and the points with the same projection and same order possess a geometric description.


title: On two remarkable groups of area-preserving homeomorphisms

abstract: We prove that on a symplectic sphere, the group of Hamiltonian homeomorphisms in the sense of Oh and M\"uller is a proper normal subgroup of the group of finite energy Hamiltonian homeomorphisms. Moreover we detect infinite-dimensional flats inside the quotient of these groups endowed with the natural Hofer pseudo-metric.


title: Sharper Bounds on Four Lattice Constants

abstract: The Korkine--Zolotareff (KZ) reduction, and its generalisations, are widely used lattice reduction strategies in communications and cryptography. The KZ constant and Schnorr's constant were defined by Schnorr in 1987. The KZ constant can be used to quantify some useful properties of KZ reduced matrices. Schnorr's constant can be used to characterize the output quality of his block $2k$-reduction and is used to define his semi block $2k$-reduction, which was also developed in 1987. Hermite's constant, which is a fundamental constant lattices, has many applications, such as bounding the length of the shortest nonzero lattice vector and the orthogonality defect of lattices. Rankin's constant was introduced by Rankin in 1953 as a generalization of Hermite's constant. It plays an important role in characterizing the output quality of block-Rankin reduction, proposed by Gama et al. in 2006. In this paper, we first develop a linear upper bound on Hermite's constant and then use it to develop an upper bound on the KZ constant. These upper bounds are sharper than those obtained recently by the authors, and the ratio of the new linear upper bound to the nonlinear upper bound, developed by Blichfeldt in 1929, on Hermite's constant is asymptotically 1.0047. Furthermore, we develop lower and upper bounds on Schnorr's constant. The improvement to the lower bound over the sharpest existing one developed by Gama et al. is around 1.7 times asymptotically, and the improvement to the upper bound over the sharpest existing one which was also developed by Gama et al. is around 4 times asymptotically. Finally, we develop lower and upper bounds on Rankin's constant. The improvements of the bounds over the sharpest existing ones, also developed by Gama et al., are exponential in the parameter defining the constant.


title: Randomized Maximum Likelihood via High-Dimensional Bayesian Optimization

abstract: Posterior sampling for high-dimensional Bayesian inverse problems is a common challenge in real-world applications. Randomized Maximum Likelihood (RML) is an optimization based methodology that gives samples from an approximation to the posterior distribution. We develop a high-dimensional Bayesian Optimization (BO) approach based on Gaussian Process (GP) surrogate models to solve the RML problem. We demonstrate the benefits of our approach in comparison to alternative optimization methods on a variety of synthetic and real-world Bayesian inverse problems, including medical and magnetohydrodynamics applications.


title: VDTR: Video Deblurring with Transformer

abstract: Video deblurring is still an unsolved problem due to the challenging spatio-temporal modeling process. While existing convolutional neural network-based methods show a limited capacity for effective spatial and temporal modeling for video deblurring. This paper presents VDTR, an effective Transformer-based model that makes the first attempt to adapt Transformer for video deblurring. VDTR exploits the superior long-range and relation modeling capabilities of Transformer for both spatial and temporal modeling. However, it is challenging to design an appropriate Transformer-based model for video deblurring due to the complicated non-uniform blurs, misalignment across multiple frames and the high computational costs for high-resolution spatial modeling. To address these problems, VDTR advocates performing attention within non-overlapping windows and exploiting the hierarchical structure for long-range dependencies modeling. For frame-level spatial modeling, we propose an encoder-decoder Transformer that utilizes multi-scale features for deblurring. For multi-frame temporal modeling, we adapt Transformer to fuse multiple spatial features efficiently. Compared with CNN-based methods, the proposed method achieves highly competitive results on both synthetic and real-world video deblurring benchmarks, including DVD, GOPRO, REDS and BSD. We hope such a Transformer-based architecture can serve as a powerful alternative baseline for video deblurring and other video restoration tasks. The source code will be available at \url{https://github.com/ljzycmd/VDTR}.


title: The Z-axis, X-axis, Weight and Disambiguation Methods for Constructing Local Reference Frame in 3D Registration: An Evaluation

abstract: The local reference frame (LRF), as an independent coordinate system generated on a local 3D surface, is widely used in 3D local feature descriptor construction and 3D transformation estimation which are two key steps in the local method-based surface matching. There are numerous LRF methods have been proposed in literatures. In these methods, the x- and z-axis are commonly generated by different methods or strategies, and some x-axis methods are implemented on the basis of a z-axis being given. In addition, the weight and disambiguation methods are commonly used in these LRF methods. In existing evaluations of LRF, each LRF method is evaluated with a complete form. However, the merits and demerits of the z-axis, x-axis, weight and disambiguation methods in LRF construction are unclear. In this paper, we comprehensively analyze the z-axis, x-axis, weight and disambiguation methods in existing LRFs, and obtain six z-axis and eight x-axis, five weight and two disambiguation methods. The performance of these methods are comprehensively evaluated on six standard datasets with different application scenarios and nuisances. Considering the evaluation outcomes, the merits and demerits of different weight, disambiguation, z- and x-axis methods are analyzed and summarized. The experimental result also shows that some new designed LRF axes present superior performance compared with the state-of-the-art ones.


title: Hadronic supercriticality in spherically expanding sources: application to GRB prompt emission

abstract: Relativistic hadronic plasmas can become under certain conditions supercritical, abruptly and efficiently releasing the energy stored in protons through photon outbursts. Past studies have tried to relate the features of such hadronic supercriticalities (HSC) to the phenomenology of Gamma-Ray Burst (GRB) prompt emission. In this work we investigate, for the first time, HSC in adiabatically expanding sources. We examine the conditions required to trigger HSC, study the role of expansion velocity, and discuss our results in relation to GRB prompt emission. We find multi-pulse light curves from slowly expanding regions ($u_{\rm exp}\lesssim 0.01 c)$ that are a manifestation of the natural HSC quasi-periodicity, while single-pulse light curves with a fast rise and slow decay are found for higher velocities. The formation of the photon spectrum is governed by an in-source electromagnetic cascade. The peak photon energy is $\sim 1$ MeV ($\sim 1$ GeV) for maximum proton energies $\sim 1-10$ PeV ($1-10$ EeV) assuming a jet Lorentz factor 100. Peak $\gamma$-ray luminosities are in the range $10^{49}-10^{52}$ erg s$^{-1}$, with the MeV-peaked spectra being $\sim 100-300$ times more luminous than their GeV-peaked analogues. HSC bursts peaking in the MeV are also copious $\sim 10$ TeV neutrino emitters, with an all-flavour fluence $\sim 10\%$ of the $\gamma$-ray one. The hypothesis that typical long-duration GRBs are powered by HSC could be tested in the near future with more sensitive neutrino telescopes like IceCube-Gen2.


title: Advances in Thunder Sound Synthesis

abstract: A recent comparative study evaluated all known thunder synthesis techniques in terms of their perceptual realness. The findings concluded that none of the synthesised audio extracts seemed as realistic as the genuine phenomenon. The work presented herein is motivated by those findings, and attempts to create a synthesised sound effect of thunder indistinguishable from a real recording. The technique supplements an existing implementation with physics-inspired, signal-based design elements intended to simulate environmental occurrences. In a listening test conducted with over 50 participants, this new implementation was perceived as the most realistic synthesised sound, though still distinguishable from a real recording. Further improvements to the model, based on insights from the listening test, were also implemented and described herein.


title: Attention Mechanism based Cognition-level Scene Understanding

abstract: Given a question-image input, the Visual Commonsense Reasoning (VCR) model can predict an answer with the corresponding rationale, which requires inference ability from the real world. The VCR task, which calls for exploiting the multi-source information as well as learning different levels of understanding and extensive commonsense knowledge, is a cognition-level scene understanding task. The VCR task has aroused researchers' interest due to its wide range of applications, including visual question answering, automated vehicle systems, and clinical decision support. Previous approaches to solving the VCR task generally rely on pre-training or exploiting memory with long dependency relationship encoded models. However, these approaches suffer from a lack of generalizability and losing information in long sequences. In this paper, we propose a parallel attention-based cognitive VCR network PAVCR, which fuses visual-textual information efficiently and encodes semantic information in parallel to enable the model to capture rich information for cognition-level inference. Extensive experiments show that the proposed model yields significant improvements over existing methods on the benchmark VCR dataset. Moreover, the proposed model provides intuitive interpretation into visual commonsense reasoning.


title: Lie symmetries reduction and spectral methods on the fractional two-dimensional heat equation

abstract: In this paper, the Lie symmetry analysis is proposed for a space-time convection-diffusion fractional differential equations with the Riemann-Liouville derivative by (2+1) independent variables and one dependent variable. We find a reduction form of our governed fractional differential equation using the similarity solution of our Lie symmetry. One-dimensional optimal system of Lie symmetry algebras is found. We present a computational method via the spectral method based on Bernstein's operational matrices to solve the two-dimensional fractional heat equation with some initial conditions.


title: Deep Learning based Automatic Detection of Dicentric Chromosome

abstract: Automatic detection of dicentric chromosomes is an essential step to estimate radiation exposure and development of end to end emergency bio dosimetry systems. During accidents, a large amount of data is required to be processed for extensive testing to formulate a medical treatment plan for the masses, which requires this process to be automated. Current approaches require human adjustments according to the data and therefore need a human expert to calibrate the system. This paper proposes a completely data driven framework which requires minimum intervention of field experts and can be deployed in emergency cases with relative ease. Our approach involves YOLOv4 to detect the chromosomes and remove the debris in each image, followed by a classifier that differentiates between an analysable chromosome and a non-analysable one. Images are extracted from YOLOv4 based on the protocols described by WHO-BIODOSNET. The analysable chromosome is classified as Monocentric or Dicentric and an image is accepted for consideration of dose estimation based on the analysable chromosome count. We report an accuracy in dicentric identification of 94.33% on a 1:1 split of Dicentric and Monocentric Chromosomes.


title: An Adaptive Task-Related Component Analysis Method for SSVEP recognition

abstract: Steady-state visual evoked potential (SSVEP) recognition methods are equipped with learning from the subject's calibration data, and they can achieve extra high performance in the SSVEP-based brain-computer interfaces (BCIs), however their performance deteriorate drastically if the calibration trials are insufficient. This study develops a new method to learn from limited calibration data and it proposes and evaluates a novel adaptive data-driven spatial filtering approach for enhancing SSVEPs detection. The spatial filter learned from each stimulus utilizes temporal information from the corresponding EEG trials. To introduce the temporal information into the overall procedure, an multitask learning approach, based on the bayesian framework, is adopted. The performance of the proposed method was evaluated into two publicly available benchmark datasets, and the results demonstrated that our method outperform competing methods by a significant margin.


title: Limit theorems of Chatterjee's rank correlation

abstract: Establishing the limiting distribution of Chatterjee's rank correlation for a general, possibly non-independent, pair of random variables has been eagerly awaited to many. This paper shows that (a) Chatterjee's rank correlation is asymptotically normal as long as one variable is not a measurable function of the other, (b) the corresponding asymptotic variance is uniformly bounded by 36, and (c) a consistent variance estimator exists. Similar results also hold for Azadkia-Chatterjee's graph-based correlation coefficient, a multivariate analogue of Chatterjee's original proposal. The proof is given by appealing to H\'ajek representation and Chatterjee's nearest-neighbor CLT.


title: A Survey of Layer-Two Blockchain Protocols

abstract: After the success of the Bitcoin blockchain, came several cryptocurrencies and blockchain solutions in the last decade. Nonetheless, Blockchain-based systems still suffer from low transaction rates and high transaction processing latencies, which hinder blockchains' scalability. An entire class of solutions, called Layer-1 scalability solutions, have attempted to incrementally improve such limitations by adding/modifying fundamental blockchain attributes. Recently, a completely different class of works, called Layer-2 protocols, have emerged to tackle the blockchain scalability issues using unconventional approaches. Layer-2 protocols improve transaction processing rates, periods, and fees by minimizing the use of underlying slow and costly blockchains. In fact, the main chain acts just as an instrument for trust establishment and dispute resolution among Layer-2 participants, where only a few transactions are dispatched to the main chain. Thus, Layer-2 blockchain protocols have the potential to transform the domain. However, rapid and discrete developments have resulted in diverse branches of Layer-2 protocols. In this work, we systematically create a broad taxonomy of such protocols and implementations. We discuss each Layer-2 protocol class in detail and also elucidate their respective approaches, salient features, requirements, etc. Moreover, we outline the issues related to these protocols along with a comparative discussion. Our thorough study will help further systematize the knowledge dispersed in the domain and help the readers to better understand the field of Layer-2 protocols.


title: RLens: A Computer-aided Visualization System for Supporting Reflection on Language Learning under Distributed Tutorship

abstract: With the rise of the gig economy, online language tutoring platforms are becoming increasingly popular. These platforms provide temporary and flexible jobs for native speakers as tutors and allow language learners to have one-on-one speaking practices on demand, on which learners occasionally practice the language with different tutors. With such distributed tutorship, learners can hold flexible schedules and receive diverse feedback. However, learners face challenges in consistently tracking their learning progress because different tutors provide feedback from diverse standards and perspectives, and hardly refer to learners' previous experiences with other tutors. We present RLens, a visualization system for facilitating learners' learning progress reflection by grouping different tutors' feedback, tracking how each feedback type has been addressed across learning sessions, and visualizing the learning progress. We validate our design through a between-subjects study with 40 real-world learners. Results show that learners can successfully analyze their progress and common language issues under distributed tutorship with RLens, while most learners using the baseline interface had difficulty achieving reflection tasks. We further discuss design considerations of computer-aided systems for supporting learning under distributed tutorship.


title: Optimal reinforcement learning near the edge of synchronization transition

abstract: Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may corresponds to a synchronization phase transition. The critical dynamics near such a critical point needs further investigation specifically when compared to the critical behavior near the standard absorbing state phase transition. Since the phenomena of learning and self-organized criticality (SOC) at the edge of synchronization transition can emerge jointly in spiking neural networks due to the presence of spike-timing dependent plasticity (STDP), it is tempting to ask: What is the relationship between synchronization and learning in neural networks? Further, does learning benefit from SOC at the edge of synchronization transition? In this paper, we intend to address these important issues. Accordingly, we construct a biologically inspired model of an autonomous cognitive system which learns to perform stimulus-response tasks. We train this system using a reinforcement learning rule implemented through dopamine-modulated STDP. We find that the system exhibits a continuous transition from synchronous to asynchronous neural oscillations upon increasing the average axonal time delay. We characterize the learning performance of the system and observe that it is optimized near the synchronization transition. We also study neuronal avalanches in the system and provide evidence that optimized learning is achieved in a slightly supercritical state.


title: Beta Residuals: Improving Fault-Tolerant Control for Sensory Faults via Bayesian Inference and Precision Learning

abstract: Model-based fault-tolerant control (FTC) often consists of two distinct steps: fault detection & isolation (FDI), and fault accommodation. In this work we investigate posing fault-tolerant control as a single Bayesian inference problem. Previous work showed that precision learning allows for stochastic FTC without an explicit fault detection step. While this leads to implicit fault recovery, information on sensor faults is not provided, which may be essential for triggering other impact-mitigation actions. In this paper, we introduce a precision-learning based Bayesian FTC approach and a novel beta residual for fault detection. Simulation results are presented, supporting the use of beta residual against competing approaches.


title: Federated Learning Cost Disparity for IoT Devices

abstract: Federated learning (FL) promotes predictive model training at the Internet of things (IoT) devices by evading data collection cost in terms of energy, time, and privacy. We model the learning gain achieved by an IoT device against its participation cost as its utility. Due to the device-heterogeneity, the local model learning cost and its quality, which can be time-varying, differs from device to device. We show that this variation results in utility unfairness because the same global model is shared among the devices. By default, the master is unaware of the local model computation and transmission costs of the devices, thus it is unable to address the utility unfairness problem. Also, a device may exploit this lack of knowledge at the master to intentionally reduce its expenditure and thereby enhance its utility. We propose to control the quality of the global model shared with the devices, in each round, based on their contribution and expenditure. This is achieved by employing differential privacy to curtail global model divulgence based on the learning contribution. In addition, we devise adaptive computation and transmission policies for each device to control its expenditure in order to mitigate utility unfairness. Our results show that the proposed scheme reduces the standard deviation of the energy cost of devices by 99% in comparison to the benchmark scheme, while the standard deviation of the training loss of devices varies around 0.103.


title: Comparison communication protocols

abstract: We introduce a restriction of the classical 2-party deterministic communication protocol where Alice and Bob are restricted to using only comparison functions. We show that the complexity of a function in the model is, up to a constant factor, determined by a complexity measure analogous to Yao's tiling number, which we call the geometric tiling number which can be computed in polynomial time. As a warm-up, we consider an analogous restricted decision tree model and observe a 1-dimensional analog of the above results.


title: Investigating the sources of low-energy events in a SuperCDMS-HVeV detector

abstract: Recent experiments searching for sub-GeV/$c^2$ dark matter have observed event excesses close to their respective energy thresholds. Although specific to the individual technologies, the measured excess event rates have been consistently reported at or below event energies of a few-hundred eV, or with charges of a few electron-hole pairs. In the present work, we operated a 1-gram silicon SuperCDMS-HVeV detector at three voltages across the crystal (0 V, 60 V and 100 V). The 0 V data show an excess of events in the tens of eV region. Despite this event excess, we demonstrate the ability to set a competitive exclusion limit on the spin-independent dark matter--nucleon elastic scattering cross section for dark matter masses of $\mathcal{O}(100)$ MeV/$c^2$, enabled by operation of the detector at 0 V potential and achievement of a very low $\mathcal{O}(10)$ eV threshold for nuclear recoils. Comparing the data acquired at 0 V, 60 V and 100 V potentials across the crystal, we investigated possible sources of the unexpected events observed at low energy. The data indicate that the dominant contribution to the excess is consistent with a hypothesized luminescence from the printed circuit boards used in the detector holder.


title: Pathologies of Pre-trained Language Models in Few-shot Fine-tuning

abstract: Although adapting pre-trained language models with few examples has shown promising performance on text classification, there is a lack of understanding of where the performance gain comes from. In this work, we propose to answer this question by interpreting the adaptation behavior using post-hoc explanations from model predictions. By modeling feature statistics of explanations, we discover that (1) without fine-tuning, pre-trained models (e.g. BERT and RoBERTa) show strong prediction bias across labels; (2) although few-shot fine-tuning can mitigate the prediction bias and demonstrate promising prediction performance, our analysis shows models gain performance improvement by capturing non-task-related features (e.g. stop words) or shallow data patterns (e.g. lexical overlaps). These observations alert that pursuing model performance with fewer examples may incur pathological prediction behavior, which requires further sanity check on model predictions and careful design in model evaluations in few-shot fine-tuning.


title: NICO++: Towards Better Benchmarking for Domain Generalization

abstract: Despite the remarkable performance that modern deep neural networks have achieved on independent and identically distributed (I.I.D.) data, they can crash under distribution shifts. Most current evaluation methods for domain generalization (DG) adopt the leave-one-out strategy as a compromise on the limited number of domains. We propose a large-scale benchmark with extensive labeled domains named NICO++ along with more rational evaluation methods for comprehensively evaluating DG algorithms. To evaluate DG datasets, we propose two metrics to quantify covariate shift and concept shift, respectively. Two novel generalization bounds from the perspective of data construction are proposed to prove that limited concept shift and significant covariate shift favor the evaluation capability for generalization. Through extensive experiments, NICO++ shows its superior evaluation capability compared with current DG datasets and its contribution in alleviating unfairness caused by the leak of oracle knowledge in model selection.


title: Kernels of splitting homomorphisms

abstract: Lei and Wu have given a description of the second homotopy group of a closed orientable 3-manifold in terms of the kernels of the epimorphisms from the fundamental group of a Heegaard splitting surface onto the fundamental groups of the two handlebody sides. In this note, we give a geometric derivation of this result and collect some observations about the relation between the various groups and the topology of the 3-manifold and the Heegaard splitting.