title: Bridging Synthetic and Real Images: a Transferable and Multiple Consistency aided Fundus Image Enhancement Framework

abstract: Deep learning based image enhancement models have largely improved the readability of fundus images in order to decrease the uncertainty of clinical observations and the risk of misdiagnosis. However, due to the difficulty of acquiring paired real fundus images at different qualities, most existing methods have to adopt synthetic image pairs as training data. The domain shift between the synthetic and the real images inevitably hinders the generalization of such models on clinical data. In this work, we propose an end-to-end optimized teacher-student framework to simultaneously conduct image enhancement and domain adaptation. The student network uses synthetic pairs for supervised enhancement, and regularizes the enhancement model to reduce domain-shift by enforcing teacher-student prediction consistency on the real fundus images without relying on enhanced ground-truth. Moreover, we also propose a novel multi-stage multi-attention guided enhancement network (MAGE-Net) as the backbones of our teacher and student network. Our MAGE-Net utilizes multi-stage enhancement module and retinal structure preservation module to progressively integrate the multi-scale features and simultaneously preserve the retinal structures for better fundus image quality enhancement. Comprehensive experiments on both real and synthetic datasets demonstrate that our framework outperforms the baseline approaches. Moreover, our method also benefits the downstream clinical tasks.


title: Constraining gravitational wave propagation using pulsar timing array correlations

abstract: Pulsar timing arrays (PTA) are a promising probe to the cosmologically novel nanohertz gravitational wave (GW) regime through the stochastic GW background. In this work, we consider subluminal GW modes as a possible source of correlations in a PTA, utilizing the public code PTAfast and the 12.5 years correlations data by NANOGrav, which we hypothesize are sourced by GWs. Our results show no evidence in support of tensor- or vector-induced GW correlations in the data, and that vector correlations are disfavored. This places an upper bound to the graviton mass, $m_{\rm g} \lesssim 10^{-22}$ eV, characteristic of the PTA GW energy scale.


title: Region-Aware Diffusion for Zero-shot Text-driven Image Editing

abstract: Image manipulation under the guidance of textual descriptions has recently received a broad range of attention. In this study, we focus on the regional editing of images with the guidance of given text prompts. Different from current mask-based image editing methods, we propose a novel region-aware diffusion model (RDM) for entity-level image editing, which could automatically locate the region of interest and replace it following given text prompts. To strike a balance between image fidelity and inference speed, we design the intensive diffusion pipeline by combing latent space diffusion and enhanced directional guidance. In addition, to preserve image content in non-edited regions, we introduce regional-aware entity editing to modify the region of interest and preserve the out-of-interest region. We validate the proposed RDM beyond the baseline methods through extensive qualitative and quantitative experiments. The results show that RDM outperforms the previous approaches in terms of visual quality, overall harmonization, non-editing region content preservation, and text-image semantic consistency. The codes are available at https://github.com/haha-lisa/RDM-Region-Aware-Diffusion-Model.


title: Weighted numerical radius inequalities for operator and operator matrices

abstract: The concepts of weighted numerical radius has been defined in recent times. In this article, we obtain several upper bound for weighted numerical radius of operators and $2 \times 2$ operator matrices which generalize and improves some well known famous inequality for classical numerical radius. We also obtain an upper bound for the weighted numerical radius of the Aluthge transformation, $\tilde{T}$ of an operator $T \in \mathcal{B}(\mathcal{H}),$ where $\tilde{T} = |T|^{1/2} U |T|^{1/2}$ and $T = U |T|$ be the canonical polar decomposition of $T.$


title: FiTs: Fine-grained Two-stage Training for Knowledge-aware Question Answering

abstract: Knowledge-aware question answering (KAQA) requires the model to answer questions over a knowledge base, which is essential for both open-domain QA and domain-specific QA, especially when language models alone cannot provide all the knowledge needed. Despite the promising result of recent KAQA systems which tend to integrate linguistic knowledge from pre-trained language models (PLM) and factual knowledge from knowledge graphs (KG) to answer complex questions, a bottleneck exists in effectively fusing the representations from PLMs and KGs because of (i) the semantic and distributional gaps between them, and (ii) the difficulties in joint reasoning over the provided knowledge from both modalities. To address the above two problems, we propose a Fine-grained Two-stage training framework (FiTs) to boost the KAQA system performance: The first stage aims at aligning representations from the PLM and the KG, thus bridging the modality gaps between them, named knowledge adaptive post-training. The second stage, called knowledge-aware fine-tuning, aims to improve the model's joint reasoning ability based on the aligned representations. In detail, we fine-tune the post-trained model via two auxiliary self-supervised tasks in addition to the QA supervision. Extensive experiments demonstrate that our approach achieves state-of-the-art performance on three benchmarks in the commonsense reasoning (i.e., CommonsenseQA, OpenbookQA) and medical question answering (i.e., MedQA-USMILE) domains.


title: On the power of quantum entanglement in multipartite quantum XOR games

abstract: In this paper we show that, given $k\geq 3$, there exist $k$-player quantum XOR games for which the entangled bias can be arbitrarily larger than the bias of the game when the players are restricted to separable strategies. In particular, quantum entanglement can be a much more powerful resource than local operations and classical communication to play these games. This result shows a strong contrast to the bipartite case, where it was recently proved that the entangled bias is always upper bounded by a universal constant times the one-way classical communication bias.


title: Fast Computation of Branching Process Transition Probabilities via ADMM

abstract: Branching processes are a class of continuous-time Markov chains (CTMCs) prevalent for modeling stochastic population dynamics in ecology, biology, epidemiology, and many other fields. The transient or finite-time behavior of these systems is fully characterized by their transition probabilities. However, computing them requires marginalizing over all paths between endpoint-conditioned values, which often poses a computational bottleneck. Leveraging recent results that connect generating function methods to a compressed sensing framework, we recast this task from the lens of sparse optimization. We propose a new solution method using variable splitting; in particular, we derive closed form updates in a highly efficient ADMM algorithm. Notably, no matrix products -- let alone inversions -- are required at any step. This reduces computational cost by orders of magnitude over existing methods, and the resulting algorithm is easily parallelizable and fairly insensitive to tuning parameters. A comparison to prior work is carried out in two applications to models of blood cell production and transposon evolution, showing that the proposed method is orders of magnitudes more scalable than existing work.


title: Patch Network for medical image Segmentation

abstract: Accurate and fast segmentation of medical images is clinically essential, yet current research methods include convolutional neural networks with fast inference speed but difficulty in learning image contextual features, and transformer with good performance but high hardware requirements. In this paper, we present a Patch Network (PNet) that incorporates the Swin Transformer notion into a convolutional neural network, allowing it to gather richer contextual information while achieving the balance of speed and accuracy. We test our PNet on Polyp(CVC-ClinicDB and ETIS- LaribPolypDB), Skin(ISIC-2018 Skin lesion segmentation challenge dataset) segmentation datasets. Our PNet achieves SOTA performance in both speed and accuracy.


title: A Comprehensive Survey on Source-free Domain Adaptation

abstract: Over the past decade, domain adaptation has become a widely studied branch of transfer learning that aims to improve performance on target domains by leveraging knowledge from the source domain. Conventional domain adaptation methods often assume access to both source and target domain data simultaneously, which may not be feasible in real-world scenarios due to privacy and confidentiality concerns. As a result, the research of Source-Free Domain Adaptation (SFDA) has drawn growing attention in recent years, which only utilizes the source-trained model and unlabeled target data to adapt to the target domain. Despite the rapid explosion of SFDA work, yet there has no timely and comprehensive survey in the field. To fill this gap, we provide a comprehensive survey of recent advances in SFDA and organize them into a unified categorization scheme based on the framework of transfer learning. Instead of presenting each approach independently, we modularize several components of each method to more clearly illustrate their relationships and mechanics in light of the composite properties of each method. Furthermore, we compare the results of more than 30 representative SFDA methods on three popular classification benchmarks, namely Office-31, Office-home, and VisDA, to explore the effectiveness of various technical routes and the combination effects among them. Additionally, we briefly introduce the applications of SFDA and related fields. Drawing from our analysis of the challenges facing SFDA, we offer some insights into future research directions and potential settings.


title: Fock structure of complete Boolean algebras of type I factors and of unital factorizations

abstract: The factorizable vectors of a complete Boolean algebra of type I factors, acting on a separable Hilbert space, are shown to be total, resolving a conjecture of Araki and Woods. En route, the spectral theory of noise-type Boolean algebras of Tsirelson is cast in the noncommutative language of "factorizations with unit" for which a muti-layered characterization of being "of Fock type" is provided.


title: Mean-field dynamo due to spatiotemporal fluctuations of the turbulent kinetic energy

abstract: In systems where the standard $\alpha$ effect is inoperative, one often explains the existence of mean magnetic fields by invoking the `incoherent $\alpha$ effect', which appeals to fluctuations of the mean kinetic helicity at a mesoscale. Most previous studies, while considering fluctuations in the mean kinetic helicity, treated the mean turbulent kinetic energy at the mesoscale as a constant, despite the fact that both these quantities involve second-order velocity correlations. The mean turbulent kinetic energy affects the mean magnetic field through both turbulent diffusion and turbulent diamagnetism. In this work, we use a double-averaging procedure to analytically show that fluctuations of the mean turbulent kinetic energy at the mesoscale (giving rise to $\eta$-fluctuations at the mesoscale, where the scalar $\eta$ is the turbulent diffusivity) can lead to the growth of a large-scale magnetic field even when the kinetic helicity is zero pointwise. Constraints on the operation of such a dynamo are expressed in terms of dynamo numbers that depend on the correlation length, correlation time, and strength of these fluctuations. In the white-noise limit, we find that these fluctuations reduce the overall turbulent diffusion, while also contributing a drift term which does not affect the growth of the field. We also study the effects of nonzero correlation time and anisotropy. Turbulent diamagnetism, which arises due to inhomogeneities in the turbulent kinetic energy, leads to growing mean field solutions even when the $\eta$-fluctuations are statistically isotropic.

categories: astro-ph.SR astro-ph.GA physics.flu-dyn physics.plasm-ph


title: PLU-Net: Extraction of multi-scale feature fusion

abstract: Deep learning algorithms have achieved remarkable results in medical image segmentation in recent years. These networks are unable to handle with image boundaries and details with enormous parameters, resulting in poor segmentation results. To address the issue, we develop atrous spatial pyramid pooling (ASPP) and combine it with the Squeeze-and-Excitation block (SE block), as well as present the PS module, which employs a broader and multi-scale receptive field at the network's bottom to obtain more detailed semantic information. We also propose the Local Guided block (LG block) and also its combination with the SE block to form the LS block, which can obtain more abundant local features in the feature map, so that more edge information can be retained in each down sampling process, thereby improving the performance of boundary segmentation. We propose PLU-Net and integrate our PS module and LS block into U-Net. We put our PLU-Net to the test on three benchmark datasets, and the results show that by fewer parameters and FLOPs, it outperforms on medical semantic segmentation tasks.


title: On the spectrum of the differential operators of even order with periodic matrix coefficients

abstract: In this paper, we consider the band functions, Bloch functions and spectrum of the self-adjoint differential operator L with periodic matrix coefficients. Conditions are found for the coefficients under which the number of gaps in the spectrum of the operator L is finite


title: Prenex normalization and the hierarchical classification of formulas

abstract: Akama et al. [1] introduced a hierarchical classification of first-order formulas for a hierarchical prenex normal form theorem in semi-classical arithmetic. In this paper, we give a justification for the hierarchical classification in a general context of first-order theories. To this end, we first formalize the standard transformation procedure for prenex normalization. Then we show that the classes $\mathrm{E}_k$ and $\mathrm{U}_k$ introduced in [1] are exactly the classes induced by $\Sigma_k$ and $\Pi_k$ respectively via the transformation procedure in any first-order theory.


title: Characterizing The Impact of Culture on Agile Methods: The MoCA Model

abstract: Agile methods are well-known approaches in software development and used in various settings, which may vary wrt. organizational size, culture, or industrial sector. One important facet for the successful use of agile methods is the strong focus on social aspects. We know, that cultural values influence the behaviour of humans. Thus, an in-depth understanding of the influence of cultural aspects on agile methods is necessary to be able to adapt agile methods to various cultural contexts. In this paper we focus on an enabler to this problem. We want to better understand the influence of cultural factors on agile practices. The core contribution of this paper is MoCA: A model describing the impact of cultural values on agile elements.


title: A novel efficient Multi-view traffic-related object detection framework

abstract: With the rapid development of intelligent transportation system applications, a tremendous amount of multi-view video data has emerged to enhance vehicle perception. However, performing video analytics efficiently by exploiting the spatial-temporal redundancy from video data remains challenging. Accordingly, we propose a novel traffic-related framework named CEVAS to achieve efficient object detection using multi-view video data. Briefly, a fine-grained input filtering policy is introduced to produce a reasonable region of interest from the captured images. Also, we design a sharing object manager to manage the information of objects with spatial redundancy and share their results with other vehicles. We further derive a content-aware model selection policy to select detection methods adaptively. Experimental results show that our framework significantly reduces response latency while achieving the same detection accuracy as the state-of-the-art methods.


title: Ordered normed spaces of functions of bounded variation

abstract: In this paper, we define and study the space of all the functions of bounded variation $f:[x,y]\to \mathbb{Y}$ denoted by $\mathcal{BV}[x,y],$ where $[x,y]$ is an ordered interval and $\mathbb{Y}$ is an absolute order unit space having vector lattice structure. By default, under the order structure of $\mathbb{Y},$ the space $\mathcal{BV}[x,y]$ forms a nearer absolute order unit space structure and in some cases it turns out to be an absolute order unit space (in fact, a unital $AM$-space). By help of variation function, we also define a different kind of order structure on the space $\mathcal{BV}[x,y]$ that also makes $\mathcal{BV}[x,y]$ a nearer absolute order unit space structure. Later, we also show that under certain conditions this ordering induces a complete norm on $\mathcal{BV}[x,y].$


title: Teacher Intervention: Improving Convergence of Quantization Aware Training for Ultra-Low Precision Transformers

abstract: Pre-trained Transformer models such as BERT have shown great success in a wide range of applications, but at the cost of substantial increases in model complexity. Quantization-aware training (QAT) is a promising method to lower the implementation cost and energy consumption. However, aggressive quantization below 2-bit causes considerable accuracy degradation due to unstable convergence, especially when the downstream dataset is not abundant. This work proposes a proactive knowledge distillation method called Teacher Intervention (TI) for fast converging QAT of ultra-low precision pre-trained Transformers. TI intervenes layer-wise signal propagation with the intact signal from the teacher to remove the interference of propagated quantization errors, smoothing loss surface of QAT and expediting the convergence. Furthermore, we propose a gradual intervention mechanism to stabilize the recovery of subsections of Transformer layers from quantization. The proposed schemes enable fast convergence of QAT and improve the model accuracy regardless of the diverse characteristics of downstream fine-tuning tasks. We demonstrate that TI consistently achieves superior accuracy with significantly lower fine-tuning iterations on well-known Transformers of natural language processing as well as computer vision compared to the state-of-the-art QAT methods.


title: Deep OC-SORT: Multi-Pedestrian Tracking by Adaptive Re-Identification

abstract: Motion-based association for Multi-Object Tracking (MOT) has recently re-achieved prominence with the rise of powerful object detectors. Despite this, little work has been done to incorporate appearance cues beyond simple heuristic models that lack robustness to feature degradation. In this paper, we propose a novel way to leverage objects' appearances to adaptively integrate appearance matching into existing high-performance motion-based methods. Building upon the pure motion-based method OC-SORT, we achieve 1st place on MOT20 and 2nd place on MOT17 with 63.9 and 64.9 HOTA, respectively. We also achieve 61.3 HOTA on the challenging DanceTrack benchmark as a new state-of-the-art even compared to more heavily-designed methods. The code and models are available at \url{https://github.com/GerardMaggiolino/Deep-OC-SORT}.


title: FTM: A Frame-level Timeline Modeling Method for Temporal Graph Representation Learning

abstract: Learning representations for graph-structured data is essential for graph analytical tasks. While remarkable progress has been made on static graphs, researches on temporal graphs are still in its beginning stage. The bottleneck of the temporal graph representation learning approach is the neighborhood aggregation strategy, based on which graph attributes share and gather information explicitly. Existing neighborhood aggregation strategies fail to capture either the short-term features or the long-term features of temporal graph attributes, leading to unsatisfactory model performance and even poor robustness and domain generality of the representation learning method. To address this problem, we propose a Frame-level Timeline Modeling (FTM) method that helps to capture both short-term and long-term features and thus learns more informative representations on temporal graphs. In particular, we present a novel link-based framing technique to preserve the short-term features and then incorporate a timeline aggregator module to capture the intrinsic dynamics of graph evolution as long-term features. Our method can be easily assembled with most temporal GNNs. Extensive experiments on common datasets show that our method brings great improvements to the capability, robustness, and domain generality of backbone methods in downstream tasks. Our code can be found at https://github.com/yeeeqichen/FTM.


title: Walk on Stars: A Grid-Free Monte Carlo Method for PDEs with Neumann Boundary Conditions

abstract: Grid-free Monte Carlo methods based on the walk on spheres (WoS) algorithm solve fundamental partial differential equations (PDEs) like the Poisson equation without discretizing the problem domain or approximating functions in a finite basis. Such methods hence avoid aliasing in the solution, and evade the many challenges of mesh generation. Yet for problems with complex geometry, practical grid-free methods have been largely limited to basic Dirichlet boundary conditions. We introduce the walk on stars (WoSt) algorithm, which solves linear elliptic PDEs with arbitrary mixed Neumann and Dirichlet boundary conditions. The key insight is that one can efficiently simulate reflecting Brownian motion (which models Neumann conditions) by replacing the balls used by WoS with star-shaped domains. We identify such domains via the closest point on the visibility silhouette, by simply augmenting a standard bounding volume hierarchy with normal information. Overall, WoSt is an easy modification of WoS, and retains the many attractive features of grid-free Monte Carlo methods such as progressive and view-dependent evaluation, trivial parallelization, and sublinear scaling to increasing geometric detail.


title: EfficientFace: An Efficient Deep Network with Feature Enhancement for Accurate Face Detection

abstract: In recent years, deep convolutional neural networks (CNN) have significantly advanced face detection. In particular, lightweight CNNbased architectures have achieved great success due to their lowcomplexity structure facilitating real-time detection tasks. However, current lightweight CNN-based face detectors trading accuracy for efficiency have inadequate capability in handling insufficient feature representation, faces with unbalanced aspect ratios and occlusion. Consequently, they exhibit deteriorated performance far lagging behind the deep heavy detectors. To achieve efficient face detection without sacrificing accuracy, we design an efficient deep face detector termed EfficientFace in this study, which contains three modules for feature enhancement. To begin with, we design a novel cross-scale feature fusion strategy to facilitate bottom-up information propagation, such that fusing low-level and highlevel features is further strengthened. Besides, this is conducive to estimating the locations of faces and enhancing the descriptive power of face features. Secondly, we introduce a Receptive Field Enhancement module to consider faces with various aspect ratios. Thirdly, we add an Attention Mechanism module for improving the representational capability of occluded faces. We have evaluated EfficientFace on four public benchmarks and experimental results demonstrate the appealing performance of our method. In particular, our model respectively achieves 95.1% (Easy), 94.0% (Medium) and 90.1% (Hard) on validation set of WIDER Face dataset, which is competitive with heavyweight models with only 1/15 computational costs of the state-of-the-art MogFace detector.


title: Effect of channel dimensions and Reynolds numbers on the turbulence modulation for particle-laden turbulent channel flows

abstract: The addition of particles to turbulent flows changes the underlying mechanism of turbulence and leads to turbulence modulation. Different temporal and spatial scales for both phases make it challenging to understand turbulence modulation via one parameter. The important parameters are particle Stokes number, mass loading, particle Reynolds number, fluid bulk Reynolds number, etc., that act together and affect the fluid phase turbulence intensities. In the present study, we have carried out the large eddy simulations for different system sizes (2{\delta}/dp = 54, 81, and 117) and fluid bulk Reynolds numbers (Re_b = 5600 and 13750) to quantify the extent of turbulence attenuation. Here, {\delta} is the half-channel width, dp is the particle diameter, and Re_b is the fluid Reynolds number based on the fluid bulk velocity and channel width. The point particles are tracked with the Lagrangian approach. The scaling analysis of the feedback force shows that system size and fluid bulk Reynolds number are the two crucial parameters that affect the turbulence modulation more significantly than the other. The streamwise turbulent structures are observed to become lengthier and fewer with an increase in system size for the same volume fraction and fixed bulk Reynolds number. However, the streamwise high-speed streaks are smaller, thinner, and closely spaced for higher Reynolds numbers than the lower ones for the same volume fraction. In particle statistics, it is observed that the scaled particle fluctuations increase with the increase in system size while keeping the Reynolds number fixed. However, the scaled particle fluctuations decrease with the increase in fluid bulk Reynolds number for the same volume fraction and fixed system size. The present study highlights the scaling issue for designing industrial equipment for particle-laden turbulent flows.


title: Super-critical accretion of BeXRB SXP 15.3

abstract: We have studied the temporal and spectral properties of SXP 15.3 observed by \textit{NuSTAR} in hard energy range 3-79 keV during late 2018. The timing analysis of \textit{NuSTAR} observation predicts coherent pulsation at $15.2388\;\pm\;0.0002\;s$. The pulse profiles in different energy bands demonstrates energy dependence. The shape of the pulse profile was generally suggestive of a fan-beamed dominated pattern, which when combined with the measured luminosity predicts that the source may be accreting in the super-critical regime. Non-monotonic increase of Pulse Fraction was observed with energy. The \textit{NuSTAR} observation finds that the pulse period of the source have spun-up at a rate of --0.0176 s $yr^{-1}$ when compared to the previous analysis by the same observatory more than 1 year ago. The source flux in the present \textit{NuSTAR} study in 3-79 keV energy range is $\sim\;1.36\;\times\;10^{-10}\;erg\;cm^{-2}\;s^{-1}$ which corresponds to a luminosity of $\sim\;6\;\times\;10^{37}\;erg\;s^{-1}$. The cyclotron line energy of the source is detected at $\sim$5 keV. Pulse phase resolved spectroscopy shows that the cyclotron line energy varies significantly with pulse phase and the photon index becomes softer with increasing flux. In addition, we have studied the evolution of luminosity with time using 2017 and 2018 \textit{Swift/XRT} observations. The analysis of \textit{Swift/XRT} data reveals that the photon index are positively correlated with the source luminosity which is a characteristic of super-critical accretion phenomena.


title: On the space of compact diamonds of Lorentzian length spaces

abstract: In this work we introduce the taxicab and uniform products for Lorentzian pre-length spaces. We further use these concepts to endow the space $D(R\times_T X)$ of causal diamonds with a Lorentzian length space structure, closely relating its causal properties with its geometry as a metric space furnished with its associated Hausdorff distance. Among the general results, we show that this space is geodesic and globally hyperbolic for complete $X$.


title: Swarmalators with thermal noise

abstract: We investigate a population of swarmalators, a mobile version of phase oscillators that both sync in time and swarm through space. We focus on a XY-type model of identical swarmalators running on a one-dimensional ring and subject to thermal noise. We uncover four distinct collective states, some of which capture the behavior of real-world swarmalators such as vinegar eels and sperm. Among these, the most intriguing is the `mixed state', which blends two of the other states. We present a comprehensive phase diagram from the Fourier mode analysis with a high accuracy, which is in excellent agreement with numerical simulation results. Our model serves as a tractable toy model for thermal systems that both self-synchronize and self-assemble interdependently.


title: Storage in Computational Geometry

abstract: We show that $n$ real numbers can be stored in a constant number of real numbers such that each original real number can be fetched in $O(\log n)$ time. Although our result has implications for many computational geometry problems, we show here, combined with Han's $O(n\sqrt{\log n})$ time real number sorting algorithm [3, arXiv:1801.00776], we can improve the complexity of Kirkpatrick's point location algorithm [8] to $O(n\sqrt{\log n})$ preprocessing time, a constant number of real numbers for storage and $O(\log n)$ point location time. Kirkpatrick's algorithm uses $O(n\log n)$ preprocessing time, $O(n)$ storage and $O(\log n)$ point location time. The complexity results in Kirkpatrick's algorithm was the previous best result. Although Lipton and Tarjan's algorithm [10] predates Kirkpatrick's algorithm and has the same complexity, Kirkpatrick's algorithm is simpler and has a better structure. This paper can be viewed as a companion paper of paper [3, arXiv:1801.00776].


title: Multi-kernel property in high-frequency price dynamics under Hawkes model

abstract: This study investigates and uses multi-kernel Hawkes models to describe a high-frequency mid-price process. Each kernel represents a different responsive speed of market participants. Using the conditional Hessian, we examine whether the numerical optimizer effectively finds the global maximum of the log-likelihood function under complicated modeling. Empirical studies that use stock prices in the US equity market show the existence of multi-kernels classified as ultra-high-frequency (UHF), very-high-frequency (VHF), and high-frequency (HF). We estimate the conditional expectations of arrival times and the degree of contribution to the high-frequency activities for each kernel.


title: FedIL: Federated Incremental Learning from Decentralized Unlabeled Data with Convergence Analysis

abstract: Most existing federated learning methods assume that clients have fully labeled data to train on, while in reality, it is hard for the clients to get task-specific labels due to users' privacy concerns, high labeling costs, or lack of expertise. This work considers the server with a small labeled dataset and intends to use unlabeled data in multiple clients for semi-supervised learning. We propose a new framework with a generalized model, Federated Incremental Learning (FedIL), to address the problem of how to utilize labeled data in the server and unlabeled data in clients separately in the scenario of Federated Learning (FL). FedIL uses the Iterative Similarity Fusion to enforce the server-client consistency on the predictions of unlabeled data and uses incremental confidence to establish a credible pseudo-label set in each client. We show that FedIL will accelerate model convergence by Cosine Similarity with normalization, proved by Banach Fixed Point Theorem. The code is available at https://anonymous.4open.science/r/fedil.


title: MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentions

abstract: Transformer based models have provided significant performance improvements in monaural speech separation. However, there is still a performance gap compared to a recent proposed upper bound. The major limitation of the current dual-path Transformer models is the inefficient modelling of long-range elemental interactions and local feature patterns. In this work, we achieve the upper bound by proposing a gated single-head transformer architecture with convolution-augmented joint self-attentions, named \textit{MossFormer} (\textit{Mo}naural \textit{s}peech \textit{s}eparation Trans\textit{Former}). To effectively solve the indirect elemental interactions across chunks in the dual-path architecture, MossFormer employs a joint local and global self-attention architecture that simultaneously performs a full-computation self-attention on local chunks and a linearised low-cost self-attention over the full sequence. The joint attention enables MossFormer model full-sequence elemental interaction directly. In addition, we employ a powerful attentive gating mechanism with simplified single-head self-attentions. Besides the attentive long-range modelling, we also augment MossFormer with convolutions for the position-wise local pattern modelling. As a consequence, MossFormer significantly outperforms the previous models and achieves the state-of-the-art results on WSJ0-2/3mix and WHAM!/WHAMR! benchmarks. Our model achieves the SI-SDRi upper bound of 21.2 dB on WSJ0-3mix and only 0.3 dB below the upper bound of 23.1 dB on WSJ0-2mix.


title: Boundary Value Caching for Walk on Spheres

abstract: Grid-free Monte Carlo methods such as walk on spheres can be used to solve elliptic partial differential equations without mesh generation or global solves. However, such methods independently estimate the solution at every point, and hence do not take advantage of the high spatial regularity of solutions to elliptic problems. We propose a fast caching strategy which first estimates solution values and derivatives at randomly sampled points along the boundary of the domain (or a local region of interest). These cached values then provide cheap, output-sensitive evaluation of the solution (or its gradient) at interior points, via a boundary integral formulation. Unlike classic boundary integral methods, our caching scheme introduces zero statistical bias and does not require a dense global solve. Moreover we can handle imperfect geometry (e.g., with self-intersections) and detailed boundary/source terms without repairing or resampling the boundary representation. Overall, our scheme is similar in spirit to virtual point light methods from photorealistic rendering: it suppresses the typical salt-and-pepper noise characteristic of independent Monte Carlo estimates, while still retaining the many advantages of Monte Carlo solvers: progressive evaluation, trivial parallelization, geometric robustness, etc. We validate our approach using test problems from visual and geometric computing.


title: Regeneration of bottomonia in an open quantum systems approach

abstract: We demonstrate the importance of quantum jumps in the nonequilibrium evolution of bottomonium states in the quark-gluon plasma. Based on nonrelativistic effective field theory and the open quantum system framework, we evolve the density matrix of color singlet and octet pairs. We show that quantum regeneration of singlet states from octet configurations is necessary to understand experimental results for the suppression of both bottomonium ground and excited states. The values of the heavy-quarkonium transport coefficients used are consistent with recent lattice QCD determinations.


title: Open Challenges for Monocular Single-shot 6D Object Pose Estimation

abstract: Object pose estimation is a non-trivial task that enables robotic manipulation, bin picking, augmented reality, and scene understanding, to name a few use cases. Monocular object pose estimation gained considerable momentum with the rise of high-performing deep learning-based solutions and is particularly interesting for the community since sensors are inexpensive and inference is fast. Prior works establish the comprehensive state of the art for diverse pose estimation problems. Their broad scopes make it difficult to identify promising future directions. We narrow down the scope to the problem of single-shot monocular 6D object pose estimation, which is commonly used in robotics, and thus are able to identify such trends. By reviewing recent publications in robotics and computer vision, the state of the art is established at the union of both fields. Following that, we identify promising research directions in order to help researchers to formulate relevant research ideas and effectively advance the state of the art. Findings include that methods are sophisticated enough to overcome the domain shift and that occlusion handling is a fundamental challenge. We also highlight problems such as novel object pose estimation and challenging materials handling as central challenges to advance robotics.


title: Numerical solution to a free boundary problem for the Stokes equation using the coupled complex boundary method in shape optimization settings

abstract: A new reformulation of a free boundary problem for the Stokes equations governing a viscous flow with overdetermined condition on the free boundary is proposed. The idea of the method is to transform the governing equations to a boundary value problem with a complex Robin boundary condition coupling the two boundary conditions on the free boundary. The proposed formulation give rise to a new cost functional that apparently has not been exploited yet in the literature, specifically, and at least, in the context of free surface problems. The shape derivatives of the cost function constructed by the imaginary part of the solution in the whole domain in order to identify the free boundary is explicitly determined. Using the computed shape gradient information, a domain variation method from a preconditioned steepest descent algorithm is applied to solve the shape optimization problem. Numerical results illustrating the applicability of the method is then provided both in two and three spatial dimensions. For validation and evaluation of the method, the numerical results are compared with the ones obtained via the classical tracking Dirichlet data.


title: Learning to Manipulate a Commitment Optimizer

abstract: It is shown in recent studies that in a Stackelberg game the follower can manipulate the leader by deviating from their true best-response behavior. Such manipulations are computationally tractable and can be highly beneficial for the follower. Meanwhile, they may result in significant payoff losses for the leader, sometimes completely defeating their first-mover advantage. A warning to commitment optimizers, the risk these findings indicate appears to be alleviated to some extent by a strict information advantage the manipulations rely on. That is, the follower knows the full information about both players' payoffs whereas the leader only knows their own payoffs. In this paper, we study the manipulation problem with this information advantage relaxed. We consider the scenario where the follower is not given any information about the leader's payoffs to begin with but has to learn to manipulate by interacting with the leader. The follower can gather necessary information by querying the leader's optimal commitments against contrived best-response behaviors. Our results indicate that the information advantage is not entirely indispensable to the follower's manipulations: the follower can learn the optimal way to manipulate in polynomial time with polynomially many queries of the leader's optimal commitment.


title: Arithmetic density and congruences of $t$-core partitions

abstract: A partition of $n$ is called a $t$-core partition if none of its hook number is divisible by $t.$ In 2019, Hirschhorn and Sellers \cite{Hirs2019} obtained a parity result for $3$-core partition function $a_3(n)$. Recently, both authors \cite{MeherJindal2022} proved density results for $a_3(n)$, wherein we proved that $a_3(n)$ is almost always divisible by arbitrary power of $2$ and $3.$ In this article, we prove that for a non-negative integer $\alpha,$ $a_{3^{\alpha} m}(n)$ is almost always divisible by arbitrary power of $2$ and $3.$ Further, we prove that $a_{t}(n)$ is almost always divisible by arbitrary power of $p_i^j,$ where $j$ is a fixed positive integer and $t= p_1^{a_1}p_2^{a_2}\ldots p_m^{a_m}$ with primes $p_i \geq 5.$ Furthermore, by employing Radu and Seller's approach, we obtain an algorithm and we give alternate proofs of several congruences modulo $3$ and $5$ for $a_{p}(n)$, where $p$ is prime number. Our results also generalizes the results in \cite{radu2011a}.


title: Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement

abstract: Ultra-High-Definition (UHD) photo has gradually become the standard configuration in advanced imaging devices. The new standard unveils many issues in existing approaches for low-light image enhancement (LLIE), especially in dealing with the intricate issue of joint luminance enhancement and noise removal while remaining efficient. Unlike existing methods that address the problem in the spatial domain, we propose a new solution, UHDFour, that embeds Fourier transform into a cascaded network. Our approach is motivated by a few unique characteristics in the Fourier domain: 1) most luminance information concentrates on amplitudes while noise is closely related to phases, and 2) a high-resolution image and its low-resolution version share similar amplitude patterns.Through embedding Fourier into our network, the amplitude and phase of a low-light image are separately processed to avoid amplifying noise when enhancing luminance. Besides, UHDFour is scalable to UHD images by implementing amplitude and phase enhancement under the low-resolution regime and then adjusting the high-resolution scale with few computations. We also contribute the first real UHD LLIE dataset, \textbf{UHD-LL}, that contains 2,150 low-noise/normal-clear 4K image pairs with diverse darkness and noise levels captured in different scenarios. With this dataset, we systematically analyze the performance of existing LLIE methods for processing UHD images and demonstrate the advantage of our solution. We believe our new framework, coupled with the dataset, would push the frontier of LLIE towards UHD. The code and dataset are available at https://li-chongyi.github.io/UHDFour.


title: D2Former: A Fully Complex Dual-Path Dual-Decoder Conformer Network using Joint Complex Masking and Complex Spectral Mapping for Monaural Speech Enhancement

abstract: Monaural speech enhancement has been widely studied using real networks in the time-frequency (TF) domain. However, the input and the target are naturally complex-valued in the TF domain, a fully complex network is highly desirable for effectively learning the feature representation and modelling the sequence in the complex domain. Moreover, phase, an important factor for perceptual quality of speech, has been proved learnable together with magnitude from noisy speech using complex masking or complex spectral mapping. Many recent studies focus on either complex masking or complex spectral mapping, ignoring their performance boundaries. To address above issues, we propose a fully complex dual-path dual-decoder conformer network (D2Former) using joint complex masking and complex spectral mapping for monaural speech enhancement. In D2Former, we extend the conformer network into the complex domain and form a dual-path complex TF self-attention architecture for effectively modelling the complex-valued TF sequence. We further boost the TF feature representation in the encoder and the decoders using a dual-path learning structure by exploiting complex dilated convolutions on time dependency and complex feedforward sequential memory networks (CFSMN) for frequency recurrence. In addition, we improve the performance boundaries of complex masking and complex spectral mapping by combining the strengths of the two training targets into a joint-learning framework. As a consequence, D2Former takes fully advantages of the complex-valued operations, the dual-path processing, and the joint-training targets. Compared to the previous models, D2Former achieves state-of-the-art results on the VoiceBank+Demand benchmark with the smallest model size of 0.87M parameters.


title: Pressure induced electride phase formation in calcium: A key to its strange high-pressure behavior

abstract: Elemental calcium (Ca), a simple metal at ambient conditions, has attracted huge interest because of its unusual high-pressure behavior in structural, electrical, and melting properties whose origin remain unsolved. Here, using a theoretical framework appropriate for describing electride phase formation, i.e., the presence of anionic electrons, we establish electride formation in Ca at a pressure as low as 8 GPa. Our analysis shows that under pressure the valence electrons of Ca localize at octahedral holes and exhibit anionic character which is responsible for its strange pressure behavior. Our calculated enthalpy and electrical resistance indicate that Ca will directly transform from an FCC-electride phase to an SC-electride phase near 30 GPa thereby avoiding the intermediate BCC phase. These findings are not limited to Ca but might hold a key to the understanding of host-guest type structures which occur in other elemental solids though at much higher pressures.


title: Generalization of Auto-Regressive Hidden Markov Models to Non-Linear Dynamics and Unit Quaternion Observation Space

abstract: Latent variable models are widely used to perform unsupervised segmentation of time series in different context such as robotics, speech recognition, and economics. One of the most widely used latent variable model is the Auto-Regressive Hidden Markov Model (ARHMM), which combines a latent mode governed by a Markov chain dynamics with a linear Auto-Regressive dynamics of the observed state. In this work, we propose two generalizations of the ARHMM. First, we propose a more general AR dynamics in Cartesian space, described as a linear combination of non-linear basis functions. Second, we propose a linear dynamics in unit quaternion space, in order to properly describe orientations. These extensions allow to describe more complex dynamics of the observed state. Although this extension is proposed for the ARHMM, it can be easily extended to other latent variable models with AR dynamics in the observed space, such as Auto-Regressive Hidden semi-Markov Models.


title: Reinforcement Learning for Combining Search Methods in the Calibration of Economic ABMs

abstract: Calibrating agent-based models (ABMs) in economics and finance typically involves a derivative-free search in a very large parameter space. In this work, we benchmark a number of search methods in the calibration of a well-known macroeconomic ABM on real data, and further assess the performance of "mixed strategies" made by combining different methods. We find that methods based on random-forest surrogates are particularly efficient, and that combining search methods generally increases performance since the biases of any single method are mitigated. Moving from these observations, we propose a reinforcement learning (RL) scheme to automatically select and combine search methods on-the-fly during a calibration run. The RL agent keeps exploiting a specific method only as long as this keeps performing well, but explores new strategies when the specific method reaches a performance plateau. The resulting RL search scheme outperforms any other method or method combination tested, and does not rely on any prior information or trial and error procedure.


title: On Statistical Properties of Sharpness-Aware Minimization: Provable Guarantees

abstract: Sharpness-Aware Minimization (SAM) is a recent optimization framework aiming to improve the deep neural network generalization, through obtaining flatter (i.e. less sharp) solutions. As SAM has been numerically successful, recent papers have studied the theoretical aspects of the framework and have shown SAM solutions are indeed flat. However, there has been limited theoretical exploration regarding statistical properties of SAM. In this work, we directly study the statistical performance of SAM, and present a new theoretical explanation of why SAM generalizes well. To this end, we study two statistical problems, neural networks with a hidden layer and kernel regression, and prove under certain conditions, SAM has smaller prediction error over Gradient Descent (GD). Our results concern both convex and non-convex settings, and show that SAM is particularly well-suited for non-convex problems. Additionally, we prove that in our setup, SAM solutions are less sharp as well, showing our results are in agreement with the previous work. Our theoretical findings are validated using numerical experiments on numerous scenarios, including deep neural networks.


title: Bounding the FDP in competition-based control of the FDR

abstract: Competition-based approach to controlling the false discovery rate (FDR) recently rose to prominence when, generalizing it to sequential hypothesis testing, Barber and Cand\`es used it as part of their knockoff-filter. Control of the FDR implies that the, arguably more important, false discovery proportion is only controlled in an average sense. We present TDC-SB and TDC-UB that provide upper prediction bounds on the FDP in the list of discoveries generated when controlling the FDR using competition. Using simulated and real data we show that, overall, our new procedures offer significantly tighter upper bounds than ones obtained using the recently published approach of Katsevich and Ramdas, even when the latter is further improved using the interpolation concept of Goeman et al.


title: Minimum-Entropy Coupling Approximation Guarantees Beyond the Majorization Barrier

abstract: Given a set of discrete probability distributions, the minimum entropy coupling is the minimum entropy joint distribution that has the input distributions as its marginals. This has immediate relevance to tasks such as entropic causal inference for causal graph discovery and bounding mutual information between variables that we observe separately. Since finding the minimum entropy coupling is NP-Hard, various works have studied approximation algorithms. The work of [Compton, ISIT 2022] shows that the greedy coupling algorithm of [Kocaoglu et al., AAAI 2017] is always within $log_2(e) \approx 1.44$ bits of the optimal coupling. Moreover, they show that it is impossible to obtain a better approximation guarantee using the majorization lower-bound that all prior works have used: thus establishing a majorization barrier. In this work, we break the majorization barrier by designing a stronger lower-bound that we call the profile method. Using this profile method, we are able to show that the greedy algorithm is always within $log_2(e)/e \approx 0.53$ bits of optimal for coupling two distributions (previous best-known bound is within 1 bit), and within $(1 + log_2(e))/2 \approx 1.22$ bits for coupling any number of distributions (previous best-known bound is within 1.44 bits). We also examine a generalization of the minimum entropy coupling problem: Concave Minimum-Cost Couplings. We are able to obtain similar guarantees for this generalization in terms of the concave cost function. Additionally, we make progress on the open problem of [Kova\v{c}evi\'c et al., Inf. Comput. 2015] regarding NP membership of the minimum entropy coupling problem by showing that any hardness of minimum entropy coupling beyond NP comes from the difficulty of computing arithmetic in the complexity class NP. Finally, we present exponential-time algorithms for computing the exactly optimal solution.


title: Spectral extrema of graphs: Forbidden star-path forests

abstract: A path of order $n$ is denoted by $P_n$, and a star of order $n$ is denoted by $S_{n-1}$. A star-path forest is a forest whose connected components are paths and stars. In this paper we determine the maximum spectral radius of graphs that contain no copy of $kS_{\ell-1}\cup P_{\ell}$, $k_1S_{2\ell -1}\cup k_2P_{2\ell}$ or $kS_{4}\cup 2P_{5}$ for $n$ appropriately large.


title: StudyFormer : Attention-Based and Dynamic Multi View Classifier for X-ray images

abstract: Chest X-ray images are commonly used in medical diagnosis, and AI models have been developed to assist with the interpretation of these images. However, many of these models rely on information from a single view of the X-ray, while multiple views may be available. In this work, we propose a novel approach for combining information from multiple views to improve the performance of X-ray image classification. Our approach is based on the use of a convolutional neural network to extract feature maps from each view, followed by an attention mechanism implemented using a Vision Transformer. The resulting model is able to perform multi-label classification on 41 labels and outperforms both single-view models and traditional multi-view classification architectures. We demonstrate the effectiveness of our approach through experiments on a dataset of 363,000 X-ray images.


title: Semi-classical states for fractional Choquard equations with decaying potentials

abstract: This paper deals with the following fractional Choquard equation $$\varepsilon^{2s}(-\Delta)^su +Vu=\varepsilon^{-\alpha}(I_\alpha*|u|^p)|u|^{p-2}u\ \ \ \mathrm{in}\ \mathbb{R}^N,$$ where $\varepsilon>0$ is a small parameter, $(-\Delta)^s$ is the fractional Laplacian, $N>2s$, $s\in(0,1)$, $\alpha\in\big((N-4s)_{+}, N\big)$, $p\in[2, \frac{N+\alpha}{N-2s})$, $I_\alpha$ is a Riesz potential, $V\in C\big(\mathbb{R}^N, [0, +\infty)\big)$ is an electric potential. Under some assumptions on the decay rate of $V$ and the corresponding range of $p$, we prove that the problem has a family of solutions $\{u_\varepsilon\}$ concentrating at a local minimum of $V$ as $\varepsilon\to 0$. Since the potential $V$ decays at infinity, we need to employ a type of penalized argument and implement delicate analysis on the both nonlocal terms to establish regularity, positivity and asymptotic behaviour of $u_\varepsilon$, which is totally different from the local case. As a contrast, we also develop some nonexistence results, which imply that the assumptions on $V$ and $p$ for the existence of $u_\varepsilon$ are almost optimal. To prove our main results, a general strong maximum principle and comparison function for the weak solutions of fractional Laplacian equations are established. The main methods in this paper are variational methods, penalized technique and some comparison principle developed in this paper.


title: Bethe vectors and recurrence relations for twisted Yangian based models

abstract: We study Olshanski twisted Yangian based models, known as one-dimensional "soliton non-preserving" open spin chains, by means of the algebraic Bethe ansatz. The even case, when the underlying bulk Lie algebra is $\mathfrak{gl}_{2n}$, was studied in arXiv:1710.08409. In the present work, we focus on the odd case, when the underlying bulk Lie algebra is $\mathfrak{gl}_{2n+1}$. We present a more symmetric form of the trace formula for Bethe vectors. We use the composite model approach and $Y(\mathfrak{gl}_n)$-type recurrence relations to obtain recurrence relations for twisted Yangian based Bethe vectors, for both even and odd cases.


title: Addressing UX Practitioners' Challenges in Designing ML Applications: an Interactive Machine Learning Approach

abstract: UX practitioners face novel challenges when designing user interfaces for machine learning (ML)-enabled applications. Interactive ML paradigms, like AutoML and interactive machine teaching, lower the barrier for non-expert end users to create, understand, and use ML models, but their application to UX practice is largely unstudied. We conducted a task-based design study with 27 UX practitioners where we asked them to propose a proof-of-concept design for a new ML-enabled application. During the task, our participants were given opportunities to create, test, and modify ML models as part of their workflows. Through a qualitative analysis of our post-task interview, we found that direct, interactive experimentation with ML allowed UX practitioners to tie ML capabilities and underlying data to user goals, compose affordances to enhance end-user interactions with ML, and identify ML-related ethical risks and challenges. We discuss our findings in the context of previously established human-AI guidelines. We also identify some limitations of interactive ML in UX processes and propose research-informed machine teaching as a supplement to future design tools alongside interactive ML.


title: Coronal Elemental Abundances during A-class Solar Flares Observed by Chandrayaan-2 XSM

abstract: The abundances of low First Ionisation Potential (FIP) elements are three to four times higher (FIP bias) in the closed loop active corona than in the photosphere, known as the FIP effect. Observations suggest that the abundances vary in different coronal structures. Here, we use the soft X-ray spectroscopic measurements from the Solar X-ray Monitor (XSM) on board the Chandrayaan-2 orbiter to study the FIP effect in multiple A-class flares observed during the minimum of solar cycle 24. Using time-integrated spectral analysis, we derive the average temperature, emission measure, and the abundances of four elements - Mg, Al, Si, and S. We find that the temperature and emission measure scales with the flares sub-class while the measured abundances show an intermediate FIP bias for the lower A-flares (e.g., A1), while for the higher A-flares, the FIP bias is near unity. To investigate it further, we perform a time-resolved spectral analysis for a sample of the A-class flares and examine the evolution of temperature, emission measure, and abundances. We find that the abundances drop from the coronal values towards their photospheric values in the impulsive phase of the flares, and after the impulsive phase, they quickly return to the usual coronal values. The transition of the abundances from the coronal to photospheric values in the impulsive phase of the flares indicates the injection of fresh unfractionated material from the lower solar atmosphere to the corona due to chromospheric evaporation. However, explaining the quick recovery of the abundances from the photospheric to coronal values in the decay phase of the flare is challenging.


title: Understanding Collaborative Practices and Tools of Professional UX Practitioners in Software Organizations

abstract: User experience (UX) has undergone a revolution in collaborative practices, due to tools that enable quick feedback and continuous collaboration with a varied team across a design's lifecycle. However, it is unclear how this shift in collaboration has been received in professional UX practice, and whether new pain points have arisen. To this end, we conducted a survey (N=114) with UX practitioners at software organizations based in the U.S. to better understand their collaborative practices and tools used throughout the design process. We found that while an increase in collaborative activity enhanced many aspects of UX work, some long-standing challenges -- such as handing off designs to developers -- still persist. Moreover, we observed new challenges emerging from activities enabled by collaborative tools such as design system management. Based on our findings, we discuss how UX practices can improve collaboration moving forward and provide concrete design implications for collaborative UX tools.


title: Movable but unavoidable nodal lines through high-symmetry points in two-dimensional materials

abstract: In two-dimensional materials electronic band contacts often give non-trivial contribution to materials topological properties. Besides band contacts at high-symmetry points (HSP) in the Brillouin zone (BZ), like those in graphene, there are nodal lines which form various patterns in the reciprocal space. In this paper we have found all movable nodal lines, which shape depends on the model, that pass through HSPs in the presence of time-reversal symmetry. Cases with and without spin-orbit coupling are included by studying all eighty layer groups and their double extensions. Eight single and six double groups, including three symmorphic, necessarily host Dirac and Weyl nodal lines that extend through the whole BZ, respectively. Our research might be of interest in designing new materials with interesting physical properties.


title: Some Remarks on Capacitary Integrals and Measure Theory

abstract: We present results for Choquet integrals with minimal assumptions on the monotone set function through which they are defined. They include the equivalence of sublinearity and strong subadditivity independent of regularity assumptions on the capacity, as well as various forms of standard measure theoretic convergence theorems for these non-additive integrals, e.g. Fatou's lemma and Lebesgue's dominated convergence theorem.


title: Web-Scale Academic Name Disambiguation: the WhoIsWho Benchmark, Leaderboard, and Toolkit

abstract: Name disambiguation -- a fundamental problem in online academic systems -- is now facing greater challenges with the increasing growth of research papers. For example, on AMiner, an online academic search platform, about 10% of names own more than 100 authors. Such real-world challenging cases have not been effectively addressed by existing researches due to the small-scale or low-quality datasets that they have used. The development of effective algorithms is further hampered by a variety of tasks and evaluation protocols designed on top of diverse datasets. To this end, we present WhoIsWho owning, a large-scale benchmark with over 1,000,000 papers built using an interactive annotation process, a regular leaderboard with comprehensive tasks, and an easy-to-use toolkit encapsulating the entire pipeline as well as the most powerful features and baseline models for tackling the tasks. Our developed strong baseline has already been deployed online in the AMiner system to enable daily arXiv paper assignments. The public leaderboard is available at http://whoiswho.biendata.xyz/. The toolkit is at https://github.com/THUDM/WhoIsWho. The online demo of daily arXiv paper assignments is at https://na-demo.aminer.cn/arxivpaper.


title: Coarse-to-Fine Knowledge Selection for Document Grounded Dialogs

abstract: Multi-document grounded dialogue systems (DGDS) belong to a class of conversational agents that answer users' requests by finding supporting knowledge from a collection of documents. Most previous studies aim to improve the knowledge retrieval model or propose more effective ways to incorporate external knowledge into a parametric generation model. These methods, however, focus on retrieving knowledge from mono-granularity language units (e.g. passages, sentences, or spans in documents), which is not enough to effectively and efficiently capture precise knowledge in long documents. This paper proposes Re3G, which aims to optimize both coarse-grained knowledge retrieval and fine-grained knowledge extraction in a unified framework. Specifically, the former efficiently finds relevant passages in a retrieval-and-reranking process, whereas the latter effectively extracts finer-grain spans within those passages to incorporate into a parametric answer generation model (BART, T5). Experiments on DialDoc Shared Task demonstrate the effectiveness of our method.


title: Object-Centric Video Prediction via Decoupling of Object Dynamics and Interactions

abstract: We propose a novel framework for the task of object-centric video prediction, i.e., extracting the compositional structure of a video sequence, as well as modeling objects dynamics and interactions from visual observations in order to predict the future object states, from which we can then generate subsequent video frames. With the goal of learning meaningful spatio-temporal object representations and accurately forecasting object states, we propose two novel object-centric video predictor (OCVP) transformer modules, which decouple the processing of temporal dynamics and object interactions, thus presenting an improved prediction performance. In our experiments, we show how our object-centric prediction framework utilizing our OCVP predictors outperforms object-agnostic video prediction models on two different datasets, while maintaining consistent and accurate object representations.


title: Theoretical Evaluation of the Capacity-Achieving Distribution for IM-DD Fiber-Optic Channels

abstract: The capacity and capacity-achieving distribution for intensity-modulation and direct-detection (IM-DD) fiber-optic channels is theoretically investigated. Different from coherent fiber-optic channels, we indicate that the capacity-achieving distribution of IM-DD systems should be discussed separately in two cases: 1) IM-DD systems without optical amplifier, which are constrained in peak power; 2) IM-DD systems with optical amplifier, which are the average power constraint (APC) system. For the two models, the maximum mutual information achieving distribution, instead of the maximum input entropy achieving distribution, is numerically computed by the iterative Blahut-Arimoto (BA) algorithm. For the IM-DD system under peak power constraint (PPC), a dynamic-assignment BA algorithm is applied to find the capacity-achieving distribution with minimum cardinality. It is observed that the maximum difference between the minimum input cardinality and capacity is around 0.8 bits. For a fixed support input cardinality, although the observed shaping gain is small and only appears in low peak-signal-to-noise ratio (PSNR) regions in the PPC IM-DD system, the probabilistic shaping technique can also be used to introduce rate adaptation to the system by adjusting the shaping and FEC overheads since the capacity-achieving distribution is symmetric. In the IM-DD system under APC, a modified BA algorithm is investigated to solve for the capacity and capacity-achieving distribution, and a significant shaping gain is observed. For PAM8 and PAM16 modulation formats, 0.294 bits/symbol and 0.531 bits/symbol shaping gain can be obtained at the SNR of 20dB. Furthermore, since the capacity-achieving distribution is asymmetric in this case, a practical discussion of the PS technique is also presented.


title: Stability of the next-to-tribimaximal mixings under radiative corrections with the variation of SUSY breaking scale in MSSM

abstract: We analyse the radiative stability of the next-to-tribimaximal mixings ($NTBM$) with the variation of SUSY breaking scale ($m_S$) in MSSM, for both normal ordering (NO) and inverted ordering (IO) at the fixed input value of seesaw scale $M_R = 10^{15}$ GeV and two different values of $\tan \beta$. All the neutrino oscillation parameters receive varying radiative corrections irrespective of the $m_S$ values at the electroweak scale, which are all within $3\sigma$ range of the latest global fit data at low value of $\tan \beta$ (30). NO is found to be more stable than IO for all four different NTBM mixing patterns.


title: Logic Blog 2022

abstract: The 2022 logic blog has concentrated on the connections of group theory and logic. It discusses Gardam's 2021 refutation of the Higman/ Kaplansky unit conjecture, and its connections to logic and to computation. The rest is about topological groups of various kinds, in particular a computational theory of tdlc groups, and a duality between locally Roelcke precompact groups and certain countable structures called meet groupoids.


title: Extension of the HKLL bulk reconstruction for small $\Delta$

abstract: We re-analyse the bulk reconstruction for a scalar field in Lorentzian AdS spacetime, both for the case of even and odd dimensions, for an extended range of conformal dimensions where the original HKLL reconstruction has to be modified. We also discuss the use of space-like Green's functions in the bulk reconstruction. We demonstrate that in the extended range also the singular part of the Green's function, omitted in the original papers, has be included. The results are particularly simple and physically interesting for integer conformal dimensions below the range considered in the original HKLL papers.


title: Accurate Free Energy Estimations of Molecular Systems Via Flow-based Targeted Free Energy Perturbation

abstract: The Targeted Free Energy Perturbation (TFEP) method aims to overcome the time-consuming and computer-intensive stratification process of standard methods for estimating the free energy difference between two states. To achieve this, TFEP uses a mapping function between the high-dimensional probability densities of these states. The bijectivity and invertibility of normalizing flow neural networks fulfill the requirements for serving as such a mapping function. Despite its theoretical potential for free energy calculations, TFEP has not yet been adopted in practice due to challenges in entropy correction, limitations in energy-based training, and mode collapse when learning density functions of larger systems with a high number of degrees of freedom. In this study, we expand flow-based TFEP to systems with variable number of atoms in the two states of consideration by exploring the theoretical basis of entropic contributions of dummy atoms, and validate our reasoning with analytical derivations for a model system containing coupled particles. We also extend the TFEP framework to handle systems of hybrid topology, propose auxiliary additions to improve the TFEP architecture, and demonstrate accurate predictions of relative free energy differences for large molecular systems. Our results provide the first practical application of the fast and accurate deep learning-based TFEP method for biomolecules and introduce it as a viable free energy estimation method within the context of drug design.


title: Analytic combinatorics of coordination numbers of cubic lattices

abstract: We investigate coordination numbers of the cubic lattices with emphases on their analytic behaviors, including the total positivity of the coordination matrices, the distribution of zeros of the coordination polynomials, the asymptotic normality of the coefficients of the coordination polynomials, the log-concavity and the log-convexity of the coordination numbers.


title: Supertraces on queerified algebras

abstract: We describe supertraces on ``queerifications'' (see arxiv:2203.06917) of the algebras of matrices of ``complex size'', algebras of observables of Calogero-Moser model, Vasiliev higher spin algebras, and (super)algebras of pseudo-differential operators. In the latter case, the supertraces establish complete integrability of the analogs of Euler equations to be written.


title: Propagator and transfer matrices, Marchenko focusing functions and their mutual relations

abstract: Many seismic imaging methods use wave field extrapolation operators to redatum sources and receivers from the surface into the subsurface. We discuss wave field extrapolation operators that account for internal multiple reflections, in particular propagator matrices, transfer matrices and Marchenko focusing functions. A propagator matrix is a square matrix that `propagates' a wave-field vector from one depth level to another. It accounts for primaries and multiples and holds for propagating and evanescent waves. A Marchenko focusing function is a wave field that focuses at a designated point in space at zero time. Marchenko focusing functions are useful for retrieving the wave field inside a heterogeneous medium from the reflection response at its surface. By expressing these focusing functions in terms of the propagator matrix, the usual approximations (such as ignoring evanescent waves) are avoided. While a propagator matrix acts on the full wave-field vector, a transfer matrix (according to the definition employed in this paper)`transfers' a decomposed wave-field vector (containing downgoing and upgoing waves) from one depth level to another. It can be expressed in terms of decomposed Marchenko focusing functions. We present propagator matrices, transfer matrices and Marchenko focusing functions in a consistent way and discuss their mutual relations. In the main text we consider the acoustic situation and in the appendices we discuss other wave phenomena. Understanding these mutual connections may lead to new developments of Marchenko theory and its applications in wave field focusing, Green's function retrieval and imaging.


title: On the product of two $1$-$q$-summable series

abstract: In this paper we consider a $q$-analog of the Borel-Laplace summation process defined by Marotte and the second author, and consider two series solutions of linear $q$-difference equations with slopes $0$ and $1$. The latter are $q$-summable and we prove that the product of the series is $q$-(multi)summable and its $q$-sum is the product of the $q$-sum of the two series. This is a first step in showing the conjecture that the $q$-summation process is a morphism of rings. We prove that the $q$-summation does induce a morphism of fields by showing that if the inverse of the $q$-Euler series is $q$-summable, then its $q$-sum is not the inverse of the $q$-sum of the $q$-Euler series.


title: Flatness-based MPC using B-splines transcription with application to a Pusher-Slider System

abstract: This work discusses the use of model predictive control (MPC) for the manipulation of a pusher-slider system. In particular we leverage the differential flatness of the pusher-slider in combination with a B-splines transcription to address the computational demand that is typically associated to real-time implementation of an MPC controller. We demonstrate the flatness based B-spline MPC controller in simulation and compare it to a standard MPC implementation approach using direct multiple shooting. We evaluate the computational advantage of the flatness based MPC empirically and document computational acceleration up to 65%.


title: Out-of-Domain Robustness via Targeted Augmentations

abstract: Models trained on one set of domains often suffer performance drops on unseen domains, e.g., when wildlife monitoring models are deployed in new camera locations. In this work, we study principles for designing data augmentations for out-of-domain (OOD) generalization. In particular, we focus on real-world scenarios in which some domain-dependent features are robust, i.e., some features that vary across domains are predictive OOD. For example, in the wildlife monitoring application above, image backgrounds vary across camera locations but indicate habitat type, which helps predict the species of photographed animals. Motivated by theoretical analysis on a linear setting, we propose targeted augmentations, which selectively randomize spurious domain-dependent features while preserving robust ones. We prove that targeted augmentations improve OOD performance, allowing models to generalize better with fewer domains. In contrast, existing approaches such as generic augmentations, which fail to randomize domain-dependent features, and domain-invariant augmentations, which randomize all domain-dependent features, both perform poorly OOD. In experiments on three real-world datasets, we show that targeted augmentations set new states-of-the-art for OOD performance by 3.2-15.2 percentage points.


title: Bounds on Functionality and Symmetric Difference -- Two Intriguing Graph Parameters

abstract: [Alecu et al.: Graph functionality, JCTB2021] define functionality, a graph parameter that generalizes graph degeneracy. They research the relation of functionality to many other graph parameters (tree-width, clique-width, VC-dimension, etc.). Extending their research, we prove logarithmic lower bound for functionality of random graph $G(n,p)$ for large range of $p$. Previously known graphs have functionality logarithmic in number of vertices. We show that for every graph $G$ on $n$ vertices we have $\mathrm{fun}(G) \le O(\sqrt{ n \log n})$ and we give a nearly matching $\Omega(\sqrt{n})$-lower bound provided by projective planes. Further, we study a related graph parameter \emph{symmetric difference}, the minimum of $|N(u) \Delta N(v)|$ over all pairs of vertices of the ``worst possible'' induced subgraph. It was observed by Alecu et al. that $\mathrm{fun}(G) \le \mathrm{sd}(G)+1$ for every graph $G$. We compare $\mathrm{fun}$ and $\mathrm{sd}$ for the class $\mathrm{INT}$ of interval graphs and $\mathrm{CA}$ of circular-arc graphs. We let $\mathrm{INT}_n$ denote the $n$-vertex interval graphs, similarly for $\mathrm{CA}_n$. Alecu et al. ask, whether $\mathrm{fun}(\mathrm{INT})$ is bounded. Dallard et al. answer this positively in a recent preprint. On the other hand, we show that $\Omega(\sqrt[4]{n}) \leq \mathrm{sd}(\mathrm{INT}_n) \leq O(\sqrt[3]{n})$. For the related class $\mathrm{CA}$ we show that $\mathrm{sd}(\mathrm{CA}_n) = \Theta(\sqrt{n})$. We propose a follow-up question: is $\mathrm{fun}(\mathrm{CA})$ bounded?


title: JT Gravity on a Finite Lorentzian Strip: Time dependent Quantum Gravity Amplitudes

abstract: We formulate JT quantum gravity on a finite Lorentzian strip. Due to the spatial boundaries of the strip, it is possible to define left and right proper times. With respect to these times we compute non-perturbatively the quantum gravity (QG) time dependent transition amplitude. Lagrangian and Hamiltonian formulations are presented. Special attention is paid to the four corner terms (Hayward terms) in the action that are needed in order to have a well defined variational problem. From a detailed analysis of the gravity boundary condition on the spatial boundary, we find that while the lapse and the shift functions are independent Lagrange multipliers on the bulk, on the spatial boundary, these two are related. This fact leads to an algebraic equation of motion for a particular degree of freedom that is conveniently introduced on the spatial boundaries whose solution can be plugged back into the action allowing to fully determine the time dependent transition amplitude. The final result suggests that time evolution is non-unitary for most of the boundary conditions. Interestingly enough, unitary could be recovered when spatial $\text{AdS}_2$ boundary conditions are imposed. Other wave functions for other topologies obtained from the strip by gluing its spatial boundaries are also presented. Remarkably these do not exhibit any non-unitary evolution behavior.


title: Grounding Graph Network Simulators using Physical Sensor Observations

abstract: Physical simulations that accurately model reality are crucial for many engineering disciplines such as mechanical engineering and robotic motion planning. In recent years, learned Graph Network Simulators produced accurate mesh-based simulations while requiring only a fraction of the computational cost of traditional simulators. Yet, the resulting predictors are confined to learning from data generated by existing mesh-based simulators and thus cannot include real world sensory information such as point cloud data. As these predictors have to simulate complex physical systems from only an initial state, they exhibit a high error accumulation for long-term predictions. In this work, we integrate sensory information to ground Graph Network Simulators on real world observations. In particular, we predict the mesh state of deformable objects by utilizing point cloud data. The resulting model allows for accurate predictions over longer time horizons, even under uncertainties in the simulation, such as unknown material properties. Since point clouds are usually not available for every time step, especially in online settings, we employ an imputation-based model. The model can make use of such additional information only when provided, and resorts to a standard Graph Network Simulator, otherwise. We experimentally validate our approach on a suite of prediction tasks for mesh-based interactions between soft and rigid bodies. Our method results in utilization of additional point cloud information to accurately predict stable simulations where existing Graph Network Simulators fail.


title: FingerMapper: Mapping Finger Motions onto Virtual Arms to Enable Safe Virtual Reality Interaction in Confined Spaces

abstract: Whole-body movements enhance the presence and enjoyment of Virtual Reality (VR) experiences. However, using large gestures is often uncomfortable and impossible in confined spaces (e.g., public transport). We introduce FingerMapper, mapping small-scale finger motions onto virtual arms and hands to enable whole-body virtual movements in VR. In a first target selection study (n=13) comparing FingerMapper to hand tracking and ray-casting, we found that FingerMapper can significantly reduce physical motions and fatigue while having a similar degree of precision. In a consecutive study (n=13), we compared FingerMapper to hand tracking inside a confined space (the front passenger seat of a car). The results showed participants had significantly higher perceived safety and fewer collisions with FingerMapper while preserving a similar degree of presence and enjoyment as hand tracking. Finally, we present three example applications demonstrating how FingerMapper could be applied for locomotion and interaction for VR in confined spaces.


title: DCNetBench: Scaleable Data Center Network Benchmarking

abstract: Data center networking is the central infrastructure of the modern information society. However, benchmarking them is very challenging as the real-world network traffic is difficult to model, and Internet service giants treat the network traffic as confidential. Several industries have published a few publicly available network traces. However, these traces are collected from specific data center environments, e.g., applications, network topology, protocols, and hardware devices, and thus cannot be scaled to different users, underlying technologies, and varying benchmarking requirements. This article argues we should scale different data center applications and environments in designing, implementing, and evaluating data center networking benchmarking. We build DCNetBench, the first application-driven data center network benchmarking that can scale to different users, underlying technologies, and varying benchmarking requirements. The methodology is as follows. We built an emulated system that can simulate networking with different configurations. Then we run applications on the emulated systems to capture the realistic network traffic patterns; we analyze and classify these patterns to model and replay those traces. Finally, we provide an automatic benchmarking framework to support this pipeline. The evaluations on DCNetBench show its scaleability, effectiveness, and diversity for data center network benchmarking.


title: Transformers in Single Object Tracking: An Experimental Survey

abstract: Single-object tracking is a well-known and challenging research topic in computer vision. Over the last two decades, numerous researchers have proposed various algorithms to solve this problem and achieved promising results. Recently, Transformer-based tracking approaches have ushered in a new era in single-object tracking by introducing new perspectives and achieving superior tracking robustness. In this paper, we conduct an in-depth literature analysis of Transformer tracking approaches by categorizing them into CNN-Transformer based trackers, Two-stream Two-stage fully-Transformer based trackers, and One-stream One-stage fully-Transformer based trackers. In addition, we conduct experimental evaluations to assess their tracking robustness and computational efficiency using publicly available benchmark datasets. Furthermore, we measure their performances on different tracking scenarios to identify their strengths and weaknesses in particular situations. Our survey provides insights into the underlying principles of Transformer tracking approaches, the challenges they encounter, and the future directions they may take.


title: A2S-NAS: Asymmetric Spectral-Spatial Neural Architecture Search For Hyperspectral Image Classification

abstract: Existing deep learning-based hyperspectral image (HSI) classification works still suffer from the limitation of the fixed-sized receptive field, leading to difficulties in distinctive spectral-spatial features for ground objects with various sizes and arbitrary shapes. Meanwhile, plenty of previous works ignore asymmetric spectral-spatial dimensions in HSI. To address the above issues, we propose a multi-stage search architecture in order to overcome asymmetric spectral-spatial dimensions and capture significant features. First, the asymmetric pooling on the spectral-spatial dimension maximally retains the essential features of HSI. Then, the 3D convolution with a selectable range of receptive fields overcomes the constraints of fixed-sized convolution kernels. Finally, we extend these two searchable operations to different layers of each stage to build the final architecture. Extensive experiments are conducted on two challenging HSI benchmarks including Indian Pines and Houston University, and results demonstrate the effectiveness of the proposed method with superior performance compared with the related works.


title: The Adams differentials on the classes $h_j^3$

abstract: In filtration 1 of the Adams spectral sequence, using secondary cohomology operations, Adams computed the differentials on the classes $h_j$, resolving the Hopf invariant one problem. In Adams filtration 2, using equivariant and chromatic homotopy theory, Hill--Hopkins--Ravenel proved that the classes $h_j^2$ support non-trivial differentials for $j \geq 7$, resolving the celebrated Kervaire invariant one problem. The precise differentials on the classes $h_j^2$ for $j \geq 7$ and the fate of $h_6^2$ remains unknown. In this paper, in Adams filtration 3, we prove an infinite family of non-trivial $d_4$-differentials on the classes $h_j^3$ for $j \geq 6$, confirming a conjecture of Mahowald. Our proof uses two different deformations of stable homotopy theory -- $\mathbb{C}$-motivic stable homotopy theory and $\mathbb{F}_2$-synthetic homotopy theory -- both in an essential way. Along the way, we also show that $h_j^2$ survives to the Adams $E_5$-page and that $h_6^2$ survives to the Adams $E_9$-page.


title: Adaptive Sampling for Probabilistic Forecasting under Distribution Shift

abstract: The world is not static: This causes real-world time series to change over time through external, and potentially disruptive, events such as macroeconomic cycles or the COVID-19 pandemic. We present an adaptive sampling strategy that selects the part of the time series history that is relevant for forecasting. We achieve this by learning a discrete distribution over relevant time steps by Bayesian optimization. We instantiate this idea with a two-step method that is pre-trained with uniform sampling and then training a lightweight adaptive architecture with adaptive sampling. We show with synthetic and real-world experiments that this method adapts to distribution shift and significantly reduces the forecasting error of the base model for three out of five datasets.


title: Deep learning reveals the common spectrum underlying multiple brain disorders in youth and elders from brain functional networks

abstract: Brain disorders in the early and late life of humans potentially share pathological alterations in brain functions. However, the key evidence from neuroimaging data for pathological commonness remains unrevealed. To explore this hypothesis, we build a deep learning model, using multi-site functional magnetic resonance imaging data (N=4,410, 6 sites), for classifying 5 different brain disorders from healthy controls, with a set of common features. Our model achieves 62.6(1.9)% overall classification accuracy on data from the 6 investigated sites and detects a set of commonly affected functional subnetworks at different spatial scales, including default mode, executive control, visual, and limbic networks. In the deep-layer feature representation for individual data, we observe young and aging patients with disorders are continuously distributed, which is in line with the clinical concept of the "spectrum of disorders". The revealed spectrum underlying early- and late-life brain disorders promotes the understanding of disorder comorbidities in the lifespan.


title: Direct Measurement of the Structural Change Associated with Amorphous Solidification using Static Scattering of Coherent Radiation

abstract: In this paper we demonstrate that the weak temperature dependence of structure factor of supercooled liquids, a defining feature of the glass transition, is a consequence of the averaging of the scattering intensity either due to the use of an incoherent radiation source or explicit angular averaging. We show that the speckle scattering at individual wavevectors, calculated from a simulated glass former, exhibits a Debye-Waller factor with a sufficiently large temperature dependence to represent a structural order parameter capable of distinguishing liquid from glass. We also extract from the speckle intensities a quantity proportional to the variance of the local restraint, i.e. a direct experimental measure of the amplitude of structural heterogeneity.


title: Capturing and Interpreting Unique Information

abstract: Partial information decompositions (PIDs), which quantify information interactions between three or more variables in terms of uniqueness, redundancy and synergy, are gaining traction in many application domains. However, our understanding of the operational interpretations of PIDs is still incomplete for many popular PID definitions. In this paper, we discuss the operational interpretations of unique information through the lens of two well-known PID definitions. We reexamine an interpretation from statistical decision theory showing how unique information upper bounds the risk in a decision problem. We then explore a new connection between the two PIDs, which allows us to develop an informal but appealing interpretation, and generalize the PID definitions using a common Lagrangian formulation. Finally, we provide a new PID definition that is able to capture the information that is unique. We also show that it has a straightforward interpretation and examine its properties.


title: What Can We Learn From The Selective Prediction And Uncertainty Estimation Performance Of 523 Imagenet Classifiers

abstract: When deployed for risk-sensitive tasks, deep neural networks must include an uncertainty estimation mechanism. Here we examine the relationship between deep architectures and their respective training regimes, with their corresponding selective prediction and uncertainty estimation performance. We consider some of the most popular estimation performance metrics previously proposed including AUROC, ECE, AURC as well as coverage for selective accuracy constraint. We present a novel and comprehensive study of selective prediction and the uncertainty estimation performance of 523 existing pretrained deep ImageNet classifiers that are available in popular repositories. We identify numerous and previously unknown factors that affect uncertainty estimation and examine the relationships between the different metrics. We find that distillation-based training regimes consistently yield better uncertainty estimations than other training schemes such as vanilla training, pretraining on a larger dataset and adversarial training. Moreover, we find a subset of ViT models that outperform any other models in terms of uncertainty estimation performance. For example, we discovered an unprecedented 99% top-1 selective accuracy on ImageNet at 47% coverage (and 95% top-1 accuracy at 80%) for a ViT model, whereas a competing EfficientNet-V2-XL cannot obtain these accuracy constraints at any level of coverage. Our companion paper, also published in ICLR 2023 (A framework for benchmarking class-out-of-distribution detection and its application to ImageNet), examines the performance of these classifiers in a class-out-of-distribution setting.


title: Improved Training of Mixture-of-Experts Language GANs

abstract: Despite the dramatic success in image generation, Generative Adversarial Networks (GANs) still face great challenges in synthesizing sequences of discrete elements, in particular human language. The difficulty in generator training arises from the limited representation capacity and uninformative learning signals obtained from the discriminator. In this work, we (1) first empirically show that the mixture-of-experts approach is able to enhance the representation capacity of the generator for language GANs and (2) harness the Feature Statistics Alignment (FSA) paradigm to render fine-grained learning signals to advance the generator training. Specifically, FSA forces the mean statistics of the distribution of fake data to approach that of real samples as close as possible in the finite-dimensional feature space. Empirical study on synthetic and real benchmarks shows the superior performance in quantitative evaluation and demonstrates the effectiveness of our approach to adversarial text generation.


title: Event reconstruction using pattern spectra and convolutional neural networks for the Cherenkov Telescope Array

abstract: The Cherenkov Telescope Array (CTA) is the future observatory for ground-based imaging atmospheric Cherenkov telescopes. Each telescope will provide a snapshot of gamma-ray induced particle showers by capturing the induced Cherenkov emission at ground level. The simulation of such events provides camera images that can be used as training data for convolutional neural networks (CNNs) to differentiate signals from background events and to determine the energy of the initial gamma-ray events. Pattern spectra are commonly used tools for image classification and provide the distributions of the sizes and shapes of features comprising an image. The application of pattern spectra on a CNN allows the selection of relevant combinations of features within an image. In this work, we generate pattern spectra from simulated gamma-ray images to train a CNN for signal-background separation and energy reconstruction for CTA. We compare our results to a CNN trained with CTA images and find that the pattern spectra-based analysis is computationally less expensive but not competitive with the purely CTA images-based analysis. Thus, we conclude that the CNN must rely on additional features in the CTA images not captured by the pattern spectra.


title: Some sharp inequalities of Mizohata--Takeuchi-type

abstract: Let $\Sigma$ be a strictly convex, compact patch of a $C^2$ hypersurface in $\mathbb{R}^n$, with non-vanishing Gaussian curvature and surface measure $d\sigma$ induced by the Lebesgue measure in $\mathbb{R}^n$. The Mizohata--Takeuchi conjecture states that \begin{equation*} \int |\widehat{gd\sigma}|^2w \leq C \|Xw\|_\infty \int |g|^2 \end{equation*} for all $g\in L^2(\Sigma)$ and all weights $w:\mathbb{R}^n\rightarrow [0,+\infty)$, where $X$ denotes the $X$-ray transform. As partial progress towards the conjecture, we show, as a straightforward consequence of recently-established decoupling inequalities, that for every $\epsilon>0$, there exists a positive constant $C_\epsilon$, which depends only on $\Sigma$ and $\epsilon$, such that for all $R \geq 1$ and all weights $w:\mathbb{R}^n\rightarrow [0,+\infty)$ we have \begin{equation*} \int_{B_R} |\widehat{gd\sigma}|^2w \leq C_\epsilon R^\epsilon \sup_T \left(\int _T w^{\frac{n+1}{2}}\right)^{\frac{2}{n+1}}\int |g|^2, \end{equation*} where $T$ ranges over the family of all tubes in $\mathbb{R}^n$ of dimensions $R^{1/2} \times \dots \times R^{1/2} \times R$. From this we deduce the Mizohata--Takeuchi conjecture with an $R^{\frac{n-1}{n+1}}$-loss; i.e., that \begin{equation*} \int_{B_R} |\widehat{gd\sigma}|^2w \leq C_\epsilon R^{\frac{n-1}{n+1}+ \epsilon}\|Xw\|_\infty\int |g|^2 \end{equation*} for any ball $B_R$ of radius $R$ and any $\epsilon>0$. The power $(n-1)/(n+1)$ here cannot be replaced by anything smaller unless properties of $\widehat{gd\sigma}$ beyond 'decoupling axioms' are exploited. We also provide estimates which improve this inequality under various conditions on the weight, and discuss some new cases where the conjecture holds.


title: Mitigating Unnecessary Handovers in Ultra-Dense Networks through Machine Learning-based Mobility Prediction

abstract: In 5G wireless communication, Intelligent Transportation Systems (ITS) and automobile applications, such as autonomous driving, are widely examined. These applications have strict requirements and often require high Quality of Service (QoS). In an urban setting, Ultra-Dense Networks (UDNs) have the potential to not only provide optimal QoS but also increase system capacity and frequency reuse. However, the current architecture of 5G UDN of dense Small Cell Nodes (SCNs) deployment prompts increased delay, handover times, and handover failures. In this paper, we propose a Machine Learning (ML) supported Mobility Prediction (MP) strategy to predict future Vehicle User Equipment (VUE) mobility and handover locations. The primary aim of the proposed methodology is to minimize Unnecessary Handover (UHO) while ensuring VUEs take full advantage of the deployed UDN. We evaluate and validate our approach on a downlink system-level simulator. We predict mobility using Support Vector Machine (SVM), Decision Tree Classifier (DTC), and Random Forest Classifier (RFC). The simulation results show an average reduction of 30% in handover times by utilizing ML-based MP, with RFC showing the most reduction up to 70% in some cases.