title: Towards carbon neutral scientific societies: A case study with the International Adsorption Society

abstract: With increasing concerns over climate change, scientists must imperatively acknowledge their share in CO2 emissions. Considering the large emissions associated with scientific traveling - especially international conferences - initiatives to mitigate such impact are blooming. With the COVID-19 pandemic shattering our notion of private/professional interactions, the moment should be seized to reinvent science conferences and collaborations with a model respectful of the environment. Yet, despite efforts to reduce the footprint of conferences, there is a lack of a robust approach based on reliable numbers (emissions, carbon offsetting/removals, etc.) to accompany this shift of paradigm. Here, considering a representative scientific society, the International Adsorption Society, we report on a case study of the problem: making conferences carbon neutral while respecting the needs of scientists. We first provide a quantitative analysis of the CO2 emissions for the IAS conference in 2022 related to accommodation, catering, flights, etc. Second, we conduct two surveys probing our community view on the carbon footprint of our activities. These surveys mirror each other, and were distributed two years before and in the aftermath of our triennial conference (also corresponding to pre/post COVID times). By combining the different parts, we propose ambitious recommendations to shape the future of conferences.


title: Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?

abstract: The success of deep learning heavily relies on large-scale data with comprehensive labels, which is more expensive and time-consuming to fetch in 3D compared to 2D images or natural languages. This promotes the potential of utilizing models pretrained with data more than 3D as teachers for cross-modal knowledge transferring. In this paper, we revisit masked modeling in a unified fashion of knowledge distillation, and we show that foundational Transformers pretrained with 2D images or natural languages can help self-supervised 3D representation learning through training Autoencoders as Cross-Modal Teachers (ACT). The pretrained Transformers are transferred as cross-modal 3D teachers using discrete variational autoencoding self-supervision, during which the Transformers are frozen with prompt tuning for better knowledge inheritance. The latent features encoded by the 3D teachers are used as the target of masked point modeling, wherein the dark knowledge is distilled to the 3D Transformer students as foundational geometry understanding. Our ACT pretrained 3D learner achieves state-of-the-art generalization capacity across various downstream benchmarks, e.g., 88.21% overall accuracy on ScanObjectNN. Codes have been released at https://github.com/RunpeiDong/ACT.


title: Investigation of Japanese PnG BERT language model in text-to-speech synthesis for pitch accent language

abstract: End-to-end text-to-speech synthesis (TTS) can generate highly natural synthetic speech from raw text. However, rendering the correct pitch accents is still a challenging problem for end-to-end TTS. To tackle the challenge of rendering correct pitch accent in Japanese end-to-end TTS, we adopt PnG~BERT, a self-supervised pretrained model in the character and phoneme domain for TTS. We investigate the effects of features captured by PnG~BERT on Japanese TTS by modifying the fine-tuning condition to determine the conditions helpful inferring pitch accents. We manipulate content of PnG~BERT features from being text-oriented to speech-oriented by changing the number of fine-tuned layers during TTS. In addition, we teach PnG~BERT pitch accent information by fine-tuning with tone prediction as an additional downstream task. Our experimental results show that the features of PnG~BERT captured by pretraining contain information helpful inferring pitch accent, and PnG~BERT outperforms baseline Tacotron on accent correctness in a listening test.


title: ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks

abstract: Causal chain reasoning (CCR) is an essential ability for many decision-making AI systems, which requires the model to build reliable causal chains by connecting causal pairs. However, CCR suffers from two main transitive problems: threshold effect and scene drift. In other words, the causal pairs to be spliced may have a conflicting threshold boundary or scenario. To address these issues, we propose a novel Reliable Causal chain reasoning framework~(ReCo), which introduces exogenous variables to represent the threshold and scene factors of each causal pair within the causal chain, and estimates the threshold and scene contradictions across exogenous variables via structural causal recurrent neural networks~(SRNN). Experiments show that ReCo outperforms a series of strong baselines on both Chinese and English CCR datasets. Moreover, by injecting reliable causal chain knowledge distilled by ReCo, BERT can achieve better performances on four downstream causal-related tasks than BERT models enhanced by other kinds of knowledge.


title: An ensemble neural network approach to forecast Dengue outbreak based on climatic condition

abstract: Dengue fever is a virulent disease spreading over 100 tropical and subtropical countries in Africa, the Americas, and Asia. This arboviral disease affects around 400 million people globally, severely distressing the healthcare systems. The unavailability of a specific drug and ready-to-use vaccine makes the situation worse. Hence, policymakers must rely on early warning systems to control intervention-related decisions. Forecasts routinely provide critical information for dangerous epidemic events. However, the available forecasting models (e.g., weather-driven mechanistic, statistical time series, and machine learning models) lack a clear understanding of different components to improve prediction accuracy and often provide unstable and unreliable forecasts. This study proposes an ensemble wavelet neural network with exogenous factor(s) (XEWNet) model that can produce reliable estimates for dengue outbreak prediction for three geographical regions, namely San Juan, Iquitos, and Ahmedabad. The proposed XEWNet model is flexible and can easily incorporate exogenous climate variable(s) confirmed by statistical causality tests in its scalable framework. The proposed model is an integrated approach that uses wavelet transformation into an ensemble neural network framework that helps in generating more reliable long-term forecasts. The proposed XEWNet allows complex non-linear relationships between the dengue incidence cases and rainfall; however, mathematically interpretable, fast in execution, and easily comprehensible. The proposal's competitiveness is measured using computational experiments based on various statistical metrics and several statistical comparison tests. In comparison with statistical, machine learning, and deep learning methods, our proposed XEWNet performs better in 75% of the cases for short-term and long-term forecasting of dengue incidence.


title: Mobile Augmented Reality with Federated Learning in the Metaverse

abstract: The Metaverse is deemed the next evolution of the Internet and has received much attention recently. Metaverse applications via mobile augmented reality (MAR) require rapid and accurate object detection to mix digital data with the real world. As mobile devices evolve, their computational capabilities are increasing, and thus their computational resources can be leveraged to train machine learning models. In light of the increasing concerns of user privacy and data security, federated learning (FL) has become a promising distributed learning framework for privacy-preserving analytics. In this article, FL and MAR are brought together in the Metaverse. We discuss the necessity and rationality of the combination of FL and MAR. The prospective technologies that support FL and MAR in the Metaverse are also discussed. In addition, existing challenges that prevent the fulfillment of FL and MAR in the Metaverse and several application scenarios are presented. Finally, three case studies of Metaverse FL-MAR systems are demonstrated.


title: Revised the $\gamma$-ray emission from SNR CTB 109 with Fermi-LAT

abstract: CTB 109 is a middle-aged shell-type SNR with bright thermal X-ray emission. We reanalyze the GeV $\gamma$-ray emission from CTB 109 using thirteen years of Pass 8 data recorded by the Fermi Large Area Telescope (Fermi-LAT). The $\gamma$-ray emission of CTB 109 shows a center bright morphology, which is well consistent with its thermal X-ray emission rather than the shell-type structure in the radio band. The spectral analysis shows an evident spectral curvature at $\sim$ several GeV for the GeV $\gamma$-ray spectrum, which can naturally explain the lack of TeV $\gamma$-ray emission from CTB 109. Although either a leptonic or a hadronic model could fit the multi-wavelength observations of CTB 109, the hadronic model is favored considering its $\gamma$-ray morphology and the spectral curvature of GeV spectrum. The unusual $\gamma$-ray spectrum of CTB 109 with other SNRs and the luminosity-diameter squared relation make CTB 109 to be distinguished both from the young-aged SNRs with hard GeV $\gamma$-ray spectra and several old-aged SNRs interacting with molecular clouds.


title: Electronic Density Response of Warm Dense Matter

abstract: Matter at extreme temperatures and pressures -- commonly known as warm dense matter (WDM) in the literature -- is ubiquitous throughout our Universe and occurs in a number of astrophysical objects such as giant planet interiors and brown dwarfs. Moreover, WDM is very important for technological applications such as inertial confinement fusion, and is realized in the laboratory using different techniques. A particularly important property for the understanding of WDM is given by its electronic density response to an external perturbation. Such response properties are routinely probed in x-ray Thomson scattering (XRTS) experiments, and, in addition, are central for the theoretical description of WDM. In this work, we give an overview of a number of recent developments in this field. To this end, we summarize the relevant theoretical background, covering the regime of linear-response theory as well as nonlinear effects, the fully dynamic response and its static, time-independent limit, and the connection between density response properties and imaginary-time correlation functions (ITCF). In addition, we introduce the most important numerical simulation techniques including ab initio path integral Monte Carlo (PIMC) simulations and different thermal density functional theory (DFT) approaches. From a practical perspective, we present a variety of simulation results for different density response properties, covering the archetypal model of the uniform electron gas and realistic WDM systems such as hydrogen. Moreover, we show how the concept of ITCFs can be used to infer the temperature from XRTS measurements of arbitrarily complex systems without the need for any models or approximations. Finally, we outline a strategy for future developments based on the close interplay between simulations and experiments.


title: WavEnhancer: Unifying Wavelet and Transformer for Image Enhancement

abstract: Image enhancement is a technique that frequently utilized in digital image processing. In recent years, the popularity of learning-based techniques for enhancing the aesthetic performance of photographs has increased. However, the majority of current works do not optimize an image from different frequency domains and typically focus on either pixel-level or global-level enhancements. In this paper, we propose a transformer-based model in the wavelet domain to refine different frequency bands of an image. Our method focuses both on local details and high-level features for enhancement, which can generate superior results. On the basis of comprehensive benchmark evaluations, our method outperforms the state-of-the-art methods.


title: MEIL-NeRF: Memory-Efficient Incremental Learning of Neural Radiance Fields

abstract: Hinged on the representation power of neural networks, neural radiance fields (NeRF) have recently emerged as one of the promising and widely applicable methods for 3D object and scene representation. However, NeRF faces challenges in practical applications, such as large-scale scenes and edge devices with a limited amount of memory, where data needs to be processed sequentially. Under such incremental learning scenarios, neural networks are known to suffer catastrophic forgetting: easily forgetting previously seen data after training with new data. We observe that previous incremental learning algorithms are limited by either low performance or memory scalability issues. As such, we develop a Memory-Efficient Incremental Learning algorithm for NeRF (MEIL-NeRF). MEIL-NeRF takes inspiration from NeRF itself in that a neural network can serve as a memory that provides the pixel RGB values, given rays as queries. Upon the motivation, our framework learns which rays to query NeRF to extract previous pixel values. The extracted pixel values are then used to train NeRF in a self-distillation manner to prevent catastrophic forgetting. As a result, MEIL-NeRF demonstrates constant memory consumption and competitive performance.


title: Text-to-speech synthesis based on latent variable conversion using diffusion probabilistic model and variational autoencoder

abstract: Text-to-speech synthesis (TTS) is a task to convert texts into speech. Two of the factors that have been driving TTS are the advancements of probabilistic models and latent representation learning. We propose a TTS method based on latent variable conversion using a diffusion probabilistic model and the variational autoencoder (VAE). In our TTS method, we use a waveform model based on VAE, a diffusion model that predicts the distribution of latent variables in the waveform model from texts, and an alignment model that learns alignments between the text and speech latent sequences. Our method integrates diffusion with VAE by modeling both mean and variance parameters with diffusion, where the target distribution is determined by approximation from VAE. This latent variable conversion framework potentially enables us to flexibly incorporate various latent feature extractors. Our experiments show that our method is robust to linguistic labels with poor orthography and alignment errors.


title: Convolution-enhanced Evolving Attention Networks

abstract: Attention-based neural networks, such as Transformers, have become ubiquitous in numerous applications, including computer vision, natural language processing, and time-series analysis. In all kinds of attention networks, the attention maps are crucial as they encode semantic dependencies between input tokens. However, most existing attention networks perform modeling or reasoning based on representations , wherein the attention maps of different layers are learned separately without explicit interactions. In this paper, we propose a novel and generic evolving attention mechanism, which directly models the evolution of inter-token relationships through a chain of residual convolutional modules. The major motivations are twofold. On the one hand, the attention maps in different layers share transferable knowledge, thus adding a residual connection can facilitate the information flow of inter-token relationships across layers. On the other hand, there is naturally an evolutionary trend among attention maps at different abstraction levels, so it is beneficial to exploit a dedicated convolution-based module to capture this process. Equipped with the proposed mechanism, the convolution-enhanced evolving attention networks achieve superior performance in various applications, including time-series representation, natural language understanding, machine translation, and image classification. Especially on time-series representation tasks, Evolving Attention-enhanced Dilated Convolutional (EA-DC-) Transformer outperforms state-of-the-art models significantly, achieving an average of 17% improvement compared to the best SOTA. To the best of our knowledge, this is the first work that explicitly models the layer-wise evolution of attention maps. Our implementation is available at https://github.com/pkuyym/EvolvingAttention.


title: Estimating POT Second-order Parameter for Bias Correction

abstract: The stable tail dependence function provides a full characterization of the extremal dependence structures. Unfortunately, the estimation of the stable tail dependence function often suffers from significant bias, whose scale relates to the Peaks-Over-Threshold (POT) second-order parameter. For this second-order parameter, this paper introduces a penalized estimator that discourages it from being too close to zero. This paper then establishes this estimator's asymptotic consistency, uses it to correct the bias in the estimation of the stable tail dependence function, and illustrates its desirable empirical properties in the estimation of the extremal dependence structures.


title: Data driven solutions and parameter discovery of the nonlocal mKdV equation via deep learning method

abstract: In this paper, we systematically study the integrability and data-driven solutions of the nonlocal mKdV equation. The infinite conservation laws of the nonlocal mKdV equation and the corresponding infinite conservation quantities are given through Riccti equation. The data driven solutions of the zero boundary for the nonlocal mKdV equation are studied by using the multi-layer physical information neural network algorithm, which including kink soliton, complex soliton, bright-bright soliton and the interaction between soliton and kink-type. For the data-driven solutions with non-zero boundary, we study kink, dark, anti-dark and rational solution. By means of image simulation, the relevant dynamic behavior and error analysis of these solutions are given. In addition, we discuss the inverse problem of the integrable nonlocal mKdV equation by applying the physics-informed neural network algorithm to discover the parameters of the nonlinear terms of the equation.


title: AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domains

abstract: As the basis for prehensile manipulation, it is vital to enable robots to grasp as robustly as humans. Our innate grasping system is prompt, accurate, flexible, and continuous across spatial and temporal domains. Few existing methods cover all these properties for robot grasping. In this paper, we propose AnyGrasp for grasp perception to enable robots these abilities using a parallel gripper. Specifically, we develop a dense supervision strategy with real perception and analytic labels in the spatial-temporal domain. Additional awareness of objects' center-of-mass is incorporated into the learning process to help improve grasping stability. Utilization of grasp correspondence across observations enables dynamic grasp tracking. Our model can efficiently generate accurate, 7-DoF, dense, and temporally-smooth grasp poses and works robustly against large depth-sensing noise. Using AnyGrasp, we achieve a 93.3% success rate when clearing bins with over 300 unseen objects, which is on par with human subjects under controlled conditions. Over 900 mean-picks-per-hour is reported on a single-arm system. For dynamic grasping, we demonstrate catching swimming robot fish in the water. Our project page is at https://graspnet.net/anygrasp.html


title: Lightweight integration of 3D features to improve 2D image segmentation

abstract: Scene understanding has made tremendous progress over the past few years, as data acquisition systems are now providing an increasing amount of data of various modalities (point cloud, depth, RGB...). However, this improvement comes at a large cost on computation resources and data annotation requirements. To analyze geometric information and images jointly, many approaches rely on both a 2D loss and 3D loss, requiring not only 2D per pixel-labels but also 3D per-point labels. However, obtaining a 3D groundtruth is challenging, time-consuming and error-prone. In this paper, we show that image segmentation can benefit from 3D geometric information without requiring a 3D groundtruth, by training the geometric feature extraction and the 2D segmentation network jointly, in an end-to-end fashion, using only the 2D segmentation loss. Our method starts by extracting a map of 3D features directly from a provided point cloud by using a lightweight 3D neural network. The 3D feature map, merged with the RGB image, is then used as an input to a classical image segmentation network. Our method can be applied to many 2D segmentation networks, improving significantly their performance with only a marginal network weight increase and light input dataset requirements, since no 3D groundtruth is required.


title: Law to Binary Tree -- An Formal Interpretation of Legal Natural Language

abstract: Knowledge representation and reasoning in law are essential to facilitate the automation of legal analysis and decision-making tasks. In this paper, we propose a new approach based on legal science, specifically legal taxonomy, for representing and reasoning with legal documents. Our approach interprets the regulations in legal documents as binary trees, which facilitates legal reasoning systems to make decisions and resolve logical contradictions. The advantages of this approach are twofold. First, legal reasoning can be performed on the basis of the binary tree representation of the regulations. Second, the binary tree representation of the regulations is more understandable than the existing sentence-based representations. We provide an example of how our approach can be used to interpret the regulations in a legal document.


title: Multiple actions of time-resolved short-pulsed metamaterials

abstract: Recently, it has been shown that temporal metamaterials based on impulsive modulations of the constitutive parameters (of duration much smaller than a characteristic electromagnetic timescale) may exhibit a nonlocal response that can be harnessed so as to perform elementary analog computing on an impinging wavepacket. These short-pulsed metamaterials can be viewed as the temporal analog of conventional (spatial) metasurfaces. Here, inspired by the analogy with cascaded metasurfaces, we leverage this concept and take it one step further, by showing that short-pulsed metamaterials can be utilized as elementary bricks for more complex computations. To this aim, we develop a simple, approximate approach to systematically model the multiple actions of time-resolved short-pulsed metamaterials. Via a number of representative examples, we illustrate the computational capabilities enabled by this approach, in terms of simple and composed operations, and validate it against a rigorous numerical solution. Our results indicate that the temporal dimension may provide new degrees of freedom and design approaches in the emerging field of computational metamaterials, in addition or as an alternative to conventional spatially variant platforms.


title: The long-time asymptotic of the derivative nonlinear Schr$\ddot{o}$dinger equation with step-like initial value

abstract: Consideration in this present paper is the long-time asymptotic of solutions to the derivative nonlinear Schr$\ddot{o}$dinger equation with the step-like initial value \begin{eqnarray} q(x,0)=q_{0}(x)=\begin{cases} \begin{split} A_{1}e^{i\phi}e^{2iBx}, \quad\quad x<0,\\ A_{2}e^{-2iBx}, \quad\quad~~ x>0. \end{split}\nonumber \end{cases} \end{eqnarray} by Deift-Zhou method. The step-like initial problem described by a matrix Riemann-Hilbert problem. A crucial ingredient used in this paper is to introduce $g$-function mechanism for solving the problem of the entries of the jump matrix growing exponentially as $t\rightarrow\infty$. It is shown that the leading order term of the asymptotic solution of the DNLS equation expressed by the Theta function $\Theta$ about the Riemann-surface of genus 3 and the subleading order term expressed by parabolic cylinder and Airy functions.


title: Strong decays of singly heavy baryons from a chiral effective theory of diquarks

abstract: A chiral effective theory of scalar and vector diquarks is formulated, which is based on $SU(3)_R\times SU(3)_L$ chiral symmetry and includes interactions between scalar and vector diquarks with one or two mesons. We find that the diquark interaction term with two mesons breaks the $U(1)_A$ and flavor $SU(3)$ symmetries. To determine the coupling constants of the interaction Lagrangians, we investigate one-pion emission decays of singly heavy baryons $Qqq$ ($Q=c, b$ and $q=u,d,s$), where baryons are regarded as diquark--heavy-quark two-body systems. Using this model, we present predictions of the unobserved decay widths of singly heavy baryons. We also study the change of masses and strong decay widths of singly heavy baryons under partial restoration of chiral symmetry.


title: Generalization Bounds for Inductive Matrix Completion in Low-noise Settings

abstract: We study inductive matrix completion (matrix completion with side information) under an i.i.d. subgaussian noise assumption at a low noise regime, with uniform sampling of the entries. We obtain for the first time generalization bounds with the following three properties: (1) they scale like the standard deviation of the noise and in particular approach zero in the exact recovery case; (2) even in the presence of noise, they converge to zero when the sample size approaches infinity; and (3) for a fixed dimension of the side information, they only have a logarithmic dependence on the size of the matrix. Differently from many works in approximate recovery, we present results both for bounded Lipschitz losses and for the absolute loss, with the latter relying on Talagrand-type inequalities. The proofs create a bridge between two approaches to the theoretical analysis of matrix completion, since they consist in a combination of techniques from both the exact recovery literature and the approximate recovery literature.


title: Neural Enhanced Belief Propagation for Multiobject Tracking

abstract: Algorithmic solutions for multi-object tracking (MOT) are a key enabler for applications in autonomous navigation and applied ocean sciences. State-of-the-art MOT methods fully rely on a statistical model and typically use preprocessed sensor data as measurements. In particular, measurements are produced by a detector that extracts potential object locations from the raw sensor data collected for a discrete time step. This preparatory processing step reduces data flow and computational complexity but may result in a loss of information. State-of-the-art Bayesian MOT methods that are based on belief propagation (BP) systematically exploit graph structures of the statistical model to reduce computational complexity and improve scalability. However, as a fully model-based approach, BP can only provide suboptimal estimates when there is a mismatch between the statistical model and the true data-generating process. Existing BP-based MOT methods can further only make use of preprocessed measurements. In this paper, we introduce a variant of BP that combines model-based with data-driven MOT. The proposed neural enhanced belief propagation (NEBP) method complements the statistical model of BP by information learned from raw sensor data. This approach conjectures that the learned information can reduce model mismatch and thus improve data association and false alarm rejection. Our NEBP method improves tracking performance compared to model-based methods. At the same time, it inherits the advantages of BP-based MOT, i.e., it scales only quadratically in the number of objects, and it can thus generate and maintain a large number of object tracks. We evaluate the performance of our NEBP approach for MOT on the nuScenes autonomous driving dataset and demonstrate that it has state-of-the-art performance.


title: Adversarial Example Defense via Perturbation Grading Strategy

abstract: Deep Neural Networks have been widely used in many fields. However, studies have shown that DNNs are easily attacked by adversarial examples, which have tiny perturbations and greatly mislead the correct judgment of DNNs. Furthermore, even if malicious attackers cannot obtain all the underlying model parameters, they can use adversarial examples to attack various DNN-based task systems. Researchers have proposed various defense methods to protect DNNs, such as reducing the aggressiveness of adversarial examples by preprocessing or improving the robustness of the model by adding modules. However, some defense methods are only effective for small-scale examples or small perturbations but have limited defense effects for adversarial examples with large perturbations. This paper assigns different defense strategies to adversarial perturbations of different strengths by grading the perturbations on the input examples. Experimental results show that the proposed method effectively improves defense performance. In addition, the proposed method does not modify any task model, which can be used as a preprocessing module, which significantly reduces the deployment cost in practical applications.


title: Unbounded Banach-Saks operators and unbounded Grothendieck operators on Banach lattices

abstract: Suppose $E$ is a Banach lattice. Recently, there have been some motivating contexts regarding the known Banach-Saks property and the Grothendieck property from an order point of view. In this paper, we establish these results for operators that enjoy different types considered for the Banach-Saks property as well as for different notions related to the Grothendieck property. In particular, beside other results, we characterize order continuity and reflexivity of Banach lattices in terms of the corresponding bounded operators defined on them.


title: SplitGP: Achieving Both Generalization and Personalization in Federated Learning

abstract: A fundamental challenge to providing edge-AI services is the need for a machine learning (ML) model that achieves personalization (i.e., to individual clients) and generalization (i.e., to unseen data) properties concurrently. Existing techniques in federated learning (FL) have encountered a steep tradeoff between these objectives and impose large computational requirements on edge devices during training and inference. In this paper, we propose SplitGP, a new split learning solution that can simultaneously capture generalization and personalization capabilities for efficient inference across resource-constrained clients (e.g., mobile/IoT devices). Our key idea is to split the full ML model into client-side and server-side components, and impose different roles to them: the client-side model is trained to have strong personalization capability optimized to each client's main task, while the server-side model is trained to have strong generalization capability for handling all clients' out-of-distribution tasks. We analytically characterize the convergence behavior of SplitGP, revealing that all client models approach stationary points asymptotically. Further, we analyze the inference time in SplitGP and provide bounds for determining model split ratios. Experimental results show that SplitGP outperforms existing baselines by wide margins in inference time and test accuracy for varying amounts of out-of-distribution samples.


title: Roundoff error problem in L2-type methods for time-fractional problems

abstract: Roundoff error problems have occurred frequently in interpolation methods of time-fractional equations, which can lead to undesirable results such as the failure of optimal convergence. These problems are essentially caused by catastrophic cancellations. Currently, a feasible way to avoid these cancellations is using the Gauss--Kronrod quadrature to approximate the integral formulas of coefficients rather than computing the explicit formulas directly for example in the L2-type methods. This nevertheless increases computational cost and arises additional integration errors. In this work, a new framework to handle catastrophic cancellations is proposed, in particular, in the computation of the coefficients for standard and fast L2-type methods on general nonuniform meshes. We propose a concept of $\delta$-cancellation and then some threshold conditions ensuring that $\delta$-cancellations will not happen. If the threshold conditions are not satisfied, a Taylor-expansion technique is proposed to avoid $\delta$-cancellation. Numerical experiments show that our proposed method performs as accurate as the Gauss--Kronrod quadrature method and meanwhile much more efficient. This enables us to complete long time simulations with hundreds of thousands of time steps in short time.


title: Open Gromov-Witten invariants from the Fukaya category

abstract: This paper proposes a framework to show that the Fukaya category of a symplectic manifold $X$ determines the open Gromov-Witten invariants of Lagrangians $L \subset X$. We associate to an object in an $A_\infty$-category an extension of the negative cyclic homology, called \emph{relative cyclic homology}. We extend the Getzler-Gauss-Manin connection to relative cyclic homology. Then, we construct (under simplifying technical assumptions) a relative cyclic open-closed map, which maps the relative cyclic homology of a Lagrangian $L$ in the Fukaya category of a symplectic manifold $X$ to the $S^1$-equivariant relative quantum homology of $(X,L)$. Relative quantum homology is the dual to the relative quantum cohomology constructed by Solomon-Tukachinsky. This is an extension of quantum cohomology, and comes equipped with a connection extending the quantum connection. We prove that the relative open-closed map respects connections. As an application of this framework, we show, assuming a construction of the relative cyclic open-closed map in a broader technical setup, that the Fukaya category of a Calabi-Yau variety determines the open Gromov-Witten invariants with one interior marked point for any null-homologous Lagrangian brane.


title: A Nesterov's Accelerated Projected Gradient Method for Monotone Variational Inequalities

abstract: In this technical note, we are concerned with the problem of solving variational inequalities with improved convergence rates. Motivated by Nesterov's accelerated gradient method for convex optimization, we propose a Nesterov's accelerated projected gradient algorithm for variational inequality problems. We prove convergence of the proposed algorithm with at least linear rate under the common assumption of Lipschitz continuity and strongly monotonicity. To the best of our knowledge, this is the first time that convergence of the Nesterov's accelerated protocol is proved for variational inequalities, other than the convex optimization or monotone inclusion problems. Simulation results are given to demonstrate the outperformance of the proposed algorithms over the well-known projected gradient approach, the reflected projected approach, and the golden ratio method. It is shown that the required number of iterations to reach the solution is greatly reduced in our proposed algorithm.


title: On the atomic structure of torsion-free monoids

abstract: Let $M$ be a cancellative and commutative (additive) monoid. The monoid $M$ is atomic if every non-invertible element can be written as a sum of irreducible elements, which are also called atoms. Also, $M$ satisfies the ascending chain condition on principal ideals (ACCP) if every increasing sequence of principal ideals (under inclusion) becomes constant from one point on. In the first part of this paper, we characterize torsion-free monoids that satisfy the ACCP as those torsion-free monoids whose submonoids are all atomic. A submonoid of the nonnegative cone of a totally ordered abelian group is often called a positive monoid. Every positive monoid is clearly torsion-free. In the second part of this paper, we study the atomic structure of certain classes of positive monoids.


title: Towards Unified All-Neural Beamforming for Time and Frequency Domain Speech Separation

abstract: Recently, frequency domain all-neural beamforming methods have achieved remarkable progress for multichannel speech separation. In parallel, the integration of time domain network structure and beamforming also gains significant attention. This study proposes a novel all-neural beamforming method in time domain and makes an attempt to unify the all-neural beamforming pipelines for time domain and frequency domain multichannel speech separation. The proposed model consists of two modules: separation and beamforming. Both modules perform temporal-spectral-spatial modeling and are trained from end-to-end using a joint loss function. The novelty of this study lies in two folds. Firstly, a time domain directional feature conditioned on the direction of the target speaker is proposed, which can be jointly optimized within the time domain architecture to enhance target signal estimation. Secondly, an all-neural beamforming network in time domain is designed to refine the pre-separated results. This module features with parametric time-variant beamforming coefficient estimation, without explicitly following the derivation of optimal filters that may lead to an upper bound. The proposed method is evaluated on simulated reverberant overlapped speech data derived from the AISHELL-1 corpus. Experimental results demonstrate significant performance improvements over frequency domain state-of-the-arts, ideal magnitude masks and existing time domain neural beamforming methods.


title: Swing Distillation: A Privacy-Preserving Knowledge Distillation Framework

abstract: Knowledge distillation (KD) has been widely used for model compression and knowledge transfer. Typically, a big teacher model trained on sufficient data transfers knowledge to a small student model. However, despite the success of KD, little effort has been made to study whether KD leaks the training data of the teacher model. In this paper, we experimentally reveal that KD suffers from the risk of privacy leakage. To alleviate this issue, we propose a novel knowledge distillation method, swing distillation, which can effectively protect the private information of the teacher model from flowing to the student model. In our framework, the temperature coefficient is dynamically and adaptively adjusted according to the degree of private information contained in the data, rather than a predefined constant hyperparameter. It assigns different temperatures to tokens according to the likelihood that a token in a position contains private information. In addition, we inject noise into soft targets provided to the student model, in order to avoid unshielded knowledge transfer. Experiments on multiple datasets and tasks demonstrate that the proposed swing distillation can significantly reduce (by over 80% in terms of canary exposure) the risk of privacy leakage in comparison to KD with competitive or better performance. Furthermore, swing distillation is robust against the increasing privacy budget.


title: Structure preserving discontinuous Galerkin approximation of one-dimensional port-Hamiltonian systems

abstract: In this article, we present the structure-preserving discretization of linear one-dimensional port-Hamiltonian (PH) systems of two conservation laws using discontinuous Galerkin (DG) methods. We recall the DG discretization procedure which is based on a subdivision of the computational domain, an elementwise weak formulation with up to two integration by parts, and the interconnection of the elements using several numerical fluxes. We present the interconnection of the element models, which is power preserving in the case of conservative (unstabilized) numerical fluxes, and we set up the resulting global PH state space model. We discuss the properties of the obtained models, including the effect of the flux stabilization parameter on the spectrum. Finally, we show simulations with different parameters for a boundary controlled linear hyperbolic system.


title: Chirality inversion and radius blow-up of a N\'eel-type skyrmion by a Pearl vortex

abstract: We develop a theory for the coaxial configuration of a N\'eel-type skyrmion and a Pearl vortex in thin superconductor-chiral ferromagnetic heterostructures. Using direct numerical solution of the Euler-Lagrange equation and micromagnetic simulations we demonstrate that the inhomogeneous magnetic field of the Pearl vortex significantly modifies the skyrmion profile with respect to the one in the absence of the vortex. We discover drastic enlargement of the skyrmion's radius and inversion of the skyrmion's chirality. To unravel physics behind these effects we invent novel two-parameter ansatz for the magnetization profile of the skyrmion in the presence of the vortex. Chirality inversion and radius blow-up are controlled not only by the material parameters of the heterostructure but also by the thickness of the superconductor. Our findings can have implications for Majorana modes localized at skyrmion-vortex pairs.


title: How flexibility can enhance catalysis

abstract: Conformational changes are observed in many enzymes, but their role in catalysis is highly controversial. Here we present a theoretical model that illustrates how rigid catalysts can be fundamentally limited and how a conformational change induced by substrate binding can overcome this limitation, ultimately enabling barrier-free catalysis. The model is deliberately minimal, but the principle it illustrates is general and consistent with unique features of proteins as well as with previous informal proposals to explain the superiority of enzymes over other classes of catalysts. Implementing the discriminative switch suggested by the model could help overcome limitations currently encountered in the design of artificial catalysts.


title: How to disagree well: Investigating the dispute tactics used on Wikipedia

abstract: Disagreements are frequently studied from the perspective of either detecting toxicity or analysing argument structure. We propose a framework of dispute tactics that unifies these two perspectives, as well as other dialogue acts which play a role in resolving disputes, such as asking questions and providing clarification. This framework includes a preferential ordering among rebuttal-type tactics, ranging from ad hominem attacks to refuting the central argument. Using this framework, we annotate 213 disagreements (3,865 utterances) from Wikipedia Talk pages. This allows us to investigate research questions around the tactics used in disagreements; for instance, we provide empirical validation of the approach to disagreement recommended by Wikipedia. We develop models for multilabel prediction of dispute tactics in an utterance, achieving the best performance with a transformer-based label powerset model. Adding an auxiliary task to incorporate the ordering of rebuttal tactics further yields a statistically significant increase. Finally, we show that these annotations can be used to provide useful additional signals to improve performance on the task of predicting escalation.


title: FewFedWeight: Few-shot Federated Learning Framework across Multiple NLP Tasks

abstract: Massively multi-task learning with large language models has recently made substantial progress on few-shot generalization. However, this is usually performed in a centralized learning fashion, ignoring the privacy sensitivity issue of (annotated) data used in multiple tasks. To mitigate this issue, we propose FewFedWeight, a few-shot federated learning framework across multiple tasks, to achieve the best of both worlds: privacy preservation and cross-task generalization. FewFedWeight trains client models in isolated devices without sharing data. It broadcasts the global model in the server to each client and produces pseudo data for clients so that knowledge from the global model can be explored to enhance few-shot learning of each client model. An energy-based algorithm is further proposed to weight pseudo samples in order to reduce the negative impact of noise from the generated pseudo data. Adaptive model weights of client models are also tuned according to their performance. We use these model weights to dynamically aggregate client models to update the global model. Experiments on 118 NLP tasks show that FewFedWeight can significantly improve the performance of client models on 61% tasks with an average performance improvement rate of 30.5% over the baseline and substantially outperform FedAvg and other decentralized learning methods.


title: Learning Classifiers of Prototypes and Reciprocal Points for Universal Domain Adaptation

abstract: Universal Domain Adaptation aims to transfer the knowledge between the datasets by handling two shifts: domain-shift and category-shift. The main challenge is correctly distinguishing the unknown target samples while adapting the distribution of known class knowledge from source to target. Most existing methods approach this problem by first training the target adapted known classifier and then relying on the single threshold to distinguish unknown target samples. However, this simple threshold-based approach prevents the model from considering the underlying complexities existing between the known and unknown samples in the high-dimensional feature space. In this paper, we propose a new approach in which we use two sets of feature points, namely dual Classifiers for Prototypes and Reciprocals (CPR). Our key idea is to associate each prototype with corresponding known class features while pushing the reciprocals apart from these prototypes to locate them in the potential unknown feature space. The target samples are then classified as unknown if they fall near any reciprocals at test time. To successfully train our framework, we collect the partial, confident target samples that are classified as known or unknown through on our proposed multi-criteria selection. We then additionally apply the entropy loss regularization to them. For further adaptation, we also apply standard consistency regularization that matches the predictions of two different views of the input to make more compact target feature space. We evaluate our proposal, CPR, on three standard benchmarks and achieve comparable or new state-of-the-art results. We also provide extensive ablation experiments to verify our main design choices in our framework.


title: Test-time Adaptation in the Dynamic World with Compound Domain Knowledge Management

abstract: Prior to the deployment of robotic systems, pre-training the deep-recognition models on all potential visual cases is infeasible in practice. Hence, test-time adaptation (TTA) allows the model to adapt itself to novel environments and improve its performance during test time (i.e., lifelong adaptation). Several works for TTA have shown promising adaptation performances in continuously changing environments. However, our investigation reveals that existing methods are vulnerable to dynamic distributional changes and often lead to overfitting of TTA models. To address this problem, this paper first presents a robust TTA framework with compound domain knowledge management. Our framework helps the TTA model to harvest the knowledge of multiple representative domains (i.e., compound domain) and conduct the TTA based on the compound domain knowledge. In addition, to prevent overfitting of the TTA model, we devise novel regularization which modulates the adaptation rates using domain-similarity between the source and the current target domain. With the synergy of the proposed framework and regularization, we achieve consistent performance improvements in diverse TTA scenarios, especially on dynamic domain shifts. We demonstrate the generality of proposals via extensive experiments including image classification on ImageNet-C and semantic segmentation on GTA5, C-driving, and corrupted Cityscapes datasets.


title: A solution to Brauer's Problem 14

abstract: It is well known that the number of real irreducible characters of a finite group G coincides with the number of real conjugacy classes of G. Richard Brauer has asked if the number of irreducible characters with Frobenius-Schur indicator 1 can also be expressed in group theoretical terms. We show that this can done by counting solutions of $g_1^2\ldots g_n^2=1$ with $g_1,\ldots,g_n\in G$.


title: Some recent trends in embeddings of time series and dynamic networks

abstract: We give a review of some recent developments in embeddings of time series and dynamic networks. We start out with traditional principal components and then look at extensions to dynamic factor models for time series. Unlike principal components for time series, the literature on time-varying nonlinear embedding is rather sparse. The most promising approaches in the literature is neural network based, and has recently performed well in forecasting competitions. We also touch upon different forms of dynamics in topological data analysis. The last part of the paper deals with embedding of dynamic networks where we believe there is a gap between available theory and the behavior of most real world networks. We illustrate our review with two simulated examples. Throughout the review, we highlight differences between the static and dynamic case, and point to several open problems in the dynamic case.


title: Trion emission from frozen p-n junctions in networks of electrolyte-gated (6,5) single-walled carbon nanotubes

abstract: We demonstrate exciton and charged exciton (trion) electroluminescence from frozen p-n junctions in networks of polymer-sorted, semiconducting (6,5) single-walled carbon nanotubes. Electrolyte-gating with an ionic liquid was employed to achieve injection and accumulation of high densities of holes and electrons in the nanotube network at low applied voltages. Static p-n junctions were formed by cooling the devices below the melting point of the ionic liquid while in the ambipolar regime. These frozen junctions showed diode-like rectification and enabled the investigation of electron-hole recombination and near-infrared electroluminescence under controlled conditions. The contributions of exciton and red-shifted trion emission to the electroluminescence spectra were influenced by the initial parameters of the p-n junction formation (balanced or unbalanced) and the applied lateral bias, but did not depend on temperature (30-200 K). The tilted potential profile along the fixed junction and consequently the number of excess carriers within the recombination zone were found to predominantly determine the emission intensity and observed trion to exciton ratio.


title: Congruence of Linear Symplectic Forms by the Symplectic Group

abstract: This paper concerns the action of linear symplectomorphisms on linear symplectic forms by conjugation in even dimensions. We prove that pfaffian and $-\frac{1}{2}\operatorname{tr}(JA)$ (sum function) of $A$ are invariants on the action. We use these invariants to provide a complete description of the orbit space in dimension four. In addition, we investigate the geometric shapes of the individual orbits in dimension four. In symplectic geometry, our classification result in dimension four provides a necessary condition for two symplectic forms on $\mathbb{R}^{4}$ to be intertwined by symplectomorphisms of the standard symplectic form. This stands in contrast to the lack of local invariants under diffeomorphisms. Furthermore, we determine global invariants of a class of symplectic forms, and we study an extension of a corollary of the Curry-Pelayo-Tang Stability Theorem. Lastly, we extend our results and investigate the action of linear symplectomorphisms on linear symplectic forms in dimension $2n$. We determine $n$ invariants of linear symplectic forms under this action, namely, $s_k(A)$ we defined as $\sigma_k(A)$ which is the coefficient of term $t^k$ in the polynomial expansion of pfaffian of $tJ+A$.


title: Quaternion Tensor Completion with Sparseness for Color Video Recovery

abstract: A novel low-rank completion algorithm based on the quaternion tensor is proposed in this paper. This approach uses the TQt-rank of quaternion tensor to maintain the structure of RGB channels throughout the entire process. In more detail, the pixels in each frame are encoded on three imaginary parts of a quaternion as an element in a quaternion matrix. Each quaternion matrix is then stacked into a quaternion tensor. A logarithmic function and truncated nuclear norm are employed to characterize the rank of the quaternion tensor in order to promote the low rankness of the tensor. Moreover, by introducing a newly defined quaternion tensor discrete cosine transform-based (QTDCT) regularization to the low-rank approximation framework, the optimized recovery results can be obtained in the local details of color videos. In particular, the sparsity of the quaternion tensor is reasonably characterized by l1 norm in the QDCT domain. This strategy is optimized via the two-step alternating direction method of multipliers (ADMM) framework. Numerical experimental results for recovering color videos show the obvious advantage of the proposed method over other potential competing approaches.


title: NetRPC: Enabling In-Network Computation in Remote Procedure Calls

abstract: People have shown that in-network computation (INC) significantly boosts performance in many application scenarios include distributed training, MapReduce, agreement, and network monitoring. However, existing INC programming is unfriendly to the normal application developers, demanding tedious network engineering details like flow control, packet organization, chip-specific programming language, and ASIC architecture with many limitations. We propose a general INC-enabled RPC system, NetRPC. NetRPC provides a set of familiar and lightweight interfaces for software developers to describe an INC application using a traditional RPC programming model. NetRPC also proposes a general-purpose INC implementation together with a set of optimization techniques to guarantee the efficiency of various types of INC applications running on a shared INC data plane. We conduct extensive experiments on different types of applications on the real testbed. Results show that using only about 5% or even fewer human-written lines of code, NetRPC can achieve performance similar to the state-of-the-art INC solutions.


title: Fast Learning of Dynamic Hand Gesture Recognition with Few-Shot Learning Models

abstract: We develop Few-Shot Learning models trained to recognize five or ten different dynamic hand gestures, respectively, which are arbitrarily interchangeable by providing the model with one, two, or five examples per hand gesture. All models were built in the Few-Shot Learning architecture of the Relation Network (RN), in which Long-Short-Term Memory cells form the backbone. The models use hand reference points extracted from RGB-video sequences of the Jester dataset which was modified to contain 190 different types of hand gestures. Result show accuracy of up to 88.8% for recognition of five and up to 81.2% for ten dynamic hand gestures. The research also sheds light on the potential effort savings of using a Few-Shot Learning approach instead of a traditional Deep Learning approach to detect dynamic hand gestures. Savings were defined as the number of additional observations required when a Deep Learning model is trained on new hand gestures instead of a Few Shot Learning model. The difference with respect to the total number of observations required to achieve approximately the same accuracy indicates potential savings of up to 630 observations for five and up to 1260 observations for ten hand gestures to be recognized. Since labeling video recordings of hand gestures implies significant effort, these savings can be considered substantial.


title: Three lines of defense against risks from AI

abstract: Organizations that develop and deploy artificial intelligence (AI) systems need to manage the associated risks - for economic, legal, and ethical reasons. However, it is not always clear who is responsible for AI risk management. The Three Lines of Defense (3LoD) model, which is considered best practice in many industries, might offer a solution. It is a risk management framework that helps organizations to assign and coordinate risk management roles and responsibilities. In this article, I suggest ways in which AI companies could implement the model. I also discuss how the model could help reduce risks from AI: it could identify and close gaps in risk coverage, increase the effectiveness of risk management practices, and enable the board of directors to oversee management more effectively. The article is intended to inform decision-makers at leading AI companies, regulators, and standard-setting bodies.


title: Geometric Rectification of Creased Document Images based on Isometric Mapping

abstract: Geometric rectification of images of distorted documents finds wide applications in document digitization and Optical Character Recognition (OCR). Although smoothly curved deformations have been widely investigated by many works, the most challenging distortions, e.g. complex creases and large foldings, have not been studied in particular. The performance of existing approaches, when applied to largely creased or folded documents, is far from satisfying, leaving substantial room for improvement. To tackle this task, knowledge about document rectification should be incorporated into the computation, among which the developability of 3D document models and particular textural features in the images, such as straight lines, are the most essential ones. For this purpose, we propose a general framework of document image rectification in which a computational isometric mapping model is utilized for expressing a 3D document model and its flattening in the plane. Based on this framework, both model developability and textural features are considered in the computation. The experiments and comparisons to the state-of-the-art approaches demonstrated the effectiveness and outstanding performance of the proposed method. Our method is also flexible in that the rectification results can be enhanced by any other methods that extract high-quality feature lines in the images.


title: Stochastic differential variational inequalities with applications

abstract: In this paper, we introduce and study a stochastic differential variational inequality (SDVI) which consists of a stochastic differential equation and a stochastic variational inequality. We obtain the existence and uniqueness of the solutions for SDVI by using the iteration method and Gronwall's inequality. Moreover, we show the convergence of Euler scheme for solving SDVI under some mild conditions. Finally, we apply the obtained results to solve the electrical circuits with diodes and the collapse of the bridge problems in stochastic environment.


title: Minimal Extension for the $\alpha$-Manhattan norm

abstract: Let $\partial \mathcal{Q}$ be the boundary of a convex polygon in $\mathbb{R}^2$, $e_\alpha = (\cos\alpha, \sin \alpha)$ and $e_{\alpha}^{\bot} = (-\sin\alpha , \cos \alpha)$ be a basis of $\mathbb{R}^2$ for some $\alpha\in[0,2\pi)$ and $\phi:\partial\mathcal{Q} \to\mathbb{R}^2$ be a continuous, finitely piecewise linear injective map. We construct a finitely piecewise affine homeomorphism $v: \mathcal{Q} \to \mathbb{R}^2$ coinciding with $\phi$ on $\partial \mathcal{Q}$ such that the following property holds: $|\langle Dv, e_{\alpha}\rangle|(\mathcal{Q})$ (resp. $\langle Dv, e_{\alpha}^{\bot}\rangle|(\mathcal{Q})$) is as close as we want to $\inf |\langle Du, e_{\alpha}\rangle|(\mathcal{Q})$ (resp. $\inf |\langle Du, e_{\alpha}^{\bot}\rangle|(\mathcal{Q})$) where the infimum is meant over the class of all $BV$ homeomorphisms $u$ extending $\phi$ inside $\mathcal{Q}$. This result extends that already proven in [14] in the shape of the domain.


title: Morse boundaries of 3-manifold groups

abstract: We classify the homeomorphism types of the Morse boundaries of all 3-manifold groups into 9 different possible homeomorphism types, and show how the Morse boundary depends on the geometric decomposition.


title: Temporal Variation Measure Analysis: An Improved Second-Order Difference Plot

abstract: In this study, an improved second-order difference plot is proposed to analyze the variability of heart rate variability. Although the variation of physiological status of cardiovascular system can be shown graphically by the second-order difference plot, the descriptive ability of existing indicators for this plot is insufficient. As a result, the physiological information contained in the second-order difference plot cannot be extracted adequately. Addressing the problem, the temporal variation measure analysis is presented to describe distribution patterns of scatter points in the second-order difference plot quantitatively and extract the acceleration information for variation of heart rate variability. Experiment results demonstrate the effectiveness of the temporal variation measure analysis. As a quantitative indicator, the temporal variation entropy is properly designed and successfully applied in the recognition and classification of the physiological statuses of the heart.


title: Shapley variable importance cloud for machine learning models

abstract: Current practice in interpretable machine learning often focuses on explaining the final model trained from data, e.g., by using the Shapley additive explanations (SHAP) method. The recently developed Shapley variable importance cloud (ShapleyVIC) extends the current practice to a group of "nearly optimal models" to provide comprehensive and robust variable importance assessments, with estimated uncertainty intervals for a more complete understanding of variable contributions to predictions. ShapleyVIC was initially developed for applications with traditional regression models, and the benefits of ShapleyVIC inference have been demonstrated in real-life prediction tasks using the logistic regression model. However, as a model-agnostic approach, ShapleyVIC application is not limited to such scenarios. In this work, we extend ShapleyVIC implementation for machine learning models to enable wider applications, and propose it as a useful complement to the current SHAP analysis to enable more trustworthy applications of these black-box models.


title: Generalizing Reduction-Based Algebraic Multigrid

abstract: Algebraic Multigrid (AMG) methods are often robust and effective solvers for solving the large and sparse linear systems that arise from discretized PDEs and other problems, relying on heuristic graph algorithms to achieve their performance. Reduction-based AMG (AMGr) algorithms attempt to formalize these heuristics by providing two-level convergence bounds that depend concretely on properties of the partitioning of the given matrix into its fine- and coarse-grid degrees of freedom. MacLachlan and Saad (SISC 2007) proved that the AMGr method yields provably robust two-level convergence for symmetric and positive-definite matrices that are diagonally dominant, with a convergence factor bounded as a function of a coarsening parameter. However, when applying AMGr algorithms to matrices that are not diagonally dominant, not only do the convergence factor bounds not hold, but measured performance is notably degraded. Here, we present modifications to the classical AMGr algorithm that improve its performance on matrices that are not diagonally dominant, making use of strength of connection, sparse approximate inverse (SPAI) techniques, and interpolation truncation and rescaling, to improve robustness while maintaining control of the algorithmic costs. We present numerical results demonstrating the robustness of this approach for both classical isotropic diffusion problems and for non-diagonally dominant systems coming from anisotropic diffusion.


title: On Asymptotic Behaviors of Stepwise Multiple Testing Procedures

abstract: Stepwise multiple testing procedures have attracted several statisticians for decades and are also quite popular with statistics users because of their technical simplicity. The Bonferroni procedure has been one of the earliest and most prominent testing rules for controlling the familywise error rate (FWER). A recent article established that the FWER for the Bonferroni method asymptotically (i.e., when the number of hypotheses becomes arbitrarily large) approaches zero under any positively equicorrelated multivariate normal framework. However, similar results for the limiting behaviors of FWER of general stepwise procedures are nonexistent. The present work addresses this gap in a unified manner by studying the limiting behaviors of the FWER of several stepwise testing rules for correlated normal setups. Specifically, we show that the limiting FWER approaches zero for any step-down rule (e.g., Holm's method) provided the infimum of the correlations is strictly positive. We also establish similar limiting zero results on FWER of other popular multiple testing rules, e.g., Hochberg's and Hommel's procedures. We then extend these results to any configuration of true and false null hypotheses. It turns out that, within our chosen asymptotic framework, the Benjamini-Hochberg method can hold the FWER at a strictly positive level asymptotically under the equicorrelated normality. We finally discuss the limiting powers of various procedures.


title: On partial cubes, well-graded families and their duals with some applications in graphs

abstract: Well-graded families, extremal systems and maximum systems (the last two in the sense of VC-theory and Sauer-Shelah lemma on VC-dimension) are three important classes of set systems. This paper aims to study the notion of duality in the context of these classes of set systems and then use the obtained results for studying graphs. More specifically, we are concerned with the characterization of the finite set systems which themselves and their dual systems are both well-graded, extremal or maximum. On the way to this goal, and maybe also of independent interest, we study the structure of the well-graded families with the property that the size of the system is not much bigger than the size of its essential domain, that is, the set of elements of the domain which are shattered by the system as single element subsets. As another target of the paper, we use the above results to characterize graphs whose set systems of open or closed neighbourhoods, cliques or independent sets are well-graded, extremal or maximum. We clarify the relation of such graphs to the celebrated half-graphs. Through the paper, we frequently relate our investigations to the VC-dimension of the systems. Also we use one-inclusion graphs associated to set systems as an important technical tool.


title: Optimal blowup stability for three-dimensional wave maps

abstract: We study corotational wave maps from $(1+3)$-dimensional Minkowski space into the three-sphere. We establish the asymptotic stability of an explicitly known self-similar wave map under perturbations that are small in the critical Sobolev space. This is accomplished by proving Strichartz estimates for a radial wave equation with a potential in similarity coordinates. Compared to earlier work, the main novelty lies with the fact that the critical Sobolev space is of fractional order.


title: Sufficiency of $c$-cyclical monotonicity in a class of multimarginal optimal transport problems

abstract: $c$-cyclical monotonicity is the most important optimality condition for an optimal transport plan. While the proof of necessity is relatively easy, the proof of sufficiency is often more difficult or even elusive. We present here a new approach and we show how known results are derived in this new framework and how this approach allows to prove sufficiency in situations previously not treatable.


title: Easy Uncertainty Quantification (EasyUQ): Generating Predictive Distributions from Single-valued Model Output

abstract: How can we quantify uncertainty if our favorite computational tool - be it a numerical, a statistical, or a machine learning approach, or just any computer model - provides single-valued output only? In this article, we introduce the Easy Uncertainty Quantification (EasyUQ) technique, which transforms real-valued model output into calibrated statistical distributions, based solely on training data of model output-outcome pairs, without any need to access model input. In its basic form, EasyUQ is a special case of the recently introduced Isotonic Distributional Regression (IDR) technique that leverages the pool-adjacent-violators algorithm for nonparametric isotonic regression. EasyUQ yields discrete predictive distributions that are calibrated and optimal in finite samples, subject to stochastic monotonicity. The workflow is fully automated, without any need for tuning. The Smooth EasyUQ approach supplements IDR with kernel smoothing, to yield continuous predictive distributions that preserve key properties of the basic form, including both, stochastic monotonicity with respect to the original model output, and asymptotic consistency. For the selection of kernel parameters, we introduce multiple one-fit grid search, a computationally much less demanding approximation to leave-one-out cross-validation. We use simulation examples and forecast data from weather prediction to illustrate the techniques. In a study of benchmark problems from machine learning, we show how EasyUQ and Smooth EasyUQ can be integrated into the workflow of neural network learning and hyperparameter tuning, and find EasyUQ to be competitive with conformal prediction, as well as more elaborate input-based approaches.


title: PointAvatar: Deformable Point-based Head Avatars from Videos

abstract: The ability to create realistic, animatable and relightable head avatars from casual video sequences would open up wide ranging applications in communication and entertainment. Current methods either build on explicit 3D morphable meshes (3DMM) or exploit neural implicit representations. The former are limited by fixed topology, while the latter are non-trivial to deform and inefficient to render. Furthermore, existing approaches entangle lighting in the color estimation, thus they are limited in re-rendering the avatar in new environments. In contrast, we propose PointAvatar, a deformable point-based representation that disentangles the source color into intrinsic albedo and normal-dependent shading. We demonstrate that PointAvatar bridges the gap between existing mesh- and implicit representations, combining high-quality geometry and appearance with topological flexibility, ease of deformation and rendering efficiency. We show that our method is able to generate animatable 3D avatars using monocular videos from multiple sources including hand-held smartphones, laptop webcams and internet videos, achieving state-of-the-art quality in challenging cases where previous methods fail, e.g., thin hair strands, while being significantly more efficient in training than competing methods.


title: Feature Dropout: Revisiting the Role of Augmentations in Contrastive Learning

abstract: What role do augmentations play in contrastive learning? Recent work suggests that good augmentations are label-preserving with respect to a specific downstream task. We complicate this picture by showing that label-destroying augmentations can be useful in the foundation model setting, where the goal is to learn diverse, general-purpose representations for multiple downstream tasks. We perform contrastive learning experiments on a range of image and audio datasets with multiple downstream tasks (e.g. for digits superimposed on photographs, predicting the class of one vs. the other). We find that Viewmaker Networks, a recently proposed model for learning augmentations for contrastive learning, produce label-destroying augmentations that stochastically destroy features needed for different downstream tasks. These augmentations are interpretable (e.g. altering shapes, digits, or letters added to images) and surprisingly often result in better performance compared to expert-designed augmentations, despite not preserving label information. To support our empirical results, we theoretically analyze a simple contrastive learning setting with a linear model. In this setting, label-destroying augmentations are crucial for preventing one set of features from suppressing the learning of features useful for another downstream task. Our results highlight the need for analyzing the interaction between multiple downstream tasks when trying to explain the success of foundation models.


title: GeneFormer: Learned Gene Compression using Transformer-based Context Modeling

abstract: With the development of gene sequencing technology, an explosive growth of gene data has been witnessed. And the storage of gene data has become an important issue. Traditional gene data compression methods rely on general software like G-zip, which fails to utilize the interrelation of nucleotide sequence. Recently, many researchers begin to investigate deep learning based gene data compression method. In this paper, we propose a transformer-based gene compression method named GeneFormer. Specifically, we first introduce a modified transformer structure to fully explore the nucleotide sequence dependency. Then, we propose fixed-length parallel grouping to accelerate the decoding speed of our autoregressive model. Experimental results on real-world datasets show that our method saves 29.7% bit rate compared with the state-of-the-art method, and the decoding speed is significantly faster than all existing learning-based gene compression methods.


title: Instance-specific Label Distribution Regularization for Learning with Label Noise

abstract: Modeling noise transition matrix is a kind of promising method for learning with label noise. Based on the estimated noise transition matrix and the noisy posterior probabilities, the clean posterior probabilities, which are jointly called Label Distribution (LD) in this paper, can be calculated as the supervision. To reliably estimate the noise transition matrix, some methods assume that anchor points are available during training. Nonetheless, if anchor points are invalid, the noise transition matrix might be poorly learned, resulting in poor performance. Consequently, other methods treat reliable data points, extracted from training data, as pseudo anchor points. However, from a statistical point of view, the noise transition matrix can be inferred from data with noisy labels under the clean-label-domination assumption. Therefore, we aim to estimate the noise transition matrix without (pseudo) anchor points. There is evidence showing that samples are more likely to be mislabeled as other similar class labels, which means the mislabeling probability is highly correlated with the inter-class correlation. Inspired by this observation, we propose an instance-specific Label Distribution Regularization (LDR), in which the instance-specific LD is estimated as the supervision, to prevent DCNNs from memorizing noisy labels. Specifically, we estimate the noisy posterior under the supervision of noisy labels, and approximate the batch-level noise transition matrix by estimating the inter-class correlation matrix with neither anchor points nor pseudo anchor points. Experimental results on two synthetic noisy datasets and two real-world noisy datasets demonstrate that our LDR outperforms existing methods.


title: On the Jacobian Matrices of Generalized Chebyshev Polynomials

abstract: In this paper, we give a practical method to compute the Jacobian matrices of generalized Chebyshev polynomials associated to arbitrary semisimple Lie algebras. The entries of each Jacobian matrix can be expressed as a linear combination of characters of irreducible representations of the underlying Lie algebra with integer coefficients. These integer coefficients can be obtained by basic computations in the fundamental Weyl chamber.


title: Temporal and latitudinal variations of Ca-K plage and network area: An implication to meridional flows

abstract: The Ca-K spectroheliograms obtained at the Kodaikanal observatory (KO) are used to generate a uniform time series using the equal contrast technique (ECT) to study the long and short-term variation in the solar chromosphere. The percentage of plage, Enhanced network (EN), Active network (AN), and Quiet network (QN) area at various latitudes is compared with the activity at 35$^{\circ}$ latitude and also with the sunspot number for the period of 1907 -- 1984. The values of phase differences indicate that the activity begins at $\sim$45$^{\circ}$ latitude and shift progressively to the lower latitude at a speed of $\sim$~9.4~m~sec$^{-1}$ . The shift speed slows down gradually and reaches $\sim$~3~m~sec$^{-1}$ at $\sim$5$^{\circ}$ latitude. No phase difference between the variations of Ca-K activity at 55$^{\circ}$, 65$^{\circ}$, and 75$^{\circ}$ latitude belts implies that changes in the activity are happening simultaneously. The analysis shows that the activity at polar latitude belts is anti-correlated with the sunspot number. This study indicates that a multi-cell meridional flow pattern could exist in the solar convection zone. One type of cell could transport the magnetic elements from mid-latitude to low-latitude belts through meridional flows, and the other one could be operating in the polar region.


title: Analytic K-semistability and wall-crossing

abstract: For a small polarised deformation of a constant scalar curvature K\"ahler manifold with abelian reduced automorphism group, we prove that K-polystability along nearby polarisations implies the existence of a constant scalar curvature K\"ahler metric. In this setting, we reduce K-polystability to the computation of the classical Futaki invariant on the cscK degeneration. Our result holds on specific families and provides a first step towards wall-crossing phenomena for the moduli of cscK manifolds when the polarisation varies.


title: Fast-moving object counting with an event camera

abstract: This paper proposes the use of an event camera as a component of a vision system that enables counting of fast-moving objects - in this case, falling corn grains. These type of cameras transmit information about the change in brightness of individual pixels and are characterised by low latency, no motion blur, correct operation in different lighting conditions, as well as very low power consumption. The proposed counting algorithm processes events in real time. The operation of the solution was demonstrated on a stand consisting of a chute with a vibrating feeder, which allowed the number of grains falling to be adjusted. The objective of the control system with a PID controller was to maintain a constant average number of falling objects. The proposed solution was subjected to a series of tests to determine the correctness of the developed method operation. On their basis, the validity of using an event camera to count small, fast-moving objects and the associated wide range of potential industrial applications can be confirmed.


title: Search Budget in Multi-Objective Refactoring Optimization: a Model-Based Empirical Study

abstract: Software model optimization is the task of automatically generate design alternatives, usually to improve quality aspects of software that are quantifiable, like performance and reliability. In this context, multi-objective optimization techniques have been applied to help the designer find suitable trade-offs among several non-functional properties. In this process, design alternatives can be generated through automated model refactoring, and evaluated on non-functional models. Due to their complexity, this type of optimization tasks require considerable time and resources, often limiting their application in software engineering processes. In this paper, we investigate the effects of using a search budget, specifically a time limit, to the search for new solutions. We performed experiments to quantify the impact that a change in the search budget may have on the quality of solutions. Furthermore, we analyzed how different genetic algorithms (i.e., NSGA-II, SPEA2, and PESA2) perform when imposing different budgets. We experimented on two case studies of different size, complexity, and domain. We observed that imposing a search budget considerably deteriorates the quality of the generated solutions, but the specific algorithm we choose seems to play a crucial role. From our experiments, NSGA-II is the fastest algorithm, while PESA2 generates solutions with the highest quality. Differently, SPEA2 is the slowest algorithm, and produces the solutions with the lowest quality.


title: Rheology of dilute granular gas mixtures where the grains interact via a square shoulder and well potential

abstract: We develop the rheology of a dilute granular gas mixture. Motivated by the interaction of charged granular particles, we assume that the grains interact via a square shoulder and well potential. Employing kinetic theory, we compute the temperature and the shear viscosity as functions of the shear rate. Numerical simulations confirm our results above the critical shear rate. At a shear rate below a critical value, clustering of the particles occurs.


title: Traffic sign detection and recognition using event camera image reconstruction

abstract: This paper presents a method for detection and recognition of traffic signs based on information extracted from an event camera. The solution used a FireNet deep convolutional neural network to reconstruct events into greyscale frames. Two YOLOv4 network models were trained, one based on greyscale images and the other on colour images. The best result was achieved for the model trained on the basis of greyscale images, achieving an efficiency of 87.03%.


title: Homonymy Information for English WordNet

abstract: A widely acknowledged shortcoming of WordNet is that it lacks a distinction between word meanings which are systematically related (polysemy), and those which are coincidental (homonymy). Several previous works have attempted to fill this gap, by inferring this information using computational methods. We revisit this task, and exploit recent advances in language modelling to synthesise homonymy annotation for Princeton WordNet. Previous approaches treat the problem using clustering methods; by contrast, our method works by linking WordNet to the Oxford English Dictionary, which contains the information we need. To perform this alignment, we pair definitions based on their proximity in an embedding space produced by a Transformer model. Despite the simplicity of this approach, our best model attains an F1 of .97 on an evaluation set that we annotate. The outcome of our work is a high-quality homonymy annotation layer for Princeton WordNet, which we release.


title: A certified wavelet-based physics-informed neural network for the solution of parameterized partial differential equations

abstract: Physics Informed Neural Networks (PINNs) have frequently been used for the numerical approximation of Partial Differential Equations (PDEs). The goal of this paper is to construct PINNs along with a computable upper bound of the error, which is particularly relevant for model reduction of Parameterized PDEs (PPDEs). To this end, we suggest to use a weighted sum of expansion coefficients of the residual in terms of an adaptive wavelet expansion both for the loss function and an error bound. This approach is shown here for elliptic PPDEs using both the standard variational and an optimally stable ultra-weak formulation. Numerical examples show a very good quantitative effectivity of the wavelet-based error bound.


title: Lessons learned from the evaluation of Spanish Language Models

abstract: Given the impact of language models on the field of Natural Language Processing, a number of Spanish encoder-only masked language models (aka BERTs) have been trained and released. These models were developed either within large projects using very large private corpora or by means of smaller scale academic efforts leveraging freely available data. In this paper we present a comprehensive head-to-head comparison of language models for Spanish with the following results: (i) Previously ignored multilingual models from large companies fare better than monolingual models, substantially changing the evaluation landscape of language models in Spanish; (ii) Results across the monolingual models are not conclusive, with supposedly smaller and inferior models performing competitively. Based on these empirical results, we argue for the need of more research to understand the factors underlying them. In this sense, the effect of corpus size, quality and pre-training techniques need to be further investigated to be able to obtain Spanish monolingual models significantly better than the multilingual ones released by large private companies, specially in the face of rapid ongoing progress in the field. The recent activity in the development of language technology for Spanish is to be welcomed, but our results show that building language models remains an open, resource-heavy problem which requires to marry resources (monetary and/or computational) with the best research expertise and practice.


title: Enhanced-rate Iterative Beamformers for Active IRS-assisted Wireless Communications

abstract: Compared to passive intelligent reflecting surface (IRS), active IRS is viewed as a more efficient promising technique to combat the double-fading impact in IRS-aided wireless network. In this paper, in order to boost the achievable rate of user in such a wireless network, three enhanced-rate iterative beamforming methods are proposed by designing the amplifying factors and the corresponding phases at active IRS. The first method, maximizing the simplified signal-to-noise ratio (Max-SSNR) is designed by omitting the cross-term in the definition of rate. Using the Rayleigh-Ritz (RR) theorem, Max-SSNR-RR is proposed to iteratively optimize the norm of beamforming vector and its associated normalized vector. In addition, generalized maximum ratio reflection (GMRR) is presented with a closed-form expression, which is motivated by the maximum ratio combining. To further improve rate, maximizing SNR (Max-SNR) is designed by fractional programming (FP), which is called Max-SNR-FP. Simulation results show that the proposed three methods make an obvious rate enhancement over Max-reflecting signal-to-noise ratio (Max-RSNR), maximum ratio reflection (MRR), selective ratio reflecting (SRR), equal gain reflection (EGR) and passive IRS, and are in increasing order of rate performance as follows: Max-SSNR-RR, GMRR, and Max-SNR-FP.


title: The International Lattice Data Grid -- towards FAIR Data

abstract: The International Lattice Data Grid (ILDG) is a community-wide initiative to realize the sharing of primary data from lattice QCD simulations according to the principles of FAIR data. We recall the basic concepts of ILDG as a federation of autonomous regional grids with common standards for (meta-)data and services, and report on current activities, progress, and plans to restore and extend the usability of ILDG.


title: On partial abelianization of framed local systems

abstract: D.~Gaiotto, G.~W.~Moore and A.~Neitzke introduced spectral networks to understand the framed $G$-local systems over punctured surfaces for $G$ a split Lie group via a procedure called abelianization. We generalize this construction to groups $G$ of the form $\mathrm{GL}_2(A)$, where $A$ is a unital associative ring, and to some of its subgroups. This relies on a precise analysis of the degree 2 ramified coverings associated with spectral networks and triangulations and on a matrix reinterpretation of their path lifting rules; along the way we provide another proof of the Laurent phenomenon brought to light by A.~Berenstein and V.~Retakh. The partial abelianization enables us to gives parametrizations of the moduli spaces of decorated $G$-local systems and of framed $G$-local systems over punctured surfaces. For $(A, \sigma)$ a Hermitian involutive $\mathbf{R}$-algebra the group $G=\mathrm{Sp}_2(A, \sigma)$ is a classical Hermitian Lie group of tube type, and we are able to identify and parametrize the moduli space of maximal framed $G$-local systems.


title: Classification of area-strict limits of planar BV homeomorphisms

abstract: We present a classification of area-strict limits of planar $BV$ homeomorphisms. This class of mappings allows for cavitations and fractures but fulfil a suitable generalization of the INV condition. As pointed out by J. Ball [4], these features are expected in limit configurations of elastic deformations. In [12], De Philippis and Pratelli introduced the \emph{no-crossing} condition which characterizes the $W^{1,p}$ closure of planar homeomorphisms. In the current paper we show that a suitable version of this concept is equivalent with a map, $f$, being the area-strict limit of BV homeomorphisms. This extends our results from [10], where we proved that the \emph{no-crossing BV} condition for a BV map was equivalent with the map being the m-strict limit of homeomorphisms (i.e. $f_k$ converges $w^*$ to $f$ and $|D_1f_k|(\Omega)+|D_2f_k|(\Omega) \to |D_1f|(\Omega)+|D_2f|(\Omega)$). Further we show that the \emph{no-crossing BV} condition is equivalent with a seemingly stronger version of the same condition.


title: Metaphorical Polysemy Detection: Conventional Metaphor meets Word Sense Disambiguation

abstract: Linguists distinguish between novel and conventional metaphor, a distinction which the metaphor detection task in NLP does not take into account. Instead, metaphoricity is formulated as a property of a token in a sentence, regardless of metaphor type. In this paper, we investigate the limitations of treating conventional metaphors in this way, and advocate for an alternative which we name 'metaphorical polysemy detection' (MPD). In MPD, only conventional metaphoricity is treated, and it is formulated as a property of word senses in a lexicon. We develop the first MPD model, which learns to identify conventional metaphors in the English WordNet. To train it, we present a novel training procedure that combines metaphor detection with word sense disambiguation (WSD). For evaluation, we manually annotate metaphor in two subsets of WordNet. Our model significantly outperforms a strong baseline based on a state-of-the-art metaphor detection model, attaining an ROC-AUC score of .78 (compared to .65) on one of the sets. Additionally, when paired with a WSD model, our approach outperforms a state-of-the-art metaphor detection model at identifying conventional metaphors in text (.659 F1 compared to .626).


title: "We are a startup to the core": A qualitative interview study on the security and privacy development practices in Turkish software startups

abstract: Security and privacy are often neglected in software development, and rarely a priority for developers. This insight is commonly based on research conducted by researchers and on developer populations living and working in the United States, Europe, and the United Kingdom. However, the production of software is global, and crucial populations in important technology hubs are not adequately studied. The software startup scene in Turkey is impactful, and comprehension, knowledge, and mitigations related to software security and privacy remain understudied. To close this research gap, we conducted a semi-structured interview study with 16 developers working in Turkish software startups. The goal of the interview study was to analyze if and how developers ensure that their software is secure and preserves user privacy. Our main finding is that developers rarely prioritize security and privacy, due to a lack of awareness, skills, and resources. We find that regulations can make a positive impact on security and privacy. Based on the study, we issue recommendations for industry, individual developers, research, educators, and regulators. Our recommendations can inform a more globalized approach to security and privacy in software development.


title: Criticality of $\text{AC}^0$ formulae

abstract: Rossman [In $\textit{Proc. $34$th Comput. Complexity Conf.}$, 2019] introduced the notion of $\textit{criticality}$. The criticality of a Boolean function $f : \{0,1\}^n \to \{0,1\}$ is the minimum $\lambda \geq 1$ such that for all positive integers $t$, \[ \Pr_{\rho \sim \mathcal{R}_p}\left[\text{DT}_{\text{depth}}(f|_{\rho}) \geq t\right] \leq (p\lambda)^t. \] H\"astad's celebrated switching lemma shows that the criticality of any $k$-DNF is at most $O(k)$. Subsequent improvements to correlation bounds of $\text{AC}^0$-circuits against parity showed that the criticality of any $\text{AC}^0$-$\textit{circuit}$ of size $S$ and depth $d+1$ is at most $O(\log S)^d$ and any $\textit{regular}$ $\text{AC}^0$-$\textit{formula}$ of size $S$ and depth $d+1$ is at most $O\left(\frac1d \cdot \log S\right)^d$. We strengthen these results by showing that the criticality of $\textit{any}$ $\text{AC}^0$-formula (not necessarily regular) of size $S$ and depth $d+1$ is at most $O\left(\frac1d\cdot {\log S}\right)^d$, resolving a conjecture due to Rossman. This result also implies Rossman's optimal lower bound on the size of any depth-$d$ $\text{AC}^0$-formula computing parity [$\textit{Comput. Complexity, 27(2):209--223, 2018.}$]. Our result implies tight correlation bounds against parity, tight Fourier concentration results and improved $\#$SAT algorithm for $\text{AC}^0$-formulae.


title: Structure-preserving discretizations of two-phase Navier-Stokes flow using fitted and unfitted approaches

abstract: We consider the numerical approximation of a sharp-interface model for two-phase flow, which is given by the incompressible Navier-Stokes equations in the bulk domain together with the classical interface conditions on the interface. We propose structure-preserving finite element methods for the model, meaning in particular that volume preservation and energy decay are satisfied on the discrete level. For the evolving fluid interface, we employ parametric finite element approximations that introduce an implicit tangential velocity to improve the quality of the interface mesh. For the two-phase Navier-Stokes equations, we consider two different approaches: an unfitted and a fitted finite element method, respectively. In the unfitted approach, the constructed method is based on an Eulerian weak formulation, while in the fitted approach a novel arbitrary Lagrangian-Eulerian (ALE) weak formulation is introduced. Using suitable discretizations of these two formulations, we introduce two finite element methods and prove their structure-preserving properties. Numerical results are presented to show the accuracy and efficiency of the introduced methods.


title: Assessing the Impact of Sequence Length Learning on Classification Tasks for Transformer Encoder Models

abstract: Classification algorithms using Transformer architectures can be affected by the sequence length learning problem whenever observations from different classes have a different length distribution. This problem causes models to use sequence length as a predictive feature instead of relying on important textual information. Although most public datasets are not affected by this problem, privately owned corpora for fields such as medicine and insurance may carry this data bias. The exploitation of this sequence length feature poses challenges throughout the value chain as these machine learning models can be used in critical applications. In this paper, we empirically expose this problem and present approaches to minimize its impacts.


title: Beyond the light-cone propagation of relativistic wavefunctions: numerical results

abstract: It is known that relativistic wavefunctions formally propagate beyond the light cone when the propagator is limited to the positive energy sector. By construction, this is the case for solutions of the Salpeter (or relativistic Schr\"odinger) equation or for Klein-Gordon and Dirac wavefunctions defined in the Foldy-Wouthuysen representation. In this work we investigate quantitatively the degree of non-causality for free propagation for different types of wavepackets all having initially a compact spatial support. In the studied examples we find that non-causality appears as a small transient effect that can in most cases be neglected. We display several numerical results and discuss the fundamental and practical consequences of our findings concerning this peculiar dynamical feature.


title: Near-Field Wideband Channel Estimation for Extremely Large-Scale MIMO

abstract: Extremely large-scale multiple-input-multiple-output (XL-MIMO) at millimeter-wave (mmWave) and terahertz (THz) bands plays an important role in supporting extreme high beamforming gain as well as ultra-wideband spectrum resources. Unfortunately, accurate wideband XL-MIMO channel estimation suffers from the new challenge called as the near-field beam split effect. Prior works either neglect the accurate near-field channel model or fail to exploit the beam split effect, resulting in poor channel estimation accuracy for wideband XL-MIMO. To tackle this problem, this paper proposes a bilinear pattern detection (BPD) based approach to accurately recover the wideband XL-MIMO channel. Specifically, by analyzing the characteristics of near-field wideband channels, we first reveal the bilinear pattern of the near-field beam split effect, which implies that the sparse support set of near-field channels in both the angle and the distance domains can be regarded as a linear function against frequency. Then, inspired by the classical simultaneously orthogonal matching pursuit technique, we use the bilinear pattern to estimate the angle-of-arrival (AoA) and distance parameters of each near-field path component at all frequencies. In this way, the entire wideband XL-MIMO channel can be recovered by compressed sensing algorithms. Moreover, we provide the computational complexity of the proposed algorithm compared with existing algorithms. Finally, simulation results demonstrate that our scheme can achieve the accurate estimation of the near-field wideband XL-MIMO channel in the presence of near-field beam split effect.