title: Compatible Transformer for Irregularly Sampled Multivariate Time Series

abstract: To analyze multivariate time series, most previous methods assume regular subsampling of time series, where the interval between adjacent measurements and the number of samples remain unchanged. Practically, data collection systems could produce irregularly sampled time series due to sensor failures and interventions. However, existing methods designed for regularly sampled multivariate time series cannot directly handle irregularity owing to misalignment along both temporal and variate dimensions. To fill this gap, we propose Compatible Transformer (CoFormer), a transformer-based encoder to achieve comprehensive temporal-interaction feature learning for each individual sample in irregular multivariate time series. In CoFormer, we view each sample as a unique variate-time point and leverage intra-variate/inter-variate attentions to learn sample-wise temporal/interaction features based on intra-variate/inter-variate neighbors. With CoFormer as the core, we can analyze irregularly sampled multivariate time series for many downstream tasks, including classification and prediction. We conduct extensive experiments on 3 real-world datasets and validate that the proposed CoFormer significantly and consistently outperforms existing methods.


title: Robust Trading in a Generalized Lattice Market

abstract: This paper introduces a novel robust trading paradigm, called \textit{multi-double linear policies}, situated within a \textit{generalized} lattice market. Distinctively, our framework departs from most existing robust trading strategies, which are predominantly limited to single or paired assets and typically embed asset correlation within the trading strategy itself, rather than as an inherent characteristic of the market. Our generalized lattice market model incorporates both serially correlated returns and asset correlation through a conditional probabilistic model. In the nominal case, where the parameters of the model are known, we demonstrate that the proposed policies ensure survivability and probabilistic positivity. We then derive an analytic expression for the worst-case expected gain-loss and prove sufficient conditions that the proposed policies can maintain a \textit{positive expected profits}, even within a seemingly nonprofitable symmetric lattice market. When the parameters are unknown and require estimation, we show that the parameter space of the lattice model forms a convex polyhedron, and we present an efficient estimation method using a constrained least-squares method. These theoretical findings are strengthened by extensive empirical studies using data from the top 30 companies within the S\&P 500 index, substantiating the efficacy of the generalized model and the robustness of the proposed policies in sustaining the positive expected profit and providing downside risk protection.


title: Four dimensional almost complex torus manifolds

abstract: In dimension 4, we extend the correspondence between compact nonsingular toric varieties and regular fans to a correspondence between almost complex torus manifolds and families of multi-fans in a geometric way, where an (almost) complex torus manifold is a $2n$-dimensional compact connected (almost) complex manifold equipped with an effective action of a real $n$-dimensional torus $T^n$ that has fixed points. Let $M$ be a 4-dimensional almost complex torus manifold. To $M$, we associate two equivalent combinatorial objects, a family $\Delta$ of multi-fans and a graph $\Gamma$, which encode the data on the fixed point set. We find a necessary and sufficient condition for each of $\Delta$ and $\Gamma$. Moreover, we provide a minimal model and operations for each of $\Delta$ and $\Gamma$. We introduce operations on a multi-fan and a graph that correspond to blow up and down of a manifold, and show that we can blow up and down $M$ to a minimal manifold $M'$ whose weights at the fixed points are unit vectors in $\mathbb{Z}^2$, $\Delta$ to a family of minimal multi-fans that has unit vectors only, and $\Gamma$ to a minimal graph whose edges all have unit vectors as labels. As an application, if $M$ is complex, $\Delta$ is a fan and determines $M$, $\Gamma$ encodes the equivariant cohomology of $M$, and $M'$ is $\mathbb{CP}^1 \times \mathbb{CP}^1$. This implies that any two 4-dimensional complex torus manifolds are obtained from each other by equivariant blow up and down.


title: SignGT: Signed Attention-based Graph Transformer for Graph Representation Learning

abstract: The emerging graph Transformers have achieved impressive performance for graph representation learning over graph neural networks (GNNs). In this work, we regard the self-attention mechanism, the core module of graph Transformers, as a two-step aggregation operation on a fully connected graph. Due to the property of generating positive attention values, the self-attention mechanism is equal to conducting a smooth operation on all nodes, preserving the low-frequency information. However, only capturing the low-frequency information is inefficient in learning complex relations of nodes on diverse graphs, such as heterophily graphs where the high-frequency information is crucial. To this end, we propose a Signed Attention-based Graph Transformer (SignGT) to adaptively capture various frequency information from the graphs. Specifically, SignGT develops a new signed self-attention mechanism (SignSA) that produces signed attention values according to the semantic relevance of node pairs. Hence, the diverse frequency information between different node pairs could be carefully preserved. Besides, SignGT proposes a structure-aware feed-forward network (SFFN) that introduces the neighborhood bias to preserve the local topology information. In this way, SignGT could learn informative node representations from both long-range dependencies and local topology information. Extensive empirical results on both node-level and graph-level tasks indicate the superiority of SignGT against state-of-the-art graph Transformers as well as advanced GNNs.


title: Exploring Automatic Evaluation Methods based on a Decoder-based LLM for Text Generation

abstract: Automatic evaluation of text generation is essential for improving the accuracy of generation tasks. In light of the current trend towards increasingly larger decoder-based language models, we investigate automatic evaluation methods based on such models for text generation. This paper compares various methods, including tuning with encoder-based models and large language models under equal conditions, on two different tasks, machine translation evaluation and semantic textual similarity, in two languages, Japanese and English. Experimental results show that compared to the tuned encoder-based models, the tuned decoder-based models perform poorly. The analysis of the causes for this suggests that the decoder-based models focus on surface word sequences and do not capture meaning. It is also revealed that in-context learning of very large decoder-based models such as ChatGPT makes it difficult to identify fine-grained semantic differences.


title: Single-Shot, Spatio-Temporal Metrology of Relativistic Plasma Optics

abstract: Ultrahigh peak power femtosecond laser pulses create extreme states of matter that are currently being probed with great interest. Plasma optics have been proposed for shaping and amplifying high-power pulses, but they are subject to huge modulations and fluctuations due to the very nature of excitation at high intensities. Multidimensional characterization (spatial and temporal) of relativistic plasma dynamics is therefore crucial to understand the spatio-temporal structure of intense femtosecond pulses shaped by plasma optics. This is, however, extremely difficult to achieve, particularly at the low repetition rates typical at 100s terawatt to petawatt powers. Here, we present a single-shot, three-dimensional (3D) spatio-temporal and spatio-spectral measurement of such pulses based on spectral interferometry. We reconstruct the 3D temporal structure of the laser pulse simultaneously resolving the complex plasma dynamics. We demonstrate our method by measuring the sub-picosecond evolution of relativistic solid-density plasmas. Our measurements reveal that different spatial regions of the plasma surface move differently yet exhibit a collective behavior globally. This all-optical measurement technique captures 3D spatio-temporal effects within pulses with ultrahigh peak powers, all in a single shot, enabling further progress in ultrahigh-intensity laser and plasma technologies.


title: Matrix Compression via Randomized Low Rank and Low Precision Factorization

abstract: Matrices are exceptionally useful in various fields of study as they provide a convenient framework to organize and manipulate data in a structured manner. However, modern matrices can involve billions of elements, making their storage and processing quite demanding in terms of computational resources and memory usage. Although prohibitively large, such matrices are often approximately low rank. We propose an algorithm that exploits this structure to obtain a low rank decomposition of any matrix $\mathbf{A}$ as $\mathbf{A} \approx \mathbf{L}\mathbf{R}$, where $\mathbf{L}$ and $\mathbf{R}$ are the low rank factors. The total number of elements in $\mathbf{L}$ and $\mathbf{R}$ can be significantly less than that in $\mathbf{A}$. Furthermore, the entries of $\mathbf{L}$ and $\mathbf{R}$ are quantized to low precision formats $--$ compressing $\mathbf{A}$ by giving us a low rank and low precision factorization. Our algorithm first computes an approximate basis of the range space of $\mathbf{A}$ by randomly sketching its columns, followed by a quantization of the vectors constituting this basis. It then computes approximate projections of the columns of $\mathbf{A}$ onto this quantized basis. We derive upper bounds on the approximation error of our algorithm, and analyze the impact of target rank and quantization bit-budget. The tradeoff between compression ratio and approximation accuracy allows for flexibility in choosing these parameters based on specific application requirements. We empirically demonstrate the efficacy of our algorithm in image compression, nearest neighbor classification of image and text embeddings, and compressing the layers of LlaMa-$7$b. Our results illustrate that we can achieve compression ratios as aggressive as one bit per matrix coordinate, all while surpassing or maintaining the performance of traditional compression techniques.


title: Core Building Blocks: Next Gen Geo Spatial GPT Application

abstract: This paper proposes MapGPT which is a novel approach that integrates the capabilities of language models, specifically large language models (LLMs), with spatial data processing techniques. This paper introduces MapGPT, which aims to bridge the gap between natural language understanding and spatial data analysis by highlighting the relevant core building blocks. By combining the strengths of LLMs and geospatial analysis, MapGPT enables more accurate and contextually aware responses to location-based queries. The proposed methodology highlights building LLMs on spatial and textual data, utilizing tokenization and vector representations specific to spatial information. The paper also explores the challenges associated with generating spatial vector representations. Furthermore, the study discusses the potential of computational capabilities within MapGPT, allowing users to perform geospatial computations and obtain visualized outputs. Overall, this research paper presents the building blocks and methodology of MapGPT, highlighting its potential to enhance spatial data understanding and generation in natural language processing applications.


title: Primordial black holes and secondary gravitational waves from generalized power-law non-canonical inflation with quartic potential

abstract: Here, generation of PBHs and secondary GWs from non-canonical inflation with quartic potential have been probed. It is illustrated that, quartic potential in non-canonical setup with a generalized power-law Lagrangian density can source a consistent inflationary era with the latest observational data. Besides, we show that our model satisfies the swampland criteria. At the same time, defining a peaked function of inflaton field as non-canonical mass scale parameter $M(\phi)$ of the Lagrangian, gives rise to slow down the inflaton in a while. In this span, namely Ultra-Slow-Roll (USR) stage, the amplitude of the curvature perturbations on small scales enlarges versus CMB scales. It has been illustrated that, further to the peaked aspect of the chosen non-canonical mass scale parameter, the amount of $\alpha$ parameter of the Lagrangian has enlarging impact on the amplitude of the scalar perturbations. As a consequence of adjusting three parameter Cases of this model, three Cases of PBHs in proper mass scopes to explain LIGO-VIRGO events, microlensing events in OGLE data and DM content in its totality, could be produced. In the end, power-law behavior of the current density parameter of gravitational waves $\Omega_{\rm GW_0}$ in terms of frequency has been examined. Also, the logarithmic power index as $n=3-2/\ln(f_c/f)$ in the infrared regime is obtained.


title: Domain Generalization Using Large Pretrained Models with Mixture-of-Adapters

abstract: Learning a robust vision model despite large distribution shift is essential for model deployment in real-world settings. Especially, domain generalization (DG) algorithm aims to maintain the performance of a trained model on different distributions which were not seen during training. One of the most effective methods has been leveraging the already learned rich knowledge of large pretrained models. However, naively fine-tuning large models to DG tasks is often practically infeasible due to memory limitations, extensive time requirements for training, and the risk of learned knowledge deterioration. Recently, parameter-efficient fine-tuning (PEFT) methods have been proposed to reduce the high computational cost during training and efficiently adapt large models to downstream tasks. In this work, for the first time, we find that the use of adapters in PEFT methods not only reduce high computational cost during training but also serve as an effective regularizer for DG tasks. Surprisingly, a naive adapter implementation for large models achieve superior performance on common datasets. However, in situations of large distribution shifts, additional factors such as optimal amount of regularization due to the strength of distribution shifts should be considered for a sophisticated adapter implementation. To address this, we propose a mixture-of-expert based adapter fine-tuning method, dubbed as mixture-of-adapters (MoA). Specifically, we employ multiple adapters that have varying capacities, and by using learnable routers, we allocate each token to a proper adapter. By using both PEFT and MoA methods, we effectively alleviate the performance deterioration caused by distribution shifts and achieve state-of-the-art performance on diverse DG benchmarks.


title: The Virtual Spectrum of Linkoids and Open Curves in 3-space

abstract: The entanglement of open curves in 3-space appears in many physical systems and affects their material properties and function. A new framework in knot theory was introduced recently, that enables to characterize the complexity of collections of open curves in 3-space using the theory of knotoids and linkoids, which are equivalence classes of diagrams with open arcs. In this paper, new invariants of linkoids are introduced via a surjective map between linkoids and virtual knots. This leads to a new collection of strong invariants of linkoids that are independent of any given virtual closure. This gives rise to a collection of novel measures of entanglement of open curves in 3-space, which are continuous functions of the curve coordinates and tend to their corresponding classical invariants when the endpoints of the curves tend to coincide.


title: Slicenet: a Simple and Scalable Flow-Level Simulator for Network Slice Provisioning and Management

abstract: Network slicing plays a crucial role in the progression of 5G and beyond, facilitating dedicated logical networks to meet diverse and specific service requirements. The principle of End-to-End (E2E) slice includes not only a service chain of physical or virtual functions for the radio and core of 5G/6G networks but also the full path to the application servers that might be running at some edge computing or at central cloud. Nonetheless, the development and optimization of E2E network slice management systems necessitate a reliable simulation tool for evaluating different aspects at large-scale network topologies such as resource allocation and function placement models. This paper introduces Slicenet, a mininetlike simulator crafted for E2E network slicing experimentation at the flow level. Slicenet aims at facilitating the investigation of a wide range of slice optimization techniques, delivering measurable, reproducible results without the need for physical resources or complex integration tools. It provides a well-defined process for conducting experiments, which includes the creation and implementation of policies for various components such as edge and central cloud resources, network functions of multiple slices of different characteristics. Furthermore, Slicenet effortlessly produces meaningful visualizations from simulation results, aiding in comprehensive understanding. Utilizing Slicenet, service providers can derive invaluable insights into resource optimization, capacity planning, Quality of Service (QoS) assessment, cost optimization, performance comparison, risk mitigation, and Service Level Agreement (SLA) compliance, thereby fortifying network resource management and slice orchestration.


title: Primordial non-Gaussianity as a saviour for PBH overproduction in SIGWs generated by Pulsar Timing Arrays for Galileon inflation

abstract: We investigate the explicit role of negative local non-Gaussianity, $f_{\rm NL}$, in suppressing the abundance of primordial black holes (PBHs) in the single-field model of Galileon inflation. PBH formation requires significantly enhancing the scalar power spectrum, which greatly affects their abundance. The associated frequencies in the nHz regime are also sensitive to the generation of scalar-induced gravitational waves (SIGWs) which may explain the current data from the pulsar timing arrays (PTAs). Our analysis using the threshold statistics on the compaction function demonstrates that Galileon theory not only avoids PBH overproduction using the curvature perturbation enhancements that give $f_{\rm NL} \sim {\cal O}(-6)$, but also generates SIGWs that conform well with the PTA data.


title: Lyricist-Singer Entropy Affects Lyric-Lyricist Classification Performance

abstract: Although lyrics represent an essential component of music, few music information processing studies have been conducted on the characteristics of lyricists. Because these characteristics may be valuable for musical applications, such as recommendations, they warrant further study. We considered a potential method that extracts features representing the characteristics of lyricists from lyrics. Because these features must be identified prior to extraction, we focused on lyricists with easily identifiable features. We believe that it is desirable for singers to perform unique songs that share certain characteristics specific to the singer. Accordingly, we hypothesized that lyricists account for the unique characteristics of the singers they write lyrics for. In other words, lyric-lyricist classification performance or the ease of capturing the features of a lyricist from the lyrics may depend on the variety of singers. In this study, we observed a relationship between lyricist-singer entropy or the variety of singers associated with a single lyricist and lyric-lyricist classification performance. As an example, the lyricist-singer entropy is minimal when the lyricist writes lyrics for only one singer. In our experiments, we grouped lyricists among five groups in terms of lyricist-singer entropy and assessed the lyric-lyricist classification performance within each group. Consequently, the best F1 score was obtained for the group with the lowest lyricist-singer entropy. Our results suggest that further analyses of the features contributing to lyric-lyricist classification performance on the lowest lyricist-singer entropy group may improve the feature extraction task for lyricists.


title: Radio Map Estimation: Empirical Validation and Analysis

abstract: Radio maps quantify magnitudes such as the received signal strength at every location of a geographical region. Although the estimation of radio maps has attracted widespread interest, the vast majority of works rely on simulated data and, therefore, cannot establish the effectiveness and relative performance of existing algorithms in practice. To fill this gap, this paper presents the first comprehensive and rigorous study of radio map estimation (RME) in the real world. The main features of the RME problem are analyzed and the capabilities of existing estimators are compared using large measurement datasets collected in this work. By studying four performance metrics, recent theoretical findings are empirically corroborated and a large number of conclusions are drawn. Remarkably, the estimation error is seen to be reasonably small even with few measurements, which establishes the viability of RME in practice. Besides, from extensive comparisons, it is concluded that estimators based on deep neural networks necessitate large volumes of training data to exhibit a significant advantage over more traditional methods. Combining both types of schemes is seen to result in a novel estimator that features the best performance in most situations. The acquired datasets are made publicly available to enable further studies.


title: Sampling for Remote Estimation of the Wiener Process over an Unreliable Channel

abstract: In this paper, we study a sampling problem where a source takes samples from a Wiener process and transmits them through a wireless channel to a remote estimator. Due to channel fading, interference, and potential collisions, the packet transmissions are unreliable and could take random time durations. Our objective is to devise an optimal causal sampling policy that minimizes the long-term average mean square estimation error. This optimal sampling problem is a recursive optimal stopping problem, which is generally quite difficult to solve. However, we prove that the optimal sampling strategy is, in fact, a simple threshold policy where a new sample is taken whenever the instantaneous estimation error exceeds a threshold. This threshold remains a constant value that does not vary over time. By exploring the structure properties of the recursive optimal stopping problem, a low-complexity iterative algorithm is developed to compute the optimal threshold. This work generalizes previous research by incorporating both transmission errors and random transmission times into remote estimation. Numerical simulations are provided to compare our optimal policy with the zero-wait and age-optimal policies.


title: Channel Autocorrelation Estimation for IRS-Aided Wireless Communications Based on Power Measurements

abstract: Intelligent reflecting surface (IRS) can bring significant performance enhancement for wireless communication systems by reconfiguring wireless channels via passive signal reflection. However, such performance improvement generally relies on the knowledge of channel state information (CSI) for IRS-associated links. Prior IRS channel estimation strategies mainly estimate IRS-cascaded channels based on the excessive pilot signals received at the users/base station (BS) with time-varying IRS reflections, which, however, are not compatible with the existing channel training/estimation protocol for cellular networks. To address this issue, we propose in this paper a new channel estimation scheme for IRS-assisted communication systems based on the received signal power measured at the user, which is practically attainable without the need of changing the current protocol. Specifically, due to the lack of signal phase information in power measurements, the autocorrelation matrix of the BS-IRS-user cascaded channel is estimated by solving equivalent matrix-rank-minimization problems. Simulation results are provided to verify the effectiveness of the proposed channel estimation algorithm as well as the IRS passive reflection design based on the estimated channel autocorrelation matrix.


title: The optical appearance of a nonsingular de Sitter core black hole geometry under several thin disk emissions

abstract: We consider the optical appearance under a thin accretion disk of a regular black hole with a central de Sitter core implementing $\mathcal{O}(l^2/r^2)$ far-corrections to the Schwarzschild black hole. We use the choice $l=0.25M$, which satisfies recently found constraints from the motion of the S2 star around Sgr A$^*$ in this model, and which leads to thermodynamically stable black holes. As the emission model, we suitably adapt ten samples of the Standard Unbound emission profile for a monochromatic intensity in the disk's frame, which have been previously employed in the literature within the context of reproducing General Relativistic Magneto-Hydrodynamic simulations of the accretion flow. We find the usual central brightness depression surrounded by the bright ring cast by the disk's direct emission as well as two non-negligible photon ring contributions. As compared to the usual Schwarzschild solution, the relative luminosities of the latter are significantly boosted, while the size of the former is strongly decreased. We discuss the entanglement of the background geometry and the choice of emission model in generating these black hole images, as well as the capability of these modifications of Schwarzschild solution to pass present and future tests based on their optical appearance when illuminated by an accretion disk.


title: Co-Learning Semantic-aware Unsupervised Segmentation for Pathological Image Registration

abstract: The registration of pathological images plays an important role in medical applications. Despite its significance, most researchers in this field primarily focus on the registration of normal tissue into normal tissue. The negative impact of focal tissue, such as the loss of spatial correspondence information and the abnormal distortion of tissue, are rarely considered. In this paper, we propose GIRNet, a novel unsupervised approach for pathological image registration by incorporating segmentation and inpainting through the principles of Generation, Inpainting, and Registration (GIR). The registration, segmentation, and inpainting modules are trained simultaneously in a co-learning manner so that the segmentation of the focal area and the registration of inpainted pairs can improve collaboratively. Overall, the registration of pathological images is achieved in a completely unsupervised learning framework. Experimental results on multiple datasets, including Magnetic Resonance Imaging (MRI) of T1 sequences, demonstrate the efficacy of our proposed method. Our results show that our method can accurately achieve the registration of pathological images and identify lesions even in challenging imaging modalities. Our unsupervised approach offers a promising solution for the efficient and cost-effective registration of pathological images. Our code is available at https://github.com/brain-intelligence-lab/GIRNet.


title: Weak-field regime of scalar-tensor theories with an instantaneous mode

abstract: Higher-order scalar-tensor theories having an instantaneous mode do not develop the Ostrogradsky instability even if a seemingly dangerous mode is present. Such theories satisfy only partially the degeneracy conditions that are usually imposed to remove the dangerous mode completely, and are dubbed as U-DHOST theories. We study weak gravitational fields sourced by nonrelativistic matter distributions in U-DHOST theories. In contrast to the case of totally degenerate theories where nonlinear derivative interactions are crucial for exhibiting the Vainshtein mechanism and its partial breaking, we show that in generic U-DHOST theories the linear analysis is sufficient for weak gravitational fields. We identify the subset of U-DHOST theories in which solar system tests are evaded and gravitational waves propagate at the speed of light. Such theories can however be tested with cosmological observations. We also point out that there is a particular case of U-DHOST theories where nonlinear derivative interactions play an important role as in totally degenerate theories. In that case, it is found, however, that the Vainshtein mechanism does not operate and gravitational forces are modified.


title: Diagrammatic Modelling of Causality and Causal Relations

abstract: It has been stated that the notion of cause and effect is one object of study that sciences and engineering revolve around. Lately, in software engineering, diagrammatic causal inference methods (e.g., Pearl s model) have gained popularity (e.g., analyzing causes and effects of change in software requirement development). This paper concerns diagrammatical (graphic) models of causal relationships. Specifically, we experiment with using the conceptual language of thinging machines (TMs) as a tool in this context. This would benefit works on causal relationships in requirements engineering, enhance our understanding of the TM modeling, and contribute to the study of the philosophical notion of causality. To specify the causality in a system s description is to constrain the system s behavior and thus exclude some possible chronologies of events. The notion of causality has been studied based on tools to express causal questions in diagrammatic and algebraic forms. Causal models deploy diagrammatic models, structural equations, and counterfactual and interventional logic. Diagrammatic models serve as a language for representing what we know about the world. The research methodology in the paper focuses on converting causal graphs into TM models and contrasts the two types of representation. The results show that the TM depiction of causality is more complete and therefore can provide a foundation for causal graphs.


title: Spoofing Attack Detection in the Physical Layer with Robustness to User Movement

abstract: In a spoofing attack, an attacker impersonates a legitimate user to access or modify data belonging to the latter. Typical approaches for spoofing detection in the physical layer declare an attack when a change is observed in certain channel features, such as the received signal strength (RSS) measured by spatially distributed receivers. However, since channels change over time, for example due to user movement, such approaches are impractical. To sidestep this limitation, this paper proposes a scheme that combines the decisions of a position-change detector based on a deep neural network to distinguish spoofing from movement. Building upon community detection on graphs, the sequence of received frames is partitioned into subsequences to detect concurrent transmissions from distinct locations. The scheme can be easily deployed in practice since it just involves collecting a small dataset of measurements at a few tens of locations that need not even be computed or recorded. The scheme is evaluated on real data collected for this purpose.


title: A Tutorial on Near-Field XL-MIMO Communications Towards 6G

abstract: Extremely large-scale multiple-input multiple-output (XL-MIMO) is a promising technology for the sixth-generation (6G) mobile communication networks. By significantly boosting the antenna number or size to at least an order of magnitude beyond current massive MIMO systems, XL-MIMO is expected to unprecedentedly enhance the spectral efficiency and spatial resolution for wireless communication. The evolution from massive MIMO to XL-MIMO is not simply an increase in the array size, but faces new design challenges, in terms of near-field channel modelling, performance analysis, channel estimation, and practical implementation. In this article, we give a comprehensive tutorial overview on near-field XL-MIMO communications, aiming to provide useful guidance for tackling the above challenges. First, the basic near-field modelling for XL-MIMO is established, by considering the new characteristics of non-uniform spherical wave (NUSW) and spatial non-stationarity. Next, based on the near-field modelling, the performance analysis of XL-MIMO is presented, including the near-field signal-to-noise ratio (SNR) scaling laws, beam focusing pattern, achievable rate, and degrees-of-freedom (DoF). Furthermore, various XL-MIMO design issues such as near-field beam codebook, beam training, channel estimation, and delay alignment modulation (DAM) transmission are elaborated. Finally, we point out promising directions to inspire future research on near-field XL-MIMO communications.


title: A microlocal Feigin-Tsygan-Preygel theorem

abstract: Let $\boldsymbol{Z}$ be a derived global complete intersection over $\mathbb{C}$. We compute the periodic cyclic homology of the category of ind-coherent sheaves with prescribed singular support on $\boldsymbol{Z}$ in terms of the microlocal homology, a family of chain theories living between cohomology and Borel-Moore homology. Our result is a microlocal generalization of both the Feigin-Tsygan theorem identifying $\mathrm{HP}_{\bullet}^{\mathbb{C}}(\mathsf{QCoh}(\boldsymbol{Z}))$ with the $2$-periodized cohomology of $\boldsymbol{Z}$ and A. Preygel's theorem identifying $\mathrm{HP}_{\bullet}^{\mathbb{C}}(\mathsf{IndCoh}(\boldsymbol{Z}))$ with the $2$-periodized Borel-Moore homology of $\boldsymbol{Z}$. Our proof strategy makes extensive use of categories of matrix factorizations, which we treat using Preygel's formalism. This paper contains generalizations of several known results in the subject which we prove in this formalism, and which may be of independent interest to the reader.


title: Fast Graph Condensation with Structure-based Neural Tangent Kernel

abstract: The rapid development of Internet technology has given rise to a vast amount of graph-structured data. Graph Neural Networks (GNNs), as an effective method for various graph mining tasks, incurs substantial computational resource costs when dealing with large-scale graph data. A data-centric manner solution is proposed to condense the large graph dataset into a smaller one without sacrificing the predictive performance of GNNs. However, existing efforts condense graph-structured data through a computational intensive bi-level optimization architecture also suffer from massive computation costs. In this paper, we propose reforming the graph condensation problem as a Kernel Ridge Regression (KRR) task instead of iteratively training GNNs in the inner loop of bi-level optimization. More specifically, We propose a novel dataset condensation framework (GC-SNTK) for graph-structured data, where a Structure-based Neural Tangent Kernel (SNTK) is developed to capture the topology of graph and serves as the kernel function in KRR paradigm. Comprehensive experiments demonstrate the effectiveness of our proposed model in accelerating graph condensation while maintaining high prediction performance. The source code is available on https://github.com/WANGLin0126/GCSNTK.


title: The Impact of Gamified Auditory-Verbal Training for Hearing-Challenged Children at Intermediate and Advanced Rehabilitation Stages

abstract: Auditory-verbal training is essential for children with hearing challenges, and the gamification approach has become a promising direction for improving the rehabilitation experience and effect. However, the specific influence of the gamified training approach on participants at different rehabilitation stages has not been empirically studied. This paper is thusly intended to investigate the research questions: Do the training performances of children at advanced rehabilitation stage differ before and after using the gamified training system? Do the training performances of children at intermediate rehabilitation stage differ before and after using the gamified training system? Do children enjoy the gamified training approach? For the purpose, a digital gamified auditory-verbal training system was originally developed, and a series of user experiments were organized. Particularly, 31 hearing-challenged children aging between three-six years old at an auditory-verbal rehabilitation center were recruited to take the training, and six professional therapists were also invited to assist with the experiments and attend the interviews. Based on the training performance observation and interviews with participants, their parents and the therapists, it can be found that generally the gamified training approach can effectively facilitate the training experience, and help with the basic auditory memory and expression capabilities. Regarding the specific influence, the gamified way can better improve the basic auditory-verbal performance of children at the intermediate stage, since they focus more on the ease of learning and adaption to the training system. These findings and conclusions can provide insights for the further exploration and application of the gamification approach in children's auditory-verbal rehabilitation.


title: Understanding Contrastive Learning via Distributionally Robust Optimization

abstract: This study reveals the inherent tolerance of contrastive learning (CL) towards sampling bias, wherein negative samples may encompass similar semantics (\eg labels). However, existing theories fall short in providing explanations for this phenomenon. We bridge this research gap by analyzing CL through the lens of distributionally robust optimization (DRO), yielding several key insights: (1) CL essentially conducts DRO over the negative sampling distribution, thus enabling robust performance across a variety of potential distributions and demonstrating robustness to sampling bias; (2) The design of the temperature $\tau$ is not merely heuristic but acts as a Lagrange Coefficient, regulating the size of the potential distribution set; (3) A theoretical connection is established between DRO and mutual information, thus presenting fresh evidence for ``InfoNCE as an estimate of MI'' and a new estimation approach for $\phi$-divergence-based generalized mutual information. We also identify CL's potential shortcomings, including over-conservatism and sensitivity to outliers, and introduce a novel Adjusted InfoNCE loss (ADNCE) to mitigate these issues. It refines potential distribution, improving performance and accelerating convergence. Extensive experiments on various domains (image, sentence, and graphs) validate the effectiveness of the proposal. The code is available at \url{https://github.com/junkangwu/ADNCE}.


title: Nonet at SemEval-2023 Task 6: Methodologies for Legal Evaluation

abstract: This paper describes our submission to the SemEval-2023 for Task 6 on LegalEval: Understanding Legal Texts. Our submission concentrated on three subtasks: Legal Named Entity Recognition (L-NER) for Task-B, Legal Judgment Prediction (LJP) for Task-C1, and Court Judgment Prediction with Explanation (CJPE) for Task-C2. We conducted various experiments on these subtasks and presented the results in detail, including data statistics and methodology. It is worth noting that legal tasks, such as those tackled in this research, have been gaining importance due to the increasing need to automate legal analysis and support. Our team obtained competitive rankings of 15$^{th}$, 11$^{th}$, and 1$^{st}$ in Task-B, Task-C1, and Task-C2, respectively, as reported on the leaderboard.


title: $k$-$t$ CLAIR: Self-Consistency Guided Multi-Prior Learning for Dynamic Parallel MR Image Reconstruction

abstract: Cardiac magnetic resonance imaging (CMR) has been widely used in clinical practice for the medical diagnosis of cardiac diseases. However, the long acquisition time hinders its development in real-time applications. Here, we propose a novel self-consistency guided multi-prior learning framework named $k$-$t$ CLAIR to exploit spatiotemporal correlations from highly undersampled data for accelerated dynamic parallel MRI reconstruction. The $k$-$t$ CLAIR progressively reconstructs faithful images by leveraging multiple complementary priors learned in the $x$-$t$, $x$-$f$, and $k$-$t$ domains in an iterative fashion, as dynamic MRI exhibits high spatiotemporal redundancy. Additionally, $k$-$t$ CLAIR incorporates calibration information for prior learning, resulting in a more consistent reconstruction. Experimental results on cardiac cine and T1W/T2W images demonstrate that $k$-$t$ CLAIR achieves high-quality dynamic MR reconstruction in terms of both quantitative and qualitative performance.


title: Electromagnetic properties of copper doped lead apatite Pb9Cu(PO4)6O

abstract: We report on the structural, electrical and magnetic measurements in as-grown polycrystalline samples of Pb10-xCux(PO4)6O. This compound has been recently reported to be a room temperature superconductor. Our as-grown specimen has excellent XRD matching with the original submission of Lee et al. This sample has 1.5% of Cu2S as an impurity phase. A resistive transition around 380 K, possibly corresponding to structural transitions of Cu2S, is observed. No evidence of superconducting to normal state transitions in I-V characteristics at room temperature is obtained. Magnetization measurements show linear diamagnetic behavior that cannot be associated to the superconducting state. Hall measurements provide evidence of hole doping through Cu substitution. In summary, we find no evidence for room temperature ambient pressure superconductivity in Cu doped lead apatite Pb9Cu(PO4)6O.


title: Investigating Threats Posed by SMS Origin Spoofing to IoT Devices

abstract: The short message service (SMS) is a service for exchanging texts via mobile networks that has been developed not only as a means of text communication between subscribers but also as a means to remotely manage Internet of Things (IoT) devices. However, the originating number of an SMS can be spoofed. If IoT devices authenticate administrators based on the originating number of an SMS, the authentication is bypassed via SMS origin spoofing. Consequently, IoT devices are at risk of accepting commands from attackers and performing unauthorized actions. Accordingly, in this study, the specifications of major cellular IoT gateways were evaluated by focusing on remote management via SMS, and the authentication bypass hypothesis was verified. The results showed that 25 of the 32 targeted products supported SMS-based remote management, and 20 implemented authentication based on the originating number of the SMS. Furthermore, by spoofing the originating number of the SMS, one product was demonstrated to be remotely exploitable through authentication bypassing. Thus, this study revealed the threats posed by SMS origin spoofing to IoT devices and proved that SMS origin spoofing not only threatens text communication between people but also puts machine communication at risk.


title: Denevil: Towards Deciphering and Navigating the Ethical Values of Large Language Models via Instruction Learning

abstract: Large Language Models (LLMs) have made unprecedented breakthroughs, yet their increasing integration into everyday life might raise societal risks due to generated unethical content. Despite extensive study on specific issues like bias, the intrinsic values of LLMs remain largely unexplored from a moral philosophy perspective. This work delves into ethical values utilizing Moral Foundation Theory. Moving beyond conventional discriminative evaluations with poor reliability, we propose DeNEVIL, a novel prompt generation algorithm tailored to dynamically exploit LLMs' value vulnerabilities and elicit the violation of ethics in a generative manner, revealing their underlying value inclinations. On such a basis, we construct MoralPrompt, a high-quality dataset comprising 2,397 prompts covering 500+ value principles, and then benchmark the intrinsic values across a spectrum of LLMs. We discovered that most models are essentially misaligned, necessitating further ethical value alignment. In response, we develop VILMO, an in-context alignment method that substantially enhances the value compliance of LLM outputs by learning to generate appropriate value instructions, outperforming existing competitors. Our methods are suitable for black-box and open-source models, offering a promising initial step in studying the ethical values of LLMs.


title: Electric traversable wormhole supported by a charged scalar field

abstract: Solving the Einstein-Klein-Gordon-Maxwell system, we construct and analyze the properties of an electrically charged wormhole, formed from a complex, massive scalar field, with self-interaction, and endowed with an electric charge. The scalar field is minimally coupled to the gravitational and the Maxwell field. Covering regions of the value of the different parameters of such wormhole, we present the dependence of the form of the solution with respect to the value of the different parameters, emphasising the role played by the charge in the configurations; we focus on the region for large values of the self-interaction parameter and found a generic behavior of the scalar field, which in turn allows us to determine explicit analytic expressions for the fields, the metric function and the global quantities such as the Komar mass and the particle number. The motion of charges in these spacetimes is also reported.


title: Revisiting Renormalization Group Equations of the SMEFT Dimension-Seven Operators

abstract: In this work, we revisit the renormalization group equations (RGEs) of dimension-seven (dim-7) operators in the Standard Model effective field theory (SMEFT) resulting from mixing among dim-7 operators themselves by means of the background field method. Adopting a recently proposed physical basis for dim-7 operators, we achieve the explicit RGEs of all non-redundant dim-7 operators in the SMEFT for the first time. Together with those originating from the dim-5 and dim-6 operators, these results constitute the complete RGEs of dim-7 operators, and hence can be exploited to study full RG-running effects on some lepton- or baryon-number-violating processes involving dim-7 operators in the SMEFT, such as neutrino masses, neutrinoless double beta decay, meson and nucleon decays. We perform an analysis of the structure and perturbative power counting of the obtained one-loop anomalous dimension matrix, which is consistent with a non-renormalization theorem and the naive dimension analysis. Additionally, a partial check on some results is carried out by means of different tools and quantum field gauges.


title: Nondegeneracy of positive solutions for a biharmonic hartree equation and its applications

abstract: In this paper, we are interested in some problems related to the following biharmonic hartree equation \begin{equation*} \Delta^{2} u=(|x|^{-\alpha}\ast |u|^{p})u^{p-1},\sp \text{in}\quad\R^N. \end{equation*} where $p=\frac{2N-\alpha}{N-4}$, $N\geq 9$ and $0<\alpha<N$. First, by using the spherical harmonic decomposition and the Funk-Heck formula of the spherical harmonic functions, we prove the nondegeneracy of the positive solutions of the above biharmonic equation. As applications, we investigate the stability of a version of nonlocal Sobolev inequality \begin{equation} \int_{\R^N}|\Delta u|^{2} \geq S^{*}\left( \int_{\R^N}\Big(|x|^{-\alpha}\ast |u|^{p}\Big)u^{p} dx\right)^{\frac{1}{p}}, \end{equation} and give a gradient form remainder. Moreover, by applying a finite dimension reduction and local Poho$\check{z}$aev identity, we can also construct multi-bubble solutions for the following equation with potential \begin{equation*} \Delta^2 u+V(|x'|, x'')u =\Big(|x|^{-\alpha}\ast |u|^{p}\Big)u^{p-1}\hspace{4.14mm}x\in \mathbb{R}^N. \end{equation*} where $N\geq9$, $(x',x'')\in \mathbb{R}^2\times\mathbb{R}^{N-2}$ and $V(|x'|, x'')$ is a bounded and nonnegative function. We will show what is the role fo the dimension and the order of the Riesz potential in proving the existence result. In fact, the existence result is restricted to the range $6-\frac{12}{N-4}\leq\alpha<N$.


title: Mutations of noncommutative crepant resolutions in geometric invariant theory

abstract: Let $X$ be a generic quasi-symmetric representation of a connected reductive group $G$. The GIT quotient stack $\mathfrak{X}=[X^{\rm ss}(\ell)/G]$ with respect to a generic $\ell$ is a (stacky) crepant resolution of the affine quotient $X/G$, and it is derived equivalent to a noncommutative crepant resolution (=NCCR) of $X/G$. Halpern-Leistner and Sam showed that the derived category $\mathrm{D}^b(\mathrm{coh}~\mathfrak{X})$ is equivalent to certain subcategories of $\mathrm{D}^b(\mathrm{coh}~[X/G])$, which are called magic windows. This paper studies equivalences between magic windows that correspond to wall-crossings in a hyperplane arrangement in terms of NCCRs. We show that those equivalences coincide with derived equivalences between NCCRs induced by tilting modules, and that those tilting modules are obtained by certain operations of modules, which is called exchanges of modules. When $G$ is a torus, it turns out that the exchanges are nothing but iterated Iyama--Wemyss mutations. Although we mainly discuss resolutions of affine varieties, our theorems also yield a result for projective Calabi-Yau varieties. Using techniques from the theory of noncommutative matrix factorizations, we show that Iyama--Wemyss mutations induce a group action of the fundamental group $\pi_1(\mathbb{P}^1 \backslash\{0,1,\infty\})$ on the derived category of a Calabi-Yau complete intersection in a weighted projective space.


title: Benchmarking the accuracy of the separable resolution of the identity approach for correlated methods in the numeric atom-centered orbitals framework

abstract: Four-center two-electron Coulomb integrals routinely appear in electronic structure algorithms. The resolution-of-the-identity (RI) is a popular technique to reduce the computational cost for the numerical evaluation of these integrals in localized basis-sets codes. Recently, Duchemin and Blase proposed a separable RI scheme [J. Chem. Phys. 150, 174120 (2019)], which preserves the accuracy of the standard global RI method with the Coulomb metric (RI-V) and permits the formulation of cubic-scaling random phase approximation (RPA) and $GW$ approaches. Here, we present the implementation of a separable RI scheme within an all-electron numeric atom-centered orbital framework. We present comprehensive benchmark results using the Thiel and the GW100 test set. Our benchmarks include atomization energies from Hartree-Fock, second-order M{\o}ller-Plesset (MP2), coupled-cluster singles and doubles, RPA and renormalized second-order perturbation theory as well as quasiparticle energies from $GW$. We found that the separable RI approach reproduces RI-free HF calculations within 9 meV and MP2 calculations within 1 meV. We have confirmed that the separable RI error is independent of the system size by including disordered carbon clusters up to 116 atoms in our benchmarks


title: Causal Feature Selection via Transfer Entropy

abstract: Machine learning algorithms are designed to capture complex relationships between features. In this context, the high dimensionality of data often results in poor model performance, with the risk of overfitting. Feature selection, the process of selecting a subset of relevant and non-redundant features, is, therefore, an essential step to mitigate these issues. However, classical feature selection approaches do not inspect the causal relationship between selected features and target, which can lead to misleading results in real-world applications. Causal discovery, instead, aims to identify causal relationships between features with observational data. In this paper, we propose a novel methodology at the intersection between feature selection and causal discovery, focusing on time series. We introduce a new causal feature selection approach that relies on the forward and backward feature selection procedures and leverages transfer entropy to estimate the causal flow of information from the features to the target in time series. Our approach enables the selection of features not only in terms of mere model performance but also captures the causal information flow. In this context, we provide theoretical guarantees on the regression and classification errors for both the exact and the finite-sample cases. Finally, we present numerical validations on synthetic and real-world regression problems, showing results competitive w.r.t. the considered baselines.


title: Locally Differentially Private Graph Embedding

abstract: Graph embedding has been demonstrated to be a powerful tool for learning latent representations for nodes in a graph. However, despite its superior performance in various graph-based machine learning tasks, learning over graphs can raise significant privacy concerns when graph data involves sensitive information. To address this, in this paper, we investigate the problem of developing graph embedding algorithms that satisfy local differential privacy (LDP). We propose LDP-GE, a novel privacy-preserving graph embedding framework, to protect the privacy of node data. Specifically, we propose an LDP mechanism to obfuscate node data and adopt personalized PageRank as the proximity measure to learn node representations. Then, we theoretically analyze the privacy guarantees and utility of the LDP-GE framework. Extensive experiments conducted over several real-world graph datasets demonstrate that LDP-GE achieves favorable privacy-utility trade-offs and significantly outperforms existing approaches in both node classification and link prediction tasks.


title: Tur\'{a}n problem for $C_{2k+1}^{-}$-free signed graph

abstract: In this paper, we study the Tur\'{a}n problem for $C_{2k+1}^{-}$. Suppose that $\dot{G}$ is an unbalanced signed graph of order $n$ with $e(\dot{G})$ edges. Let $\lambda_{1} (\dot{G})$ be the largest eigenvalue of $\dot{G}$, and $C_{2k+1}^{-}$ be the set of the negative cycle with length $2k+1$($3 \le k \le \frac{n}{15}$). We prove that if $\dot{G}$ is a $C_{2k+1}^{-}$-free unbalanced signed graph, then $e(\dot{G}) \le e(C_{3}^{-} \cdot K_{n-2})$ and $\lambda_{1}(\dot{G}) \le \lambda_{1}(C_{3}^{-} \cdot K_{n-2})$, with equality holding if and only if $\dot{G}$ is switching equivalent to $C_{3}^{-} \cdot K_{n-2}$.


title: NP-RDMA: Using Commodity RDMA without Pinning Memory

abstract: Remote Direct Memory Access (RDMA) has been haunted by the need of pinning down memory regions. Pinning limits the memory utilization because it impedes on-demand paging and swapping. It also increases the initialization latency of large memory applications from seconds to minutes. To remove memory pining, existing approaches often require special hardware which supports page fault, and still have inferior performance. We propose NP-RDMA, which removes memory pinning during memory registration and enables dynamic page fault handling with commodity RDMA NICs. NP-RDMA does not require NICs to support page fault. Instead, by monitoring local memory paging and swapping with MMU-notifier, combining with IOMMU/SMMU-based address mapping, NP-RDMA efficiently detects and handles page fault in the software with near-zero additional latency to non-page-fault RDMA verbs. We implement an LD_PRELOAD library (with a modified kernel module), which is fully compatible with existing RDMA applications. Experiments show that NP-RDMA adds only 0.1{\sim}2 {\mu}s latency under non-page-fault scenarios. Moreover, NP-RDMA adds only 3.5{\sim}5.7 {\mu}s and 60 {\mu}s under minor or major page faults, respectively, which is 500x faster than ODP which uses advanced NICs that support page fault. With non-pinned memory, Spark initialization is 20x faster and the physical memory usage reduces by 86% with only 5.4% slowdown. Enterprise storage can expand to 5x capacity with SSDs while the average latency is only 10% higher. To the best of our knowledge, NP-RDMA is the first efficient and application-transparent software approach to remove memory pinning using commodity RDMA NICs.


title: An Overview of Current and Emerging Biomaterials Technology for Continuous Glucose Monitoring (CGM) Devices -- Current state and future perspectives of the leading technologies

abstract: In the world today, diabetic complications are a major factor in the disease's high mortality rate. Diabetes mellitus has been a major source of concern for decades due to its global prevalence and the resulting rising costs to individuals, governments, and healthcare systems on both a social and economic level. The complex interplay between nutrition, exercise, stress, medicine, sickness, and hormonal changes makes controlling diabetes difficult. Even though there is currently no cure for diabetes, the condition may be managed with careful attention to blood glucose levels and the use of appropriate medications. Blood sugar levels should be monitored on a regular basis, which requires a glucometer and a fingertip and is becoming the standard in diabetes control technologies. For the convenience of diabetic patients, the use of a CGM device for monitoring glucose levels has become the preferred method. For diabetes therapy at the point of care, replacing finger-prick glucometers can be done anywhere they are currently on the market. As a result, it has sparked a lot of interest in a variety of glucose sensing mechanisms, particularly non-invasive or marginally glucose sensing mechanisms that focus on subcutaneously implantable electrochemical sugar sensors that work more reliably and last longer.


title: On currents in the $O(n)$ loop model

abstract: Using methods from the conformal bootstrap, we study the properties of Noether currents in the critical $O(n)$ loop model. We confirm that they do not give rise to a Kac-Moody algebra (for $n\neq 2$), a result expected from the underlying lack of unitarity. By studying four-point functions in detail, we fully determine the current-current OPEs, and thus obtain several structure constants with physical meaning. We find in particular that the terms $:\!J\bar{J}\!:$ in the identity and adjoint channels vanish exactly, invalidating the argument made in \cite{car93-1} that adding orientation-dependent interactions to the model should lead to continuously varying exponents in self-avoiding walks. We also determine the residue of the identity channel in the $JJ$ two-point function, finding that it coincides both with the result of a transfer-matrix computation for an orientation-dependent correlation function in the lattice model, and with an earlier Coulomb gas computation of Cardy \cite{car93}. This is, to our knowledge, one of the first instances where the Coulomb gas formalism and the bootstrap can be successfully compared.


title: Resampling Stochastic Gradient Descent Cheaply for Efficient Uncertainty Quantification

abstract: Stochastic gradient descent (SGD) or stochastic approximation has been widely used in model training and stochastic optimization. While there is a huge literature on analyzing its convergence, inference on the obtained solutions from SGD has only been recently studied, yet is important due to the growing need for uncertainty quantification. We investigate two computationally cheap resampling-based methods to construct confidence intervals for SGD solutions. One uses multiple, but few, SGDs in parallel via resampling with replacement from the data, and another operates this in an online fashion. Our methods can be regarded as enhancements of established bootstrap schemes to substantially reduce the computation effort in terms of resampling requirements, while at the same time bypassing the intricate mixing conditions in existing batching methods. We achieve these via a recent so-called cheap bootstrap idea and Berry-Esseen-type bound for SGD.


title: Diffractive single hadron production in a saturation framework at the NLO

abstract: We calculate the cross-sections of diffractive single hadron photo- or electroproduction with large $p_T$, on a nucleon or a nucleus in the shockwave formalism. We use the hybrid formalism mixing collinear factorization with high energy small-$x$ factorization with the impact factors computed at next-to-leading order accuracy. We prove the cancellation of divergence and we determine the finite parts of the differential cross-sections. We work in general kinematics such that both photoproduction and leptoproduction are considered. The results can be used to detect saturation effects, at both the future EIC or already at LHC, using Ultra-Peripheral Collisions.


title: Sommerfeld effect for continuum gamma-ray spectra from Dark Matter annihilation

abstract: We present a calculation of the continuum part of the gamma-ray spectra resulting from Dark Matter annihilation in the framework of the MSSM taking into account Sommerfeld effects. Concentrating on pure wino and pure higgsino scenarios we compare our calculation to existing work and explore the numerical impact of the features not captured by previous approximative descriptions. We find that, in particular for large neutralino masses, when the Sommerfeld enhancement is very large, chargino-antichargino annihilation processes, which have not been considered before, lead to sizable differences with respect to existing calculations. In scenarios with neutralinos in the intermediate-mass range, we find that the role of the charginos is crucial in the endpoint regime. Our calculation provides the currently most accurate prediction for the continuum gamma-ray spectra.


title: Aerial-Aided mmWave VANETs Using NOMA: Performance Analysis, Comparison, and Insights

abstract: In this paper, we propose the integration of tethered flying platforms in cooperative vehicular ad hoc networks (VANETs) to alleviate the problems of rapid urbanization. In this context, we study the performance of VANETs by deriving approximate outage probability and average achievable rate expressions using tools from stochastic geometry. We compare between the usage of networked tethered flying platforms (NTFPs) and traditional roadside units (RSUs). On the other hand, the rapid increase of smart devices in vehicles and the upcoming urban air mobility (UAM) vision will congest the spectrum and require increased data rates. Hence, we use non-orthogonal multiple access (NOMA) to improve spectral efficiency and compare its performance to orthogonal access schemes. Furthermore, we utilize millimeter-wave (mmWave) frequencies for high data rates and implement a sectored beamforming model. We extensively study the system using three transmission schemes: direct, relay, and hybrid transmission. The results show that when acting as relays, NTFPs outperform RSUs for larger distances between the transmitting and the receiving vehicles, while RSUs outperform NTFPs for short distances. However, NTFPs are the best solution when acting as a source. Moreover, we find that, in most cases, direct transmission is preferred to achieve a high rate compared to other schemes. Finally, the results are summarized in two tables that provide insights into connecting VANETs by selecting the most suitable platform and type of communication for a given set of parameters, configurations, and requirements.


title: VoxArabica: A Robust Dialect-Aware Arabic Speech Recognition System

abstract: Arabic is a complex language with many varieties and dialects spoken by over 450 millions all around the world. Due to the linguistic diversity and variations, it is challenging to build a robust and generalized ASR system for Arabic. In this work, we address this gap by developing and demoing a system, dubbed VoxArabica, for dialect identification (DID) as well as automatic speech recognition (ASR) of Arabic. We train a wide range of models such as HuBERT (DID), Whisper, and XLS-R (ASR) in a supervised setting for Arabic DID and ASR tasks. Our DID models are trained to identify 17 different dialects in addition to MSA. We finetune our ASR models on MSA, Egyptian, Moroccan, and mixed data. Additionally, for the remaining dialects in ASR, we provide the option to choose various models such as Whisper and MMS in a zero-shot setting. We integrate these models into a single web interface with diverse features such as audio recording, file upload, model selection, and the option to raise flags for incorrect outputs. Overall, we believe VoxArabica will be useful for a wide range of audiences concerned with Arabic research. Our system is currently running at https://cdce-206-12-100-168.ngrok.io/.


title: Intelligent Resource Allocation for UAV-Based Cognitive NOMA Networks: An Active Inference Approach

abstract: Future wireless networks will need to improve adaptive resource allocation and decision-making to handle the increasing number of intelligent devices. Unmanned aerial vehicles (UAVs) are being explored for their potential in real-time decision-making. Moreover, cognitive non-orthogonal multiple access (Cognitive-NOMA) is envisioned as a remedy to address spectrum scarcity and enable massive connectivity. This paper investigates the design of joint subchannel and power allocation in an uplink UAV-based cognitive NOMA network. We aim to maximize the cumulative sum rate by jointly optimizing the subchannel and power allocation based on the UAV's mobility at each time step. This is often formulated as an optimization problem with random variables. However, conventional optimization algorithms normally introduce significant complexity, and machine learning methods often rely on large but partially representative datasets to build solution models, assuming stationary testing data. Consequently, inference strategies for non stationary events are often overlooked. In this study, we introduce a novel active inference-based learning approach, rooted in cognitive neuroscience, to solve this complex problem. The framework involves creating a training dataset using random or iterative methods to find suboptimal resource allocations. This dataset trains a mobile UAV offline, enabling it to learn a generative model of discrete subchannels and continuous power allocation. The UAV then uses this model for online inference. The method incrementally derives new generative models from training data by identifying dynamic equilibrium conditions between required actions and variables, represented within a unique dynamic Bayesian network. The proposed approach is validated through numerical simulations, showing efficient performance compared to suboptimal baseline schemes.


title: Highly Efficient Creation and Detection of Ultracold Deeply-Bound Molecules via Chainwise Stimulated Raman Shortcut-to-Adiabatic Passage

abstract: Chainwise stimulated Raman adiabatic passage (C-STIRAP) in M-type molecular system is a good alternative in creating ultracold deeply-bound molecules when the typical STIRAP in {\Lambda}-type system does not work due to weak Frank-Condon factors between states. However, its creation efficiency under the smooth evolution is generally low. During the process, the population in the intermediate states may decay out quickly and the strong laser pulses may induce multi-photon processes. In this paper, we find that shortcut-to-adiabatic (STA) passage fits very well in improving the performance of the C-STIRAP. Currently, related discussions on the so-called chainwise stimulated Raman shortcut-to-adiabatic passage (C-STIRSAP) are rare. Here, we investigate this topic under the adiabatic elimination. Given a relation among the four incident pulses, it is quite interesting that the M-type system can be generalized into an effective {\Lambda}-type structure with the simplest resonant coupling. Consequently, all possible methods of STA for three-state system can be borrowed. We take the counter-diabatic driving and "chosen path" method as instances to demonstrate our treatment on the molecular system. Although the "chosen path" method does not work well in real three-state system if there is strong decay in the excited state, our C-STIRSAP protocol under both the two methods can create ultracold deeply-bound molecules with high efficiency in the M-type system. The evolution time is shortened without strong laser pulses and the robustness of STA is well preserved. Finally, the detection of ultracold deeply-bound molecules is discussed.


title: Finding Time for Wheeler-DeWitt Cosmology

abstract: We conduct a case study analysis of a proposal for the emergence of time based upon the approximate derivation of three grades of temporal structure within an explicit quantum cosmological model which obeys a Wheeler-DeWitt type equation without an extrinsic time parameter. Our main focus will be issues regarding the consistency of the approximations and derivations in question. Our conclusion is that the model provides a self-consistent account of the emergence of chronordinal, chronometric and chronodirected structure. Residual concerns relate to explanatory rather than consistency considerations.


title: Second-order adiabatic connection: The theory and application to two electrons in a parabolic confinement

abstract: The adiabatic connection formalism, usually based on the first-order perturbation theory, has been generalized to an arbitrary order. The generalization stems from the observation that the formalism can be derived from a properly arranged Taylor expansion. The second-order theory is developed in detail and applied to the description of two electrons in a parabolic confinement (harmonium). A significant improvement relative to the first-order theory has been obtained.


title: XUE. Molecular inventory in the inner region of an extremely irradiated Protoplanetary Disk

abstract: We present the first results of the eXtreme UV Environments (XUE) James Webb Space Telescope (JWST) program, that focuses on the characterization of planet forming disks in massive star forming regions. These regions are likely representative of the environment in which most planetary systems formed. Understanding the impact of environment on planet formation is critical in order to gain insights into the diversity of the observed exoplanet populations. XUE targets 15 disks in three areas of NGC 6357, which hosts numerous massive OB stars, among which some of the most massive stars in our Galaxy. Thanks to JWST we can, for the first time, study the effect of external irradiation on the inner ($< 10$ au), terrestrial-planet forming regions of proto-planetary disks. In this study, we report on the detection of abundant water, CO, CO$_2$, HCN and C$_2$H$_2$ in the inner few au of XUE 1, a highly irradiated disk in NGC 6357. In addition, small, partially crystalline silicate dust is present at the disk surface. The derived column densities, the oxygen-dominated gas-phase chemistry, and the presence of silicate dust are surprisingly similar to those found in inner disks located in nearby, relatively isolated low-mass star-forming regions. Our findings imply that the inner regions of highly irradiated disks can retain similar physical and chemical conditions as disks in low-mass star-forming regions, thus broadening the range of environments with similar conditions for inner disk rocky planet formation to the most extreme star-forming regions in our Galaxy.


title: Sim-to-Real Transfer of Adaptive Control Parameters for AUV Stabilization under Current Disturbance

abstract: Learning-based adaptive control methods hold the premise of enabling autonomous agents to reduce the effect of process variations with minimal human intervention. However, its application to autonomous underwater vehicles (AUVs) has so far been restricted due to 1) unknown dynamics under the form of sea current disturbance that we can not model properly nor measure due to limited sensor capability and 2) the nonlinearity of AUVs tasks where the controller response at some operating points must be overly conservative in order to satisfy the specification at other operating points. Deep Reinforcement Learning (DRL) can alleviates these limitations by training general-purpose neural network policies, but applications of DRL algorithms to AUVs have been restricted to simulated environments, due to their inherent high sample complexity and distribution shift problem. This paper presents a novel approach, merging the Maximum Entropy Deep Reinforcement Learning framework with a classic model-based control architecture, to formulate an adaptive controller. Within this framework, we introduce a Sim-to-Real transfer strategy comprising the following components: a bio-inspired experience replay mechanism, an enhanced domain randomisation technique, and an evaluation protocol executed on a physical platform. Our experimental assessments demonstrate that this method effectively learns proficient policies from suboptimal simulated models of the AUV, resulting in control performance 3 times higher when transferred to a real-world vehicle, compared to its model-based nonadaptive but optimal counterpart.


title: Assessment of the Electromagnetic Behaviour of Servovalve Torque Motor Using Reluctance Network Models

abstract: The torque motor is the most common technology used in electrohydraulic two-stage servovalves to drive the hydraulic pilot stage. As it is a key component in these valves, its performance considerably affects the overall performance of servovalve systems. Modeling accurately the magnetic behavior of the torque motor will help to get a more realistic performance of the servovalve at different operating conditions during the product design and development stage. In this paper, an advanced model of the torque motor is presented. The aim is to integrate it into the overall multiphysics model of the servovalve through a multi-variable function obtained using the proposed modeling tool. The advanced reluctance network model has been developed by progressively considering various magnetic phenomena, including flux leaks between different parts and variations in magnetic induction. This model allows rapid assessment of the magnetic performance at various operating temperatures or using different ferromagnetic materials, without the need for additional analysis in 3D finite element software.


title: United We Stand: Using Epoch-wise Agreement of Ensembles to Combat Overfit

abstract: Deep neural networks have become the method of choice for solving many classification tasks, largely because they can fit very complex functions defined over raw data. The downside of such powerful learners is the danger of overfit. In this paper, we introduce a novel ensemble classifier for deep networks that effectively overcomes overfitting by combining models generated at specific intermediate epochs during training. Our method allows for the incorporation of useful knowledge obtained by the models during the overfitting phase without deterioration of the general performance, which is usually missed when early stopping is used. To motivate this approach, we begin with the theoretical analysis of a regression model, whose prediction -- that the variance among classifiers increases when overfit occurs -- is demonstrated empirically in deep networks in common use. Guided by these results, we construct a new ensemble-based prediction method, where the prediction is determined by the class that attains the most consensual prediction throughout the training epochs. Using multiple image and text classification datasets, we show that when regular ensembles suffer from overfit, our method eliminates the harmful reduction in generalization due to overfit, and often even surpasses the performance obtained by early stopping. Our method is easy to implement and can be integrated with any training scheme and architecture, without additional prior knowledge beyond the training set. It is thus a practical and useful tool to overcome overfit. Code is available at https://github.com/uristern123/United-We-Stand-Using-Epoch-wise-Agreement-of-Ensembles-to-Combat-Overfit.


title: An Lp-theory for fractional stationary Navier-Stokes equations

abstract: We consider the stationary (time-independent) Navier-Stokes equations in the whole threedimensional space, under the action of a source term and with the fractional Laplacian operator (--$\Delta$) $\alpha$/2 in the diffusion term. In the framework of Lebesgue and Lorentz spaces, we find some natural sufficient conditions on the external force and on the parameter $\alpha$ to prove the existence and in some cases nonexistence of solutions. Secondly, we obtain sharp pointwise decaying rates and asymptotic profiles of solutions, which strongly depend on $\alpha$. Finally, we also prove the global regularity of solutions. As a bi-product, we obtain some uniqueness theorems so-called Liouville-type results. On the other hand, our regularity result yields a new regularity criterion for the classical ( i.e. with $\alpha$ = 2) stationary Navier-Stokes equations. Contents


title: Learning from Red Teaming: Gender Bias Provocation and Mitigation in Large Language Models

abstract: Recently, researchers have made considerable improvements in dialogue systems with the progress of large language models (LLMs) such as ChatGPT and GPT-4. These LLM-based chatbots encode the potential biases while retaining disparities that can harm humans during interactions. The traditional biases investigation methods often rely on human-written test cases. However, these test cases are usually expensive and limited. In this work, we propose a first-of-its-kind method that automatically generates test cases to detect LLMs' potential gender bias. We apply our method to three well-known LLMs and find that the generated test cases effectively identify the presence of biases. To address the biases identified, we propose a mitigation strategy that uses the generated test cases as demonstrations for in-context learning to circumvent the need for parameter fine-tuning. The experimental results show that LLMs generate fairer responses with the proposed approach.


title: On General Capacity-Distortion Formulas of Integrated Sensing and Communication

abstract: The integrated sensing and communication (ISAC) problem with general state and channel distributions is investigated. General formulas of the capacity-distortion tradeoff for the ISAC problem under maximal and average distortion constraints are provided. The results cover some existing communication models such as the general point-to-point channel and Gel'fand-Pinsker channel. More details including memoryless states and channels, mixed states and channels, and rate-limited CSI at one side are considered. Numerical results focus on writing-on-dirty paper model and channel with ergodic/non-ergodic fading.


title: Understanding writing style in social media with a supervised contrastively pre-trained transformer

abstract: Online Social Networks serve as fertile ground for harmful behavior, ranging from hate speech to the dissemination of disinformation. Malicious actors now have unprecedented freedom to misbehave, leading to severe societal unrest and dire consequences, as exemplified by events such as the Capitol assault during the US presidential election and the Antivaxx movement during the COVID-19 pandemic. Understanding online language has become more pressing than ever. While existing works predominantly focus on content analysis, we aim to shift the focus towards understanding harmful behaviors by relating content to their respective authors. Numerous novel approaches attempt to learn the stylistic features of authors in texts, but many of these approaches are constrained by small datasets or sub-optimal training losses. To overcome these limitations, we introduce the Style Transformer for Authorship Representations (STAR), trained on a large corpus derived from public sources of 4.5 x 10^6 authored texts involving 70k heterogeneous authors. Our model leverages Supervised Contrastive Loss to teach the model to minimize the distance between texts authored by the same individual. This author pretext pre-training task yields competitive performance at zero-shot with PAN challenges on attribution and clustering. Additionally, we attain promising results on PAN verification challenges using a single dense layer, with our model serving as an embedding encoder. Finally, we present results from our test partition on Reddit. Using a support base of 8 documents of 512 tokens, we can discern authors from sets of up to 1616 authors with at least 80\% accuracy. We share our pre-trained model at huggingface (https://huggingface.co/AIDA-UPM/star) and our code is available at (https://github.com/jahuerta92/star)


title: Multi-omics Sampling-based Graph Transformer for Synthetic Lethality Prediction

abstract: Synthetic lethality (SL) prediction is used to identify if the co-mutation of two genes results in cell death. The prevalent strategy is to abstract SL prediction as an edge classification task on gene nodes within SL data and achieve it through graph neural networks (GNNs). However, GNNs suffer from limitations in their message passing mechanisms, including over-smoothing and over-squashing issues. Moreover, harnessing the information of non-SL gene relationships within large-scale multi-omics data to facilitate SL prediction poses a non-trivial challenge. To tackle these issues, we propose a new multi-omics sampling-based graph transformer for SL prediction (MSGT-SL). Concretely, we introduce a shallow multi-view GNN to acquire local structural patterns from both SL and multi-omics data. Further, we input gene features that encode multi-view information into the standard self-attention to capture long-range dependencies. Notably, starting with batch genes from SL data, we adopt parallel random walk sampling across multiple omics gene graphs encompassing them. Such sampling effectively and modestly incorporates genes from omics in a structure-aware manner before using self-attention. We showcase the effectiveness of MSGT-SL on real-world SL tasks, demonstrating the empirical benefits gained from the graph transformer and multi-omics data.


title: CSG: Curriculum Representation Learning for Signed Graph

abstract: Signed graphs are valuable for modeling complex relationships with positive and negative connections, and Signed Graph Neural Networks (SGNNs) have become crucial tools for their analysis. However, prior to our work, no specific training plan existed for SGNNs, and the conventional random sampling approach did not address varying learning difficulties within the graph's structure. We proposed a curriculum-based training approach, where samples progress from easy to complex, inspired by human learning. To measure learning difficulty, we introduced a lightweight mechanism and created the Curriculum representation learning framework for Signed Graphs (CSG). This framework optimizes the order in which samples are presented to the SGNN model. Empirical validation across six real-world datasets showed impressive results, enhancing SGNN model accuracy by up to 23.7% in link sign prediction (AUC) and significantly improving stability with an up to 8.4 reduction in the standard deviation of AUC scores.


title: Periodic linear complexions: Co-segregation of solutes at a low-angle grain boundary in a magnesium alloy

abstract: Solute segregation at low angle grain boundaries (LAGB) in Mg alloys significantly affects GB energy and mobility, therefore recrystallization kinetics and corresponding texture modification. In a system featuring multiple substitutional elements at high local concentration levels, solute-solute interaction needs to be considered to interpret and predict co-segregation behavior. In this work, atomic-scale experimental and modelling techniques were applied to investigate the co-segregation behavior of Ca, Zn and Al solutes at a LAGB in a Mg alloy. Three-dimensional atom probe tomography and corresponding clustering analysis revealed a strong clustering tendency of Ca solutes at the linear dislocation arrays. Atomistic simulations indicate that the co-segregation of Ca-Ca pairs in vicinity of the dislocation core region is more energetically favorable than other solute pairs, as well as the segregation of individual solutes.


title: Document-Level In-Context Few-Shot Relation Extraction via Pre-Trained Language Models

abstract: Document-level relation extraction aims at inferring structured human knowledge from textual documents. State-of-the-art methods for this task use pre-trained language models (LMs) via fine-tuning, yet fine-tuning is computationally expensive and cannot adapt to new relation types or new LMs. As a remedy, we leverage the generalization capabilities of pre-trained LMs and present a novel framework for document-level in-context few-shot relation extraction. Our framework has three strengths: it eliminates the need (1) for named entity recognition and (2) for human annotations of documents, and (3) it can be updated to new LMs without re-training. We evaluate our framework using DocRED, the largest publicly available dataset for document-level relation extraction, and demonstrate that our framework achieves state-of-the-art performance. We further show that our framework actually performs much better than the original labels from the development set of DocRED. Finally, we demonstrate that our complete framework yields consistent performance gains across diverse datasets and across different pre-trained LMs. To the best of our knowledge, we are the first to reformulate the document-level relation extraction task as a tailored in-context few-shot learning paradigm.


title: Torsion and twists of abelian varieties

abstract: In this article, we investigate the possible torsion subgroups of twists of abelian varieties with good reduction. As an application, we prove a theorem concerning ramified primes over any quadratic extension where odd-order torsion growth is achieved. In particular, we show that for every rational elliptic curve and every imaginary quadratic field not equal to $\mathbb{Q}(\sqrt{-3})$ satisfying the Heegner hypothesis no odd-order torsion growth can occur.


title: Feature Pyramid biLSTM: Using Smartphone Sensors for Transportation Mode Detection

abstract: The widespread utilization of smartphones has provided extensive availability to Inertial Measurement Units, providing a wide range of sensory data that can be advantageous for the detection of transportation modes. The objective of this study is to propose a novel end-to-end approach to effectively explore a reduced amount of sensory data collected from a smartphone to achieve accurate mode detection in common daily traveling activities. Our approach, called Feature Pyramid biLSTM (FPbiLSTM), is characterized by its ability to reduce the number of sensors required and processing demands, resulting in a more efficient modeling process without sacrificing the quality of the outcomes than the other current models. FPbiLSTM extends an existing CNN biLSTM model with the Feature Pyramid Network, leveraging the advantages of both shallow layer richness and deeper layer feature resilience for capturing temporal moving patterns in various transportation modes. It exhibits an excellent performance by employing the data collected from only three out of seven sensors, i.e. accelerometers, gyroscopes, and magnetometers, in the 2018 Sussex-Huawei Locomotion (SHL) challenge dataset, attaining a noteworthy accuracy of 95.1% and an F1-score of 94.7% in detecting eight different transportation modes.


title: MeKB-Rec: Personal Knowledge Graph Learning for Cross-Domain Recommendation

abstract: It is a long-standing challenge in modern recommender systems to effectively make recommendations for new users, namely the cold-start problem. Cross-Domain Recommendation (CDR) has been proposed to address this challenge, but current ways to represent users' interests across systems are still severely limited. We introduce Personal Knowledge Graph (PKG) as a domain-invariant interest representation, and propose a novel CDR paradigm named MeKB-Rec. We first link users and entities in a knowledge base to construct a PKG of users' interests, named MeKB. Then we learn a semantic representation of MeKB for the cross-domain recommendation. To efficiently utilize limited training data in CDR, MeKB-Rec employs Pretrained Language Models to inject world knowledge into understanding users' interests. Beyond most existing systems, our approach builds a semantic mapping across domains which breaks the requirement for in-domain user behaviors, enabling zero-shot recommendations for new users in a low-resource domain. We experiment MeKB-Rec on well-established public CDR datasets, and demonstrate that the new formulation % is more powerful than previous approaches, achieves a new state-of-the-art that significantly improves HR@10 and NDCG@10 metrics over best previous approaches by 24\%--91\%, with a 105\% improvement for HR@10 of zero-shot users with no behavior in the target domain. We deploy MeKB-Rec in WeiXin recommendation scenarios and achieve significant gains in core online metrics. MeKB-Rec is now serving hundreds of millions of users in real-world products.


title: Harmonicity of normal almost contact metric structures

abstract: We consider normal almost contact structures on a Riemannian manifold and, through their associated sections of an ad-hoc twistor bundle, study their harmonicity, as sections or as maps. We rewrite these harmonicity equations in terms of the curvature tensor and find conditions relating the harmonicity of the almost contact metric and almost complex structures of the total and base spaces of the Morimoto fibration. We apply these results to homogeneous principal circle bundles over generalised flag manifolds, in particular Aloff-Wallach spaces, to mass-produce harmonic almost contact metric structures.


title: On a generalized density point defined by families of sequences involving ideals

abstract: In this paper we have introduced the notion of $\mathcal{I}_{(s)}$-density point corresponding to the family of unbounded and $\mathcal{I}$-monotonic increasing positive real sequences, where $\mathcal{I}$ is the ideal of subsets of the set of natural numbers. We have studied the corresponding topology in the space of reals and have investigated several properties of this topology. Also we have formulated a weaker condition for the sequences so that the classical density topology coincides with $\mathcal{I}_{(s)}$-density topology.


title: Torus quotients of Richardson varieties in $G_{r,qr+1}$

abstract: Let $r$ and $q$ be positive integers and $n=qr+1.$ Let $G = SL(n, \mathbb{C})$ and $T$ be a maximal torus of $G.$ Let $P^{\alpha_r}$ be the maximal parabolic subgroup of $G$ corresponding to the simple root $\alpha_r.$ Let $\omega_r$ be the fundamental weight corresponding to $\alpha_r.$ Let $W$ be the Weyl group of $G$ and $W_{P^{\alpha_r}}$ be the Weyl group of $P^{\alpha_r}.$ Let $W^{P^{\alpha_r}}$ be the set of all minimal coset representatives of $W/W_{P^{\alpha_r}}$ in $W.$ Let $w_{r,n}$ (respectively, $v_{r,n}$) be the minimal (respectively, maximal) element in $W^{P^{\alpha_{r}}}$ such that $w_{r,n}(n\omega_r) \leq 0$ (respectively, $v_{r,n}(n\omega_r) \geq 0$). Let $v \leq v_{r,n}$ and $X^v_{w_{r,n}}$ be the Richardson variety in $G_{r,n}$ corresponding to $v$ and $w_{r,n}.$ In this article, we give a sufficient condition on $v$ such that the GIT quotient of $X^{v}_{w_{r,n}}$ for the action of $T$ is the product of projective spaces with respect to the descent of the line bundle $\mathcal{L}(n\omega_r).$


title: DORec: Decomposed Object Reconstruction Utilizing 2D Self-Supervised Features

abstract: Decomposing a target object from a complex background while reconstructing is challenging. Most approaches acquire the perception for object instances through the use of manual labels, but the annotation procedure is costly. The recent advancements in 2D self-supervised learning have brought new prospects to object-aware representation, yet it remains unclear how to leverage such noisy 2D features for clean decomposition. In this paper, we propose a Decomposed Object Reconstruction (DORec) network based on neural implicit representations. Our key idea is to transfer 2D self-supervised features into masks of two levels of granularity to supervise the decomposition, including a binary mask to indicate the foreground regions and a K-cluster mask to indicate the semantically similar regions. These two masks are complementary to each other and lead to robust decomposition. Experimental results show the superiority of DORec in segmenting and reconstructing the foreground object on various datasets.


title: SODA: Robust Training of Test-Time Data Adaptors

abstract: Adapting models deployed to test distributions can mitigate the performance degradation caused by distribution shifts. However, privacy concerns may render model parameters inaccessible. One promising approach involves utilizing zeroth-order optimization (ZOO) to train a data adaptor to adapt the test data to fit the deployed models. Nevertheless, the data adaptor trained with ZOO typically brings restricted improvements due to the potential corruption of data features caused by the data adaptor. To address this issue, we revisit ZOO in the context of test-time data adaptation. We find that the issue directly stems from the unreliable estimation of the gradients used to optimize the data adaptor, which is inherently due to the unreliable nature of the pseudo-labels assigned to the test data. Based on this observation, we propose pseudo-label-robust data adaptation (SODA) to improve the performance of data adaptation. Specifically, SODA leverages high-confidence predicted labels as reliable labels to optimize the data adaptor with ZOO for label prediction. For data with low-confidence predictions, SODA encourages the adaptor to preserve data information to mitigate data corruption. Empirical results indicate that SODA can significantly enhance the performance of deployed models in the presence of distribution shifts without requiring access to model parameters.


title: Relearning Forgotten Knowledge: on Forgetting, Overfit and Training-Free Ensembles of DNNs

abstract: The infrequent occurrence of overfit in deep neural networks is perplexing. On the one hand, theory predicts that as models get larger they should eventually become too specialized for a specific training set, with ensuing decrease in generalization. In contrast, empirical results in image classification indicate that increasing the training time of deep models or using bigger models almost never hurts generalization. Is it because the way we measure overfit is too limited? Here, we introduce a novel score for quantifying overfit, which monitors the forgetting rate of deep models on validation data. Presumably, this score indicates that even while generalization improves overall, there are certain regions of the data space where it deteriorates. When thus measured, we show that overfit can occur with and without a decrease in validation accuracy, and may be more common than previously appreciated. This observation may help to clarify the aforementioned confusing picture. We use our observations to construct a new ensemble method, based solely on the training history of a single network, which provides significant improvement in performance without any additional cost in training time. An extensive empirical evaluation with modern deep models shows our method's utility on multiple datasets, neural networks architectures and training schemes, both when training from scratch and when using pre-trained networks in transfer learning. Notably, our method outperforms comparable methods while being easier to implement and use, and further improves the performance of competitive networks on Imagenet by 1%.


title: Interview with Adrian Raftery

abstract: Professor Adrian E. Raftery is the Boeing International Professor of Statistics and Sociology, and an adjunct professor of Atmospheric Sciences, at the University of Washington in Seattle. He was born in Dublin, Ireland, and obtained a B.A. in Mathematics and an M.Sc. in Statistics and Operations Research at Trinity College Dublin. He obtained a doctorate in mathematical statistics from the Universit\'e Pierre et Marie Curie under the supervision of Paul Deheuvels. He was a lecturer in statistics at Trinity College Dublin, and then an associate and full professor of statistics and sociology at the University of Washington. He was the founding Director of the Center for Statistics and Social Sciences. Professor Raftery has published over 200 articles in peer-reviewed statistical, sociological and other journals. His research focuses on Bayesian model selection and Bayesian model averaging, model-based clustering, inference for deterministic models, and the development of new statistical methods for demography, sociology, and the environmental and health sciences. He is a member of the United States National Academy of Sciences, a Fellow of the American Academy of Arts and Sciences, an Honorary Member of the Royal Irish Academy, a member of the Washington State Academy of Sciences, a Fellow of the American Statistical Association, a Fellow of the Institute of Mathematical Statistics, and an elected Member of the Sociological Research Association. He has won multiple awards for his research. He was Coordinating and Applications Editor of the Journal of the American Statistical Association and Editor of Sociological Methodology. He was identified as the world's most cited researcher in mathematics for the period 1995-2005. Thirty-three students have obtained Ph.D.'s working under Raftery's supervision, of whom 21 hold or have held tenure-track university faculty positions.