title: OAAFormer: Robust and Efficient Point Cloud Registration Through Overlapping-Aware Attention in Transformer

abstract: In the domain of point cloud registration, the coarse-to-fine feature matching paradigm has received substantial attention owing to its impressive performance. This paradigm involves a two-step process: first, the extraction of multi-level features, and subsequently, the propagation of correspondences from coarse to fine levels. Nonetheless, this paradigm exhibits two notable limitations.Firstly, the utilization of the Dual Softmax operation has the potential to promote one-to-one correspondences between superpoints, inadvertently excluding valuable correspondences. This propensity arises from the fact that a source superpoint typically maintains associations with multiple target superpoints. Secondly, it is imperative to closely examine the overlapping areas between point clouds, as only correspondences within these regions decisively determine the actual transformation. Based on these considerations, we propose {\em OAAFormer} to enhance correspondence quality. On one hand, we introduce a soft matching mechanism, facilitating the propagation of potentially valuable correspondences from coarse to fine levels. Additionally, we integrate an overlapping region detection module to minimize mismatches to the greatest extent possible. Furthermore, we introduce a region-wise attention module with linear complexity during the fine-level matching phase, designed to enhance the discriminative capabilities of the extracted features. Tests on the challenging 3DLoMatch benchmark demonstrate that our approach leads to a substantial increase of about 7\% in the inlier ratio, as well as an enhancement of 2-4\% in registration recall. =


title: MCMC for Bayesian nonparametric mixture modeling under differential privacy

abstract: Estimating the probability density of a population while preserving the privacy of individuals in that population is an important and challenging problem that has received considerable attention in recent years. While the previous literature focused on frequentist approaches, in this paper, we propose a Bayesian nonparametric mixture model under differential privacy (DP) and present two Markov chain Monte Carlo (MCMC) algorithms for posterior inference. One is a marginal approach, resembling Neal's algorithm 5 with a pseudo-marginal Metropolis-Hastings move, and the other is a conditional approach. Although our focus is primarily on local DP, we show that our MCMC algorithms can be easily extended to deal with global differential privacy mechanisms. Moreover, for some carefully chosen mechanisms and mixture kernels, we show how auxiliary parameters can be analytically marginalized, allowing standard MCMC algorithms (i.e., non-privatized, such as Neal's Algorithm 2) to be efficiently employed. Our approach is general and applicable to any mixture model and privacy mechanism. In several simulations and a real case study, we discuss the performance of our algorithms and evaluate different privacy mechanisms proposed in the frequentist literature.


title: Comparative Analysis of Optimization Strategies for K-means Clustering in Big Data Contexts: A Review

abstract: This paper presents a comparative analysis of different optimization techniques for the K-means algorithm in the context of big data. K-means is a widely used clustering algorithm, but it can suffer from scalability issues when dealing with large datasets. The paper explores different approaches to overcome these issues, including parallelization, approximation, and sampling methods. The authors evaluate the performance of various clustering techniques on a large number of benchmark datasets, comparing them according to the dominance criterion provided by the "less is more" approach (LIMA), i.e., simultaneously along the dimensions of speed, clustering quality, and simplicity. The results show that different techniques are more suitable for different types of datasets and provide insights into the trade-offs between speed and accuracy in K-means clustering for big data. Overall, the paper offers a comprehensive guide for practitioners and researchers on how to optimize K-means for big data applications.


title: Assessing the Reliability of Large Language Model Knowledge

abstract: Large language models (LLMs) have been treated as knowledge bases due to their strong performance in knowledge probing tasks. LLMs are typically evaluated using accuracy, yet this metric does not capture the vulnerability of LLMs to hallucination-inducing factors like prompt and context variability. How do we evaluate the capabilities of LLMs to consistently produce factually correct answers? In this paper, we propose MOdel kNowledge relIabiliTy scORe (MONITOR), a novel metric designed to directly measure LLMs' factual reliability. MONITOR computes the distance between the probability distributions of a valid output and its counterparts produced by the same LLM probing the same fact using different styles of prompts and contexts.Experiments on a comprehensive range of 12 LLMs demonstrate the effectiveness of MONITOR in evaluating the factual reliability of LLMs while maintaining a low computational overhead. In addition, we release the FKTC (Factual Knowledge Test Corpus) test set, containing 210,158 prompts in total to foster research along this line (https://github.com/Vicky-Wil/MONITOR).


title: LICO: Explainable Models with Language-Image Consistency

abstract: Interpreting the decisions of deep learning models has been actively studied since the explosion of deep neural networks. One of the most convincing interpretation approaches is salience-based visual interpretation, such as Grad-CAM, where the generation of attention maps depends merely on categorical labels. Although existing interpretation methods can provide explainable decision clues, they often yield partial correspondence between image and saliency maps due to the limited discriminative information from one-hot labels. This paper develops a Language-Image COnsistency model for explainable image classification, termed LICO, by correlating learnable linguistic prompts with corresponding visual features in a coarse-to-fine manner. Specifically, we first establish a coarse global manifold structure alignment by minimizing the distance between the distributions of image and language features. We then achieve fine-grained saliency maps by applying optimal transport (OT) theory to assign local feature maps with class-specific prompts. Extensive experimental results on eight benchmark datasets demonstrate that the proposed LICO achieves a significant improvement in generating more explainable attention maps in conjunction with existing interpretation methods such as Grad-CAM. Remarkably, LICO improves the classification performance of existing models without introducing any computational overhead during inference. Source code is made available at https://github.com/ymLeiFDU/LICO.


title: Turn Passive to Active: A Survey on Active Intellectual Property Protection of Deep Learning Models

abstract: The intellectual property protection of deep learning (DL) models has attracted increasing serious concerns. Many works on intellectual property protection for Deep Neural Networks (DNN) models have been proposed. The vast majority of existing work uses DNN watermarking to verify the ownership of the model after piracy occurs, which is referred to as passive verification. On the contrary, we focus on a new type of intellectual property protection method named active copyright protection, which refers to active authorization control and user identity management of the DNN model. As of now, there is relatively limited research in the field of active DNN copyright protection. In this review, we attempt to clearly elaborate on the connotation, attributes, and requirements of active DNN copyright protection, provide evaluation methods and metrics for active copyright protection, review and analyze existing work on active DL model intellectual property protection, discuss potential attacks that active DL model copyright protection techniques may face, and provide challenges and future directions for active DL model intellectual property protection. This review is helpful to systematically introduce the new field of active DNN copyright protection and provide reference and foundation for subsequent work.


title: Finite size corrections for real eigenvalues of the elliptic Ginibre matrices

abstract: We consider the elliptic Ginibre matrices in the orthogonal symmetry class that interpolates between the real Ginibre ensemble and the Gaussian orthogonal ensemble. We obtain the finite size corrections of the real eigenvalue densities in both the global and edge scaling regimes, as well as in both the strong and weak non-Hermiticity regimes. Our results extend and provide the rate of convergence to the previous recent findings in the aforementioned limits. In particular, in the Hermitian limit, our results recover the finite size corrections of the Gaussian orthogonal ensemble established by Forrester, Frankel and Garoni.


title: Overconstrained Robotic Limb with Energy-Efficient, Omni-directional Locomotion

abstract: This paper studies the design, modeling, and control of a novel quadruped, featuring overconstrained robotic limbs employing the Bennett linkage for motion and power transmission. The modular limb design allows the robot to morph into reptile- or mammal-inspired forms. In contrast to the prevailing focus on planar limbs, this research delves into the classical overconstrained linkages, which have strong theoretical foundations in advanced kinematics but limited engineering applications. The study showcases the morphological superiority of overconstrained robotic limbs that can transform into planar or spherical limbs, exemplifying the Bennett linkage. By conducting kinematic and dynamic modeling, we apply model predictive control to simulate a range of locomotion tasks, revealing that overconstrained limbs outperform planar designs in omni-directional tasks like forward trotting, lateral trotting, and turning on the spot when considering foothold distances. These findings highlight the biological distinctions in limb design between reptiles and mammals and represent the first documented instance of overconstrained robotic limbs outperforming planar designs in dynamic locomotion.


title: Mathematical Analysis of the role of Information on the Dynamics of Typhoid Fever

abstract: We consider a deterministic mathematical model to study the role of Information on the dynamics of Typhoid Fever. We analyses the model to study its boundedness and compute the threshold value known as basic reproduction number for determination of number of secondary cases and establishment of the the condition for local and global asymptotic stability of the stationary points. The numerical simulation is used to depict dynamical behavior of Typhoid Fever in the considered population. The results indicate a clear role of information in influencing a behavior change that may in a way lead to an increase in the transmission typhoid fever. The result further show that the increase of the number of individuals with Typhoid fever is greatly influenced by failure of the people to follow health precaution that reduce the spread of the disease. The result necessitate the importance of the government to continue educating and/or giving information to her people on the behavior that in one way or another may lead to the increase of the transmission of typhoid fever which should also be an importance topic to be discussed when planning for any control strategies against the disease.


title: Algorithm-oriented qubit mapping for variational quantum algorithms

abstract: Optimizing qubit mapping is critical for the successful implementation of algorithms on near-term quantum devices. In this paper we present an algorithm-oriented qubit mapping (AOQMAP) that capitalizes on the inherent regular substructures within quantum algorithms. While exact methods provide optimal solutions, their exponential scaling renders them impractical. AOQMAP addresses this challenge through a strategic two-step approach. First, it adapts circuits onto subtopologies of the target quantum device to satisfy connectivity constraints. Optimal and scalable solutions with minimum circuit depth are provided for variational quantum algorithms with all-to-all connected interactions on linear, T-shaped, and H-shaped subtopologies. Second, it identifies the optimal mapping scheme by using a cost function based on current device noise. Demonstrations on various IBM quantum devices indicate that AOQMAP significantly reduces both gate count and circuit depth compared to traditional mapping approaches, consequently enhancing performance. Specifically, AOQMAP achieves up to 82.1% depth reduction and a 138% average increase in success probability compared to Qiskit, Tket, and SWAP network. This specialized and scalable mapping paradigm can potentially optimize broader quantum algorithm classes. Tailoring qubit mapping to leverage algorithmic features holds the promise of maximizing the performance of near-term quantum algorithms.


title: VFLAIR: A Research Library and Benchmark for Vertical Federated Learning

abstract: Vertical Federated Learning (VFL) has emerged as a collaborative training paradigm that allows participants with different features of the same group of users to accomplish cooperative training without exposing their raw data or model parameters. VFL has gained significant attention for its research potential and real-world applications in recent years, but still faces substantial challenges, such as in defending various kinds of data inference and backdoor attacks. Moreover, most of existing VFL projects are industry-facing and not easily used for keeping track of the current research progress. To address this need, we present an extensible and lightweight VFL framework VFLAIR (available at https://github.com/FLAIR-THU/VFLAIR), which supports VFL training with a variety of models, datasets and protocols, along with standardized modules for comprehensive evaluations of attacks and defense strategies. We also benchmark 11 attacks and 8 defenses performance under different communication and model partition settings and draw concrete insights and recommendations on the choice of defense strategies for different practical VFL deployment scenarios.


title: Top-K Pooling with Patch Contrastive Learning for Weakly-Supervised Semantic Segmentation

abstract: Weakly Supervised Semantic Segmentation (WSSS) using only image-level labels has gained significant attention due to cost-effectiveness. Recently, Vision Transformer (ViT) based methods without class activation map (CAM) have shown greater capability in generating reliable pseudo labels than previous methods using CAM. However, the current ViT-based methods utilize max pooling to select the patch with the highest prediction score to map the patch-level classification to the image-level one, which may affect the quality of pseudo labels due to the inaccurate classification of the patches. In this paper, we introduce a novel ViT-based WSSS method named top-K pooling with patch contrastive learning (TKP-PCL), which employs a top-K pooling layer to alleviate the limitations of previous max pooling selection. A patch contrastive error (PCE) is also proposed to enhance the patch embeddings to further improve the final results. The experimental results show that our approach is very efficient and outperforms other state-of-the-art WSSS methods on the PASCAL VOC 2012 dataset.


title: Quantum Schwarzschild Black Hole Optical Aspects

abstract: In this paper, we investigate the optical behaviors of a quantum Schwarzschild black hole with a spacetime solution including a parameter $\lambda$ that encodes its discretization. Concretly, we derive the effective potential of such solution. In particular, we study the circular orbits around the quantum black hole. Indeed, we find that the effective potential is characterized by a minimum and a maximum yielding a double photon spheres denoted by $r_{p_1}, r_{p_2}$ respectively. Then, we analyse the double shadow behaviors as a function of the parameter $\lambda$ where we show that it controles the shadow circular size. An inspection of the Innermost Stable Circular Orbits (ISCO) shows that the radius $r_{ISCO}$ increases as a function of $\lambda$. Besides, we find that such radius is equal to $6M$ for an angular momentum $L=2\sqrt{3}$ independently of $\lambda$. A numerical analysis shows that the photon sphere of radius $r_{p_1}$ generates a shadow with a radius larger than $r_{ISCO}$. Thus, a truncation of the effective potential is imposed to exclude such behavior. Finally, the $\lambda$-effect is inspect on the deflection angle of such a black hole showing that it increases when higher values of the parameter $\lambda$ are considered. However, such an increase is limited by an upper bound given by $\frac{6 M}{b}$.


title: Convergence rates for Chernoff-type approximations of convex monotone semigroups

abstract: We provide explicit convergence rates for Chernoff-type approximations of convex monotone semigroups which have the form $S(t)f=\lim_{n\to\infty}I(\frac{t}{n})^n f$ for bounded continuous functions $f$. Under suitable conditions on the one-step operators $I(t)$ regarding the time regularity and consistency of the approximation scheme, we obtain $\|S(t)f-I(\frac{t}{n})^n f\|_\infty\leq cn^{-\gamma}$ for bounded Lipschitz continuous functions $f$, where $c\geq 0$ and $\gamma>0$ are determined explicitly. Moreover, the mapping $t\mapsto S(t)f$ is H\"older continuous. These results are closely related to monotone approximation schemes for viscosity solutions but are obtained independently by following a recently developed semigroup approach to Hamilton-Jacobi-Bellman equations which uniquely characterizes semigroups via their $\Gamma$-generators. The different approach allows to consider convex rather than sublinear equations and the results can be extended to unbounded functions by modifying the norm with a suitable weight function. Furthermore, up to possibly different consistency errors for the operators $I(t)$, the upper and lower bound for the error between the semigroup and the iterated operators are symmetric. The abstract results are applied to Nisio semigroups and limit theorems for convex expectations.


title: MAGIC: Detecting Advanced Persistent Threats via Masked Graph Representation Learning

abstract: Advance Persistent Threats (APTs), adopted by most delicate attackers, are becoming increasing common and pose great threat to various enterprises and institutions. Data provenance analysis on provenance graphs has emerged as a common approach in APT detection. However, previous works have exhibited several shortcomings: (1) requiring attack-containing data and a priori knowledge of APTs, (2) failing in extracting the rich contextual information buried within provenance graphs and (3) becoming impracticable due to their prohibitive computation overhead and memory consumption. In this paper, we introduce MAGIC, a novel and flexible self-supervised APT detection approach capable of performing multi-granularity detection under different level of supervision. MAGIC leverages masked graph representation learning to model benign system entities and behaviors, performing efficient deep feature extraction and structure abstraction on provenance graphs. By ferreting out anomalous system behaviors via outlier detection methods, MAGIC is able to perform both system entity level and batched log level APT detection. MAGIC is specially designed to handle concept drift with a model adaption mechanism and successfully applies to universal conditions and detection scenarios. We evaluate MAGIC on three widely-used datasets, including both real-world and simulated attacks. Evaluation results indicate that MAGIC achieves promising detection results in all scenarios and shows enormous advantage over state-of-the-art APT detection approaches in performance overhead.


title: Merging Experts into One: Improving Computational Efficiency of Mixture of Experts

abstract: Scaling the size of language models usually leads to remarkable advancements in NLP tasks. But it often comes with a price of growing computational cost. Although a sparse Mixture of Experts (MoE) can reduce the cost by activating a small subset of parameters (e.g., one expert) for each input, its computation escalates significantly if increasing the number of activated experts, limiting its practical utility. Can we retain the advantages of adding more experts without substantially increasing the computational costs? In this paper, we first demonstrate the superiority of selecting multiple experts and then propose a computation-efficient approach called \textbf{\texttt{Merging Experts into One}} (MEO), which reduces the computation cost to that of a single expert. Extensive experiments show that MEO significantly improves computational efficiency, e.g., FLOPS drops from 72.0G of vanilla MoE to 28.6G (MEO). Moreover, we propose a token-level attention block that further enhances the efficiency and performance of token-level MEO, e.g., 83.3\% (MEO) vs. 82.6\% (vanilla MoE) average score on the GLUE benchmark. Our code will be released upon acceptance. Code will be released at: \url{https://github.com/Shwai-He/MEO}.


title: Robust Multi-Agent Reinforcement Learning by Mutual Information Regularization

abstract: In multi-agent reinforcement learning (MARL), ensuring robustness against unpredictable or worst-case actions by allies is crucial for real-world deployment. Existing robust MARL methods either approximate or enumerate all possible threat scenarios against worst-case adversaries, leading to computational intensity and reduced robustness. In contrast, human learning efficiently acquires robust behaviors in daily life without preparing for every possible threat. Inspired by this, we frame robust MARL as an inference problem, with worst-case robustness implicitly optimized under all threat scenarios via off-policy evaluation. Within this framework, we demonstrate that Mutual Information Regularization as Robust Regularization (MIR3) during routine training is guaranteed to maximize a lower bound on robustness, without the need for adversaries. Further insights show that MIR3 acts as an information bottleneck, preventing agents from over-reacting to others and aligning policies with robust action priors. In the presence of worst-case adversaries, our MIR3 significantly surpasses baseline methods in robustness and training efficiency while maintaining cooperative performance in StarCraft II and robot swarm control. When deploying the robot swarm control algorithm in the real world, our method also outperforms the best baseline by 14.29%.


title: Improved Flow Recovery from Packet Data

abstract: Typical event datasets such as those used in network intrusion detection comprise hundreds of thousands, sometimes millions, of discrete packet events. These datasets tend to be high dimensional, stateful, and time-series in nature, holding complex local and temporal feature associations. Packet data can be abstracted into lower dimensional summary data, such as packet flow records, where some of the temporal complexities of packet data can be mitigated, and smaller well-engineered feature subsets can be created. This data can be invaluable as training data for machine learning and cyber threat detection techniques. Data can be collected in real-time, or from historical packet trace archives. In this paper we focus on how flow records and summary metadata can be extracted from packet data with high accuracy and robustness. We identify limitations in current methods, how they may impact datasets, and how these flaws may impact learning models. Finally, we propose methods to improve the state of the art and introduce proof of concept tools to support this work.


title: Secure and Robust Communications for Cislunar Space Networks

abstract: There is no doubt that the Moon has become the center of interest for commercial and international actors. Over the past decade, the number of planned long-term missions has increased dramatically. This makes the establishment of cislunar space networks (CSNs) crucial to orchestrate uninterrupted communications between the Moon and Earth. However, there are numerous challenges, unknowns, and uncertainties associated with cislunar communications that may pose various risks to lunar missions. In this study, we aim to address these challenges for cislunar communications by proposing a machine learning-based cislunar space domain awareness (SDA) capability that enables robust and secure communications. To this end, we first propose a detailed channel model for selected cislunar scenarios. Secondly, we propose two types of interference that could model anomalies that occur in cislunar space and are so far known only to a limited extent. Finally, we discuss our cislunar SDA to work in conjunction with the spacecraft communication system. Our proposed cislunar SDA, involving heuristic learning capabilities with machine learning algorithms, detects interference models with over 96% accuracy. The results demonstrate the promising performance of our cislunar SDA approach for secure and robust cislunar communication.


title: Investigation on the bottom analogs of the $T_{cc}^{+}$

abstract: We investigated the doubly bottom molecule state $T^-_{bb}$ composed of two bottomed mesons. The potentials are obtained by using the one-boson-exchange model. With the heavy quark flavor symmetry, all the parameters in the model are determined from the doubly charmed tetraquark $T_{cc}^{+}$ by fitting its experimental data in our previous work. The mass of the bound state is predicted to be around $10560$ MeV ($\approx 44$ MeV below the $\bar{B}\bar{B}^*$ threshold), which is consistent with the lattice calculations. Furthermore, a resonance state around $10621$ MeV was found. These results, extracted by using the complex scaling method and $T$-matrix, are remarkably consistent with each other. The $\bar{B}\bar{B}^*$ molecule predicted here could be observed in the electromagnetic decay channel $\bar{B}\bar{B}\gamma$, while the strong decay into $\bar{B}\bar{B}\pi$ channel is forbidden. This research will help guide the search of these exotic states in the future experiments and eventually deepen the insights of them.


title: A proof for Ando's theorem on norm-coherent coordinates via the Coleman norm operator

abstract: Ando established an algebraic criterion for when a complex orientation for a Morava E-theory is an $H_\infty$-map. The criterion relates such an orientation to a specific property of the formal group associated to the E-theory, namely, a norm coherence condition on its coordinate. On the other hand, Coleman constructed a norm operator for interpolating division values in local fields, which depends on a Lubin--Tate formal group law. These formal group laws are important tools in explicit local class field theory. In this article, we give a conceptual proof for Ando's theorem using the Coleman norm operator via the bridge of formal group laws between topology and arithmetic.


title: Explaining How a Neural Network Play the Go Game and Let People Learn

abstract: The AI model has surpassed human players in the game of Go, and it is widely believed that the AI model has encoded new knowledge about the Go game beyond human players. In this way, explaining the knowledge encoded by the AI model and using it to teach human players represent a promising-yet-challenging issue in explainable AI. To this end, mathematical supports are required to ensure that human players can learn accurate and verifiable knowledge, rather than specious intuitive analysis. Thus, in this paper, we extract interaction primitives between stones encoded by the value network for the Go game, so as to enable people to learn from the value network. Experiments show the effectiveness of our method.


title: Black hole ringdown from physically sensible initial value problem in higher-order scalar-tensor theories

abstract: We study odd-parity perturbations about static and spherically symmetric black hole solutions with a linearly time-dependent scalar field in higher-order scalar-tensor theories. In particular, we consider stealth Schwarzschild and stealth Schwarzschild-de Sitter solutions, where the deviation from the general relativity case is controlled by a single parameter. We find that complex frequencies of quasinormal modes (QNMs) are given by a simple scaling of those in general relativity. We also show that there is a degeneracy between the parameter characterizing the modification from general relativity and the black hole mass. We then consider a physically sensible initial value problem by taking into account the fact that the effective metric for the odd-parity perturbations is in general different from the background metric. We confirm that damped oscillations appearing at late times are indeed dominated by the QNMs. Our analysis includes the case where the perturbations are superluminal, and we demonstrate in this case that the perturbations can escape from the region inside the horizon for the background metric.


title: Towards Structural Sparse Precoding: Dynamic Time, Frequency, Space, and Power Multistage Resource Programming

abstract: In last decades, dynamic resource programming in partial resource domains has been extensively investigated for single time slot optimizations. However, with the emerging real-time media applications in fifth-generation communications, their new quality of service requirements are often measured in temporal dimension. This requires multistage optimization for full resource domain dynamic programming. Taking experience rate as a typical temporal multistage metric, we jointly optimize time, frequency, space and power domains resource for multistage optimization. To strike a good tradeoff between system performance and computational complexity, we first transform the formulated mixed integer non-linear constraints into equivalent convex second order cone constraints, by exploiting the coupling effect among the resources. Leveraging the concept of structural sparsity, the objective of max-min experience rate is given as a weighted 1-norm term associated with the precoding matrix. Finally, a low-complexity iterative algorithm is proposed for full resource domain programming, aided by another simple conic optimization for obtaining its feasible initial result. Simulation verifies that our design significantly outperform the benchmarks while maintaining a fast convergence rate, shedding light on full domain dynamic resource programming of multistage optimizations.


title: Differential calculus for fully matricial functions I

abstract: We will introduce a cyclic derivative for fully (stably) matricial functions and study its basic properties. In particular, we will show the Poincar\'{e} lemma for stably matricial functions of certain classes. We will also position Voiculescu's framework of fully matricial functions in the context of nc functions due to Kaliuzhnyi-Verbovetskyi and Vinnikov in order to clarify the relation between the present work and previous related works.


title: Grassmann Time-Evolving Matrix Product Operators for Equilibrium Quantum Impurity Problems

abstract: Tensor-network-based methods are promising candidates to solve quantum impurity problems. They are free of sampling noises and the sign problem compared to state-of-the-art continuous-time quantum Monte Carlo methods. Recent progress made in tensor-network-based impurity solvers is to use the Feynman-Vernon influence functional to integrate out the bath analytically, retaining only the impurity dynamics and representing it compactly as a matrix product state. The recently proposed Grassmann time-evolving matrix product operator (GTEMPO) method is one of the representative methods in this direction. In this work, we systematically study the performance of GTEMPO in solving equilibrium quantum impurity problems at a finite temperature with a semicircular spectrum density of the bath. Our results show that its computational cost would generally increase as the temperature goes down and scale exponentially with the number of orbitals. In particular, the single-orbital Anderson impurity model can be efficiently solved with this method, for two orbitals we estimate that one could possibly reach inverse temperature $\beta\approx 20$ if high-performance computing techniques are utilized, while beyond that only very high-temperature regimes can be reached in the current formalism. Our work paves the way to apply GTEMPO as an imaginary-time impurity solver.


title: CoCoFormer: A controllable feature-rich polyphonic music generation method

abstract: This paper explores the modeling method of polyphonic music sequence. Due to the great potential of Transformer models in music generation, controllable music generation is receiving more attention. In the task of polyphonic music, current controllable generation research focuses on controlling the generation of chords, but lacks precise adjustment for the controllable generation of choral music textures. This paper proposed Condition Choir Transformer (CoCoFormer) which controls the output of the model by controlling the chord and rhythm inputs at a fine-grained level. In this paper, the self-supervised method improves the loss function and performs joint training through conditional control input and unconditional input training. In order to alleviate the lack of diversity on generated samples caused by the teacher forcing training, this paper added an adversarial training method. CoCoFormer enhances model performance with explicit and implicit inputs to chords and rhythms. In this paper, the experiments proves that CoCoFormer has reached the current better level than current models. On the premise of specifying the polyphonic music texture, the same melody can also be generated in a variety of ways.


title: Risk-Adaptive Local Decision Rules

abstract: For parameterized mixed-binary optimization problems, we construct local decision rules that prescribe near-optimal courses of action across a set of parameter values. The decision rules stem from solving risk-adaptive training problems over classes of continuous, possibly nonlinear mappings. In asymptotic and nonasymptotic analysis, we establish that the decision rules prescribe near-optimal decisions locally for the actual problems, without relying on linearity, convexity, or smoothness. The development also accounts for practically important aspects such as inexact function evaluations, solution tolerances in training problems, regularization, and reformulations to solver-friendly models. The decision rules also furnish a means to carry out sensitivity and stability analysis for broad classes of parameterized optimization problems. We develop a decomposition algorithm for solving the resulting training problems and demonstrate its ability to generate quality decision rules on a nonlinear binary optimization model from search theory.


title: An Abstract Maximum Principle for constrained minimum problems

abstract: This article makes no claim to originality, other than, perhaps, the simple statement here called the {\it Abstract Maximum Principle}. Actually, the whole contents are strongly based on some H. Sussmann's and coauthors' papers, in which, in a much more general context, the set-separation approach is regarded as foundational for necessary conditions for minima. So, rather than being the exposition of original material, this paper has mainly a pedagogical purpose. From the Abstract Maximum Principle it is possible to deduce several necessary conditions for both finite dimensional minimum problems and for optimal control problems. More in general, this Principle seems apt to capture some consequences of the geometric and topological idea of (possibly vector-valued) minimization in a parametrized problem.


title: Generalizing Few-Shot Named Entity Recognizers to Unseen Domains with Type-Related Features

abstract: Few-shot named entity recognition (NER) has shown remarkable progress in identifying entities in low-resource domains. However, few-shot NER methods still struggle with out-of-domain (OOD) examples due to their reliance on manual labeling for the target domain. To address this limitation, recent studies enable generalization to an unseen target domain with only a few labeled examples using data augmentation techniques. Two important challenges remain: First, augmentation is limited to the training data, resulting in minimal overlap between the generated data and OOD examples. Second, knowledge transfer is implicit and insufficient, severely hindering model generalizability and the integration of knowledge from the source domain. In this paper, we propose a framework, prompt learning with type-related features (PLTR), to address these challenges. To identify useful knowledge in the source domain and enhance knowledge transfer, PLTR automatically extracts entity type-related features (TRFs) based on mutual information criteria. To bridge the gap between training and OOD data, PLTR generates a unique prompt for each unseen example by selecting relevant TRFs. We show that PLTR achieves significant performance improvements on in-domain and cross-domain datasets. The use of PLTR facilitates model adaptation and increases representation similarities between the source and unseen domains.


title: XRMDN: An Extended Recurrent Mixture Density Network for Short-Term Probabilistic Rider Demand Forecasting with High Volatility

abstract: In the realm of Mobility-on-Demand (MoD) systems, the forecasting of rider demand is a cornerstone for operational decision-making and system optimization. Traditional forecasting methodologies primarily yield point estimates, thereby neglecting the inherent uncertainty within demand projections. Moreover, MoD demand levels are profoundly influenced by both endogenous and exogenous factors, leading to high and dynamic volatility. This volatility significantly undermines the efficacy of conventional time series forecasting methods. In response, we propose an Extended Recurrent Mixture Density Network (XRMDN), a novel deep learning framework engineered to address these challenges. XRMDN leverages a sophisticated architecture to process demand residuals and variance through correlated modules, allowing for the flexible incorporation of endogenous and exogenous data. This architecture, featuring recurrent connections within the weight, mean, and variance neural networks, adeptly captures demand trends, thus significantly enhancing forecasting precision, particularly in high-volatility scenarios. Our comprehensive experimental analysis, utilizing real-world MoD datasets, demonstrates that XRMDN surpasses the existing benchmark models across various metrics, notably excelling in high-demand volatility contexts. This advancement in probabilistic demand forecasting marks a significant contribution to the field, offering a robust tool for enhancing operational efficiency and customer satisfaction in MoD systems.


title: Enhancing Stance Classification with Quantified Moral Foundations

abstract: This study enhances stance detection on social media by incorporating deeper psychological attributes, specifically individuals' moral foundations. These theoretically-derived dimensions aim to provide a comprehensive profile of an individual's moral concerns which, in recent work, has been linked to behaviour in a range of domains, including society, politics, health, and the environment. In this paper, we investigate how moral foundation dimensions can contribute to predicting an individual's stance on a given target. Specifically we incorporate moral foundation features extracted from text, along with message semantic features, to classify stances at both message- and user-levels across a range of targets and models. Our preliminary results suggest that encoding moral foundations can enhance the performance of stance detection tasks and help illuminate the associations between specific moral foundations and online stances on target topics. The results highlight the importance of considering deeper psychological attributes in stance analysis and underscores the role of moral foundations in guiding online social behavior.


title: Solid state defect emitters with no electrical activity

abstract: Point defects may introduce defect levels into the fundamental band gap of the host semiconductors that alter the electrical properties of the material. As a consequence, the in-gap defect levels and states automatically lower the threshold energy of optical excitation associated with the optical gap of the host semiconductor. It is, therefore, a common assumption that solid state defect emitters in semiconductors ultimately alter the conductivity of the host. Here we demonstrate on a particular defect in 4H silicon carbide that a yet unrecognized class of point defects exists which are optically active but electrically inactive in the ground state.


title: Twenty-eight and counting

abstract: After 28 years from the conception of the pyramid WFS several new kind of devices able to convert wavefront shape into some sort of different illumination on a detector have been conceived. While, suspending momentarily any kind of modesty, I claim credit for being among the few that contributed to show at the time that there could be much more than just a lenslet array I continued -- with alternating successes -- to conceive other types of such devices.


title: Robust quantum teleportation via a non-Markovian channel

abstract: In this paper, we propose a non-Markovian quantum channel approach to mitigating the degradation of the average fidelity in continuous-variable quantum teleportation. The non-Markovian quantum channel is modeled by an augmented system, where ancillary systems are introduced to represent the internal modes of non-Markovian environments. With a proper non-Markovianity, enhanced effects of the channels on continuous-variable quantum teleportation are observed. Also, the logarithmic negativity of entangled states can be effectively maintained so that the decay of the average fidelity of quantum teleportation is mitigated. In addition, the analysis on different teleported quantum states shows that coherent states exhibit stronger robustness than those of squeezed states and cat states in quantum teleportation with a non-Markovian channel.


title: Alpha Elimination: Using Deep Reinforcement Learning to Reduce Fill-In during Sparse Matrix Decomposition

abstract: A large number of computational and scientific methods commonly require decomposing a sparse matrix into triangular factors as LU decomposition. A common problem faced during this decomposition is that even though the given matrix may be very sparse, the decomposition may lead to a denser triangular factors due to fill-in. A significant fill-in may lead to prohibitively larger computational costs and memory requirement during decomposition as well as during the solve phase. To this end, several heuristic sparse matrix reordering methods have been proposed to reduce fill-in before the decomposition. However, finding an optimal reordering algorithm that leads to minimal fill-in during such decomposition is known to be a NP-hard problem. A reinforcement learning based approach is proposed for this problem. The sparse matrix reordering problem is formulated as a single player game. More specifically, Monte-Carlo tree search in combination with neural network is used as a decision making algorithm to search for the best move in our game. The proposed method, alphaElimination is found to produce significantly lesser non-zeros in the LU decomposition as compared to existing state-of-the-art heuristic algorithms with little to no increase in overall running time of the algorithm. The code for the project will be publicly available here\footnote{\url{https://github.com/misterpawan/alphaEliminationPaper}}.


title: MERTech: Instrument Playing Technique Detection Using Self-Supervised Pretrained Model With Multi-Task Finetuning

abstract: Instrument playing techniques (IPTs) constitute a pivotal component of musical expression. However, the development of automatic IPT detection methods suffers from limited labeled data and inherent class imbalance issues. In this paper, we propose to apply a self-supervised learning model pre-trained on large-scale unlabeled music data and finetune it on IPT detection tasks. This approach addresses data scarcity and class imbalance challenges. Recognizing the significance of pitch in capturing the nuances of IPTs and the importance of onset in locating IPT events, we investigate multi-task finetuning with pitch and onset detection as auxiliary tasks. Additionally, we apply a post-processing approach for event-level prediction, where an IPT activation initiates an event only if the onset output confirms an onset in that frame. Our method outperforms prior approaches in both frame-level and event-level metrics across multiple IPT benchmark datasets. Further experiments demonstrate the efficacy of multi-task finetuning on each IPT class.


title: Let data talk: data-regularized operator learning theory for inverse problems

abstract: Regularization plays a pivotal role in integrating prior information into inverse problems. While many deep learning methods have been proposed to solve inverse problems, determining where to apply regularization remains a crucial consideration. Typical methods regularize neural networks via architecture, wherein neural network functions parametrize the parameter of interest or the regularization term. We introduce a novel approach, denoted as the "data-regularized operator learning" (DaROL) method, designed to address PDE inverse problems. The DaROL method trains a neural network on data, regularized through common techniques such as Tikhonov variational methods and Bayesian inference. The DaROL method offers flexibility across different frameworks, faster inverse problem-solving, and a simpler structure that separates regularization and neural network training. We demonstrate that training a neural network on the regularized data is equivalent to supervised learning for a regularized inverse map. Furthermore, we provide sufficient conditions for the smoothness of such a regularized inverse map and estimate the learning error in terms of neural network size and the number of training samples.


title: Long Baseline Neutrino Oscillation Results (T2K and NOvA)

abstract: The well-established neutrino oscillation phenomenon, which confirms neutrinos have mass and the charged and neutral leptons are mixed, has been widely exploited to investigate the physics of this elusive particle. The complete description of neutrino oscillations, which are dictated by two mass-squared splittings, three mixing angles, and one Dirac CP-violation phase, however, has yet to be reached. The ongoing accelerator-based long-baseline neutrino experiments, T2K and NOvA, are critical in completing this picture. Using data and analyses accessible by summer 2023, T2K favors a leptonic CP violation at more than 90\% C.L. while NOvA shows no preference of this indication. Both experiments weakly opt for the \emph{normal} neutrino mass ordering and higher octant of the $\theta_{23}$ mixing angle.


title: Pseudo-differential integral autoencoder network for inverse PDE operators

abstract: Partial differential equations (PDEs) play a foundational role in modeling physical phenomena. This study addresses the challenging task of determining variable coefficients within PDEs from measurement data. We introduce a novel neural network, "pseudo-differential IAEnet" (pd-IAEnet), which draws inspiration from pseudo-differential operators. pd-IAEnet achieves significantly enhanced computational speed and accuracy with fewer parameters compared to conventional models. Extensive benchmark evaluations are conducted across a range of inverse problems, including Electrical Impedance Tomography (EIT), optical tomography, and seismic imaging, consistently demonstrating pd-IAEnet's superior accuracy. Notably, pd-IAEnet exhibits robustness in the presence of measurement noise, a critical characteristic for real-world applications. An exceptional feature is its discretization invariance, enabling effective training on data from diverse discretization schemes while maintaining accuracy on different meshes. In summary, pd-IAEnet offers a potent and efficient solution for addressing inverse PDE problems, contributing to improved computational efficiency, robustness, and adaptability to a wide array of data sources.


title: On the ubiquity of oriented double rays

abstract: A digraph $H$ is called ubiquitous if every digraph that contains arbitrarily many vertex-disjoint copies of $H$ also contains infinitely many vertex-disjoint copies of $H$. We study oriented double rays, that is, digraphs $H$ whose underlying undirected graphs are double rays. Calling a vertex of an oriented double ray a turn if it has in-degree or out-degree 2, we prove that an oriented double ray with at least one turn is ubiquitous if and only if it has a (finite) odd number of turns. It remains an open problem to determine whether the consistently oriented double ray is ubiquitous.


title: Federated Reinforcement Learning for Resource Allocation in V2X Networks

abstract: Resource allocation significantly impacts the performance of vehicle-to-everything (V2X) networks. Most existing algorithms for resource allocation are based on optimization or machine learning (e.g., reinforcement learning). In this paper, we explore resource allocation in a V2X network under the framework of federated reinforcement learning (FRL). On one hand, the usage of RL overcomes many challenges from the model-based optimization schemes. On the other hand, federated learning (FL) enables agents to deal with a number of practical issues, such as privacy, communication overhead, and exploration efficiency. The framework of FRL is then implemented by the inexact alternative direction method of multipliers (ADMM), where subproblems are solved approximately using policy gradients and accelerated by an adaptive step size calculated from their second moments. The developed algorithm, PASM, is proven to be convergent under mild conditions and has a nice numerical performance compared with some baseline methods for solving the resource allocation problem in a V2X network.


title: Simplicial complex entropy for time series analysis

abstract: The complex behavior of many systems in nature requires the application of robust methodologies capable of identifying changes in their dynamics. In the case of time series (which are sensed values of a system during a time interval), several methods have been proposed to evaluate their irregularity. However, for some types of dynamics such as stochastic and chaotic, new approaches are required that can provide a better characterization of them. In this paper we present the simplicial complex approximate entropy (SCAE), which is based on the conditional probability of the occurrence of elements of a simplicial complex. Our results show that this entropy measure provides a wide range of values with details not easily identifiable with standard methods. In particular, we show that our method is able to quantify the irregularity in simulated random sequences and those from low-dimensional chaotic dynamics. Furthermore, it is possible to consistently differentiate cardiac interbeat sequences from healthy subjects and from patients with heart failure, as well as to identify changes between dynamical states of coupled chaotic maps. Our results highlight the importance of the structures revealed by the simplicial complexes, which holds promise for applications of this approach in various contexts.


title: Posets of Copies of Countable Ultrahomogeneous Tournaments

abstract: The poset of copies of a relational structure ${\mathbb X}$ is the partial order ${\mathbb P} ({\mathbb X} ) := \langle \{ Y \subset X: {\mathbb Y} \cong {\mathbb X}\}, \subset \rangle$ and each similarity of such posets (e.g. isomorphism, forcing equivalence) determines a classification of structures. We consider the countable ultrahomogeneous tournaments: ${\mathbb Q} $ (the rational line), ${\mathbb S} (2)$ (the circular tournament), and ${\mathbb T} ^\infty$ (the random tournament); as well as the ultrahomogeneous digraphs ${\mathbb S} (3)$, ${\mathbb Q} [{\mathbb I}_n]$, ${\mathbb S} (2)[{\mathbb I}_n]$ and ${\mathbb T} ^\infty [{\mathbb I}_n]$ from Cherlin's list. If ${\mathbb G} _{{\mathrm{Rado}}}$ (resp. ${\mathbb Q} _n$) denotes the countable homogeneous universal graph (resp. $n$-labeled linear order), it turns out that ${\mathbb P} ({\mathbb T} ^\infty)\cong {\mathbb P} ({\mathbb G}_{{\mathrm{Rado}}})$ and that ${\mathbb P} ({\mathbb Q} _n)$ densely embeds in ${\mathbb P} ({\mathbb S} (n))$, for $n\in\{ 2,3\}$. Consequently, ${\mathbb B} _{\mathbb X} \cong {\mathrm{ro}}\, ({\mathbb S} \ast \pi)$, where ${\mathbb S}$ is the Sacks forcing and $1_{\mathbb S} \Vdash "\pi $ is a separative, atomless and $\sigma$-closed forcing", whenever ${\mathbb X}$ is a countable structure equimorphic with ${\mathbb Q}$, ${\mathbb Q} _n$, ${\mathbb S} (2)$, ${\mathbb S} (3)$, ${\mathbb Q} [{\mathbb I}_n]$ or ${\mathbb S} (2)[{\mathbb I}_n]$. Also, ${\mathbb B} _{\mathbb X} \cong {\mathrm{ro}}\, ({\mathbb S} \ast \pi)$, where $1_{\mathbb S} \Vdash "\pi $ is an $\omega$-distributive forcing", whenever ${\mathbb X}$ is a countable graph embedding ${\mathbb G} _{{\mathrm{Rado}}}$, or a countable tournament embedding ${\mathbb T} ^\infty$, or ${\mathbb X} ={\mathbb T} ^\infty [{\mathbb I}_n]$.


title: Stacked Intelligent Metasurface Performs a 2D DFT in the Wave Domain for DOA Estimation

abstract: Staked intelligent metasurface (SIM) based techniques are developed to perform two-dimensional (2D) direction-of-arrival (DOA) estimation. In contrast to the conventional designs, an advanced SIM in front of the receiving array automatically performs the 2D discrete Fourier transform (DFT) as the incident waves propagate through it. To arrange for the SIM to carry out this task, we design a gradient descent algorithm for iteratively updating the phase shift of each meta-atom in the SIM to minimize the fitting error between the SIM's response and the 2D DFT matrix. To further improve the DOA estimation accuracy, we configure the phase shifts in the input layer of SIM to generate a set of 2D DFT matrices having orthogonal spatial frequency bins. Extensive numerical simulations verify the capability of a well-trained SIM to perform 2D DFT. Specifically, it is demonstrated that the SIM having an optical computational speed achieves an MSE of $10^{-4}$ in 2D DOA estimation.


title: Impurity-doped scalar fields in arbitrary dimensions

abstract: We investigate the presence of localized structures for relativistic scalar fields coupled to impurities in arbitrary spatial dimensions. Such systems present spatial inhomogeneity, realized through the inclusion of explicit coordinate dependence in the Lagrangian. It is shown that, in stark contrast to the impurity-free scenario, Derrick's argument does not present a strong hindrance to the existence of stable solutions in this case. Bogomol'nyi equations giving rise to global minima of the energy are found, and some of the ensuing BPS configurations are presented.


title: Quantum radiation reaction spectrum of electrons in plane waves

abstract: In previous works we derived equations for the average momentum of high-energy electrons experiencing quantum radiation reaction (RR) in strong electromagnetic plane-wave background fields. In this paper we derive similar equations for the momentum spectrum. We formulate the equations in terms of the cumulative function and study the relation between the equations for the spectrum and the equations for the moments, analyze the structure of the low-energy expansions, and finally explain how our formulation is essentially in terms of a ``Green's function'' which allows us to study the dynamics without choosing a specific initial wave packet (or particle-bunch distribution).


title: Vavilov-Cherenkov emission with a twist: a study of the final entangled state

abstract: We present a theoretical investigation of the Vavilov-Cherenkov (VC) radiation by a plane-wave or twisted electron. Special emphasis is put on the question whether and at what conditions the emitted VC photons can be twisted. For this aim we obtain a general expression in the coordinate and momentum representations for the quantum state of the final electron-photon system that is a result of the radiation process itself and does not depend on the properties of a detector. It is shown that this evolved state is an entangled state of an electron and a photon, and both particles can be twisted. A direct consequence of this result follows: if one uses a detector sensitive to the twisted electron (photon) with the definite projection of the total angular momentum (TAM), then the final photon (electron) also will be in the twisted state with a definite TAM projection. Further, we investigate the polarization properties of the final twisted photon in more general conditions than has been calculated before. Finally, we exploit a close similarity between the discussed VC radiation and the process of the equivalent photon emission in the Weizs\"acker-Williams method and find the corresponding final state.


title: Asymptotic Stability of 3D relativistic Collisionless plasma states in a constant magnetic field with a boundary

abstract: Motivated by solar wind models in the low altitude, we explore a boundary problem of the nonlinear relativistic Vlasov-Poisson systems in the 3D half space in the presence of a constant vertical magnetic field and strong background gravity with the inflow boundary condition. As the main result, we construct stationary solutions and establish their nonlinear dynamical asymptotic stability.


title: Federated Multi-Objective Learning

abstract: In recent years, multi-objective optimization (MOO) emerges as a foundational problem underpinning many multi-agent multi-task learning applications. However, existing algorithms in MOO literature remain limited to centralized learning settings, which do not satisfy the distributed nature and data privacy needs of such multi-agent multi-task learning applications. This motivates us to propose a new federated multi-objective learning (FMOL) framework with multiple clients distributively and collaboratively solving an MOO problem while keeping their training data private. Notably, our FMOL framework allows a different set of objective functions across different clients to support a wide range of applications, which advances and generalizes the MOO formulation to the federated learning paradigm for the first time. For this FMOL framework, we propose two new federated multi-objective optimization (FMOO) algorithms called federated multi-gradient descent averaging (FMGDA) and federated stochastic multi-gradient descent averaging (FSMGDA). Both algorithms allow local updates to significantly reduce communication costs, while achieving the {\em same} convergence rates as those of their algorithmic counterparts in the single-objective federated learning. Our extensive experiments also corroborate the efficacy of our proposed FMOO algorithms.


title: A remark on Ado's Theorem for principal ideal domains

abstract: Ado's Theorem had been extended to principal ideal domains independently by Churkin and Weigel. They demonstrated that if $R$ is a principal ideal domain of characteristic zero and $\mathfrak{L}$ is a Lie algebra over $R$ which is also a free $R$-module of finite rank, then $\mathfrak{L}$ admits a finite faithful Lie algebra representation over $R$. We present a quantitative proof of this result, providing explicit bounds on the degree of the Lie algebra representations in terms of the rank of the free module. To achieve it, we generalise an established embedding theorem for complex Lie algebras: any Lie algebra as above embeds within a larger Lie algebra that decomposes as the direct sum of its nilpotent radical and another subalgebra.


title: The treasure behind the haystack: MUSE analysis of five recently discovered globular clusters

abstract: After the second data release of Gaia, the number of new globular cluster candidates has increased importantly. However, most of them need to be properly characterised, both spectroscopically and photometrically, by means of radial velocities, metallicities, and deeper photometric observations. Our goal is to provide an independent confirmation of the cluster nature of Gran 4, a recently discovered globular cluster, with follow-up spectroscopic observations. The derived radial velocity for individual stars, coupled with proper motions, allows us to isolate cluster members from field stars, while the analysis of their spectra allows us to derive metallicities. By including in the analysis the recently confirmed clusters Gran 1, 2, 3, and 5, we aim to completely characterise the sample presented in Gran et al. 2022. Using Gaia DR3 and VVV catalogue data and MUSE@VLT observations, we performed a selection of cluster members based on their proper motions, radial velocities and their position in colour-magnitude diagrams. Furthermore, full spectral synthesis was performed on the cluster members, extracting surface parameters and metallicity from MUSE spectra. Finally, a completeness estimation was performed on the total globular cluster population of the Milky Way. We confirm the nature of Gran 4, a newly discovered globular cluster behind the Galactic bulge, with a mean radial velocity of ${\rm RV} = -265.28 \pm 3.92$ km s$^{-1}$ and a mean metallicity of ${\rm [Fe/H] = -1.72 \pm 0.32}$ dex. Additionally, independent measurements of the metallicities were derived for Gran 1, 2, 3, and 5. We also revise the observational lower mass limit for a globular cluster to survive in the bulge/disk environment. We estimate that $\sim 12-26$ globular clusters have still to be discovered on the other side of the Galaxy (i.e., behind the bulge/bar/disk), up to 20 kpc.


title: Memory switching due to thermal noise in amorphous solids subject to cyclic shear

abstract: The discovery that memory of particle configurations and plastic events can be stored in amorphous solids subject to oscillatory shear has spurred research into methods for storing and retrieving information from these materials. However, it is unclear to what extent the ability to store memory is affected by thermal fluctuations and other environmental noises, which are expected to be relevant in realistic situations. Here, we show that while memory has a long lifetime at low temperatures, thermal fluctuations eventually lead to a catastrophic loss of memory, resulting in the erasure of most or all of the stored information within a few forcing cycles. We observe that an escape from the memory-retaining state (limit cycle) is triggered by a change in the switching of plastic events, leading to a cascade of new plastic events that were not present in the original limit cycle. The displacements from the new plastic events change the particle configuration which leads to the loss of memory. We further show that the rate of escaping from a limit cycle increases in a non-Arrhenius manner as a function of temperature, and the probability of staying in a limit cycle decays exponentially with an increase in the shearing frequency. These results have important implications for memory storage since increasing the temperature offers a means of effectively erasing existing memories and allowing for the imprinting of new ones that can then be stored for a long time at low temperatures.


title: Two-loop master integrals for a planar topology contributing to $pp \rightarrow t\bar{t}j$

abstract: We report on recent progress for the QCD corrections to top quark pair plus jet production. In particular, we discuss a recent computation for the two-loop master integrals associated to a two-loop five-point pentagon-box integral configuration with one internal massive propagator, that contributes to top quark pair production in association with a jet in the QCD planar limit.


title: Multivariate sensitivity-adaptive polynomial chaos expansion for high-dimensional surrogate modeling and uncertainty quantification

abstract: This work develops a novel basis-adaptive method for constructing anisotropic polynomial chaos expansions of multidimensional (vector-valued, multi-output) model responses. The adaptive basis selection is based on multivariate sensitivity analysis metrics that can be estimated by post-processing the polynomial chaos expansion and results in a common anisotropic polynomial basis for the vector-valued response. This allows the application of the method to problems with up to moderately high-dimensional model inputs (in the order of tens) and up to very high-dimensional model responses (in the order of thousands). The method is applied to different engineering test cases for surrogate modeling and uncertainty quantification, producing highly accurate results with low data and computational demand.


title: Empower Text-Attributed Graphs Learning with Large Language Models (LLMs)

abstract: Text-attributed graphs have recently garnered significant attention due to their wide range of applications in web domains. Existing methodologies employ word embedding models for acquiring text representations as node features, which are subsequently fed into Graph Neural Networks (GNNs) for training. Recently, the advent of Large Language Models (LLMs) has introduced their powerful capabilities in information retrieval and text generation, which can greatly enhance the text attributes of graph data. Furthermore, the acquisition and labeling of extensive datasets are both costly and time-consuming endeavors. Consequently, few-shot learning has emerged as a crucial problem in the context of graph learning tasks. In order to tackle this challenge, we propose a lightweight paradigm called ENG, which adopts a plug-and-play approach to empower text-attributed graphs through node generation using LLMs. Specifically, we utilize LLMs to extract semantic information from the labels and generate samples that belong to these categories as exemplars. Subsequently, we employ an edge predictor to capture the structural information inherent in the raw dataset and integrate the newly generated samples into the original graph. This approach harnesses LLMs for enhancing class-level information and seamlessly introduces labeled nodes and edges without modifying the raw dataset, thereby facilitating the node classification task in few-shot scenarios. Extensive experiments demonstrate the outstanding performance of our proposed paradigm, particularly in low-shot scenarios. For instance, in the 1-shot setting of the ogbn-arxiv dataset, ENG achieves a 76% improvement over the baseline model.


title: Reinforcement Learning for Reduced-order Models of Legged Robots

abstract: Model-based approaches for planning and control for bipedal locomotion have a long history of success. It can provide stability and safety guarantees while being effective in accomplishing many locomotion tasks. Model-free reinforcement learning, on the other hand, has gained much popularity in recent years due to computational advancements. It can achieve high performance in specific tasks, but it lacks physical interpretability and flexibility in re-purposing the policy for a different set of tasks. For instance, we can initially train a neural network (NN) policy using velocity commands as inputs. However, to handle new task commands like desired hand or footstep locations at a desired walking velocity, we must retrain a new NN policy. In this work, we attempt to bridge the gap between these two bodies of work on a bipedal platform. We formulate a model-based reinforcement learning problem to learn a reduced-order model (ROM) within a model predictive control (MPC). Results show a 49% improvement in viable task region size and a 21% reduction in motor torque cost. All videos and code are available at https://sites.google.com/view/ymchen/research/rl-for-roms.


title: TF-DCon: Leveraging Large Language Models (LLMs) to Empower Training-Free Dataset Condensation for Content-Based Recommendation

abstract: Modern techniques in Content-based Recommendation (CBR) leverage item content information to provide personalized services to users, but suffer from resource-intensive training on large datasets. To address this issue, we explore the dataset condensation for textual CBR in this paper. The goal of dataset condensation is to synthesize a small yet informative dataset, upon which models can achieve performance comparable to those trained on large datasets. While existing condensation approaches are tailored to classification tasks for continuous data like images or embeddings, direct application of them to CBR has limitations. To bridge this gap, we investigate efficient dataset condensation for content-based recommendation. Inspired by the remarkable abilities of large language models (LLMs) in text comprehension and generation, we leverage LLMs to empower the generation of textual content during condensation. To handle the interaction data involving both users and items, we devise a dual-level condensation method: content-level and user-level. At content-level, we utilize LLMs to condense all contents of an item into a new informative title. At user-level, we design a clustering-based synthesis module, where we first utilize LLMs to extract user interests. Then, the user interests and user embeddings are incorporated to condense users and generate interactions for condensed users. Notably, the condensation paradigm of this method is forward and free from iterative optimization on the synthesized dataset. Extensive empirical findings from our study, conducted on three authentic datasets, substantiate the efficacy of the proposed method. Particularly, we are able to approximate up to 97% of the original performance while reducing the dataset size by 95% (i.e., on dataset MIND).


title: Free as a Bird: Event-based Dynamic Sense-and-Avoid for Ornithopter Robot Flight

abstract: Autonomous flight of flapping-wing robots is a major challenge for robot perception. Most of the previous sense-and-avoid works have studied the problem of obstacle avoidance for flapping-wing robots considering only static obstacles. This paper presents a fully onboard dynamic sense-and-avoid scheme for large-scale ornithopters using event cameras. These sensors trigger pixel information due to changes of illumination in the scene such as those produced by dynamic objects. The method performs event-by-event processing in low-cost hardware such as those onboard small aerial vehicles. The proposed scheme detects obstacles and evaluates possible collisions with the robot body. The onboard controller actuates over the horizontal and vertical tail deflections to execute the avoidance maneuver. The scheme is validated in both indoor and outdoor scenarios using obstacles of different shapes and sizes. To the best of the authors' knowledge, this is the first event-based method for dynamic obstacle avoidance in a flapping-wing robot.


title: Bounding and Filling: A Fast and Flexible Framework for Image Captioning

abstract: Most image captioning models following an autoregressive manner suffer from significant inference latency. Several models adopted a non-autoregressive manner to speed up the process. However, the vanilla non-autoregressive manner results in subpar performance, since it generates all words simultaneously, which fails to capture the relationships between words in a description. The semi-autoregressive manner employs a partially parallel method to preserve performance, but it sacrifices inference speed. In this paper, we introduce a fast and flexible framework for image captioning called BoFiCap based on bounding and filling techniques. The BoFiCap model leverages the inherent characteristics of image captioning tasks to pre-define bounding boxes for image regions and their relationships. Subsequently, the BoFiCap model fills corresponding words in each box using two-generation manners. Leveraging the box hints, our filling process allows each word to better perceive other words. Additionally, our model offers flexible image description generation: 1) by employing different generation manners based on speed or performance requirements, 2) producing varied sentences based on user-specified boxes. Experimental evaluations on the MS-COCO benchmark dataset demonstrate that our framework in a non-autoregressive manner achieves the state-of-the-art on task-specific metric CIDEr (125.6) while speeding up 9.22x than the baseline model with an autoregressive manner; in a semi-autoregressive manner, our method reaches 128.4 on CIDEr while a 3.69x speedup. Our code and data is available at https://github.com/ChangxinWang/BoFiCap.


title: Statistical inference using machine learning and classical techniques based on accumulated local effects (ALE)

abstract: Accumulated Local Effects (ALE) is a model-agnostic approach for global explanations of the results of black-box machine learning (ML) algorithms. There are at least three challenges with conducting statistical inference based on ALE: ensuring the reliability of ALE analyses, especially in the context of small datasets; intuitively characterizing a variable's overall effect in ML; and making robust inferences from ML data analysis. In response, we introduce innovative tools and techniques for statistical inference using ALE, establishing bootstrapped confidence intervals tailored to dataset size and introducing ALE effect size measures that intuitively indicate effects on both the outcome variable scale and a normalized scale. Furthermore, we demonstrate how to use these tools to draw reliable statistical inferences, reflecting the flexible patterns ALE adeptly highlights, with implementations available in the 'ale' package in R. This work propels the discourse on ALE and its applicability in ML and statistical analysis forward, offering practical solutions to prevailing challenges in the field.


title: Three-dimensional calculations of the inductive coupling between radio-frequency waves and plasma in the drivers of the SPIDER device

abstract: This work documents the initial 3D calculations to simulate the coupling between radio-frequency (RF) waves and plasma in discharges of the SPIDER device. Axisymmetric 3D calculations in the plasma domain alone compare well against equivalent 2D cases. A model of SPIDER driver, the cylindrical chamber where the plasma is heated by the RF drive, is then defined including the metallic parts of the Faraday shield, insulator and vacuum layer up to the RF winding (not included in the calculation domain). Estimates of the power share in the different parts are obtained using experimental conditions and plasma data. The results are sensitive to the particular geometry of the driver and the temperature of the Faraday shield, but generally agree with the experimental knowledge. The ratio between total delivered power and plasma absorbed power is found, depending on the plasma parameters, in the range 30--45\%


title: Coherent Distorted Beliefs

abstract: Many models of economics assume that individuals distort objective probabilities. We propose a simple consistency condition on distortion functions, which we term distortion coherence, that ensures that the function commutes with conditioning on an event. We show that distortion coherence restricts belief distortions to have a particular function form: power-weighted distortions, where distorted beliefs are proportional to the original beliefs raised to a power and weighted by a state-specific value. We generalize our findings to allow for distortions of the probabilities assigned to both states and signals, which nests the functional forms widely used in studying probabilistic biases (e.g., Grether, 1980 and Benjamin, 2019). We show how coherent distorted beliefs are tightly related to several extant models of motivated beliefs: they are the outcome of maximizing anticipated expected utility subject to a generalized Kullback-Liebler cost of distortion. Moreover, in the domain of lottery choice, we link coherent distortions to explanations of non-expected utility like the Allais paradox: individuals who maximize subjective expected utility maximizers conditional on coherent distorted beliefs are equivalent to the weighted utility maximizers studied by Chew [1983].


title: Decoherence is an echo of Anderson localization in open quantum systems

abstract: We study the time evolution of single-particle quantum states described by a Lindblad master equation with local terms. By means of a geometric resolvent equation derived for Lindblad generators, we establish a finite-volume-type criterion for the decay of the off-diagonal matrix elements in the position basis of the time-evolved or steady states. This criterion is shown to yield exponential decay for systems where the non-hermitian evolution is either gapped or strongly disordered. The gap exists for example whenever any level of local dephasing is present in the system. The result in the disordered case can be viewed as an extension of Anderson localization to open quantum systems.


title: In-Context Learning with Iterative Demonstration Selection

abstract: Spurred by advancements in scale, large language models (LLMs) have demonstrated strong few-shot learning ability via in-context learning (ICL). However, the performance of ICL has been shown to be highly sensitive to the selection of few-shot demonstrations. Selecting the most suitable examples as context remains an ongoing challenge and an open problem. Existing literature has highlighted the importance of selecting examples that are diverse or semantically similar to the test sample while ignoring the fact that the optimal selection dimension, i.e., diversity or similarity, is task-specific. Based on how the test sample is answered, we propose Iterative Demonstration Selection (IDS) to leverage the merits of both dimensions. Using zero-shot chain-of-thought reasoning (Zero-shot-CoT), IDS iteratively selects examples that are diverse but still strongly correlated with the test sample as ICL demonstrations. Specifically, IDS applies Zero-shot-CoT to the test sample before demonstration selection. The output reasoning path is then used to choose demonstrations that are prepended to the test sample for inference. The generated answer is followed by its corresponding reasoning path for extracting a new set of demonstrations in the next iteration. After several iterations, IDS adopts majority voting to obtain the final result. Through extensive experiments on tasks including reasoning, question answering, and topic classification, we demonstrate that IDS can consistently outperform existing ICL demonstration selection methods.


title: Room-temperature waveguide-coupled silicon single-photon avalanche diodes

abstract: Single photon detection is important for a wide range of low-light applications, including quantum information processing, spectroscopy, and light detection and ranging (LiDAR). A key challenge in these applications has been to integrate single-photon detection capability into photonic circuits for the realization of complex photonic microsystems. Short-wavelength ($\lambda$ < 1.1 $\mu$m) integrated photonics platforms that use silicon (Si) as photodetectors offer the opportunity to achieve single-photon avalanche diodes (SPADs) that operate at or near room temperature. Here, we report the first waveguide-coupled Si SPAD. The device is monolithically integrated in a Si photonic platform and operates in the visible spectrum. The device exhibited a single photon detection efficiency of > 6% for wavelengths of 488 nm and 532 nm with an excess voltage less than 20% of the breakdown voltage. The dark count rate was below 100 kHz at room temperature, with the possibility of improving by approximately 35% by reducing the temperature to -5$^{\circ}$C.


title: Zero-Shot Object Goal Visual Navigation With Class-Independent Relationship Network

abstract: This paper investigates the zero-shot object goal visual navigation problem. In the object goal visual navigation task, the agent needs to locate navigation targets from its egocentric visual input. "Zero-shot" means that the target the agent needs to find is not trained during the training phase. To address the issue of coupling navigation ability with target features during training, we propose the Class-Independent Relationship Network (CIRN). This method combines target detection information with the relative semantic similarity between the target and the navigation target, and constructs a brand new state representation based on similarity ranking, this state representation does not include target feature or environment feature, effectively decoupling the agent's navigation ability from target features. And a Graph Convolutional Network (GCN) is employed to learn the relationships between different objects based on their similarities. During testing, our approach demonstrates strong generalization capabilities, including zero-shot navigation tasks with different targets and environments. Through extensive experiments in the AI2-THOR virtual environment, our method outperforms the current state-of-the-art approaches in the zero-shot object goal visual navigation task. Furthermore, we conducted experiments in more challenging cross-target and cross-scene settings, which further validate the robustness and generalization ability of our method. Our code is available at: https://github.com/SmartAndCleverRobot/ICRA-CIRN.


title: Unmasking the Web of Deceit: Uncovering Coordinated Activity to Expose Information Operations on Twitter

abstract: Social media platforms, particularly Twitter, have become pivotal arenas for influence campaigns, often orchestrated by state-sponsored information operations (IOs). This paper delves into the detection of key players driving IOs by employing similarity graphs constructed from behavioral pattern data. We unveil that well-known, yet underutilized network properties can help accurately identify coordinated IO drivers. Drawing from a comprehensive dataset of 49 million tweets from six countries, which includes multiple verified IOs, our study reveals that traditional network filtering techniques do not consistently pinpoint IO drivers across campaigns. We first propose a framework based on node pruning that emerges superior, particularly when combining multiple behavioral indicators across different networks. Then, we introduce a supervised machine learning model that harnesses a vector representation of the fused similarity network. This model, which boasts a precision exceeding 0.95, adeptly classifies IO drivers on a global scale and reliably forecasts their temporal engagements. Our findings are crucial in the fight against deceptive influence campaigns on social media, helping us better understand and detect them.


title: On best-response algorithms for monotone Nash equilibrium problems with mixed-integer variables

abstract: We characterize the convergence properties of traditional best-response (BR) algorithms in computing solutions to mixed-integer Nash equilibrium problems (MI-NEPs) that turn into a class of monotone Nash equilibrium problems (NEPs) once relaxed the integer restrictions. We show that the sequence produced by a Jacobi/Gauss-Seidel BR method always approaches a bounded region containing the entire solution set of the MI-NEP, whose tightness depends on the problem data, and it is related to the degree of strong monotonicity of the relaxed NEP. When the underlying algorithm is applied to the relaxed NEP, we establish data-dependent complexity results characterizing its convergence to the unique solution of the NEP. In addition, we derive one of the very few sufficient conditions for the existence of solutions to MI-NEPs. The theoretical results developed bring important practical advantages that are illustrated on a numerical instance of a smart building control application.


title: Lifelong Sequence Generation with Dynamic Module Expansion and Adaptation

abstract: Lifelong sequence generation (LSG), a problem in continual learning, aims to continually train a model on a sequence of generation tasks to learn constantly emerging new generation patterns while avoiding the forgetting of previous knowledge. Existing LSG methods mainly focus on maintaining old knowledge while paying little attention to knowledge transfer across tasks. In contrast, humans can better learn new tasks by leveraging previously acquired knowledge from similar tasks. Inspired by the learning paradigm of humans, we propose Dynamic Module Expansion and Adaptation (DMEA), which enables the model to dynamically determine the architecture for acquiring new knowledge based on task correlation and select the most similar previous tasks to facilitate adaptation to new tasks. In addition, as the learning process can easily be biased towards the current task which might cause more severe forgetting of previously learned knowledge, we propose dynamic gradient scaling to balance the learning of the current task and replayed tasks. With extensive experiments, we demonstrate that DMEA can consistently outperform existing methods in different LSG settings.


title: Imprints of new physics in {\Lambda}_b decays into {\Lambda}*(1520)l^+ l^- in non-universal Z^' model

abstract: Inspired by various updated tantalizing results of LHCb on baryonic sector we study the {\Lambda}_b decays into {\Lambda}^* (1520)l^+ l^- decay in non-universal Z^' model. We present the four-fold angular distributions of the decay in terms of transversity amplitudes. We structure the observables: differential branching ratio, lepton side forward backward asymmetries and polarization fractions in terms of the transversity amplitudes and incorporate the new physics (NP) terms in it. We reduce the number of the form factors using the improved Isgur-Wise relations. We study the observables in the standard model (SM) as well as in non-universal Z^' model. The predicted values are very interesting for the high energy physics community and results might provide prominent footprints of NP.


title: A mirror theorem for non-split toric bundles

abstract: We construct an I-function for toric bundles obtained as a fiberwise GIT quotient of a (not necessarily split) vector bundle. This is a generalization of Brown's I-function for split toric bundles and the I-function for non-split projective bundles. In order to prove the mirror theorem, we establish a characterization of points on the Givental Lagrangian cones of toric bundles and prove a mirror theorem for the twisted Gromov-Witten theory of a fiber product of projective bundles. The former result generalizes Brown's characterization for split toric bundles to the non-split case.


title: The Capacity Region of Information Theoretic Secure Aggregation with Uncoded Groupwise Keys

abstract: This paper considers the secure aggregation problem for federated learning under an information theoretic cryptographic formulation, where distributed training nodes (referred to as users) train models based on their own local data and a curious-but-honest server aggregates the trained models without retrieving other information about users' local data. Secure aggregation generally contains two phases, namely key sharing phase and model aggregation phase. Due to the common effect of user dropouts in federated learning, the model aggregation phase should contain two rounds, where in the first round the users transmit masked models and, in the second round, according to the identity of surviving users after the first round, these surviving users transmit some further messages to help the server decrypt the sum of users' trained models. The objective of the considered information theoretic formulation is to characterize the capacity region of the communication rates in the two rounds from the users to the server in the model aggregation phase, assuming that key sharing has already been performed offline in prior. In this context, Zhao and Sun completely characterized the capacity region under the assumption that the keys can be arbitrary random variables. More recently, an additional constraint, known as "uncoded groupwise keys," has been introduced. This constraint entails the presence of multiple independent keys within the system, with each key being shared by precisely S users. The capacity region for the information-theoretic secure aggregation problem with uncoded groupwise keys was established in our recent work subject to the condition S > K - U, where K is the number of total users and U is the designed minimum number of surviving users. In this paper we fully characterize of the the capacity region for this problem by proposing a new converse bound and an achievable scheme.


title: Score-Based Methods for Discrete Optimization in Deep Learning

abstract: Discrete optimization problems often arise in deep learning tasks, despite the fact that neural networks typically operate on continuous data. One class of these problems involve objective functions which depend on neural networks, but optimization variables which are discrete. Although the discrete optimization literature provides efficient algorithms, they are still impractical in these settings due to the high cost of an objective function evaluation, which involves a neural network forward-pass. In particular, they require $O(n)$ complexity per iteration, but real data such as point clouds have values of $n$ in thousands or more. In this paper, we investigate a score-based approximation framework to solve such problems. This framework uses a score function as a proxy for the marginal gain of the objective, leveraging embeddings of the discrete variables and speed of auto-differentiation frameworks to compute backward-passes in parallel. We experimentally demonstrate, in adversarial set classification tasks, that our method achieves a superior trade-off in terms of speed and solution quality compared to heuristic methods.


title: Towards Deep Learning Models Resistant to Transfer-based Adversarial Attacks via Data-centric Robust Learning

abstract: Transfer-based adversarial attacks raise a severe threat to real-world deep learning systems since they do not require access to target models. Adversarial training (AT), which is recognized as the strongest defense against white-box attacks, has also guaranteed high robustness to (black-box) transfer-based attacks. However, AT suffers from heavy computational overhead since it optimizes the adversarial examples during the whole training process. In this paper, we demonstrate that such heavy optimization is not necessary for AT against transfer-based attacks. Instead, a one-shot adversarial augmentation prior to training is sufficient, and we name this new defense paradigm Data-centric Robust Learning (DRL). Our experimental results show that DRL outperforms widely-used AT techniques (e.g., PGD-AT, TRADES, EAT, and FAT) in terms of black-box robustness and even surpasses the top-1 defense on RobustBench when combined with diverse data augmentations and loss regularizations. We also identify other benefits of DRL, for instance, the model generalization capability and robust fairness.


title: Active Perception using Neural Radiance Fields

abstract: We study active perception from first principles to argue that an autonomous agent performing active perception should maximize the mutual information that past observations posses about future ones. Doing so requires (a) a representation of the scene that summarizes past observations and the ability to update this representation to incorporate new observations (state estimation and mapping), (b) the ability to synthesize new observations of the scene (a generative model), and (c) the ability to select control trajectories that maximize predictive information (planning). This motivates a neural radiance field (NeRF)-like representation which captures photometric, geometric and semantic properties of the scene grounded. This representation is well-suited to synthesizing new observations from different viewpoints. And thereby, a sampling-based planner can be used to calculate the predictive information from synthetic observations along dynamically-feasible trajectories. We use active perception for exploring cluttered indoor environments and employ a notion of semantic uncertainty to check for the successful completion of an exploration task. We demonstrate these ideas via simulation in realistic 3D indoor environments.


title: Adaptive Contact-Implicit Model Predictive Control with Online Residual Learning

abstract: The hybrid nature of multi-contact robotic systems, due to making and breaking contact with the environment, creates significant challenges for high-quality control. Existing model-based methods typically rely on either good prior knowledge of the multi-contact model or require significant offline model tuning effort, thus resulting in low adaptability and robustness. In this paper, we propose a real-time adaptive multi-contact model predictive control framework, which enables online adaption of the hybrid multi-contact model and continuous improvement of the control performance for contact-rich tasks. This framework includes an adaption module, which continuously learns a residual of the hybrid model to minimize the gap between the prior model and reality, and a real-time multi-contact MPC controller. We demonstrated the effectiveness of the framework in synthetic examples, and applied it on hardware to solve contact-rich manipulation tasks, where a robot uses its end-effector to roll different unknown objects on a table to track given paths. The hardware experiments show that with a rough prior model, the multi-contact MPC controller adapts itself on-the-fly with an adaption rate around 20 Hz and successfully manipulates previously unknown objects with non-smooth surface geometries.


title: Vector Focus Wave Modes with Elliptic Cross-Section

abstract: Nondiffracting pulsed beams are well studied nowadays and can be as short as a few femtoseconds. The nondiffracting pulsed beams not only resist diffraction but also propagate without changes due to the dispersion of a linear dispersive medium. A promising member of non-diffracting beam family is the so-called Mathieu beam which is a solution of Helmholtz wave equation in elliptical coordinate system. Zeroth order even Mathieu beams have unique asymmetric cross-section which makes these beams suitable for precise material processing. In this work we derive vectorial Mathieu beams using classical techniques and superpose them to create femtosecond pulsed beams. For these pulsed beams diffraction spreading and dispersive broadening is compensated by a given angular dispersion. Various intensity distributions, durations, angular dispersions and polarization states of different vector Mathieu focus wave modes are presented and discussed in detail.


title: A priori tests of turbulence models for compressible flows

abstract: A priori tests of turbulence models for the compressible Reynolds-Averaged Navier--Stokes (RANS) are performed by using Direct Numerical Simulations (DNS) data of zero-pressure-gradient flat-plate turbulent boundary layers. The DNS database covers a wide range of operating conditions, ranging from supersonic ($M_\infty = 2.25$) up to the high-enthalpy hypersonic regime ($M_\infty= 12.48$). Several RANS closures and compressibility corrections in the literature are assessed against the exact terms from the DNS. Particular attention is paid to closure models for the turbulent heat fluxes and the dilatational dissipation, as well as to the analysis of turbulence/chemistry and turbulence/vibrational relaxation interactions for the high-enthalpy simulations.


title: Parabolic Vector Focus Wave Modes

abstract: Weber-type parabolic beams have a transverse intensity profile, which is parabolically-shaped and can be flexibly controlled. On the other hand, this type of beams belongs to the family of the so-called nondiffracting beams and have properties, promising for applications where the shape of the beam is of an importance. Vector electromagnetic theory has to be introduced in order to fully describe optical beams inside a high numerical aperture system, where the angles of the spatial spectra are large. We introduce here parabolic vector focus wave modes (FWM), which are both resistant to diffraction and to material dispersion. We employ here a spectral approach and investigate durations of parabolic vector FWMs in the femtosecond region. Two cases of transverse electric and transverse magnetic modes are introduced and both standing and traveling types of waves are considered. We demonstrate how the angular dispersion affects the pulse shape and its properties. Parabolic vector FWMs are studied in a transparent dielectric media (sapphire), which is widely used as laser processed material.


title: Reformulating NLP tasks to Capture Longitudinal Manifestation of Language Disorders in People with Dementia

abstract: Dementia is associated with language disorders which impede communication. Here, we automatically learn linguistic disorder patterns by making use of a moderately-sized pre-trained language model and forcing it to focus on reformulated natural language processing (NLP) tasks and associated linguistic patterns. Our experiments show that NLP tasks that encapsulate contextual information and enhance the gradient signal with linguistic patterns benefit performance. We then use the probability estimates from the best model to construct digital linguistic markers measuring the overall quality in communication and the intensity of a variety of language disorders. We investigate how the digital markers characterize dementia speech from a longitudinal perspective. We find that our proposed communication marker is able to robustly and reliably characterize the language of people with dementia, outperforming existing linguistic approaches; and shows external validity via significant correlation with clinical markers of behaviour. Finally, our proposed linguistic disorder markers provide useful insights into gradual language impairment associated with disease progression.