title: U-BEV: Height-aware Bird's-Eye-View Segmentation and Neural Map-based Relocalization

abstract: Efficient relocalization is essential for intelligent vehicles when GPS reception is insufficient or sensor-based localization fails. Recent advances in Bird's-Eye-View (BEV) segmentation allow for accurate estimation of local scene appearance and in turn, can benefit the relocalization of the vehicle. However, one downside of BEV methods is the heavy computation required to leverage the geometric constraints. This paper presents U-BEV, a U-Net inspired architecture that extends the current state-of-the-art by allowing the BEV to reason about the scene on multiple height layers before flattening the BEV features. We show that this extension boosts the performance of the U-BEV by up to 4.11 IoU. Additionally, we combine the encoded neural BEV with a differentiable template matcher to perform relocalization on neural SD-map data. The model is fully end-to-end trainable and outperforms transformer-based BEV methods of similar computational complexity by 1.7 to 2.8 mIoU and BEV-based relocalization by over 26% Recall Accuracy on the nuScenes dataset.


title: Graph AI in Medicine

abstract: In clinical artificial intelligence (AI), graph representation learning, mainly through graph neural networks (GNNs), stands out for its capability to capture intricate relationships within structured clinical datasets. With diverse data -- from patient records to imaging -- GNNs process data holistically by viewing modalities as nodes interconnected by their relationships. Graph AI facilitates model transfer across clinical tasks, enabling models to generalize across patient populations without additional parameters or minimal re-training. However, the importance of human-centered design and model interpretability in clinical decision-making cannot be overstated. Since graph AI models capture information through localized neural transformations defined on graph relationships, they offer both an opportunity and a challenge in elucidating model rationale. Knowledge graphs can enhance interpretability by aligning model-driven insights with medical knowledge. Emerging graph models integrate diverse data modalities through pre-training, facilitate interactive feedback loops, and foster human-AI collaboration, paving the way to clinically meaningful predictions.


title: PACE: Human and Camera Motion Estimation from in-the-wild Videos

abstract: We present a method to estimate human motion in a global scene from moving cameras. This is a highly challenging task due to the coupling of human and camera motions in the video. To address this problem, we propose a joint optimization framework that disentangles human and camera motions using both foreground human motion priors and background scene features. Unlike existing methods that use SLAM as initialization, we propose to tightly integrate SLAM and human motion priors in an optimization that is inspired by bundle adjustment. Specifically, we optimize human and camera motions to match both the observed human pose and scene features. This design combines the strengths of SLAM and motion priors, which leads to significant improvements in human and camera motion estimation. We additionally introduce a motion prior that is suitable for batch optimization, making our approach significantly more efficient than existing approaches. Finally, we propose a novel synthetic dataset that enables evaluating camera motion in addition to human motion from dynamic videos. Experiments on the synthetic and real-world RICH datasets demonstrate that our approach substantially outperforms prior art in recovering both human and camera motions.


title: Compositional Deep Probabilistic Models of DNA Encoded Libraries

abstract: DNA-Encoded Library (DEL) has proven to be a powerful tool that utilizes combinatorially constructed small molecules to facilitate highly-efficient screening assays. These selection experiments, involving multiple stages of washing, elution, and identification of potent binders via unique DNA barcodes, often generate complex data. This complexity can potentially mask the underlying signals, necessitating the application of computational tools such as machine learning to uncover valuable insights. We introduce a compositional deep probabilistic model of DEL data, DEL-Compose, which decomposes molecular representations into their mono-synthon, di-synthon, and tri-synthon building blocks and capitalizes on the inherent hierarchical structure of these molecules by modeling latent reactions between embedded synthons. Additionally, we investigate methods to improve the observation models for DEL count data such as integrating covariate factors to more effectively account for data noise. Across two popular public benchmark datasets (CA-IX and HRP), our model demonstrates strong performance compared to count baselines, enriches the correct pharmacophores, and offers valuable insights via its intrinsic interpretable structure, thereby providing a robust tool for the analysis of DEL data.


title: Self-similar blow-up solutions in the generalized Korteweg-de Vries equation: Spectral analysis, normal form and asymptotics

abstract: In the present work we revisit the problem of the generalized Korteweg-de Vries equation parametrically, as a function of the relevant nonlinearity exponent, to examine the emergence of blow-up solutions, as traveling waveforms lose their stability past a critical point of the relevant parameter $p$, here at $p=5$. We provide a {\it normal form} of the associated collapse dynamics and illustrate how this captures the collapsing branch bifurcating from the unstable traveling branch. We also systematically characterize the linearization spectrum of not only the traveling states, but importantly of the emergent collapsing waveforms in the so-called co-exploding frame where these waveforms are identified as stationary states. This spectrum, in addition to two positive real eigenvalues which are shown to be associated with the symmetries of translation and scaling invariance of the original (non-exploding) frame features complex patterns of negative eigenvalues that we also fully characterize. We show that the phenomenology of the latter is significantly affected by the boundary conditions and is far more complicated than in the corresponding symmetric Laplacian case of the nonlinear Schr{\"o}dinger problem that has recently been explored. In addition, we explore the dynamics of the unstable solitary waves for $p>5$ in the co-exploding frame.


title: Copyright Violations and Large Language Models

abstract: Language models may memorize more than just facts, including entire chunks of texts seen during training. Fair use exemptions to copyright laws typically allow for limited use of copyrighted material without permission from the copyright holder, but typically for extraction of information from copyrighted materials, rather than {\em verbatim} reproduction. This work explores the issue of copyright violations and large language models through the lens of verbatim memorization, focusing on possible redistribution of copyrighted text. We present experiments with a range of language models over a collection of popular books and coding problems, providing a conservative characterization of the extent to which language models can redistribute these materials. Overall, this research highlights the need for further examination and the potential impact on future developments in natural language processing to ensure adherence to copyright regulations. Code is at \url{https://github.com/coastalcph/CopyrightLLMs}.


title: TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models

abstract: We present TexFusion (Texture Diffusion), a new method to synthesize textures for given 3D geometries, using large-scale text-guided image diffusion models. In contrast to recent works that leverage 2D text-to-image diffusion models to distill 3D objects using a slow and fragile optimization process, TexFusion introduces a new 3D-consistent generation technique specifically designed for texture synthesis that employs regular diffusion model sampling on different 2D rendered views. Specifically, we leverage latent diffusion models, apply the diffusion model's denoiser on a set of 2D renders of the 3D object, and aggregate the different denoising predictions on a shared latent texture map. Final output RGB textures are produced by optimizing an intermediate neural color field on the decodings of 2D renders of the latent texture. We thoroughly validate TexFusion and show that we can efficiently generate diverse, high quality and globally coherent textures. We achieve state-of-the-art text-guided texture synthesis performance using only image diffusion models, while avoiding the pitfalls of previous distillation-based methods. The text-conditioning offers detailed control and we also do not rely on any ground truth 3D textures for training. This makes our method versatile and applicable to a broad range of geometry and texture types. We hope that TexFusion will advance AI-based texturing of 3D assets for applications in virtual reality, game design, simulation, and more.


title: Systemic risk approach to mitigate delay cascading in railway networks

abstract: In public railway systems, minor disruptions can trigger cascading events that lead to delays in the entire system. Typically, delays originate and propagate because the equipment is blocking ways, operational units are unavailable, or at the wrong place at the needed time. The specific understanding of the origins and processes involved in delay-spreading is still a challenge, even though large-scale simulations of national railway systems are becoming available on a highly detailed scale. Without this understanding, efficient management of delay propagation, a growing concern in some Western countries, will remain impossible. Here, we present a systemic risk-based approach to manage daily delay cascading on national scales. We compute the {\em systemic impact} of every train as the maximum of all delays it could possibly cause due to its interactions with other trains, infrastructure, and operational units. To compute it, we design an effective impact network where nodes are train services and links represent interactions that could cause delays. Our results are not only consistent with highly detailed and computationally intensive agent-based railway simulations but also allow us to pinpoint and identify the causes of delay cascades in detail. The systemic approach reveals structural weaknesses in railway systems whenever shared resources are involved. We use the systemic impact to optimally allocate additional shared resources to the system to reduce delays with minimal costs and effort. The method offers a practical and intuitive solution for delay management by optimizing the effective impact network through the introduction of new cheap local train services.


title: Seq2seq is All You Need for Coreference Resolution

abstract: Existing works on coreference resolution suggest that task-specific models are necessary to achieve state-of-the-art performance. In this work, we present compelling evidence that such models are not necessary. We finetune a pretrained seq2seq transformer to map an input document to a tagged sequence encoding the coreference annotation. Despite the extreme simplicity, our model outperforms or closely matches the best coreference systems in the literature on an array of datasets. We also propose an especially simple seq2seq approach that generates only tagged spans rather than the spans interleaved with the original text. Our analysis shows that the model size, the amount of supervision, and the choice of sequence representations are key factors in performance.


title: The second-order zero differential spectra of some APN and other maps over finite fields

abstract: The Feistel Boomerang Connectivity Table and the related notion of $F$-Boomerang uniformity (also known as the second-order zero differential uniformity) has been recently introduced by Boukerrou et al.~\cite{Bouk}. These tools shall provide a major impetus in the analysis of the security of the Feistel network-based ciphers. In the same paper, a characterization of almost perfect nonlinear functions (APN) over fields of even characteristic in terms of second-order zero differential uniformity was also given. Here, we find a sufficient condition for an odd or even function over fields of odd characteristic to be an APN function, in terms of second-order zero differential uniformity. Moreover, we compute the second-order zero differential spectra of several APN or other low differential uniform functions, and show that our considered functions also have low second-order zero differential uniformity, though it may vary widely, unlike the case for even characteristic when it is always zero.


title: Hurwitz-Hecke Invariant Subvarieties

abstract: We introduce a construction of affine invariant subvarieties in strata of translation surfaces whose input is purely combinatorial. We then show that this construction can be used to construct the Bouw-Moeller Teichmueller curves and the seven Eskin-McMullen-Mukamel-Wright rank two orbit closures. The construction is based on the theory of Hurwitz spaces and is inspired by work of Delecroix, Rueth, and Wright.


title: Discrete and Continuous Caching Games

abstract: Alpern's Caching Game is played by $2$ players. Player $1$ is a squirrel, who is hiding his $d$ nuts in $n$ different holes, with the restriction that he can only dig down a distance of $1$ metre altogether. After that, Player $2$ wants to find all the nuts, and she is allowed to dig down a distance of $k$ metres altogether. Player $2$ wins after finding all the nuts, if she fails then the squirrel wins. We investigate a discrete version of the game, finding strategies and statements for both smaller and general values of $n,d,k$. In particular, we answer a question of P\'alv\"olgyi, by exhibiting an example, where the value of the game can change depending on which nut the squirrel reveals, when he has multiple options in the discrete game. We also investigate and invent other continuous versions of the game, one of them having a connection to the Manickam-Mikl\'os-Singhi Conjecture.


title: Inferring Properties in Computation Tree Logic

abstract: We consider the problem of automatically inferring specifications in the branching-time logic, Computation Tree Logic (CTL), from a given system. Designing functional and usable specifications has always been one of the biggest challenges of formal methods. While in recent years, works have focused on automatically designing specifications in linear-time logics such as Linear Temporal Logic (LTL) and Signal Temporal Logic (STL), little attention has been given to branching-time logics despite its popularity in formal methods. We intend to infer concise (thus, interpretable) CTL formulas from a given finite state model of the system in consideration. However, inferring specification only from the given model (and, in general, from only positive examples) is an ill-posed problem. As a result, we infer a CTL formula that, along with being concise, is also language-minimal, meaning that it is rather specific to the given model. We design a counter-example guided algorithm to infer a concise and language-minimal CTL formula via the generation of undesirable models. In the process, we also develop, for the first time, a passive learning algorithm to infer CTL formulas from a set of desirable and undesirable Kripke structures. The passive learning algorithm involves encoding a popular CTL model-checking procedure in the Boolean Satisfiability problem.


title: Weibel-dominated quasi-perpendicular shock: hybrid simulations and in situ observations

abstract: We directly compare hybrid kinetic simulations and in situ observations of a high Mach number high-$\beta$ shock in the Solar wind. We launch virtual probes to demonstrate that the model quantitatively reproduces the observations. The observed wave properties are caused by the ion Weibel instability in the shock foot. Parameters of reflected ions in the shock foot are extracted from simulations, and their coordinate dependencies are linearly approximated. These approximations could be used in analytical models. Due to strong magnetic variations at ramp the reflected ions density can be locally very high (nearly that of the incoming flow), which makes favourable conditions for the instability.


title: A Modular Framework for Implicit 3D-0D Coupling in Cardiac Mechanics

abstract: In numerical simulations of cardiac mechanics, coupling the heart to a model of the circulatory system is essential for capturing physiological cardiac behavior. A popular and efficient technique is to use an electrical circuit analogy, known as a lumped parameter network or zero-dimensional (0D) fluid model, to represent blood flow throughout the cardiovascular system. Due to the strong physical interaction between the heart and the blood circulation, developing accurate and efficient numerical coupling methods remains an active area of research. In this work, we present a modular framework for implicitly coupling three-dimensional (3D) finite element simulations of cardiac mechanics to 0D models of blood circulation. The framework is modular in that the circulation model can be modified independently of the 3D finite element solver, and vice versa. The numerical scheme builds upon a previous work that combines 3D blood flow models with 0D circulation models (3D fluid - 0D fluid). Here, we extend it to couple 3D cardiac tissue mechanics models with 0D circulation models (3D structure - 0D fluid), showing that both mathematical problems can be solved within a unified coupling scheme. The effectiveness, temporal convergence, and computational cost of the algorithm are assessed through multiple examples relevant to the cardiovascular modeling community. Importantly, in an idealized left ventricle example, we show that the coupled model yields physiological pressure-volume loops and naturally recapitulates the isovolumic contraction and relaxation phases of the cardiac cycle without any additional numerical techniques. Furthermore, we provide a new derivation of the scheme inspired by the Approximate Newton Method of Chan (1985), explaining how the proposed numerical scheme combines the stability of monolithic approaches with the modularity and flexibility of partitioned approaches.


title: How Much Consistency Is Your Accuracy Worth?

abstract: Contrast set consistency is a robustness measurement that evaluates the rate at which a model correctly responds to all instances in a bundle of minimally different examples relying on the same knowledge. To draw additional insights, we propose to complement consistency with relative consistency -- the probability that an equally accurate model would surpass the consistency of the proposed model, given a distribution over possible consistencies. Models with 100% relative consistency have reached a consistency peak for their accuracy. We reflect on prior work that reports consistency in contrast sets and observe that relative consistency can alter the assessment of a model's consistency compared to another. We anticipate that our proposed measurement and insights will influence future studies aiming to promote consistent behavior in models.


title: Data-Free Knowledge Distillation Using Adversarially Perturbed OpenGL Shader Images

abstract: Knowledge distillation (KD) has been a popular and effective method for model compression. One important assumption of KD is that the original training dataset is always available. However, this is not always the case due to privacy concerns and more. In recent years, "data-free" KD has emerged as a growing research topic which focuses on the scenario of performing KD when no data is provided. Many methods rely on a generator network to synthesize examples for distillation (which can be difficult to train) and can frequently produce images that are visually similar to the original dataset, which raises questions surrounding whether privacy is completely preserved. In this work, we propose a new approach to data-free KD that utilizes unnatural OpenGL images, combined with large amounts of data augmentation and adversarial attacks, to train a student network. We demonstrate that our approach achieves state-of-the-art results for a variety of datasets/networks and is more stable than existing generator-based data-free KD methods. Source code will be available in the future.


title: Study of spectral index of giant radio galaxy from Leahy's Atlas: DA 240

abstract: Here we investigate the giant radio galaxy DA 240, which is a FR II source. Specifically, we investigate its flux density, as well as the spectral index distribution. For that purpose, we used publicly available data for the source: Leahy's atlas of double radio-sources and NASA/IPAC Extragalactic Database (NED). We used observations at 326 MHz (92 cm) and at 608 MHz (49 cm) and obtained spectral index distributions between 326 and 608 MHz. For the first time we give spectral index map for these frequencies. We found that the synchrotron radiation is the dominant radiation mechanism over most of the area of DA 240, and also investigated the mechanism of radiation at some characteristic points, namely its core and the hotspots. The results of this study will be helpful for understanding the evolutionary process of the DA 240 radio source.


title: PFA and the definability of the nonstationary ideal

abstract: We produce, relative to a ${\sf ZFC}$ model with a supercompact cardinal, a ${\sf ZFC}$ model of the Proper Forcing Axiom in which the nonstationary ideal on $\omega_1$ is $\Pi_1$-definable in a parameter from $H_{\aleph_2}$.


title: Bayesian Estimation of Panel Models under Potentially Sparse Heterogeneity

abstract: We incorporate a version of a spike and slab prior, comprising a pointmass at zero ("spike") and a Normal distribution around zero ("slab") into a dynamic panel data framework to model coefficient heterogeneity. In addition to homogeneity and full heterogeneity, our specification can also capture sparse heterogeneity, that is, there is a core group of units that share common parameters and a set of deviators with idiosyncratic parameters. We fit a model with unobserved components to income data from the Panel Study of Income Dynamics. We find evidence for sparse heterogeneity for balanced panels composed of individuals with long employment histories.


title: Fundamental Limits of Membership Inference Attacks on Machine Learning Models

abstract: Membership inference attacks (MIA) can reveal whether a particular data point was part of the training dataset, potentially exposing sensitive information about individuals. This article provides theoretical guarantees by exploring the fundamental statistical limitations associated with MIAs on machine learning models. More precisely, we first derive the statistical quantity that governs the effectiveness and success of such attacks. We then theoretically prove that in a non-linear regression setting with overfitting algorithms, attacks may have a high probability of success. Finally, we investigate several situations for which we provide bounds on this quantity of interest. Interestingly, our findings indicate that discretizing the data might enhance the algorithm's security. Specifically, it is demonstrated to be limited by a constant, which quantifies the diversity of the underlying data distribution. We illustrate those results through two simple simulations.


title: Enhancing Illicit Activity Detection using XAI: A Multimodal Graph-LLM Framework

abstract: Financial cybercrime prevention is an increasing issue with many organisations and governments. As deep learning models have progressed to identify illicit activity on various financial and social networks, the explainability behind the model decisions has been lacklustre with the investigative analyst at the heart of any deep learning platform. In our paper, we present a state-of-the-art, novel multimodal proactive approach to addressing XAI in financial cybercrime detection. We leverage a triad of deep learning models designed to distill essential representations from transaction sequencing, subgraph connectivity, and narrative generation to significantly streamline the analyst's investigative process. Our narrative generation proposal leverages LLM to ingest transaction details and output contextual narrative for an analyst to understand a transaction and its metadata much further.


title: A New and Faster Representation for Counting Integer Points in Parametric Polyhedra

abstract: In this paper, we consider the counting function $E_P(y) = |P_{y} \cap Z^{n_x}|$ for a parametric polyhedron $P_{y} = \{x \in R^{n_x} \colon A x \leq b + B y\}$, where $y \in R^{n_y}$. We give a new representation of $E_P(y)$, called a \emph{piece-wise step-polynomial with periodic coefficients}, which is a generalization of piece-wise step-polynomials and integer/rational Ehrhart's quasi-polynomials. It gives the fastest way to calculate $E_P(y)$ in certain scenarios. The most important cases are the following: 1) We show that, for the parametric polyhedron $P_y$ defined by a standard-form system $A x = y,\, x \geq 0$ with a fixed number of equalities, the function $E_P(y)$ can be represented by a polynomial-time computable function. In turn, such a representation of $E_P(y)$ can be constructed by an $poly\bigl(n, \|A\|_{\infty}\bigr)$-time algorithm; 2) Assuming again that the number of equalities is fixed, we show that integer/rational Ehrhart's quasi-polynomials of a polytope can be computed by FPT-algorithms, parameterized by sub-determinants of $A$ or its elements; 3) Our representation of $E_P$ is more efficient than other known approaches, if $A$ has bounded elements, especially if it is sparse in addition. Additionally, we provide a discussion about possible applications in the area of compiler optimization. In some "natural" assumptions on a program code, our approach has the fastest complexity bounds.


title: Classification of higher grade $\ell$ graphs for $\mathrm{U}(N)^2\times \mathrm{O}(D)$ multi-matrix models

abstract: We studied in [Ann. Inst. Henri Poincar\'e D 9, 367-433, (2022)], a complex multi-matrix model with $\mathrm{U}(N)^2 \times \mathrm{O}(D)$ symmetry, and whose double scaling limit where simultaneously the large-$N$ and large-$D$ limits were taken while keeping the ratio $N/\sqrt{D}=M$ finite and fixed. In this double scaling limit, the complete recursive characterization of the Feynman graphs of arbitrary genus for the leading order grade $\ell=0$ was achieved. In this current study, we classify the higher order graphs in $\ell$. More specifically, $\ell=1$ and $\ell=2$ with arbitrary genus, in addition to a specific class of two-particle-irreducible (2PI) graphs for higher $\ell \geqslant 3$ but with genus zero. Furthermore, we demonstrate that counting the 2PI graphs with a single $\mathrm{O}(D)$-loop corresponds to enumerating the alternating knots using the Rolsen's table results, performing a connected sum, or Tait flyping moves on them.


title: Absolute calculus and prismatic crystals on cyclotomic rings

abstract: Let $p$ be a prime, $W$ the ring of Witt vectors of a perfect field $k$ of characteristic $p$ and $\zeta$ a primitive $p$th root of unity. We introduce a new notion of calculus over $W$ that we call absolute calculus. It may be seen as a singular version of the $q$-calculus used in previous work, in the sense that the role of the coordinate is now played by $q$ itself. We show that what we call a weakly nilpotent absolute connection on a finite free module is equivalent to a prismatic vector bundle on $W[\zeta]$. As a corollary of a theorem of Bhatt and Scholze, we finally obtain that an absolute connection with a frobenius structure on a finite free module is equivalent to a lattice in a crystalline representation. We also consider the case of de Rham prismatic crystals as well as Hodge-Tate prismatic crystals.


title: Comparative Analysis of Machine Learning Algorithms for Solar Irradiance Forecasting in Smart Grids

abstract: The increasing global demand for clean and environmentally friendly energy resources has caused increased interest in harnessing solar power through photovoltaic (PV) systems for smart grids and homes. However, the inherent unpredictability of PV generation poses problems associated with smart grid planning and management, energy trading and market participation, demand response, reliability, etc. Therefore, solar irradiance forecasting is essential for optimizing PV system utilization. This study proposes the next-generation machine learning algorithms such as random forests, Extreme Gradient Boosting (XGBoost), Light Gradient Boosted Machine (lightGBM) ensemble, CatBoost, and Multilayer Perceptron Artificial Neural Networks (MLP-ANNs) to forecast solar irradiance. Besides, Bayesian optimization is applied to hyperparameter tuning. Unlike tree-based ensemble algorithms that select the features intrinsically, MLP-ANN needs feature selection as a separate step. The simulation results indicate that the performance of the MLP-ANNs improves when feature selection is applied. Besides, the random forest outperforms the other learning algorithms.


title: Densest Subhypergraph: Negative Supermodular Functions and Strongly Localized Methods

abstract: Dense subgraph discovery is a fundamental primitive in graph and hypergraph analysis which among other applications has been used for real-time story detection on social media and improving access to data stores of social networking systems. We present several contributions for localized densest subgraph discovery, which seeks dense subgraphs located nearby given seed sets of nodes. We first introduce a generalization of a recent $\textit{anchored densest subgraph}$ problem, extending this previous objective to hypergraphs and also adding a tunable locality parameter that controls the extent to which the output set overlaps with seed nodes. Our primary technical contribution is to prove when it is possible to obtain a strongly-local algorithm for solving this problem, meaning that the runtime depends only on the size of the input set. We provide a strongly-local algorithm that applies whenever the locality parameter is not too small, and show via counterexample why strongly-local algorithms are impossible below a certain threshold. Along the way to proving our results for localized densest subgraph discovery, we also provide several advances in solving global dense subgraph discovery objectives. This includes the first strongly polynomial time algorithm for the densest supermodular set problem and a flow-based exact algorithm for a heavy and dense subgraph discovery problem in graphs with arbitrary node weights. We demonstrate our algorithms on several web-based data analysis tasks.


title: A Unified View of Evaluation Metrics for Structured Prediction

abstract: We present a conceptual framework that unifies a variety of evaluation metrics for different structured prediction tasks (e.g. event and relation extraction, syntactic and semantic parsing). Our framework requires representing the outputs of these tasks as objects of certain data types, and derives metrics through matching of common substructures, possibly followed by normalization. We demonstrate how commonly used metrics for a number of tasks can be succinctly expressed by this framework, and show that new metrics can be naturally derived in a bottom-up way based on an output structure. We release a library that enables this derivation to create new metrics. Finally, we consider how specific characteristics of tasks motivate metric design decisions, and suggest possible modifications to existing metrics in line with those motivations.


title: Quantum vortex lattice via Lifshitz duality

abstract: We study an effective field theory of a vortex lattice in a two-dimensional neutral rotating superfluid. Utilizing particle-vortex dualities we explore its formulation in terms of a $U(1)$ gauge theory coupled to elasticity, that at low energies reduces to a Lifshitz theory augmented with a Berry phase term encoding the vortex dynamics in the presence of a superflow. Utilizing elasticity- and Lifshitz-gauge theory dualities, we derive dual formulations of the vortex lattice in terms of a traceless symmetric scalar-charge theory and demonstrate low-energy equivalence of our dual gauge theory to its elasticity-gauge theory dual. We further discuss a multipole symmetry of the vortex lattice and its dual gauge theory's multipole one-form symmetries. We also study its topological crystalline defects, where the multipole one-form symmetry plays a prominent role, organizing the defects, explaining their restricted mobility, and characterizing descendant vortex phases.

categories: cond-mat.str-el cond-mat.quant-gas cond-mat.stat-mech hep-th


title: The Human Behind the Data: Reflections from an Ongoing Co-Design and Deployment of a Data-Navigation Interface for Front-Line Emergency Housing Shelter Staff

abstract: On any night in Canada, at least 35,000 individuals experience homelessness. These individuals use emergency shelters to transition out of homelessness and into permanent housing. We designed and deployed a technology to support front-line staff at the largest emergency housing shelter in Calgary, Canada. Over a period of five months in 2022, we worked closely with front-line staff to co-design an interface for supporting a holistic understanding of client context and facilitating decision-making. The tool is currently in-use and our collaboration is ongoing. In this paper, we reflect on preliminary findings regarding the second iteration of the tool. We find that supporting shelter staff in understanding the human behind the data was a critical component of design. This work contributes to literature on how data tools may be integrated into homeless shelters in a way that aligns with shelters' values.


title: Faithful graphical representations of local independence

abstract: Graphical models use graphs to represent conditional independence structure in the distribution of a random vector. In stochastic processes, graphs may represent so-called local independence or conditional Granger causality. Under some regularity conditions, a local independence graph implies a set of independences using a graphical criterion known as $\delta$-separation, or using its generalization, $\mu$-separation. This is a stochastic process analogue of $d$-separation in DAGs. However, there may be more independences than implied by this graph and this is a violation of so-called faithfulness. We characterize faithfulness in local independence graphs and give a method to construct a faithful graph from any local independence model such that the output equals the true graph when Markov and faithfulness assumptions hold. We discuss various assumptions that are weaker than faithfulness, and we explore different structure learning algorithms and their properties under varying assumptions.


title: The Measure Preserving Martingale Sinkhorn Algorithm

abstract: We contribute to the recent studies of the so-called Bass martingale. Backhoff-Veraguas et al. (2020) showed it is the solution to the martingale Benamou-Brenier (mBB) problem, i.e., among all martingales with prescribed initial and terminal distributions it is the one closest to the Brownian motion. We link it with semimartingale optimal transport and deduce an alternative way to derive the dual formulation recently obtained in Backhoff-Veraguas et al. (2023). We then consider computational methods to compute the Bass martingale. The dual formulation of the transport problem leads to an iterative scheme that mirrors to the celebrated Sinkhorn algorithm for entropic optimal transport. We call it the measure preserving martingale Sinkhorn (MPMS) algorithm. We prove that in any dimension, each step of the algorithm improves the value of the dual problem, which implies its convergence. Our MPMS algorithm is equivalent to the fixed-point method of Conze and Henry-Labordere (2021), studied in Acciaio et al. (2023), and performs very well on a range of examples, including real market data.


title: Specific versus General Principles for Constitutional AI

abstract: Human feedback can prevent overtly harmful utterances in conversational models, but may not automatically mitigate subtle problematic behaviors such as a stated desire for self-preservation or power. Constitutional AI offers an alternative, replacing human feedback with feedback from AI models conditioned only on a list of written principles. We find this approach effectively prevents the expression of such behaviors. The success of simple principles motivates us to ask: can models learn general ethical behaviors from only a single written principle? To test this, we run experiments using a principle roughly stated as "do what's best for humanity". We find that the largest dialogue models can generalize from this short constitution, resulting in harmless assistants with no stated interest in specific motivations like power. A general principle may thus partially avoid the need for a long list of constitutions targeting potentially harmful behaviors. However, more detailed constitutions still improve fine-grained control over specific types of harms. This suggests both general and specific principles have value for steering AI safely.


title: Traveling Wave for a diffusive SIR model with delay in diffusion term

abstract: This paper is concerned with traveling waves to an diffusive SIR model with delay placed in the diffusion terms as well as nonlinear incidence rate with delay. Using a cross iteration scheme and partial monotone conditions it will be shown that the existence of quasi upper and lower solutions is a sufficient condition for the existence of a traveling wave front. This will be shown via Schauder's fixed point theorem. Given an appropriate basic reproduction number the traveling wave front will flow from a disease-free steady state to endemic steady state. The construction of quasi upper and lower solutions will be carried out for a specific model.


title: Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Tasks

abstract: Large Language Models (LLMs) evaluation is a patchy and inconsistent landscape, and it is becoming clear that the quality of automatic evaluation metrics is not keeping up with the pace of development of generative models. We aim to improve the understanding of current models' performance by providing a preliminary and hybrid evaluation on a range of open and closed-source generative LLMs on three NLP benchmarks: text summarisation, text simplification and grammatical error correction (GEC), using both automatic and human evaluation. We also explore the potential of the recently released GPT-4 to act as an evaluator. We find that ChatGPT consistently outperforms many other popular models according to human reviewers on the majority of metrics, while scoring much more poorly when using classic automatic evaluation metrics. We also find that human reviewers rate the gold reference as much worse than the best models' outputs, indicating the poor quality of many popular benchmarks. Finally, we find that GPT-4 is capable of ranking models' outputs in a way which aligns reasonably closely to human judgement despite task-specific variations, with a lower alignment in the GEC task.


title: Optimization of highly circularly polarized thermal radiation in $\alpha$-MoO$_3$/$\beta$-Ga$_2$O$_3$ twisted layers

abstract: We investigate a bi-layer scheme for circularly polarized infrared thermal radiation. Our approach takes advantage of the strong anisotropy of low-symmetry materials such as $\beta$-Ga$_2$O$_3$ and $\alpha$-MoO$_3$. We numerically report narrow-band, high degree of circular polarization (over 0.85), thermal radiation at two typical emission frequencies related to the excitation of $\beta$-Ga$_2$O$_3$ optical phonons. Optimization of the degree of circular polarization is achieved by a proper relative tilt of the crystal axes between the two layers. Our simple but effective scheme could set the basis for a new class of lithography-free thermal sources for IR bio-sensing.


title: Improving Molecular Properties Prediction Through Latent Space Fusion

abstract: Pre-trained Language Models have emerged as promising tools for predicting molecular properties, yet their development is in its early stages, necessitating further research to enhance their efficacy and address challenges such as generalization and sample efficiency. In this paper, we present a multi-view approach that combines latent spaces derived from state-of-the-art chemical models. Our approach relies on two pivotal elements: the embeddings derived from MHG-GNN, which represent molecular structures as graphs, and MoLFormer embeddings rooted in chemical language. The attention mechanism of MoLFormer is able to identify relations between two atoms even when their distance is far apart, while the GNN of MHG-GNN can more precisely capture relations among multiple atoms closely located. In this work, we demonstrate the superior performance of our proposed multi-view approach compared to existing state-of-the-art methods, including MoLFormer-XL, which was trained on 1.1 billion molecules, particularly in intricate tasks such as predicting clinical trial drug toxicity and inhibiting HIV replication. We assessed our approach using six benchmark datasets from MoleculeNet, where it outperformed competitors in five of them. Our study highlights the potential of latent space fusion and feature integration for advancing molecular property prediction. In this work, we use small versions of MHG-GNN and MoLFormer, which opens up an opportunity for further improvement when our approach uses a larger-scale dataset.


title: Noise robustness and metabolic load determine the principles of central dogma regulation

abstract: The processes of gene expression are inherently stochastic, even for essential genes required for growth. How does the cell maximize fitness in light of noise? To answer this question, we build a mathematical model to explore the trade-off between metabolic load and growth robustness. The model predicts novel principles of central dogma regulation: Optimal protein expression levels for many genes are in vast overabundance. Essential genes are transcribed above a lower limit of one message per cell cycle. Gene expression is achieved by load balancing between transcription and translation. We present evidence that each of these novel regulatory principles is observed. These results reveal that robustness and metabolic load determine the global regulatory principles that govern central dogma function, and these principles have broad implications for cellular function.


title: The Orbit Space Approach for Piecewise Smooth Vector Fields

abstract: In this work we establish a well defined theory of 'orbit spaces' for nonsmooth vector fields (NSVF). This approach is inspired from the techniques already used in the study of endomorphism, namely inverse limit analysis. We then apply the construction of our theory for the understanding of transitivity in NSVF. We also prove that the known examples of transitive NSVF are indeed transitive in the 'orbit space' as a consequence of our general theorem of transitivity.


title: Normalizing flow-based deep variational Bayesian network for seismic multi-hazards and impacts estimation from InSAR imagery

abstract: Onsite disasters like earthquakes can trigger cascading hazards and impacts, such as landslides and infrastructure damage, leading to catastrophic losses; thus, rapid and accurate estimates are crucial for timely and effective post-disaster responses. Interferometric Synthetic aperture radar (InSAR) data is important in providing high-resolution onsite information for rapid hazard estimation. Most recent methods using InSAR imagery signals predict a single type of hazard and thus often suffer low accuracy due to noisy and complex signals induced by co-located hazards, impacts, and irrelevant environmental changes (e.g., vegetation changes, human activities). We introduce a novel stochastic variational inference with normalizing flows derived to jointly approximate posteriors of multiple unobserved hazards and impacts from noisy InSAR imagery.


title: RoseNet: Predicting Energy Metrics of Double InDel Mutants Using Deep Learning

abstract: An amino acid insertion or deletion, or InDel, can have profound and varying functional impacts on a protein's structure. InDel mutations in the transmembrane conductor regulator protein for example give rise to cystic fibrosis. Unfortunately performing InDel mutations on physical proteins and studying their effects is a time prohibitive process. Consequently, modeling InDels computationally can supplement and inform wet lab experiments. In this work, we make use of our data sets of exhaustive double InDel mutations for three proteins which we computationally generated using a robotics inspired inverse kinematics approach available in Rosetta. We develop and train a neural network, RoseNet, on several structural and energetic metrics output by Rosetta during the mutant generation process. We explore and present how RoseNet is able to emulate the exhaustive data set using deep learning methods, and show to what extent it can predict Rosetta metrics for unseen mutant sequences with two InDels. RoseNet achieves a Pearson correlation coefficient median accuracy of 0.775 over all Rosetta scores for the largest protein. Furthermore, a sensitivity analysis is performed to determine the necessary quantity of data required to accurately emulate the structural scores for computationally generated mutants. We show that the model can be trained on minimal data (<50%) and still retain a high level of accuracy.


title: Learning to (Learn at Test Time)

abstract: We reformulate the problem of supervised learning as learning to learn with two nested loops (i.e. learning problems). The inner loop learns on each individual instance with self-supervision before final prediction. The outer loop learns the self-supervised task used by the inner loop, such that its final prediction improves. Our inner loop turns out to be equivalent to linear attention when the inner-loop learner is only a linear model, and to self-attention when it is a kernel estimator. For practical comparison with linear or self-attention layers, we replace each of them in a transformer with an inner loop, so our outer loop is equivalent to training the architecture. When each inner-loop learner is a neural network, our approach vastly outperforms transformers with linear attention on ImageNet from 224 x 224 raw pixels in both accuracy and FLOPs, while (regular) transformers cannot run.


title: Cavity enhanced emission from a silicon T center

abstract: Silicon T centers present the promising possibility to generate optically active spin qubits in an all-silicon device. However, these color centers exhibit long excited state lifetimes and a low Debye-Waller factor, making them dim emitters with low efficiency into the zero-phonon line. Nanophotonic cavities can solve this problem by enhancing radiative emission into the zero-phonon line through the Purcell effect. In this work we demonstrate cavity-enhanced emission from a single T center in a nanophotonic cavity. We achieve a two-orders of magnitude increase in brightness of the zero-phonon line relative to waveguide-coupled emitters, a 23% collection efficiency from emitter to fiber, and an overall emission efficiency into the zero-phonon line of 63.4%. We also observe a lifetime enhancement of 5, corresponding to a Purcell factor exceeding 18 when correcting for the emission to the phonon sideband. These results pave the way towards efficient spin-photon interfaces in silicon photonics.


title: Enhanced Low-Dimensional Sensing Mapless Navigation of Terrestrial Mobile Robots Using Double Deep Reinforcement Learning Techniques

abstract: In this study, we present two distinct approaches within the realm of Deep Reinforcement Learning (Deep-RL) aimed at enhancing mapless navigation for a ground-based mobile robot. The research methodology primarily involves a comparative analysis between a Deep-RL strategy grounded in the foundational Deep Q-Network (DQN) algorithm, and an alternative approach based on the Double Deep Q-Network (DDQN) algorithm. The agents in these approaches leverage 24 measurements from laser range sampling, coupled with the agent's positional differentials and orientation relative to the target. This amalgamation of data influences the agents' determinations regarding navigation, ultimately dictating the robot's velocities. By embracing this parsimonious sensory framework as proposed, we successfully showcase the training of an agent for proficiently executing navigation tasks and adeptly circumventing obstacles. Notably, this accomplishment is attained without a dependency on intricate sensory inputs like those inherent to image-centric methodologies. The proposed methodology is evaluated in three different real environments, revealing that Double Deep structures significantly enhance the navigation capabilities of mobile robots compared to simple Q structures.


title: A Better Match for Drivers and Riders: Reinforcement Learning at Lyft

abstract: To better match drivers to riders in our ridesharing application, we revised Lyft's core matching algorithm. We use a novel online reinforcement learning approach that estimates the future earnings of drivers in real time and use this information to find more efficient matches. This change was the first documented implementation of a ridesharing matching algorithm that can learn and improve in real time. We evaluated the new approach during weeks of switchback experimentation in most Lyft markets, and estimated how it benefited drivers, riders, and the platform. In particular, it enabled our drivers to serve millions of additional riders each year, leading to more than $30 million per year in incremental revenue. Lyft rolled out the algorithm globally in 2021.


title: The Method of Moving Spheres on the Hyperbolic Space and the Classification of Solutions and the prescribed Q-curvature problem

abstract: The classification of solutions to semilinear partial differential equations, as well as the classification of critical points of the corresponding functionals, have wide applications in the study of partial differential equations and differential geometry. The classical moving plane method and the method of moving sphere on the Euclidean space $\mathbb{R}^n$ provide an effective approach to capture the symmetry of solutions. As far as we know, the moving sphere method has yet to be developed on the hyperbolic space $\mathbb{H}^n$. In the present paper, we focus on the following equation \begin{equation*} P_k u = f(u) \end{equation*} on hyperbolic spaces $\mathbb{H}^n$, where $P_k$ denotes the GJMS operators on $\mathbb{H}^n$ and $f : \mathbb{R} \to \mathbb{R}$ satisfies certain growth conditions. We develop a moving sphere approach on $\mathbb{H}^n$ to obtain the symmetry propertyas well as the classification of positive solutions to the above equation. Our methods also rely on the Helgason-Fourier analysis and Hardy-Littlewood-Sobolev inequalities on hyperbolic space together with a Kelvin transform we introduce on the hyperbolic space in this paper. We also present applications to the higher order prescribed $Q$-curvature problem on the hyperbolic space.


title: Yet Another Model for Arabic Dialect Identification

abstract: In this paper, we describe a spoken Arabic dialect identification (ADI) model for Arabic that consistently outperforms previously published results on two benchmark datasets: ADI-5 and ADI-17. We explore two architectural variations: ResNet and ECAPA-TDNN, coupled with two types of acoustic features: MFCCs and features exratected from the pre-trained self-supervised model UniSpeech-SAT Large, as well as a fusion of all four variants. We find that individually, ECAPA-TDNN network outperforms ResNet, and models with UniSpeech-SAT features outperform models with MFCCs by a large margin. Furthermore, a fusion of all four variants consistently outperforms individual models. Our best models outperform previously reported results on both datasets, with accuracies of 84.7% and 96.9% on ADI-5 and ADI-17, respectively.


title: High-temperature phonons in h-BN: momentum-resolved vibrational spectroscopy and theory

abstract: Vibrations in materials and nanostructures at sufficiently high temperatures result in anharmonic atomic displacements, which leads to new phenomena such as thermal expansion and multiphonon scattering processes, with a profound impact on temperature-dependent material properties including thermal conductivity, phonon lifetimes, nonradiative electronic transitions, and phase transitions. Nanoscale momentum-resolved vibrational spectroscopy, which has recently become possible on monochromated scanning-transmission-electron microscopes, is a unique method to probe the underpinnings of these phenomena. Here we report momentum-resolved vibrational spectroscopy in hexagonal boron nitride at temperatures of 300, 800, and 1300 K across three Brillouin zones (BZs) that reveals temperature-dependent phonon energy shifts and demonstrates the presence of strong Umklapp processes. Density-functional-theory calculations of temperature-dependent phonon self-energies reproduce the observed energy shifts and identify the contributing mechanisms.


title: The Tur\'an and Laguerre inequalities for quasi-polynomial-like functions

abstract: This paper deals with both the higher order Tur\'an inequalities and the Laguerre inequalities for quasi-polynomial-like functions -- that are expressions of the form $f(n)=c_l(n)n^l+\cdots+c_d(n)n^d+o(n^d)$, where $d,l\in\mathbb{N}$ and $d\leqslant l$. A natural example of such a function is the $A$-partition function $p_{A}(n)$, which enumerates the number of partitions of $n$ with parts in the fixed finite multiset $A=\{a_1,a_2,\ldots,a_k\}$ of positive integers. For an arbitrary positive integer $d$, we present efficient criteria for both the order $d$ Tur\'an inequality and the $d$th Laguarre inequality for quasi-polynomial-like functions. In particular, we apply these results to deduce non-trivial analogues for $p_A(n)$.


title: Quantum physics cannot be captured by classical linear hidden variable theories even in the absence of entanglement

abstract: Recent experimental tests of Bell inequalities confirm that entangled quantum systems cannot be described by local classical theories but still do not answer the question whether or not quantum systems could in principle be modelled by linear hidden variable theories. In this paper, we study the quantum trajectories of a single qubit that experiences a sequence of repeated generalised measurements. It is shown that this system, which constitutes a Hidden Quantum Markov Model, is more likely to produce complex time correlations than any classical Hidden Markov Model with two output symbols. From this, we conclude that quantum physics cannot be replaced by linear hidden variable theories. Indeed, it has already been recognised that not only entanglement but also non-classical time correlations of quantum systems with quantum feedback are a valuable resource for quantum technology applications.


title: On topological properties of compact attractors on Hausdorff spaces

abstract: We characterize when a compact, invariant, asymptotically stable attractor on a locally compact Hausdorff space is a strong deformation retract of its domain of attraction.


title: Deep Learning Based Forecasting-Aided State Estimation in Active Distribution Networks

abstract: Operating an active distribution network (ADN) in the absence of enough measurements, the presence of distributed energy resources, and poor knowledge of responsive demand behaviour is a huge challenge. This paper introduces systematic modelling of demand response behaviour which is then included in Forecasting Aided State Estimation (FASE) for better control of the network. There are several innovative elements in tuning parameters of FASE-based, demand profiling, and aggregation. The comprehensive case studies for three UK representative demand scenarios in 2023, 2035, and 2050 demonstrated the effectiveness of the proposed approach.


title: FATA-Trans: Field And Time-Aware Transformer for Sequential Tabular Data

abstract: Sequential tabular data is one of the most commonly used data types in real-world applications. Different from conventional tabular data, where rows in a table are independent, sequential tabular data contains rich contextual and sequential information, where some fields are dynamically changing over time and others are static. Existing transformer-based approaches analyzing sequential tabular data overlook the differences between dynamic and static fields by replicating and filling static fields into each transformer, and ignore temporal information between rows, which leads to three major disadvantages: (1) computational overhead, (2) artificially simplified data for masked language modeling pre-training task that may yield less meaningful representations, and (3) disregarding the temporal behavioral patterns implied by time intervals. In this work, we propose FATA-Trans, a model with two field transformers for modeling sequential tabular data, where each processes static and dynamic field information separately. FATA-Trans is field- and time-aware for sequential tabular data. The field-type embedding in the method enables FATA-Trans to capture differences between static and dynamic fields. The time-aware position embedding exploits both order and time interval information between rows, which helps the model detect underlying temporal behavior in a sequence. Our experiments on three benchmark datasets demonstrate that the learned representations from FATA-Trans consistently outperform state-of-the-art solutions in the downstream tasks. We also present visualization studies to highlight the insights captured by the learned representations, enhancing our understanding of the underlying data. Our codes are available at https://github.com/zdy93/FATA-Trans.


title: LanPose: Language-Instructed 6D Object Pose Estimation for Robotic Assembly

abstract: Comprehending natural language instructions is a critical skill for robots to cooperate effectively with humans. In this paper, we aim to learn 6D poses for roboticassembly by natural language instructions. For this purpose, Language-Instructed 6D Pose Regression Network (LanPose) is proposed to jointly predict the 6D poses of the observed object and the corresponding assembly position. Our proposed approach is based on the fusion of geometric and linguistic features, which allows us to finely integrate multi-modality input and map it to the 6D pose in SE(3) space by the cross-attention mechanism and the language-integrated 6D pose mapping module, respectively. To validate the effectiveness of our approach, an integrated robotic system is established to precisely and robustly perceive, grasp, manipulate and assemble blocks by language commands. 98.09 and 93.55 in ADD(-S)-0.1d are derived for the prediction of 6D object pose and 6D assembly pose, respectively. Both quantitative and qualitative results demonstrate the effectiveness of our proposed language-instructed 6D pose estimation methodology and its potential to enable robots to better understand and execute natural language instructions.


title: FERI: A Multitask-based Fairness Achieving Algorithm with Applications to Fair Organ Transplantation

abstract: Liver transplantation often faces fairness challenges across subgroups defined by sensitive attributes like age group, gender, and race/ethnicity. Machine learning models for outcome prediction can introduce additional biases. To address these, we introduce Fairness through the Equitable Rate of Improvement in Multitask Learning (FERI) algorithm for fair predictions of graft failure risk in liver transplant patients. FERI constrains subgroup loss by balancing learning rates and preventing subgroup dominance in the training process. Our experiments show that FERI maintains high predictive accuracy with AUROC and AUPRC comparable to baseline models. More importantly, FERI demonstrates an ability to improve fairness without sacrificing accuracy. Specifically, for gender, FERI reduces the demographic parity disparity by 71.74%, and for the age group, it decreases the equalized odds disparity by 40.46%. Therefore, the FERI algorithm advances fairness-aware predictive modeling in healthcare and provides an invaluable tool for equitable healthcare systems.


title: Geometric Learning with Positively Decomposable Kernels

abstract: Kernel methods are powerful tools in machine learning. Classical kernel methods are based on positive-definite kernels, which map data spaces into reproducing kernel Hilbert spaces (RKHS). For non-Euclidean data spaces, positive-definite kernels are difficult to come by. In this case, we propose the use of reproducing kernel Krein space (RKKS) based methods, which require only kernels that admit a positive decomposition. We show that one does not need to access this decomposition in order to learn in RKKS. We then investigate the conditions under which a kernel is positively decomposable. We show that invariant kernels admit a positive decomposition on homogeneous spaces under tractable regularity assumptions. This makes them much easier to construct than positive-definite kernels, providing a route for learning with kernels for non-Euclidean data. By the same token, this provides theoretical foundations for RKKS-based methods in general.


title: Adversarial Attacks on Fairness of Graph Neural Networks

abstract: Fairness-aware graph neural networks (GNNs) have gained a surge of attention as they can reduce the bias of predictions on any demographic group (e.g., female) in graph-based applications. Although these methods greatly improve the algorithmic fairness of GNNs, the fairness can be easily corrupted by carefully designed adversarial attacks. In this paper, we investigate the problem of adversarial attacks on fairness of GNNs and propose G-FairAttack, a general framework for attacking various types of fairness-aware GNNs in terms of fairness with an unnoticeable effect on prediction utility. In addition, we propose a fast computation technique to reduce the time complexity of G-FairAttack. The experimental study demonstrates that G-FairAttack successfully corrupts the fairness of different types of GNNs while keeping the attack unnoticeable. Our study on fairness attacks sheds light on potential vulnerabilities in fairness-aware GNNs and guides further research on the robustness of GNNs in terms of fairness.


title: Gauge Boson Mass Dependence and Chiral Anomalies in Generalized Massless Schwinger models

abstract: I bosonize the position-space correlators of flavor-diagonal scalar fermion bilinears in arbitrary generalizations of the Schwinger model with $n_F$ massless fermions coupled to $n_A$ gauge bosons for $n_F\geq n_A$. For $n_A=n_F$, the fermion bilinears can be bosonized in terms of $n_F$ scalars with masses proportional to the gauge couplings. As in the Schwinger model, bosonization can be used to find all correlators, including those that are forbidden in perturbation theory by anomalous chiral symmetries, but there are subtleties when there is more than one gauge boson. The new result here is the general treatment of the dependence on gauge boson masses in models with more than one gauge symmetry. For $n_A<n_F$, there are fermion bilinears with nontrivial anomalous dimensions and there are unbroken chiral symmetries so some correlators vanish while others are non-zero due to chiral anomlies. Taking careful account of the dependence on the masses, I show how the $n_A<n_F$ models emerge from $n_A=n_F$ as gauge couplings (and thus gauge boson masses) go to zero. When this is done properly, the limit of zero gauge coupling is smooth. Our consistent treatment of gauge boson masses guarantees that anomalous symmetries are broken while unbroken chiral symmetries are preserved because correlators that break the non-anomalous symmetries go to zero in the limit of zero gauge coupling.


title: Plausibility Processing in Transformer Language Models: Focusing on the Role of Attention Heads in GPT

abstract: The goal of this paper is to explore how Transformer language models process semantic knowledge, especially regarding the plausibility of noun-verb relations. First, I demonstrate GPT2 exhibits a higher degree of similarity with humans in plausibility processing compared to other Transformer language models. Next, I delve into how knowledge of plausibility is contained within attention heads of GPT2 and how these heads causally contribute to GPT2's plausibility processing ability. Through several experiments, it was found that: i) GPT2 has a number of attention heads that detect plausible noun-verb relationships; ii) these heads collectively contribute to the Transformer's ability to process plausibility, albeit to varying degrees; and iii) attention heads' individual performance in detecting plausibility does not necessarily correlate with how much they contribute to GPT2's plausibility processing ability.


title: Generalized Spatially-Coupled Product-Like Codes Using Zipper Codes With Irregular Degree

abstract: Zipper codes with irregular variable degree are studied. Two new interleaver maps -- chevron and half-chevron -- are described. Simulation results with shortened double-error-correcting Bose--Chaudhuri--Hocquenghem constituent codes show that zipper codes with chevron and half-chevron interleaver maps outperform staircase codes when the rate is below 0.86 and 0.91, respectively, at $10^{-8}$ output bit error rate operating point. In the miscorrection-free decoding scheme, both zipper codes with chevron and half-chevron interleaver maps outperform staircase codes. However, constituent decoder miscorrections induce additional performance gaps.


title: A p-value for Process Tracing and other N=1 Studies

abstract: The paper introduces a \(p\)-value that summarizes the evidence against a rival causal theory that explains an observed outcome in a single case. We show how to represent the probability distribution characterizing a theorized rival hypothesis (the null) in the absence of randomization of treatment and when counting on qualitative data, for instance when conducting process tracing. As in Fisher's \autocite*{fisher1935design} original design, our \(p\)-value indicates how frequently one would find the same observations or even more favorable observations under a theory that is compatible with our observations but antagonistic to the working hypothesis. We also present an extension that allows researchers assess the sensitivity of their results to confirmation bias. Finally, we illustrate the application of our hypothesis test using the study by Snow \autocite*{Snow1855} about the cause of Cholera in Soho, a classic in Process Tracing, Epidemiology, and Microbiology. Our framework suits any type of case studies and evidence, such as data from interviews, archives, or participant observation.


title: Neutrino Target-of-Opportunity Sky Coverage and Scheduler for EUSO-SPB2

abstract: Very-high-energy neutrinos can be observed by detecting air shower signals. Detection of transient target of opportunity (ToO) neutrino sources is part of a broader multimessenger program. The Extreme Universe Space Observatory on a Super Pressure Balloon 2 (EUSO-SPB2) Mission, launched on May 12, 2023, was equipped with an optical Cherenkov Telescope (CT) designed to detect up-going air showers sourced by Earth-skimming neutrinos that interact near the Earth's limb. Presented here is an overview of the sky coverage and ToO scheduler software for EUSO-SPB2. By using the balloon trajectory coordinates and setting constraints on the positions of the Sun and Moon to ensure dark skies, we can determine if and when a source direction is slightly below the Earth's limb. From a source catalog, CT scheduling and pointing is performed to optimize the search for high-energy neutrinos coming from astrophysical sources. Some sample results for EUSO-SPB2 are shown.


title: Nightshade: Prompt-Specific Poisoning Attacks on Text-to-Image Generative Models

abstract: Data poisoning attacks manipulate training data to introduce unexpected behaviors into machine learning models at training time. For text-to-image generative models with massive training datasets, current understanding of poisoning attacks suggests that a successful attack would require injecting millions of poison samples into their training pipeline. In this paper, we show that poisoning attacks can be successful on generative models. We observe that training data per concept can be quite limited in these models, making them vulnerable to prompt-specific poisoning attacks, which target a model's ability to respond to individual prompts. We introduce Nightshade, an optimized prompt-specific poisoning attack where poison samples look visually identical to benign images with matching text prompts. Nightshade poison samples are also optimized for potency and can corrupt an Stable Diffusion SDXL prompt in <100 poison samples. Nightshade poison effects "bleed through" to related concepts, and multiple attacks can composed together in a single prompt. Surprisingly, we show that a moderate number of Nightshade attacks can destabilize general features in a text-to-image generative model, effectively disabling its ability to generate meaningful images. Finally, we propose the use of Nightshade and similar tools as a last defense for content creators against web scrapers that ignore opt-out/do-not-crawl directives, and discuss possible implications for model trainers and content creators.


title: Universal Representation of Permutation-Invariant Functions on Vectors and Tensors

abstract: A main object of our study is multiset functions -- that is, permutation-invariant functions over inputs of varying sizes. Deep Sets, proposed by \cite{zaheer2017deep}, provides a \emph{universal representation} for continuous multiset functions on scalars via a sum-decomposable model. Restricting the domain of the functions to finite multisets of $D$-dimensional vectors, Deep Sets also provides a \emph{universal approximation} that requires a latent space dimension of $O(N^D)$ -- where $N$ is an upper bound on the size of input multisets. In this paper, we strengthen this result by proving that universal representation is guaranteed for continuous and discontinuous multiset functions though a latent space dimension of $O(N^D)$. We then introduce \emph{identifiable} multisets for which we can uniquely label their elements using an identifier function, namely, finite-precision vectors are identifiable. Using our analysis on identifiable multisets, we prove that a sum-decomposable model for general continuous multiset functions only requires a latent dimension of $2DN$. We further show that both encoder and decoder functions of the model are continuous -- our main contribution to the existing work which lack such a guarantee. Also this provides a significant improvement over the aforementioned $O(N^D)$ bound which was derived for universal representation of continuous and discontinuous multiset functions. We then extend our results and provide special sum-decomposition structures to universally represent permutation-invariant tensor functions on identifiable tensors. These families of sum-decomposition models enables us to design deep network architectures and deploy them on a variety of learning tasks on sequences, images, and graphs.


title: ML-Based Feedback-Free Adaptive MCS Selection for Massive Multi-User MIMO

abstract: As wireless communication systems strive to improve spectral efficiency, there has been a growing interest in employing machine learning (ML)-based approaches for adaptive modulation and coding scheme (MCS) selection. In this paper, we introduce a new adaptive MCS selection framework for massive MIMO systems that operates without any feedback from users by solely relying on instantaneous uplink channel estimates. Our proposed method can effectively operate in multi-user scenarios where user feedback imposes excessive delay and bandwidth overhead. To learn the mapping between the user channel matrices and the optimal MCS level of each user, we develop a Convolutional Neural Network (CNN)-Long Short-Term Memory Network (LSTM)-based model and compare the performance with the state-of-the-art methods. Finally, we validate the effectiveness of our algorithm by evaluating it experimentally using real-world datasets collected from the RENEW massive MIMO platform.


title: Transformers for Trajectory Optimization with Application to Spacecraft Rendezvous

abstract: Reliable and efficient trajectory optimization methods are a fundamental need for autonomous dynamical systems, effectively enabling applications including rocket landing, hypersonic reentry, spacecraft rendezvous, and docking. Within such safety-critical application areas, the complexity of the emerging trajectory optimization problems has motivated the application of AI-based techniques to enhance the performance of traditional approaches. However, current AI-based methods either attempt to fully replace traditional control algorithms, thus lacking constraint satisfaction guarantees and incurring in expensive simulation, or aim to solely imitate the behavior of traditional methods via supervised learning. To address these limitations, this paper proposes the Autonomous Rendezvous Transformer (ART) and assesses the capability of modern generative models to solve complex trajectory optimization problems, both from a forecasting and control standpoint. Specifically, this work assesses the capabilities of Transformers to (i) learn near-optimal policies from previously collected data, and (ii) warm-start a sequential optimizer for the solution of non-convex optimal control problems, thus guaranteeing hard constraint satisfaction. From a forecasting perspective, results highlight how ART outperforms other learning-based architectures at predicting known fuel-optimal trajectories. From a control perspective, empirical analyses show how policies learned through Transformers are able to generate near-optimal warm-starts, achieving trajectories that are (i) more fuel-efficient, (ii) obtained in fewer sequential optimizer iterations, and (iii) computed with an overall runtime comparable to benchmarks based on convex optimization.


title: Absolute continuity of Wasserstein barycenters on manifolds with a lower Ricci curvature bound

abstract: Given a complete Riemannian manifold $M$ with a lower Ricci curvature bound, we consider barycenters in the Wasserstein space $\mathcal{W}_2(M)$ of probability measures on $M$. We refer to them as Wasserstein barycenters, which by definition are probability measures on $M$. The goal of this article is to present a novel approach to proving their absolute continuity. We introduce a new class of displacement functionals exploiting the Hessian equality for Wasserstein barycenters. To provide suitable instances of such functionals, we revisit Souslin space theory, Dunford-Pettis theorem and the de la Vall\'ee Poussin criterion for uniform integrability. Our method shows that if a probability measure $\mathbb{P}$ on $\mathcal{W}_2(M)$ gives mass to absolutely continuous measures on $M$, then its unique barycenter is also absolutely continuous. This generalizes the previous results on compact manifolds by Kim and Pass arXiv:1412.7726 [math.AP] .


title: GraphMaker: Can Diffusion Models Generate Large Attributed Graphs?

abstract: Large-scale graphs with node attributes are increasingly common in various real-world applications. Creating synthetic, attribute-rich graphs that mirror real-world examples is crucial, especially for sharing graph data for analysis and developing learning models when original data is restricted to be shared. Traditional graph generation methods are limited in their capacity to handle these complex structures. Recent advances in diffusion models have shown potential in generating graph structures without attributes and smaller molecular graphs. However, these models face challenges in generating large attributed graphs due to the complex attribute-structure correlations and the large size of these graphs. This paper introduces a novel diffusion model, GraphMaker, specifically designed for generating large attributed graphs. We explore various combinations of node attribute and graph structure generation processes, finding that an asynchronous approach more effectively captures the intricate attribute-structure correlations. We also address scalability issues through edge mini-batching generation. To demonstrate the practicality of our approach in graph data dissemination, we introduce a new evaluation pipeline. The evaluation demonstrates that synthetic graphs generated by GraphMaker can be used to develop competitive graph machine learning models for the tasks defined over the original graphs without actually accessing these graphs, while many leading graph generation methods fall short in this evaluation.


title: Morphological Study of Granular-Granular Impact Craters through Time-of-Flight Cameras: from Concept to Automation in Python

abstract: Laboratory made granular-granular impact craters have been used as model analogues of planetary impact craters. These kind of craters have been observed and studied using profilometry techniques that allow to retrieve important morphologic features from the impacted surface. In this work, we propose to use a Time-of-Flight camera (Microsoft Kinect One) for the acquisition of depth data. We show comparisons between the typically used technique and the analysis derived from the Time-of-Flight data. We also release craterslab, a Python library developed to automate most of the tasks from the process of studying impact craters produced by granular projectiles hitting on the surface of granular targets. The library is able to acquire, identify, and measure morphological features of impacted surfaces through the reconstruction of 3D topographic maps. Our results show that using a Time-of-Flight camera and automating the data processing with a software library for the systematic study of impact craters can produce very accurate results while reducing the time spent on different stages of the process.


title: Transfer systems for rank two elementary Abelian groups: characteristic functions and matchstick games

abstract: We prove that Hill's characteristic function $\chi$ for transfer systems on a lattice $P$ surjects onto interior operators for $P$. Moreover, the fibers of $\chi$ have unique maxima which are exactly the saturated transfer systems. In order to apply this theorem in examples relevant to equivariant homotopy theory, we develop the theory of saturated transfer systems on modular lattices, ultimately producing a ``matchstick game'' that puts saturated transfer systems in bijection with certain structured subsets of covering relations. After an interlude developing a recursion for transfer systems on certain combinations of bounded posets, we apply these results to determine the full lattice of transfer systems for rank two elementary Abelian groups.


title: Foundation Model's Embedded Representations May Detect Distribution Shift

abstract: Sampling biases can cause distribution shifts between train and test datasets for supervised learning tasks, obscuring our ability to understand the generalization capacity of a model. This is especially important considering the wide adoption of pre-trained foundational neural networks -- whose behavior remains poorly understood -- for transfer learning (TL) tasks. We present a case study for TL on the Sentiment140 dataset and show that many pre-trained foundation models encode different representations of Sentiment140's manually curated test set $M$ from the automatically labeled training set $P$, confirming that a distribution shift has occurred. We argue training on $P$ and measuring performance on $M$ is a biased measure of generalization. Experiments on pre-trained GPT-2 show that the features learnable from $P$ do not improve (and in fact hamper) performance on $M$. Linear probes on pre-trained GPT-2's representations are robust and may even outperform overall fine-tuning, implying a fundamental importance for discerning distribution shift in train/test splits for model interpretation.


title: NLO corrections to the deeply virtual meson production revisited: impact on the extraction of generalized parton distributions

abstract: We revisit the next-to-leading order (NLO) perturbative QCD corrections for the deeply virtual meson production (DVMP) process, exploring its phenomenology both in isolation and in a multichannel fit combined with deeply virtual Compton scattering (DVCS). Our approach involves the conformal partial wave (CPaW) formalism, which allows for the straightforward inclusion of higher-order contributions and evolutionary effects. Our findings indicate that a description of the longitudinal component of the vector meson DVMP cross-section at high energies is achievable only at NLO within the standard collinear approach. Furthermore, we demonstrate a simultaneous description of DIS, DVCS, and DVMP processes, providing insights into the proton structure described at NLO by unique universal generalized parton distribution (GPD) functions.


title: CNN-based Prediction of Partition Path for VVC Fast Inter Partitioning Using Motion Fields

abstract: The Versatile Video Coding (VVC) standard has been recently finalized by the Joint Video Exploration Team (JVET). Compared to the High Efficiency Video Coding (HEVC) standard, VVC offers about 50% compression efficiency gain, in terms of Bjontegaard Delta-Rate (BD-rate), at the cost of a 10-fold increase in encoding complexity. In this paper, we propose a method based on Convolutional Neural Network (CNN) to speed up the inter partitioning process in VVC. Firstly, a novel representation for the quadtree with nested multi-type tree (QTMT) partition is introduced, derived from the partition path. Secondly, we develop a U-Net-based CNN taking a multi-scale motion vector field as input at the Coding Tree Unit (CTU) level. The purpose of CNN inference is to predict the optimal partition path during the Rate-Distortion Optimization (RDO) process. To achieve this, we divide CTU into grids and predict the Quaternary Tree (QT) depth and Multi-type Tree (MT) split decisions for each cell of the grid. Thirdly, an efficient partition pruning algorithm is introduced to employ the CNN predictions at each partitioning level to skip RDO evaluations of unnecessary partition paths. Finally, an adaptive threshold selection scheme is designed, making the trade-off between complexity and efficiency scalable. Experiments show that the proposed method can achieve acceleration ranging from 16.5% to 60.2% under the RandomAccess Group Of Picture 32 (RAGOP32) configuration with a reasonable efficiency drop ranging from 0.44% to 4.59% in terms of BD-rate, which surpasses other state-of-the-art solutions. Additionally, our method stands out as one of the lightest approaches in the field, which ensures its applicability to other encoders.


title: Dark matter distribution in Milky Way-analog galaxies

abstract: Our current understanding of how dark matter (DM) is distributed within the Milky Way halo, particularly in the solar neighborhood, is based on either careful studies of the local stellar orbits, model assumptions on the global shape of the MW halo, or from direct acceleration measurements. In this work, we undertake a study of external galaxies, with the intent of providing insight to the DM distribution in MW-analog galaxies. For this, we carefully select a sample of galaxies similar to the MW, based on maximum atomic hydrogen (HI) rotational velocity ($v_{\rm max,HI}$= 200-280 km s$^{-1}$) and morphological type (Sab-Sbc) criteria. With a need for deep, highly-resolved HI, our resulting sample is composed of 5 galaxies from the VIVA and THINGS surveys. To perform our baryonic analysis, we use deep Spitzer mid-IR images at 3.6 and 4.5 $\mu$m from the S$^4$G survey. Based on the dynamical three-dimensional modeling software $^{3D}$Barolo, we construct rotation curves (RCs) and derive the gas and stellar contributions from the galaxy's gaseous- and stellar-disks mass surface density profiles. Through a careful decomposition of their RCs into their baryonic (stars, gas) and DM components, we isolate the DM contribution by using an MCMC-based approach. Based on the Sun's location and the MW's R$_{25}$, we define the corresponding location of the solar neighborhood in these systems. We put forward a window for the DM density ($\rho_{dm}$ = 0.21-0.55 GeV cm$^{-3}$) at these galactocentric distances in our MW analog sample, consistent with the values found for the MW's local DM density, based on more traditional approaches found in the literature.


title: Phase Control of Nonlinear Breit-Wheeler Pair Creation

abstract: Electron-positron pair creation occurs throughout the universe in the environments of extreme astrophysical objects, such as pulsar magnetospheres and black hole accretion disks. The difficulty of emulating these environments in the laboratory has motivated the use of ultrahigh-intensity laser pulses for pair creation. Here we show that the phase offset between a laser pulse and its second harmonic can be used to control the relative transverse motion of electrons and positrons created in the nonlinear Breit-Wheeler process. Analytic theory and particle-in-cell simulations of a head-on collision between a two-color laser pulse and electron beam predict that with an appropriate phase offset, the electrons will drift in one direction and the positrons in the other. The resulting current may provide a collective signature of nonlinear Breit-Wheeler, while the spatial separation resulting from the relative motion may facilitate isolation of positrons for subsequent applications or detection.


title: Fast hyperboloid decision tree algorithms

abstract: Hyperbolic geometry is gaining traction in machine learning for its effectiveness at capturing hierarchical structures in real-world data. Hyperbolic spaces, where neighborhoods grow exponentially, offer substantial advantages and consistently deliver state-of-the-art results across diverse applications. However, hyperbolic classifiers often grapple with computational challenges. Methods reliant on Riemannian optimization frequently exhibit sluggishness, stemming from the increased computational demands of operations on Riemannian manifolds. In response to these challenges, we present hyperDT, a novel extension of decision tree algorithms into hyperbolic space. Crucially, hyperDT eliminates the need for computationally intensive Riemannian optimization, numerically unstable exponential and logarithmic maps, or pairwise comparisons between points by leveraging inner products to adapt Euclidean decision tree algorithms to hyperbolic space. Our approach is conceptually straightforward and maintains constant-time decision complexity while mitigating the scalability issues inherent in high-dimensional Euclidean spaces. Building upon hyperDT we introduce hyperRF, a hyperbolic random forest model. Extensive benchmarking across diverse datasets underscores the superior performance of these models, providing a swift, precise, accurate, and user-friendly toolkit for hyperbolic data analysis.


title: 475{\deg}C aging embrittlement of partially recrystallized FeCrAl ODS ferritic steels after simulated tube process

abstract: Tube processing and aging effects in FeCrAl ODS steels are investigated in four mechanical alloyed ferritic ODS steels, Fe15Cr (SP2), Fe15Cr5Al (SP4), Fe15Cr7Al (SP7) and Fe18Cr7Al (SP11). These steels were made into 0.3mm thick plates by simulated tube processing (STP). Strengthening after partial recrystallization was achieved after the last cold rolling and heat treatment step. However, the ductility reduced about one third of the as-extruded steels. The STPed steels were aged at 475{\deg}C in sealed vacuum tubes up to 2000 hrs and 10000 hrs, respectively. The yield stress and elongation were investigated by tensile tests. The results revealed that all the STPed steels fractured in a ductile manner irrespective of aging conditions. Aging hardening and ductility reduction in STPed steels are similar to as-extruded ones. The STPed ODS steels showed similar ageing embrittlement resistance as as-extruded steels, but much higher than the non-ODS steels. The aging hardening based on cut-through and bow-pass mechanisms were discussed. The time dependent hardening of overaged steel (beta prime only) was analyzed as well.


title: Long Solution Times or Low Solution Quality: On Trade-Offs in Choosing a Power Flow Formulation for the Optimal Power Shutoff Problem

abstract: The Optimal Power Shutoff (OPS) problem is an optimization problem that makes power line de-energization decisions in order to reduce the risk of igniting a wildfire, while minimizing the load shed of customers. This problem, with DC linear power flow equations, has been used in many studies in recent years. However, using linear approximations for power flow when making decisions on the network topology is known to cause challenges with AC feasibility of the resulting network, as studied in the related contexts of optimal transmission switching or grid restoration planning. This paper explores the accuracy of the DC OPS formulation and the ability to recover an AC-feasible power flow solution after de-energization decisions are made. We also extend the OPS problem to include variants with the AC, Second-Order-Cone, and Network-Flow power flow equations, and compare them to the DC approximation with respect to solution quality and time. The results highlight that the DC approximation overestimates the amount of load that can be served, leading to poor de-energization decisions. The AC and SOC-based formulations are better, but prohibitively slow to solve for even modestly sized networks thus demonstrating the need for new solution methods with better trade-offs between computational time and solution quality.


title: Multi-level, Forming Free, Bulk Switching Trilayer RRAM for Neuromorphic Computing at the Edge

abstract: Resistive memory-based reconfigurable systems constructed by CMOS-RRAM integration hold great promise for low energy and high throughput neuromorphic computing. However, most RRAM technologies relying on filamentary switching suffer from variations and noise leading to computational accuracy loss, increased energy consumption, and overhead by expensive program and verify schemes. Low ON-state resistance of filamentary RRAM devices further increases the energy consumption due to high-current read and write operations, and limits the array size and parallel multiply & accumulate operations. High-forming voltages needed for filamentary RRAM are not compatible with advanced CMOS technology nodes. To address all these challenges, we developed a forming-free and bulk switching RRAM technology based on a trilayer metal-oxide stack. We systematically engineered a trilayer metal-oxide RRAM stack and investigated the switching characteristics of RRAM devices with varying thicknesses and oxygen vacancy distributions across the trilayer to achieve reliable bulk switching without any filament formation. We demonstrated bulk switching operation at megaohm regime with high current nonlinearity and programmed up to 100 levels without compliance current. We developed a neuromorphic compute-in-memory platform based on trilayer bulk RRAM crossbars by combining energy-efficient switched-capacitor voltage sensing circuits with differential encoding of weights to experimentally demonstrate high-accuracy matrix-vector multiplication. We showcased the computational capability of bulk RRAM crossbars by implementing a spiking neural network model for an autonomous navigation/racing task. Our work addresses challenges posed by existing RRAM technologies and paves the way for neuromorphic computing at the edge under strict size, weight, and power constraints.


title: Augment with Care: Enhancing Graph Contrastive Learning with Selective Spectrum Perturbation

abstract: In recent years, Graph Contrastive Learning (GCL) has shown remarkable effectiveness in learning representations on graphs. As a component of GCL, good augmentation views are supposed to be invariant to the important information while discarding the unimportant part. Existing augmentation views with perturbed graph structures are usually based on random topology corruption in the spatial domain; however, from perspectives of the spectral domain, this approach may be ineffective as it fails to pose tailored impacts on the information of different frequencies, thus weakening the agreement between the augmentation views. By a preliminary experiment, we show that the impacts caused by spatial random perturbation are approximately evenly distributed among frequency bands, which may harm the invariance of augmentations required by contrastive learning frameworks. To address this issue, we argue that the perturbation should be selectively posed on the information concerning different frequencies. In this paper, we propose GASSER which poses tailored perturbation on the specific frequencies of graph structures in spectral domain, and the edge perturbation is selectively guided by the spectral hints. As shown by extensive experiments and theoretical analysis, the augmentation views are adaptive and controllable, as well as heuristically fitting the homophily ratios and spectrum of graph structures.


title: A stabilizing effect of advection on planar interfaces in singularly perturbed reaction-diffusion equations

abstract: We consider planar traveling fronts between stable steady states in two-component singularly perturbed reaction-diffusion-advection equations, where a small quantity $\delta^2$ represents the ratio of diffusion coefficients. The fronts under consideration are large amplitude and contain a sharp interface, induced by traversing a fast heteroclinic orbit in a suitable slow fast framework. We explore the effect of advection on the spectral stability of the fronts to long wavelength perturbations in two spatial dimensions. We find that for suitably large advection coefficient $\nu$, the fronts are stable to such perturbations, while they can be unstable for smaller values of $\nu$. In this case, a critical asymptotic scaling $\nu\sim \delta^{-4/3}$ is obtained at which the onset of instability occurs. The results are applied to a family of traveling fronts in a dryland ecosystem model.


title: Perturbing the Stable Accretion Disk in Kerr and 4-D Einstein-Gauss-Bonnet Gravities:Comprehensive Analysis of Instabilities and Dynamics

abstract: The study of a disturbed accretion disk holds great significance in the realm of astrophysics. This is because such events play a crucial role in revealing the nature of disk structure, the release of energy, and the generated shock waves. Thus, they can help explain the causes of X-ray emissions observed in black hole accretion disk systems. In this paper, we perturb the stable disk formed by spherical accretion around Kerr and EGB black holes. This perturbation reveals one- and two-armed spiral shock waves on the disk's surface. We find a strong connection between these waves and the black hole's spin parameter (a/M) and the EGB coupling constant ($\alpha$). Specifically, we found that as alpha increases in the negative direction, the dynamics of the disk and the waves become more chaotic. Additionally, we observe that the angular momentum of the perturbing matter significantly affects mass accretion and the oscillation of the arising shock waves. This allows us to observe changes in QPOs frequencies. Particularly, perturbations with angular momentum matches the observed C-type QPOs frequencies of GRS 1915 + 105 source. Thus, we conclude that the possibility of the shock waves occurring within the vicinity of GRS 1915 + 105 is substantial.


title: FABULA: Intelligence Report Generation Using Retrieval-Augmented Narrative Construction

abstract: Narrative construction is the process of representing disparate event information into a logical plot structure that models an end to end story. Intelligence analysis is an example of a domain that can benefit tremendously from narrative construction techniques, particularly in aiding analysts during the largely manual and costly process of synthesizing event information into comprehensive intelligence reports. Manual intelligence report generation is often prone to challenges such as integrating dynamic event information, writing fine-grained queries, and closing information gaps. This motivates the development of a system that retrieves and represents critical aspects of events in a form that aids in automatic generation of intelligence reports. We introduce a Retrieval Augmented Generation (RAG) approach to augment prompting of an autoregressive decoder by retrieving structured information asserted in a knowledge graph to generate targeted information based on a narrative plot model. We apply our approach to the problem of neural intelligence report generation and introduce FABULA, framework to augment intelligence analysis workflows using RAG. An analyst can use FABULA to query an Event Plot Graph (EPG) to retrieve relevant event plot points, which can be used to augment prompting of a Large Language Model (LLM) during intelligence report generation. Our evaluation studies show that the plot points included in the generated intelligence reports have high semantic relevance, high coherency, and low data redundancy.