title: Measurements and EFT fits on detector level

abstract: The framework of standard model effective field theory (SMEFT) provides a relatively model-agnostic tool with which to parameterize the off-shell effects of potential heavy new physics. In the top quark sector, the ATLAS and CMS experiments make use of data collected by the CERN LHC to search for these off-shell effects by probing dimension-six SMEFT operators involving top quarks. The analyses employ a variety of approaches, which range from relatively indirect (e.g. reinterpretations of unfolded measurements) to relatively direct (in which the SMEFT effects are propagated all the way to detector-level predictions). These proceedings discuss the landscape of detector-level SMEFT analyses in ATLAS and CMS, describe the methodology of the direct detector-level approach, and summarize several recent experimental results.


title: SDN-Based Dynamic Cybersecurity Framework of IEC-61850 Communications in Smart Grid

abstract: In recent years, critical infrastructure and power grids have experienced a series of cyber-attacks, leading to temporary, widespread blackouts of considerable magnitude. Since most substations are unmanned and have limited physical security protection, cyber breaches into power grid substations present a risk. Nowadays, software-defined network (SDN), a popular virtual network technology based on the OpenFlow protocol is being widely used in the substation automation system. However, the susceptibility of SDN architecture to cyber-attacks has exhibited a notable increase in recent years, as indicated by research findings. This suggests a growing concern regarding the potential for cybersecurity breaches within the SDN framework. In this paper, we propose a hybrid intrusion detection system (IDS)-integrated SDN architecture for detecting and preventing the injection of malicious IEC 61850-based generic object-oriented substation event (GOOSE) messages in a digital substation. Additionally, this program locates the fault's location and, as a form of mitigation, disables a certain port. Furthermore, implementation examples are demonstrated and verified using a hardware-in-the-loop (HIL) testbed that mimics the functioning of a digital substation.


title: On The Use of Risk Measures in Digital Twins to Identify Weaknesses in Structures

abstract: Given measurements from sensors and a set of standard forces, an optimization based approach to identify weakness in structures is introduced. The key novelty lies in letting the load and measurements to be random variables. Subsequently the conditional-value-at-risk (CVaR) is minimized subject to the elasticity equations as constraints. CVaR is a risk measure that leads to minimization of rare and low probability events which the standard expectation cannot. The optimization variable is the (deterministic) strength factor which appears as a coefficient in the elasticity equation, thus making the problem nonconvex. Due to uncertainty, the problem is high dimensional and, due to CVaR, the problem is nonsmooth. An adjoint based approach is developed with quadrature in the random variables. Numerical results are presented in the context of a plate, a large structure with trusses similar to those used in solar arrays or cranes, and a footbridge.


title: Defense semantics of argumentation: revisit

abstract: In this paper we introduce a novel semantics, called defense semantics, for Dung's abstract argumentation frameworks in terms of a notion of (partial) defence, which is a triple encoding that one argument is (partially) defended by another argument via attacking the attacker of the first argument. In terms of defense semantics, we show that defenses related to self-attacked arguments and arguments in 3-cycles are unsatifiable under any situation and therefore can be removed without affecting the defense semantics of an AF. Then, we introduce a new notion of defense equivalence of AFs, and compare defense equivalence with standard equivalence and strong equivalence, respectively. Finally, by exploiting defense semantics, we define two kinds of reasons for accepting arguments, i.e., direct reasons and root reasons, and a notion of root equivalence of AFs that can be used in argumentation summarization.


title: Novel Cross Section Ratios as Possible Signals of Saturation in UPCs

abstract: We propose new cross section ratios in ultra-peripheral A$+$A and $p+$A collisions (UPCs) as a potential experimental signal of saturation physics. We consider the ratio $R_1$ of elastic vector meson photoproduction cross section to the inclusive hadron or jet photoproduction cross section. The ratio can be measured in the $\gamma +$A and $\gamma + p$ collisions taking place in the UPCs. We label the ratios $R_1 ({\rm A})$ and $R_1 (p)$, respectively. Constructing the double ratio $R_{\rm{UPC}} ({\rm A}) = R_1 ({\rm A})/R_1 (p)$, and performing a small-$x$ calculation both in the quasi-classical approximation and by including small-$x$ evolution, we observe that $R_{\rm{UPC}} ({\rm A})$ exhibits a markedly different dependence on the nuclear atomic number inside and outside the saturation region. This result indicates that $R_{\rm{UPC}} ({\rm A})$ and $R_1 ({\rm A})$ measurements in UPCs may help in the experimental searches for the evidence of saturation physics.


title: Comparing self-consistent GW and vertex corrected G0W0 (G0W0{\Gamma}) accuracy for molecular ionization potentials

abstract: We test the performance of self-consistent GW and several representative implementations of vertex corrected G0W0 (G0W0{\Gamma}). These approaches are tested on benchmark data sets covering full valence spectra (first ionization potentials and some inner valence shell excitations). For small molecules, when comparing against state of the art wave function techniques, our results show that performing full self-consistency in the GW scheme either systematically outperforms vertex corrected G0W0 or gives results of at least the same quality. Moreover, the G0W0{\Gamma} results in additional computational cost when compared to G0W0 or self-consistent GW and the G0W0{\Gamma} dependency on the starting mean-filed solution is frequently larger than the magnitude of the vertex correction. Consequently, for molecular systems self-consistent GW performed on imaginary axis and then followed by modern analytical continuation techniques offers a more reliable approach to make predictions of IP spectra.


title: Insight into the Formation of $\beta$ Pic b through the Composition of Its Parent Protoplanetary Disk as Revealed by the $\beta$ Pic Moving Group Member HD 181327

abstract: It has been suggested that $\beta$ Pic b has a supersolar metallicity and subsolar C/O ratio. Assuming solar carbon and oxygen abundances for the star $\beta$ Pic and therefore the planet's parent protoplanetary disk, $\beta$ Pic b's C/O ratio suggests that it formed via core accretion between its parent protoplanteary disk's H$_{2}$O and CO$_{2}$ ice lines. $\beta$ Pic b's high metallicity is difficult to reconcile with its mass $M_{\text{p}}~=~11.7~M_{\text{Jup}}$ though. Massive stars can present peculiar photospheric abundances that are unlikely to record the abundances of their former protoplanetary disks. This issue can be overcome for early-type stars in moving groups by infering the elemental abundances of the FGK stars in the same moving group that formed in the same molecular cloud and presumably share the same composition. We infer the photospheric abundances of the F dwarf HD 181327, a $\beta$ Pic moving group member that is the best available proxy for the composition of $\beta$ Pic b's parent protoplanetary disk. In parallel, we infer updated atmospheric abundances for $\beta$ Pic b. As expected for a planet of its mass formed via core-accretion beyond its parent protoplanetary disk's H$_{2}$O ice line, we find that $\beta$ Pic b's atmosphere is consistent with stellar metallicity and confirm that is has superstellar carbon and oxygen abundances with a substellar C/O ratio. We propose that the elemental abundances of FGK dwarfs in moving groups can be used as proxies for the otherwise difficult-to-infer elemental abundances of early-type and late-type members of the same moving groups.


title: DefensiveDR: Defending against Adversarial Patches using Dimensionality Reduction

abstract: Adversarial patch-based attacks have shown to be a major deterrent towards the reliable use of machine learning models. These attacks involve the strategic modification of localized patches or specific image areas to deceive trained machine learning models. In this paper, we propose \textit{DefensiveDR}, a practical mechanism using a dimensionality reduction technique to thwart such patch-based attacks. Our method involves projecting the sample images onto a lower-dimensional space while retaining essential information or variability for effective machine learning tasks. We perform this using two techniques, Singular Value Decomposition and t-Distributed Stochastic Neighbor Embedding. We experimentally tune the variability to be preserved for optimal performance as a hyper-parameter. This dimension reduction substantially mitigates adversarial perturbations, thereby enhancing the robustness of the given machine learning model. Our defense is model-agnostic and operates without assumptions about access to model decisions or model architectures, making it effective in both black-box and white-box settings. Furthermore, it maintains accuracy across various models and remains robust against several unseen patch-based attacks. The proposed defensive approach improves the accuracy from 38.8\% (without defense) to 66.2\% (with defense) when performing LaVAN and GoogleAp attacks, which supersedes that of the prominent state-of-the-art like LGS (53.86\%) and Jujutsu (60\%).


title: Bulk photovoltaic effect in antiferromagnet: Role of collective spin dynamics

abstract: Inspired by recent advancements in the bulk photovoltaic effect which can extend beyond the independent particle approximation (IPA), this study delves into the influence of collective spin dynamics in an antiferromagnetic on photocurrent generation using a time domain calculation. In the linear and photocurrent conductivity spectra, we observe peaks below the bandgap regime, attributed to the resonant contributions of collective modes, alongside broadband modifications resulting from off-resonant spin dynamics. Notably, the emergence of spin dynamics allows various types of photocurrent, which are absent in the IPA framework. Furthermore, we emphasize the importance of energy scale proximity between electronic and spin degrees of freedom in enabling efficient feedback between them. These findings offer new avenues for efficient energy harvesting and optoelectronic applications.


title: Evolutionary Equations are $G$-compact

abstract: We prove a compactness result related to $G$-convergence for autonomous evolutionary equations in the sense of Picard. Compared to previous work related to applications, we do not require any boundedness or regularity of the underlying spatial domain; nor do we assume any periodicity or ergodicity assumption on the potentially oscillatory part. In terms of abstract evolutionary equations, we remove any compactness assumptions of the resolvent modulo kernel of the spatial operator. To achieve the results, we introduced a slightly more general class of material laws. As a by-product, we also provide a criterion for $G$-convergence for time-dependent equations solely in terms of static equations.


title: Random Fourier Signature Features

abstract: Tensor algebras give rise to one of the most powerful measures of similarity for sequences of arbitrary length called the signature kernel accompanied with attractive theoretical guarantees from stochastic analysis. Previous algorithms to compute the signature kernel scale quadratically in terms of the length and the number of the sequences. To mitigate this severe computational bottleneck, we develop a random Fourier feature-based acceleration of the signature kernel acting on the inherently non-Euclidean domain of sequences. We show uniform approximation guarantees for the proposed unbiased estimator of the signature kernel, while keeping its computation linear in the sequence length and number. In addition, combined with recent advances on tensor projections, we derive two even more scalable time series features with favourable concentration properties and computational complexity both in time and memory. Our empirical results show that the reduction in computational cost comes at a negligible price in terms of accuracy on moderate-sized datasets, and it enables one to scale to large datasets up to a million time series.


title: A bump statistic on permutations resulting from the Robinson-Schensted correspondence

abstract: In this paper we introduce a new permutation statistic. This statistic counts the number of bumps that occur during the execution of the Robinson-Schensted procedure when applied to a given permutation. We provide several interpretations of this bump statistic that include the tableaux shape and also as an extremal problem concerning permutations and increasing subsequences. Several aspects of this bump statistic are investigated from both structural and enumerative viewpoints.


title: Type A Partially-Symmetric Macdonald Polynomials

abstract: We construct type A partially-symmetric Macdonald polynomials $P_{(\lambda \mid \gamma)}$, where $\lambda \in \mathbb{Z}_{\geq 0}^{n-k}$ is a partition and $\gamma \in \mathbb{Z}_{\geq 0}^k$ is a composition. These are polynomials which are symmetric in the first $n-k$ variables, but not necessarily in the final $k$ variables. We establish their stability and an integral form defined using Young diagram statistics. Finally, we build Pieri-type rules for degree 1 products $x_j P_{(\lambda \mid \gamma)}$ for $j > n-k$ and $e_1[x_1, \dotsc, x_{n-k}] P_{(\lambda \mid \gamma)}$, along with substantial combinatorial simplification of the $e_1$ multiplication. The $P_{(\lambda \mid \gamma)}$ are the same as the $m$-symmetric Macdonald polynomials defined by Lapointe up to a change of variables.


title: Enhanced Measurement of Neutral Atom Qubits with Machine Learning

abstract: We demonstrate qubit state measurements assisted by a supervised convolutional neural network (CNN) in a neutral atom quantum processor. We present two CNN architectures for analyzing neutral atom qubit readout data: a compact 5-layer single-qubit CNN architecture and a 6-layer multi-qubit CNN architecture. We benchmark both architectures against a conventional Gaussian threshold analysis method. In a sparse array (9 {\mu}m atom separation) which experiences negligible crosstalk, we observed up to 32% and 56% error reduction for the multi-qubit and single-qubit architectures respectively, as compared to the benchmark. In a tightly spaced array (5 {\mu}m atom separation), which suffers from readout crosstalk, we observed up to 43% and 32% error reduction in the multi-qubit and single-qubit CNN architectures respectively, as compared to the benchmark. By examining the correlation between the predicted states of neighboring qubits, we found that the multi-qubit CNN architecture reduces the crosstalk correlation up to 78.5%. This work demonstrates a proof of concept for a CNN network to be implemented as a real-time readout processing method on a neutral atom quantum computer, enabling faster readout time and improved fidelity.


title: Characterizing traces of processes defined by precedence and response constraints: an order theory approach

abstract: In this paper we consider a general system of activities that can, but do not have to, occur. This system is governed by a set of two types of constraints: precedence and response. A precedence constraint dictates that an activity can only occur if it has been preceded by some other specified activity. Response constraints are similarly defined. An execution of the system is a listing of activities in the order they occur and which satisfies all constraints. Such systems naturally arise in areas of theoretical computer science and decision science. An outcome of the freedom with which activities can occur is that there are many different possible executions, and gaining a combinatorial insight into these is a non-trivial problem. We characterize all of the ways in which such a system can be executed. Our approach uses order theory to provide a classification in terms of the linear extensions of posets constructed from the constraint sets. This characterization is essential in calculating the stakeholder utility metrics that have been developed by the first author that allow for quantitative comparisons of such systems/processes. It also allows for a better understanding of the theoretical backbone to these processes and their deconstruction as a shuffle product of smaller systems.


title: Invariant subspace perturbation of a matrix with Jordan blocks

abstract: We investigate how invariant subspaces will change when a matrix with a single eigenvalue is perturbed. We focus on the case when an invariant subspace corresponds to the eigenvalues perturbed from those associated with the same order Jordan blocks. An invariant subspace can be expressed as the range of a full column matrix. We characterize the perturbations in terms of fractional orders for the blocks of such a matrix. We also provide the formulas for the coefficient matrices associated with the zero and first fractional orders. The results generalize the existing standard invariant subspace perturbation theory.


title: NavMarkAR: A Landmark-based Augmented Reality (AR) Wayfinding System for Enhancing Spatial Learning of Older Adults

abstract: Wayfinding in complex indoor environments is often challenging for older adults due to declines in navigational and spatial-cognition abilities. This paper introduces NavMarkAR, an augmented reality navigation system designed for smart-glasses to provide landmark-based guidance, aiming to enhance older adults' spatial navigation skills. This work addresses a significant gap in design research, with limited prior studies evaluating cognitive impacts of AR navigation systems. An initial usability test involved 6 participants, leading to prototype refinements, followed by a comprehensive study with 32 participants in a university setting. Results indicate improved wayfinding efficiency and cognitive map accuracy when using NavMarkAR. Future research will explore long-term cognitive skill retention with such navigational aids.


title: Spinon heat transport in the three-dimensional quantum magnet PbCuTe$_2$O$_6$

abstract: Quantum spin liquids (QSL) are novel phases of matter which remain quantum disordered even at the lowest temperature. They are characterized by emergent gauge fields and fractionalized quasiparticles. Here we show that the sub-Kelvin thermal transport of the three-dimensional $S=1/2$ hyper-hyperkagome quantum magnet PbCuTe$_2$O$_6$ is governed by a sizeable charge-neutral fermionic contribution which is compatible with the itinerant fractionalized excitations of a spinon Fermi surface. We demonstrate that this hallmark feature of the QSL state is remarkably robust against sample crystallinity, large magnetic field, and field-induced magnetic order, ruling out the imitation of QSL features by extrinsic effects. Our findings thus reveal the characteristic low-energy features of PbCuTe$_2$O$_6$ which qualify this compound as a true QSL material.


title: Electron irradiation reveals robust fully gapped superconductivity in LaNiGa$_{2}$

abstract: The effects of 2.5 MeV electron irradiation were studied in the superconducting phase of single crystals of LaNiGa$_2$, using measurements of electrical transport and radio-frequency magnetic susceptibility. The London penetration depth is found to vary exponentially with temperature, suggesting a fully gapped Fermi surface. The inferred superfluid density is close to that of a single-gap weak-coupling isotropic $s-$wave superconductor. Superconductivity is extremely robust against nonmagnetic point-like disorder induced by electron irradiation. Our results place strong constraints on the previously proposed triplet pairing state by requiring fine-tuned impurity scattering amplitudes and are most naturally explained by a sign-preserving, weak-coupling, and approximately momentum independent singlet superconducting state in LaNiGa$_2$, which does not break time-reversal symmetry. We discuss how our findings could be reconciled with previous measurements indicating magnetic moments in the superconducting phase.


title: Digital Twin-Based User-Centric Edge Continual Learning in Integrated Sensing and Communication

abstract: In this paper, we propose a digital twin (DT)-based user-centric approach for processing sensing data in an integrated sensing and communication (ISAC) system with high accuracy and efficient resource utilization. The considered scenario involves an ISAC device with a lightweight deep neural network (DNN) and a mobile edge computing (MEC) server with a large DNN. After collecting sensing data, the ISAC device either processes the data locally or uploads them to the server for higher-accuracy data processing. To cope with data drifts, the server updates the lightweight DNN when necessary, referred to as continual learning. Our objective is to minimize the long-term average computation cost of the MEC server by optimizing two decisions, i.e., sensing data offloading and sensing data selection for the DNN update. A DT of the ISAC device is constructed to predict the impact of potential decisions on the long-term computation cost of the server, based on which the decisions are made with closed-form formulas. Experiments on executing DNN-based human motion recognition tasks are conducted to demonstrate the outstanding performance of the proposed DT-based approach in computation cost minimization.


title: Fast Inner-Product Algorithms and Architectures for Deep Neural Network Accelerators

abstract: We introduce a new algorithm called the Free-pipeline Fast Inner Product (FFIP) and its hardware architecture that improve an under-explored fast inner-product algorithm (FIP) proposed by Winograd in 1968. Unlike the unrelated Winograd minimal filtering algorithms for convolutional layers, FIP is applicable to all machine learning (ML) model layers that can mainly decompose to matrix multiplication, including fully-connected, convolutional, recurrent, and attention/transformer layers. We implement FIP for the first time in an ML accelerator then present our FFIP algorithm and generalized architecture which inherently improve FIP's clock frequency and, as a consequence, throughput for a similar hardware cost. Finally, we contribute ML-specific optimizations for the FIP and FFIP algorithms and architectures. We show that FFIP can be seamlessly incorporated into traditional fixed-point systolic array ML accelerators to achieve the same throughput with half the number of multiply-accumulate (MAC) units, or it can double the maximum systolic array size that can fit onto devices with a fixed hardware budget. Our FFIP implementation for non-sparse ML models with 8 to 16-bit fixed-point inputs achieves higher throughput and compute efficiency than the best-in-class prior solutions on the same type of compute platform.


title: HandSight: DeCAF & Improved Fisher Vectors to Classify Clothing Color and Texture with a Finger-Mounted Camera

abstract: We demonstrate the use of DeCAF and Improved Fisher Vector image features to classify clothing texture. The issue of choosing clothes is a problem for the blind every day. This work attempts to solve the issue with a finger-mounted camera and state-of-the-art classification algorithms. To evaluate our solution, we collected 520 close-up images across 29 pieces of clothing. We contribute (1) the HCTD, an image dataset taken with a NanEyeGS camera, a camera small enough to be mounted on the finger, and (2) evaluations of state-of-the-art recognition algorithms applied to our dataset - achieving an accuracy >95%. Throughout the paper, we will discuss previous work, evaluate the current work, and finally, suggest the project's future direction.


title: Wireless BMS Architecture for Secure Readout in Vehicle and Second life Applications

abstract: Battery management systems (BMS) are becoming increasingly important in the modern age, where clean energy awareness is getting more prominent. They are responsible for controlling large battery packs in modern electric vehicles. However, conventional solutions rely only on a wired design, which adds manufacturing cost and complexity. Recent research has considered wireless solutions for the BMS. However, it is still challenging to develop a solution that considers both the active in-vehicle and the external second-life applications. The battery passport initiative aims to keep track of the batteries, both during active and inactive use cases. There is a need to provide a secure design while considering energy and cost-efficient solutions. We aim to fill this gap by proposing a wireless solution based on near-field communication (NFC) that extends previous work and provides a unified architecture for both use cases. To provide protection against common wireless threats, an advanced security analysis is performed, as well as a system design analysis for the wake-up process that reduces the daily power consumption of the stored battery packs from milli- to microwatts.


title: Stochastic flexibility needs assessment: learnings from H2020 EUniversal's German demonstration

abstract: Operational flexibility needs assessment (FNA) is crucial for system operators to plan/procure flexible resources in order to avoid probable network issues. We implemented an FNA tool in the framework of the H2020 EUniversal project for the German demonstration. In this work, we summarize our learnings from the demo implementation to cope with the limited availability of measurement data. Using a reduced network model and key performance indicators, we evaluate the digital-twin results with real-world implementations. The paper aims to motivate future research directions by duly considering real-world limitations in their modelling and developing innovative tailor-made solutions for an improved decision support framework for system operators.


title: A Collapsible Polynomial Hierarchy for Promise Problems

abstract: The polynomial hierarchy has been widely studied in classical complexity theory. In this paper, we will generalize some commonly known results about the polynomial hierarchy to a version of the hierarchy extended to promise problems. This paper proposes new definitions of existential and universal operators for classes of promise problems. Applying these to BQP, we recover the hierarchy proposed by Gharibian et al. (MFCS 2018). Moreover, using our definition, we give an easy proof of the collapse of this hierarchy under a Karp-Lipton-like scenario, which was an open question for the original definition of Gharibian et al.


title: NeuroPrompts: An Adaptive Framework to Optimize Prompts for Text-to-Image Generation

abstract: Despite impressive recent advances in text-to-image diffusion models, obtaining high-quality images often requires prompt engineering by humans who have developed expertise in using them. In this work, we present NeuroPrompts, an adaptive framework that automatically enhances a user's prompt to improve the quality of generations produced by text-to-image models. Our framework utilizes constrained text decoding with a pre-trained language model that has been adapted to generate prompts similar to those produced by human prompt engineers. This approach enables higher-quality text-to-image generations and provides user control over stylistic features via constraint set specification. We demonstrate the utility of our framework by creating an interactive application for prompt enhancement and image generation using Stable Diffusion. Additionally, we conduct experiments utilizing a large dataset of human-engineered prompts for text-to-image generation and show that our approach automatically produces enhanced prompts that result in superior image quality. We make our code and a screencast video demo of NeuroPrompts publicly available.


title: Data-Guided Regulator for Adaptive Nonlinear Control

abstract: This paper addresses the problem of designing a data-driven feedback controller for complex nonlinear dynamical systems in the presence of time-varying disturbances with unknown dynamics. Such disturbances are modeled as the "unknown" part of the system dynamics. The goal is to achieve finite-time regulation of system states through direct policy updates while also generating informative data that can subsequently be used for data-driven stabilization or system identification. First, we expand upon the notion of "regularizability" and characterize this system characteristic for a linear time-varying representation of the nonlinear system with locally-bounded higher-order terms. "Rapid-regularizability" then gauges the extent by which a system can be regulated in finite time, in contrast to its asymptotic behavior. We then propose the Data-Guided Regulation for Adaptive Nonlinear Control ( DG-RAN) algorithm, an online iterative synthesis procedure that utilizes discrete time-series data from a single trajectory for regulating system states and identifying disturbance dynamics. The effectiveness of our approach is demonstrated on a 6-DOF power descent guidance problem in the presence of adverse environmental disturbances.


title: Local Kakutani's ellipsoid characterization

abstract: We prove the following local version of Kakutani's characterization of ellipsoids: Let $V$ be a finite-dimensional real vector space, $B\subset V$ a convex body with 0 in its interior, and ${2\le k<\dim V}$ an integer. Suppose that the body $B$ is contained in a cylinder based on the cross-section $B \cap X$ for any $k$-plane $X$ from a connected open set of linear $k$-planes in $V$. Then in the region of $V$ swept by these $k$-planes $B$ coincides with either an ellipsoid, or a cylinder over an ellipsoid, or a cylinder over a $k$-dimensional base. For $k=2$ and $k=3$ we obtain as a corollary a local solution to Banach's isometric subspace problem: If all cross-sections of $B$ by $k$-planes from a connected open set are linearly equivalent, then the same conclusion as above holds.


title: The principal eigenvalue problem for a strongly anisotropic second-order elliptic operator

abstract: We consider an elliptic operator in which the second-order term is very small in one direction. In this regime, we study the behaviour of the principal eigenfunction and of the principal eigenvalue. Our first result deals with the limit of the principal eigenfunction and is shown with a representation of the principal eigenfunction as a quasi-stationary distribution. Subsequent results deal with the limit of the principal eigenvalue and are shown using Hamilton-Jacobi equations.


title: Unifying Corroborative and Contributive Attributions in Large Language Models

abstract: As businesses, products, and services spring up around large language models, the trustworthiness of these models hinges on the verifiability of their outputs. However, methods for explaining language model outputs largely fall across two distinct fields of study which both use the term "attribution" to refer to entirely separate techniques: citation generation and training data attribution. In many modern applications, such as legal document generation and medical question answering, both types of attributions are important. In this work, we argue for and present a unified framework of large language model attributions. We show how existing methods of different types of attribution fall under the unified framework. We also use the framework to discuss real-world use cases where one or both types of attributions are required. We believe that this unified framework will guide the use case driven development of systems that leverage both types of attribution, as well as the standardization of their evaluation.


title: A Steep Decline in the Galaxy Space Density Beyond Redshift 9 in the CANUCS UV Luminosity Function

abstract: We present a new sample of 158 galaxies at redshift $z>7.5$ selected from deep \jwst\ NIRCam imaging of five widely-separated sightlines in the CANUCS survey. Two-thirds of the pointings and 80\% of the galaxies are covered by 12 to 14 NIRCam filters, including seven to nine medium bands, providing accurate photometric redshifts and robustness against low redshift interlopers. A sample of 28 galaxies at $z>7.5$ with spectroscopic redshifts shows a low systematic offset and scatter in the difference between photometric and spectroscopic redshifts. We derive the galaxy UV luminosity function at redshifts 8 to 12, finding a slightly higher normalization than previously seen with \hst\ at redshifts 8 to 10. We observe a steeper decline in the galaxy space density from $z=8$ to $12$ than found by most \jwst\ Cycle 1 studies. In particular, we find only eight galaxies at $z>10$ and none at $z>12.5$, with no $z>10$ galaxies brighter than F277W AB=28 or $M_{\rm UV}=-20$ in our unmasked, delensed survey area of 53.4 square arcminutes. We attribute the lack of bright $z>10$ galaxies in CANUCS compared to GLASS and CEERS to intrinsic variance in the galaxy density along different sightlines. The evolution in the CANUCS luminosity function between $z=8$ and $12$ is comparable to that predicted by simulations that assume a standard star formation efficiency, without invoking any special adjustments.


title: Improvements in Interlayer Pipelining of CNN Accelerators Using Genetic Algorithms

abstract: Deploying Convolutional Neural Networks (CNNs) on edge platforms necessitates efficient hardware acceleration. Any unnecessary data movement in such accelerators can unacceptably degrade performance and efficiency. To address this, we develop a layer fusion technique targeting CNNs, that reduces off-chip data communication using a Genetic Algorithm (GA) applied to graph-based topological sort. Results show a 1.8$\times$ increase in energy efficiency and 1.9$\times$ improvement in energy-delay product (EDP) for MobileNet-v3 on a SIMBA-like mobile architecture. Our approach consistently improves workload performance, averaging 1.4$\times$ improvement to EDP for SIMBA and 1.12$\times$ for Eyeriss.


title: Ontological Reasoning over Shy and Warded Datalog$+/-$ for Streaming-based Architectures (technical report)

abstract: Recent years witnessed a rising interest towards Datalog-based ontological reasoning systems, both in academia and industry. These systems adopt languages, often shared under the collective name of Datalog$+/-$, that extend Datalog with the essential feature of existential quantification, while introducing syntactic limitations to sustain reasoning decidability and achieve a good trade-off between expressive power and computational complexity. From an implementation perspective, modern reasoners borrow the vast experience of the database community in developing streaming-based data processing systems, such as volcano-iterator architectures, that sustain a limited memory footprint and good scalability. In this paper, we focus on two extremely promising, expressive, and tractable languages, namely, Shy and Warded Datalog$+/-$. We leverage their theoretical underpinnings to introduce novel reasoning techniques, technically, "chase variants", that are particularly fit for efficient reasoning in streaming-based architectures. We then implement them in Vadalog, our reference streaming-based engine, to efficiently solve ontological reasoning tasks over real-world settings.


title: Crystal Nucleation in an AlNiZr Metallic Liquid: Within and Beyond Classical Nucleation Theory

abstract: The Classical Nucleation Theory (CNT) has played a key role in crystal nucleation studies since the 19th century and has significantly advanced the understanding of nucleation. However, certain key assumptions of CNT, such as a compact and spherical nucleating cluster and the concept of individual diffusive jumps are questionable. The results of molecular dynamics (MD) studies of crystal nucleation in a Al20Ni60Zr20 metallic liquid demonstrate that the nucleating cluster is neither spherical nor compact. The seeding method was employed to determine the critical cluster size and nucleation parameters from CNT, which were then compared to those derived from the Mean First Passage Time (MFPT) method. While the CNT-based nucleation rate aligns well with experimental data from similar metallic liquids, the MFPT rate differs significantly. Further, contrary to the assumption of individual jumps for atoms to join the nucleating cluster, a cooperative mechanism of attachment or detachment is observed. This is accompanied by synchronized changes in the local potential energy. Similar cooperative motion also appeared in a non-classical nucleation process, particularly during the coalescence of nuclei.


title: Foundations of Quantum Information for Physical Chemistry

abstract: Quantum information, a field in which great advances have been made in the past decades, now presents opportunities for chemistry. One roadblock to progress, especially for experimental chemical science, is that new concepts and technical definitions need to be learned. In this paper, we review some basic, but sometimes misunderstood, concepts of quantum information based on the mathematical formulation of quantum mechanics that will be useful for chemists interested in discovering ways that chemistry can contribute to the quantum information field. We cover topics including qubits and their density matrix formalism, quantum measurement as a quantum operation, information theory, and entanglement. We focus on the difference between the concepts in the quantum context and the classic context. We also discuss the relation and distinction among entanglement, correlation, and coherence. We aim to clarify the rigorous definition of these concepts, and then indicate some examples in physical chemistry.


title: Quantum-inspired nonlinear Galerkin ansatz for high-dimensional HJB equations

abstract: Neural networks are increasingly recognized as a powerful numerical solution technique for partial differential equations (PDEs) arising in diverse scientific computing domains, including quantum many-body physics. In the context of time-dependent PDEs, the dominant paradigm involves casting the approximate solution in terms of stochastic minimization of an objective function given by the norm of the PDE residual, viewed as a function of the neural network parameters. Recently, advancements have been made in the direction of an alternative approach which shares aspects of nonlinearly parametrized Galerkin methods and variational quantum Monte Carlo, especially for high-dimensional, time-dependent PDEs that extend beyond the usual scope of quantum physics. This paper is inspired by the potential of solving Hamilton-Jacobi-Bellman (HJB) PDEs using Neural Galerkin methods and commences the exploration of nonlinearly parametrized trial functions for which the evolution equations are analytically tractable. As a precursor to the Neural Galerkin scheme, we present trial functions with evolution equations that admit closed-form solutions, focusing on time-dependent HJB equations relevant to finance.


title: Sturm-Liouville systems for the survival probability in first-passage time problems

abstract: We derive a Sturm-Liouville system of equations for the exact calculation of the survival probability in first-passage time problems. This system is the one associated with the Wiener-Hopf integral equation obtained from the theory of random walks. The derived approach is an alternative to the existing literature and we tested it against direct calculations from both discrete- and continuous-time random walks in a manageable, but meaningful, example. Within this framework, the Sparre Andersen theorem results to be a boundary condition for the system.


title: InteraSSort: Interactive Assortment Planning Using Large Language Models

abstract: Assortment planning, integral to multiple commercial offerings, is a key problem studied in e-commerce and retail settings. Numerous variants of the problem along with their integration into business solutions have been thoroughly investigated in the existing literature. However, the nuanced complexities of in-store planning and a lack of optimization proficiency among store planners with strong domain expertise remain largely overlooked. These challenges frequently necessitate collaborative efforts with multiple stakeholders which often lead to prolonged decision-making processes and significant delays. To mitigate these challenges and capitalize on the advancements of Large Language Models (LLMs), we propose an interactive assortment planning framework, InteraSSort that augments LLMs with optimization tools to assist store planners in making decisions through interactive conversations. Specifically, we develop a solution featuring a user-friendly interface that enables users to express their optimization objectives as input text prompts to InteraSSort and receive tailored optimized solutions as output. Our framework extends beyond basic functionality by enabling the inclusion of additional constraints through interactive conversation, facilitating precise and highly customized decision-making. Extensive experiments demonstrate the effectiveness of our framework and potential extensions to a broad range of operations management challenges.


title: Uniformly Strict Equilibrium for Repeated Games with Private Monitoring and Communication

abstract: Cooperation through repetition is an important theme in game theory. In this regard, various celebrated ``folk theorems'' have been proposed for repeated games in increasingly more complex environments. There has, however, been insufficient attention paid to the robustness of a large set of equilibria that is needed for such folk theorems. Starting with perfect public equilibrium as our starting point, we study uniformly strict equilibria in repeated games with private monitoring and direct communication (cheap talk). We characterize the limit equilibrium payoff set and identify the conditions for the folk theorem to hold with uniformly strict equilibrium.


title: Properties of Intense Electromagnetic Ion Cyclotron Waves: Implications for Quasi-linear, Nonlinear, and Nonresonant Wave-Particle Interactions

abstract: Resonant interactions between relativistic electrons and electromagnetic ion cyclotron (EMIC) waves provide an effective loss mechanism for this important electron population in the outer radiation belt. The diffusive regime of electron scattering and loss has been well incorporated into radiation belt models within the framework of the quasi-linear diffusion theory, whereas the nonlinear regime has been mostly studied with test particle simulations. There is also a less investigated, nonresonant regime of electron scattering by EMIC waves. All three regimes should be present, depending on the EMIC waves and ambient plasma properties, but the occurrence rates of these regimes have not been previously quantified. This study provides a statistical investigation of the most important EMIC wave-packet characteristics for the diffusive, nonlinear, and nonresonant regimes of electron scattering. We utilize 3 years of Van Allen Probe observations to derive distributions of wave amplitudes, wave-packet sizes, and rates of frequency variations within individual wave-packets. We demonstrate that EMIC waves typically propagate as wave-packets with $\sim 10$ wave periods each, and that $\sim 3-10$\% of such wave-packets can reach the regime of nonlinear resonant interaction with 2 to 6 MeV electrons. We show that EMIC frequency variations within wave-packets reach $50-100$\% of the center frequency, corresponding to a significant high-frequency tail in their wave power spectrum. We explore the consequences of these wave-packet characteristics for high and low energy electron precipitation by H-band EMIC waves and for the relative importance of quasi-linear and nonlinear regimes of wave-particle interactions.


title: Provable Representation with Efficient Planning for Partial Observable Reinforcement Learning

abstract: In most real-world reinforcement learning applications, state information is only partially observable, which breaks the Markov decision process assumption and leads to inferior performance for algorithms that conflate observations with state. Partially Observable Markov Decision Processes (POMDPs), on the other hand, provide a general framework that allows for partial observability to be accounted for in learning, exploration and planning, but presents significant computational and statistical challenges. To address these difficulties, we develop a representation-based perspective that leads to a coherent framework and tractable algorithmic approach for practical reinforcement learning from partial observations. We provide a theoretical analysis for justifying the statistical efficiency of the proposed algorithm, and also empirically demonstrate the proposed algorithm can surpass state-of-the-art performance with partial observations across various benchmarks, advancing reliable reinforcement learning towards more practical applications.


title: Towards Accurate Loop Closure Detection in Semantic SLAM with 3D Semantic Covisibility Graphs

abstract: Loop closure is necessary for correcting errors accumulated in simultaneous localization and mapping (SLAM) in unknown environments. However, conventional loop closure methods based on low-level geometric or image features may cause high ambiguity by not distinguishing similar scenarios. Thus, incorrect loop closures can occur. Though semantic 2D image information is considered in some literature to detect loop closures, there is little work that compares 3D scenes as an integral part of a semantic SLAM system. This paper introduces an approach, called SmSLAM+LCD, integrated into a semantic SLAM system to combine high-level 3D semantic information and low-level feature information to conduct accurate loop closure detection and effective drift reduction. The effectiveness of our approach is demonstrated in testing results.


title: Evolution of viscous vortex filaments and desingularization of the Biot-Savart integral

abstract: We consider a viscous fluid with kinematic viscosity $\nu $ and initial data consisting of a smooth closed vortex filament with circulation $\Gamma $. We show that, for short enough time, the solution consists of a deformed Lamb-Oseen vortex whose center (a filament) follows the binormal flow dynamics plus leading order corrections that depend locally on the filament curvature and the nonlocal interactions with distant parts of the filament. In order to achieve this scale separation we require $\Gamma /\nu $ to be sufficiently small.


title: A simulated electronic market with speculative behaviour and bubble formation

abstract: This paper presents an agent based model of an electronic market with two types of trading agents. One type follows a mean reverting strategy and the other, the speculative trader, tracks the maximum realised return over recent trades. The speculators have a distribution of returns concentrated on negative returns, with a small fraction making profits. The market experiences an increased volatility and prices that greatly depart from the fundamental value of the asset. Our research provides synthetic datasets of the order book to study its dynamics under different levels of speculation


title: Sparse graph counting and Kelley-Meka bounds for binary systems

abstract: In a recent breakthrough, Kelley and Meka (FOCS 2023) obtained a strong upper bound on the density of sets of integers without nontrivial three-term arithmetic progressions. In this work, we extend their result, establishing similar bounds for all linear patterns defined by binary systems of linear forms, where "binary" indicates that every linear form depends on exactly two variables. Prior to our work, no strong bounds were known for such systems even in the finite field model setting. A key ingredient in our proof is a graph counting lemma. The classical graph counting lemma, developed by Thomason (Random Graphs 1985) and Chung, Graham, and Wilson (Combinatorica 1989), is a fundamental tool in combinatorics. For a fixed graph $H$, it states that the number of copies of $H$ in a pseudorandom graph $G$ is similar to the number of copies of $H$ in a purely random graph with the same edge density as $G$. However, this lemma is only non-trivial when $G$ is a dense graph. In this work, we prove a graph counting lemma that is also effective when $G$ is sparse. Moreover, our lemma is well-suited for density increment arguments in additive number theory. As an immediate application, we obtain a strong bound for the Tur\'an problem in abelian Cayley sum graphs: let $\Gamma$ be a finite abelian group with odd order. If a Cayley sum graph on $\Gamma$ does not contain any $r$-clique as a subgraph, it must have at most $2^{-\Omega_r(\log^{1/16}|\Gamma|)}\cdot |\Gamma|^2$ edges. These results hinge on the technology developed by Kelley and Meka and the follow-up work by Kelley, Lovett, and Meka (STOC 2024).


title: The merger of hard binaries in globular clusters as the primary channel for the formation of second generation stars

abstract: We have recently presented observational evidence which suggests that the origin of the second generation (G2) stars in globular clusters (GCs) is due to the binary-mediated collision of primordial (G1) low-mass main-sequence (MS) stars. This mechanism avoids both the mass budget problem and the need of external gas for dilution. Here, we report on another piece of evidence supporting this scenario: (1) the fraction of MS binaries is proportional to the fraction of G1 stars in GCs and, at the same time, (2) the smaller the fraction of G1 stars is, the more deficient binaries of higher mass ratio (q$>0.7$) are. They are, on average, harder than their smaller mass-ratio counterparts due to higher binding energy at a given primary mass. Then (2) implies that (1) is due to the merging\slash collisions of hard binaries rather than to their disruption. These new results complemented by the present-day data on binaries lead to the following conclusions: (i) the mass-ratio distribution of binaries, particularly short-period ones, with low-mass primaries, $M_{\rm P} < 1.5$ M$_{\sun}$, is strongly peaked close to q$=1.0$, whereas (ii) dynamical processes at high stellar density tend to destroy softer binaries and make hard (nearly) twin binaries to become even harder and favor their mergers and collisions. G2 stars formed this way gain mass that virtually doubles the primary one, $2M_{\rm P}$, at which the number of G1 stars is $\sim5$ times smaller than at $M_{\rm P}$ according to the slope of a Milky Way-like IMF at $M_{\rm MS} < 1.0$ M$_{\sun}$.


title: Generation of super-stable vector modes using on-axis complex-amplitude modulation

abstract: In this manuscript, we propose the generation of complex vector beams with high quality and stability based on a novel approach that relies on the combination of two techniques that seem incompatible at first glance. The first is Complex Amplitude Modulation (CAM), which produces scalar structured light fields in phase and amplitude with high accuracy. The second is on-axis modulation for the generation of vector beams, a method that requires phase-only holograms, therefore yielding beams of reduced quality. More precisely, the idea behind our technique is to send the shaped light produced by CAM co-axially to the zeroth order, rather than to the first order, as commonly done. We describe our technique, explaining the generation of the hologram and experimental setup to isolate the desired vector mode, and then present experimental results that corroborate our approach. We first address the quality of the generated beams using Stokes polarimetry to reconstruct their transverse polarisation distribution, and then compare their stability against the same mode produced using a popular interferometric method. Our vector beams are of good quality and remarkably stable, two qualities that we expect will appeal to the community working with vector modes.


title: Strongly Coupled Two-scale System with Nonlinear Dispersion: Weak Solvability and Numerical Simulation

abstract: We investigate a two-scale system featuring an upscaled parabolic dispersion-reaction equation intimately linked to a family of elliptic cell problems. The system is strongly coupled through a dispersion tensor, which depends on the solutions to the cell problems, and via the cell problems themselves, where the solution of the parabolic problem interacts nonlinearly with the drift term. This particular mathematical structure is motivated by a rigorously derived upscaled reaction-diffusion-convection model that describes the evolution of a population of interacting particles pushed by a large drift through an array of periodically placed obstacles (i.e., through a regular porous medium). We prove the existence and uniqueness of weak solutions to our system by means of an iterative scheme, where particular care is needed to ensure the uniform positivity of the dispersion tensor. Additionally, we use finite element-based approximations for the same iteration scheme to perform multiple simulation studies. Finally, we highlight how the choice of micro-geometry (building the regular porous medium) and of the nonlinear drift coupling affects the macroscopic dispersion of particles.


title: Sensitivity analysis with multiple treatments and multiple outcomes with applications to air pollution mixtures

abstract: Understanding the health impacts of air pollution is vital in public health research. Numerous studies have estimated negative health effects of a variety of pollutants, but accurately gauging these impacts remains challenging due to the potential for unmeasured confounding bias that is ubiquitous in observational studies. In this study, we develop a framework for sensitivity analysis in settings with both multiple treatments and multiple outcomes simultaneously. This setting is of particular interest because one can identify the strength of association between the unmeasured confounders and both the treatment and outcome, under a factor confounding assumption. This provides informative bounds on the causal effect leading to partial identification regions for the effects of multivariate treatments that account for the maximum possible bias from unmeasured confounding. We also show that when negative controls are available, we are able to refine the partial identification regions substantially, and in certain cases, even identify the causal effect in the presence of unmeasured confounding. We derive partial identification regions for general estimands in this setting, and develop a novel computational approach to finding these regions.


title: The limitation of neural nets for approximation and optimization

abstract: We are interested in assessing the use of neural networks as surrogate models to approximate and minimize objective functions in optimization problems. While neural networks are widely used for machine learning tasks such as classification and regression, their application in solving optimization problems has been limited. Our study begins by determining the best activation function for approximating the objective functions of popular nonlinear optimization test problems, and the evidence provided shows that~SiLU has the best performance. We then analyze the accuracy of function value, gradient, and Hessian approximations for such objective functions obtained through interpolation/regression models and neural networks. When compared to interpolation/regression models, neural networks can deliver competitive zero- and first-order approximations (at a high training cost) but underperform on second-order approximation. However, it is shown that combining a neural net activation function with the natural basis for quadratic interpolation/regression can waive the necessity of including cross terms in the natural basis, leading to models with fewer parameters to determine. Lastly, we provide evidence that the performance of a state-of-the-art derivative-free optimization algorithm can hardly be improved when the gradient of an objective function is approximated using any of the surrogate models considered, including neural networks.


title: A Counterexample to a Question on Grothendieck Groups of Schemes

abstract: If an element of the Grothendieck group of the derived category of a scheme is locally represented by perfect complexes, then can the original element be represented by a perfect complex? We provide a counterexample on a projective variety of dimension 2, as well as a counterexample on a thickening of a Dedekind domain.


title: Exploring Time Granularity on Temporal Graphs for Dynamic Link Prediction in Real-world Networks

abstract: Dynamic Graph Neural Networks (DGNNs) have emerged as the predominant approach for processing dynamic graph-structured data. However, the influence of temporal information on model performance and robustness remains insufficiently explored, particularly regarding how models address prediction tasks with different time granularities. In this paper, we explore the impact of time granularity when training DGNNs on dynamic graphs through extensive experiments. We examine graphs derived from various domains and compare three different DGNNs to the baseline model across four varied time granularities. We mainly consider the interplay between time granularities, model architectures, and negative sampling strategies to obtain general conclusions. Our results reveal that a sophisticated memory mechanism and proper time granularity are crucial for a DGNN to deliver competitive and robust performance in the dynamic link prediction task. We also discuss drawbacks in considered models and datasets and propose promising directions for future research on the time granularity of temporal graphs.


title: Local control of a single nitrogen-vacancy center by nanoscale engineered magnetic domain wall motions

abstract: Effective control and readout of qubits form the technical foundation of next-generation, transformative quantum information sciences and technologies. The nitrogen-vacancy (NV) center, an intrinsic three-level spin system, is naturally relevant in this context due to its excellent quantum coherence, high fidelity of operations, and remarkable functionality over a broad range of experimental conditions. It is an active contender for the development and implementation of cutting-edge quantum technologies. Here, we report magnetic domain wall motion driven local control and measurements of NV spin properties. By engineering the local magnetic field environment of an NV center via nanoscale reconfigurable domain wall motions, we show that NV photoluminescence, spin level energies, and coherence time can be reliably controlled and correlated to the magneto-transport response of a magnetic device. Our results highlight the electrically tunable dipole interaction between NV centers and nanoscale magnetic structures, providing an attractive platform to realize interactive information transfer between spin qubits and non-volatile magnetic memory in hybrid quantum spintronic systems.


title: Equipping Pretrained Unconditional Music Transformers with Instrument and Genre Controls

abstract: The ''pretraining-and-finetuning'' paradigm has become a norm for training domain-specific models in natural language processing and computer vision. In this work, we aim to examine this paradigm for symbolic music generation through leveraging the largest ever symbolic music dataset sourced from the MuseScore forum. We first pretrain a large unconditional transformer model using 1.5 million songs. We then propose a simple technique to equip this pretrained unconditional music transformer model with instrument and genre controls by finetuning the model with additional control tokens. Our proposed representation offers improved high-level controllability and expressiveness against two existing representations. The experimental results show that the proposed model can successfully generate music with user-specified instruments and genre. In a subjective listening test, the proposed model outperforms the pretrained baseline model in terms of coherence, harmony, arrangement and overall quality.


title: Tile Numbers of Knot Corner Mosaics

abstract: A knot mosaic is a grid of pictorial tiles representing a tame knot or link. Recently, two groups independently introduced a new set of tiles. We call mosaics made with these new tiles corner mosaics. The (corner) tile number is the minimum number of tiles needed to represent a knot or link as a (corner) mosaic. We show that the corner tile number plus a positive term is less than or equal to the tile number. This positive term is greater than or equal to four for all links with no unlinked, unknotted components. We also show that the only links with corner tile number less than nine and no unlinked, unknotted components are the Hopf link, the trefoil, and Soloman's knot.


title: Analytical models of supermassive black holes in galaxies surrounded by dark matter halos

abstract: In this Letter, we present five analytical models in closed forms, each representing a supermassive black hole (SMBH) located at the center of a galaxy surrounded by dark matter (DM) halo. The density profile of the halo vanishes inside twice the Schwarzschild radius of the hole and satisfies the weak, strong, and dominant energy conditions. The spacetime are asymptotically flat, and the difference among the models lies in the slopes of the density profiles in the spike and regions far from the center of the galaxy. Three of them represent cusp models, whereas the other two represent core models. With the well-known (generalized) Newman-Janis algorithm, rotating SMBHs with DM halos can be easily constructed from these models.


title: Geodesic ball packings generated by rotations and monotonicity behavior of their densities in $\mathbf{H}^2\!\times\!\mathbf{R}$ space

abstract: After having investigated several types of geodesic ball packings in $\SXR$ space, in this paper we study the locally optimal geodesic simply and multiply transitive ball packings with equal balls to the space groups generated by rotations in $\HXR$ geometry which space can be derived by the direct product of the hyperbolic plane $\bH^2$ and the real line $\bR$. Moreover, we develop a procedure to determine the densities of the above locally densest geodesic ball packing configurations. Additionally, we examine the monotonicity properties of the densities within infinite series of the considered space groups. E. Moln\'ar showed, that the homogeneous 3-spaces have a unified interpretation in the projective 3-sphere $\mathcal{PS}^3(\bV^4,\BV_4, \mathbf{R})$. In our work, we use this projective model of $\HXR$ and apply this to the visualization of locally optimal ball arrangements.


title: EnduRL: Enhancing Safety, Stability, and Efficiency of Mixed Traffic Under Real-World Perturbations Via Reinforcement Learning

abstract: Human-driven vehicles (HVs) amplify naturally occurring perturbations in traffic, leading to congestion--a major contributor to increased fuel consumption, higher collision risks, and reduced road capacity utilization. While previous research demonstrates that Robot Vehicles (RVs) can be leveraged to mitigate these issues, most such studies rely on simulations with simplistic models of human car-following behaviors. In this work, we analyze real-world driving trajectories and extract a wide range of acceleration profiles. We then incorporates these profiles into simulations for training RVs to mitigate congestion. We evaluate the safety, efficiency, and stability of mixed traffic via comprehensive experiments conducted in two mixed traffic environments (Ring and Bottleneck) at various traffic densities, configurations, and RV penetration rates. The results show that under real-world perturbations, prior RV controllers experience performance degradation on all three objectives (sometimes even lower than 100% HVs). To address this, we introduce a reinforcement learning based RV that employs a congestion stage classifier to optimize the safety, efficiency, and stability of mixed traffic. Our RVs demonstrate significant improvements: safety by up to 66%, efficiency by up to 54%, and stability by up to 97%.


title: Reclassifying Feynman integrals as special functions

abstract: Although Feynman integrals in general cannot be expressed as well-studied special functions, they can be calculated systematically and efficiently using the \texttt{AMFlow} method in combination with differential equations in the kinematic space. Therefore, it is constructive to define Feynman integrals as a new class of special functions (or transcedental numbers if there is no kinematic variable). Several crucial avenues for further exploration in this direction are outlined.


title: Quantum Vector Signal Analyzer

abstract: A technique that allows a harmonic oscillator to be used as a wideband, vector signal analyzer is described and demonstrated using a single trapped 40Ca+ ion cooled near its motional ground state. Further, the analyzer is shown to be compatible with both quantum amplification via squeezing and measurement in the Fock basis, allowing performance beyond the standard quantum limit. In addition to providing an attractive platform for quantum sensing of small fields, the technique allows in situ calibration of qubit control lines in systems using quantum harmonic oscillators and transduction of external, non-resonant drives into oscillator motion. This technique is extendable to other quantum harmonic oscillator systems.


title: Resilient Control of Networked Microgrids using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

abstract: Improving system-level resiliency of networked microgrids is an important aspect with increased population of inverter-based resources (IBRs). This paper (1) presents resilient control design in presence of adversarial cyber-events, and proposes a novel federated reinforcement learning (Fed-RL) approach to tackle (a) model complexities, unknown dynamical behaviors of IBR devices, (b) privacy issues regarding data sharing in multi-party-owned networked grids, and (2) transfers learned controls from simulation to hardware-in-the-loop test-bed, thereby bridging the gap between simulation and real world. With these multi-prong objectives, first, we formulate a reinforcement learning (RL) training setup generating episodic trajectories with adversaries (attack signal) injected at the primary controllers of the grid forming (GFM) inverters where RL agents (or controllers) are being trained to mitigate the injected attacks. For networked microgrids, the horizontal Fed-RL method involving distinct independent environments is not appropriate, leading us to develop vertical variant Federated Soft Actor-Critic (FedSAC) algorithm to grasp the interconnected dynamics of networked microgrid. Next, utilizing OpenAI Gym interface, we built a custom simulation set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark test systems comprising 3 interconnected microgrids. Finally, the learned policies in simulation world are transferred to the real-time hardware-in-the-loop test-bed set-up developed using high-fidelity Hypersim platform. Experiments show that the simulator-trained RL controllers produce convincing results with the real-time test-bed set-up, validating the minimization of sim-to-real gap.


title: Virtual Home Staging: Inverse Rendering and Editing an Indoor Panorama under Natural Illumination

abstract: We propose a novel inverse rendering method that enables the transformation of existing indoor panoramas with new indoor furniture layouts under natural illumination. To achieve this, we captured indoor HDR panoramas along with real-time outdoor hemispherical HDR photographs. Indoor and outdoor HDR images were linearly calibrated with measured absolute luminance values for accurate scene relighting. Our method consists of three key components: (1) panoramic furniture detection and removal, (2) automatic floor layout design, and (3) global rendering with scene geometry, new furniture objects, and a real-time outdoor photograph. We demonstrate the effectiveness of our workflow in rendering indoor scenes under different outdoor illumination conditions. Additionally, we contribute a new calibrated HDR (Cali-HDR) dataset that consists of 137 calibrated indoor panoramas and their associated outdoor photographs.


title: Stability and equivariant Gromov--Hausdorff convergence

abstract: We give applications of equivariant Gromov--Hausdorff convergence in various contexts. Namely, using equivariant Gromov--Hausdorff convergence, we prove a stability result in the setting of compact finite dimensional Alexandrov spaces. Moreover, we introduce the notion of an \emph{almost commutative diagram} and show that its use simplifies both exposition and argument.


title: Learning Causal Representations from General Environments: Identifiability and Intrinsic Ambiguity

abstract: We study causal representation learning, the task of recovering high-level latent variables and their causal relationships in the form of a causal graph from low-level observed data (such as text and images), assuming access to observations generated from multiple environments. Prior results on the identifiability of causal representations typically assume access to single-node interventions which is rather unrealistic in practice, since the latent variables are unknown in the first place. In this work, we provide the first identifiability results based on data that stem from general environments. We show that for linear causal models, while the causal graph can be fully recovered, the latent variables are only identified up to the surrounded-node ambiguity (SNA) \citep{varici2023score}. We provide a counterpart of our guarantee, showing that SNA is basically unavoidable in our setting. We also propose an algorithm, \texttt{LiNGCReL} which provably recovers the ground-truth model up to SNA, and we demonstrate its effectiveness via numerical experiments. Finally, we consider general non-parametric causal models and show that the same identification barrier holds when assuming access to groups of soft single-node interventions.


title: Boosting Audio-visual Zero-shot Learning with Large Language Models

abstract: Audio-visual zero-shot learning aims to recognize unseen classes based on paired audio-visual sequences. Recent methods mainly focus on learning multi-modal features aligned with class names to enhance the generalization ability to unseen categories. However, these approaches ignore the obscure event concepts in class names and may inevitably introduce complex network structures with difficult training objectives. In this paper, we introduce a straightforward yet efficient framework called KnowleDge-Augmented audio-visual learning (KDA), which aids the model in more effectively learning novel event content by leveraging an external knowledge base. Specifically, we first propose to utilize the knowledge contained in large language models (LLMs) to generate numerous descriptive sentences that include important distinguishing audio-visual features of event classes, which helps to better understand unseen categories. Furthermore, we propose a knowledge-aware adaptive margin loss to help distinguish similar events, further improving the generalization ability towards unseen classes. Extensive experimental results demonstrate that our proposed KDA can outperform state-of-the-art methods on three popular audio-visual zero-shot learning datasets.Our code will be avaliable at \url{https://github.com/chenhaoxing/KDA}.


title: Hochschild cohomology for functors on linear symmetric monoidal categories

abstract: Let $R$ be a commutative ring with unit. We develop a Hochschild cohomology theory in the category $\mathcal{F}$ of linear functors defined from an essentially small symmetric monoidal category enriched in $R$-Mod, to $R$-Mod. The category $\mathcal{F}$ is known to be symmetric monoidal too, so one can consider monoids in $\mathcal{F}$ and modules over these monoids, which allows for the possibility of a Hochschild cohomology theory. The emphasis of the article is in considering natural hom constructions appearing in this context. These homs, together with the abelian structure of $\mathcal{F}$ lead to nice definitions and provide effective tools to prove the main properties and results of the classical Hochschild cohomology theory.


title: Constraints from Solar System tests on a covariant loop quantum black hole

abstract: Recently, a covariant spherically symmetric model of a black hole within the framework of loop quantum gravity (LQG), characterized by a quantum parameter $r_0$ or $\lambda$, has been proposed. To derive constraints on the LQG-corrected parameter, we explore observational constraints imposed on $r_0$ and $\lambda$ through investigations of the light deflection, the Shapiro time delay, the precession of perihelia, and the geodetic precession test. Among these constraints, the tightest one arises from the Shapiro time delay measured by the Cassini mission, yielding an upper constraint of approximately $10^{-5}$.


title: Approximating Maximally Localized Wannier Functions with Position Scaling-Eigenfunction

abstract: Position scaling-eigenfunctions are generated by transforming compactly supported orthonormal scaling functions and utilized for faster alternatives to maximally localized Wannier functions (MLWFs). The position scaling-eigenfunctions are first applied to numerical procedures solving Schr\"odinger and Maxwell's equations, and the solutions well agree with preceding results. Subsequently, by projecting the position scaling-eigenfunctions onto the space spanned by the Bloch functions, approximated MLWFs are obtained. They show good agreements with preceding results using MLWFs. In addition, analytical explanations of the agreements and an estimate of the error associated with the approximation are provided.


title: Procedural Generation of Grain Orientations using the Wave Function Collapse Algorithm

abstract: Statistics of grain sizes and orientations in metals correlate to the material's mechanical properties. Reproducing representative volume elements for further analysis of deformation and failure in metals, like 316L stainless steel, is particularly important due to their wide use in manufacturing goods today. Two approaches, initially created for video games, were considered for the procedural generation of representative grain microstructures. The first is the Wave Function Collapse (WFC) algorithm, and the second is constraint propagation and probabilistic inference through Markov Junior, a free and open-source software. This study aimed to investigate these two algorithms' effectiveness in using reference electron backscatter diffraction (EBSD) maps and recreating a statistically similar one that could be used in further research. It utilized two stainless steel EBSD maps as references to test both algorithms. First, the WFC algorithm was too constricting and, thus, incapable of producing images that resembled EBSDs. The second, MarkovJunior, was much more effective in creating a Voronoi tessellation that could be used to create an EBSD map in Python. When comparing the results between the reference and the generated EBSD, we discovered that the orientation and volume fractions were extremely similar. With the study, it was concluded that MarkovJunior is an effective machine learning tool that can reproduce representative grain microstructures.


title: How AI-driven Digital Twins Can Empower Mobile Networks

abstract: The growing complexity of next-generation networks exacerbates the modeling and algorithmic flaws of conventional network optimization methodology. In this paper, we propose a mobile network digital twin (MNDT) architecture for 6G networks. To address the modeling and algorithmic shortcomings, the MNDT uses a simulation-optimization structure. The feedback from the network simulation engine, which serves as validation for the optimizer's decision outcomes, is used explicitly to train artificial intelligence (AI) empowered optimizers iteratively. In practice, we develop a network digital twin prototype system leveraging data-driven technology to accurately model the behaviors of mobile network elements (e.g., mobile users and base stations), wireless environments, and network performance. An AI-powered network optimizer has been developed based on the deployed MNDT prototype system for providing reliable and optimized network configurations. The results of the experiments demonstrate that the proposed MNDT infrastructure can provide practical network optimization solutions while adapting to the more complex environment.


title: Micro Energy-Water-Hydrogen Nexus: Data-driven Real-time Optimal Operation

abstract: This paper extends a new concept of energy-water-hydrogen (EWH) nexus, which was recently developed as a solution for reducing carbon emissions from the generation side of power systems, to the distribution side. Under the concept of distribution-level EWH (micro EWH) nexus, renewable energy sources (RES) are utilized to meet the energy needs of a small community. To avoid the uncertainty caused by RESs, this paper aims to investigate the real-time optimal operation of the micro EWH nexus which is however a challenging optimization problem. First, such a large-scale mixed-integer nonlinear programming problem is relaxed into a mixed-integer convex program (MICP) by leveraging the effective convex-hull relaxation technique. Second, a fast data-driven solution method based on active constraint and integer variable prediction is presented, which can solve the MICP problem very fast since it utilizes historical optimization data to quickly predict binary variable values and a limited set of active constraints.


title: Enabling On-Device Large Language Model Personalization with Self-Supervised Data Selection and Synthesis

abstract: After a large language model (LLM) is deployed on edge devices, it is desirable for these devices to learn from user-generated conversation data to generate user-specific and personalized responses in real-time. However, user-generated data usually contains sensitive and private information, and uploading such data to the cloud for annotation is not preferred if not prohibited. While it is possible to obtain annotation locally by directly asking users to provide preferred responses, such annotations have to be sparse to not affect user experience. In addition, the storage of edge devices is usually too limited to enable large-scale fine-tuning with full user-generated data. It remains an open question how to enable on-device LLM personalization, considering sparse annotation and limited on-device storage. In this paper, we propose a novel framework to select and store the most representative data online in a self-supervised way. Such data has a small memory footprint and allows infrequent requests of user annotations for further fine-tuning. To enhance fine-tuning quality, multiple semantically similar pairs of question texts and expected responses are generated using the LLM. Our experiments show that the proposed framework achieves the best user-specific content-generating capability (accuracy) and fine-tuning speed (performance) compared with vanilla baselines. To the best of our knowledge, this is the very first on-device LLM personalization framework.


title: The first Ka-band (26.1-35 GHz) blind line survey towards Orion KL

abstract: We conducted a Ka-band (26.1--35 GHz) line survey towards Orion KL using the TianMa 65-m Radio Telescope (TMRT). It is the first blind line survey in the Ka band, and achieves a sensitivity of mK level (1--3 mK at a spectral resolution of $\sim$1 km s$^{-1}$). In total, 592 Gaussian features are extracted. Among them, 257 radio recombination lines (RRLs) are identified. The maximum $\Delta n$ of RRLs of H, He and C are 20, 15, and 5, respectively. Through stacking, we have detected the $\beta$ lines of ion RRLs (RRLs of C$^+$ with possible contribution of other ions like O$^+$) for the first time, and tentative signal of the $\gamma$ lines of ion RRLs can also be seen on the stacked spectrum. Besides, 318 other line features were assigned to 37 molecular species, and ten of these species were not detected in the Q-band survey of TMRT. The vibrationally excited states of nine species were also detected. Emission of most species can be modeled under LTE. A number of transitions of E-CH3OH ($J_2-J_1$) display maser effects, which are confirmed by our modeling, and besides the bumping peak at $J\sim 6$ there is another peak at $J\sim 13$. Methylcyanoacetylene (CH$_3$C$_3$N) is detected in Orion KL for the first time. This work emphasizes that the Ka band, which was long-ignored for spectral line surveys, is very useful for surveying RRLs and molecular lines simultaneously.


title: Dihedral groups of order $2pq$ or $2pqr$ are DCI

abstract: A group has the (D)CI ((Directed) Cayley Isomorphism) property, or more commonly is a (D)CI group, if any two Cayley (di)graphs on the group are isomorphic via a group automorphism. That is, $G$ is a (D)CI group if whenever $\rm{Cay}(G,S)\cong \rm{Cay}(G,T)$, there is some $\delta \in \rm{Aut}(G)$ such that $S^\delta=T$. (For the CI property, we only require this to be true if $S$ and $T$ are closed under inversion.) Suppose $p,q,r$ are distinct odd primes. We show that $D_{2pqr}$ is a DCI group. We present this result in the more general context of dihedral groups of squarefree order; some of our results apply to any such group, and may be useful in future toward showing that all dihedral groups of squarefree order are DCI groups.


title: The Data Acquisition System for Phase-III of the BeEST Experiment

abstract: The BeEST experiment is a precision laboratory search for physics beyond the standard model that measures the electron capture decay of $^7$Be implanted into superconducting tunnel junction (STJ) detectors. For Phase-III of the experiment, we constructed a continuously sampling data acquisition system to extract pulse shape and timing information from 16 STJ pixels offline. Four additional pixels are read out with a fast list-mode digitizer, and one with a nuclear MCA already used in the earlier limit-setting phases of the experiment. We present the performance of the data acquisition system and discuss the relative advantages of the different digitizers.


title: Probabilistic Forecast Reconciliation with Kullback-Leibler Divergence Regularization

abstract: As the popularity of hierarchical point forecast reconciliation methods increases, there is a growing interest in probabilistic forecast reconciliation. Many studies have utilized machine learning or deep learning techniques to implement probabilistic forecasting reconciliation and have made notable progress. However, these methods treat the reconciliation step as a fixed and hard post-processing step, leading to a trade-off between accuracy and coherency. In this paper, we propose a new approach for probabilistic forecast reconciliation. Unlike existing approaches, our proposed approach fuses the prediction step and reconciliation step into a deep learning framework, making the reconciliation step more flexible and soft by introducing the Kullback-Leibler divergence regularization term into the loss function. The approach is evaluated using three hierarchical time series datasets, which shows the advantages of our approach over other probabilistic forecast reconciliation methods.


title: Geometric Characterization of Many Body Localization

abstract: Many body localization (MBL) represents a unique physical phenomenon, providing a testing ground for exploring thermalization, or more precisely its failure. Here we characterize the MBL phase geometrically by the many-body quantum metric (MBQM), defined in the parameter space of twist boundary. We find that MBQM scales linearly as a function of the inverse system length in the MBL phase, and grows faster in the ergodic phase. We validate our theory using the disordered hardcore Bose-Hubbard model, and characterize the ergodic to MBL phase transition via the localization length scale defined from the MBQM. MBQM provides an intuitive and experimentally accessible method to characterize MBL phases.

categories: cond-mat.dis-nn cond-mat.quant-gas cond-mat.stat-mech quant-ph


title: GPUSCAN$^{++}$:Efficient Structural Graph Clustering on GPUs

abstract: Structural clustering is one of the most popular graph clustering methods, which has achieved great performance improvement by utilizing GPUs. Even though, the state-of-the-art GPU-based structural clustering algorithm, GPUSCAN, still suffers from efficiency issues since lots of extra costs are introduced for parallelization. Moreover, GPUSCAN assumes that the graph is resident in the GPU memory. However, the GPU memory capacity is limited currently while many real-world graphs are big and cannot fit in the GPU memory, which makes GPUSCAN unable to handle large graphs. Motivated by this, we present a new GPU-based structural clustering algorithm, GPUSCAN++, in this paper. To address the efficiency issue, we propose a new progressive clustering method tailored for GPUs that not only avoid high parallelization costs but also fully exploits the computing resources of GPUs. To address the GPU memory limitation issue, we propose a partition-based algorithm for structural clustering that can process large graphs with limited GPU memory. We conduct experiments on real graphs, and the experimental results demonstrate that our algorithm can achieve up to 168 times speedup compared with the state-of-the-art GPU-based algorithm when the graph can be resident in the GPU memory. Moreover, our algorithm is scalable to handle large graphs. As an example, our algorithm can finish the structural clustering on a graph with 1.8 billion edges using less than 2 GB GPU memory.


title: Orthogonally weighted $\ell_{2,1}$ regularization for rank-aware joint sparse recovery: algorithm and analysis

abstract: We propose and analyze an efficient algorithm for solving the joint sparse recovery problem using a new regularization-based method, named orthogonally weighted $\ell_{2,1}$ ($\mathit{ow}\ell_{2,1}$), which is specifically designed to take into account the rank of the solution matrix. This method has applications in feature extraction, matrix column selection, and dictionary learning, and it is distinct from commonly used $\ell_{2,1}$ regularization and other existing regularization-based approaches because it can exploit the full rank of the row-sparse solution matrix, a key feature in many applications. We provide a proof of the method's rank-awareness, establish the existence of solutions to the proposed optimization problem, and develop an efficient algorithm for solving it, whose convergence is analyzed. We also present numerical experiments to illustrate the theory and demonstrate the effectiveness of our method on real-life problems.


title: A new twist on modular links from an old perspective

abstract: We show that the complement of arithmetic modular links found in arXiv:2307.09409 is homeomorphic to the complement of augmented chainlinks. In particular, these link complements arise as n-fold cyclic covers of the Whitehead link complement.


title: Model Predictive Control for Aggressive Driving Over Uneven Terrain

abstract: Terrain traversability in unstructured off-road autonomy has traditionally relied on semantic classification, resource-intensive dynamics models, or purely geometry-based methods to predict vehicle-terrain interactions. While inconsequential at low speeds, uneven terrain subjects our full-scale system to safety-critical challenges at operating speeds of 7--10 m/s. This study focuses particularly on uneven terrain such as hills, banks, and ditches. These common high-risk geometries are capable of disabling the vehicle and causing severe passenger injuries if poorly traversed. We introduce a physics-based framework for identifying traversability constraints on terrain dynamics. Using this framework, we derive two fundamental constraints, each with a focus on mitigating rollover and ditch-crossing failures while being fully parallelizable in the sample-based Model Predictive Control (MPC) framework. In addition, we present the design of our planning and control system, which implements our parallelized constraints in MPC and utilizes a low-level controller to meet the demands of our aggressive driving without prior information about the environment and its dynamics. Through real-world experimentation and traversal of hills and ditches, we demonstrate that our approach captures fundamental elements of safe and aggressive autonomy over uneven terrain. Our approach improves upon geometry-based methods by completing comprehensive off-road courses up to 22% faster while maintaining safe operation.


title: Electronic Structure of Ta$_2$O$_5$ Polymorphs: Variation Trend of Band Gap and the Role of Oxygen Vacancies

abstract: We provide a systematic study on the electronic structure of a series of Ta$_2$O$_5$ polymorphs using standard density functional theory (DFT) calculations as well as the more accurate many-body perturbation theory within the GW approximation. For the defect-free polymorphs, the variation trend of band gap can be microscopically related to the strength of orbital hybridization, and to the macroscopic bulk formation energy. The presence of oxygen vacancies is found to have profound effects on the electronic properties near the Fermi level, notably the reduction of band gap and gap closure (insulator-to-metal transition). Furthermore, depending on the vacancy sites, the band gap of some defective system may be enlarged with comparison to its defect-free counterpart. Such an anomalous behavior originates from the unexpected formation of Ta-Ta bonds.


title: Thermodynamics for regular black holes as intermediate thermodynamic states and quasinormal frequencies

abstract: The thermodynamics for regular black holes (RBHs) is considered under the restricted phase space (RPS) formalism. It is shown that the RPS formalism seems to hold for RBHs, however, in order for the extensive thermodynamic parameters to be independent from each other, the RBHs need to be viewed as intermediate thermodynamic states in a larger class of black holes (BHs) which admit both regular and singular states. This idea is checked for several classes of BHs. In particular, for the electrically charged Hayward class BHs, it is shown that the regular states can either be thermodynamically stable or unstable, depending on the amount of charges carried by the BHs. The quasinormal frequencies for the Hayward class BHs are also analyzed, and it turns out that, even for the thermodynamically unstable regular states, the dynamic stability still holds, at least under massless scalar perturbations.


title: Adapting LLMs for Efficient, Personalized Information Retrieval: Methods and Implications

abstract: The advent of Large Language Models (LLMs) heralds a pivotal shift in online user interactions with information. Traditional Information Retrieval (IR) systems primarily relied on query-document matching, whereas LLMs excel in comprehending and generating human-like text, thereby enriching the IR experience significantly. While LLMs are often associated with chatbot functionalities, this paper extends the discussion to their explicit application in information retrieval. We explore methodologies to optimize the retrieval process, select optimal models, and effectively scale and orchestrate LLMs, aiming for cost-efficiency and enhanced result accuracy. A notable challenge, model hallucination-where the model yields inaccurate or misinterpreted data-is addressed alongside other model-specific hurdles. Our discourse extends to crucial considerations including user privacy, data optimization, and the necessity for system clarity and interpretability. Through a comprehensive examination, we unveil not only innovative strategies for integrating Language Models (LLMs) with Information Retrieval (IR) systems, but also the consequential considerations that underline the need for a balanced approach aligned with user-centric principles.


title: Context-Dependent Memory in Situated Visualization

abstract: Situated visualization presents data alongside their source context (physical referent). While environmental factors influence memory recall (known as Context-Dependent Memory or CDM), how physical context affects cognition in real-world tasks such as working with visualizations in situated contexts is unclear. This study explores the design space of information memorability in situated visualization through the lens of CDM. We investigate the presence of physical referents for creating contextual cues in desktop and Virtual Reality (VR) environments. Across three studies (n=144), we observe a trend suggesting a CDM effect due to contextual referent is more apparent in VR. Overall, we did not find statistically significant evidence of a CDM effect due to the presence of a referent. However, we did find a significant CDM effect for lighting conditions. This suggests that representing the entire environment, rather than the physical objects alone, may be necessary to provide sufficiently strong contextual memory cues.


title: ATLANTIC: Structure-Aware Retrieval-Augmented Language Model for Interdisciplinary Science

abstract: Large language models record impressive performance on many natural language processing tasks. However, their knowledge capacity is limited to the pretraining corpus. Retrieval augmentation offers an effective solution by retrieving context from external knowledge sources to complement the language model. However, existing retrieval augmentation techniques ignore the structural relationships between these documents. Furthermore, retrieval models are not explored much in scientific tasks, especially in regard to the faithfulness of retrieved documents. In this paper, we propose a novel structure-aware retrieval augmented language model that accommodates document structure during retrieval augmentation. We create a heterogeneous document graph capturing multiple types of relationships (e.g., citation, co-authorship, etc.) that connect documents from more than 15 scientific disciplines (e.g., Physics, Medicine, Chemistry, etc.). We train a graph neural network on the curated document graph to act as a structural encoder for the corresponding passages retrieved during the model pretraining. Particularly, along with text embeddings of the retrieved passages, we obtain structural embeddings of the documents (passages) and fuse them together before feeding them to the language model. We evaluate our model extensively on various scientific benchmarks that include science question-answering and scientific document classification tasks. Experimental results demonstrate that structure-aware retrieval improves retrieving more coherent, faithful and contextually relevant passages, while showing a comparable performance in the overall accuracy.


title: A Supervised Contrastive Learning Pretrain-Finetune Approach for Time Series

abstract: Foundation models have recently gained attention within the field of machine learning thanks to its efficiency in broad data processing. While researchers had attempted to extend this success to time series models, the main challenge is effectively extracting representations and transferring knowledge from pretraining datasets to the target finetuning dataset. To tackle this issue, we introduce a novel pretraining procedure that leverages supervised contrastive learning to distinguish features within each pretraining dataset. This pretraining phase enables a probabilistic similarity metric, which assesses the likelihood of a univariate sample being closely related to one of the pretraining datasets. Subsequently, using this similarity metric as a guide, we propose a fine-tuning procedure designed to enhance the accurate prediction of the target data by aligning it more closely with the learned dynamics of the pretraining datasets. Our experiments have shown promising results which demonstrate the efficacy of our approach.


title: Instance-aware 3D Semantic Segmentation powered by Shape Generators and Classifiers

abstract: Existing 3D semantic segmentation methods rely on point-wise or voxel-wise feature descriptors to output segmentation predictions. However, these descriptors are often supervised at point or voxel level, leading to segmentation models that can behave poorly at instance-level. In this paper, we proposed a novel instance-aware approach for 3D semantic segmentation. Our method combines several geometry processing tasks supervised at instance-level to promote the consistency of the learned feature representation. Specifically, our methods use shape generators and shape classifiers to perform shape reconstruction and classification tasks for each shape instance. This enforces the feature representation to faithfully encode both structural and local shape information, with an awareness of shape instances. In the experiments, our method significantly outperform existing approaches in 3D semantic segmentation on several public benchmarks, such as Waymo Open Dataset, SemanticKITTI and ScanNetV2.