title: Sharp variance estimator and causal bootstrap in stratified randomized experiments

abstract: The design-based finite-population asymptotic theory provides a normal approximation for the sampling distribution of the average treatment effect estimator in stratified randomized experiments. The asymptotic variance could be estimated by a Neyman-type conservative variance estimator. However, the variance estimator can be overly conservative, and the asymptotic theory may fail in small samples. To solve these issues, we propose a sharp variance estimator for the weighted difference-in-means in stratified randomized experiments. Furthermore, we propose two causal bootstrap procedures to more accurately approximate the sampling distribution of the weighted difference-in-means estimator. The first causal bootstrap procedure is based on rank-preserving imputation and we prove its second-order refinement over normal approximation. The second causal bootstrap procedure is based on constant-treatment-effect imputation and is applicable in paired experiments. We prove its validity even when the assumption of constant treatment effect is violated for the true potential outcomes. Our analysis is randomization-based or design-based by conditioning on the potential outcomes, with treatment assignment being the sole source of randomness. Numerical studies and two real data applications demonstrate advantages of our proposed methods in finite samples.


title: InteractOut: Leveraging Interaction Proxies as Input Manipulation Strategies for Reducing Smartphone Overuse

abstract: Smartphone overuse poses risks to people's physical and mental health. However, current intervention techniques mainly focus on explicitly changing screen content (i.e., output) and often fail to persistently reduce smartphone overuse due to being over-restrictive or over-flexible. We present the design and implementation of InteractOut, a suite of implicit input manipulation techniques that leverage interaction proxies to weakly inhibit the natural execution of common user gestures on mobile devices. We present a design space for input manipulations and demonstrate 8 Android implementations of input interventions. We first conducted a pilot lab study (N=30) to evaluate the usability of these interventions. Based on the results, we then performed a 5-week within-subject field experiment (N=42) to evaluate InteractOut in real-world scenarios. Compared to the traditional and common timed lockout technique, InteractOut significantly reduced the usage time by an additional 15.6% and opening frequency by 16.5% on participant-selected target apps. InteractOut also achieved a 25.3% higher user acceptance rate, and resulted in less frustration and better user experience according to participants' subjective feedback. InteractOut demonstrates a new direction for smartphone overuse intervention and serves as a strong complementary set of techniques with existing methods.


title: Improving Global Weather and Ocean Wave Forecast with Large Artificial Intelligence Models

abstract: The rapid advancement of artificial intelligence technologies, particularly in recent years, has led to the emergence of several large parameter artificial intelligence weather forecast models. These models represent a significant breakthrough, overcoming the limitations of traditional numerical weather prediction models and indicating the emergence of profound potential tools for atmosphere-ocean forecasts. This study explores the evolution of these advanced artificial intelligence forecast models, and based on the identified commonalities, proposes the "Three Large Rules" to measure their development. We discuss the potential of artificial intelligence in revolutionizing numerical weather prediction, and briefly outlining the underlying reasons for its great potential. While acknowledging the high accuracy, computational efficiency, and ease of deployment of large artificial intelligence forecast models, we also emphasize the irreplaceable values of traditional numerical forecasts and explore the challenges in the future development of large-scale artificial intelligence atmosphere-ocean forecast models. We believe that the optimal future of atmosphere-ocean weather forecast lies in achieving a seamless integration of artificial intelligence and traditional numerical models. Such a synthesis is anticipated to offer a more advanced and reliable approach for improved atmosphere-ocean forecasts. Additionally, we illustrate how forecasters can adapt and leverage the advanced artificial intelligence model through an example by building a large artificial intelligence model for global ocean wave forecast.

categories: cs.LG cs.AI physics.ao-ph physics.geo-ph


title: Combinatorial games played randomly: Chomp and nim

abstract: In this note, we investigate combinatorial games where both players move randomly (each turn, independently selecting a legal move uniformly at random). In this model, we provide closed-form expressions for the expected number of turns in a game of Chomp with any starting condition. We also derive and prove formulas for the win probabilities for any game of Chomp with at most two rows. Additionally, we completely analyze the game of nim under random play by finding the expected number of turns and win probabilities from any starting position.


title: Resurgence in the Transition Region: The Incomplete Gamma Function

abstract: We study the resurgence properties of the coefficients $C_n(\tau)$ appearing in the asymptotic expansion of the incomplete gamma function within the transition region. Our findings reveal that the asymptotic behaviour of $C_n(\tau)$ as $n\to +\infty$ depends on the parity of $n$. Both $C_{2n-1}(\tau)$ and $C_{2n}(\tau)$ exhibit behaviours characterised by a leading term accompanied by an inverse factorial series, where the coefficients are once again $C_{2k-1}(\tau)$ and $C_{2k}(\tau)$, respectively. Our derivation employs elementary tools and relies on the known resurgence properties of the asymptotic expansion of the gamma function and the uniform asymptotic expansion of the incomplete gamma function. To the best of our knowledge, prior to this paper, there has been no investigation in the existing literature regarding the resurgence properties of asymptotic expansions in transition regions.


title: AutoIE: An Automated Framework for Information Extraction from Scientific Literature

abstract: In the rapidly evolving field of scientific research, efficiently extracting key information from the burgeoning volume of scientific papers remains a formidable challenge. This paper introduces an innovative framework designed to automate the extraction of vital data from scientific PDF documents, enabling researchers to discern future research trajectories more readily. AutoIE uniquely integrates four novel components: (1) A multi-semantic feature fusion-based approach for PDF document layout analysis; (2) Advanced functional block recognition in scientific texts; (3) A synergistic technique for extracting and correlating information on molecular sieve synthesis; (4) An online learning paradigm tailored for molecular sieve literature. Our SBERT model achieves high Marco F1 scores of 87.19 and 89.65 on CoNLL04 and ADE datasets. In addition, a practical application of AutoIE in the petrochemical molecular sieve synthesis domain demonstrates its efficacy, evidenced by an impressive 78\% accuracy rate. This research paves the way for enhanced data management and interpretation in molecular sieve synthesis. It is a valuable asset for seasoned experts and newcomers in this specialized field.


title: Exploring quantum entanglement in chiral symmetry partial restoration with 1+1 string model

abstract: Within the confining color flux tube picture, we assess the color electric field generated by quark-antiquark pairs within the framework of the Schwinger model and estimate its impact on the chiral condensate. We observe differences in the distribution of the color flux tube generated by quark-antiquark pairs at different separation distances, leading to discrepancies in the partial restoration of chiral symmetry. Furthermore, we suggest incorporating the color magnetic field in the calculation of chiral condensate, leading to quantum entanglement effects, and proceed to compute the entanglement entropy. We observe that the entanglement entropy increases with the distance of the color source (the separation distance between quark and anti-quark), and the magnitude of the color electric field and chiral condensate restoration after spatial integration also increases with the distance of the color source. Then, we try to provide a qualitative explanation for the existence of these phenomena.


title: Toward Data-Driven Subgrid-Scale Modeling of the Zel'dovich Deflagration-To-Detonation Mechanism in Dense Stellar Plasmas

abstract: A novel, data-driven model of deflagration-to-detonationtransition (DDT) is constructed for application to explosions of thermonuclear supernovae (SN Ia). The DDT mechanism has been suggested as the necessary physics process to obtain qualitative agreement between SN Ia observations and computational explosion models. This work builds upon a series of studies of turbulent combustion that develops during the final stages of the SN explosion. These studies suggest that DDT can occur in the turbulerized flame of the white dwarf via the Zel'dovich reactivity gradient mechanism when hotspots are formed. We construct a large database of direct numerical simulations that explore the parameter space of the Zel'dovich initiated detonation. We use this database to construct a neural network classifier for hotspots. The classifier is integrated into our supernova simulation code, FLASH/Proteus, and is used as the basis for a subgrid-scale model for DDT. The classifier is evaluated both in the training environment and in reactive turbulence simulations to verify its accuracy in realistic conditions.

categories: astro-ph.SR astro-ph.HE physics.flu-dyn physics.plasm-ph


title: An Efficient Algorithm for Vertex Enumeration of Arrangement

abstract: This paper presents a state-of-the-art algorithm for the vertex enumeration problem of arrangements, which is based on the proposed new pivot rule, called the Zero rule. The Zero rule possesses several desirable properties: i) It gets rid of the objective function; ii) Its terminal satisfies uniqueness; iii) We establish the if-and-only if condition between the Zero rule and its valid reverse, which is not enjoyed by earlier rules; iv) Applying the Zero rule recursively definitely terminates in $d$ steps, where $d$ is the dimension of input variables. Because of so, given an arbitrary arrangement with $v$ vertices of $n$ hyperplanes in $\mathbb{R}^d$, the algorithm's complexity is at most $\mathcal{O}(n^2d^2v)$ and can be as low as $\mathcal{O}(nd^4v)$ if it is a simple arrangement, while Moss' algorithm takes $\mathcal{O}(nd^2v^2)$, and Avis and Fukuda's algorithm goes into a loop or skips vertices because the if-and-only-if condition between the rule they chose and its valid reverse is not fulfilled. Systematic and comprehensive experiments confirm that the Zero rule not only does not fail but also is the most efficient.


title: Cosmological Prediction of the CSST Ultra Deep Field Type Ia Supernova Photometric Survey

abstract: Type Ia supernova (SN Ia) as a standard candle is an ideal tool to measure cosmic distance and expansion history of the Universe. Here we investigate the SN Ia photometric measurement in the China Space Station Telescope Ultra Deep Field (CSST-UDF) survey, and study the constraint power on the cosmological parameters, such as the equation of state of dark energy. The CSST-UDF survey is expected to cover a 9 deg$^2$ sky area in two years with 250 s $\times$ 60 exposures for each band. The magnitude limit can reach $i\simeq26$ AB mag for 5$\sigma$ point source detection with a single exposure. We generate light curve mock data for SNe Ia and different types of core-collapse supernovae (CCSNe). {\tt SNCosmo} is chosen as the framework by utilizing the SALT3 model to simulate SN Ia data. After selecting high-quality data and fitting the light curves, we derive the light curve parameters and identify CCSNe as contamination, resulting in $\sim2200$ SNe with a $\sim7\%$ CCSN contamination rate. We adopt a calibration method similar to Chauvenet's criterion, and apply it to the distance modulus data to further reduce the contamination. We find that this method is effective and can suppress the contamination fraction to $\sim3.5\%$ with 2012 SNe Ia and 73 CCSNe. In the cosmological fitting stage, we did not distinguish between SNe Ia and CCSNe. We find that the constraint accuracies on $\Omega_{\rm M}$, $\Omega_{\Lambda}$ and $w$ are about two times better than the current SN surveys, and it could be further improved by a factor of $\sim$1.4 if including the baryon acoustic oscillation (BAO) data from the CSST spectroscopic wide-field galaxy survey.


title: T3: Transparent Tracking & Triggering for Fine-grained Overlap of Compute & Collectives

abstract: Large Language Models increasingly rely on distributed techniques for their training and inference. These techniques require communication across devices which can reduce scaling efficiency as the number of devices increases. While some distributed techniques can overlap, and thus, hide this communication with independent computations, techniques such as Tensor Parallelism (TP) inherently serialize communication with model execution. One approach to hide this serialized communication is to interleave it with the producer operation (of the communicated data) in a fine-grained manner. However, this fine-grained interleaving of communication and computation in software can be difficult. Furthermore, as with any concurrent execution, it requires compute and memory resources to be shared between computation and communication, causing resource contention that reduces overlapping efficacy. To overcome these challenges, we propose T3 which applies hardware-software co-design to transparently overlap serialized communication while minimizing resource contention with compute. T3 transparently fuses producer operations with the subsequent communication via a simple configuration of the producer's output address space and requires minor software changes. At the hardware level, T3 adds a lightweight track and trigger mechanism to orchestrate the producer's compute, and communication. It further uses compute-enhanced memories for communication's attendant compute. As a result, T3 reduces resource contention, and efficiently overlaps serialized communication with computation. For important Transformer models like T-NLG, T3 speeds up communication-heavy sublayers by 30% geomean (max 47%) and reduces data movement by 22% geomean (max 36%). Furthermore, T3's benefits persist as models scale: geomean 29% for sublayers in $\sim$500-billion parameter models, PALM and MT-NLG.


title: The Detection and Understanding of Fictional Discourse

abstract: In this paper, we present a variety of classification experiments related to the task of fictional discourse detection. We utilize a diverse array of datasets, including contemporary professionally published fiction, historical fiction from the Hathi Trust, fanfiction, stories from Reddit, folk tales, GPT-generated stories, and anglophone world literature. Additionally, we introduce a new feature set of word "supersenses" that facilitate the goal of semantic generalization. The detection of fictional discourse can help enrich our knowledge of large cultural heritage archives and assist with the process of understanding the distinctive qualities of fictional storytelling more broadly.


title: A Novel Scalable Quantum Protocol for the Dining Cryptographers Problem

abstract: This paper presents an innovative entanglement-based protocol to address the Dining Cryptographers Problem, utilizing maximally entangled $\ket{ GHZ_{ n } }$ tuples as its core. This protocol aims to provide scalability in terms of both the number of cryptographers $n$ and the amount of anonymous information conveyed, represented by the number of qubits $m$ within each quantum register. The protocol supports an arbitrary number of cryptographers $n$, enabling scalability in both participant count and the volume of anonymous information transmitted. While the original Dining Cryptographers Problem focused on a single bit of information, i.e., whether a cryptographer paid for dinner, the proposed protocol allows $m$, the number of qubits in each register, to be any arbitrarily large positive integer. This flexibility permits the conveyance of various information, such as the cost of the dinner or the timing of the arrangement. Another noteworthy aspect of the introduced protocol is its versatility in accommodating both localized and distributed versions of the Dining Cryptographers problem. The localized scenario involves all cryptographers gathering physically at the same location, such as a restaurant, simultaneously. In contrast, the distributed scenario accommodates cryptographers situated in different places, engaging in a virtual dinner at the same time. Finally, in terms of implementation, the protocol ensures uniformity by requiring all cryptographers to utilize identical private quantum circuits. This design establishes a completely modular quantum system where all modules are identical. Furthermore, each private quantum circuit exclusively employs the widely used Hadamard and CNOT quantum gates, facilitating straightforward implementation on contemporary quantum computers.


title: Quasi-neutral limit of Nernst-Planck-Navier-Stokes system

abstract: In this paper, we investigate the quasi-neutral limit of Nernst-Planck-Navier-Stokes system in a smooth bounded domain $\Omega$ of $\mathbb{R}^d$ for $d=2,3,$ with ``electroneutral boundary conditions" and well-prepared data. We first prove by using modulated energy estimate that the solution sequence converges to the limit system in the norm of $L^\infty((0,T);L^2(\Omega))$ for some positive time $T.$ In order to justify the limit in a stronger norm, we need to construct both the initial layers and weak boundary layers in the approximate solutions.


title: The Design of a High Speed Low Power Phase Locked Loop

abstract: The upgrade of the ATLAS Liquid Argon Calorimeter readout system calls for the development of radiation tolerant, high speed and low power serializer ASIC. We have designed a phase locked loop using a commercial 0.25 um Silicon-on-Sapphire (SoS) CMOS technology. Post-layout simulation indicates that tuning range is 3.79-5.01 GHz and power consumption is 104 mW. The PLL has been submitted for fabrication. The design and simulation results are presented.


title: Recent Advances in Model-Based Fault Diagnosis for Lithium-Ion Batteries: A Comprehensive Review

abstract: Lithium-ion batteries (LIBs) have found wide applications in a variety of fields such as electrified transportation, stationary storage and portable electronics devices. A battery management system (BMS) is critical to ensure the reliability, efficiency and longevity of LIBs. Recent research has witnessed the emergence of model-based fault diagnosis methods in advanced BMSs. This paper provides a comprehensive review on the model-based fault diagnosis methods for LIBs. First, the widely explored battery models in the existing literature are classified into physics-based electrochemical models and electrical equivalent circuit models. Second, a general state-space representation that describes electrical dynamics of a faulty battery is presented. The formulation of the state vectors and the identification of the parameter matrices are then elaborated. Third, the fault mechanisms of both battery faults (incl. overcharege/overdischarge faults, connection faults, short circuit faults) and sensor faults (incl. voltage sensor faults and current sensor faults) are discussed. Furthermore, different types of modeling uncertainties, such as modeling errors and measurement noises, aging effects, measurement outliers, are elaborated. An emphasis is then placed on the observer design (incl. online state observers and offline state observers). The algorithm implementation of typical state observers for battery fault diagnosis is also put forward. Finally, discussion and outlook are offered to envision some possible future research directions.


title: Polynomial Chaos Expansions on Principal Geodesic Grassmannian Submanifolds for Surrogate Modeling and Uncertainty Quantification

abstract: In this work we introduce a manifold learning-based surrogate modeling framework for uncertainty quantification in high-dimensional stochastic systems. Our first goal is to perform data mining on the available simulation data to identify a set of low-dimensional (latent) descriptors that efficiently parameterize the response of the high-dimensional computational model. To this end, we employ Principal Geodesic Analysis on the Grassmann manifold of the response to identify a set of disjoint principal geodesic submanifolds, of possibly different dimension, that captures the variation in the data. Since operations on the Grassmann require the data to be concentrated, we propose an adaptive algorithm based on Riemanniann K-means and the minimization of the sample Frechet variance on the Grassmann manifold to identify "local" principal geodesic submanifolds that represent different system behavior across the parameter space. Polynomial chaos expansion is then used to construct a mapping between the random input parameters and the projection of the response on these local principal geodesic submanifolds. The method is demonstrated on four test cases, a toy-example that involves points on a hypersphere, a Lotka-Volterra dynamical system, a continuous-flow stirred-tank chemical reactor system, and a two-dimensional Rayleigh-Benard convection problem


title: Defocusing Hirota equation with fully asymmetric non-zero boundary conditions: the inverse scattering transform

abstract: The paper aims to apply the inverse scattering transform to the defocusing Hirota equation with fully asymmetric non-zero boundary conditions (NZBCs), addressing scenarios in which the solution's limiting values at spatial infinities exhibit distinct non-zero moduli. In comparison to the symmetric case, we explore the characteristic branched nature of the relevant scattering problem explicitly, instead of introducing Riemann surfaces. For the direct problem, we formulate the Jost solutions and scattering data on a single sheet of the scattering variables. We then derive their analyticity behavior, symmetry properties, and the distribution of discrete spectrum. Additionally, we study the behavior of the eigenfunctions and scattering data at the branch points. Finally, the solutions to the defocusing Hirota equation with asymmetric NZBCs are presented through the related Riemann-Hilbert problem on an open contour. Our results can be applicable to the study of asymmetric conditions in nonlinear optics.


title: Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection

abstract: Multimodal federated learning (FL) aims to enrich model training in FL settings where clients are collecting measurements across multiple modalities. However, key challenges to multimodal FL remain unaddressed, particularly in heterogeneous network settings where: (i) the set of modalities collected by each client will be diverse, and (ii) communication limitations prevent clients from uploading all their locally trained modality models to the server. In this paper, we propose multimodal Federated learning with joint Modality and Client selection (mmFedMC), a new FL methodology that can tackle the above-mentioned challenges in multimodal settings. The joint selection algorithm incorporates two main components: (a) A modality selection methodology for each client, which weighs (i) the impact of the modality, gauged by Shapley value analysis, (ii) the modality model size as a gauge of communication overhead, against (iii) the frequency of modality model updates, denoted recency, to enhance generalizability. (b) A client selection strategy for the server based on the local loss of modality model at each client. Experiments on five real-world datasets demonstrate the ability of mmFedMC to achieve comparable accuracy to several baselines while reducing the communication overhead by over 20x. A demo video of our methodology is available at https://liangqiy.com/mmfedmc/.


title: Algorithm for solving a pump-probe model for an arbitrary number of energy levels

abstract: We describe a generalized algorithm for evaluating the steady-state solution of the density matrix equation of motion, for the pump-probe scheme, when two fields oscillating at different frequencies couple the same set of atomic transitions involving an arbitrary number of energy levels, to an arbitrary order of the harmonics of the pump-probe frequency difference. We developed a numerical approach and a symbolic approach for this algorithm. We have verified that both approaches yield the same result for all cases studied, but require different computation time. The results are further validated by comparing them with the analytical solution of a two-level system to first order. We have also used both models to produce results up to the third order in the pump-probe frequency difference, for two-, three- and four-level systems. In addition, we have used this model to determine accurately, for the first time, the gain profile for a self-pumped Raman laser, for a system involving 16 Zeeman sublevels in the D1 manifold of 87Rb atoms. We have also used this model to determine the behavior of a single-pumped superluminal laser. In many situations involving the applications of multiple laser fields to atoms with many energy levels, one often makes the approximation that each field couples only one transition, because of the difficulty encountered in accounting for the effect of another field coupling the same transition but with a large detuning. The use of the algorithm presented here would eliminate the need for making such approximations, thus improving the accuracy of numerical calculations for such schemes.


title: Revisiting Gradient Pruning: A Dual Realization for Defending against Gradient Attacks

abstract: Collaborative learning (CL) is a distributed learning framework that aims to protect user privacy by allowing users to jointly train a model by sharing their gradient updates only. However, gradient inversion attacks (GIAs), which recover users' training data from shared gradients, impose severe privacy threats to CL. Existing defense methods adopt different techniques, e.g., differential privacy, cryptography, and perturbation defenses, to defend against the GIAs. Nevertheless, all current defense methods suffer from a poor trade-off between privacy, utility, and efficiency. To mitigate the weaknesses of existing solutions, we propose a novel defense method, Dual Gradient Pruning (DGP), based on gradient pruning, which can improve communication efficiency while preserving the utility and privacy of CL. Specifically, DGP slightly changes gradient pruning with a stronger privacy guarantee. And DGP can also significantly improve communication efficiency with a theoretical analysis of its convergence and generalization. Our extensive experiments show that DGP can effectively defend against the most powerful GIAs and reduce the communication cost without sacrificing the model's utility.


title: Characterization of Magnetic Labyrinthine Structures through Junctions and Terminals Detection Using Template Matching and CNN

abstract: Defects influence diverse properties of materials, shaping their structural, mechanical, and electronic characteristics. Among a variety of materials exhibiting unique defects, magnets exhibit diverse nano- to micro-scale defects and have been intensively studied in materials science. Specifically, defects in magnetic labyrinthine patterns, called junctions and terminals, serve as the canonical targets of the research. While detecting and characterizing such defects is crucial for understanding magnets, systematically investigating large-scale images containing over a thousand closely packed junctions and terminals remains a formidable challenge. This study introduces a new technique called TM-CNN (Template Matching - Convolutional Neural Network) designed to detect a multitude of small objects in images, such as the defects in magnetic labyrinthine patterns. TM-CNN was used to identify 641,649 such structures in 444 experimental images, and the results were explored to deepen understanding of magnetic materials. It employs a two-stage detection approach combining template matching, used in initial detection, with a convolutional neural network, used to eliminate incorrect identifications. To train a CNN classifier, it is necessary to annotate a large number of training images.This difficulty prevents the use of CNN in many practical applications. TM-CNN significantly reduces the manual workload for creating training images by automatically making most of the annotations and leaving only a small number of corrections to human reviewers. In testing, TM-CNN achieved an impressive F1 score of 0.991, far outperforming traditional template matching and CNN-based object detection algorithms.


title: Expansions of the Characteristic Polynomial of a Perturbed Positive Semidefinite Matrix and Convergence Analysis of Alternating Projections

abstract: We observe that the characteristic polynomial of a linearly perturbed semidefinite matrix can be used to give the convergence rate of alternating projections for the positive semidefinite cone and a line. As a consequence, we show that such alternating projections converge at $O(k^{-1/2})$, independently of the singularity degree. A sufficient condition for the linear convergence is also obtained. Our method directly analyzes the defining equation for an alternating projection sequence and does not use error bounds.


title: A Detailed Historical and Statistical Analysis of the Influence of Hardware Artifacts on SPEC Integer Benchmark Performance

abstract: The Standard Performance Evaluation Corporation (SPEC) CPU benchmark has been widely used as a measure of computing performance for decades. The SPEC is an industry-standardized, CPU-intensive benchmark suite and the collective data provide a proxy for the history of worldwide CPU and system performance. Past efforts have not provided or enabled answers to questions such as, how has the SPEC benchmark suite evolved empirically over time and what micro-architecture artifacts have had the most influence on performance? -- have any micro-benchmarks within the suite had undue influence on the results and comparisons among the codes? -- can the answers to these questions provide insights to the future of computer system performance? To answer these questions, we detail our historical and statistical analysis of specific hardware artifacts (clock frequencies, core counts, etc.) on the performance of the SPEC benchmarks since 1995. We discuss in detail several methods to normalize across benchmark evolutions. We perform both isolated and collective sensitivity analyses for various hardware artifacts and we identify one benchmark (libquantum) that had somewhat undue influence on performance outcomes. We also present the use of SPEC data to predict future performance.


title: Social Physics of Bacteria: Avoidance of an Information Black Hole

abstract: Social physics explores responses to information exchange in a social network, and can be mapped down to bacterial collective signaling. Here, we explore how social inter-bacterial communication includes coordination of response to communication loss, as opposed to solitary searching for food, with collective response emergence at the population level. We present a 2-dimensional enclosed microfluidic environment that utilizes concentric rings of funnel ratchets, which direct motile E.coli bacteria towards a sole exit hole, an information ``black hole'', passage into the black hole irreversibly sweeps the bacteria away via hydrodynamic flow. We show that the spatiotemporal evolution of entropy production reveals how bacteria avoid crossing the hydrodynamic black hole information horizon.


title: Calibration-then-Calculation: A Variance Reduced Metric Framework in Deep Click-Through Rate Prediction Models

abstract: The adoption of deep learning across various fields has been extensive, yet there is a lack of focus on evaluating the performance of deep learning pipelines. Typically, with the increased use of large datasets and complex models, the training process is run only once and the result is compared to previous benchmarks. This practice can lead to imprecise comparisons due to the variance in neural network evaluation metrics, which stems from the inherent randomness in the training process. Traditional solutions, such as running the training process multiple times, are often infeasible due to computational constraints. In this paper, we introduce a novel metric framework, the Calibrated Loss Metric, designed to address this issue by reducing the variance present in its conventional counterpart. Consequently, this new metric enhances the accuracy in detecting effective modeling improvements. Our approach is substantiated by theoretical justifications and extensive experimental validations within the context of Deep Click-Through Rate Prediction Models.


title: Synchronization Behavior of Newton's Cradle

abstract: A Newton's cradle is a device that demonstrates conservation of momentum using a series of identical colliding pendula. Despite being a famous example that demonstrates the concept of momentum conservation, extensive analysis of the system is rarely reported in literature. Here, we model the system as a collection of identical nonlinear spring pendulums performing viscoelastic collisions, which shows excellent agreement with experiments performed at various conditions. Dependence of its synchronization rate on four key system parameters are studied in detail. Interestingly, the resonance between radial and angular motion was found to modulate the synchronization rate. The proposed theory with full consideration of two dimensional motion and string hysteresis provides an excellent long-term prediction of the synchronized cradle motion.


title: EdgeOL: Efficient in-situ Online Learning on Edge Devices

abstract: Emerging applications, such as robot-assisted eldercare and object recognition, generally employ deep learning neural networks (DNNs) and naturally require: i) handling streaming-in inference requests and ii) adapting to possible deployment scenario changes. Online model fine-tuning is widely adopted to satisfy these needs. However, an inappropriate fine-tuning scheme could involve significant energy consumption, making it challenging to deploy on edge devices. In this paper, we propose EdgeOL, an edge online learning framework that optimizes inference accuracy, fine-tuning execution time, and energy efficiency through both inter-tuning and intra-tuning optimizations. Experimental results show that, on average, EdgeOL reduces overall fine-tuning execution time by 64%, energy consumption by 52%, and improves average inference accuracy by 1.75% over the immediate online learning strategy.


title: Focusing membrane metamirrors for integrated cavity optomechanics

abstract: We have realized a suspended, high-reflectivity focusing metamirror ($f\approx 10$ cm, $\mathcal{R} \approx 99\%$) by non-periodic photonic crystal patterning of a Si$_3$N$_4$ membrane. The design enables construction of a stable, short ($L$ = 30 $\mu$m), high-finesse ($\mathcal{F}>600$) membrane cavity optomechanical system using a single plano dielectric end-mirror. We present the metamirror design, fabrication process, and characterization of its reflectivity using both free space and cavity-based transmission measurements. The mirror's effective radius of curvature is inferred from the transverse mode spectrum of the cavity. In combination with phononic engineering and metallization, focusing membrane mirrors offer a route towards high-cooperativity, vertically-integrated cavity optomechanical systems with applications ranging from precision force sensing to hybrid quantum transduction.


title: Properties of chiral nucleon-nucleon interaction at N$^3$LO with high cutoffs studied by local projection

abstract: The chiral nucleon-nucleon ($NN$) interaction at high cutoffs has been plagued by the presence of spurious bound states. In this work, the chiral $NN$ interaction at N$^3$LO is studied by the local projection method as the cutoff increases. The evolution of short-range behaviors of pion-exchange interactions and contact interactions is intuitively demonstrated. The $P$-channel potentials toward high cutoffs appear to be erratic at short ranges to compromise with phase shifts, while such erratic behaviors can be avoided in $S$ and $D$ channels. Furthermore, a chiral $NN$ interaction at N$^3$LO is studied at a cutoff of 700 MeV. The properties of deuteron and triton are testified with this interaction. Such a hard interaction is expected to provide an alternative choice for studies of short-range correlations and high density nuclear matter.


title: The Velocity-Space Signature of Transit-Time Damping

abstract: Transit-time damping (TTD) is a process in which the magnetic mirror force -- induced by the parallel gradient of magnetic field strength -- interacts with resonant plasma particles in a time-varying magnetic field, leading to the collisionless damping of electromagnetic waves and the resulting energization of those particles through the perpendicular component of the electric field, $E_\perp$. In this study, we utilize the recently developed field-particle correlation technique to analyze gyrokinetic simulation data. This method enables the identification of the velocity-space structure of the TTD energy transfer rate between waves and particles during the damping of plasma turbulence. Our analysis reveals a unique bipolar pattern of energy transfer in velocity space characteristic of TTD. By identifying this pattern, we provide clear evidence of TTD's significant role in the damping of strong plasma turbulence. Additionally, we compare the TTD signature with that of Landau damping (LD). Although they both produce a bipolar pattern of phase-space energy density loss and gain about the parallel resonant velocity of the Alfv\'enic waves, they are mediated by different forces and exhibit different behaviors as $v_\perp \to 0$. We also explore how the dominant damping mechanism varies with ion plasma beta $\beta_i$, showing that TTD dominates over LD for $\beta_i > 1$. This work deepens our understanding of the role of TTD in the damping of weakly collisional plasma turbulence and paves the way to seek the signature of TTD using \emph{in situ} spacecraft observations of turbulence in space plasmas.


title: Hyperelliptically fibred surfaces with nodes

abstract: Using elementary methods of algebraic geometry, we present constructions of hyperelliptically fibred surfaces containing nodal fibres.


title: Towards Unified Interactive Visual Grounding in The Wild

abstract: Interactive visual grounding in Human-Robot Interaction (HRI) is challenging yet practical due to the inevitable ambiguity in natural languages. It requires robots to disambiguate the user input by active information gathering. Previous approaches often rely on predefined templates to ask disambiguation questions, resulting in performance reduction in realistic interactive scenarios. In this paper, we propose TiO, an end-to-end system for interactive visual grounding in human-robot interaction. Benefiting from a unified formulation of visual dialogue and grounding, our method can be trained on a joint of extensive public data, and show superior generality to diversified and challenging open-world scenarios. In the experiments, we validate TiO on GuessWhat?! and InViG benchmarks, setting new state-of-the-art performance by a clear margin. Moreover, we conduct HRI experiments on the carefully selected 150 challenging scenes as well as real-robot platforms. Results show that our method demonstrates superior generality to diversified visual and language inputs with a high success rate. Codes and demos are available at https://github.com/jxu124/TiO.


title: Towards Precise 3D Human Pose Estimation with Multi-Perspective Spatial-Temporal Relational Transformers

abstract: 3D human pose estimation captures the human joint points in three-dimensional space while keeping the depth information and physical structure. That is essential for applications that require precise pose information, such as human-computer interaction, scene understanding, and rehabilitation training. Due to the challenges in data collection, mainstream datasets of 3D human pose estimation are primarily composed of multi-view video data collected in laboratory environments, which contains rich spatial-temporal correlation information besides the image frame content. Given the remarkable self-attention mechanism of transformers, capable of capturing the spatial-temporal correlation from multi-view video datasets, we propose a multi-stage framework for 3D sequence-to-sequence (seq2seq) human pose detection. Firstly, the spatial module represents the human pose feature by intra-image content, while the frame-image relation module extracts temporal relationships and 3D spatial positional relationship features between the multi-perspective images. Secondly, the self-attention mechanism is adopted to eliminate the interference from non-human body parts and reduce computing resources. Our method is evaluated on Human3.6M, a popular 3D human pose detection dataset. Experimental results demonstrate that our approach achieves state-of-the-art performance on this dataset. The source code will be available at https://github.com/WUJINHUAN/3D-human-pose.


title: Multivariate Priors and the Linearity of Optimal Bayesian Estimators under Gaussian Noise

abstract: Consider the task of estimating a random vector $X$ from noisy observations $Y = X + Z$, where $Z$ is a standard normal vector, under the $L^p$ fidelity criterion. This work establishes that, for $1 \leq p \leq 2$, the optimal Bayesian estimator is linear and positive definite if and only if the prior distribution on $X$ is a (non-degenerate) multivariate Gaussian. Furthermore, for $p > 2$, it is demonstrated that there are infinitely many priors that can induce such an estimator.


title: Multi-granularity Correspondence Learning from Long-term Noisy Videos

abstract: Existing video-language studies mainly focus on learning short video clips, leaving long-term temporal dependencies rarely explored due to over-high computational cost of modeling long videos. To address this issue, one feasible solution is learning the correspondence between video clips and captions, which however inevitably encounters the multi-granularity noisy correspondence (MNC) problem. To be specific, MNC refers to the clip-caption misalignment (coarse-grained) and frame-word misalignment (fine-grained), hindering temporal learning and video understanding. In this paper, we propose NOise Robust Temporal Optimal traNsport (Norton) that addresses MNC in a unified optimal transport (OT) framework. In brief, Norton employs video-paragraph and clip-caption contrastive losses to capture long-term dependencies based on OT. To address coarse-grained misalignment in video-paragraph contrast, Norton filters out the irrelevant clips and captions through an alignable prompt bucket and realigns asynchronous clip-caption pairs based on transport distance. To address the fine-grained misalignment, Norton incorporates a soft-maximum operator to identify crucial words and key frames. Additionally, Norton exploits the potential faulty negative samples in clip-caption contrast by rectifying the alignment target with OT assignment to ensure precise temporal modeling. Extensive experiments on video retrieval, videoQA, and action segmentation verify the effectiveness of our method. Code is available at https://lin-yijie.github.io/projects/Norton.


title: Plane Wave Dynamic Model of Electric Power Networks with High Shares of Inverter-Based Resources

abstract: Contemporary theories and models for electric power system stability are predicated on a widely held assumption that the mechanical inertia of the rotating mass of synchronous generators provides the sole contribution to stable and synchronized operation of this class of complex networks on subsecond timescales. Here we formulate the electromagnetic momentum of the field around the transmission lines that transports energy and present evidence from a real-world bulk power network that demonstrates its physical significance. We show the classical stability model for power networks that overlooks this property, known as the "swing equation", may become inadequate to analyze systems with high shares of inverter-based resources, commonly known as "low-inertia power systems". Subsequently, we introduce a plane wave dynamic model, consistent with the structural properties of emerging power systems with up to 100% inverter-based resources, which identifies the concept of inertia in power grids as a time-varying component. We leverage our theory to discuss a number of open questions in the electric power industry. Most notably, we postulate that the changing nature of power networks with a preponderance of variable renewable energy power plants could strengthen power network stability in the future; a vision which is irreconcilable with the conventional theories.


title: Bottomonium suppression in 5.02 and 8.16 TeV p-Pb collisions

abstract: We compute the suppression of Upsilon(1S), Upsilon(2S), and Upsilon(3S) states in p-Pb collisions relative to pp collisions, including nuclear parton distribution function (nPDF) effects, coherent energy loss, momentum broadening, and final-state interactions in the quark-gluon plasma. We employ the EPPS21 nPDFs and calculate the uncertainty resulting from variation over the associated error sets. To compute coherent energy loss and momentum broadening, we follow the approach of Arleo, Peigne, and collaborators. The 3+1D viscous hydrodynamical background evolution of the quark-gluon plasma is generated by anisotropic hydrodynamics. The in-medium suppression of bottomonium in the quark-gluon plasma is computed using a next-to-leading-order open quantum system framework formulated within potential nonrelativistic quantum chromodynamics. We find that inclusion of all these effects provides a reasonable description of experimental data from the ALICE, ATLAS, CMS, and LHCb collaborations for the suppression of Upsilon(1S), Upsilon(2S), and Upsilon(3S) as a function of both transverse momentum and rapidity.


title: Layer group classification of two-dimensional materials

abstract: The symmetry of a crystal structure with a three-dimensional (3D) lattice can be classified by one of the 230 space group types. For some types of crystals, e.g. crystalline films, surfaces, or planar interfaces, it is more appropriate to assume a 2D lattice. With this assumption, the structure can be classified by one of the 80 layer group types. We have implemented an algorithm to determine the layer group type of a 3D structure with a 2D lattice, and applied it to more than 15,000 monolayer structures in the Computational 2D Materials (C2DB) database. We compare the classification of monolayers by layer groups and space groups, respectively. The latter is defined as the space group of the 3D bulk structure obtained by repeating the monolayer periodically in the direction perpendicular to the 2D lattice (AA-stacking). By this correspondence, nine pairs of layer group types are mapped to the same space group type due to the inability of the space group to distinguish the in-plane and out-of-plane axes. In total 18% of the monolayers in the C2DB belong to one of these layer group pairs and are thus not properly classified by the space group type.


title: Subspace-Based Detection in OFDM ISAC Systems under Different Constellations

abstract: This paper investigates subspace-based target detection in OFDM integrated sensing and communications (ISAC) systems, considering the impact of various constellations. To meet diverse communication demands, different constellation schemes with varying modulation orders (e.g., PSK, QAM) can be employed, which in turn leads to variations in peak sidelobe levels (PSLs) within the radar functionality. These PSL fluctuations pose a significant challenge in the context of multi-target detection, particularly in scenarios where strong sidelobe masking effects manifest. To tackle this challenge, we have devised a subspace-based approach for a step-by-step target detection process, systematically eliminating interference stemming from detected targets. Simulation results corroborate the effectiveness of the proposed method in achieving consistently high target detection performance under a wide range of constellation options in OFDM ISAC systems.


title: Optimal Redundancy in Exact Channel Synthesis

abstract: We consider the redundancy of the exact channel synthesis problem under an i.i.d. assumption. Existing results provide an upper bound on the unnormalized redundancy that is logarithmic in the block length. We show, via an improved scheme, that the logarithmic term can be halved for most channels and eliminated for all others. For full-support discrete memoryless channels, we show that this is the best possible.


title: Multivariate Beta Mixture Model: Probabilistic Clustering With Flexible Cluster Shapes

abstract: This paper introduces the multivariate beta mixture model (MBMM), a new probabilistic model for soft clustering. MBMM adapts to diverse cluster shapes because of the flexible probability density function of the multivariate beta distribution. We introduce the properties of MBMM, describe the parameter learning procedure, and present the experimental results, showing that MBMM fits diverse cluster shapes on synthetic and real datasets. The code is released anonymously at https://github.com/hhchen1105/mbmm/.


title: A Random Coding Approach to Performance Analysis of the Ordered Statistic Decoding with Local Constraints

abstract: This paper is concerned with the ordered statistic decoding with local constraints (LC-OSD) of binary linear block codes, which is a near maximum-likelihood decoding algorithm. Compared with the conventional OSD, the LC-OSD significantly reduces both the maximum and the average number of searches. The former is achieved by performing the serial list Viterbi algorithm (SLVA) or a two-way flipping pattern tree (FPT) algorithm with local constraints on the test error patterns, while the latter is achieved by incorporating tailored early termination criteria. The main objective of this paper is to explore the relationship between the performance of the LC-OSD and decoding parameters, such as the constraint degree and the maximum list size. To this end, we approximate the local parity-check matrix as a totally random matrix and then estimate the performance of the LC-OSD by analyzing with a saddlepoint approach the performance of random codes over the channels associated with the most reliable bits (MRBs). The random coding approach enables us to derive an upper bound on the performance and predict the average rank of the transmitted codeword in the list delivered by the LC-OSD. This allows us to balance the constraint degree and the maximum list size for the average (or maximum) time complexity reduction. Simulation results show that the approximation by random coding approach is numerically effective and powerful. Simulation results also show that the RS codes decoded by the LC-OSD can approach the random coding union (RCU) bounds, verifying the efficiency and universality of the LC-OSD.


title: Dynamic Human Digital Twin Deployment at the Edge for Task Execution: A Two-Timescale Accuracy-Aware Online Optimization

abstract: Human digital twin (HDT) is an emerging paradigm that bridges physical twins (PTs) with powerful virtual twins (VTs) for assisting complex task executions in human-centric services. In this paper, we study a two-timescale online optimization for building HDT under an end-edge-cloud collaborative framework. As a unique feature of HDT, we consider that PTs' corresponding VTs are deployed on edge servers, consisting of not only generic models placed by downloading experiential knowledge from the cloud but also customized models updated by collecting personalized data from end devices. To maximize task execution accuracy with stringent energy and delay constraints, and by taking into account HDT's inherent mobility and status variation uncertainties, we jointly and dynamically optimize VTs' construction and PTs' task offloading, along with communication and computation resource allocations. Observing that decision variables are asynchronous with different triggers, we propose a novel two-timescale accuracy-aware online optimization approach (TACO). Specifically, TACO utilizes an improved Lyapunov method to decompose the problem into multiple instant ones, and then leverages piecewise McCormick envelopes and block coordinate descent based algorithms, addressing two timescales alternately. Theoretical analyses and simulations show that the proposed approach can reach asymptotic optimum within a polynomial-time complexity, and demonstrate its superiority over counterparts.


title: Insight into the Galactic Bulge Chemodynamical Properties from Gaia DR3

abstract: We explore the chemodynamical properties of the Galaxy in the azimuthal velocity $V_\phi$ and metallicity [Fe/H] space using red giant stars from Gaia Data Release 3. The row-normalized $V_\phi$-[Fe/H] maps form a coherent sequence from the bulge to the outer disk, clearly revealing the thin/thick disk and the Splash. The metal-rich stars display bar-like kinematics while the metal-poor stars show dispersion-dominated kinematics. The intermediate-metallicity population ($-1<$[Fe/H]$<-0.4$) can be separated into two populations, one that is bar-like, i.e. dynamically cold ($\sigma_{V_R}\sim80$ $\rm km\ s^{-1}$) and fast rotating ($V_\phi\gtrsim100$ $\rm km\ s^{-1}$), and the Splash, which is dynamically hot ($\sigma_{V_R}\sim110$ $\rm km\ s^{-1}$) and slow rotating ($V_\phi\lesssim100$ $\rm km\ s^{-1}$). We compare the observations in the bulge region with an Auriga simulation where the last major merger event occurred $\sim10$ Gyr ago: only stars born around the time of the merger reveal a Splash-like feature in the $V_\phi$-[Fe/H] space, suggesting that the Splash is likely merger-induced, predominantly made-up of heated disk stars and the starburst associated with the last major merger. Since the Splash formed from the proto-disk, its lower metallicity limit coincides with that of the thick disk. The bar formed later from the dynamically hot disk with [Fe/H] $>-1$ dex, with the Splash not participating in the bar formation and growth. Moreover, with a set of isolated evolving $N$-body disk simulations, we confirm that a non-rotating classical bulge can be spun up by the bar and develop cylindrical rotation, consistent with the observation for the metal-poor stars.


title: LF Tracy: A Unified Single-Pipeline Approach for Salient Object Detection in Light Field Cameras

abstract: Leveraging the rich information extracted from light field (LF) cameras is instrumental for dense prediction tasks. However, adapting light field data to enhance Salient Object Detection (SOD) still follows the traditional RGB methods and remains under-explored in the community. Previous approaches predominantly employ a custom two-stream design to discover the implicit angular feature within light field cameras, leading to significant information isolation between different LF representations. In this study, we propose an efficient paradigm (LF Tracy) to address this limitation. We eschew the conventional specialized fusion and decoder architecture for a dual-stream backbone in favor of a unified, single-pipeline approach. This comprises firstly a simple yet effective data augmentation strategy called MixLD to bridge the connection of spatial, depth, and implicit angular information under different LF representations. A highly efficient information aggregation (IA) module is then introduced to boost asymmetric feature-wise information fusion. Owing to this innovative approach, our model surpasses the existing state-of-the-art methods, particularly demonstrating a 23% improvement over previous results on the latest large-scale PKU dataset. By utilizing only 28.9M parameters, the model achieves a 10% increase in accuracy with 3M additional parameters compared to its backbone using RGB images and an 86% rise to its backbone using LF images. The source code will be made publicly available at https://github.com/FeiBryantkit/LF-Tracy.


title: Prospects for inconsistency detection using large language models and sheaves

abstract: We demonstrate that large language models can produce reasonable numerical ratings of the logical consistency of claims. We also outline a mathematical approach based on sheaf theory for lifting such ratings to hypertexts such as laws, jurisprudence, and social media and evaluating their consistency globally. This approach is a promising avenue to increasing consistency in and of government, as well as to combating mis- and disinformation and related ills.


title: A Point Cloud Enhancement Method for 4D mmWave Radar Imagery

abstract: A point cloud enhancement method for 4D mmWave radar imagery is proposed in this paper. Based on the patch antenna and MIMO array theories, the MIMO array with small redundancy and high SNR is designed to provide the probability of high angular resolution and detection rate. The antenna array is deployed using a ladder shape in vertical direction to decrease the redundancy and improve the resolution in horizontal direction with the constrains of physical factors. Considering the complicated environment of the real world with non-uniform distributed clutters, the dynamic detection method is used to solve the weak target sensing problem. The window size of CFAR detector is assumed variant to be determined using optimization method, making it adaptive to different environments especially when weak targets exist. The angular resolution increase using FT-based DOA method and the designed antenna array is described, which provides the basis of accurate detection and dense point cloud. To verify the performance of the proposed method, experiments of simulations and practical measurements are carried out, whose results show that the accuracy and the point cloud density are improved with comparison of the original manufacturer mmWave radar of TI AWR2243.


title: Going Viral: Case Studies on the Impact of Protestware

abstract: Maintainers are now self-sabotaging their work in order to take political or economic stances, a practice referred to as "protestware". In this poster, we present our approach to understand how the discourse about such an attack went viral, how it is received by the community, and whether developers respond to the attack in a timely manner. We study two notable protestware cases, i.e., Colors.js and es5-ext, comparing with discussions of a typical security vulnerability as a baseline, i.e., Ua-parser, and perform a thematic analysis of more than two thousand protest-related posts to extract the different narratives when discussing protestware.


title: A parameter-free approach for solving SOS-convex semi-algebraic fractional programs

abstract: In this paper, we study a class of nonsmooth fractional programs {\rm (FP, for short)} with SOS-convex semi-algebraic functions. Under suitable assumptions, we derive a strong duality result between the problem (FP) and its semidefinite programming (SDP) relaxations. Remarkably, we extract an optimal solution of the problem (FP) by solving one and only one associated SDP problem. Numerical examples are also given.


title: Scattering for the dispersion managed nonlinear Schr\"odinger equation

abstract: We consider the dispersion managed nonlinear Schr\"dinger equations with quintic and cubic nonlinearities in one and two dimensions, respectively. We prove the global well-posedness and scattering in $L_x^2$ for small initial data employing the $U^p$ and $V^p$ spaces.


title: The pluricomplex Green function of the Monge-Amp\`{e}re equation for $(n-1)$-plurisubharmonic functions and form type $k$-Hessian equations

abstract: In this paper, we introduce the pluricomplex Green function of the Monge-Amp\`{e}re equation for $(n-1)$-plurisubharmonic functions by solving the Dirichlet problem for the form type Monge-Amp\`{e}re and Hessian equations on a punctured domain. We prove the pluricomplex Green function is $C^{1,\alpha}$ by constructing approximating solutions and establishing uniform a priori estimates for the gradient and the complex Hessian. The singular solutions turn out to be smooth for the $k$-Hessian equations for $(n-1)$-$k$-admissible functions.


title: OptiState: State Estimation of Legged Robots using Gated Networks with Transformer-based Vision and Kalman Filtering

abstract: State estimation for legged robots is challenging due to their highly dynamic motion and limitations imposed by sensor accuracy. By integrating Kalman filtering, optimization, and learning-based modalities, we propose a hybrid solution that combines proprioception and exteroceptive information for estimating the state of the robot's trunk. Leveraging joint encoder and IMU measurements, our Kalman filter is enhanced through a single-rigid body model that incorporates ground reaction force control outputs from convex Model Predictive Control optimization. The estimation is further refined through Gated Recurrent Units, which also considers semantic insights and robot height from a Vision Transformer autoencoder applied on depth images. This framework not only furnishes accurate robot state estimates, including uncertainty evaluations, but can minimize the nonlinear errors that arise from sensor measurements and model simplifications through learning. The proposed methodology is evaluated in hardware using a quadruped robot on various terrains, yielding a 65% improvement on the Root Mean Squared Error compared to our VIO SLAM baseline. Code example: https://github.com/AlexS28/OptiState


title: SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing

abstract: There has been a proliferation of artificial intelligence applications, where model training is key to promising high-quality services for these applications. However, the model training process is both time-intensive and energy-intensive, inevitably affecting the user's demand for application efficiency. Layer freezing, an efficient model training technique, has been proposed to improve training efficiency. Although existing layer freezing methods demonstrate the great potential to reduce model training costs, they still remain shortcomings such as lacking generalizability and compromised accuracy. For instance, existing layer freezing methods either require the freeze configurations to be manually defined before training, which does not apply to different networks, or use heuristic freezing criteria that is hard to guarantee decent accuracy in different scenarios. Therefore, there lacks a generic and smart layer freezing method that can automatically perform ``in-situation'' layer freezing for different networks during training processes. To this end, we propose a generic and efficient training framework (SmartFRZ). The core proposed technique in SmartFRZ is attention-guided layer freezing, which can automatically select the appropriate layers to freeze without compromising accuracy. Experimental results show that SmartFRZ effectively reduces the amount of computation in training and achieves significant training acceleration, and outperforms the state-of-the-art layer freezing approaches.


title: Exceptional magnetic anomalies in TbIrIn5

abstract: We study the single crystal growth and the electronic properties of TbIrIn5. The single crystals of TbIrIn5 were grown using the flux method. The analysis of the x-ray diffraction pattern shows high-quality single crystals formed in a tetragonal crystal structure. A trace of In-flux was also found in the data. Temperature and field-dependent magnetic measurements exhibit strong anisotropy and antiferromagnetic ordering with a Neel temperature of 43.2 K. The estimated Tb-moment from the data in the paramagnetic regime is found to be close to its free ion value. Interestingly, a strong diamagnetic behaviour and sharp resistivity drop typical of the superconducting phase is observed below 2.6 K which may have a link to the trace of indium present in the system. Further studies are required to ascertain this finding.


title: Optimal-Landmark-Guided Image Blending for Face Morphing Attacks

abstract: In this paper, we propose a novel approach for conducting face morphing attacks, which utilizes optimal-landmark-guided image blending. Current face morphing attacks can be categorized into landmark-based and generation-based approaches. Landmark-based methods use geometric transformations to warp facial regions according to averaged landmarks but often produce morphed images with poor visual quality. Generation-based methods, which employ generation models to blend multiple face images, can achieve better visual quality but are often unsuccessful in generating morphed images that can effectively evade state-of-the-art face recognition systems~(FRSs). Our proposed method overcomes the limitations of previous approaches by optimizing the morphing landmarks and using Graph Convolutional Networks (GCNs) to combine landmark and appearance features. We model facial landmarks as nodes in a bipartite graph that is fully connected and utilize GCNs to simulate their spatial and structural relationships. The aim is to capture variations in facial shape and enable accurate manipulation of facial appearance features during the warping process, resulting in morphed facial images that are highly realistic and visually faithful. Experiments on two public datasets prove that our method inherits the advantages of previous landmark-based and generation-based methods and generates morphed images with higher quality, posing a more significant threat to state-of-the-art FRSs.


title: Improving Business Insurance Loss Models by Leveraging InsurTech Innovation

abstract: Recent transformative and disruptive advancements in the insurance industry have embraced various InsurTech innovations. In particular, with the rapid progress in data science and computational capabilities, InsurTech is able to integrate a multitude of emerging data sources, shedding light on opportunities to enhance risk classification and claims management. This paper presents a groundbreaking effort as we combine real-life proprietary insurance claims information together with InsurTech data to enhance the loss model, a fundamental component of insurance companies' risk management. Our study further utilizes various machine learning techniques to quantify the predictive improvement of the InsurTech-enhanced loss model over that of the insurance in-house. The quantification process provides a deeper understanding of the value of the InsurTech innovation and advocates potential risk factors that are unexplored in traditional insurance loss modeling. This study represents a successful undertaking of an academic-industry collaboration, suggesting an inspiring path for future partnerships between industry and academic institutions.


title: Evidence of electron correlation and unusual spectral evolution in an exotic superconductor, PdTe

abstract: We study the electronic structure of an exotic superconductor, PdTe employing depth-resolved high resolution photoemission spectroscopy and density functional theory. The valence band spectra exhibit large density of states at the Fermi level with flat intensity in a wide energy range indicating highly metallic ground state. The Pd 4d-Te 5p hybridization is found to be strong leading to a highly covalent character of the itinerant states. Core level spectra exhibit several features including the signature of plasmon excitations. Although the radial extension of the 4d orbitals is larger than 3d ones, the Pd core level spectra exhibit distinct satellites indicating importance of electron correlation in the electronic structure which may be a reason for unconventional superconductivity observed in this system. The depth-resolved data reveal surface peaks at higher binding energies in both, Te and Pd core level spectra. Interestingly, core level shift in Te-case is significantly large compared to Pd although Te is relatively more electronegative. Detailed analysis rules out applicability of the charge transfer and/or band-narrowing models to capture this scenario. This unusual scenario is attributed to the reconstruction and/or vacancies at the surface. These results reveal the importance of electron correlation and surface topology for the physics of this material exhibiting Dirac fermions and complex superconductivity.


title: Exploiting Equivariance in the Design of Tracking Controllers for Euler-Poincare Systems on Matrix Lie Groups

abstract: The trajectory tracking problem is a fundamental control task in the study of mechanical systems. A key construction in tracking control is the error or difference between an actual and desired trajectory. This construction also lies at the heart of observer design and recent advances in the study of equivariant systems have provided a template for global error construction that exploits the symmetry structure of a group action if such a structure exists. Hamiltonian systems are posed on the cotangent bundle of configuration space of a mechanical system and symmetries for the full cotangent bundle are not commonly used in geometric control theory. In this paper, we propose a group structure on the cotangent bundle of a Lie group and leverage this to define momentum and configuration errors for trajectory tracking drawing on recent work on equivariant observer design. We show that this error definition leads to error dynamics that are themselves ``Euler-Poincare like'' and use these to derive simple, almost global trajectory tracking control for fully-actuated Euler-Poincare systems on a Lie group state space.


title: Variable-Length Feedback Codes over Known and Unknown Channels with Non-vanishing Error Probabilities

abstract: We study variable-length feedback (VLF) codes with noiseless feedback for discrete memoryless channels. We present a novel non-asymptotic bound, which analyzes the average error probability and average decoding time of our modified Yamamoto--Itoh scheme. We then optimize the parameters of our code in the asymptotic regime where the average error probability $\epsilon$ remains a constant as the average decoding time $N$ approaches infinity. Our second-order achievability bound is an improvement of Polyanskiy et al.'s (2011) achievability bound. We also universalize our code by employing the empirical mutual information in our decoding metric and derive a second-order achievability bound for universal VLF codes. Our results for both VLF and universal VLF codes are extended to the additive white Gaussian noise channel with an average power constraint. The former yields an improvement over Truong and Tan's (2017) achievability bound. The proof of our results for universal VLF codes uses a refined version of the method of types and an asymptotic expansion from the nonlinear renewal theory literature.


title: Recent Advances in Hate Speech Moderation: Multimodality and the Role of Large Models

abstract: In the evolving landscape of online communication, moderating hate speech (HS) presents an intricate challenge, compounded by the multimodal nature of digital content. This comprehensive survey delves into the recent strides in HS moderation, spotlighting the burgeoning role of large language models (LLMs) and large multimodal models (LMMs). Our exploration begins with a thorough analysis of current literature, revealing the nuanced interplay between textual, visual, and auditory elements in propagating HS. We uncover a notable trend towards integrating these modalities, primarily due to the complexity and subtlety with which HS is disseminated. A significant emphasis is placed on the advances facilitated by LLMs and LMMs, which have begun to redefine the boundaries of detection and moderation capabilities. We identify existing gaps in research, particularly in the context of underrepresented languages and cultures, and the need for solutions to handle low-resource settings. The survey concludes with a forward-looking perspective, outlining potential avenues for future research, including the exploration of novel AI methodologies, the ethical governance of AI in moderation, and the development of more nuanced, context-aware systems. This comprehensive overview aims to catalyze further research and foster a collaborative effort towards more sophisticated, responsible, and human-centric approaches to HS moderation in the digital era. WARNING: This paper contains offensive examples.


title: Unexpected linear conductivity in Landau-Zener model: limitations and improvements of the relaxation time approximation in the quantum master equation

abstract: The nonequilibrium steady states of quantum materials have many challenges. Here, we highlight issues with the relaxation time approximation (RTA) for the DC conductivity in insulating systems. The RTA to the quantum master equation (QME) is frequently employed as a simple method, yet this phenomenological approach is exposed as a fatal approximation, displaying metallic DC conductivity in insulating systems within the linear response regime. We find that the unexpected metallic behavior is caused by the fact that the density matrix in the RTA incompletely incorporates the first order of the external field. To solve this problem, we have derived a new calculation scheme based on the QME that ensure correct behavior in low electric fields. Our method reproduces well the overall features of the exact electric currents in the whole field region. It is not time-consuming, and its application to lattice systems is straightforward. This method will encourage progress in this research area as a simple way to more accurately describe nonequilibrium steady states.


title: Widely Linear Matched Filter: A Lynchpin towards the Interpretability of Complex-valued CNNs

abstract: A recent study on the interpretability of real-valued convolutional neural networks (CNNs) {Stankovic_Mandic_2023CNN} has revealed a direct and physically meaningful link with the task of finding features in data through matched filters. However, applying this paradigm to illuminate the interpretability of complex-valued CNNs meets a formidable obstacle: the extension of matched filtering to a general class of noncircular complex-valued data, referred to here as the widely linear matched filter (WLMF), has been only implicit in the literature. To this end, to establish the interpretability of the operation of complex-valued CNNs, we introduce a general WLMF paradigm, provide its solution and undertake analysis of its performance. For rigor, our WLMF solution is derived without imposing any assumption on the probability density of noise. The theoretical advantages of the WLMF over its standard strictly linear counterpart (SLMF) are provided in terms of their output signal-to-noise-ratios (SNRs), with WLMF consistently exhibiting enhanced SNR. Moreover, the lower bound on the SNR gain of WLMF is derived, together with condition to attain this bound. This serves to revisit the convolution-activation-pooling chain in complex-valued CNNs through the lens of matched filtering, which reveals the potential of WLMFs to provide physical interpretability and enhance explainability of general complex-valued CNNs. Simulations demonstrate the agreement between the theoretical and numerical results.


title: Three-dimensional velocity fields of the solar filament eruptions detected by CHASE

abstract: The eruption of solar filaments, also known as prominences appearing off-limb, is a common phenomenon in the solar atmosphere. It ejects massive plasma and high-energy particles into interplanetary space, disturbing the solar-terrestrial environment. It is vital to obtain the three-dimensional velocity fields of erupting filaments for space-weather predictions. We derive the three-dimensional kinematics of an off-limb prominence and an on-disk filament, respectively, using the full-disk spectral and imaging data detected by the Chinese H$\alpha$ Solar Explorer (CHASE). It is found that both the prominence and the filament experience a fast semicircle-shaped expansion at first. The prominence keeps propagating outward with an increasing velocity until escaping successfully, whereas the south leg of the prominence finally moves back to the Sun in a swirling manner. For the filament, the internal plasma falls back to the Sun associated with an anticlockwise rotation in the late ejection, matching the failed eruption without a coronal mass ejection. During the eruptions, both the prominence and the filament show material splitting along the line-of-sight direction, revealed by the bimodal H$\alpha$ spectral profiles. For the prominence, the splitting begins at the top and gradually spreads to almost the whole prominence with a fast blue-shift component and a slow red-shift component. The material splitting in the filament is more fragmental. As shown by the present results, the CHASE full-disk spectroscopic observations make it possible to systematically study the three-dimensional kinematics of solar filament eruptions.


title: Towards Generating Informative Textual Description for Neurons in Language Models

abstract: Recent developments in transformer-based language models have allowed them to capture a wide variety of world knowledge that can be adapted to downstream tasks with limited resources. However, what pieces of information are understood in these models is unclear, and neuron-level contributions in identifying them are largely unknown. Conventional approaches in neuron explainability either depend on a finite set of pre-defined descriptors or require manual annotations for training a secondary model that can then explain the neurons of the primary model. In this paper, we take BERT as an example and we try to remove these constraints and propose a novel and scalable framework that ties textual descriptions to neurons. We leverage the potential of generative language models to discover human-interpretable descriptors present in a dataset and use an unsupervised approach to explain neurons with these descriptors. Through various qualitative and quantitative analyses, we demonstrate the effectiveness of this framework in generating useful data-specific descriptors with little human involvement in identifying the neurons that encode these descriptors. In particular, our experiment shows that the proposed approach achieves 75% precision@2, and 50% recall@2


title: Flash: A Hybrid Private Inference Protocol for Deep CNNs with High Accuracy and Low Latency on CPU

abstract: This paper presents Flash, an optimized private inference (PI) hybrid protocol utilizing both homomorphic encryption (HE) and secure two-party computation (2PC), which can reduce the end-to-end PI latency for deep CNN models less than 1 minute with CPU. To this end, first, Flash proposes a low-latency convolution algorithm built upon a fast slot rotation operation and a novel data encoding scheme, which results in 4-94x performance gain over the state-of-the-art. Second, to minimize the communication cost introduced by the standard nonlinear activation function ReLU, Flash replaces the entire ReLUs with the polynomial $x^2+x$ and trains deep CNN models with the new activation function. The trained models improve the inference accuracy for CIFAR-10/100 and TinyImageNet by 16% on average (up to 40% for ResNet-32) compared to prior art. Last, Flash proposes an efficient 2PC-based $x^2+x$ evaluation protocol that does not require any offline communication and that reduces the total communication cost to process the activation layer by 84-196x over the state-of-the-art. As a result, the end-to-end PI latency of Flash implemented on CPU is 0.02 minute for CIFAR-100 and 0.57 minute for TinyImageNet classification, while the total data communication is 0.07GB for CIFAR-100 and 0.22GB for TinyImageNet. Flash improves the state-of-the-art PI by 16-45x in latency and 84-196x in communication cost. Moreover, even for ImageNet, Flash can deliver the latency less than 1 minute on CPU with the total communication less than 1GB.


title: Contour deformations for non-holomorphic actions

abstract: We show how contour deformations may be used to control the sign problem of lattice Monte Carlo calculations with non-holomorphic actions. Such actions arise naturally in quantum mechanical scattering problems. The approach is demonstrated in conjunction with the holomorphic gradient flow. As our central example we compute the real-time evolution of a particle in a one-dimensional analog of the Yukawa potential.


title: Besov and Paley-Wiener spaces, Moduli of continuity and Hardy-Steklov operators associated with the group $"ax+b"$

abstract: We introduce and describe relations between Sobolev, Besov and Paley-Wiener spaces associated with three representations of the Lie group of affine transformations of the line. These representations are left and right regular representations and a representation in a space of functions defined on the half-line. The Besov spaces are described as interpolation spaces between respective Sobolev spaces in terms of the Petree's real interpolation method and in terms of a relevant moduli of continuity. By using a Laplace operators associated with these representations a scales of relevant Paley-Wiener spaces are developed and a corresponding $L_{2}$-approximation theory is constructed in which our Besov spaces appear as approximation spaces. Another description of our Besov spaces is given in terms of a frequency-localized Hilbert frames. A Jackson-type inequalities are also proven.


title: Angular Position Sensor Based on Anisotropic Magnetoresistive and Anomalous Nernst Effect

abstract: Magnetic position sensors find extensive applications in various industrial sectors and consumer products. However, measuring angles in the full range of 0{\deg} to 360{\deg} in a wide field range using a single magnetic sensor remains a challenge. Here, we propose a magnetic position sensor based on a single Wheatstone bridge structure made from a single ferromagnetic layer. By measuring the anisotropic magnetoresistance (AMR) signal from the bridge and two sets of anomalous Nernst effect (ANE) signals from the transverse ports on two perpendicular Wheatstone bridge arms concurrently, we show that it is possible to achieve 0{\deg} to 360{\deg} angle detection using a single bridge sensor. The combined use of AMR and ANE signals allows to achieve a mean angle error in the range of 0.51{\deg} to 1.05{\deg} within a field range of 100 Oe to 10,000 Oe.


title: Engineering A Large Language Model From Scratch

abstract: The proliferation of deep learning in natural language processing (NLP) has led to the development and release of innovative technologies capable of understanding and generating human language with remarkable proficiency. Atinuke, a Transformer-based neural network, optimises performance across various language tasks by utilising a unique configuration. The architecture interweaves layers for processing sequential data with attention mechanisms to draw meaningful affinities between inputs and outputs. Due to the configuration of its topology and hyperparameter tuning, it can emulate human-like language by extracting features and learning complex mappings. Atinuke is modular, extensible, and integrates seamlessly with existing machine learning pipelines. Advanced matrix operations like softmax, embeddings, and multi-head attention enable nuanced handling of textual, acoustic, and visual signals. By unifying modern deep learning techniques with software design principles and mathematical theory, the system achieves state-of-the-art results on natural language tasks whilst remaining interpretable and robust.


title: Formation of highly stable interfacial nitrogen gas hydrate overlayers under ambient conditions

abstract: Surfaces (interfaces) dictate many physical and chemical properties of solid materials and adsorbates considerably affect these properties. Nitrogen molecules, which are the most abundant constituent in ambient air, are considered to be inert. Our study combining atomic force microscopy (AFM), X-ray photoemission spectroscopy (XPS), and thermal desorption spectroscopy (TDS) revealed that nitrogen and water molecules can self-assemble into two-dimensional domains, forming ordered stripe structures on graphitic surfaces in both water and ambient air. The stripe structures of this study were composed of approximately 90% and 10% water and nitrogen molecules, respectively, and survived in ultra-high vacuum (UHV) conditions at temperatures up to approximately 350 K. Because pure water molecules completely desorb from graphitic surfaces in a UHV at temperatures lower than 200 K, our results indicate that the incorporation of nitrogen molecules substantially enhanced the stability of the crystalline water hydrogen bonding network. Additional studies on interfacial gas hydrates can provide deeper insight into the mechanisms underlying formation of gas hydrates.


title: A novel non-adiabatic spin relaxation mechanism in molecular qubits

abstract: The interaction of electronic spin and molecular vibrations mediated by spin-orbit coupling governs spin relaxation in molecular qubits. I derive an extended molecular spin Hamiltonian that includes both adiabatic and non-adiabatic spin-dependent interactions, and I implement the computation of its matrix elements using state-of-the-art density functional theory. The new molecular spin Hamiltonian contains a novel spin-vibrational orbit interaction with non-adiabatic origin together with the traditional molecular Zeeman and zero-field splitting interactions with adiabatic origin. The spin-vibrational orbit interaction represents a non-Abelian Berry curvature on the ground-state electronic manifold and corresponds to an effective magnetic field in the electronic spin dynamics. I further develop a spin relaxation rate model that estimates the spin relaxation time via the two-phonon Raman process. An application of the extended molecular spin Hamiltonian together with the spin relaxation rate model to Cu(II) porphyrin, a prototypical $S=1/2$ molecular qubit, demonstrates that the spin relaxation time at elevated temperatures is dominated by the non-adiabatic spin-vibrational orbit interaction. The computed spin relaxation rate and its magnetic field orientation dependence are in excellent agreement with experimental measurements.


title: Independence numbers in certain families of highly symmetric graphs

abstract: FI-graphs were introduced by the second author and White to capture the idea of a family of nested graphs, each member of which is acted on by a progressively larger symmetric group. That work was built on the newly minted foundations of representation stability theory and FI-modules. Examples of such families include the complete graphs and the Kneser and Johnson graphs, among many others. While it was shown in the originating work how various counting invariants in these families behave very regularly, not much has thus far been proven about the behaviors of the typical extremal graph theoretic invariants such as their independence and clique numbers. In this paper we provide a conjecture on the growth of the independence and clique numbers in these families, and prove this conjecture in one case. We also provide computer code that generates experimental evidence in many other cases. All of this work falls into a growing trend in representation stability theory that displays the regular behaviors of a number of extremal invariants that arise when one looks at FI-algebras and modules.


title: Laser-power consumption of soliton formation in a bidirectional Kerr resonator

abstract: Laser sources power extreme data transmission as well as computing acceleration, access to ultrahigh-speed signaling, and sensing for chemicals, distance, and pattern recognition. The ever-growing scale of these applications drives innovation in multi-wavelength lasers for massively parallel processing. We report a nanophotonic Kerr-resonator circuit that consumes the power of an input laser and generates a soliton frequency comb at approaching unit efficiency. By coupling forward and backward propagation, we realize a bidirectional Kerr resonator that supports universal phase matching but also opens excess loss by double-sided emission. Therefore, we induce reflection of the resonator's forward, external-coupling port to favor backward propagation, resulting in efficient, one-sided soliton formation. Coherent backscattering with nanophotonics provides the control to put arbitrary phase-matching and efficient laser-power consumption on equal footing in Kerr resonators. In the overcoupled-resonator regime, we measure 65% conversion efficiency of a 40 mW input pump laser, and the nonlinear circuit consumes 97% of the pump, generating the maximum possible comb power. Our work opens up high-efficiency soliton formation in integrated photonics, exploring how energy flows in nonlinear circuits and enabling laser sources for advanced transmission, computing, quantum sensing, and artificial-intelligence applications.


title: MESA: Matching Everything by Segmenting Anything

abstract: Feature matching is a crucial task in the field of computer vision, which involves finding correspondences between images. Previous studies achieve remarkable performance using learning-based feature comparison. However, the pervasive presence of matching redundancy between images gives rise to unnecessary and error-prone computations in these methods, imposing limitations on their accuracy. To address this issue, we propose MESA, a novel approach to establish precise area (or region) matches for efficient matching redundancy reduction. MESA first leverages the advanced image understanding capability of SAM, a state-of-the-art foundation model for image segmentation, to obtain image areas with implicit semantic. Then, a multi-relational graph is proposed to model the spatial structure of these areas and construct their scale hierarchy. Based on graphical models derived from the graph, the area matching is reformulated as an energy minimization task and effectively resolved. Extensive experiments demonstrate that MESA yields substantial precision improvement for multiple point matchers in indoor and outdoor downstream tasks, e.g. +13.61% for DKM in indoor pose estimation.


title: Generative AI-based closed-loop fMRI system

abstract: While generative AI is now widespread and useful in society, there are potential risks of misuse, e.g., unconsciously influencing cognitive processes or decision-making. Although this causes a security problem in the cognitive domain, there has been no research about neural and computational mechanisms counteracting the impact of malicious generative AI in humans. We propose DecNefGAN, a novel framework that combines a generative adversarial system and a neural reinforcement model. More specifically, DecNefGAN bridges human and generative AI in a closed-loop system, with the AI creating stimuli that induce specific mental states, thus exerting external control over neural activity. The objective of the human is the opposite, to compete and reach an orthogonal mental state. This framework can contribute to elucidating how the human brain responds to and counteracts the potential influence of generative AI.


title: Multi-Group Multicasting Systems Using Multiple RISs

abstract: In this paper, practical utilization of multiple distributed reconfigurable intelligent surfaces (RISs), which are able to conduct group-specific operations, for multi-group multicasting systems is investigated. To tackle the inter-group interference issue in the multi-group multicasting systems, the block diagonalization (BD)-based beamforming is considered first. Without any inter-group interference after the BD operation, the multiple distributed RISs are operated to maximize the minimum rate for each group. Since the computational complexity of the BD-based beamforming can be too high, a multicasting tailored zero-forcing (MTZF) beamforming technique is proposed to efficiently suppress the inter-group interference, and the novel design for the multiple RISs that makes up for the inevitable loss of MTZF beamforming is also described. Effective closed-form solutions for the loss minimizing RIS operations are obtained with basic linear operations, making the proposed MTZF beamforming-based RIS design highly practical. Numerical results show that the BD-based approach has ability to achieve high sum-rate, but it is useful only when the base station deploys large antenna arrays. Even with the small number of antennas, the MTZF beamforming-based approach outperforms the other schemes in terms of the sum-rate while the technique requires low computational complexity. The results also prove that the proposed techniques can work with the minimum rate requirement for each group.


title: ShaRP: Explaining Rankings with Shapley Values

abstract: Algorithmic decisions in critical domains such as hiring, college admissions, and lending are often based on rankings. Because of the impact these decisions have on individuals, organizations, and population groups, there is a need to understand them: to know whether the decisions are abiding by the law, to help individuals improve their rankings, and to design better ranking procedures. In this paper, we present ShaRP (Shapley for Rankings and Preferences), a framework that explains the contributions of features to different aspects of a ranked outcome, and is based on Shapley values. Using ShaRP, we show that even when the scoring function used by an algorithmic ranker is known and linear, the weight of each feature does not correspond to its Shapley value contribution. The contributions instead depend on the feature distributions, and on the subtle local interactions between the scoring features. ShaRP builds on the Quantitative Input Influence framework, and can compute the contributions of features for multiple Quantities of Interest, including score, rank, pair-wise preference, and top-k. Because it relies on black-box access to the ranker, ShaRP can be used to explain both score-based and learned ranking models. We show results of an extensive experimental validation of ShaRP using real and synthetic datasets, showcasing its usefulness for qualitative analysis.


title: MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models

abstract: Large language models (LLMs) are increasingly relied upon for complex multi-turn conversations across diverse real-world applications. However, existing benchmarks predominantly focus on single-turn evaluations, overlooking the models' capabilities in multi-turn interactions. To address this gap, we introduce MT-Eval, a comprehensive benchmark designed to evaluate multi-turn conversational abilities. By analyzing human-LLM conversations, we categorize interaction patterns into four types: recollection, expansion, refinement, and follow-up. We construct multi-turn queries for each category either by augmenting existing datasets or by creating new examples with GPT-4 to avoid data leakage. To study the factors impacting multi-turn abilities, we create single-turn versions of the 1170 multi-turn queries and compare performance. Our evaluation of 11 well-known LLMs shows that while closed-source models generally surpass open-source ones, certain open-source models exceed GPT-3.5-Turbo in specific tasks. We observe significant performance degradation in multi-turn settings compared to single-turn settings in most models, which is not correlated with the models' fundamental capabilities. Moreover, we identify the distance to relevant content and susceptibility to error propagation as the key factors influencing multi-turn performance. MT-Eval is released publicly to encourage future research towards more robust conversational models.


title: Unipotent nearby cycles and nearby cycles over general bases

abstract: We show that under some conditions, two constructions of nearby cycles over general bases coincide. More specifically, we show that under the assumption of $\Psi$-factorizability, the constructions of unipotent nearby cycles over an affine space can be described using the theory of nearby cycles over general bases via the vanishing topos. In particular, this applies to nearby cycles of Satake sheaves on Beilinson-Drinfeld Grassmannians with parahoric ramification.


title: Searching for Particle Dark Matter with eROSITA Early Data

abstract: Many well motivated dark matter (DM) particle candidates can decay into detectable X-ray photons. We analyze the Final Equatorial Depth Survey (eFEDS) data from eROSITA early data release to search for unidentified X-ray lines that could indicate DM signals. Having discovered no anomalous signal, we set limits on DM decay rate in mass range between 1.8-18 keV, and constrain the parameter space of two DM particles: sterile neutrino and axion-like particles. Finally we also study the projected sensitivity of eROSITA full sky search, showing that eROSITA all-sky survey is expected to set the most stringent limits in the soft X-ray band.