title: High-resolution spectroscopy of proximity superconductivity in finite-size quantized surface states

abstract: Adding superconducting (SC) electron pairing via the proximity effect to pristinely non-superconducting materials can lead to a variety of interesting physical phenomena. Particular interest has recently focused on inducing SC into two-dimensional surface states (SSs), potentially also combined with non-trivial topology. We study the mechanism of proximity-induced SC into the Shockley-type SSs of the noble metals Ag(111) and Cu(111) grown on the elemental SC Nb(110) using scanning tunneling spectroscopy. The tunneling spectra exhibit an intriguing multitude of sharp states at low energies. Their appearance can be explained by Andreev bound states (ABS) formed by the weakly proximitized SSs subject to lateral finite-size confinement. We study systematically how the proximity gap in the bulk states of both Ag(111) and Cu(111) persists up to island thicknesses of several times the bulk coherence length of Nb. We find that even for thick islands, the SSs acquire a gap, with the gap size for Cu being consistently larger than for Ag. Based on this, we argue that the SC in the SS is not provided through direct overlap of the SS wavefunction with the SC host but can be understood to be mediated by step edges inducing electronic coupling to the bulk. Our work provides important input for the microscopic understanding of induced superconductivity in heterostructures and its spectral manifestation. Moreover, it lays the foundation for more complex SC heterostructures based on noble metals.


title: Ergodicity demystifies fast neutrino flavor instability

abstract: Flavor ergodicity implies that angular crossings are necessary and sufficient for fast instability.


title: RB5 Low-Cost Explorer: Implementing Autonomous Long-Term Exploration on Low-Cost Robotic Hardware

abstract: This systems paper presents the implementation and design of RB5, a wheeled robot for autonomous long-term exploration with fewer and cheaper sensors. Requiring just an RGB-D camera and low-power computing hardware, the system consists of an experimental platform with rocker-bogie suspension. It operates in unknown and GPS-denied environments and on indoor and outdoor terrains. The exploration consists of a methodology that extends frontier- and sampling-based exploration with a path-following vector field and a state-of-the-art SLAM algorithm. The methodology allows the robot to explore its surroundings at lower update frequencies, enabling the use of lower-performing and lower-cost hardware while still retaining good autonomous performance. The approach further consists of a methodology to interact with a remotely located human operator based on an inexpensive long-range and low-power communication technology from the internet-of-things domain (i.e., LoRa) and a customized communication protocol. The results and the feasibility analysis show the possible applications and limitations of the approach.


title: UniEnc-CASSNAT: An Encoder-only Non-autoregressive ASR for Speech SSL Models

abstract: Non-autoregressive automatic speech recognition (NASR) models have gained attention due to their parallelism and fast inference. The encoder-based NASR, e.g. connectionist temporal classification (CTC), can be initialized from the speech foundation models (SFM) but does not account for any dependencies among intermediate tokens. The encoder-decoder-based NASR, like CTC alignment-based single-step non-autoregressive transformer (CASS-NAT), can mitigate the dependency problem but is not able to efficiently integrate SFM. Inspired by the success of recent work of speech-text joint pre-training with a shared transformer encoder, we propose a new encoder-based NASR, UniEnc-CASSNAT, to combine the advantages of CTC and CASS-NAT. UniEnc-CASSNAT consists of only an encoder as the major module, which can be the SFM. The encoder plays the role of both the CASS-NAT encoder and decoder by two forward passes. The first pass of the encoder accepts the speech signal as input, while the concatenation of the speech signal and the token-level acoustic embedding is used as the input for the second pass. Examined on the Librispeech 100h, MyST, and Aishell1 datasets, the proposed UniEnc-CASSNAT achieves state-of-the-art NASR results and is better or comparable to CASS-NAT with only an encoder and hence, fewer model parameters. Our codes are publicly available.


title: Free Space Optical Frequency Comparison Over Rapidly Moving Links

abstract: The comparison of optical reference frequency signals over free-space optical links is limited by the relative motion between local and remote sites. For ground to low earth orbit comparison, the expected Doppler shift and Doppler rate typically reach 4 GHz at 100 MHz/s, which prevents the narrow-band detection required to compare optical frequencies at the highest levels of stability. We demonstrate a system capable of optical frequency comparison in the presence of these significant Doppler shifts, using an electro-optic phase modulator with an actuation bandwidth of 10 GHz, which will enable ground-to-space frequency comparison. This system was demonstrated over a retro-reflected drone link, with a maximum line-of-sight velocity of 15 m/s and Doppler shift of 19 MHz at a Doppler rate of 1 MHz/s. The best fractional frequency stability obtained was 7E-18 at an integration time of 5s. These results are an important step toward ground to low earth orbit optical frequency comparison, providing a scalable terrestrial test bed.


title: The photodissociation dynamics and ultrafast electron diffraction image of cyclobutanone from the surface hopping dynamics simulation

abstract: The comprehension of nonadiabatic dynamics in polyatomic systems relies heavily on the simultaneous advancements in theoretical and experimental domains. The gas-phase electron diffraction (GUED) technique has attracted widespread attention as a promising tool for observing the photochemical and photophysical features at all-atomic level with high temporal and spatial resolutions. In this work, the GUED spectra were predicted to perform a double-blind test of accuracy in excited-state simulation for cyclobutanone based on the trajectory surface hopping method, with respect to the benchmark data obtained by upcoming MeV-GUED experiments at the Stanfold Linear Accelerator Laboratory. The results show that the ultrafast nonadiabatic dynamics occurs in the photoinduced dynamics, and two C2 and C3 channels play dominant roles in the nonadiabatic reactions of cyclobutanone. The simulated UED signal can be directly interpreted by atomic movements, providing a unique view to monitor the time-dependent evolution of the molecular structure in the femtosecond dynamics.


title: Characterization of the ATLAS Liquid Argon Front-End ASIC ALFE2 for the HL-LHC upgrade

abstract: ALFE2 is an ATLAS Liquid Argon Calorimeter (LAr) Front-End ASIC designed for the HL-LHC upgrade. ALFE2 comprises four channels of pre-amplifiers and CR-(RC)2 shapers with adjustable input impedance. ALFE2 features two separate gain outputs to provide 16-bit dynamic-range coverage and an optimum resolution. ALFE2 is characterized using a Front-End Test Board (FETB) based on a Zynq UltraScale+ MPSoC and two octal-channel 16-bit high-speed ADCs. The test results indicate that ALFE2 fulfills or greatly exceeds all specifications on gain, noise, linearity, uniformity, and radiation tolerance.


title: Auto-Encoding Bayesian Inverse Games

abstract: When multiple agents interact in a common environment, each agent's actions impact others' future decisions, and noncooperative dynamic games naturally capture this coupling. In interactive motion planning, however, agents typically do not have access to a complete model of the game, e.g., due to unknown objectives of other players. Therefore, we consider the inverse game problem, in which some properties of the game are unknown a priori and must be inferred from observations. Existing maximum likelihood estimation (MLE) approaches to solve inverse games provide only point estimates of unknown parameters without quantifying uncertainty, and perform poorly when many parameter values explain the observed behavior. To address these limitations, we take a Bayesian perspective and construct posterior distributions of game parameters. To render inference tractable, we employ a variational autoencoder (VAE) with an embedded differentiable game solver. This structured VAE can be trained from an unlabeled dataset of observed interactions, naturally handles continuous, multi-modal distributions, and supports efficient sampling from the inferred posteriors without computing game solutions at runtime. Extensive evaluations in simulated driving scenarios demonstrate that the proposed approach successfully learns the prior and posterior game parameter distributions, provides more accurate objective estimates than MLE baselines, and facilitates safer and more efficient game-theoretic motion planning.


title: A geostatistical analysis of multiscale metallicity variations in galaxies -- III. Spatial resolution and data quality limits

abstract: Geostatistical methods are powerful tools for understanding the spatial structure of the metallicity distribution of galaxies, and enable construction of accurate predictive models of the 2D metallicity distribution. However, so far these methods have only been applied to very high spatial resolution metallicity maps, leaving it uncertain if they will work on lower quality data. In this study, we apply geostatistical techniques to high-resolution spectroscopic maps of three local galaxies convolved to eight different spatial resolutions ranging from ~40pc to ~1 kpc per pixel. We fit a geostatistical model to the data at all resolutions, and find that for metallicity maps where small scale structure is visible by eye (with > ~10 resolution elements per Re), all parameters, including the metallicity correlation scale, can be recovered accurately. At all resolutions tested, we find that point metallicity predictions from such a geostatistical model outperform a circularly symmetric metallicity gradient model. We also explore dependence on the number of data points, and find that N > ~100 spatially resolved metallicity values are sufficient to train a geostatistical model that yields more accurate metallicity predictions than a radial gradient model. Finally, we investigate the potential detrimental effects of having spaxels smaller than an individual Hii region by repeating our analysis with metallicities integrated over Hii regions. We see that spaxel-based measurements have more noise, as expected, but the underlying spatial metallicity distribution can be recovered regardless of whether spaxels or integrated regions are used.


title: Sound Field Reconstruction Using a Compact Acoustics-informed Neural Network

abstract: Sound field reconstruction (SFR) augments the information of a sound field captured by a microphone array. Conventional SFR methods using basis function decomposition are straightforward and computationally efficient, but may require more microphones than needed to measure the sound field. Recent studies show that pure data-driven and learning-based methods are promising in some SFR tasks, but they are usually computationally heavy and may fail to reconstruct a physically valid sound field. This paper proposes a compact acoustics-informed neural network (AINN) method for SFR, whereby the Helmholtz equation is exploited to regularize the neural network. As opposed to pure data-driven approaches that solely rely on measured sound pressures, the integration of the Helmholtz equation improves robustness of the neural network against variations during the measurement processes and prompts the generation of physically valid reconstructions. The AINN is designed to be compact, and is able to predict not only the sound pressures but also sound pressure gradients within a spatial region of interest based on measured sound pressures along the boundary. Numerical experiments with acoustic transfer functions measured in different environments demonstrate the superiority of the AINN method over the traditional cylinder harmonic decomposition and the singular value decomposition methods.


title: Time preference, wealth and utility inequality: A microeconomic interaction and dynamic macroeconomic model connection approach

abstract: Based on interactions between individuals and others and references to social norms, this study reveals the impact of heterogeneity in time preference on wealth distribution and inequality. We present a novel approach that connects the interactions between microeconomic agents that generate heterogeneity to the dynamic equations for capital and consumption in macroeconomic models. Using this approach, we estimate the impact of changes in the discount rate due to microeconomic interactions on capital, consumption and utility and the degree of inequality. The results show that intercomparisons with others regarding consumption significantly affect capital, i.e. wealth inequality. Furthermore, the impact on utility is never small and social norms can reduce this impact. Our supporting evidence shows that the quantitative results of inequality calculations correspond to survey data from cohort and cross-cultural studies. This study's micro-macro connection approach can be deployed to connect microeconomic interactions, such as exchange, interest and debt, redistribution, mutual aid and time preference, to dynamic macroeconomic models.


title: Decay-protected superconducting qubit with fast control enabled by integrated on-chip filters

abstract: Subharmonic control of superconducting qubits simultaneously facilitates fast single-qubit gates, long coherence times, and reduced thermal load. However, its implementation requires a very strong coupling of the drive line to the qubit or an excessively strong microwave signal. To address this challenge, we introduce on-chip filters of the qubit drive that exhibit a stopband at the resonance frequency and ultra-strong coupling at the subharmonic frequency. The on-chip filters are designed to demonstrate qubit $T_1$ in the millisecond range while enabling fast gates of tens of nanoseconds with subharmonic control. For a resonant drive, we experimentally show a maximum of 200-fold improvement in the measured $T_1$ and a factor of 220 suppression in the measured Rabi frequency at the stopband. Furthermore, we successfully implemented subharmonic driving of Rabi oscillations with a $\pi$-pulse duration of 12 ns. Our demonstration of on-chip filters and the resulting introduction of efficient subharmonic driving in a two-dimensional quantum processor paves the way for a scalable qubit architecture with reduced thermal load and noise from the control line.


title: Subgraph Pooling: Tackling Negative Transfer on Graphs

abstract: Transfer learning aims to enhance performance on a target task by using knowledge from related tasks. However, when the source and target tasks are not closely aligned, it can lead to reduced performance, known as negative transfer. Unlike in image or text data, we find that negative transfer could commonly occur in graph-structured data, even when source and target graphs have semantic similarities. Specifically, we identify that structural differences significantly amplify the dissimilarities in the node embeddings across graphs. To mitigate this, we bring a new insight in this paper: for semantically similar graphs, although structural differences lead to significant distribution shift in node embeddings, their impact on subgraph embeddings could be marginal. Building on this insight, we introduce Subgraph Pooling (SP) by aggregating nodes sampled from a k-hop neighborhood and Subgraph Pooling++ (SP++) by a random walk, to mitigate the impact of graph structural differences on knowledge transfer. We theoretically analyze the role of SP in reducing graph discrepancy and conduct extensive experiments to evaluate its superiority under various settings. The proposed SP methods are effective yet elegant, which can be easily applied on top of any backbone Graph Neural Networks (GNNs). Our code and data are available at: https://github.com/Zehong-Wang/Subgraph-Pooling.


title: Teamwork Makes TEE Work: Open and Resilient Remote Attestation on Decentralized Trust

abstract: Remote Attestation (RA) enables the integrity and authenticity of applications in Trusted Execution Environment (TEE) to be verified. Existing TEE RA designs employ a centralized trust model where they rely on a single provisioned secret key and a centralized verifier to establish trust for remote parties. This model is however brittle and can be untrusted under advanced attacks nowadays. Besides, most designs only provide fixed functionalities once deployed, making them hard to adapt to different needs on availability, Quality of Service (QoS), etc. Therefore, we propose JANUS, an open and resilient TEE RA scheme. To decentralize trust, we, on one hand, introduce Physically Unclonable Function (PUF) as an intrinsic root of trust (RoT) in TEE to provide additional measurements and cryptographic enhancements. On the other hand, we use blockchain and smart contract to realize decentralized verification and result audit. Furthermore, we design an automated turnout mechanism that allows JANUS to remain resilient and offer flexible RA services under various situations. We provide a UC-based security proof and demonstrate the scalability and generality of JANUS by implementing an open-sourced prototype.


title: A locally mass-conservative enriched Petrov-Galerkin method without penalty for the Darcy flow in porous media

abstract: In this work we present an enriched Petrov-Galerkin (EPG) method for the simulation of the Darcy flow in porous media. The new method enriches the approximation trial space of the conforming continuous Galerkin (CG) method with bubble functions and enriches the approximation test space of the CG method with piecewise constant functions, and it does not require any penalty term in the weak formulation. Moreover, we propose a framework for constructing the bubble functions and consider a decoupled algorithm for the EPG method based on this framework, which enables the process of solving pressure to be decoupled into two steps. The first step is to solve the pressure by the standard CG method, and the second step is a post-processing correction of the first step. Compared with the CG method, the proposed EPG method is locally mass-conservative, while keeping fewer degrees of freedom than the discontinuous Galerkin (DG) method. In addition, this method is more concise in the error analysis than the enriched Galerkin (EG) method. The coupled flow and transport in porous media is considered to illustrate the advantages of locally mass-conservative properties of the EPG method. We establish the optimal convergence of numerical solutions and present several numerical examples to illustrate the performance of the proposed method.


title: Learning-based Bone Quality Classification Method for Spinal Metastasis

abstract: Spinal metastasis is the most common disease in bone metastasis and may cause pain, instability and neurological injuries. Early detection of spinal metastasis is critical for accurate staging and optimal treatment. The diagnosis is usually facilitated with Computed Tomography (CT) scans, which requires considerable efforts from well-trained radiologists. In this paper, we explore a learning-based automatic bone quality classification method for spinal metastasis based on CT images. We simultaneously take the posterolateral spine involvement classification task into account, and employ multi-task learning (MTL) technique to improve the performance. MTL acts as a form of inductive bias which helps the model generalize better on each task by sharing representations between related tasks. Based on the prior knowledge that the mixed type can be viewed as both blastic and lytic, we model the task of bone quality classification as two binary classification sub-tasks, i.e., whether blastic and whether lytic, and leverage a multiple layer perceptron to combine their predictions. In order to make the model more robust and generalize better, self-paced learning is adopted to gradually involve from easy to more complex samples into the training process. The proposed learning-based method is evaluated on a proprietary spinal metastasis CT dataset. At slice level, our method significantly outperforms an 121-layer DenseNet classifier in sensitivities by $+12.54\%$, $+7.23\%$ and $+29.06\%$ for blastic, mixed and lytic lesions, respectively, meanwhile $+12.33\%$, $+23.21\%$ and $+34.25\%$ at vertebrae level.


title: A merger-driven scenario for clumpy galaxy formation in the epoch of reionization: Physical properties of clumps in the FirstLight simulation

abstract: Recent JWST observations with superb angular resolution have revealed the existence of clumpy galaxies at high redshift through the detection of rest-frame optical emission lines. We use the FirstLight simulation to study the properties of (sub-)galactic clumps that are bright in [OIII] 5007$\mathrm{\mathring{A}}$ line with flux greater than $\sim 10^{-18} \, {\rm erg\, s^{-1}\, cm^{-2}}$, to be detected by JWST. For 62 simulated galaxies that have stellar masses of $(0.5-6) \times 10^{10} \, M_\odot$ at $z=5$, we find clumps in 1828 snapshots in the redshift range $z = 9.5-5.5$. The clumps are identified by the surface density of star formation rate. About one-tenth of the snapshots show the existence of clumpy systems with two or more components. Most of the clumps are formed by mergers and can be characterized by their ages; central clumps dominated by stellar populations older than 50 Myr, and off-centered clumps dominated by younger stellar populations with specific star formation rates of $\sim 50 \, {\rm Gyr^{-1}}$. The latter type of young clumps is formed from gas debris in the tidal tails of major mergers with baryonic mass ratios of $1 \leq q < 4$. The merger-induced clumps are short-lived, and merge within a dynamical time of several tens million years. The number density of the clumpy systems is estimated to be $\sim 10^{-5}\, {\rm cMpc^{-3}}$, which is large enough to be detected in recent JWST surveys.


title: Supercloseness of the DDG method for a singularly perturbed convection diffusion problem on Shishkin mesh

abstract: This paper investigates the supercloseness of a singularly perturbed convection diffusion problem using the direct discontinuous Galerkin (DDG) method on a Shishkin mesh. The main technical difficulties lie in controlling the diffusion term inside the layer, the convection term outside the layer, and the inter element jump term caused by the discontinuity of the numerical solution. The main idea is to design a new composite interpolation, in which a global projection is used outside the layer to satisfy the interface conditions determined by the selection of numerical flux, thereby eliminating or controlling the troublesome terms on the unit interface; and inside the layer, Gau{\ss} Lobatto projection is used to improve the convergence order of the diffusion term. On the basis of that, by selecting appropriate parameters in the numerical flux, we obtain the supercloseness result of almost $k+1$ order under an energy norm. Numerical experiments support our main theoretical conclusion.


title: Sharp decay estimates and asymptotic stability for incompressible MHD equations without viscosity or magnetic diffusion

abstract: Whether the global existence and uniqueness of strong solutions of $n$-dimensional incompressible magnetohydrodynamic (MHD for short) equations with only kinematic viscosity or magnetic diffusion holds true or not remains an outstanding open problem. In recent years, more attention has been paid to the case when the magnetic field close to an equilibrium state (the background magnetic field for short). Specifically, when the background magnetic field satisfies the Diophantine condition (see (1.2) for details), Chen, Zhang and Zhou [Sci. China Math. 41 (2022), pp.1-10] first studied the perturbation system and established the decay estimates and stability of its solutions in 3D periodic domain $\mathbb{T}^3$, which was then improved to $H^{(3+2\beta)r+5+(\alpha+2\beta)}(\mathbb{T}^2)$ for 2D periodic domain $\mathbb{T}^2$ and any $\alpha>0$, $\beta>0$ by Zhai [J. Differ. Equ. 374 (2023), pp.267-278]. In this paper, we seek to find the optimal decay estimates and improve the space where the global stability is taking place. Through deeply exploring and fully utilizing the structure of perturbation system, we discover a new dissipative mechanism, which enables us to establish the decay estimates in Sobolev space with much lower regularity. Based on the above discovery, we greatly reduce the initial regularity requirement of aforementioned two works from $H^{4r+7}(\mathbb{T}^3)$ and $H^{(3+2\beta)r+5+(\alpha+2\beta)}(\mathbb{T}^2)$ to $H^{(3r+3)^+}(\mathbb{T}^n)$ for $r>n-1$ when $n=3$ and $n=2$ respectively. Additionally, we first present the linear stability result via the method of spectral analysis in this paper. From which, the decay estimates obtained for the nonlinear system can be seen as sharp in the sense that they are in line with those for the linearized system.


title: Understanding the mirror asymmetry in Gamow-Teller transition rates between $^{28}$Al($\beta^-$)$^{28m}$Si and $^{28}$P($\beta^+$)$^{28m}$Si

abstract: The long-standing discrepancy between shell-model and experimental values of the mirror asymmetry in Gamow-Teller transition rates for $^{28}$Al($\beta^-$)$^{28m}$Si and $^{28}$P($\beta^+$)$^{28m}$Si is partially resolved by integrating the $p$-orbital contribution into the radial mismatch correction term. This approach offers a potential estimate of the radial mismatch-induced core-orbital contribution based on the French-Macfarlane sum rules, avoiding the need for heavy calculations required by the first-principle shell model. Additionally, the isospin-mixing contribution undergoes considerable improvement through scaling the calculated isospin-mixing correction with the experimental energy separation between the lowest two admixed states, in accordance with the result from the two-level model.


title: Lattice calculation of electromagnetic corrections to $K\ell3$ decay

abstract: We describe a first-principles method to apply lattice QCD to compute the order $\alpha_{\mathrm{EM}}$ corrections to $K\to\pi\ell\nu_\ell$ decay. This method formulates the calculation in infinite volume with the conventional infinite-volume, continuum treatment of QED. Infinite volume reconstruction is used to replace the QCD components of the calculation with finite-volume amplitudes which can be computed in Euclidean space using lattice QCD, introducing finite-volume errors which vanish exponentially as the volume used in the QCD calculation is increased. This approach has also been described in an appendix to the recent paper: arXiv:2304.08026.


title: Lightweight Deep Learning Based Channel Estimation for Extremely Large-Scale Massive MIMO Systems

abstract: Extremely large-scale massive multiple-input multiple-output (XL-MIMO) systems introduce the much higher channel dimensionality and incur the additional near-field propagation effect, aggravating the computation load and the difficulty to acquire the prior knowledge for channel estimation. In this article, an XL-MIMO channel network (XLCNet) is developed to estimate the high-dimensional channel, which is a universal solution for both the near-field users and far-field users with different channel statistics. Furthermore, a compressed XLCNet (C-XLCNet) is designed via weight pruning and quantization to accelerate the model inference as well as to facilitate the model storage and transmission. Simulation results show the performance superiority and universality of XLCNet. Compared to XLCNet, C-XLCNet incurs the limited performance loss while reducing the computational complexity and model size by about $10 \times$ and $36 \times$, respectively.


title: An Interference-aware Approach for Co-located Container Orchestration with Novel Metric

abstract: Container orchestration technologies are widely employed in cloud computing, facilitating the co-location of online and offline services on the same infrastructure. Online services demand rapid responsiveness and high availability, whereas offline services require extensive computational resources. However, this mixed deployment can lead to resource contention, adversely affecting the performance of online services, yet the metrics used by existing methods cannot accurately reflect the extent of interference. In this paper, we introduce scheduling latency as a novel metric for quantifying interference and compare it with existing metrics. Empirical evidence demonstrates that scheduling latency more accurately reflects the performance degradation of online services. We also utilize various machine learning techniques to predict potential interference on specific hosts for online services, providing reference information for subsequent scheduling decisions. Simultaneously, we propose a method for quantifying node interference based on scheduling latency. To enhance resource utilization, we train a model for online services that predicts CPU and MEM (memory) resource allocation based on workload type and QPS. Finally, we present a scheduling algorithm based on predictive modeling, aiming to reduce interference in online services while balancing node resource utilization. Through experiments and comparisons with three other baseline methods, we demonstrate the effectiveness of our approach. Compared with three baselines, our approach can reduce the average response time, 90th percentile response time, and 99th percentile response time of online services by 29.4%, 31.4%, and 14.5%, respectively.


title: Graph Inference Acceleration by Learning MLPs on Graphs without Supervision

abstract: Graph Neural Networks (GNNs) have demonstrated effectiveness in various graph learning tasks, yet their reliance on message-passing constraints their deployment in latency-sensitive applications such as financial fraud detection. Recent works have explored distilling knowledge from GNNs to Multi-Layer Perceptrons (MLPs) to accelerate inference. However, this task-specific supervised distillation limits generalization to unseen nodes, which are prevalent in latency-sensitive applications. To this end, we present \textbf{\textsc{SimMLP}}, a \textbf{\textsc{Sim}}ple yet effective framework for learning \textbf{\textsc{MLP}}s on graphs without supervision, to enhance generalization. \textsc{SimMLP} employs self-supervised alignment between GNNs and MLPs to capture the fine-grained and generalizable correlation between node features and graph structures, and proposes two strategies to alleviate the risk of trivial solutions. Theoretically, we comprehensively analyze \textsc{SimMLP} to demonstrate its equivalence to GNNs in the optimal case and its generalization capability. Empirically, \textsc{SimMLP} outperforms state-of-the-art baselines, especially in settings with unseen nodes. In particular, it obtains significant performance gains {\bf (7$\sim$26\%)} over MLPs and inference acceleration over GNNs {\bf (90$\sim$126$\times$)} on large-scale graph datasets. Our codes are available at: \url{https://github.com/Zehong-Wang/SimMLP}.


title: Interpretable Measures of Conceptual Similarity by Complexity-Constrained Descriptive Auto-Encoding

abstract: Quantifying the degree of similarity between images is a key copyright issue for image-based machine learning. In legal doctrine however, determining the degree of similarity between works requires subjective analysis, and fact-finders (judges and juries) can demonstrate considerable variability in these subjective judgement calls. Images that are structurally similar can be deemed dissimilar, whereas images of completely different scenes can be deemed similar enough to support a claim of copying. We seek to define and compute a notion of "conceptual similarity" among images that captures high-level relations even among images that do not share repeated elements or visually similar components. The idea is to use a base multi-modal model to generate "explanations" (captions) of visual data at increasing levels of complexity. Then, similarity can be measured by the length of the caption needed to discriminate between the two images: Two highly dissimilar images can be discriminated early in their description, whereas conceptually dissimilar ones will need more detail to be distinguished. We operationalize this definition and show that it correlates with subjective (averaged human evaluation) assessment, and beats existing baselines on both image-to-image and text-to-text similarity benchmarks. Beyond just providing a number, our method also offers interpretability by pointing to the specific level of granularity of the description where the source data are differentiated.


title: Quantifying and Characterizing Clones of Self-Admitted Technical Debt in Build Systems

abstract: Self-Admitted Technical Debt (SATD) annotates development decisions that intentionally exchange long-term software artifact quality for short-term goals. Recent work explores the existence of SATD clones (duplicate or near duplicate SATD comments) in source code. Cloning of SATD in build systems (e.g., CMake and Maven) may propagate suboptimal design choices, threatening qualities of the build system that stakeholders rely upon (e.g., maintainability, reliability, repeatability). Hence, we conduct a large-scale study on 50,608 SATD comments extracted from Autotools, CMake, Maven, and Ant build systems to investigate the prevalence of SATD clones and to characterize their incidences. We observe that: (i) prior work suggests that 41-65% of SATD comments in source code are clones, but in our studied build system context, the rates range from 62% to 95%, suggesting that SATD clones are a more prevalent phenomenon in build systems than in source code; (ii) statements surrounding SATD clones are highly similar, with 76% of occurrences having similarity scores greater than 0.8; (iii) a quarter of SATD clones are introduced by the author of the original SATD statements; and (iv) among the most commonly cloned SATD comments, external factors (e.g., platform and tool configuration) are the most frequent locations, limitations in tools and libraries are the most frequent causes, and developers often copy SATD comments that describe issues to be fixed later. Our work presents the first step toward systematically understanding SATD clones in build systems and opens up avenues for future work, such as distinguishing different SATD clone behavior, as well as designing an automated recommendation system for repaying SATD effectively based on resolved clones.


title: Enhancing ID and Text Fusion via Alternative Training in Session-based Recommendation

abstract: Session-based recommendation has gained increasing attention in recent years, with its aim to offer tailored suggestions based on users' historical behaviors within sessions. To advance this field, a variety of methods have been developed, with ID-based approaches typically demonstrating promising performance. However, these methods often face challenges with long-tail items and overlook other rich forms of information, notably valuable textual semantic information. To integrate text information, various methods have been introduced, mostly following a naive fusion framework. Surprisingly, we observe that fusing these two modalities does not consistently outperform the best single modality by following the naive fusion framework. Further investigation reveals an potential imbalance issue in naive fusion, where the ID dominates and text modality is undertrained. This suggests that the unexpected observation may stem from naive fusion's failure to effectively balance the two modalities, often over-relying on the stronger ID modality. This insight suggests that naive fusion might not be as effective in combining ID and text as previously expected. To address this, we propose a novel alternative training strategy AlterRec. It separates the training of ID and text, thereby avoiding the imbalance issue seen in naive fusion. Additionally, AlterRec designs a novel strategy to facilitate the interaction between the two modalities, enabling them to mutually learn from each other and integrate the text more effectively. Comprehensive experiments demonstrate the effectiveness of AlterRec in session-based recommendation. The implementation is available at https://github.com/Juanhui28/AlterRec.


title: The Mirrored Influence Hypothesis: Efficient Data Influence Estimation by Harnessing Forward Passes

abstract: Large-scale black-box models have become ubiquitous across numerous applications. Understanding the influence of individual training data sources on predictions made by these models is crucial for improving their trustworthiness. Current influence estimation techniques involve computing gradients for every training point or repeated training on different subsets. These approaches face obvious computational challenges when scaled up to large datasets and models. In this paper, we introduce and explore the Mirrored Influence Hypothesis, highlighting a reciprocal nature of influence between training and test data. Specifically, it suggests that evaluating the influence of training data on test predictions can be reformulated as an equivalent, yet inverse problem: assessing how the predictions for training samples would be altered if the model were trained on specific test samples. Through both empirical and theoretical validations, we demonstrate the wide applicability of our hypothesis. Inspired by this, we introduce a new method for estimating the influence of training data, which requires calculating gradients for specific test samples, paired with a forward pass for each training point. This approach can capitalize on the common asymmetry in scenarios where the number of test samples under concurrent examination is much smaller than the scale of the training dataset, thus gaining a significant improvement in efficiency compared to existing approaches. We demonstrate the applicability of our method across a range of scenarios, including data attribution in diffusion models, data leakage detection, analysis of memorization, mislabeled data detection, and tracing behavior in language models. Our code will be made available at https://github.com/ruoxi-jia-group/Forward-INF.


title: IMUOptimize: A Data-Driven Approach to Optimal IMU Placement for Human Pose Estimation with Transformer Architecture

abstract: This paper presents a novel approach for predicting human poses using IMU data, diverging from previous studies such as DIP-IMU, IMUPoser, and TransPose, which use up to 6 IMUs in conjunction with bidirectional RNNs. We introduce two main innovations: a data-driven strategy for optimal IMU placement and a transformer-based model architecture for time series analysis. Our findings indicate that our approach not only outperforms traditional 6 IMU-based biRNN models but also that the transformer architecture significantly enhances pose reconstruction from data obtained from 24 IMU locations, with equivalent performance to biRNNs when using only 6 IMUs. The enhanced accuracy provided by our optimally chosen locations, when coupled with the parallelizability and performance of transformers, provides significant improvements to the field of IMU-based pose estimation.


title: Study of local conserved quantities in the one-dimensional Hubbard model

abstract: In this thesis, I study the local charges $\{Q_k\}$ in the one-dimensional Hubbard model, which is an integrable system used for theoretical studies of non-perturbative effects in strongly correlated electron systems. I obtained their explicit expressions in a closed form. An expression of the $k$-local charge $Q_k$ for $k > 5$, where $k$ denotes the support, had been unknown in previous studies. I find that $Q_k$ is a linear combination of a particular kind of products of the hopping terms. I introduce a diagrammatic notation to represent these products efficiently, which enables the prediction of the general formula of the local charges. These linear combinations have non-trivial coefficients for $k > 5$, and some of the coefficients were proved to be identical to the generalized Catalan numbers, which also appear in the local charges of the Heisenberg chain. I derive the recursion equation for these coefficients. I also prove that the obtained local charges are exhaustive. Thus, any local charge is written as a linear combination of $\{Q_k\}$. Although the completeness of the local charges is a natural conjecture in the transfer-matrix formulation, its proof has not been presented for almost all cases. Lastly, I emphasize that this is the first study demonstrating general explicit expressions of the local charges for an electron system that lacks the boost operator.

categories: cond-mat.stat-mech cond-mat.str-el math-ph math.MP nlin.SI


title: MaxMin-RLHF: Towards Equitable Alignment of Large Language Models with Diverse Human Preferences

abstract: Reinforcement Learning from Human Feedback (RLHF) aligns language models to human preferences by employing a singular reward model derived from preference data. However, such an approach overlooks the rich diversity of human preferences inherent in data collected from multiple users. In this work, we first derive an impossibility result of alignment with single reward RLHF, thereby highlighting its insufficiency in representing diverse human preferences. To provide an equitable solution to the problem, we learn a mixture of preference distributions via an expectation-maximization algorithm and propose a MaxMin alignment objective for policy learning inspired by the Egalitarian principle in social choice theory to better represent diverse human preferences. We elucidate the connection of our proposed approach to distributionally robust optimization and general utility RL, thereby highlighting the generality and robustness of our proposed solution. We present comprehensive experimental results on small-scale (GPT-2) and large-scale language models (with Tulu2-7B) and show the efficacy of the proposed approach in the presence of diversity among human preferences. Our algorithm achieves an average improvement of more than 16% in win-rates over conventional RLHF algorithms and improves the win-rate (accuracy) for minority groups by over 33% without compromising the performance of majority groups, showcasing the robustness and fairness of our approach. We remark that our findings in this work are not only limited to language models but also extend to reinforcement learning in general.


title: Conformal Finite Element Methods for Nonlinear Rosenau-Burgers-Biharmonic Models

abstract: We present a novel and comparative analysis of finite element discretizations for a nonlinear Rosenau-Burgers model including a biharmonic term. We analyze both continuous and mixed finite element approaches, providing stability, existence, and uniqueness statements of the corresponding variational methods. We also obtain optimal error estimates of the semidiscrete scheme in corresponding B\^ochner spaces. Finally, we construct a fully discrete scheme through a backward Euler discretization of the time derivative, and prove well-posedness statements for this fully discrete scheme. Our findings show that the mixed approach removes some theoretical impediments to analysis and is numerically easier to implement. We provide numerical simulations for the mixed formulation approach using $C^0$ Taylor-Hood finite elements on several domains. Our numerical results confirm that the algorithm has optimal convergence in accordance with the observed theoretical results.


title: Critical speeding-up in dynamical percolation

abstract: We study the autocorrelation time of the size of the cluster at the origin in discrete-time dynamical percolation. We focus on binary trees and high-dimensional tori, and show in both cases that this autocorrelation time is linear in the volume in the subcritical regime, but strictly sublinear in the volume at criticality. This establishes rigorously that the cluster size at the origin in these models exhibits critical speeding-up. The proofs involve controlling relevant Fourier coefficients. In the case of binary trees, these Fourier coefficients are studied explicitly, while for high-dimensional tori we employ a randomised algorithm argument introduced by Schramm and Steif in the context of noise sensitivity.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Noise estimation in an entanglement distillation protocol

abstract: Estimating noise processes is an essential step for practical quantum information processing. Standard estimation tools require consuming valuable quantum resources. Here we ask the question of whether the noise affecting entangled states can be learned solely from the measurement statistics obtained during a distillation protocol. As a first step, we consider states of the Werner form and find that the Werner parameter can be estimated efficiently from the measurement statistics of an idealized distillation protocol. Our proposed estimation method can find application in scenarios where distillation is an unavoidable step.


title: Second Order Methods for Bandit Optimization and Control

abstract: Bandit convex optimization (BCO) is a general framework for online decision making under uncertainty. While tight regret bounds for general convex losses have been established, existing algorithms achieving these bounds have prohibitive computational costs for high dimensional data. In this paper, we propose a simple and practical BCO algorithm inspired by the online Newton step algorithm. We show that our algorithm achieves optimal (in terms of horizon) regret bounds for a large class of convex functions that we call $\kappa$-convex. This class contains a wide range of practically relevant loss functions including linear, quadratic, and generalized linear models. In addition to optimal regret, this method is the most efficient known algorithm for several well-studied applications including bandit logistic regression. Furthermore, we investigate the adaptation of our second-order bandit algorithm to online convex optimization with memory. We show that for loss functions with a certain affine structure, the extended algorithm attains optimal regret. This leads to an algorithm with optimal regret for bandit LQR/LQG problems under a fully adversarial noise model, thereby resolving an open question posed in \citep{gradu2020non} and \citep{sun2023optimal}. Finally, we show that the more general problem of BCO with (non-affine) memory is harder. We derive a $\tilde{\Omega}(T^{2/3})$ regret lower bound, even under the assumption of smooth and quadratic losses.


title: Subwavelength Photorefractive Grating in a Thin-Film Lithium Niobate Microcavity

abstract: Subwavelength gratings play a fundamental and pivotal role in numerous science and applications for wave manipulation, exhibiting distinctive features such as filtering, phase manipulation, and anti-reflection. However, conventional fabrication methods for ultrasmall periodic structures are constrained by the fundamental optical diffraction limit, making it challenging to produce subwavelength gratings for optics. Here, we demonstrate a novel technique to build a reconfigurable subwavelength photorefractive grating (SPG) in a thin-film lithium niobate on the platform of an optical microcavity. Such SPGs are optically induced through the photorefractive effect and the subwavelength features originate from the spatial phase modulations of the pump's standing wave. The resulting SPGs lead to the mode splitting of two counter-propagating modes inside the microcavity, exhibiting an Electromagnetically Induced Transparency (EIT)-like transmission spectrum. Moreover, the unique subwavelength characteristic of SPGs enables first-order quasi-phase-matching for backward second-harmonic generation, a long-standing problem in nonlinear optics. Also, free-space-to-chip vertical nonlinear frequency conversion can be achieved in a similar manner. These results provide a flexible approach towards fabricating subwavelength gratings, which holds significant potential in various applications such as nonlinear frequency conversion, optical communication, sensing, and quantum technologies.


title: Depth-aware Volume Attention for Texture-less Stereo Matching

abstract: Stereo matching plays a crucial role in 3D perception and scenario understanding. Despite the proliferation of promising methods, addressing texture-less and texture-repetitive conditions remains challenging due to the insufficient availability of rich geometric and semantic information. In this paper, we propose a lightweight volume refinement scheme to tackle the texture deterioration in practical outdoor scenarios. Specifically, we introduce a depth volume supervised by the ground-truth depth map, capturing the relative hierarchy of image texture. Subsequently, the disparity discrepancy volume undergoes hierarchical filtering through the incorporation of depth-aware hierarchy attention and target-aware disparity attention modules. Local fine structure and context are emphasized to mitigate ambiguity and redundancy during volume aggregation. Furthermore, we propose a more rigorous evaluation metric that considers depth-wise relative error, providing comprehensive evaluations for universal stereo matching and depth estimation models. We extensively validate the superiority of our proposed methods on public datasets. Results demonstrate that our model achieves state-of-the-art performance, particularly excelling in scenarios with texture-less images. The code is available at https://github.com/ztsrxh/DVANet.


title: Listening to Multi-talker Conversations: Modular and End-to-end Perspectives

abstract: Since the first speech recognition systems were built more than 30 years ago, improvement in voice technology has enabled applications such as smart assistants and automated customer support. However, conversation intelligence of the future requires recognizing free-flowing multi-party conversations, which is a crucial and challenging component that still remains unsolved. In this dissertation, we focus on this problem of speaker-attributed multi-talker speech recognition, and propose two perspectives which result from its probabilistic formulation. In the modular perspective, we build a pipeline of sub-tasks involving speaker diarization, target speaker extraction, and speech recognition. Our first contribution is a method to perform overlap-aware diarization by reformulating spectral clustering as a constrained optimization problem. We also describe an algorithm to ensemble diarization outputs, either to combine overlap-aware systems or to perform multi-channel diarization by late fusion. Once speaker segments are identified, we robustly extract single-speaker utterances from the mixture using a GPU-accelerated implementation of guided source separation, which allows us to use an off-the-shelf ASR system to obtain speaker-attributed transcripts. Since the modular approach suffers from error propagation, we propose an alternate "end-to-end" perspective on the problem. For this, we describe the Streaming Unmixing and Recognition Transducer (SURT). We show how to train SURT models efficiently by carefully designing the network architecture, objective functions, and mixture simulation techniques. Finally, we add an auxiliary speaker branch to enable joint prediction of speaker labels synchronized with the speech tokens. We demonstrate that training on synthetic mixtures and adapting with real data helps these models transfer well for streaming transcription of real meeting sessions.


title: Sudoku Number of Corona of Graphs

abstract: Let $G = (V,E)$ be a graph of order $n$ with chromatic number $\chi(G) = k$, let $S \subset V$ and let $C_0$ be a $k$-coloring of the induced subgraph $G[S]$. The coloring $C_0$ is called an extendable coloring, if $C_0$ can be extended to a $k$-coloring of $G$ and it is a Sudoku coloring of $G$ if the extension is unique. The smallest order of such an induced subgraph $G[S]$ of $G$ which admits a Sudoku coloring is called the Sudoku number of $G$ and is denoted by $sn(G)$. In this paper, we first introduce the notion of uniquely color extendable vertex and then we obtain the lower and upper bounds for the Sudoku number of $G \circ K_1$. Some families of graphs which attain these bounds are also obtained. The exact value of the Sudoku number of corona of $C_n$, $W_n$ and $K_n$ with $K_1$ and $C_n \circ P_m$ are also obtained.


title: Extreme Video Compression with Pre-trained Diffusion Models

abstract: Diffusion models have achieved remarkable success in generating high quality image and video data. More recently, they have also been used for image compression with high perceptual quality. In this paper, we present a novel approach to extreme video compression leveraging the predictive power of diffusion-based generative models at the decoder. The conditional diffusion model takes several neural compressed frames and generates subsequent frames. When the reconstruction quality drops below the desired level, new frames are encoded to restart prediction. The entire video is sequentially encoded to achieve a visually pleasing reconstruction, considering perceptual quality metrics such as the learned perceptual image patch similarity (LPIPS) and the Frechet video distance (FVD), at bit rates as low as 0.02 bits per pixel (bpp). Experimental results demonstrate the effectiveness of the proposed scheme compared to standard codecs such as H.264 and H.265 in the low bpp regime. The results showcase the potential of exploiting the temporal relations in video data using generative models. Code is available at: https://github.com/ElesionKyrie/Extreme-Video-Compression-With-Prediction-Using-Pre-trainded-Diffusion-Models-


title: Search for ultralight vector dark matter with a Torsion Pendulum Dual Oscillator

abstract: Ultralight bosons with masses in the range from $\sim 10^{-22}$ eV to $\sim 1$ eV, are well-motivated, wave-like dark matter candidates. Particles on the lower-mass end are less explored in experiments due to their vanishingly small mass and weak coupling to the Standard Model. We propose to search for U(1)$_{B\!-\!L}$ gauge boson dark matter using a Torsion Pendulum Dual Oscillator (TorPeDO), a sensor originally designed to detect Newtonian gravitational field fluctuations with an enhanced differential torque sensitivity in a frequency band of $\sim 10^{-2}$-$10$ Hz. We describe the experiment setup of a modified TorPeDO sensor, equipped with four 5-kg end test masses (two made from beryllium and two from aluminium). We present the estimated sensitivity to an ultralight dark matter field coupled to baryon minus lepton ($B\!-\!L$) number, in a mass range of $\sim 10^{-17}$-$10^{-13}$ eV. The projected constraints on the coupling constant $g_{B\!-\!L} (\hbar c)^{-1/2}$ can reach $\sim 10^{-29}$ for a boson mass of $\sim 10^{-15}$ eV in the most sensitive frequency band.


title: Predictive Temporal Attention on Event-based Video Stream for Energy-efficient Situation Awareness

abstract: The Dynamic Vision Sensor (DVS) is an innovative technology that efficiently captures and encodes visual information in an event-driven manner. By combining it with event-driven neuromorphic processing, the sparsity in DVS camera output can result in high energy efficiency. However, similar to many embedded systems, the off-chip communication between the camera and processor presents a bottleneck in terms of power consumption. Inspired by the predictive coding model and expectation suppression phenomenon found in human brain, we propose a temporal attention mechanism to throttle the camera output and pay attention to it only when the visual events cannot be well predicted. The predictive attention not only reduces power consumption in the sensor-processor interface but also effectively decreases the computational workload by filtering out noisy events. We demonstrate that the predictive attention can reduce 46.7% of data communication between the camera and the processor and reduce 43.8% computation activities in the processor.


title: Stability of Poincar\'e gauge theory with cubic order invariants

abstract: We analyse the stability of the vector and axial sectors of Poincar\'e gauge theory around general backgrounds in the presence of cubic order invariants defined from the curvature and torsion tensors, showing how the latter can in fact cancel out well-known instabilities arising from the quadratic curvature invariants of the theory and accordingly help in the construction of healthy models with both curvature and torsion. For this task, we introduce the most general parity preserving cubic Lagrangian with mixing terms of the curvature and torsion tensors, and find the relations of its coefficients to avoid a pathological behaviour from the vector and axial modes of torsion. As a result, on top of the gravitational constant of General Relativity and the mass parameters of torsion, our action contains 23 additional coupling constants controlling the dynamics of this field. As in the quadratic Poincar\'e gauge theory, we show that a further restriction on the cubic part of the action allows the existence of Reissner-Nordstr\"om-like black hole solutions with dynamical torsion.


title: AINeedsPlanner: A Workbook to Support Effective Collaboration Between AI Experts and Clients

abstract: Clients often partner with AI experts to develop AI applications tailored to their needs. In these partnerships, careful planning and clear communication are critical, as inaccurate or incomplete specifications can result in misaligned model characteristics, expensive reworks, and potential friction between collaborators. Unfortunately, given the complexity of requirements ranging from functionality, data, and governance, effective guidelines for collaborative specification of requirements in client-AI expert collaborations are missing. In this work, we introduce AINeedsPlanner, a workbook that AI experts and clients can use to facilitate effective interchange and clear specifications. The workbook is based on (1) an interview of 10 completed AI application project teams, which identifies and characterizes steps in AI application planning and (2) a study with 12 AI experts, which defines a taxonomy of AI experts' information needs and dimensions that affect the information needs. Finally, we demonstrate the workbook's utility with two case studies in real-world settings.


title: Premise Order Matters in Reasoning with Large Language Models

abstract: Large language models (LLMs) have accomplished remarkable reasoning performance in various domains. However, in the domain of reasoning tasks, we discover a frailty: LLMs are surprisingly brittle to the ordering of the premises, despite the fact that such ordering does not alter the underlying task. In particular, we observe that LLMs achieve the best performance when the premise order aligns with the context required in intermediate reasoning steps. For example, in deductive reasoning tasks, presenting the premises in the same order as the ground truth proof in the prompt (as opposed to random ordering) drastically increases the model's accuracy. We first examine the effect of premise ordering on deductive reasoning on a variety of LLMs, and our evaluation shows that permuting the premise order can cause a performance drop of over 30%. In addition, we release the benchmark R-GSM, based on GSM8K, to examine the ordering effect for mathematical problem-solving, and we again observe a significant drop in accuracy, relative to the original GSM8K benchmark.


title: Structure and magnetic properties of a La$_{0.75}$Sr$_{0.25}$Cr$_{0.90}$O$_{3-\delta}$ single crystal

abstract: We have successfully grown large and good-quality single crystals of the La$_{0.75}$Sr$_{0.25}$Cr$_{0.90}$O$_{3-\delta}$ compound using the floating-zone method with laser diodes. We investigated the crystal quality, crystallography, chemical composition, magnetic properties and the oxidation state of Cr in the grown single crystals by employing a combination of techniques, including X-ray Laue and powder diffraction, scanning electron microscopy, magnetization measurements, X-ray photoelectron spectroscopy and light absorption. The La$_{0.75}$Sr$_{0.25}$Cr$_{0.90}$O$_{3-\delta}$ single crystal exhibits a single-phase composition, crystallizing in a trigonal structure with the space group $R\bar{3}c$ at room temperature. The chemical composition was determined as La$_{0.75}$Sr$_{0.25}$Cr$_{0.90}$O$_{3-\delta}$, indicating a significant chromium deficiency. Upon warming, we observed five distinctive characteristic temperatures, namely $T_1 =$ 21.50(1) K, $T_2 =$ 34.98(1) K, $T_3 =$ 117.94(1) K, $T_4 =$ 155.01(1) K, and $T_{\textrm{N}} =$ 271.80(1) K, revealing five distinct magnetic anomalies. Our magnetization study allows us to explore the nature of these anomalies. Remarkably, the oxidation state of chromium in the single-crystal La$_{0.75}$Sr$_{0.25}$Cr$_{0.90}$O$_{3-\delta}$, characterized by a band gap of 1.630(8) eV, is exclusively attributed to Cr$^{3+}$ ions, making a departure from the findings of previous studies on polycrystalline materials.


title: Local-Polynomial Estimation for Multivariate Regression Discontinuity Designs

abstract: We introduce a multivariate local-linear estimator for multivariate regression discontinuity designs in which treatment is assigned by crossing a boundary in the space of running variables. The dominant approach uses the Euclidean distance from a boundary point as the scalar running variable; hence, multivariate designs are handled as uni-variate designs. However, the distance running variable is incompatible with the assumption for asymptotic validity. We handle multivariate designs as multivariate. In this study, we develop a novel asymptotic normality for multivariate local-polynomial estimators. Our estimator is asymptotically valid and can capture heterogeneous treatment effects over the boundary. We demonstrate the effectiveness of our estimator through numerical simulations. Our empirical illustration of a Colombian scholarship study reveals a richer heterogeneity (including its absence) of the treatment effect that is hidden in the original estimates.


title: Homomorphisms into Specht modules labelled by hooks in quantum characteristic two

abstract: Let $R_n$ denote the KLR algebra of type $A^{(1)}_{e-1}$. Using the presentation of Specht modules given by Kleschev-Mathas-Ram, Loubert completely determined $\hom_{R_n}(S^\mu,S^\lambda)$ where $\mu$ is an arbitrary partition, $\lambda$ is a hook and $e\neq2$. In this paper, we investigate the same problem when $e=2$. First we give a complete description of the action of the generators on the basis elements of $S^\lambda$. We use this result to identify a large family of partitions $\mu$ such that there exists at least one non-zero homomorphism from $S^\mu$ to $S^\lambda$, explicitly describe these maps and give their grading. Finally, we generalise James's result for the trivial module.


title: Evaluating DTW Measures via a Synthesis Framework for Time-Series Data

abstract: Time-series data originate from various applications that describe specific observations or quantities of interest over time. Their analysis often involves the comparison across different time-series data sequences, which in turn requires the alignment of these sequences. Dynamic Time Warping (DTW) is the standard approach to achieve an optimal alignment between two temporal signals. Different variations of DTW have been proposed to address various needs for signal alignment or classifications. However, a comprehensive evaluation of their performance in these time-series data processing tasks is lacking. Most DTW measures perform well on certain types of time-series data without a clear explanation of the reason. To address that, we propose a synthesis framework to model the variation between two time-series data sequences for comparison. Our synthesis framework can produce a realistic initial signal and deform it with controllable variations that mimic real-world scenarios. With this synthesis framework, we produce a large number of time-series sequence pairs with different but known variations, which are used to assess the performance of a number of well-known DTW measures for the tasks of alignment and classification. We report their performance on different variations and suggest the proper DTW measure to use based on the type of variations between two time-series sequences. This is the first time such a guideline is presented for selecting a proper DTW measure. To validate our conclusion, we apply our findings to real-world applications, i.e., the detection of the formation top for the oil and gas industry and the pattern search in streamlines for flow visualization.


title: The Racah algebra of rank 2: Properties, symmetries and representation

abstract: This paper is threefold. First, we provide a new "universal" definition for the Racah algebra of rank-2 as an extension of the rank-1 Racah algebra where the generators are indexed by subsets and any three disjoint indexing sets define a subalgebra isomorphic to the rank-1 case. With this definition, we explore some of the properties of the algebra including verifying that these natural assumptions are equivalent to other defining relations in the literature. Second, we look at the symmetries of the generators of the rank-2 Racah algebra. Those symmetries allows us to partially make abstraction of the choice of the generators and write relations and properties in a different format. Last, we provide a novel representation of the Racah algebra. This new representation requires only one generator to be diagonal and is based on an expansion of the split basis representation from the rank-1 Racah algebra.

categories: math-ph math.MP math.QA math.RT physics.class-ph


title: Etale spaces of residuated lattices

abstract: This paper explores the concept of \'{e}tal\'{e} spaces associated with residuated lattices. Notions of bundles and \'{e}tal\'{e}s of residuated lattices over a given topological space are introduced and investigated. For a topological space $\mathscr{B}$, we establish that the category of \'{e}tal\'{e}s of residuated lattices over $\mathscr{B}$ with morphisms of \'{e}tal\'{e}s of residuated lattices is coreflective in the category of bundles of residuated lattices over $\mathscr{B}$ along with morphisms of bundles of residuated lattices. We provide a method for transferring an \'{e}tal\'{e} of residuated lattices over a topological space to another, utilizing a continuous map. Finally, we define a contravariant functor, called the section functor, from the category of \'{e}tal\'{e}s of residuated lattices with inverse morphisms to the category of residuated lattices.


title: Measuring Sharpness in Grokking

abstract: Neural networks sometimes exhibit grokking, a phenomenon where perfect or near-perfect performance is achieved on a validation set well after the same performance has been obtained on the corresponding training set. In this workshop paper, we introduce a robust technique for measuring grokking, based on fitting an appropriate functional form. We then use this to investigate the sharpness of transitions in training and validation accuracy under two settings. The first setting is the theoretical framework developed by Levi et al. (2023) where closed form expressions are readily accessible. The second setting is a two-layer MLP trained to predict the parity of bits, with grokking induced by the concealment strategy of Miller et al. (2023). We find that trends between relative grokking gap and grokking sharpness are similar in both settings when using absolute and relative measures of sharpness. Reflecting on this, we make progress toward explaining some trends and identify the need for further study to untangle the various mechanisms which influence the sharpness of grokking.


title: Switchable optical trapping based on Mie-resonant phase-change nanoparticles

abstract: Optical tweezers have revolutionized the manipulation of nanoscale objects, offering versatile control over trapped particles. Typically, the manipulation and trapping capabilities of optical tweezers rely on adjusting either the trapping laser beams or the optical environment surrounding the trapped nanoparticles. In our study, we present a novel approach to achieve tunable and switchable trapping using optical tweezers. We utilize nanoparticles made of a phase-change material (vanadium dioxide or VO$_2$), trapped by a focused Gaussian beam. By varying the intensity of the trapping beam, we can optically control the phase and optomechanical properties of the vanadium dioxide nanoparticles. At lower intensities, the nanoparticle remains in its monoclinic phase, and it is trapped by attractive optical forces. However, at higher intensities, the optical beam induces a phase transition in the nanoparticle to the rutile phase, which dramatically alters the optical forces, transforming them from attractive to repulsive, thereby pushing the nanoparticle away from the beam. Importantly, this effect is reversible, allowing the same particle to be attracted and repelled repeatedly. The observed phenomenon is governed by Mie resonances supported by the nanoparticle and their alterations during the phase transition of the VO$_2$ material. Our findings introduce a versatile new addition to the optical tweezers toolbox for optomechanical manipulation of nanoparticles.


title: Mean-Field Analysis for Learning Subspace-Sparse Polynomials with Gaussian Input

abstract: In this work, we study the mean-field flow for learning subspace-sparse polynomials using stochastic gradient descent and two-layer neural networks, where the input distribution is standard Gaussian and the output only depends on the projection of the input onto a low-dimensional subspace. We propose a basis-free generalization of the merged-staircase property in Abbe et al. (2022) and establish a necessary condition for the SGD-learnability. In addition, we prove that the condition is almost sufficient, in the sense that a condition slightly stronger than the necessary condition can guarantee the exponential decay of the loss functional to zero.


title: Unraveling the emergence of quantum state designs in systems with symmetry

abstract: Quantum state designs, by enabling an efficient sampling of random quantum states, play a quintessential role in devising and benchmarking various quantum protocols with broad applications ranging from circuit designs to black hole physics. Symmetries, on the other hand, are expected to reduce the randomness of a state. Despite being ubiquitous, the effects of symmetry on quantum state designs remain an outstanding question. The recently introduced projected ensemble framework generates efficient approximate state t-designs by hinging on projective measurements and many-body quantum chaos. In this work, we examine the emergence of state designs from the random generator states exhibiting symmetries. Leveraging on translation symmetry, we analytically establish a sufficient condition for the measurement basis leading to the state t-designs. Then, by making use of the trace distance measure, we numerically investigate the convergence to the designs. Subsequently, we inspect the violation of the sufficient condition to identify bases that fail to converge. We further demonstrate the emergence of state designs in a physical system by studying the dynamics of a chaotic tilted field Ising chain with periodic boundary conditions. We find faster convergence of the trace distance in the initial time, however, it saturates to a finite value deviating from random matrix prediction at a late time, in contrast to the case with open boundary condition. To delineate the general applicability of our results, we extend our analysis to other symmetries. We expect our findings to pave the way for further exploration of deep thermalization and equilibration of closed and open quantum many-body systems.

categories: quant-ph cond-mat.quant-gas cond-mat.stat-mech cond-mat.str-el hep-th


title: Taking GPU Programming Models to Task for Performance Portability

abstract: Portability is critical to ensuring high productivity in developing and maintaining scientific software as the diversity in on-node hardware architectures increases. While several programming models provide portability for diverse GPU platforms, they don't make any guarantees about performance portability. In this work, we explore several programming models -- CUDA, HIP, Kokkos, RAJA, OpenMP, OpenACC, and SYCL, to study if the performance of these models is consistently good across NVIDIA and AMD GPUs. We use five proxy applications from different scientific domains, create implementations where missing, and use them to present a comprehensive comparative evaluation of the programming models. We provide a Spack scripting-based methodology to ensure reproducibility of experiments conducted in this work. Finally, we attempt to answer the question -- to what extent does each programming model provide performance portability for heterogeneous systems in real-world usage?


title: Cosmology of unimodular Born-Infeld-$f(R)$ gravity

abstract: We propose a novel modified gravity: unimodular generalization of the Born-Infeld-$f(R)$ gravity within the framework of cosmology. After formulating the action corresponding to the generalized Born-Infeld-$f(R)$ gravity, we present a reconstruction scheme of this unimodular extension to achieve various cosmological eras of the universe. Interestingly, the unimodular generalization of Born-Infeld-$f(R)$ gravity proves to be suitable for inflation (de-Sitter and quasi de-Sitter) along with power law cosmology which actually includes from reheating to the Standard Big-Bang cosmology. Apart from the inflation, such generalized Born-Infeld-$f(R)$ theory is also capable to trigger non-singular bouncing cosmology for suitable forms of the unimodular Lagrange multiplier, which are exotic for the standard Einstein-Hilbert gravity and cannot be realized in that case. The possible consequences are discussed.


title: A two-stage solution to quantum process tomography: error analysis and optimal design

abstract: Quantum process tomography is a critical task for characterizing the dynamics of quantum systems and achieving precise quantum control. In this paper, we propose a two-stage solution for both trace-preserving and non-trace-preserving quantum process tomography. Utilizing a tensor structure, our algorithm exhibits a computational complexity of $O(MLd^2)$ where $d$ is the dimension of the quantum system and $ M $, $ L $ represent the numbers of different input states and measurement operators, respectively. We establish an analytical error upper bound and then design the optimal input states and the optimal measurement operators, which are both based on minimizing the error upper bound and maximizing the robustness characterized by the condition number. Numerical examples and testing on IBM quantum devices are presented to demonstrate the performance and efficiency of our algorithm.


title: Entropy Jump and Entropic Central Limit Theorem for Independent Sum

abstract: It is a manuscript for results about entropic central limit theorem for independent sum under finite Poincar\'e constant conditions.


title: HTML papers on arXiv -- why it is important, and how we made it happen

abstract: In October 2023, arXiv made HTML formatted papers available to readers. This was the exciting outcome of over a year of accessibility research and development with the scientific community. Currently, only 2.4% of research outputs meet accessibility guidelines. Informed by scientists who rely on assistive technology, our analysis demonstrates that offering HTML is the most impactful step arXiv can take. Scientists need HTML now, and emphasize to not let perfect be the enemy of good enough. In this paper we share with you how arXiv is achieving HTML conversions from LaTeX now, and our plans for future improvements.


title: Using Counterfactual Tasks to Evaluate the Generality of Analogical Reasoning in Large Language Models

abstract: Large language models (LLMs) have performed well on several reasoning benchmarks, including ones that test analogical reasoning abilities. However, it has been debated whether they are actually performing humanlike abstract reasoning or instead employing less general processes that rely on similarity to what has been seen in their training data. Here we investigate the generality of analogy-making abilities previously claimed for LLMs (Webb, Holyoak, & Lu, 2023). We take one set of analogy problems used to evaluate LLMs and create a set of "counterfactual" variants-versions that test the same abstract reasoning abilities but that are likely dissimilar from any pre-training data. We test humans and three GPT models on both the original and counterfactual problems, and show that, while the performance of humans remains high for all the problems, the GPT models' performance declines sharply on the counterfactual set. This work provides evidence that, despite previously reported successes of LLMs on analogical reasoning, these models lack the robustness and generality of human analogy-making.


title: Seagull: Privacy preserving network verification system

abstract: The current routing protocol used in the internet backbone is based on manual configuration, making it susceptible to errors. To mitigate these configuration-related issues, it becomes imperative to validate the accuracy and convergence of the algorithm, ensuring a seamless operation devoid of problems. However, the process of network verification faces challenges related to privacy and scalability. This paper addresses these challenges by introducing a novel approach: leveraging privacy-preserving computation, specifically multiparty computation (MPC), to verify the correctness of configurations in the internet backbone, governed by the BGP protocol. Not only does our proposed solution effectively address scalability concerns, but it also establishes a robust privacy framework. Through rigorous analysis, we demonstrate that our approach maintains privacy by not disclosing any information beyond the query result, thus providing a comprehensive and secure solution to the intricacies associated with routing protocol verification in large-scale networks.


title: MUSTARD: Mastering Uniform Synthesis of Theorem and Proof Data

abstract: Recent large language models (LLMs) have witnessed significant advancement in various tasks, including mathematical reasoning and theorem proving. As these two tasks require strict and formal multi-step inference, they are appealing domains for exploring the reasoning ability of LLMs but still face important challenges. Previous studies such as Chain-of-Thought (CoT) have revealed the effectiveness of intermediate steps guidance. However, such step-wise annotation requires heavy labor, leading to insufficient training steps for current benchmarks. To fill this gap, this work introduces MUSTARD, a data generation framework that masters uniform synthesis of theorem and proof data of high quality and diversity. MUSTARD synthesizes data in three stages: (1) It samples a few mathematical concept seeds as the problem category. (2) Then, it prompts a generative language model with the sampled concepts to obtain both the problems and their step-wise formal solutions. (3) Lastly, the framework utilizes a proof assistant (e.g., Lean Prover) to filter the valid proofs. With the proposed MUSTARD, we present a theorem-and-proof benchmark MUSTARDSAUCE with 5,866 valid data points. Each data point contains an informal statement, an informal proof, and a translated formal proof that passes the prover validation. We perform extensive analysis and demonstrate that MUSTARD generates validated high-quality step-by-step data. We further apply the MUSTARDSAUCE for fine-tuning smaller language models. The fine-tuned Llama 2-7B achieves a 15.41% average relative performance gain in automated theorem proving, and 8.18% in math word problems. Codes and data are available at https://github.com/Eleanor-H/MUSTARD.


title: Towards Next-Level Post-Training Quantization of Hyper-Scale Transformers

abstract: With the increasing complexity of generative AI models, post-training quantization (PTQ) has emerged as a promising solution for deploying hyper-scale models on edge devices such as mobile devices and TVs. Existing PTQ schemes, however, consume considerable time and resources, which could be a bottleneck in real situations where frequent model updates and multiple hyper-parameter tunings are required. As a cost-effective alternative, one-shot PTQ schemes have been proposed. Still, the performance is somewhat limited because they cannot consider the inter-layer dependency within the attention module, which is a very important feature of Transformers. In this paper, we thus propose a novel PTQ algorithm that balances accuracy and efficiency. The key idea of the proposed algorithm called aespa is to perform quantization layer-wise for efficiency while considering cross-layer dependency to preserve the attention score. Through extensive experiments on various language models and complexity analysis, we demonstrate that aespa is accurate and efficient in quantizing Transformer models.


title: Quasi-Akaike information criterion of structural equation modeling with latent variables for diffusion processes

abstract: We consider a model selection problem for structural equation modeling (SEM) with latent variables for diffusion processes based on high-frequency data. First, we propose the quasi-Akaike information criterion of the SEM and study the asymptotic properties. Next, we consider the situation where the set of competing models includes some misspecified parametric models. It is shown that the probability of choosing the misspecified models converges to zero. Furthermore, examples and simulation results are given.


title: Open-Vocabulary Segmentation with Unpaired Mask-Text Supervision

abstract: Current state-of-the-art open-vocabulary segmentation methods typically rely on image-mask-text triplet annotations for supervision. However, acquiring such detailed annotations is labour-intensive and poses scalability challenges in complex real-world scenarios. While existing weakly-supervised approaches leverage image-text pairs to reduce the expansive annotation cost, the lack of mask supervision makes it difficult for the model to locate multiple instances and accurately group pixels with similar semantics, significantly hampering versatility and performance. In this paper, we introduce Unpair-Seg, a novel weakly-supervised open-vocabulary segmentation framework that learns from unpaired image-mask and image-text pairs, which can be independently and efficiently collected. Unpair-Seg initially predicts a set of binary masks and generates pseudo labels by identifying confident pairs of masks and text entities. We then train a feature adapter to align region embeddings with text embeddings based on these pseudo labels, achieving open-vocabulary segmentation. However, the inherent noise in the mask-entity correspondence poses a challenge to obtaining reliable pairs. To address this, we employ a vision-language large model to re-caption the input images and extract precise entities, and we design a multi-scale matching strategy to reduce noisy mask-entity pairs. Our Unpair-Seg framework demonstrates impressive performance, achieving 14.6\% and 19.5\% mIoU on the ADE-847 and PASCAL Context-459 datasets, significantly narrowing the gap between fully-supervised and weakly-supervised methods.


title: HyCubE: Efficient Knowledge Hypergraph 3D Circular Convolutional Embedding

abstract: Knowledge hypergraph embedding models are usually computationally expensive due to the inherent complex semantic information. However, existing works mainly focus on improving the effectiveness of knowledge hypergraph embedding, making the model architecture more complex and redundant. It is desirable and challenging for knowledge hypergraph embedding to reach a trade-off between model effectiveness and efficiency. In this paper, we propose an end-to-end efficient n-ary knowledge hypergraph embedding model, HyCubE, which designs a novel 3D circular convolutional neural network and the alternate mask stack strategy to enhance the interaction and extraction of feature information comprehensively. Furthermore, our proposed model achieves a better trade-off between effectiveness and efficiency by adaptively adjusting the 3D circular convolutional layer structure to handle different arity knowledge hypergraphs with fewer parameters. In addition, we use 1-N multilinear scoring based on the entity mask mechanism to further accelerate the model training efficiency. Finally, extensive experimental results on all datasets demonstrate that our proposed model consistently outperforms state-of-the-art baselines, with an average improvement of 7.30%-9.53% and a maximum improvement of 33.82% across all metrics. Meanwhile, HyCubE is 4.12x faster, GPU memory usage is 52.19% lower, and the number of parameters is reduced by 85.21% compared with the average metric of the latest state-of-the-art baselines.


title: The Cohen-Macaulay property of invariant rings over ring of integers of a global field

abstract: Let $A$ be the ring of integers of global field $K$. Let $G \subseteq GL_2(A)$ be a finite group. Let $G$ act linearly on $R = A[X,Y]$ (fixing $A$). Let $R^G$ be the ring of invariants. In the equi-characteristic case we prove $R^G$ is Cohen-Macaulay. In mixed characteristic case we prove that if for all primes $p$ dividing $|G|$ the Sylow $p$-subgroup of $G$ has exponent $p$ then $R^G$ is Cohen-Macaulay. We prove a similar case if for all primes $p$ dividing $|G|$ the prime $p$ is un-ramified in $K$.


title: DUEL: Duplicate Elimination on Active Memory for Self-Supervised Class-Imbalanced Learning

abstract: Recent machine learning algorithms have been developed using well-curated datasets, which often require substantial cost and resources. On the other hand, the direct use of raw data often leads to overfitting towards frequently occurring class information. To address class imbalances cost-efficiently, we propose an active data filtering process during self-supervised pre-training in our novel framework, Duplicate Elimination (DUEL). This framework integrates an active memory inspired by human working memory and introduces distinctiveness information, which measures the diversity of the data in the memory, to optimize both the feature extractor and the memory. The DUEL policy, which replaces the most duplicated data with new samples, aims to enhance the distinctiveness information in the memory and thereby mitigate class imbalances. We validate the effectiveness of the DUEL framework in class-imbalanced environments, demonstrating its robustness and providing reliable results in downstream tasks. We also analyze the role of the DUEL policy in the training process through various metrics and visualizations.


title: Predicting User Experience on Laptops from Hardware Specifications

abstract: Estimating the overall user experience (UX) on a device is a common challenge faced by manufacturers. Today, device makers primarily rely on microbenchmark scores, such as Geekbench, that stress test specific hardware components, such as CPU or RAM, but do not satisfactorily capture consumer workloads. System designers often rely on domain-specific heuristics and extensive testing of prototypes to reach a desired UX goal, and yet there is often a mismatch between the manufacturers' performance claims and the consumers' experience. We present our initial results on predicting real-life experience on laptops from their hardware specifications. We target web applications that run on Chromebooks (ChromeOS laptops) for a simple and fair aggregation of experience across applications and workloads. On 54 laptops, we track 9 UX metrics on common end-user workloads: web browsing, video playback and audio/video calls. We focus on a subset of high-level metrics exposed by the Chrome browser, that are part of the Web Vitals initiative for judging the UX on web applications. With a dataset of 100K UX data points, we train gradient boosted regression trees that predict the metric values from device specifications. Across our 9 metrics, we note a mean $R^2$ score (goodness-of-fit on our dataset) of 97.8% and a mean MAAPE (percentage error in prediction on unseen data) of 10.1%.


title: Dynamical 4-D Gauss-Bonnet action from matter-graviton interaction at one-loop

abstract: The occurrence of singularities at the centers of black holes suggests that general relativity (GR), although a highly successful model of gravity and cosmology, is inapplicable. This is due to the breakdown of the equivalence principle. Gauss-Bonnet (GB) action is a simplest extension of GR as it possess second-order equations of motion and is devoid of ghosts. However, in 4-D, the GB action is topological. Recently, Glavan and Lin proposed a mathematical framework that transforms the 4-D GB gravity theory into a non-topological one. However, it has been argued that without a canonical way to choose 4-D from the higher-dimensional space, such a GB gravity is not well-defined in 4-D. The current work takes a step in addressing this issue by demonstrating that the rescaling of the GB coupling $\alpha \rightarrow \alpha/(D - 4)$ arises from the self-energy correction of gravitons in 4-D via \emph{the dimensional regularization}. To keep things transparent, we focus on the linearized theory of gravity coupled with matter fields. By computing the one-loop self-energy correction of gravitons induced by the matter fields, we explicitly provide the origin of the prescription provided by Glavan and Lin. Our work naturally opens a new window to considering 4-D Einstein Gauss-Bonnet gravity as the most straightforward modification to GR.


title: Pretraining Vision-Language Model for Difference Visual Question Answering in Longitudinal Chest X-rays

abstract: Difference visual question answering (diff-VQA) is a challenging task that requires answering complex questions based on differences between a pair of images. This task is particularly important in reading chest X-ray images because radiologists often compare multiple images of the same patient taken at different times to track disease progression and changes in its severity in their clinical practice. However, previous works focused on designing specific network architectures for the diff-VQA task, missing opportunities to enhance the model's performance using a pretrained vision-language model (VLM). Here, we introduce a novel VLM called PLURAL, which is pretrained on natural and longitudinal chest X-ray data for the diff-VQA task. The model is developed using a step-by-step approach, starting with being pretrained on natural images and texts, followed by being trained using longitudinal chest X-ray data. The longitudinal data consist of pairs of X-ray images, along with question-answer sets and radiologist's reports that describe the changes in lung abnormalities and diseases over time. Our experimental results show that the PLURAL model outperforms state-of-the-art methods not only in diff-VQA for longitudinal X-rays but also in conventional VQA for a single X-ray image. Through extensive experiments, we demonstrate the effectiveness of the proposed VLM architecture and pretraining method in improving the model's performance.


title: Generative AI for Pull Request Descriptions: Adoption, Impact, and Developer Interventions

abstract: GitHub's Copilot for Pull Requests (PRs) is a promising service aiming to automate various developer tasks related to PRs, such as generating summaries of changes or providing complete walkthroughs with links to the relevant code. As this innovative technology gains traction in the Open Source Software (OSS) community, it is crucial to examine its early adoption and its impact on the development process. Additionally, it offers a unique opportunity to observe how developers respond when they disagree with the generated content. In our study, we employ a mixed-methods approach, blending quantitative analysis with qualitative insights, to examine 18,256 PRs in which parts of the descriptions were crafted by generative AI. Our findings indicate that: (1) Copilot for PRs, though in its infancy, is seeing a marked uptick in adoption. (2) PRs enhanced by Copilot for PRs require less review time and have a higher likelihood of being merged. (3) Developers using Copilot for PRs often complement the automated descriptions with their manual input. These results offer valuable insights into the growing integration of generative AI in software development.


title: GrounDial: Human-norm Grounded Safe Dialog Response Generation

abstract: Current conversational AI systems based on large language models (LLMs) are known to generate unsafe responses, agreeing to offensive user input or including toxic content. Previous research aimed to alleviate the toxicity, by fine-tuning LLM with manually annotated safe dialogue histories. However, the dependency on additional tuning requires substantial costs. To remove the dependency, we propose GrounDial, where response safety is achieved by grounding responses to commonsense social rules without requiring fine-tuning. A hybrid approach of in-context learning and human-norm-guided decoding of GrounDial enables the response to be quantitatively and qualitatively safer even without additional data or tuning.


title: Hamiltonian input model and spectroscopy on quantum computers

abstract: We present a novel input model for general second-quantized Hamiltonians of relativistic or non-relativistic many-fermion systems. This input model incorporates the fermionic anticommutation relations, particle number variations, and respects the symmetries of the Hamiltonian. Based on our input model, we propose a hybrid framework for spectral calculations on future quantum hardwares. We provide explicit circuit designs and the associated gate cost and circuit depth. We demonstrate our framework by solving the low-lying spectra of ${^{42}}Ca$ and ${^{46}}Ca$. Our input model provides new pathways to solving the spectra and time evolutions of the relativistic and nonrelativistic many-fermion systems.


title: A remark on "A non-singular dynamical system without maximal ergodic inequality" by E. H. El Abdalaoui"

abstract: In this note we would like to correct a comment made by E.H. El Abdaloui about my work [arXiv:1312:5270].


title: Structured Language Generation Model for Robust Structure Prediction

abstract: Previous work in structured prediction (e.g. NER, information extraction) using single model make use of explicit dataset information, which helps boost in-distribution performance but is orthogonal to robust generalization in real-world situations. To overcome this limitation, we propose the Structured Language Generation Model (SLGM), a framework that reduces sequence-to-sequence problems to classification problems via methodologies in loss calibration and decoding method. Our experimental results show that SLGM is able to maintain performance without explicit dataset information, follow and potentially replace dataset-specific fine-tuning.


title: A class of weighted composition operators whose Range and Null spaces are complemented

abstract: In this paper, we prove that the null space of a weighted composition operator on $\ell_p~ (1 \leq p < \infty)$ is a complemented subspace. We also give a necessary and sufficient condition for a weighted composition operator on $\ell_p$ whose range space is of finite co-dimension. Thereafter, we characterize a class of weighted composition operators whose range space is a complemented subspace. Lastly, we characterize weighted composition operators on $\ell_p$ which are Fredholm operators.


title: Convergence rate and exponential stability of backward Euler method for neutral stochastic delay differential equations under generalized monotonicity conditions

abstract: This work focuses on the numerical approximations of neutral stochastic delay differential equations with their drift and diffusion coefficients growing super-linearly with respect to both delay variables and state variables. Under generalized monotonicity conditions, we prove that the backward Euler method not only converges strongly in the mean square sense with order $1/2$, but also inherit the mean square exponential stability of the original equations. As a byproduct, we obtain the same results on convergence rate and exponential stability of the backward Euler method for stochastic delay differential equations with generalized monotonicity conditions. These theoretical results are finally supported by several numerical experiments.


title: Examining the Unique Online Risk Experiences and Mental Health Outcomes of LGBTQ+ versus Heterosexual Youth

abstract: We collected and analyzed Instagram direct messages (DMs) from 173 youth aged 13-21 (including 86 LGBTQ+ youth). We examined youth's risk-flagged social media trace data with their self-reported mental health outcomes to examine how the differing online experiences of LGBTQ+ youth compare with their heterosexual counterparts. We found that LGBTQ+ youth experienced significantly more high-risk online interactions compared to heterosexual youth. LGBTQ+ youth reported overall poorer mental health, with online harassment specifically amplifying Self-Harm and Injury. LGBTQ+ youth's mental well-being linked positively to sexual messages, unlike heterosexual youth. Qualitatively, we found that most of the risk-flagged messages of LGBTQ+ youth were sexually motivated; however, a silver lining was that they sought support for their sexual identity from peers on the platform. The study highlights the importance of tailored online safety and inclusive design for LGBTQ+ youth, with implications for CHI community advancements in fostering a supportive online environments.