title: Systematic equation formulation for simulation of power electronic circuits using explicit methods

abstract: Use of explicit integration methods for power electronic circuits with ideal switch models significantly improves simulation speed. The PLECS package [1] has effectively used this idea; however, the implementation details involved in PLECS are not available in the public domain. Recently, a basic framework, called the ``ELEX" scheme, for implementing explicit methods has been described [2]. A few modifications of the ELEX scheme for efficient handling of inductors and switches have been presented in [3]. In this paper, the approach presented in [3] is further augmented with robust schemes that enable systematic equation formulation for circuits involving switches, inductors, and transformers. Several examples are presented to illustrate the proposed schemes.


title: Scaling of the Quantum Geometry Metrics in Disordered Topological Phases

abstract: We report a study of disorder-dependent quantum geometry in topological systems. Thanks to the development of an efficient linear-scaling numerical methodology based on the kernel polynomial method, we can explore the nontrivial behavior of the quantum geometry metrics (quantum metric and Chern number) in large-scale inhomogeneous systems, accounting for the presence of disorder. We illustrate this approach in the disordered Haldane model, examining the impact of Anderson and vacancy-type of disorders on the trivial and topological phases captured by this model.


title: Contraction rates for conjugate gradient and Lanczos approximate posteriors in Gaussian process regression

abstract: Due to their flexibility and theoretical tractability Gaussian process (GP) regression models have become a central topic in modern statistics and machine learning. While the true posterior in these models is given explicitly, numerical evaluations depend on the inversion of the augmented kernel matrix $ K + \sigma^2 I $, which requires up to $ O(n^3) $ operations. For large sample sizes n, which are typically given in modern applications, this is computationally infeasible and necessitates the use of an approximate version of the posterior. Although such methods are widely used in practice, they typically have very limtied theoretical underpinning. In this context, we analyze a class of recently proposed approximation algorithms from the field of Probabilistic numerics. They can be interpreted in terms of Lanczos approximate eigenvectors of the kernel matrix or a conjugate gradient approximation of the posterior mean, which are particularly advantageous in truly large scale applications, as they are fundamentally only based on matrix vector multiplications amenable to the GPU acceleration of modern software frameworks. We combine result from the numerical analysis literature with state of the art concentration results for spectra of kernel matrices to obtain minimax contraction rates. Our theoretical findings are illustrated by numerical experiments.


title: Vernacular? I Barely Know Her: Challenges with Style Control and Stereotyping

abstract: Large Language Models (LLMs) are increasingly being used in educational and learning applications. Research has demonstrated that controlling for style, to fit the needs of the learner, fosters increased understanding, promotes inclusion, and helps with knowledge distillation. To understand the capabilities and limitations of contemporary LLMs in style control, we evaluated five state-of-the-art models: GPT-3.5, GPT-4, GPT-4o, Llama-3, and Mistral-instruct- 7B across two style control tasks. We observed significant inconsistencies in the first task, with model performances averaging between 5th and 8th grade reading levels for tasks intended for first-graders, and standard deviations up to 27.6. For our second task, we observed a statistically significant improvement in performance from 0.02 to 0.26. However, we find that even without stereotypes in reference texts, LLMs often generated culturally insensitive content during their tasks. We provide a thorough analysis and discussion of the results.


title: Measuring Psychological Depth in Language Models

abstract: Evaluations of creative stories generated by large language models (LLMs) often focus on objective properties of the text, such as its style, coherence, and toxicity. While these metrics are indispensable, they do not speak to a story's subjective, psychological impact from a reader's perspective. We introduce the Psychological Depth Scale (PDS), a novel framework rooted in literary theory that measures an LLM's ability to produce authentic and narratively complex stories that provoke emotion, empathy, and engagement. We empirically validate our framework by showing that humans can consistently evaluate stories based on PDS (0.72 Krippendorff's alpha). We also explore techniques for automating the PDS to easily scale future analyses. GPT-4o, combined with a novel Mixture-of-Personas (MoP) prompting strategy, achieves an average Spearman correlation of $0.51$ with human judgment while Llama-3-70B scores as high as 0.68 for empathy. Finally, we compared the depth of stories authored by both humans and LLMs. Surprisingly, GPT-4 stories either surpassed or were statistically indistinguishable from highly-rated human-written stories sourced from Reddit. By shifting the focus from text to reader, the Psychological Depth Scale is a validated, automated, and systematic means of measuring the capacity of LLMs to connect with humans through the stories they tell.


title: Using operator covariance to disentangle scaling dimensions in lattice models

abstract: In critical lattice models, distance ($r$) dependent correlation functions contain power laws $r^{-2\Delta}$ governed by scaling dimensions $\Delta$ of an underlying continuum field theory. In Monte Carlo simulations and other numerical approaches, the leading dimensions can be extracted by data fitting, which can be difficult when two or more powers contribute significantly. Here a method utilizing covariance between multiple lattice operators is developed where the $r$ dependent eigenvalues of the covariance matrix represent scaling dimensions of individual field operators. The scheme is tested on symmetric operators in the two-dimensional tricritical Blume-Capel model, where the two relevant dimensions, as well as some irrelevant ones, are isolated along with their corresponding eigenvectors. The method will be broadly useful in studies of classical and quantum models at multicritical points and for targeting irrelevant operators at simple critical (or multicritical) points.


title: The Impact of Stellar Radiative Feedback on Formation of Young Massive Clusters via Fast HI Gas Collisions

abstract: Young massive clusters (YMCs) are dense aggregates of young stars and are often speculated as potential precursors to globular clusters. However, the formation mechanism of massive and compact gas clumps that precede YMCs remains unknown. In this paper, we study the formation of such massive clumps via fast HI gas collisions (~100 km/s) as suggested by recent observations and their subsequent evolution into YMCs by using three-dimensional magnetohydrodynamics simulations involving self-gravity and detailed thermal/chemical processes. In particular, the impact of ionization feedback from stellar radiation is included in an approximate fashion where the temperature within the HII regions is elevated to 10,000 K, while supernova feedback is not included. We examine whether the resulting massive clumps can survive this ionization feedback and evolve into YMCs. Our simulations reveal the emergence of gas clumps that do not only possess substantial mass (~10^5 M_sun) but also sufficient compactness (~5 pc). Notably, these clumps exhibit significantly higher escape velocities compared to the sound speed of the HII region, indicating effective gravitational retention of gas against feedback-induced evaporation. Consequently, these conditions foster efficient star formation within the massive gas clumps, ultimately leading to their evolution into YMCs. We also perform simulations involving lower-velocity gas collisions, approximately 15 km/s, typical shock velocities induced by galactic superbubbles.


title: Spatial Sequence Attention Network for Schizophrenia Classification from Structural Brain MR Images

abstract: Schizophrenia is a debilitating, chronic mental disorder that significantly impacts an individual's cognitive abilities, behavior, and social interactions. It is characterized by subtle morphological changes in the brain, particularly in the gray matter. These changes are often imperceptible through manual observation, demanding an automated approach to diagnosis. This study introduces a deep learning methodology for the classification of individuals with Schizophrenia. We achieve this by implementing a diversified attention mechanism known as Spatial Sequence Attention (SSA) which is designed to extract and emphasize significant feature representations from structural MRI (sMRI). Initially, we employ the transfer learning paradigm by leveraging pre-trained DenseNet to extract initial feature maps from the final convolutional block which contains morphological alterations associated with Schizophrenia. These features are further processed by the proposed SSA to capture and emphasize intricate spatial interactions and relationships across volumes within the brain. Our experimental studies conducted on a clinical dataset have revealed that the proposed attention mechanism outperforms the existing Squeeze & Excitation Network for Schizophrenia classification.


title: A JWST project on 47 Tucanae. NIRSpec spectroscopy of multiple populations among M dwarfs

abstract: We present the first spectroscopic estimates of the chemical abundance of M dwarf stars in a globular cluster (GC), namely 47 Tucanae. By exploiting NIRSpec on board the James Webb Space Telescope (JWST) we gathered low-resolution spectra for 28 stars with masses in the range ~0.4-0.5 solar masses. The spectra are strongly affected by the H2O water vapour bands which can be used as indicators of the oxygen abundance. The spectral analysis reveals that the target stars feature a different O abundance, with a difference of ~0.40 dex between first and the most-polluted second population. The observed range is similar to that observed among red giant stars. This result reinforces previous findings based on the analysis of photometric diagrams, including the ``chromosome maps'', providing a first, and more direct, evidence of light element variations in the M dwarfs' mass regime. The observation that the multiple populations, with their variations in light elements, exhibit the same patterns from the lower main sequence all the way to the red giant branch further strengthens the notion that multiple stellar populations in globular clusters formed in a series of bursts of star formation.


title: Eigenfunction Expansion and the Decomposition of Jacobi Operators on $\mathbb{Z}$

abstract: Let $J$ be a Jacobi operator on $\ell^2\left(\mathbb{Z}\right)$. We prove an eigenfunction expansion theorem for the singular part of $J$ using subordinate solutions to the eigenvalue equation. We exploit this theorem in order to show that $J$ can be decomposed as a direct integral of half-line operators.


title: Dynamical traceback age of the Octans young stellar association

abstract: Octans is one of the most distant ($d\sim150$pc) young stellar associations of the solar neighbourhood. Its age is still poorly constrained in the literature and requires further investigation. We take advantage of the state-of-the-art astrometry delivered by the third data release of the Gaia space mission combined with radial velocity measurements obtained from high-resolution spectroscopy to compute the 3D positions and 3D spatial velocities of the stars and derive the dynamical traceback age of the association. We performed an extensive traceback analysis using different subsamples of stars, different metrics to define the size of the association, and different models for the Galactic potential to integrate the stellar orbits in the past. We derive a dynamical age of $34^{+2}_{-2}$Myr that is independent from stellar models and represents the most precise age estimate currently available for the Octans association. After correcting the radial velocity of the stars for the effect of gravitational redshift, we obtain a dynamical age of $33^{+3}_{-1}$Myr, which is in very good agreement with our first solution. This shows that the effect of gravitational redshift is small for such a distant young stellar association. Our result is also consistent with the less accurate age estimates obtained in previous studies from lithium depletion (30-40Myr) and isochrones (20-30Myr). By integrating the stellar orbits in time, we show that the members of Octans and Octans-Near had different locations in the past, which indicates that the two associations are unrelated despite the close proximity in the sky. Our results confirm that it is possible to derive precise dynamical ages via the traceback method for $\sim30$Myr old stellar clusters at about $\sim150$pc with the same precision level that has been achieved in other studies for young stellar groups within 50pc of the Sun.


title: Using LLMs to Aid Annotation and Collection of Clinically-Enriched Data in Bipolar Disorder and Schizophrenia

abstract: NLP in mental health has been primarily social media focused. Real world practitioners also have high case loads and often domain specific variables, of which modern LLMs lack context. We take a dataset made by recruiting 644 participants, including individuals diagnosed with Bipolar Disorder (BD), Schizophrenia (SZ), and Healthy Controls (HC). Participants undertook tasks derived from a standardized mental health instrument, and the resulting data were transcribed and annotated by experts across five clinical variables. This paper demonstrates the application of contemporary language models in sequence-to-sequence tasks to enhance mental health research. Specifically, we illustrate how these models can facilitate the deployment of mental health instruments, data collection, and data annotation with high accuracy and scalability. We show that small models are capable of annotation for domain-specific clinical variables, data collection for mental-health instruments, and perform better then commercial large models.


title: Speak in the Scene: Diffusion-based Acoustic Scene Transfer toward Immersive Speech Generation

abstract: This paper introduces a novel task in generative speech processing, Acoustic Scene Transfer (AST), which aims to transfer acoustic scenes of speech signals to diverse environments. AST promises an immersive experience in speech perception by adapting the acoustic scene behind speech signals to desired environments. We propose AST-LDM for the AST task, which generates speech signals accompanied by the target acoustic scene of the reference prompt. Specifically, AST-LDM is a latent diffusion model conditioned by CLAP embeddings that describe target acoustic scenes in either audio or text modalities. The contributions of this paper include introducing the AST task and implementing its baseline model. For AST-LDM, we emphasize its core framework, which is to preserve the input speech and generate audio consistently with both the given speech and the target acoustic environment. Experiments, including objective and subjective tests, validate the feasibility and efficacy of our approach.


title: The contact process on dynamical random trees with degree dependence

abstract: The contact process is a simple model for the spread of an infection in a structured population. We investigate the case when the underlying structure evolves dynamically as a degree-dependent dynamical percolation model. Starting with a connected locally finite base graph we initially declare edges independently open with a probability that is allowed to depend on the degree of the adjacent vertices and closed otherwise. Edges are independently updated with a rate depending on the degrees and then are again declared open and closed with the same probabilities. We are interested in the contact process, where infections are only allowed to spread via open edges. Our aim is to analyze the impact of the update speed and the probability for edges to be open on the existence of a phase transition. For a general connected locally finite graph, our first result gives sufficient conditions for the critical value for survival to be strictly positive. Furthermore, in the setting of Bienaym\'e-Galton-Watson trees, we show that the process survives strongly with positive probability for any infection rate if the offspring distribution has a stretched exponential tail with an exponent depending on the percolation probability and the update speed. In particular, if the offspring distribution follows a power law and the connection probability is given by a product kernel and the update speed exhibits polynomial behaviour, we provide a complete characterisation of the phase transition.


title: Dielectric relaxation in the quantum multiferroics Rb$_2$Cu$_2$Mo$_3$O$_{12}$ and Cs$_2$Cu$_2$Mo$_3$O$_{12}$

abstract: Motivated by the recent discovery of dielectric relaxation by quantum critical magnons in Cs$_2$Cu$_2$Mo$_3$O$_{12}$, we conduct a detailed analysis of its dielectric response and compare it to that in the isostructural compound Rb$_2$Cu$_2$Mo$_3$O$_{12}$. Measurements in the vicinity of the field-induced magnon softening show that its description in terms of 3D Bose-Einstein condensation of magnons quantum critical point is unaltered by the presence of dielectric relaxation. We also demonstrate the existence of dielectric relaxation anomalies at 19 K in Rb$_2$Cu$_2$Mo$_3$O$_{12}$ and discuss the implications for the microscopic origin of dielectric activity in two compounds.


title: High energy scattering in the Unitary Toy Model

abstract: We continue exploring the Unitary Toy Model (UTM) as a playground for high energy collisions in QCD. Our new approach is based on the diagonalization of the evolution Hamiltonian. Part of the spectrum can be identified with intercepts of dressed Pomerons. Analogously to QCD, a multi-Pomeron expansion of the $S$-matrix is badly divergent asymptotic series. Yet we succeeded to establish resummation procedures resulting in a well behaved $S$-matrix. In addition the Hamiltonian possesses negative eigenvalues, which dominate the approach of the $S$-matrix to saturation. We are hopeful that important lessons about BFKL-based Pomeron calculus could be taken from the toy world to real QCD.


title: MAGIC: Generating Self-Correction Guideline for In-Context Text-to-SQL

abstract: Self-correction in text-to-SQL is the process of prompting large language model (LLM) to revise its previously incorrectly generated SQL, and commonly relies on manually crafted self-correction guidelines by human experts that are not only labor-intensive to produce but also limited by the human ability in identifying all potential error patterns in LLM responses. We introduce MAGIC, a novel multi-agent method that automates the creation of the self-correction guideline. MAGIC uses three specialized agents: a manager, a correction, and a feedback agent. These agents collaborate on the failures of an LLM-based method on the training set to iteratively generate and refine a self-correction guideline tailored to LLM mistakes, mirroring human processes but without human involvement. Our extensive experiments show that MAGIC's guideline outperforms expert human's created ones. We empirically find out that the guideline produced by MAGIC enhance the interpretability of the corrections made, providing insights in analyzing the reason behind the failures and successes of LLMs in self-correction. We make all agent interactions publicly available to the research community, to foster further research in this area, offering a synthetic dataset for future explorations into automatic self-correction guideline generation.


title: XXLTraffic: Expanding and Extremely Long Traffic Dataset for Ultra-Dynamic Forecasting Challenges

abstract: Traffic forecasting is crucial for smart cities and intelligent transportation initiatives, where deep learning has made significant progress in modeling complex spatio-temporal patterns in recent years. However, current public datasets have limitations in reflecting the ultra-dynamic nature of real-world scenarios, characterized by continuously evolving infrastructures, varying temporal distributions, and temporal gaps due to sensor downtimes or changes in traffic patterns. These limitations inevitably restrict the practical applicability of existing traffic forecasting datasets. To bridge this gap, we present XXLTraffic, the largest available public traffic dataset with the longest timespan and increasing number of sensor nodes over the multiple years observed in the data, curated to support research in ultra-dynamic forecasting. Our benchmark includes both typical time-series forecasting settings with hourly and daily aggregated data and novel configurations that introduce gaps and down-sample the training size to better simulate practical constraints. We anticipate the new XXLTraffic will provide a fresh perspective for the time-series and traffic forecasting communities. It would also offer a robust platform for developing and evaluating models designed to tackle ultra-dynamic and extremely long forecasting problems. Our dataset supplements existing spatio-temporal data resources and leads to new research directions in this domain.


title: Computing the Bandwidth of Meager Timed Automata

abstract: The bandwidth of timed automata characterizes the quantity of information produced/transmitted per time unit. We previously delimited 3 classes of TA according to the nature of their asymptotic bandwidth: meager, normal, and obese. In this paper, we propose a method, based on a finite-state simply-timed abstraction, to compute the actual value of the bandwidth of meager automata. The states of this abstraction correspond to barycenters of the faces of the simplices in the region automaton. Then the bandwidth is $\log 1/|z_0|$ where $z_0$ is the smallest root (in modulus) of the characteristic polynomial of this finite-state abstraction.


title: Integrability of open boundary driven quantum circuits

abstract: In this paper, we address the problem of Yang-Baxter integrability of doubled quantum circuit of qubits (spins 1/2) with open boundary conditions where the two circuit replicas are only coupled at the left or right boundary. We investigate the cases where the bulk is given by elementary six vertex unitary gates of either the free fermionic XX type or interacting XXZ type. By using the Sklyanin's construction of reflection algebra, we obtain the most general solutions of the boundary Yang-Baxter equation for such a setup. We use this solution to build, from the transfer matrix formalism, integrable circuits with two step discrete time Floquet (aka brickwork) dynamics. We prove that, only if the bulk is a free-model, the boundary matrices are in general non-factorizable, and for particular choice of free parameters yield non-trivial unitary dynamics with boundary interaction between the two chains. Then, we consider the limit of continuous time evolution and we give the interpretation of a restricted set of the boundary terms in the Lindbladian setting. Specifically, for a particular choice of free parameters, the solutions correspond to an open quantum system dynamics with the source terms representing injecting or removing particles from the boundary of the spin chain.

categories: quant-ph cond-mat.stat-mech math-ph math.MP nlin.SI


title: Ultrasmall CsPbBr3 Blue Emissive Perovskite Quantum Dots using K-alloyed Cs4PbBr6 Nanocrystals as Precursors

abstract: We report a colloidal synthesis of blue emissive, stable cube-shaped CsPbBr3 quantum dots (QDs) in the strong quantum confinement regime via a dissolution-recrystallization starting from pre-synthesized (KxCs1-x)4PbBr6 nanocrystals which are then reacted with PbBr2. This is markedly different from the known case of Cs4PbBr6 nanocrystals that react within seconds with PbBr2 and get transformed into much larger, green emitting CsPbBr3 nanocrystals. Here, instead, the conversion of (KxCs1-x)4PbBr6 nanocrystals to CsPbBr3 QDs occurs in a time span of hours, and tuning of the QDs size is achieved by adjusting the concentration of precursors. The QDs exhibit excitonic features in optical absorption that are tunable in the 420 - 452 nm range, accompanied by blue photoluminescence with quantum yield around 60%. Detailed spectroscopic investigations in both the single and multi-exciton regime reveal the exciton fine structure and the effect of Auger recombination of these CsPbBr3 QDs, confirming theoretical predictions for this system.


title: The small boundary property in products

abstract: For a continuous action $G\curvearrowright X$ of a countable group on a compact metrizable space we show that the following are equivalent: (i) the action $G\curvearrowright X$ has the small boundary property and no finite orbits, (ii) for every continuous action $H\curvearrowright Y$ of a countable group on a compact metrizable space, the product action $G\times H\curvearrowright X\times Y$ has the small boundary property. In particular, (ii) is automatic when $G$ is infinite and the action $G\curvearrowright X$ is minimal and has the small boundary property. The argument relies on a small boundary version of the Urysohn lemma.


title: Online-Adaptive Anomaly Detection for Defect Identification in Aircraft Assembly

abstract: Anomaly detection deals with detecting deviations from established patterns within data. It has various applications like autonomous driving, predictive maintenance, and medical diagnosis. To improve anomaly detection accuracy, transfer learning can be applied to large, pre-trained models and adapt them to the specific application context. In this paper, we propose a novel framework for online-adaptive anomaly detection using transfer learning. The approach adapts to different environments by selecting visually similar training images and online fitting a normality model to EfficientNet features extracted from the training subset. Anomaly detection is then performed by computing the Mahalanobis distance between the normality model and the test image features. Different similarity measures (SIFT/FLANN, Cosine) and normality models (MVG, OCSVM) are employed and compared with each other. We evaluate the approach on different anomaly detection benchmarks and data collected in controlled laboratory settings. Experimental results showcase a detection accuracy exceeding 0.975, outperforming the state-of-the-art ET-NET approach.


title: Bridging the Gap: Integrating Pre-trained Speech Enhancement and Recognition Models for Robust Speech Recognition

abstract: Noise robustness is critical when applying automatic speech recognition (ASR) in real-world scenarios. One solution involves the used of speech enhancement (SE) models as the front end of ASR. However, neural network-based (NN-based) SE often introduces artifacts into the enhanced signals and harms ASR performance, particularly when SE and ASR are independently trained. Therefore, this study introduces a simple yet effective SE post-processing technique to address the gap between various pre-trained SE and ASR models. A bridge module, which is a lightweight NN, is proposed to evaluate the signal-level information of the speech signal. Subsequently, using the signal-level information, the observation addition technique is applied to effectively reduce the shortcomings of SE. The experimental results demonstrate the success of our method in integrating diverse pre-trained SE and ASR models, considerably boosting the ASR robustness. Crucially, no prior knowledge of the ASR or speech contents is required during the training or inference stages. Moreover, the effectiveness of this approach extends to different datasets without necessitating the fine-tuning of the bridge module, ensuring efficiency and improved generalization.


title: SUPER: Selfie Undistortion and Head Pose Editing with Identity Preservation

abstract: Self-portraits captured from a short distance might look unnatural or even unattractive due to heavy distortions making facial features malformed, and ill-placed head poses. In this paper, we propose SUPER, a novel method of eliminating distortions and adjusting head pose in a close-up face crop. We perform 3D GAN inversion for a facial image by optimizing camera parameters and face latent code, which gives a generated image. Besides, we estimate depth from the obtained latent code, create a depth-induced 3D mesh, and render it with updated camera parameters to obtain a warped portrait. Finally, we apply the visibility-based blending so that visible regions are reprojected, and occluded parts are restored with a generative model. Experiments on face undistortion benchmarks and on our self-collected Head Rotation dataset (HeRo), show that SUPER outperforms previous approaches both qualitatively and quantitatively, opening new possibilities for photorealistic selfie editing.


title: A hybrid reduced-order model for segregated fluid-structure interaction solvers in an ALE approach at high Reynolds number

abstract: This study introduces a first step for constructing a hybrid reduced-order models (ROMs) for segregated fluid-structure interaction in an Arbitrary Lagrangian-Eulerian (ALE) approach at a high Reynolds number using the Finite Volume Method (FVM). The ROM is driven by proper orthogonal decomposition (POD) with hybrid techniques that combines the classical Galerkin projection and two data-driven methods (radial basis networks , and neural networks/ long short term memory). Results demonstrate the ROM ability to accurately capture the physics of fluid-structure interaction phenomena. This approach is validated through a case study focusing on flow-induced vibration (FIV) of a pitch-plunge airfoil at a high Reynolds number 10000000.


title: [WIP] Jailbreak Paradox: The Achilles' Heel of LLMs

abstract: We introduce two paradoxes concerning jailbreak of foundation models: First, it is impossible to construct a perfect jailbreak classifier, and second, a weaker model cannot consistently detect whether a stronger (in a pareto-dominant sense) model is jailbroken or not. We provide formal proofs for these paradoxes and a short case study on Llama and GPT4-o to demonstrate this. We discuss broader theoretical and practical repercussions of these results.


title: Coarse-Fine Spectral-Aware Deformable Convolution For Hyperspectral Image Reconstruction

abstract: We study the inverse problem of Coded Aperture Snapshot Spectral Imaging (CASSI), which captures a spatial-spectral data cube using snapshot 2D measurements and uses algorithms to reconstruct 3D hyperspectral images (HSI). However, current methods based on Convolutional Neural Networks (CNNs) struggle to capture long-range dependencies and non-local similarities. The recently popular Transformer-based methods are poorly deployed on downstream tasks due to the high computational cost caused by self-attention. In this paper, we propose Coarse-Fine Spectral-Aware Deformable Convolution Network (CFSDCN), applying deformable convolutional networks (DCN) to this task for the first time. Considering the sparsity of HSI, we design a deformable convolution module that exploits its deformability to capture long-range dependencies and non-local similarities. In addition, we propose a new spectral information interaction module that considers both coarse-grained and fine-grained spectral similarities. Extensive experiments demonstrate that our CFSDCN significantly outperforms previous state-of-the-art (SOTA) methods on both simulated and real HSI datasets.


title: Quantum Kerr Black Hole from Matrix Theory of Quantum Gravity

abstract: Recently, a quantum mechanical theory of quantum spaces described by a large $N$ non-commutative coordinates is proposed as a theory for quantum gravity [1]. In this paper, we construct Kerr black hole as a rotating noncommutative geometry solution of this theory. Due to rotation, the fuzzy sphere is deformed into a fuzzy ellipsoid, which matches exactly the outer horizon of the Kerr black hole in the Boyer-Lindquist coordinates. Together with a half-filled Fermi sea, the fuzzy solution reproduces the Bekenstein-Hawking entropy as well as the mass of the Kerr black hole. These results provide further support that the proposed theory of quantum spaces is a plausible candidate for the theory of quantum gravity.


title: Coherence Length of Electronic Nematicity in Iron-Based Superconductors

abstract: Recent developments in laser-excited photoemission electron microscopy (laser-PEEM) advance the visualization of electronic nematicity and nematic domain structures in iron-based superconductors. In FeSe and BaFe$_2$(As$_{0.87}$P$_{0.13}$)$_2$ superconductors, it has been reported that the thickness of the electronic nematic domain walls is unexpectedly long, leading to the formation of mesoscopic nematicity wave [T. Shimojima $\textit{et al.}$, Science $\textbf{373}$ (2021) 1122]. This finding demonstrates that the nematic coherence length $\xi_{\rm nem}$ can be decoupled from the lattice domain wall. Here, we report that the electronic domain wall thickness shows a distinct variation in related materials: it is similarly long in FeSe$_{0.9}$S$_{0.1}$ whereas it is much shorter in undoped BaFe$_2$As$_2$. We find a correlation between the thick domain walls and the non-Fermi liquid properties of normal-state resistivity above the nematic transition temperature. This suggests that the nematic coherence length can be enhanced by underlying spin-orbital fluctuations responsible for the anomalous transport properties.


title: The Laplace asymptotic expansion in high dimensions: a nonasymptotic analysis

abstract: We study the classical Laplace asymptotic expansion of $\int_{\mathbb R^d} f(x)e^{-nv(x)}dx$ in high dimensions $d$. We derive an error bound to the expansion when truncated to arbitrary order. The error bound is fully explicit except for absolute constants, and it depends on $d$, $n$, and operator norms of the derivatives of $v$ and $f$ in a neighborhood of the minimizer of $v$.


title: Talk With Human-like Agents: Empathetic Dialogue Through Perceptible Acoustic Reception and Reaction

abstract: Large Language Model (LLM)-enhanced agents become increasingly prevalent in Human-AI communication, offering vast potential from entertainment to professional domains. However, current multi-modal dialogue systems overlook the acoustic information present in speech, which is crucial for understanding human communication nuances. This oversight can lead to misinterpretations of speakers' intentions, resulting in inconsistent or even contradictory responses within dialogues. To bridge this gap, in this paper, we propose PerceptiveAgent, an empathetic multi-modal dialogue system designed to discern deeper or more subtle meanings beyond the literal interpretations of words through the integration of speech modality perception. Employing LLMs as a cognitive core, PerceptiveAgent perceives acoustic information from input speech and generates empathetic responses based on speaking styles described in natural language. Experimental results indicate that PerceptiveAgent excels in contextual understanding by accurately discerning the speakers' true intentions in scenarios where the linguistic meaning is either contrary to or inconsistent with the speaker's true feelings, producing more nuanced and expressive spoken dialogues. Code is publicly available at: \url{https://github.com/Haoqiu-Yan/PerceptiveAgent}.


title: AgentReview: Exploring Peer Review Dynamics with LLM Agents

abstract: Peer review is fundamental to the integrity and advancement of scientific publication. Traditional methods of peer review analyses often rely on exploration and statistics of existing peer review data, which do not adequately address the multivariate nature of the process, account for the latent variables, and are further constrained by privacy concerns due to the sensitive nature of the data. We introduce AgentReview, the first large language model (LLM) based peer review simulation framework, which effectively disentangles the impacts of multiple latent factors and addresses the privacy issue. Our study reveals significant insights, including a notable 37.1% variation in paper decisions due to reviewers' biases, supported by sociological theories such as the social influence theory, altruism fatigue, and authority bias. We believe that this study could offer valuable insights to improve the design of peer review mechanisms.


title: Enhancing Spatio-temporal Quantile Forecasting with Curriculum Learning: Lessons Learned

abstract: Training models on spatio-temporal (ST) data poses an open problem due to the complicated and diverse nature of the data itself, and it is challenging to ensure the model's performance directly trained on the original ST data. While limiting the variety of training data can make training easier, it can also lead to a lack of knowledge and information for the model, resulting in a decrease in performance. To address this challenge, we presented an innovative paradigm that incorporates three separate forms of curriculum learning specifically targeting from spatial, temporal, and quantile perspectives. Furthermore, our framework incorporates a stacking fusion module to combine diverse information from three types of curriculum learning, resulting in a strong and thorough learning process. We demonstrated the effectiveness of this framework with extensive empirical evaluations, highlighting its better performance in addressing complex ST challenges. We provided thorough ablation studies to investigate the effectiveness of our curriculum and to explain how it contributes to the improvement of learning efficiency on ST data.


title: What is in the Chrome Web Store? Investigating Security-Noteworthy Browser Extensions

abstract: This paper is the first attempt at providing a holistic view of the Chrome Web Store (CWS). We leverage historical data provided by ChromeStats to study global trends in the CWS and security implications. We first highlight the extremely short life cycles of extensions: roughly 60% of extensions stay in the CWS for one year. Second, we define and show that Security-Noteworthy Extensions (SNE) are a significant issue: they pervade the CWS for years and affect almost 350 million users. Third, we identify clusters of extensions with a similar code base. We discuss how code similarity techniques could be used to flag suspicious extensions. By developing an approach to extract URLs from extensions' comments, we show that extensions reuse code snippets from public repositories or forums, leading to the propagation of dated code and vulnerabilities. Finally, we underline a critical lack of maintenance in the CWS: 60% of the extensions in the CWS have never been updated; half of the extensions known to be vulnerable are still in the CWS and still vulnerable 2 years after disclosure; a third of extensions use vulnerable library versions. We believe that these issues should be widely known in order to pave the way for a more secure CWS.


title: The Enigma of Li-Rich Giants and its Relation with Temporal Variations Observed in Radial Velocity and Stellar Activity Signals

abstract: Despite the large number of studies focused on the characterization of Li-rich stars and understanding of the mechanisms leading to such enrichment, their origin remains a mystery. Magnetic activity, in particular the phenomena usually associated with it, such as spots and plages, and the Li abundance (A(Li)) of stars, are in general thought to be connected. However, as of today it is unclear just how. In this work, we study a sample of young but evolved intermediate mass red giants, inhabitants of open clusters where planets have been searched. We aim at using radial velocity (RV) and stellar activity indicator signals to look for relations between Li abundances and stellar activity/variability. We explore how the standard deviation (STD), peak to peak amplitude (PTP), mean and median of typical stellar activity indicators (BIS, FWHM, $T_\textrm{eff}$, and H$\alpha$ index) change as a function of the Li content of 82 red giants. Furthermore, we compute weighted Pearson Correlation Coefficients ($\rho_w$) between time series of RV measurements and the stellar activity indicators for the stars in our sample. To aid our results, we also study Generalized Lomb-Scargle Periodograms (GLSP) to capture possible significant periodic temporal variations in our data. Our analysis indicates that the STD and PTP of BIS and FWHM, the mean and median of the H$\alpha$ index and $v\sin(i)$ increase exponentially with A(Li) in our sample of red giants. Significant temporal variations and correlations between RVs and activity indicators also tend to be found preferentially for stars where high A(Li) is observed. Most of the Li-rich stars in our sample either show strong correlations of RV with at least one of the stellar activity indicators or reveal significant periodic temporal variations in their stellar activity indicators GLSPs consistent with those found for RV.


title: Self-Localized Collaborative Perception

abstract: Collaborative perception has garnered considerable attention due to its capacity to address several inherent challenges in single-agent perception, including occlusion and out-of-range issues. However, existing collaborative perception systems heavily rely on precise localization systems to establish a consistent spatial coordinate system between agents. This reliance makes them susceptible to large pose errors or malicious attacks, resulting in substantial reductions in perception performance. To address this, we propose~$\mathtt{CoBEVGlue}$, a novel self-localized collaborative perception system, which achieves more holistic and robust collaboration without using an external localization system. The core of~$\mathtt{CoBEVGlue}$ is a novel spatial alignment module, which provides the relative poses between agents by effectively matching co-visible objects across agents. We validate our method on both real-world and simulated datasets. The results show that i) $\mathtt{CoBEVGlue}$ achieves state-of-the-art detection performance under arbitrary localization noises and attacks; and ii) the spatial alignment module can seamlessly integrate with a majority of previous methods, enhancing their performance by an average of $57.7\%$. Code is available at https://github.com/VincentNi0107/CoBEVGlue


title: Structure of Massive Gauge/Gravity Scattering Amplitudes, Equivalence Theorems, and Extended Double-Copy with Compactified Warped Space

abstract: We study the structure of scattering amplitudes of massive Kaluza-Klein (KK) states in the compactified 5-dimensional warped gauge and gravity theories. We present systematic formulations of the gauge theory equivalence theorem (GAET) and the gravitational equivalence theorem (GRET) for warped KK theories in $R_\xi^{}$ gauge, where the GAET connects the scattering amplitudes of longitudinal KK gauge bosons to that of the corresponding KK Goldstone bosons and the GRET connects the scattering amplitudes of KK gravitons of helicity-zero (helicity-one) to that of the corresponding gravitational KK Goldstone bosons. We analyze the structure of 3-point and 4-point scattering amplitudes of massive KK gauge bosons and of massive KK gravitons as well as their corresponding Goldstone bosons. We first prove the GAET and GRET explicitly for the fundamental 3-point KK gauge/gravity scattering amplitudes. We then demonstrate that the validity of the GAET and GRET for 4-point gauge/gravity scattering amplitudes can be reduced to the validity of GAET and GRET for 3-point gauge/gravity scattering amplitudes at tree level. With these, we study the double-copy construction of KK scattering amplitudes in the warped gauge/gravity theories. We newly realize the double-copy for massive 3-point full gauge/gravity amplitudes at tree level under proper correspondences of color-kinematics and of gauge/gravity couplings, whereas we can construct the double-copy for 4-point KK gauge/gravity amplitudes to the leading order (LO) of high energy expansion. We further demonstrate that this LO double-copy construction can be extended to $N$-point KK scattering amplitudes with $N\geqslant 4$.


title: Difference Autocorrelation: A Novel Approach to Estimate Shear Wave Speed in the Presence of Compression Waves

abstract: In share wave elastography (SWE), the aim is to measure the velocity of shear waves, however unwanted compression waves and bulk tissue motion pose challenges in evaluating tissue stiffness. Conventional approaches often struggle to discriminate between shear and compression waves, leading to inaccurate shear wave speed (SWS) estimation. In this study, we propose a novel approach known as the difference autocorrelation estimator to accurately estimate reverberant SWS in the presence of compression waves and noise. Methods: The difference autocorrelation estimator, unlike conventional techniques, computes the subtraction of velocity between neighboring particles, effectively minimizing the impact of long wavelength compression waves and other wide-area movements such as those caused by respiration. We evaluated the effectiveness of the integrated difference autocorrelation (IDA) by: (1) using k-Wave simulations of a branching cylinder in a soft background, (2) using ultrasound elastography on a breast phantom, (3) using ultrasound elastography in the human liver-kidney region, and (4) using magnetic resonance elastography (MRE) on a brain phantom. Results: By applying IDA on the unfiltered contaminated wave fields of simulation and elastography experiments, the estimated SWSs are in good agreement with the ground truth values (i.e., less than 2% error for the simulation, 9% error for ultrasound elastography of breast phantom and 19% error for MRE). Conclusion: Our results demonstrate that IDA accurately estimates SWS, revealing the existence of a lesion, even in the presence of strong compression waves. Significance: IDA exhibits consistency in SWS estimation across different modalities and excitation scenarios, highlighting its robustness and potential clinical utility.


title: Runtime Verification on Abstract Finite State Models

abstract: Finite-state models are ubiquitous in the study of concurrent systems, especially controllers and servers that operate in a repetitive cycle. In this paper, we show how to extract finite state models from a run of a multi-threaded Java program and carry out runtime verification of correctness properties. These properties include data-oriented and control-oriented properties; the former express correctness conditions over the data fields of objects, while the latter are concerned with the correct flow of control among the modules of larger software. As the extracted models can become very large for long runs, the focus of this paper is on constructing reduced models with user-defined abstraction functions that map a larger domain space to a smaller one. The abstraction functions should be chosen so that the resulting model is property preserving, i.e., proving a property on the abstract model carries over to the concrete model. The main contribution of this paper is in showing how runtime verification can be made efficient through online property checking on property-preserving abstract models. The property specification language resembles a propositional linear temporal logic augmented with simple datatypes and operators. Classic concurrency examples and larger case studies (Multi-rotor Drone Controller, OAuth Protocol) are presented in order to demonstrate the usefulness of our proposed techniques, which are incorporated in an Eclipse plug-in for runtime visualization and verification of Java programs.


title: Concurrent Accretion and Migration of Giant Planets in their Natal Disks with Consistent Accretion Torque

abstract: Migration commonly occurs during the epoch of planet formation. For emerging gas giant planets, it proceeds concurrently with their growth through the accretion of gas from their natal protoplanetary disks. Similar migration process should also be applied to the stellar-mass black holes embedded in active galactic nucleus disks. In this work, we perform high resolution 3D and 2D numerical hydrodynamical simulations to study the migration dynamics for accreting embedded objects over the disk viscous timescales in a self-consistent manner. We find that an accreting planet embedded in a predominantly viscous disk has a tendency to migrate outward, in contrast to the inward orbital decay of non-accreting planets. 3D and 2D simulations find the consistent outward migration results for the accreting planets. Under this circumstance, the accreting planet's outward migration is mainly due to the asymmetric spiral arms feeding from the global disk into the Hill radius. This is analogous to the unsaturated corotation torque although the imbalance is due to material accretion within the libration timescale rather than diffusion onto the inner disk. In a disk with a relatively small viscosity, the accreting planets clear deep gaps near their orbits. The tendency of inward migration is recovered, albeit with suppressed rates. By performing a parameter survey with a range of disks' viscosity, we find that the transition from outward to inward migration occurs with the effective viscous efficiency factor $\alpha\sim 0.003$ for Jupiter-mass planets.


title: Parameterized Shortest Path Reconfiguration

abstract: An st-shortest path, or st-path for short, in a graph G is a shortest (induced) path from s to t in G. Two st-paths are said to be adjacent if they differ on exactly one vertex. A reconfiguration sequence between two st-paths P and Q is a sequence of adjacent st-paths starting from P and ending at Q. Deciding whether there exists a reconfiguration sequence between two given $st$-paths is known to be PSPACE-complete, even on restricted classes of graphs such as graphs of bounded bandwidth (hence pathwidth). On the positive side, and rather surprisingly, the problem is polynomial-time solvable on planar graphs. In this paper, we study the parameterized complexity of the Shortest Path Reconfiguration (SPR) problem. We show that SPR is W[1]-hard parameterized by k + \ell, even when restricted to graphs of bounded (constant) degeneracy; here k denotes the number of edges on an st-path, and \ell denotes the length of a reconfiguration sequence from P to Q. We complement our hardness result by establishing the fixed-parameter tractability of SPR parameterized by \ell and restricted to nowhere-dense classes of graphs. Additionally, we establish fixed-parameter tractability of SPR when parameterized by the treedepth, by the cluster-deletion number, or by the modular-width of the input graph.


title: AGLA: Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention

abstract: Despite their great success across various multimodal tasks, Large Vision-Language Models (LVLMs) are facing a prevalent problem with object hallucinations, where the generated textual responses are inconsistent with ground-truth objects in the given image. This paper investigates various LVLMs and pinpoints attention deficiency toward discriminative local image features as one root cause of object hallucinations. Specifically, LVLMs predominantly attend to prompt-independent global image features, while failing to capture prompt-relevant local features, consequently undermining the visual grounding capacity of LVLMs and leading to hallucinations. To this end, we propose Assembly of Global and Local Attention (AGLA), a training-free and plug-and-play approach that mitigates object hallucinations by exploring an ensemble of global features for response generation and local features for visual discrimination simultaneously. Our approach exhibits an image-prompt matching scheme that captures prompt-relevant local features from images, leading to an augmented view of the input image where prompt-relevant content is reserved while irrelevant distractions are masked. With the augmented view, a calibrated decoding distribution can be derived by integrating generative global features from the original image and discriminative local features from the augmented image. Extensive experiments show that AGLA consistently mitigates object hallucinations and enhances general perception capability for LVLMs across various discriminative and generative benchmarks. Our code will be released at https://github.com/Lackel/AGLA.


title: On the Robustness of Language Models for Tabular Question Answering

abstract: Large Language Models (LLMs), originally shown to ace various text comprehension tasks have also remarkably been shown to tackle table comprehension tasks without specific training. While previous research has explored LLM capabilities with tabular dataset tasks, our study assesses the influence of $\textit{in-context learning}$,$ \textit{model scale}$, $\textit{instruction tuning}$, and $\textit{domain biases}$ on Tabular Question Answering (TQA). We evaluate the robustness of LLMs on Wikipedia-based $\textbf{WTQ}$ and financial report-based $\textbf{TAT-QA}$ TQA datasets, focusing on their ability to robustly interpret tabular data under various augmentations and perturbations. Our findings indicate that instructions significantly enhance performance, with recent models like Llama3 exhibiting greater robustness over earlier versions. However, data contamination and practical reliability issues persist, especially with WTQ. We highlight the need for improved methodologies, including structure-aware self-attention mechanisms and better handling of domain-specific tabular data, to develop more reliable LLMs for table comprehension.


title: Liouville results for semilinear integral equations with conical diffusion

abstract: Nonexistence results for positive supersolutions of the equation $$-Lu=u^p\quad\text{in $\mathbb R^N_+$}$$ are obtained, $-L$ being any symmetric and stable linear operator, positively homogeneous of degree $2s$, $s\in(0,1)$, whose spectral measure is absolutely continuous and positive only in a relative open set of the unit sphere of $\mathbb R^N$. The results are sharp: $u\equiv 0$ is the only nonnegative supersolution in the subcritical regime $1\leq p\leq\frac{N+s}{N-s}\,$, while nontrivial supersolutions exist, at least for some specific $-L$, as soon as $p>\frac{N+s}{N-s}$. \\ The arguments used rely on a rescaled test function's method, suitably adapted to such nonlocal setting with weak diffusion; they are quite general and also employed to obtain Liouville type results in the whole space.


title: Sound event detection based on auxiliary decoder and maximum probability aggregation for DCASE Challenge 2024 Task 4

abstract: In this report, we propose three novel methods for developing a sound event detection (SED) model for the DCASE 2024 Challenge Task 4. First, we propose an auxiliary decoder attached to the final convolutional block to improve feature extraction capabilities while reducing dependency on embeddings from pre-trained large models. The proposed auxiliary decoder operates independently from the main decoder, enhancing performance of the convolutional block during the initial training stages by assigning a different weight strategy between main and auxiliary decoder losses. Next, to address the time interval issue between the DESED and MAESTRO datasets, we propose maximum probability aggregation (MPA) during the training step. The proposed MPA method enables the model's output to be aligned with soft labels of 1 s in the MAESTRO dataset. Finally, we propose a multi-channel input feature that employs various versions of logmel and MFCC features to generate time-frequency pattern. The experimental results demonstrate the efficacy of these proposed methods in a view of improving SED performance by achieving a balanced enhancement across different datasets and label types. Ultimately, this approach presents a significant step forward in developing more robust and flexible SED models


title: Non-central limit of densities of some functionals of Gaussian processes

abstract: We establish the convergence of the densities of a sequence of nonlinear functionals of an underlying Gaussian process to the density of a Gamma distribution. We provide precise estimates on the distance between densities while developing the techniques of Malliavin calculus and Stein's method suitable to Gamma approximation. We first focus our study on the case of random variables living in a fixed Wiener chaos of an even order for which the bound for the difference of the densities can be dominated by a linear combination of moments up to order four. We then study the case of general Gaussian functionals with possibly infinite chaos expansion. Finally, we provide two applications of our results, namely the limit of random variables living in the second Wiener chaos, and the limit of sums of independent Pareto distributed random variables.


title: BIOSCAN-5M: A Multimodal Dataset for Insect Biodiversity

abstract: As part of an ongoing worldwide effort to comprehend and monitor insect biodiversity, this paper presents the BIOSCAN-5M Insect dataset to the machine learning community and establish several benchmark tasks. BIOSCAN-5M is a comprehensive dataset containing multi-modal information for over 5 million insect specimens, and it significantly expands existing image-based biological datasets by including taxonomic labels, raw nucleotide barcode sequences, assigned barcode index numbers, and geographical information. We propose three benchmark experiments to demonstrate the impact of the multi-modal data types on the classification and clustering accuracy. First, we pretrain a masked language model on the DNA barcode sequences of the BIOSCAN-5M dataset, and demonstrate the impact of using this large reference library on species- and genus-level classification performance. Second, we propose a zero-shot transfer learning task applied to images and DNA barcodes to cluster feature embeddings obtained from self-supervised learning, to investigate whether meaningful clusters can be derived from these representation embeddings. Third, we benchmark multi-modality by performing contrastive learning on DNA barcodes, image data, and taxonomic information. This yields a general shared embedding space enabling taxonomic classification using multiple types of information and modalities. The code repository of the BIOSCAN-5M Insect dataset is available at https://github.com/zahrag/BIOSCAN-5M.


title: Viscous Unified Dark Matter Models Under Scrutiny: Uncovering Inconsistencies from Dynamical System Analysis

abstract: Viscous unified dark matter models aim to describe the dark sector of the Universe, as the dark matter fluid itself gives rise to an accelerated expansion due to a negative bulk viscous pressure. However, in most studies, radiation is often disregarded as a minor factor in dynamical system analyses, overlooking whether radiation domination is achievable. In this paper, we rigorously examine this critical aspect for common parameterizations of bulk viscosity, denoted as $\xi$, within two general classes of viscous unified models. Our findings reveal significant inconsistencies in models where $\xi \propto H^{1-2s} \rho_{m}^{s}$ with $s\leq 0$, and surprisingly, in models where $\xi \propto \rho_{m}^{s}$ with exponents $s<0$, as they both fail to produce a radiation-dominated era. Moreover, the exponent $s$ must lye within the interval $0 \leq s < 1/2$ for the latter model to correctly describes the cosmological evolution. These results underscore the need of including these constraints as a prior in statistical analyses of observational data, with implications for current statistical inferences for the second model, where both prior and best-fit values of $s$ often fall outside the acceptable range.


title: Can Large Language Models Code Like a Linguist?: A Case Study in Low Resource Sound Law Induction

abstract: Historical linguists have long written a kind of incompletely formalized ''program'' that converts reconstructed words in an ancestor language into words in one of its attested descendants that consist of a series of ordered string rewrite functions (called sound laws). They do this by observing pairs of words in the reconstructed language (protoforms) and the descendent language (reflexes) and constructing a program that transforms protoforms into reflexes. However, writing these programs is error-prone and time-consuming. Prior work has successfully scaffolded this process computationally, but fewer researchers have tackled Sound Law Induction (SLI), which we approach in this paper by casting it as Programming by Examples. We propose a language-agnostic solution that utilizes the programming ability of Large Language Models (LLMs) by generating Python sound law programs from sound change examples. We evaluate the effectiveness of our approach for various LLMs, propose effective methods to generate additional language-agnostic synthetic data to fine-tune LLMs for SLI, and compare our method with existing automated SLI methods showing that while LLMs lag behind them they can complement some of their weaknesses.


title: ED-sKWS: Early-Decision Spiking Neural Networks for Rapid,and Energy-Efficient Keyword Spotting

abstract: Keyword Spotting (KWS) is essential in edge computing requiring rapid and energy-efficient responses. Spiking Neural Networks (SNNs) are well-suited for KWS for their efficiency and temporal capacity for speech. To further reduce the latency and energy consumption, this study introduces ED-sKWS, an SNN-based KWS model with an early-decision mechanism that can stop speech processing and output the result before the end of speech utterance. Furthermore, we introduce a Cumulative Temporal (CT) loss that can enhance prediction accuracy at both the intermediate and final timesteps. To evaluate early-decision performance, we present the SC-100 dataset including 100 speech commands with beginning and end timestamp annotation. Experiments on the Google Speech Commands v2 and our SC-100 datasets show that ED-sKWS maintains competitive accuracy with 61% timesteps and 52% energy consumption compared to SNN models without early-decision mechanism, ensuring rapid response and energy efficiency.


title: Massively Parallel Ruling Set Made Deterministic

abstract: We study the deterministic complexity of the $2$-Ruling Set problem in the model of Massively Parallel Computation (MPC) with linear and strongly sublinear local memory. Linear MPC: We present a constant-round deterministic algorithm for the $2$-Ruling Set problem that matches the randomized round complexity recently settled by Cambus, Kuhn, Pai, and Uitto [DISC'23], and improves upon the deterministic $O(\log \log n)$-round algorithm by Pai and Pemmaraju [PODC'22]. Our main ingredient is a simpler analysis of CKPU's algorithm based solely on bounded independence, which makes its efficient derandomization possible. Sublinear MPC: We present a deterministic algorithm that computes a $2$-Ruling Set in $\tilde O(\sqrt{\log n})$ rounds deterministically. Notably, this is the first deterministic ruling set algorithm with sublogarithmic round complexity, improving on the $O(\log \Delta + \log \log^* n)$-round complexity that stems from the deterministic MIS algorithm of Czumaj, Davies, and Parter [TALG'21]. Our result is based on a simple and fast randomness-efficient construction that achieves the same sparsification as that of the randomized $\tilde O(\sqrt{\log n})$-round LOCAL algorithm by Kothapalli and Pemmaraju [FSTTCS'12].


title: Toward mean-field bound for critical temperature on Nishimori line

abstract: The critical inverse temperature of the mean-field approximation establishes a lower bound of the true critical inverse temperature in a broad class of ferromagnetic spin models. This is referred to as the mean-field bound for the critical temperature. In this study, we explored the possibility of a corresponding mean-field bound for the critical temperature in Ising spin glass models with Gaussian randomness on the Nishimori line. On this line, the critical inverse temperature of the mean-field approximation is given by $\beta_{MF}^{NL}=\sqrt{1/z}$, where $z$ is the coordination number. Using the Griffiths inequalities on the Nishimori line, we proved that there is zero spontaneous magnetization in the high-temperature region $\beta < \beta_{MF}^{NL}/2$. In other words, the true critical inverse temperature $\beta_c^{NL}$ on the Nishimori line is always bounded by $\beta_c^{NL} \ge \beta_{MF}^{NL}/2$. Unfortunately, we have not succeeded in obtaining the corresponding mean-field bound $\beta_c^{NL} \ge \beta_{MF}^{NL}$ on the Nishimori line.


title: Spin-Peierls instability of deconfined quantum critical points

abstract: Deconfined quantum critical points (DQCPs) are putative phase transitions beyond the Landau paradigm with emergent fractionalized degrees of freedom. The original example of a DQCP is the spin-1/2 quantum antiferromagnet on the square lattice which features a second order transition between valence bond solid (VBS) and N\'eel order. The VBS order breaks a lattice symmetry, and the corresponding VBS order parameter may couple to lattice distortion modes (phonons) at appropriate momenta. We investigate a field-theoretic description of the DQCP in the presence of such a spin-lattice coupling. We show that treating phonons as classical lattice distortions leads to a relevant monopole-phonon interaction inducing an instability towards a distorted lattice by an analogous mechanism to the spin-Peierls instability in one dimension. Consequently, there is a breakdown of the DQCP which generally becomes a strong first-order transition. Taking into account the full quantum nature of the phonons, we argue that the continuous DQCP persists above a critical phonon frequency. Lastly, we comment on the connection to general gapless, deconfined gauge theories.


title: Predicting the energetic proton flux with a machine learning regression algorithm

abstract: The need of real-time of monitoring and alerting systems for Space Weather hazards has grown significantly in the last two decades. One of the most important challenge for space mission operations and planning is the prediction of solar proton events (SPEs). In this context, artificial intelligence and machine learning techniques have opened a new frontier, providing a new paradigm for statistical forecasting algorithms. The great majority of these models aim to predict the occurrence of a SPE, i.e., they are based on the classification approach. In this work we present a simple and efficient machine learning regression algorithm which is able to forecast the energetic proton flux up to 1 hour ahead by exploiting features derived from the electron flux only. This approach could be helpful to improve monitoring systems of the radiation risk in both deep space and near-Earth environments. The model is very relevant for mission operations and planning, especially when flare characteristics and source location are not available in real time, as at Mars distance.

categories: astro-ph.SR astro-ph.IM cs.LG physics.space-ph


title: Tactile SoftHand-A: 3D-Printed, Tactile, Highly-underactuated, Anthropomorphic Robot Hand with an Antagonistic Tendon Mechanism

abstract: For tendon-driven multi-fingered robotic hands, ensuring grasp adaptability while minimizing the number of actuators needed to provide human-like functionality is a challenging problem. Inspired by the Pisa/IIT SoftHand, this paper introduces a 3D-printed, highly-underactuated, five-finger robotic hand named the Tactile SoftHand-A, which features only two actuators. The dual-tendon design allows for the active control of specific (distal or proximal interphalangeal) joints to adjust the hand's grasp gesture. We have also developed a new design of fully 3D-printed tactile sensor that requires no hand assembly and is printed directly as part of the robotic finger. This sensor is integrated into the fingertips and combined with the antagonistic tendon mechanism to develop a human-hand-guided tactile feedback grasping system. The system can actively mirror human hand gestures, adaptively stabilize grasp gestures upon contact, and adjust grasp gestures to prevent object movement after detecting slippage. Finally, we designed four different experiments to evaluate the novel fingers coupled with the antagonistic mechanism for controlling the robotic hand's gestures, adaptive grasping ability, and human-hand-guided tactile feedback grasping capability. The experimental results demonstrate that the Tactile SoftHand-A can adaptively grasp objects of a wide range of shapes and automatically adjust its gripping gestures upon detecting contact and slippage. Overall, this study points the way towards a class of low-cost, accessible, 3D-printable, underactuated human-like robotic hands, and we openly release the designs to facilitate others to build upon this work. This work is Open-sourced at github.com/SoutheastWind/Tactile_SoftHand_A


title: Automatic generation of insights from workers' actions in industrial workflows with explainable Machine Learning

abstract: New technologies such as Machine Learning (ML) gave great potential for evaluating industry workflows and automatically generating key performance indicators (KPIs). However, despite established standards for measuring the efficiency of industrial machinery, there is no precise equivalent for workers' productivity, which would be highly desirable given the lack of a skilled workforce for the next generation of industry workflows. Therefore, an ML solution combining data from manufacturing processes and workers' performance for that goal is required. Additionally, in recent times intense effort has been devoted to explainable ML approaches that can automatically explain their decisions to a human operator, thus increasing their trustworthiness. We propose to apply explainable ML solutions to differentiate between expert and inexpert workers in industrial workflows, which we validate at a quality assessment industrial workstation. Regarding the methodology used, input data are captured by a manufacturing machine and stored in a NoSQL database. Data are processed to engineer features used in automatic classification and to compute workers' KPIs to predict their level of expertise (with all classification metrics exceeding 90 %). These KPIs, and the relevant features in the decisions are textually explained by natural language expansion on an explainability dashboard. These automatic explanations made it possible to infer knowledge from expert workers for inexpert workers. The latter illustrates the interest of research in self-explainable ML for automatically generating insights to improve productivity in industrial workflows.


title: The Top Dimensional Singular Set $\text{sing}_{*}u$

abstract: In this survey, we examine the properties of the top dimensional singular set $\text{sing}_{*}(u)$, including several theorems, geometric properties, and relation to homogeneous degree zero minimizers.


title: Unstable cohomology of $\mathsf{GL}_{2n}(\mathbb{Z})$ and the odd commutative graph complex

abstract: We study a closed differential form on the symmetric space of positive definite matrices, which is defined using the Pfaffian and is $\mathsf{GL}_{2n}(\mathbb{Z})$ invariant up to a sign. It gives rise to an infinite family of unstable classes in the compactly-supported cohomology of the locally symmetric space for $\mathsf{GL}_{2n}(\mathbb{Z})$ with coefficients in the orientation bundle. Furthermore, by applying the Pfaffian forms to the dual Laplacian of graphs, and integrating them over the space of edge lengths, we construct an infinite family of cocycles for the odd commutative graph complex. By explicit computation, we show that the first such cocycle gives a non-trivial class in $H^{-6}(\mathsf{GC}_3)$.


title: Injection Optimization at Particle Accelerators via Reinforcement Learning: From Simulation to Real-World Application

abstract: Optimizing the injection process in particle accelerators is crucial for enhancing beam quality and operational efficiency. This paper presents a framework for utilizing Reinforcement Learning (RL) to optimize the injection process at accelerator facilities. By framing the optimization challenge as an RL problem, we developed an agent capable of dynamically aligning the beam's transverse space with desired targets. Our methodology leverages the Soft Actor-Critic algorithm, enhanced with domain randomization and dense neural networks, to train the agent in simulated environments with varying dynamics promoting it to learn a generalized robust policy. The agent was evaluated in live runs at the Cooler Synchrotron COSY and it has successfully optimized the beam cross-section reaching human operator level but in notably less time. An empirical study further validated the importance of each architecture component in achieving a robust and generalized optimization strategy. The results demonstrate the potential of RL in automating and improving optimization tasks at particle acceleration facilities.


title: Beyond Visual Appearances: Privacy-sensitive Objects Identification via Hybrid Graph Reasoning

abstract: The Privacy-sensitive Object Identification (POI) task allocates bounding boxes for privacy-sensitive objects in a scene. The key to POI is settling an object's privacy class (privacy-sensitive or non-privacy-sensitive). In contrast to conventional object classes which are determined by the visual appearance of an object, one object's privacy class is derived from the scene contexts and is subject to various implicit factors beyond its visual appearance. That is, visually similar objects may be totally opposite in their privacy classes. To explicitly derive the objects' privacy class from the scene contexts, in this paper, we interpret the POI task as a visual reasoning task aimed at the privacy of each object in the scene. Following this interpretation, we propose the PrivacyGuard framework for POI. PrivacyGuard contains three stages. i) Structuring: an unstructured image is first converted into a structured, heterogeneous scene graph that embeds rich scene contexts. ii) Data Augmentation: a contextual perturbation oversampling strategy is proposed to create slightly perturbed privacy-sensitive objects in a scene graph, thereby balancing the skewed distribution of privacy classes. iii) Hybrid Graph Generation & Reasoning: the balanced, heterogeneous scene graph is then transformed into a hybrid graph by endowing it with extra "node-node" and "edge-edge" homogeneous paths. These homogeneous paths allow direct message passing between nodes or edges, thereby accelerating reasoning and facilitating the capturing of subtle context changes. Based on this hybrid graph... **For the full abstract, see the original paper.**


title: Regular algebras of dimension four associated to coordinate rings of rank-two quadrics

abstract: In this paper, we classify connected graded quadratic Artin-Schelter regular (AS-regular, henceforth) algebras of global dimension four that have a Hilbert series the same as that of the polynomial ring on four generators and that map onto a twisted homogeneous coordinate ring of a rank-two quadric. A twisted homogeneous coordinate ring is a construction that was defined by Artin, Tate, and Van den Bergh in \cite{ATV1, ATV2, AVdB1990} in the context of the classification of AS-regular algebras of global dimension three. In \cite{SV99,VVr}, the authors classified AS-regular algebras of global dimension four that map onto the twisted homogeneous coordinate ring of a rank-three and a rank-four quadric, respectively. We expand on their work to include the case of coordinate rings of a rank-two quadric.


title: Large Language Model as a Universal Clinical Multi-task Decoder

abstract: The development of effective machine learning methodologies for enhancing the efficiency and accuracy of clinical systems is crucial. Despite significant research efforts, managing a plethora of diversified clinical tasks and adapting to emerging new tasks remain significant challenges. This paper presents a novel paradigm that employs a pre-trained large language model as a universal clinical multi-task decoder. This approach leverages the flexibility and diversity of language expressions to handle task topic variations and associated arguments. The introduction of a new task simply requires the addition of a new instruction template. We validate this framework across hundreds of tasks, demonstrating its robustness in facilitating multi-task predictions, performing on par with traditional multi-task learning and single-task learning approaches. Moreover, it shows exceptional adaptability to new tasks, with impressive zero-shot performance in some instances and superior data efficiency in few-shot scenarios. This novel approach offers a unified solution to manage a wide array of new and emerging tasks in clinical applications.


title: Self-Distillation for Model Stacking Unlocks Cross-Lingual NLU in 200+ Languages

abstract: LLMs have become a go-to solution not just for text generation, but also for natural language understanding (NLU) tasks. Acquiring extensive knowledge through language modeling on web-scale corpora, they excel on English NLU, yet struggle to extend their NLU capabilities to underrepresented languages. In contrast, machine translation models (MT) produce excellent multilingual representations, resulting in strong translation performance even for low-resource languages. MT encoders, however, lack the knowledge necessary for comprehensive NLU that LLMs obtain through language modeling training on immense corpora. In this work, we get the best both worlds by integrating MT encoders directly into LLM backbones via sample-efficient self-distillation. The resulting MT-LLMs preserve the inherent multilingual representational alignment from the MT encoder, allowing lower-resource languages to tap into the rich knowledge embedded in English-centric LLMs. Merging the MT encoder and LLM in a single model, we mitigate the propagation of translation errors and inference overhead of MT decoding inherent to discrete translation-based cross-lingual transfer (e.g., translate-test). Evaluation spanning three prominent NLU tasks and 127 predominantly low-resource languages renders MT-LLMs highly effective in cross-lingual transfer. MT-LLMs substantially and consistently outperform translate-test based on the same MT model, showing that we truly unlock multilingual language understanding for LLMs.


title: On homological properties of the Schlichting completion

abstract: We show how finiteness properties of a group and a subgroup transfer to finiteness properties of the Schlichting completion relative to this subgroup. Further, we provide a criterion when the dense embedding of a discrete group into the Schlichting completion relative to one of its subgroups induces an isomorphism in (continuous) cohomology. As an application, we show that the continuous cohomology of the Neretin group vanishes in all positive degrees.


title: Characterization of Additive Manufacturing Materials for String Assembly in Cleanroom

abstract: Beamline components, such as superconducting radio frequency cavities and focusing lenses, need to be assembled together in a string while in a cleanroom environment. The present contribution identifies and characterizes materials for additive manufacturing that can be used in a cleanroom. The well known advantages of additive manufacturing processes would highly benefit the design and development of tooling needed for the mechanical support and alignment of string components. Cleanliness, mechanical properties, and leak tightness of the chosen materials are the main focus of this contribution, which also paves the way for the integration of such materials in cryomodule assemblies. Results reported here were obtained in the framework of the PIP-II project at Fermilab.


title: Benchmarking Multi-Image Understanding in Vision and Language Models: Perception, Knowledge, Reasoning, and Multi-Hop Reasoning

abstract: The advancement of large language models (LLMs) has significantly broadened the scope of applications in natural language processing, with multi-modal LLMs extending these capabilities to integrate and interpret visual data. However, existing benchmarks for visual language models (VLMs) predominantly focus on single-image inputs, neglecting the crucial aspect of multi-image understanding. In this paper, we introduce a Multi-Image Relational Benchmark MIRB, designed to evaluate VLMs' ability to compare, analyze, and reason across multiple images. Our benchmark encompasses four categories: perception, visual world knowledge, reasoning, and multi-hop reasoning. Through a comprehensive evaluation of a wide range of open-source and closed-source models, we demonstrate that while open-source VLMs were shown to approach the performance of GPT-4V in single-image tasks, a significant performance gap remains in multi-image reasoning tasks. Our findings also reveal that even the state-of-the-art GPT-4V model struggles with our benchmark, underscoring the need for further research and development in this area. We believe our contribution of MIRB could serve as a testbed for developing the next-generation multi-modal models.


title: Electron-Beam Writing of Atomic-Scale Reconstructions at Oxide Interfaces

abstract: The epitaxial growth of complex oxides enables the production of high-quality films, yet substrate choice is restricted to certain symmetry and lattice parameters, thereby limiting the technological applications of epitaxial oxides. In comparison, the development of free-standing oxide membranes gives opportunities to create novel heterostructures by non-epitaxial stacking of membranes, opening new possibilities for materials design. Here, we introduce a method for writing, with atomic precision, ionically bonded crystalline material across the gap between an oxide membrane and a carrier substrate. The process involves a thermal pre-treatment, followed by localized exposure to the raster scan of a scanning transmission electron microscopy (STEM) beam. STEM imaging and electron energy-loss spectroscopy show that we achieve atomically sharp interface reconstructions between a 30 nm-thick SrTiO${_3}$ membrane and a niobium-doped SrTiO${_3}$(001)-oriented carrier substrate. These findings indicate new strategies for fabricating synthetic heterostructures with novel structural and electronic properties.


title: Ensuring Both Positivity and Stability Using Sector-Bounded Nonlinearity for Systems with Neural Network Controllers

abstract: This paper introduces a novel method for the stability analysis of positive feedback systems with a class of fully connected feedforward neural networks (FFNN) controllers. By establishing sector bounds for fully connected FFNNs without biases, we present a stability theorem that demonstrates the global exponential stability of linear systems under fully connected FFNN control. Utilizing principles from positive Lur'e systems and the positive Aizerman conjecture, our approach effectively addresses the challenge of ensuring stability in highly nonlinear systems. The crux of our method lies in maintaining sector bounds that preserve the positivity and Hurwitz property of the overall Lur'e system. We showcase the practical applicability of our methodology through its implementation in a linear system managed by a FFNN trained on output feedback controller data, highlighting its potential for enhancing stability in dynamic systems.


title: Useful stochastic bounds in time-varying queues with service and patience times having general joint distribution

abstract: Consider a first-come, first-served single server queue with an initial workload $x>0$ and customers who arrive according to an inhomogeneous Poisson process with rate function $\lambda:[0,\infty)\rightarrow[0,\lambda_h ]$ for some $\lambda_h>0$. For each $i\in\mathbb{N}$, let $S_i$ (resp., $Y_i$) be the service (resp., patience) time of the $i$'th customer and assume that $(S_1,Y_1),(S_2,Y_2),\ldots$ is an iid sequence of bivariate random vectors with non-negative coordinates. A customer joins if and only if his patience time is not less than his prospective waiting time (i.e., the left-limit of the workload process at his arrival epoch). Let $\tau(x)$ be the first time when the system becomes empty and let $N^*_\lambda(\cdot)$ be the arrival process of those who join the queue. In the present work we suggest a novel coupling technique which is applied to derive stochastic upper bounds for the functionals: \begin{equation*} \int_0^{\tau(x)}g\circ W_x(t){\rm d}t\ \ \text{and}\ \ \int_0^{\tau(x)}g\circ W_x(t){\rm d}N^*_\lambda(t)\,, \end{equation*} where $W_x(\cdot)$ is the workload process in the queue and $g(\cdot)$ is any lower semi-continuous function. We also demonstrate how to utilise these bounds via some examples under the additional assumption that $\lambda(\cdot)$ is periodic.


title: Rationale-based Ensemble of Multiple QA Strategies for Zero-shot Knowledge-based VQA

abstract: Knowledge-based Visual Qustion-answering (K-VQA) necessitates the use of background knowledge beyond what is depicted in the image. Current zero-shot K-VQA methods usually translate an image to a single type of textual decision context and use a text-based model to answer the question based on it, which conflicts with the fact that K-VQA questions often require the combination of multiple question-answering strategies. In light of this, we propose Rationale-based Ensemble of Answer Context Tactics (REACT) to achieve a dynamic ensemble of multiple question-answering tactics, comprising Answer Candidate Generation (ACG) and Rationale-based Strategy Fusion (RSF). In ACG, we generate three distinctive decision contexts to provide different strategies for each question, resulting in the generation of three answer candidates. RSF generates automatic and mechanistic rationales from decision contexts for each candidate, allowing the model to select the correct answer from all candidates. We conduct comprehensive experiments on the OK-VQA and A-OKVQA datasets, and our method significantly outperforms state-of-the-art LLM-based baselines on all datasets.


title: TSI-Bench: Benchmarking Time Series Imputation

abstract: Effective imputation is a crucial preprocessing step for time series analysis. Despite the development of numerous deep learning algorithms for time series imputation, the community lacks standardized and comprehensive benchmark platforms to effectively evaluate imputation performance across different settings. Moreover, although many deep learning forecasting algorithms have demonstrated excellent performance, whether their modeling achievements can be transferred to time series imputation tasks remains unexplored. To bridge these gaps, we develop TSI-Bench, the first (to our knowledge) comprehensive benchmark suite for time series imputation utilizing deep learning techniques. The TSI-Bench pipeline standardizes experimental settings to enable fair evaluation of imputation algorithms and identification of meaningful insights into the influence of domain-appropriate missingness ratios and patterns on model performance. Furthermore, TSI-Bench innovatively provides a systematic paradigm to tailor time series forecasting algorithms for imputation purposes. Our extensive study across 34,804 experiments, 28 algorithms, and 8 datasets with diverse missingness scenarios demonstrates TSI-Bench's effectiveness in diverse downstream tasks and potential to unlock future directions in time series imputation research and analysis. The source code and experiment logs are available at https://github.com/WenjieDu/AwesomeImputation.


title: A quantum algorithm to simulate Lindblad master equations

abstract: We present a quantum algorithm for simulating a family of Markovian master equations that can be realized through a probabilistic application of unitary channels and state preparation. Our approach employs a second-order product formula for the Lindblad master equation, achieved by decomposing the dynamics into dissipative and Hamiltonian components and replacing the dissipative segments with randomly compiled, easily implementable elements. The sampling approach eliminates the need for ancillary qubits to simulate the dissipation process and reduces the gate complexity in terms of the number of jump operators. We provide a rigorous performance analysis of the algorithm. We also extend the algorithm to time-dependent Lindblad equations, generalize the noise model when there is access to limited ancillary systems, and explore applications beyond the Markovian noise model. A new error bound, in terms of the diamond norm, for second-order product formulas for time-dependent Liouvillians is provided that might be of independent interest.


title: PVDF transducer shape optimization for the characterization of anisotropic materials

abstract: In the context of the ultrasonic determination of mechanical properties, it is common to use oblique incident waves to characterize fluid-immersed anisotropic samples. The lateral displacement of the ultrasonic field owing to leaky guided wave phenomena poses a challenge for data inversion because beam spreading is rarely well represented by plane-wave models. In this study, a finite beam model based on the angular spectrum method was developed to estimate the influence of the transducer shape and position on the transmitted signals. Additionally, anisotropic solids were considered so that the beam skewing effect was contemplated. A small-emitter large-receiver configuration was chosen, and the ideal shape and position of the receiving transducer were obtained through a meta-heuristic optimization approach with the goal of achieving a measurement system that sufficiently resembles plane-wave propagation. A polyvinylidene fluoride receiver was fabricated and tested in three cases: a single-crystal silicon wafer, a lightly anisotropic stainless-steel plate, and a highly anisotropic composite plate. Good agreement was found between the measurements and the plane-wave model.


title: Using the Haken-Strobl-Reineker Model to Determine the Temperature Dependence of the Diffusion Coefficient

abstract: Stochastic quantum Liouville equations (SQLE) are widely used to model energy and charge dynamics in molecular systems. The Haken-Strobl-Reineker (HSR) SQLE is a particular paradigm in which the dynamical noise that destroys quantum coherences arises from a white noise (i.e., constant-frequency) spectrum. A system subject to the HSR SQLE thus evolves to its `high-temperature' limit, whereby all the eigenstates are equally populated. This result would seem to imply that the predictions of the HSR model, e.g., the temperature dependence of the diffusion coefficient, have no validity for temperatures lower than the particle bandwidth. The purpose of this paper is to show that this assumption is incorrect for translationally invariant systems. In particular, provided that the diffusion coefficient is determined via the mean-squared-displacement, considerations about detailed-balance are irrelevant. Consequently, the high-temperature prediction for the temperature dependence of the diffusion coefficient may be extrapolated to lower temperatures, provided that the bath remains classical. Thus, for diagonal dynamical disorder the long-time diffusion coefficient, $D_{\infty}(T) = c_{1} /T$, while for both diagonal and off-diagonal disorder, $D_{\infty}(T) = c_{1}/T + c_{2} T$, where $c_{2} \ll c_{1}$. An appendix discusses an alternative interpretation from the HSR model of the `quantum to classical' dynamics transition, whereby the dynamics is described as stochastically punctuated coherent motion.


title: Expanding quasisymmetric Schur $Q$-functions into peak Young quasisymmetric Schur functions

abstract: The dual immaculate and Young quasisymmetric Schur bases of quasisymmetric functions possess analogues in the peak algebra: respectively, the quasisymmetric Schur $Q$-functions and the peak Young quasisymmetric Schur functions. We show elements of the former basis expand into the latter basis with nonnegative coefficients.


title: Extracting Training Data from Unconditional Diffusion Models

abstract: As diffusion probabilistic models (DPMs) are being employed as mainstream models for generative artificial intelligence (AI), the study of their memorization of the raw training data has attracted growing attention. Existing works in this direction aim to establish an understanding of whether or to what extent DPMs learn by memorization. Such an understanding is crucial for identifying potential risks of data leakage and copyright infringement in diffusion models and, more importantly, for more controllable generation and trustworthy application of Artificial Intelligence Generated Content (AIGC). While previous works have made important observations of when DPMs are prone to memorization, these findings are mostly empirical, and the developed data extraction methods only work for conditional diffusion models. In this work, we aim to establish a theoretical understanding of memorization in DPMs with 1) a memorization metric for theoretical analysis, 2) an analysis of conditional memorization with informative and random labels, and 3) two better evaluation metrics for measuring memorization. Based on the theoretical analysis, we further propose a novel data extraction method called \textbf{Surrogate condItional Data Extraction (SIDE)} that leverages a classifier trained on generated data as a surrogate condition to extract training data directly from unconditional diffusion models. Our empirical results demonstrate that SIDE can extract training data from diffusion models where previous methods fail, and it is on average over 50\% more effective across different scales of the CelebA dataset.


title: OlympicArena: Benchmarking Multi-discipline Cognitive Reasoning for Superintelligent AI

abstract: The evolution of Artificial Intelligence (AI) has been significantly accelerated by advancements in Large Language Models (LLMs) and Large Multimodal Models (LMMs), gradually showcasing potential cognitive reasoning abilities in problem-solving and scientific discovery (i.e., AI4Science) once exclusive to human intellect. To comprehensively evaluate current models' performance in cognitive reasoning abilities, we introduce OlympicArena, which includes 11,163 bilingual problems across both text-only and interleaved text-image modalities. These challenges encompass a wide range of disciplines spanning seven fields and 62 international Olympic competitions, rigorously examined for data leakage. We argue that the challenges in Olympic competition problems are ideal for evaluating AI's cognitive reasoning due to their complexity and interdisciplinary nature, which are essential for tackling complex scientific challenges and facilitating discoveries. Beyond evaluating performance across various disciplines using answer-only criteria, we conduct detailed experiments and analyses from multiple perspectives. We delve into the models' cognitive reasoning abilities, their performance across different modalities, and their outcomes in process-level evaluations, which are vital for tasks requiring complex reasoning with lengthy solutions. Our extensive evaluations reveal that even advanced models like GPT-4o only achieve a 39.97% overall accuracy, illustrating current AI limitations in complex reasoning and multimodal integration. Through the OlympicArena, we aim to advance AI towards superintelligence, equipping it to address more complex challenges in science and beyond. We also provide a comprehensive set of resources to support AI research, including a benchmark dataset, an open-source annotation platform, a detailed evaluation tool, and a leaderboard with automatic submission features.


title: Chumor 1.0: A Truly Funny and Challenging Chinese Humor Understanding Dataset from Ruo Zhi Ba

abstract: Existing humor datasets and evaluations predominantly focus on English, lacking resources for culturally nuanced humor in non-English languages like Chinese. To address this gap, we construct Chumor, a dataset sourced from Ruo Zhi Ba (RZB), a Chinese Reddit-like platform dedicated to sharing intellectually challenging and culturally specific jokes. We annotate explanations for each joke and evaluate human explanations against two state-of-the-art LLMs, GPT-4o and ERNIE Bot, through A/B testing by native Chinese speakers. Our evaluation shows that Chumor is challenging even for SOTA LLMs, and the human explanations for Chumor jokes are significantly better than explanations generated by the LLMs.