title: ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU

abstract: Limited by the complexity of basis function (B-spline) calculations, Kolmogorov-Arnold Networks (KAN) suffer from restricted parallel computing capability on GPUs. This paper proposes a novel ReLU-KAN implementation that inherits the core idea of KAN. By adopting ReLU (Rectified Linear Unit) and point-wise multiplication, we simplify the design of KAN's basis function and optimize the computation process for efficient CUDA computing. The proposed ReLU-KAN architecture can be readily implemented on existing deep learning frameworks (e.g., PyTorch) for both inference and training. Experimental results demonstrate that ReLU-KAN achieves a 20x speedup compared to traditional KAN with 4-layer networks. Furthermore, ReLU-KAN exhibits a more stable training process with superior fitting ability while preserving the "catastrophic forgetting avoidance" property of KAN. You can get the code in https://github.com/quiqi/relu_kan


title: A Silicon Photonic 32-Input Coherent Combiner for Turbulence Mitigation in Free Space Optics Links

abstract: A photonic integrated circuit (PIC) for the coherent combination of 32 input optical signals into a single output fiber is reported. The PIC was fabricated using a low-loss thick silicon-on-insulator (SOI) process and packaged with 32 input and 1 output fibers. The basic building block is a 2x2 Mach-Zehnder interferometer (MZI) with an external (to the MZI branches) and an internal thermal phase shifter, and a bandwidth in excess of 80 kHz. The PIC monolithically integrates 31 MZIs and 31 germanium photodetectors, and is suitable in principle for turbulence mitigation in LEO-ground and horizontal free space optics links. Improvements to the device for the coherent combination of 64 inputs and for the reduction of insertion losses are also discussed


title: Multi-target stain normalization for histology slides

abstract: Traditional staining normalization approaches, e.g. Macenko, typically rely on the choice of a single representative reference image, which may not adequately account for the diverse staining patterns of datasets collected in practical scenarios. In this study, we introduce a novel approach that leverages multiple reference images to enhance robustness against stain variation. Our method is parameter-free and can be adopted in existing computational pathology pipelines with no significant changes. We evaluate the effectiveness of our method through experiments using a deep-learning pipeline for automatic nuclei segmentation on colorectal images. Our results show that by leveraging multiple reference images, better results can be achieved when generalizing to external data, where the staining can widely differ from the training set.


title: A Toolbox for Supporting Research on AI in Water Distribution Networks

abstract: Drinking water is a vital resource for humanity, and thus, Water Distribution Networks (WDNs) are considered critical infrastructures in modern societies. The operation of WDNs is subject to diverse challenges such as water leakages and contamination, cyber/physical attacks, high energy consumption during pump operation, etc. With model-based methods reaching their limits due to various uncertainty sources, AI methods offer promising solutions to those challenges. In this work, we introduce a Python toolbox for complex scenario modeling \& generation such that AI researchers can easily access challenging problems from the drinking water domain. Besides providing a high-level interface for the easy generation of hydraulic and water quality scenario data, it also provides easy access to popular event detection benchmarks and an environment for developing control algorithms.


title: Assessing the Performance of Chinese Open Source Large Language Models in Information Extraction Tasks

abstract: Information Extraction (IE) plays a crucial role in Natural Language Processing (NLP) by extracting structured information from unstructured text, thereby facilitating seamless integration with various real-world applications that rely on structured data. Despite its significance, recent experiments focusing on English IE tasks have shed light on the challenges faced by Large Language Models (LLMs) in achieving optimal performance, particularly in sub-tasks like Named Entity Recognition (NER). In this paper, we delve into a comprehensive investigation of the performance of mainstream Chinese open-source LLMs in tackling IE tasks, specifically under zero-shot conditions where the models are not fine-tuned for specific tasks. Additionally, we present the outcomes of several few-shot experiments to further gauge the capability of these models. Moreover, our study includes a comparative analysis between these open-source LLMs and ChatGPT, a widely recognized language model, on IE performance. Through meticulous experimentation and analysis, we aim to provide insights into the strengths, limitations, and potential enhancements of existing Chinese open-source LLMs in the domain of Information Extraction within the context of NLP.


title: LongSSM: On the Length Extension of State-space Models in Language Modelling

abstract: In this paper, we investigate the length-extension of state-space models (SSMs) in language modeling. Length extension involves training models on short sequences and testing them on longer ones. We show that state-space models trained with zero hidden states initialization have difficulty doing length extension. We explain this difficulty by pointing out the length extension is equivalent to polynomial extrapolation. Based on the theory, we propose a simple yet effective method - changing the hidden states initialization scheme - to improve the length extension. Moreover, our method shows that using long training sequence length is beneficial but not necessary to length extension. Changing the hidden state initialization enables the efficient training of long-memory model with a smaller training context length.


title: FightLadder: A Benchmark for Competitive Multi-Agent Reinforcement Learning

abstract: Recent advances in reinforcement learning (RL) heavily rely on a variety of well-designed benchmarks, which provide environmental platforms and consistent criteria to evaluate existing and novel algorithms. Specifically, in multi-agent RL (MARL), a plethora of benchmarks based on cooperative games have spurred the development of algorithms that improve the scalability of cooperative multi-agent systems. However, for the competitive setting, a lightweight and open-sourced benchmark with challenging gaming dynamics and visual inputs has not yet been established. In this work, we present FightLadder, a real-time fighting game platform, to empower competitive MARL research. Along with the platform, we provide implementations of state-of-the-art MARL algorithms for competitive games, as well as a set of evaluation metrics to characterize the performance and exploitability of agents. We demonstrate the feasibility of this platform by training a general agent that consistently defeats 12 built-in characters in single-player mode, and expose the difficulty of training a non-exploitable agent without human knowledge and demonstrations in two-player mode. FightLadder provides meticulously designed environments to address critical challenges in competitive MARL research, aiming to catalyze a new era of discovery and advancement in the field. Videos and code at https://sites.google.com/view/fightladder/home.


title: On the Computation of 2-Dimensional Recurrence Equations

abstract: The paper demonstrates how a 2-dimensional recurrence problem can be reduced to a mono-dimensional recurrence problem where the Kogge and Stone algorithm is applicable, with the computation time - excluding the reduction step - becoming proportional to $log_2(2n-1)$.


title: Simultaneous spectropolarimetric observations in the H$\alpha$ and Ca II 8662 {\AA} lines of an active region

abstract: We present spectropolarimetric observations of an active region recorded simultaneously in the H$\alpha$ Ca II 8662 {\AA} lines. The sunspot exhibits multiple structures, including a lightbridge and a region where Ca II 8662 {\AA} line core is in emission. Correspondingly, the H$\alpha$ line core image displays brightening in the emission region, with the spectral profiles showing elevated line cores. The stratification of the line-of-sight magnetic field is inferred through non-LTE multiline inversions of the Ca II 8662 {\AA} line and the weak field approximation over the H$\alpha$ line. The field strength inferred from the H$\alpha$ line core is consistently smaller than that inferred from inversions at $\log \tau_{500}$ = $-$4.5. However, the study finds no correlation between the WFA over the core of the H$\alpha$ line and that inferred from inversions at $\log \tau_{500}$ = $-$4.5. In regions exhibiting emission features, the morphology of the magnetic field at $\log \tau_{500}$ = $-$4.5 resembles that at $\log \tau_{500}$ = $-$1, with slightly higher or comparable field strengths. The magnetic field morphology inferred from the core of the H$\alpha$ line is also similar to that inferred from the full spectral range of the H$\alpha$ line in the emission region. The field strength inferred in the lightbridge at $\log \tau_{500}$ = $-$1 is smaller than the surrounding umbral regions and comparable at $\log \tau_{500}$ = $-$4.5. Similarly, the field strength inferred in the lightbridge from the WFA over the H$\alpha$ line appears lower compared to the surrounding umbral regions.


title: Predicting the Curie temperature of magnetic materials with automated calculations across chemistries and structures

abstract: We develop a technique for predicting the Curie temperature of magnetic materials using density functional theory calculations suitable to include in high-throughput frameworks. We apply four different models, including physically relevant observables and assess numerical constants by studying 32 ferro- and ferrimagnets. With the best-performing model, the Curie temperature can be predicted with a mean absolute error of approximately 126 K. As predictive factors, the models consider either the energy differences between the magnetic ground state and a magnetically disordered paramagnetic state, or the average constraining fields acting on magnetic moments in a disordered local moments calculation. Additionally, the energy differences are refined by incorporating the magnetic entropy of the paramagnetic state and the number of nearest magnetic neighbors of the magnetic atoms. The most advanced model is found to extend well into Fe$_{1-x}$Co$_x$ alloys, indicating the potential efficacy of utilizing our model in designing materials with tailored Curie temperatures by altering alloy compositions. This examination can illuminate the factors influencing magnetic transition temperatures in magnetic materials and provide insights into how they can be employed to make quantitative predictions of Curie temperatures. Our approach is not restricted to specific crystal structures or chemical compositions. It offers a more cost-effective alternative, in terms of human time and need for hands-on oversight, to other density functional theory methods for predicting the Curie temperature. As a result, it provides a practical strategy for conducting high-throughput screening for new technologically applicable magnetic materials. Alternatively, it can complement ML-based screening of magnetic materials by integrating physical principles into such approaches, thereby enhancing their prediction accuracy.


title: Foundations of logic programming in hybrid-dynamic quantum logic

abstract: The main contribution of the present paper is the introduction of a simple yet expressive hybrid-dynamic logic for describing quantum programs. This version of quantum logic can express quantum measurements and unitary evolutions of states in a natural way based on concepts advanced in (hybrid and dynamic) modal logics. We then study Horn clauses in the hybrid-dynamic quantum logic proposed, and develop a series of results that lead to an initial semantics theorem for sets of clauses that are satisfiable. This shows that a significant fragment of hybrid-dynamic quantum logic has good computational properties, and can serve as a basis for defining executable languages for specifying quantum programs. We set the foundations of logic programming in this fragment by proving a variant of Herbrand's theorem, which reduces the semantic entailment of a logic-programming query by a program to the search of a suitable substitution.


title: Multi-level quantum signal processing with applications to ground state preparation using fast-forwarded Hamiltonian evolution

abstract: The preparation of the ground state of a Hamiltonian $H$ with a large spectral radius has applications in many areas such as electronic structure theory and quantum field theory. Given an initial state with a constant overlap with the ground state, and assuming that the Hamiltonian $H$ can be efficiently simulated with an ideal fast-forwarding protocol, we first demonstrate that employing a linear combination of unitaries (LCU) approach can prepare the ground state at a cost of $\mathcal{O}(\log^2(\|H\| \Delta^{-1}))$ queries to controlled Hamiltonian evolution. Here $\|H\|$ is the spectral radius of $H$ and $\Delta$ the spectral gap. However, traditional Quantum Signal Processing (QSP)-based methods fail to capitalize on this efficient protocol, and its cost scales as $\mathcal{O}(\|H\| \Delta^{-1})$. To bridge this gap, we develop a multi-level QSP-based algorithm that exploits the fast-forwarding feature. This novel algorithm not only matches the efficiency of the LCU approach when an ideal fast-forwarding protocol is available, but also exceeds it with a reduced cost that scales as $\mathcal{O}(\log(\|H\| \Delta^{-1}))$. Additionally, our multi-level QSP method requires only $\mathcal{O}(\log(\|H\| \Delta^{-1}))$ coefficients for implementing single qubit rotations. This eliminates the need for constructing the PREPARE oracle in LCU, which prepares a state encoding $\mathcal{O}(\|H\| \Delta^{-1})$ coefficients regardless of whether the Hamiltonian can be fast-forwarded.


title: Boundedness of variation, oscillation and maximal differential transform on BMO space

abstract: In this paper, we prove that the oscillation operator, variation operator and maximal differential transform associated with the approximate identities are bounded from ${\rm BMO}({\mathbb R}^n)$ to its subspace ${\rm BLO}({\mathbb R}^n)$.


title: Fast and Practical Strassen's Matrix Multiplication using FPGAs

abstract: Matrix multiplication is a cornerstone operation in a wide array of scientific fields, including machine learning and computer graphics. The standard algorithm for matrix multiplication has a complexity of $\mathcal{O}(n^3)$ for $n\times n$ matrices. Strassen's algorithm improves this to $\mathcal{O}(n^{2.807})$, but its practicality is limited for small to medium matrix sizes due to the large number of additions it introduces. This paper presents a novel FPGA-based implementation of Strassen's algorithm that achieves superior speed over an optimized General Matrix Multiply (GeMM) implementation for matrices as small as $n=256$. Our design, tested extensively on two high-performance FPGA accelerators (Alveo U50 and U280) across various data types, matches or surpasses the performance of a highly optimized baseline across a range of matrix sizes.


title: Long-Time Behavior of Zero-Sum Linear-Quadratic Stochastic Differential Games

abstract: The paper investigates the long-time behavior of zero-sum linear-quadratic stochastic differential games, aiming to demonstrate that, under appropriate conditions, both the saddle strategy and the optimal state process exhibit the exponential turnpike property. Namely, for the majority of the time horizon, the distributions of the saddle strategy and the optimal state process closely stay near certain (time-invariant) distributions $\nu_1^*$, $\nu_2^*$ and $\mu^*$, respectively. Additionally, as a byproduct, we solve the infinite horizon version of the differential game and derive closed-loop representations for its open-loop saddle strategy, which has not been proved in the literature.


title: WEIRD ICWSM: How Western, Educated, Industrialized, Rich, and Democratic is Social Computing Research?

abstract: Much of the research in social computing analyzes data from social media platforms, which may inherently carry biases. An overlooked source of such bias is the over-representation of WEIRD (Western, Educated, Industrialized, Rich, and Democratic) populations, which might not accurately mirror the global demographic diversity. We evaluated the dependence on WEIRD populations in research presented at the AAAI ICWSM conference; the only venue whose proceedings are fully dedicated to social computing research. We did so by analyzing 494 papers published from 2018 to 2022, which included full research papers, dataset papers and posters. After filtering out papers that analyze synthetic datasets or those lacking clear country of origin, we were left with 420 papers from which 188 participants in a crowdsourcing study with full manual validation extracted data for the WEIRD scores computation. This data was then used to adapt existing WEIRD metrics to be applicable for social media data. We found that 37% of these papers focused solely on data from Western countries. This percentage is significantly less than the percentages observed in research from CHI (76%) and FAccT (84%) conferences, suggesting a greater diversity of dataset origins within ICWSM. However, the studies at ICWSM still predominantly examine populations from countries that are more Educated, Industrialized, and Rich in comparison to those in FAccT, with a special note on the 'Democratic' variable reflecting political freedoms and rights. This points out the utility of social media data in shedding light on findings from countries with restricted political freedoms. Based on these insights, we recommend extensions of current "paper checklists" to include considerations about the WEIRD bias and call for the community to broaden research inclusivity by encouraging the use of diverse datasets from underrepresented regions.


title: Giant cluster formation in a simple model for globular colloidal aggregates

abstract: A simple model of fluid whose constituent particles interact via a short range attractive and long range repulsive potential is used to model the aggregation of giant clusters made up of hundreds of particles. The model can be thought of as a simplistic representation membraneless organelles or a straightforward rendition of colloid flocculation into large spherical aggregates. We illustrate how temperature and particle density influence the cluster size distribution and vary specially the inter-cluster dynamics. The system is shown to exhibit two well separated length and time scales, which can be tuned by the balance between repulsive and attractive forces.


title: MaskSR: Masked Language Model for Full-band Speech Restoration

abstract: Speech restoration aims at restoring high quality speech in the presence of a diverse set of distortions. Although several deep learning paradigms have been studied for this task, the power of the recently emerging language models has not been fully explored. In this paper, we propose MaskSR, a masked language model capable of restoring full-band 44.1 kHz speech jointly considering noise, reverb, clipping, and low bandwidth. MaskSR works with discrete acoustic tokens extracted using a pre-trained neural codec. During training, MaskSR is optimized to predict randomly masked tokens extracted from the high quality target speech, conditioned on the corrupted speech with various distortions. During inference, MaskSR reconstructs the target speech tokens with efficient iterative sampling. Extensive experiments show that MaskSR obtains competitive results on both the full-band speech restoration task and also on sub-tasks compared with a wide range of models.


title: Multi-state Chiral Switching Through Adiabaticity Control in Encircling Exceptional Points

abstract: Dynamic encircling of exceptional points has attracted significant interest in recent years, as it can facilitate chiral transmission selectivity due to a nontrivial eigenstate evolution. Recently, multi-state systems have been explored, associated with more complex topologies supporting a larger number of exceptional points, but chiral switching among multiple eigenstates has remained elusive in experiments. Here, we overcome this challenge by dividing the eigenstate space into multiple subspaces by controlling the adiabaticity. The eigenstates in different subspaces can evolve without crosstalk, and chiral switching occurs as the eigenstates within each subspace are subject to a non-adiabatic transition while they encircle exceptional points. We experimentally demonstrate this phenomenon by reporting chiral switching for two groups of optical modes at telecom wavelengths in a four-state optical system, and theoretically demonstrate that our approach can be extended to higher-order systems. Our findings pave new avenues for studying chiral dynamics based on exceptional-point physics in multi-state systems, and offer opportunities to develop multiplexed photonic devices.


title: Hybrid-Dynamic Ehrenfeucht-Fra\"iss\'e Games

abstract: Ehrenfeucht-Fra\"iss\'e games provide means to characterize elementary equivalence for first-order logic, and by standard translation also for modal logics. We propose a novel generalization of Ehrenfeucht- Fra\"iss\'e games to hybrid-dynamic logics which is direct and fully modular: parameterized by the features of the hybrid language we wish to include, for instance, the modal and hybrid language operators as well as first-order existential quantification. We use these games to establish a new modular Fra\"iss\'e-Hintikka Theorem for hybrid-dynamic propositional logic and its various fragments. We study the relationship between countable game equivalence (determined by countable Ehrenfeucht- Fra\"iss\'e games) and bisimulation (determined by countable back-and-forth systems). In general, the former turns out to be weaker than the latter, but under certain conditions on the language, the two coincide. We also use games to prove that for reachable image-finite Kripke structures elementary equivalence implies isomorphism.


title: Brightened emission of dark trions in transition-metal dichalcogenide monolayers

abstract: The optical emission spectra of semiconducting transition-metal dichalcogenide monolayers highlight fascinating recombination processes of charged excitons (trions). When charge tunable WSe2 monolayers are moderately doped with electrons, a strong luminescence peak emerges just below the well-understood spectral lines associated with the recombination of negatively charged bright and dark trions. Despite previous investigations, its origin remains elusive. Here, we demonstrate that this luminescence peak is the result of electron-electron assisted recombination that brightens the dark trion emission. Supporting evidence for this second-order recombination process comes from identifying the equivalent brightened emission of positively charged dark trions when the monolayer is electrostatically doped with holes. Remarkably, the discovered hole-hole assisted luminescence peak emerges in the near infrared, about 500 meV below the well-studied spectral region of excitons and trions. In addition to identifying new recombination channels of these excitonic complexes, our findings accurately determine the spin-split energies of the conduction and valence bands. Both of which play crucial roles in understanding the optical properties of WSe2 based homo- and hetero-structures.


title: MS-Mapping: Multi-session LiDAR Mapping with Wasserstein-based Keyframe Selection

abstract: Large-scale multi-session LiDAR mapping plays a crucial role in various applications but faces significant challenges in data redundancy and pose graph scalability. This paper present MS-Mapping, a novel multi-session LiDAR mapping system that combines an incremental mapping scheme with support for various LiDAR-based odometry, enabling high-precision and consistent map assembly in large-scale environments. Our approach introduces a real-time keyframe selection method based on the Wasserstein distance, which effectively reduces data redundancy and pose graph complexity. We formulate the LiDAR point cloud keyframe selection problem using a similarity method based on Gaussian mixture models (GMM) and tackle the real-time challenge by employing an incremental voxel update method. Extensive experiments on large-scale campus scenes and over \SI{12.8}{km} of public and self-collected datasets demonstrate the efficiency, accuracy, and consistency of our map assembly approach. To facilitate further research and development in the community, we make our code https://github.com/JokerJohn/MS-Mapping and datasets publicly available.


title: The Benchmark Mode $\Omega_c \to \Omega^-\pi^+$ and Its Related Processes

abstract: The benchmark mode $\Omega_c^0\to \Omega^- \pi^+$, which receives purely factorization contribution, is of great importance among all the decay channels of $\Omega_c^0$ decays. In this work, within the framework of non-relativistic quark model (NRQM), we calculate all the 6 baryon transition form factors involving $\frac12 ^+\to \frac32 ^+$ decays. The absolute branching fractions of non-leptonic decays $\Omega_c^0\to \Omega^- \pi^+$, $\Omega_c^0\to \Omega^- \rho^+$ and $\Omega_c^0\to \Xi^- \pi^+$ as well as semi-leptonic decays $\Omega_c^0\to \Omega^- \ell^+ \nu_{\ell} \; (\ell=e,\mu)$ are calculated although they cannot be measured directly by current experiment. Based on the prediction $\mathcal{B}(\Omega_c^0\to\Omega^-\pi^+)=3.43\%$ in our work, we further predict the ratios between interested modes and the benchmark mode, giving $R(\Xi^-\pi^+)=0.156$, $R(\Omega^-\rho^+)=5.33$, $R(\Omega^- e^+\nu_e)=1.18$ and $R(\Omega^- \mu^+\nu_\mu)=1.11$. The predictions on $\Omega_c^0\to \Xi^-\pi^+$ and $\Omega_c^0\to \Omega^- e^+\nu$ agree well with recent measured ratios reported by LHCb in 2023 and ALICE in 2024, respectively.


title: Blow-up of solutions to semilinear wave equations with spatial derivatives

abstract: For small-amplitude semilinear wave equations with power type nonlinearity on the first-order spatial derivative, the expected sharp upper bound on the lifespan of solutions is obtained for both critical cases and subcritical cases, for all spatial dimensions $n>1$. It is achieved uniformly by constructing the integral equations, deriving the ordinary differential inequality system, and iteration argument. Combined with the former works, the sharp lifespan estimates for this problem are completely established, at least for the spherical symmetric case.


title: Homogeneous nucleation for two-dimensional Kawasaki dynamics

abstract: This is the third in a series of three papers in which we study a lattice gas subject to Kawasaki dynamics at inverse temperature $\beta>0$ in a large finite box $\Lambda_\beta \subset \mathbb{Z}^2$ whose volume depends on $\beta$. Each pair of neighbouring particles has a negative binding energy $-U<0$, while each particle has a positive activation energy $\Delta>0$. The initial configuration is drawn from the grand-canonical ensemble restricted to the set of configurations where all the droplets are subcritical. Our goal is to describe, in the metastable regime $\Delta \in (U,2U)$ and in the limit as $\beta\to\infty$, how and when the system nucleates, i.e., creates a critical droplet somewhere in $\Lambda_\beta$ that subsequently grows by absorbing particles from the surrounding gas. In the first paper we showed that subcritical droplets behave as quasi-random walks. In the second paper we used the results in the first paper to analyse how subcritical droplets form and dissolve on multiple space-time scales when the volume is moderately large, namely, $|\Lambda_\beta| = \mathrm{e}^{\theta\beta}$ with $\Delta < \theta < 2\Delta-U$. In the present paper we consider the setting where the volume is very large, namely, $|\Lambda_\beta| = \mathrm{e}^{\Theta\beta}$ with $\Delta < \Theta < \Gamma-(2\Delta-U)$, where $\Gamma$ is the energy of the critical droplet in the local model with fixed volume, and use the results in the first two papers to identify the nucleation time and the tube of typical trajectories towards nucleation. We will see that in a very large volume critical droplets appear more or less independently in boxes of moderate volume, a phenomenon referred to as homogeneous nucleation. One of the key ingredients in the proof is an estimate showing that no information can travel between these boxes on relevant time scales.

categories: math.PR cond-mat.stat-mech math-ph math.MP


title: Exploring Mathematical Extrapolation of Large Language Models with Synthetic Data

abstract: Large Language Models (LLMs) have shown excellent performance in language understanding, text generation, code synthesis, and many other tasks, while they still struggle in complex multi-step reasoning problems, such as mathematical reasoning. In this paper, through a newly proposed arithmetical puzzle problem, we show that the model can perform well on multi-step reasoning tasks via fine-tuning on high-quality synthetic data. Experimental results with the open-llama-3B model on three different test datasets show that not only the model can reach a zero-shot pass@1 at 0.44 on the in-domain dataset, it also demonstrates certain generalization capabilities on the out-of-domain datasets. Specifically, this paper has designed two out-of-domain datasets in the form of extending the numerical range and the composing components of the arithmetical puzzle problem separately. The fine-tuned models have shown encouraging performance on these two far more difficult tasks with the zero-shot pass@1 at 0.33 and 0.35, respectively.


title: Universal gravitational self-force for a point mass orbiting around a compact star

abstract: In this work, we study the gravitational back-reaction (i.e., the "self-force") of a point mass moving around a non-rotating, compact star on a circular orbit. We find that the additional self-force, comparing with the case with a point mass orbiting around a Schwarzschild black hole, can be well characterized by an universal frequency-dependent function multiplied by the (dynamical) tidal deformability of the compact star. This finding provides the foundation for building the waveform model for an extreme mass-ratio inspiral system around a star-like black hole mimicker, which is relevant for testing General Relativity and exotic compact objects with space-borne gravitational wave detectors.


title: Simulation-based approach for Multiproject Scheduling based on composite priority rules

abstract: This paper presents a simulation approach to enhance the performance of heuristics for multi-project scheduling. Unlike other heuristics available in the literature that use only one priority criterion for resource allocation, this paper proposes a structured way to sequentially apply more than one priority criterion for this purpose. By means of simulation, different feasible schedules are obtained to, therefore, increase the probability of finding the schedule with the shortest duration. The performance of this simulation approach was validated with the MPSPLib library, one of the most prominent libraries for resource-constrained multi-project scheduling. These results highlight the proposed method as a useful option for addressing limited time and resources in portfolio management.


title: A Bayesian Approach to Online Planning

abstract: The combination of Monte Carlo tree search and neural networks has revolutionized online planning. As neural network approximations are often imperfect, we ask whether uncertainty estimates about the network outputs could be used to improve planning. We develop a Bayesian planning approach that facilitates such uncertainty quantification, inspired by classical ideas from the meta-reasoning literature. We propose a Thompson sampling based algorithm for searching the tree of possible actions, for which we prove the first (to our knowledge) finite time Bayesian regret bound, and propose an efficient implementation for a restricted family of posterior distributions. In addition we propose a variant of the Bayes-UCB method applied to trees. Empirically, we demonstrate that on the ProcGen Maze and Leaper environments, when the uncertainty estimates are accurate but the neural network output is inaccurate, our Bayesian approach searches the tree much more effectively. In addition, we investigate whether popular uncertainty estimation methods are accurate enough to yield significant gains in planning. Our code is available at: https://github.com/nirgreshler/bayesian-online-planning.


title: Pseudo-transition between antiferromagnetic and charge orders in a minimal spin-pseudospin model of one-dimensional cuprates

abstract: This study rigorously investigates the phenomenon of a pseudo-transition in a minimal spinpseudospin model, serving as a simplified model of one-dimensional cuprate chains [CuO]n, by making use of the transfer-matrix method. The studied spin-pseudospin model of one-dimensional cuprate chains [CuO]n reveals a peculiar pseudo-transition between a charged-ordered phase and an antiferromagnetic phase, which is accompanied with anomalous behavior of magnetic and thermodynamic quantities. While the entropy and short-range correlations undergo near the pseudo-transition steep continuous changes reminiscent of a discontinuous phase transition, the specific heat displays a sizable sharp peak akin to a continuous phase transition.


title: Kernel vs. Kernel: Exploring How the Data Structure Affects Neural Collapse

abstract: Recently, a vast amount of literature has focused on the "Neural Collapse" (NC) phenomenon, which emerges when training neural network (NN) classifiers beyond the zero training error point. The core component of NC is the decrease in the within class variability of the network's deepest features, dubbed as NC1. The theoretical works that study NC are typically based on simplified unconstrained features models (UFMs) that mask any effect of the data on the extent of collapse. In this paper, we provide a kernel-based analysis that does not suffer from this limitation. First, given a kernel function, we establish expressions for the traces of the within- and between-class covariance matrices of the samples' features (and consequently an NC1 metric). Then, we turn to focus on kernels associated with shallow NNs. First, we consider the NN Gaussian Process kernel (NNGP), associated with the network at initialization, and the complement Neural Tangent Kernel (NTK), associated with its training in the "lazy regime". Interestingly, we show that the NTK does not represent more collapsed features than the NNGP for prototypical data models. As NC emerges from training, we then consider an alternative to NTK: the recently proposed adaptive kernel, which generalizes NNGP to model the feature mapping learned from the training data. Contrasting our NC1 analysis for these two kernels enables gaining insights into the effect of data distribution on the extent of collapse, which are empirically aligned with the behavior observed with practical training of NNs.


title: MARS: Benchmarking the Metaphysical Reasoning Abilities of Language Models with a Multi-task Evaluation Dataset

abstract: To enable Large Language Models (LLMs) to function as conscious agents with generalizable reasoning capabilities, it is crucial that they possess the reasoning ability to comprehend situational changes (transitions) in distribution triggered by environmental factors or actions from other agents. Despite its fundamental significance, this ability remains underexplored due to the complexity of modeling infinite possible changes in an event and their associated distributions, coupled with the lack of benchmark data with situational transitions. Addressing these gaps, we propose a novel formulation of reasoning with distributional changes as a three-step discriminative process, termed as MetAphysical ReaSoning. We then introduce the first-ever benchmark, MARS, comprising three tasks corresponding to each step. These tasks systematically assess LLMs' capabilities in reasoning the plausibility of (i) changes in actions, (ii) states caused by changed actions, and (iii) situational transitions driven by changes in action. Extensive evaluations with 20 (L)LMs of varying sizes and methods indicate that all three tasks in this process pose significant challenges, even for state-of-the-art LLMs and LMs after fine-tuning. Further analyses reveal potential causes for the underperformance of LLMs and demonstrate that pre-training them on large-scale conceptualization taxonomies can potentially enhance their metaphysical reasoning capabilities. Our data and models are publicly accessible at https://github.com/HKUST-KnowComp/MARS.


title: Degrees are Useless in SNORT When Measuring Temperature

abstract: Snort is a two-player game played on a simple graph in which players alternately colour a vertex such that they do not colour adjacent to their opponents' vertex. In combinatorial game theory, the temperature of a position is a measure of the urgency of moving first. It is known that the temperature of \snort in general is infinite ($K_{1,n}$ has temperature $n$). We show that the temperature in addition can be infinitely larger than the degree of the board being played on. We do so by constructing a family of positions in which the temperature grows twice as fast as the degree of the board.


title: Description Complexity of Unary Structures in First-Order Logic with Links to Entropy

abstract: The description complexity of a model is the length of the shortest formula that defines the model. We study the description complexity of unary structures in first-order logic FO, also drawing links to semantic complexity in the form of entropy. The class of unary structures provides a simple way to represent tabular Boolean data sets as relational structures. We define structures with FO-formulas that are strictly linear in the size of the model as opposed to using the naive quadratic ones, and we use arguments based on formula size games to obtain related lower bounds for description complexity. We also obtain a precise asymptotic result on the expected description complexity of a randomly selected structure. We then give bounds on the relationship between Shannon entropy and description complexity. We extend this relationship also to Boltzmann entropy by establishing an asymptotic match between the two entropies. Despite the simplicity of unary structures, our arguments require the use of formula size games, Stirling's approximation and Chernoff bounds.


title: Euler-Heisenberg black hole surrounded by quintessence in the background of perfect fluid dark matter: Thermodynamics, Shadows and Quasinormal modes

abstract: Current observations show that a significant fraction of the Universe is composed of dark energy and dark matter. In this paper, we investigate the simultaneous effects of these dark sectors on the Euler-Heisenberg black hole, using the quintessence matter field and perfect fluid to model them. In particular, we study the black hole's thermodynamics, shadows, and quasinormal modes, and discuss in detail how these properties change with relatively large or small dark sector components.


title: UniOQA: A Unified Framework for Knowledge Graph Question Answering with Large Language Models

abstract: OwnThink stands as the most extensive Chinese open-domain knowledge graph introduced in recent times. Despite prior attempts in question answering over OwnThink (OQA), existing studies have faced limitations in model representation capabilities, posing challenges in further enhancing overall accuracy in question answering. In this paper, we introduce UniOQA, a unified framework that integrates two complementary parallel workflows. Unlike conventional approaches, UniOQA harnesses large language models (LLMs) for precise question answering and incorporates a direct-answer-prediction process as a cost-effective complement. Initially, to bolster representation capacity, we fine-tune an LLM to translate questions into the Cypher query language (CQL), tackling issues associated with restricted semantic understanding and hallucinations. Subsequently, we introduce the Entity and Relation Replacement algorithm to ensure the executability of the generated CQL. Concurrently, to augment overall accuracy in question answering, we further adapt the Retrieval-Augmented Generation (RAG) process to the knowledge graph. Ultimately, we optimize answer accuracy through a dynamic decision algorithm. Experimental findings illustrate that UniOQA notably advances SpCQL Logical Accuracy to 21.2% and Execution Accuracy to 54.9%, achieving the new state-of-the-art results on this benchmark. Through ablation experiments, we delve into the superior representation capacity of UniOQA and quantify its performance breakthrough.


title: Categorical Quantum Volume Operator

abstract: We present a generalization of the quantum volume operator quantifying the volume in curved three-dimensional discrete geometries. In its standard form, the quantum volume operator is constructed from tetrahedra whose faces are endowed with irreducible representations of $\mathrm{SU}(2)$. Here, we show two equivalent constructions that allow general objects in fusion categories as degrees of freedom. First, we compute the volume operator for ribbon fusion categories. This includes the important class of modular tensor categories (such as quantum doubles), which are the building blocks of anyon models. Second, we further generalize the volume operator to spherical fusion categories by relaxing the categorical analog of the closure constraint (known as tetrahedral symmetry). In both cases, we obtain a volume operator that is Hermitian, provided that the input category is unitary. As an illustrative example, we consider the case of $\mathrm{SU}(2)_k$ and show that the standard $\mathrm{SU}(2)$ volume operator is recovered in the limit $k\rightarrow\infty$.


title: Symmetry-Governed Dynamics of Magnetic Skyrmions Under Field Pulses

abstract: Topological magnetic solitons, such as skyrmions, exhibit intriguing particle-like properties that make them attractive for fundamental research and practical applications. While many magnetic systems can host skyrmions as statically stable configurations, chiral magnets stand out for their ability to accommodate a wide diversity of skyrmions with arbitrary topological charges and varied morphologies. Despite extensive investigation, a complete understanding of chiral magnetic skyrmions has remained elusive. We present a classification of all chiral skyrmions, demonstrating three classes based on their response to external magnetic field pulses: stationary, translating, and rotating. We highlight the role of magnetic texture symmetry in this classification. Skyrmions with varied dynamics offer avenues for exploring phenomena like skyrmion-skyrmion scattering that might be crucial for future applications.


title: Timescale bridging in atomistic simulations of epoxy polymer mechanics using non-affine deformation theory

abstract: Developing a deep understanding of macroscopic mechanical properties of amorphous systems which lack structural periodicity, has posed a key challenge, not only at the level of theory but also in molecular simulations. Despite significant advancements in computational resources, there is a vast timescale disparity, more than 6 orders of magnitude, between mechanical properties probed in simulations compared to experiments. Using the theoretical framework of non-affine lattice dynamics (NALD), based on the instantaneous normal modes analysis determined through the dynamical matrix of the system, we study the viscoelastic response of a cross-linked epoxy system of diglycidyl ether of bisphenol A (DGEBA) and poly(oxypropylene) diamine, over many orders of magnitude in deformation frequency, below the glass transition temperature. Predictions of the elastic modulus are satisfactorily validated against the non-equilibrium molecular dynamics simulations in the high-frequency regime, and against experimental data from dynamic mechanical analysis at frequencies $ \sim 1 {\rm Hz}$, hence successfully bridging the timescale gap. The comparison shows that non-affine displacements at the atomic level account for nearly two orders of magnitude reduction in the low-frequency elastic modulus of the polymer glass, compared to affine elasticity estimates. The analysis also reveals the role of internal stresses (as reflected in the instantaneous normal modes), which act as to strengthen the mechanical response.

categories: cond-mat.soft cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.other physics.chem-ph


title: Deriving the size and shape of the ALBA electron beam with optical synchrotron radiation interferometry using aperture masks: technical choices

abstract: We explore non-redundant aperture masking to derive the size and shape of the ALBA synchrotron light source at optical wavelengths using synchrotron radiation interferometry. We show that non-redundant masks are required due to phase fluctuations arising within the experimental set-up. We also show, using closure phase, that the phase fluctuations are factorizable into element-based errors. We employ multiple masks, including 2, 3, 5, and 6 hole configurations. We develop a process for self-calibration of the element-based amplitudes (square root of flux through the aperture), which corrects for non-uniform illumination over the mask, in order to derive visibility coherences and phases, from which the source size and shape can be derived. We explore the optimal procedures to obtain the most reliable results with the 5-hole mask, based on the temporal scatter in measured coherences and closure phases. We find that the closure phases are very stable, and close to zero (within $2^o$). Through uv-modeling, we consider the noise properties of the experiment and conclude that our visibility measurements per frame are likely accurate to an rms scatter of $\sim 1\%$.


title: Investigating controlled teleportation capability of quantum states with respect to $k$-separability

abstract: Quantum teleportation is an essential application of quantum entanglement. The examination of teleportation fidelity in two-party standard teleportation schemes reveals a critical threshold distinguishing separable and entangled states. For separable states, their teleportation fidelities cannot exceed the threshold, emphasizing the significance of entanglement. We extend this analysis to multi-party scenarios known as controlled teleportation. Our study provides thresholds that $N$-qudit $k$-separable states cannot exceed in a controlled teleportation scheme, where $N \ge 3$ and $2 \le k \le N$. This not only establishes a standard for utilizing a given quantum state as a resource in controlled teleportation but also enhances our understanding of the influence of the entanglement structure on controlled teleportation performance. In addition, we show that genuine multipartite entanglement is not a prerequisite for achieving a high controlled teleportation capability.


title: A clock is just a way to tell the time: gravitational algebras in cosmological spacetimes

abstract: We study the algebra of observables in semiclassical quantum gravity for cosmological backgrounds, focusing on two key examples: slow-roll inflation and evaporating Schwarzschild-de Sitter black holes. In both cases, we demonstrate the existence of a nontrivial algebra of diffeomorphism-invariant observables \emph{without} the introduction of an external clock system or the presence of any asymptotic gravitational charges. Instead, the rolling inflaton field and the evaporating black hole act as physical clocks that allow a definition of gauge-invariant observables at $G = 0$. The resulting algebras are both Type II$_\infty$ factors, but neither is manifestly a crossed product algebra. We establish a connection between the Type II entropy of these algebras and generalized entropies for appropriate states. Our work extends previous results on Type II gravitational algebras and highlights the crucial role of out-of-equilibrium dynamics for defining gauge-invariant observables in semiclassical canonically quantised gravity. We also briefly discuss the construction of gauge-invariant algebras for compact wedges bounded by extremal surfaces in generic spacetimes (i.e. in the absence of any Killing symmetry). In contrast to the inflaton and black hole cases, this algebra does end up being a simple crossed product. No clock or asymptotic charges are required because of the absence of any symmetry in the classical background.


title: Spectral line fluorescence in moving envelopes of stars

abstract: The formation of optical fluorescent lines in moving media has not yet been studied in detail, so this work represents a first step in investigating the fluorescence process in different types of macroscopic velocity fields: (a) accelerated outflows, (b) accelerated infalls, and (c) non-monotonic velocity fields (such as an accelerating outflow followed by a deceleration region or an accretion shock front). We solve the radiative transfer equations for the lines involved in the fluorescent process, assuming spherical symmetry and a simplified atomic model. We use the framework of the generalized Sobolev theory for computing the interacting, non-local source functions. The emergent line fluxes are then integrated exactly. Because of Doppler shifts in the moving gaseous envelope, photons of the three lines involved in TTS FeI fluorescence CaII H, FeI 3969, and H_epsilon interact with each other in a complex way, so that fluorescent amplification of the line flux occurs not only for FeI 3969, but also for the other two lines, in all velocity fields that we investigated. With the assumption of LTE populations, the line source functions of moderately optically thick lines are not strongly affected by line interactions, while they are depressed in the inner envelope for optically thick lines because of stellar photon absorption in the interaction regions. Fluorescent amplification takes place mainly in the observer's reference frame during the flux integration. Further comparison with observations will require solving the rate equations for the atomic populations involved, along with the radiation field computed with the method presented here. The main product of this research is the open-source computer code SLIM2 (Spectral Line Interactions in Moving Media), written in Python/Numpy, which numerically solves the fluorescence problem for arbitrary 2D velocities.


title: An Archive Can Bring Provable Speed-ups in Multi-Objective Evolutionary Algorithms

abstract: In the area of multi-objective evolutionary algorithms (MOEAs), there is a trend of using an archive to store non-dominated solutions generated during the search. This is because 1) MOEAs may easily end up with the final population containing inferior solutions that are dominated by other solutions discarded during the search process and 2) the population that has a commensurable size of the problem's Pareto front is often not practical. In this paper, we theoretically show, for the first time, that using an archive can guarantee speed-ups for MOEAs. Specifically, we prove that for two well-established MOEAs (NSGA-II and SMS-EMOA) on two commonly studied problems (OneMinMax and LeadingOnesTrailingZeroes), using an archive brings a polynomial acceleration on the expected running time. The reason is that with an archive, the size of the population can reduce to a small constant; there is no need for the population to keep all the Pareto optimal solutions found. This contrasts existing theoretical studies for MOEAs where a population with a commensurable size of the problem's Pareto front is needed. The findings in this paper not only provide a theoretical confirmation for an increasingly popular practice in the design of MOEAs, but can also be beneficial to the theory community towards studying more practical MOEAs.


title: A novel model reduction method to solve inverse problems of parabolic type

abstract: In this paper, we propose novel proper orthogonal decomposition (POD)--based model reduction methods that effectively address the issue of inverse crime in solving parabolic inverse problems. Both the inverse initial value problems and inverse source problems are studied. By leveraging the inherent low-dimensional structures present in the data, our approach enables a reduction in the forward model complexity without compromising the accuracy of the inverse problem solution. Besides, we prove the convergence analysis of the proposed methods for solving parabolic inverse problems. Through extensive experimentation and comparative analysis, we demonstrate the effectiveness of our method in overcoming inverse crime and achieving improved inverse problem solutions. The proposed POD model reduction method offers a promising direction for improving the reliability and applicability of inverse problem-solving techniques in various domains.


title: Diver: Large Language Model Decoding with Span-Level Mutual Information Verification

abstract: Large language models (LLMs) have shown impressive capabilities in adapting to various tasks when provided with task-specific instructions. However, LLMs using standard decoding strategies often struggle with deviations from the inputs. Intuitively, compliant LLM outputs should reflect the information present in the input, which can be measured by point-wise mutual information (PMI) scores. Therefore, we propose Diver, a novel approach that enhances LLM Decoding through span-level PMI verification. During inference, Diver first identifies divergence steps that may lead to multiple candidate spans. Subsequently, it calculates the PMI scores by assessing the log-likelihood gains of the input if the candidate spans are generated. Finally, the optimal span is selected based on the PMI re-ranked output distributions. We evaluate our method across various downstream tasks, and empirical results demonstrate that Diver significantly outperforms existing decoding methods in both performance and versatility.


title: Surface groups among cubulated hyperbolic and one-relator groups

abstract: Let $X$ be a non-positively curved cube complex with hyperbolic fundamental group. We prove that $\pi_1(X)$ has a non-free subgroup of infinite index unless $\pi_1(X)$ is either free or a surface group, answering a question of Wise. A similar result for one-relator groups follows, answering a question posed by several authors. The proof relies on a careful analysis of free and cyclic splittings of cubulated groups.


title: clauseSMT: A NLSAT-Based Clause-Level Framework for Satisfiability Modulo Nonlinear Real Arithmetic Theory

abstract: Model-constructing satisfiability calculus (MCSAT) framework has been applied to SMT problems on different arithmetic theories. NLSAT, an implementation using cylindrical algebraic decomposition for explanation, is especially competitive among nonlinear real arithmetic constraints. However, current Conflict-Driven Clause Learning (CDCL)-style algorithms only consider literal information for decision, and thus ignore clause-level influence on arithmetic variables. As a consequence, NLSAT encounters unnecessary conflicts caused by improper literal decisions. In this work, we analyze the literal decision caused conflicts, and introduce clause-level information with a direct effect on arithmetic variables. Two main algorithm improvements are presented: clause-level feasible-set based look-ahead mechanism and arithmetic propagation based branching heuristic. We implement our solver named clauseSMT on our dynamic variable ordering framework. Experiments show that clauseSMT is competitive on nonlinear real arithmetic theory against existing SMT solvers (cvc5, Z3, Yices2), and outperforms all these solvers on satisfiable instances of SMT(QF_NRA) in SMT-LIB. The effectiveness of our proposed methods are also studied.


title: Altermagnetism: Exploring New Frontiers in Magnetism and Spintronics

abstract: Recent developments have introduced a groundbreaking form of collinear magnetism known as "altermagnetism". This emerging magnetic phase is characterized by robust time-reversal symmetry breaking, antiparallel magnetic order, and alternating spin-splitting band structures, yet it exhibits vanishing net magnetization constrained by symmetry. Altermagnetism uniquely integrates traits previously considered mutually exclusive to conventional collinear ferromagnetism and antiferromagnetism, thereby facilitating phenomena and functionalities previously not achievable within these traditional categories of magnetism. Initially proposed theoretically, the existence of the altermagnetic phase has since been corroborated by a range of experimental studies, which have confirmed its unique properties and potential for applications. This review explores the rapidly expanding research on altermagnets, emphasizing the novel physical phenomena they manifest, methodologies for inducing altermagnetism, and promising altermagnetic materials. The goal of this review is to furnish readers with a comprehensive overview of altermagnetism and to inspire further innovative studies on altermagnetic materials which could potentially revolutionize applications in technology and materials science.


title: Measuring the Dispersion of Discrete Distributions

abstract: Measuring dispersion is among the most fundamental and ubiquitous concepts in statistics, both in applied and theoretical contexts. In order to ensure that dispersion measures like the standard deviation indeed capture the dispersion of any given distribution, they are by definition required to preserve a stochastic order of dispersion. The most basic order that functions as a foundation underneath the concept of dispersion measures is the so-called dispersive order. However, that order is incompatible with almost all discrete distributions, including all lattice distributions and most empirical distributions. Thus, there is no guarantee that popular measures properly capture the dispersion of these distributions. In this paper, discrete adaptations of the dispersive order are derived and analyzed. Their derivation is directly informed by key properties of the dispersive order in order to obtain a foundation for the measurement of discrete dispersion that is as similar as possible to the continuous setting. Two slightly different orders are obtained that both have numerous properties that the original dispersive order also has. Their behaviour on well-known families of lattice distribution is generally as expected if the parameter differences are large enough. Most popular dispersion measures preserve both discrete dispersive orders, which rigorously ensures that they are also meaningful in discrete settings. However, the interquantile range preserves neither discrete order, yielding that it should not be used to measure the dispersion of discrete distributions.


title: Domain Game: Disentangle Anatomical Feature for Single Domain Generalized Segmentation

abstract: Single domain generalization aims to address the challenge of out-of-distribution generalization problem with only one source domain available. Feature distanglement is a classic solution to this purpose, where the extracted task-related feature is presumed to be resilient to domain shift. However, the absence of references from other domains in a single-domain scenario poses significant uncertainty in feature disentanglement (ill-posedness). In this paper, we propose a new framework, named \textit{Domain Game}, to perform better feature distangling for medical image segmentation, based on the observation that diagnostic relevant features are more sensitive to geometric transformations, whilist domain-specific features probably will remain invariant to such operations. In domain game, a set of randomly transformed images derived from a singular source image is strategically encoded into two separate feature sets to represent diagnostic features and domain-specific features, respectively, and we apply forces to pull or repel them in the feature space, accordingly. Results from cross-site test domain evaluation showcase approximately an ~11.8% performance boost in prostate segmentation and around ~10.5% in brain tumor segmentation compared to the second-best method.


title: CityLight: A Universal Model Towards Real-world City-scale Traffic Signal Control Coordination

abstract: Traffic signal control (TSC) is a promising low-cost measure to enhance transportation efficiency without affecting existing road infrastructure. While various reinforcement learning-based TSC methods have been proposed and experimentally outperform conventional rule-based methods, none of them has been deployed in the real world. An essential gap lies in the oversimplification of the scenarios in terms of intersection heterogeneity and road network intricacy. To make TSC applicable in urban traffic management, we target TSC coordination in city-scale high-authenticity road networks, aiming to solve the three unique and important challenges: city-level scalability, heterogeneity of real-world intersections, and effective coordination among intricate neighbor connections. Since optimizing multiple agents in a parameter-sharing paradigm can boost the training efficiency and help achieve scalability, we propose our method, CityLight, based on the well-acknowledged optimization framework, parameter-sharing MAPPO. To ensure the unified policy network can learn to fit large-scale heterogeneous intersections and tackle the intricate between-neighbor coordination, CityLight proposes a universal representation module that consists of two key designs: heterogeneous intersection alignment and neighborhood impact alignment for coordination. To further boost coordination, CityLight adopts neighborhood-integrated rewards to transition from achieving local optimal to global optimal. Extensive experiments on datasets with hundreds to tens of thousands of real-world intersections and authentic traffic demands validate the surprising effectiveness and generalizability of CityLight, with an overall performance gain of 11.66% and a 22.59% improvement in transfer scenarios in terms of throughput.


title: On the non-uniqueness of the energy-momentum and spin currents

abstract: The macroscopic energy-momentum and spin densities of relativistic spin hydrodynamics are obtained from the ensemble average of their respective microscopic definitions (quantum operators). These microscopic definitions suffer from ambiguities, meaning that, one may obtain different forms of symmetric energy-momentum tensor and spin tensor through pseudogauge transformations (or in other words Belinfante improvement procedure). However, this ambiguity can be removed if we obtain these currents using Noether's second theorem instead of widely used Noether's first theorem. In this article, we use Noether's second theorem to derive energy-momentum and spin currents without the need of pseudogauge transformations for free Dirac massive particles with spin one-half.

categories: hep-th hep-ph math-ph math.MP nucl-th quant-ph


title: Iteration Head: A Mechanistic Study of Chain-of-Thought

abstract: Chain-of-Thought (CoT) reasoning is known to improve Large Language Models both empirically and in terms of theoretical approximation power. However, our understanding of the inner workings and conditions of apparition of CoT capabilities remains limited. This paper helps fill this gap by demonstrating how CoT reasoning emerges in transformers in a controlled and interpretable setting. In particular, we observe the appearance of a specialized attention mechanism dedicated to iterative reasoning, which we coined "iteration heads". We track both the emergence and the precise working of these iteration heads down to the attention level, and measure the transferability of the CoT skills to which they give rise between tasks.


title: Slice diameter two property in ultrapowers

abstract: In this note we study the inheritance of the slice diameter two property by ultrapowers. Given a Banach space $X$, we give a characterisation of when $(X)_\mathcal U$ has the slice diameter two property obtaining that this is the case for many Banach spaces which are known to enjoy the slice diameter two property. We also provide an example of a Banach space $X$ with the Daugavet property so that $(X)_\mathcal U$ fails the slice diameter two property for every free ultrafilter $\mathcal U$ over $\mathbb N$ which proves that, in general, this property is not inherited by taking ultraproduct spaces.


title: Spin Orbit and Hyperfine Simulations with Two-Species Ultracold Atoms in a Ring

abstract: A collective spin model is used to describe two species of mutually interacting ultracold bosonic atoms confined to a toroidal trap. The system is modeled by a Hamiltonian that can be split into two components, a linear part and a quadratic part, which may be controlled independently. We show the linear component is an analog of a Zeeman Hamiltonian, and the quadratic component presents a macroscopic simulator for spin-orbit and hyperfine interactions. We determine a complete set of commuting observables for both the linear and quadratic Hamiltonians, and derive analytical expressions for their respective spectra and density of states. We determine the conditions for generating maximal entanglement between the two species of atoms with a view to applications involving quantum correlations among spin degrees of freedom, such as in the area of quantum information.


title: CondTSF: One-line Plugin of Dataset Condensation for Time Series Forecasting

abstract: Dataset condensation is a newborn technique that generates a small dataset that can be used in training deep neural networks to lower training costs. The objective of dataset condensation is to ensure that the model trained with the synthetic dataset can perform comparably to the model trained with full datasets. However, existing methods predominantly concentrate on classification tasks, posing challenges in their adaptation to time series forecasting (TS-forecasting). This challenge arises from disparities in the evaluation of synthetic data. In classification, the synthetic data is considered well-distilled if the model trained with the full dataset and the model trained with the synthetic dataset yield identical labels for the same input, regardless of variations in output logits distribution. Conversely, in TS-forecasting, the effectiveness of synthetic data distillation is determined by the distance between predictions of the two models. The synthetic data is deemed well-distilled only when all data points within the predictions are similar. Consequently, TS-forecasting has a more rigorous evaluation methodology compared to classification. To mitigate this gap, we theoretically analyze the optimization objective of dataset condensation for TS-forecasting and propose a new one-line plugin of dataset condensation designated as Dataset Condensation for Time Series Forecasting (CondTSF) based on our analysis. Plugging CondTSF into previous dataset condensation methods facilitates a reduction in the distance between the predictions of the model trained with the full dataset and the model trained with the synthetic dataset, thereby enhancing performance. We conduct extensive experiments on eight commonly used time series datasets. CondTSF consistently improves the performance of all previous dataset condensation methods across all datasets, particularly at low condensing ratios.


title: Canonical coordinates for Yang-Mills-Chern-Simons theory

abstract: We consider the classical field theory of 2+1-dimensional Yang-Mills-Chern-Simons theory on an arbitrary spatial manifold. We first define a gauge covariant transverse electric field strength, which together with the gauge covariant scalar magnetic field strength can be taken as coordinates on the classical phase space. We then determine the Poisson-Dirac bracket and find that these coordinates are canonically conjugate to each other. The Hamiltonian is non-polynomial when expressed in terms of these coordinates, but can be expanded in a power series in the coupling constant with polynomial coefficients.


title: SimulTron: On-Device Simultaneous Speech to Speech Translation

abstract: Simultaneous speech-to-speech translation (S2ST) holds the promise of breaking down communication barriers and enabling fluid conversations across languages. However, achieving accurate, real-time translation through mobile devices remains a major challenge. We introduce SimulTron, a novel S2ST architecture designed to tackle this task. SimulTron is a lightweight direct S2ST model that uses the strengths of the Translatotron framework while incorporating key modifications for streaming operation, and an adjustable fixed delay. Our experiments show that SimulTron surpasses Translatotron 2 in offline evaluations. Furthermore, real-time evaluations reveal that SimulTron improves upon the performance achieved by Translatotron 1. Additionally, SimulTron achieves superior BLEU scores and latency compared to previous real-time S2ST method on the MuST-C dataset. Significantly, we have successfully deployed SimulTron on a Pixel 7 Pro device, show its potential for simultaneous S2ST on-device.


title: The current status of large language models in summarizing radiology report impressions

abstract: Large language models (LLMs) like ChatGPT show excellent capabilities in various natural language processing tasks, especially for text generation. The effectiveness of LLMs in summarizing radiology report impressions remains unclear. In this study, we explore the capability of eight LLMs on the radiology report impression summarization. Three types of radiology reports, i.e., CT, PET-CT, and Ultrasound reports, are collected from Peking University Cancer Hospital and Institute. We use the report findings to construct the zero-shot, one-shot, and three-shot prompts with complete example reports to generate the impressions. Besides the automatic quantitative evaluation metrics, we define five human evaluation metrics, i.e., completeness, correctness, conciseness, verisimilitude, and replaceability, to evaluate the semantics of the generated impressions. Two thoracic surgeons (ZSY and LB) and one radiologist (LQ) compare the generated impressions with the reference impressions and score each impression under the five human evaluation metrics. Experimental results show that there is a gap between the generated impressions and reference impressions. Although the LLMs achieve comparable performance in completeness and correctness, the conciseness and verisimilitude scores are not very high. Using few-shot prompts can improve the LLMs' performance in conciseness and verisimilitude, but the clinicians still think the LLMs can not replace the radiologists in summarizing the radiology impressions.


title: Robust Interaction-based Relevance Modeling for Online E-Commerce and LLM-based Retrieval

abstract: Semantic relevance calculation is crucial for e-commerce search engines, as it ensures that the items selected closely align with customer intent. Inadequate attention to this aspect can detrimentally affect user experience and engagement. Traditional text-matching techniques are prevalent but often fail to capture the nuances of search intent accurately, so neural networks now have become a preferred solution to processing such complex text matching. Existing methods predominantly employ representation-based architectures, which strike a balance between high traffic capacity and low latency. However, they exhibit significant shortcomings in generalization and robustness when compared to interaction-based architectures. In this work, we introduce a robust interaction-based modeling paradigm to address these shortcomings. It encompasses 1) a dynamic length representation scheme for expedited inference, 2) a professional terms recognition method to identify subjects and core attributes from complex sentence structures, and 3) a contrastive adversarial training protocol to bolster the model's robustness and matching capabilities. Extensive offline evaluations demonstrate the superior robustness and effectiveness of our approach, and online A/B testing confirms its ability to improve relevance in the same exposure position, resulting in more clicks and conversions. To the best of our knowledge, this method is the first interaction-based approach for large e-commerce search relevance calculation. Notably, we have deployed it for the entire search traffic on alibaba.com, the largest B2B e-commerce platform in the world.


title: Rabi Oscillation of High Partial Wave Interacting Atoms in Deep Optical Lattice

abstract: Motivated by the recent experiment of p-wave interacting $^{40}\mathrm{K}$ atom gases in a deep optical lattice, we investigated the Rabi oscillation for any partial wave interacting quantum gases in a deep optical lattice. We first review the solution for two particles interacting by any partial wave in a harmonic trap by using pseudopotential. We generalize the model used in recent work to any partial wave cases, repeated some of the theoretic and experiment results for p-wave interacting $^{40}\mathrm{K}$ atoms in a deep optical lattice and show the results for the d-wave case. Our results may be useful for future experiments and may stimulate further theoretic investigation.


title: Enhanced Nonlinear Frequency Conversion Bandwidth through Birefringence induced Mode Hybridization

abstract: On-chip quantum information network requires qubit transfer between different wavelengths while preserving quantum coherence and entanglement, which needs broadband up-conversion available. Herein, we demonstrate a mode-hybridization based broadband nonlinear frequency conversion on X-cut thin film lithium niobate. With the spontaneous quasi-phase matching and quasi groupvelocity matching being simultaneously satisfied, broadband second harmonic generation with a 3-dB bandwidth up to 13 nm has been achieved in a micro-racetrack resonator. The same mechanism can work on the frequency conversion of the ultra-short pulse in the bent waveguide structure. This work will be beneficial to on-chip tunable frequency conversion and quantum light source generation on integrated photonic platforms, and further enable on-chip large-capacity multiplexing, multichannel optical information processing, and large quantum information networks.


title: Eikonal calculation of (p,3p) cross sections for neutron-rich nuclei

abstract: In this work, we present the first, to our knowledge, theoretical description of two-proton removal reactions with proton target $(p,3p)$ for medium-mass nuclei at intermediate energies and present cross sections for the different bound states of the residual nucleus with two fewer protons. The description of the reaction assumes two sequential ``quasifree'' collisions between the target and removed protons and considers eikonal propagation in between. The formalism is applied to the reactions $^{12}\mathrm{C}(p,3p)^{10}\mathrm{Be}$, $^{28}\mathrm{Mg}(p,3p)^{26}\mathrm{Ne}$ and $^{54}\mathrm{Ca}(p,3p)^{52}\mathrm{Ar}$, finding reasonable agreement to experimental data for the $^{12}$C target and an overestimation of a factor $\sim3$ for the more neutron-rich and $^{54}$Ca, which is similar to the results found in two-proton knockout experiments with $^9$Be and $^{12}$C targets.


title: Statistical Age of Information: A Risk-Aware Metric and Its Applications in Status Updates

abstract: Age of information (AoI) is an effective measure to quantify the information freshness in wireless status update systems. It has been further validated that the peak AoI has the potential to capture the core characteristics of the aging process, and thus the average peak AoI is widely used to evaluate the long-term performance of information freshness. However, the average peak AoI is a risk-insensitive metric and therefore may not be well suited for evaluating critical status update services. Motivated by this concern, and following the spirit of entropic value-at-risk (EVaR) in the field of risk analysis, in this paper we present a concept, termed Statistical AoI, for providing a unified framework to guarantee various requirements of risk-sensitive status-update services with the demand on the violation probability of the peak age. In particular, as the constraint on the violation probability of the peak age varies from loose to strict, the statistical AoI evolves from the average peak AoI to the maximum peak AoI. We then investigate the statistical AoI minimization problem for status updates over wireless fading channels. It is interesting to note that the corresponding optimal sampling scheme varies from step to constant functions of the channel power gain with the peak age violation probability from one to zero. We also address the maximum statistical AoI minimization problem for multi-status updates with time division multiple access (TDMA), where longer transmission time can improve reliability but may also cause the larger age. By solving this problem, we derive the optimal transmission time allocation scheme. Numerical results show that our proposals can better satisfy the diverse requirements of various risk-sensitive status update services, and demonstrate the great potential of improving information freshness compared to baseline approaches.


title: Optimality of Matrix Mechanism on $\ell_p^p$-metric

abstract: In this paper, we introduce the $\ell_p^p$-error metric (for $p \geq 2$) when answering linear queries under the constraint of differential privacy. We characterize such an error under $(\epsilon,\delta)$-differential privacy. Before this paper, tight characterization in the hardness of privately answering linear queries was known under $\ell_2^2$-error metric (Edmonds et al., STOC 2020) and $\ell_p^2$-error metric for unbiased mechanisms (Nikolov and Tang, ITCS 2024). As a direct consequence of our results, we give tight bounds on answering prefix sum and parity queries under differential privacy for all constant $p$ in terms of the $\ell_p^p$ error, generalizing the bounds in Henzinger et al. (SODA 2023) for $p=2$.


title: Leveraging deterministic weather forecasts for in-situ probabilistic temperature predictions via deep learning

abstract: We propose a neural network approach to produce probabilistic weather forecasts from a deterministic numerical weather prediction. Our approach is applied to operational surface temperature outputs from the Global Deterministic Prediction System up to ten-day lead times, targeting METAR observations in Canada and the United States. We show how postprocessing performance is improved by training a single model for multiple lead times. Multiple strategies to condition the network for the lead time are studied, including a supplementary predictor and an embedding. The proposed model is evaluated for accuracy, spread, distribution calibration, and its behavior under extremes. The neural network approach decreases CRPS by 15% and has improved distribution calibration compared to a naive probabilistic model based on past forecast errors. Our approach increases the value of a deterministic forecast by adding information about the uncertainty, without incurring the cost of simulating multiple trajectories. It applies to any gridded forecast including the recent machine learning-based weather prediction models. It requires no information regarding forecast spread and can be trained to generate probabilistic predictions from any deterministic forecast.


title: Analyzing the Effect of Combined Degradations on Face Recognition

abstract: A face recognition model is typically trained on large datasets of images that may be collected from controlled environments. This results in performance discrepancies when applied to real-world scenarios due to the domain gap between clean and in-the-wild images. Therefore, some researchers have investigated the robustness of these models by analyzing synthetic degradations. Yet, existing studies have mostly focused on single degradation factors, which may not fully capture the complexity of real-world degradations. This work addresses this problem by analyzing the impact of both single and combined degradations using a real-world degradation pipeline extended with under/over-exposure conditions. We use the LFW dataset for our experiments and assess the model's performance based on verification accuracy. Results reveal that single and combined degradations show dissimilar model behavior. The combined effect of degradation significantly lowers performance even if its single effect is negligible. This work emphasizes the importance of accounting for real-world complexity to assess the robustness of face recognition models in real-world settings. The code is publicly available at https://github.com/ThEnded32/AnalyzingCombinedDegradations.


title: Reinforcement Tuning for Detecting Stances and Debunking Rumors Jointly with Large Language Models

abstract: Learning multi-task models for jointly detecting stance and verifying rumors poses challenges due to the need for training data of stance at post level and rumor veracity at claim level, which are difficult to obtain. To address this issue, we leverage large language models (LLMs) as the foundation annotators for the joint stance detection (SD) and rumor verification (RV) tasks, dubbed as JSDRV. We introduce a novel reinforcement tuning framework to enhance the joint predictive capabilities of LLM-based SD and RV components. Specifically, we devise a policy for selecting LLM-annotated data at the two levels, employing a hybrid reward mechanism to choose high-quality labels for effective LLM fine-tuning on both tasks. Results demonstrate that JSDRV improves the capabilities of LLMs in the joint tasks, not only outperforming state-of-the-art methods but also generalizing to non-LLMs accommodated as task models.


title: Room-temperature entanglement of the nickel-radical molecular complex (Et3NH)[Ni(hfac)2L]

abstract: The bipartite entanglement is comprehensively investigated in the mononuclear molecular complex (Et3NH)[Ni(hfac)2L]L, where HL denotes 2-(2-hydroxy-3-methoxy-5-nitrophenyl)-4,4,5,5-tetramethyl-4,5-dihydro-1H-imidazol-3-oxide-1-oxyl and hfacH stands for hexafluoroacetylacetone. From the magnetic point of view, the molecular compound (Et3NH)[Ni(hfac)2L] consists of an exchange-coupled spin-1 Ni2+ magnetic ion and a spin-1/2 nitronyl-nitroxide radical substituted nitrophenol. The nickel-radical molecular complex affords an experimental realization of a mixed spin-(1/2, 1) Heisenberg dimer with a strong antiferromagnetic exchange coupling J/kB = 505 K and two distinct g-factors gRad=2.005 and gNi=2.275. By adopting this set of magnetic parameters we demonstrate that the Zeeman splitting of a quantum ferrimagnetic ground-state doublet due to a weak magnetic field may substantially reinforce the strength of bipartite entanglement at low temperatures. The molecular compound (Et3NH)[Ni(hfac)2L] maintains sufficiently strong thermal entanglement even at room temperature, vanishing only above 546 K. Specifically, the thermal entanglement in the nickel-radical molecular complex retains approximately 40% of the maximum value corresponding to perfectly entangled Bell states at room temperature, which implies that this magnetic compound provides suitable platform of a molecular qubit with potential implications for room-temperature quantum computation and quantum information processing.


title: The continuity equation in the Heisenberg-periodic case: a representation formula and an application to Mean Field Games

abstract: We provide a representation of the weak solution of the continuity equation on the Heisenberg group $\mathbb H^1$ with periodic data (the periodicity is suitably adapted to the group law). This solution is the push forward of a measure concentrated on the flux associated with the drift of the continuity equation. Furthermore, we shall use this interpretation for proving that weak solutions to first order Mean Field Games on $\mathbb H^1$ are also mild solutions.


title: Activation Bottleneck: Sigmoidal Neural Networks Cannot Forecast a Straight Line

abstract: A neural network has an activation bottleneck if one of its hidden layers has a bounded image. We show that networks with an activation bottleneck cannot forecast unbounded sequences such as straight lines, random walks, or any sequence with a trend: The difference between prediction and ground truth becomes arbitrary large, regardless of the training procedure. Widely-used neural network architectures such as LSTM and GRU suffer from this limitation. In our analysis, we characterize activation bottlenecks and explain why they prevent sigmoidal networks from learning unbounded sequences. We experimentally validate our findings and discuss modifications to network architectures which mitigate the effects of activation bottlenecks.


title: UA-Track: Uncertainty-Aware End-to-End 3D Multi-Object Tracking

abstract: 3D multiple object tracking (MOT) plays a crucial role in autonomous driving perception. Recent end-to-end query-based trackers simultaneously detect and track objects, which have shown promising potential for the 3D MOT task. However, existing methods overlook the uncertainty issue, which refers to the lack of precise confidence about the state and location of tracked objects. Uncertainty arises owing to various factors during motion observation by cameras, especially occlusions and the small size of target objects, resulting in an inaccurate estimation of the object's position, label, and identity. To this end, we propose an Uncertainty-Aware 3D MOT framework, UA-Track, which tackles the uncertainty problem from multiple aspects. Specifically, we first introduce an Uncertainty-aware Probabilistic Decoder to capture the uncertainty in object prediction with probabilistic attention. Secondly, we propose an Uncertainty-guided Query Denoising strategy to further enhance the training process. We also utilize Uncertainty-reduced Query Initialization, which leverages predicted 2D object location and depth information to reduce query uncertainty. As a result, our UA-Track achieves state-of-the-art performance on the nuScenes benchmark, i.e., 66.3% AMOTA on the test split, surpassing the previous best end-to-end solution by a significant margin of 8.9% AMOTA.


title: Synergetic Event Understanding: A Collaborative Approach to Cross-Document Event Coreference Resolution with Large Language Models

abstract: Cross-document event coreference resolution (CDECR) involves clustering event mentions across multiple documents that refer to the same real-world events. Existing approaches utilize fine-tuning of small language models (SLMs) like BERT to address the compatibility among the contexts of event mentions. However, due to the complexity and diversity of contexts, these models are prone to learning simple co-occurrences. Recently, large language models (LLMs) like ChatGPT have demonstrated impressive contextual understanding, yet they encounter challenges in adapting to specific information extraction (IE) tasks. In this paper, we propose a collaborative approach for CDECR, leveraging the capabilities of both a universally capable LLM and a task-specific SLM. The collaborative strategy begins with the LLM accurately and comprehensively summarizing events through prompting. Then, the SLM refines its learning of event representations based on these insights during fine-tuning. Experimental results demonstrate that our approach surpasses the performance of both the large and small language models individually, forming a complementary advantage. Across various datasets, our approach achieves state-of-the-art performance, underscoring its effectiveness in diverse scenarios.


title: Von Neumann's 1927 Trilogy on the Foundations of Quantum Mechanics. Annotated Translations

abstract: English translation of John von Neumann's 1927 trilogy on the foundations of quantum mechanics with an introduction and detailed commentary.


title: Analysis and Simulation of a Coupled Fluid-Heat System in a Thin, Rough Layer

abstract: We investigate the effective coupling between heat and fluid dynamics within a thin fluid layer in contact with a solid structure via a rough surface. Moreover, the opposing vertical surfaces of the thin layer are in relative motion. This setup is particularly relevant to grinding processes, where cooling lubricants interact with the rough surface of a rotating grinding wheel. The resulting model is non-linearly coupled through(i) temperature-dependent viscosity and (ii) convective heat transport. The underlying geometry is highly heterogeneous due to the thin, rough surface characterized by a small parameter representing both the height of the layer and the periodicity of the roughness. We analyze this non-linear system for existence, uniqueness, and energy estimates and study the limit behavior within the framework of two-scale convergence in thin domains. In this limit, we derive an effective interface model in 3D (a line in 2D) for the heat and fluid interactions inside the fluid. We implement the system numerically and validate the limit problem through direct comparison with the micromodel. Additionally, we investigate the influence of the temperature-dependent viscosity and various geometrical configurations via simulation experiments. The corresponding numerical code is freely available on GitHub.


title: Quantum Magnetism in Fe2Cu2 Polymeric Branched Chains: Insights from Exactly Solved Ising-Heisenberg Model

abstract: The spin-1/2 Ising-Heisenberg branched chain, inspired by the magnetic structure of three isostructural polymeric coordination compounds [(Tp)2Fe2(CN)6X(bdmap)Cu2(H2O)].H2O to be further denoted as Fe2Cu2 (Tp = tris(pyrazolyl)hydroborate, bdmapH = 1,3-bis(dimethylamino)-2-propanol, HX = acetic acid, propionic acid or trifluoroacetic acid), is rigorously studied using the transfer-matrix method. The overall ground-state phase diagram reveals three distinct phases: a quantum antiferromagnetic phase, a quantum ferrimagnetic phase and a classical ferromagnetic phase. In the zero-temperature magnetization curve, two quantum ground states are manifested as intermediate plateaus at zero and half of the saturation magnetization, while the magnetization reaches its saturated value within the classical ferromagnetic phase. The bipartite entanglement between nearest-neighbor Heisenberg spins is more pronounced in the quantum ferrimagnetic phase compared to the quantum antiferromagnetic phase due to a fully polarized nature of the Ising spins. A reasonable agreement between theoretical predictions for the spin-1/2 Ising-Heisenberg branched chain and experimental data measured for a temperature dependence of the magnetic susceptibility and a low-temperature magnetization curve suggests strong antiferromagnetic coupling between nearest-neighbor CuII-CuII magnetic ions and moderately strong ferromagnetic coupling between nearest-neighbor CuII-FeIII magnetic ions in the polymeric compounds Fe2Cu2. A thermal entanglement between nearest-neighbor CuII-CuII magnetic ions persists up to a relatively high threshold temperature T = 224 K and undergoes a transient magnetic-field-driven strengthening.


title: A sequential test procedure for the choice of the number of regimes in multivariate nonlinear models

abstract: This paper proposes a sequential test procedure for determining the number of regimes in nonlinear multivariate autoregressive models. The procedure relies on linearity and no additional nonlinearity tests for both multivariate smooth transition and threshold autoregressive models. We conduct a simulation study to evaluate the finite-sample properties of the proposed test in small samples. Our findings indicate that the test exhibits satisfactory size properties, with the rescaled version of the Lagrange Multiplier test statistics demonstrating the best performance in most simulation settings. The sequential procedure is also applied to two empirical cases, the US monthly interest rates and Icelandic river flows. In both cases, the detected number of regimes aligns well with the existing literature.


title: Analyzing the Feature Extractor Networks for Face Image Synthesis

abstract: Advancements like Generative Adversarial Networks have attracted the attention of researchers toward face image synthesis to generate ever more realistic images. Thereby, the need for the evaluation criteria to assess the realism of the generated images has become apparent. While FID utilized with InceptionV3 is one of the primary choices for benchmarking, concerns about InceptionV3's limitations for face images have emerged. This study investigates the behavior of diverse feature extractors -- InceptionV3, CLIP, DINOv2, and ArcFace -- considering a variety of metrics -- FID, KID, Precision\&Recall. While the FFHQ dataset is used as the target domain, as the source domains, the CelebA-HQ dataset and the synthetic datasets generated using StyleGAN2 and Projected FastGAN are used. Experiments include deep-down analysis of the features: $L_2$ normalization, model attention during extraction, and domain distributions in the feature space. We aim to give valuable insights into the behavior of feature extractors for evaluating face image synthesis methodologies. The code is publicly available at https://github.com/ThEnded32/AnalyzingFeatureExtractors.


title: Learning Hamiltonian neural Koopman operator and simultaneously sustaining and discovering conservation law

abstract: Accurately finding and predicting dynamics based on the observational data with noise perturbations is of paramount significance but still a major challenge presently. Here, for the Hamiltonian mechanics, we propose the Hamiltonian Neural Koopman Operator (HNKO), integrating the knowledge of mathematical physics in learning the Koopman operator, and making it automatically sustain and even discover the conservation laws. We demonstrate the outperformance of the HNKO and its extension using a number of representative physical systems even with hundreds or thousands of freedoms. Our results suggest that feeding the prior knowledge of the underlying system and the mathematical theory appropriately to the learning framework can reinforce the capability of machine learning in solving physical problems.


title: Mean field equilibrium asset pricing model with habit formation

abstract: This paper presents an asset pricing model in an incomplete market involving a large number of heterogeneous agents based on the mean field game theory. In the model, we incorporate habit formation in consumption preferences, which has been widely used to explain various phenomena in financial economics. In order to characterize the market-clearing equilibrium, we derive a quadratic-growth mean field backward stochastic differential equation (BSDE) and study its well-posedness and asymptotic behavior in the large population limit. Additionally, we introduce an exponential quadratic Gaussian reformulation of the asset pricing model, in which the solution is obtained in a semi-analytic form.


title: Almost linear time differentially private release of synthetic graphs

abstract: In this paper, we give an almost linear time and space algorithms to sample from an exponential mechanism with an $\ell_1$-score function defined over an exponentially large non-convex set. As a direct result, on input an $n$ vertex $m$ edges graph $G$, we present the \textit{first} $\widetilde{O}(m)$ time and $O(m)$ space algorithms for differentially privately outputting an $n$ vertex $O(m)$ edges synthetic graph that approximates all the cuts and the spectrum of $G$. These are the \emph{first} private algorithms for releasing synthetic graphs that nearly match this task's time and space complexity in the non-private setting while achieving the same (or better) utility as the previous works in the more practical sparse regime. Additionally, our algorithms can be extended to private graph analysis under continual observation.


title: Online Learning and Information Exponents: On The Importance of Batch size, and Time/Complexity Tradeoffs

abstract: We study the impact of the batch size $n_b$ on the iteration time $T$ of training two-layer neural networks with one-pass stochastic gradient descent (SGD) on multi-index target functions of isotropic covariates. We characterize the optimal batch size minimizing the iteration time as a function of the hardness of the target, as characterized by the information exponents. We show that performing gradient updates with large batches $n_b \lesssim d^{\frac{\ell}{2}}$ minimizes the training time without changing the total sample complexity, where $\ell$ is the information exponent of the target to be learned \citep{arous2021online} and $d$ is the input dimension. However, larger batch sizes than $n_b \gg d^{\frac{\ell}{2}}$ are detrimental for improving the time complexity of SGD. We provably overcome this fundamental limitation via a different training protocol, \textit{Correlation loss SGD}, which suppresses the auto-correlation terms in the loss function. We show that one can track the training progress by a system of low-dimensional ordinary differential equations (ODEs). Finally, we validate our theoretical results with numerical experiments.