title: A2Q+: Improving Accumulator-Aware Weight Quantization

abstract: Quantization techniques commonly reduce the inference costs of neural networks by restricting the precision of weights and activations. Recent studies show that also reducing the precision of the accumulator can further improve hardware efficiency at the risk of numerical overflow, which introduces arithmetic errors that can degrade model accuracy. To avoid numerical overflow while maintaining accuracy, recent work proposed accumulator-aware quantization (A2Q), a quantization-aware training method that constrains model weights during training to safely use a target accumulator bit width during inference. Although this shows promise, we demonstrate that A2Q relies on an overly restrictive constraint and a sub-optimal weight initialization strategy that each introduce superfluous quantization error. To address these shortcomings, we introduce: (1) an improved bound that alleviates accumulator constraints without compromising overflow avoidance; and (2) a new strategy for initializing quantized weights from pre-trained floating-point checkpoints. We combine these contributions with weight normalization to introduce A2Q+. We support our analysis with experiments that show A2Q+ significantly improves the trade-off between accumulator bit width and model accuracy and characterize new trade-offs that arise as a consequence of accumulator constraints.


title: Spontaneous localization at a potential saddle point from edge state reconstruction in a quantum Hall point contact

abstract: Quantum point contacts (QPCs) are an essential component in mesoscopic devices. Here, we study the transmission of quantum Hall edge modes through a gate-defined QPC in monolayer graphene. We observe resonant tunneling peaks and a nonlinear conductance pattern characteristic of Coulomb-blockaded localized states. The in-plane electric polarizability reveals the states are localized at a classically-unstable electrostatic saddle point. We explain this unexpected finding within a self-consistent Thomas-Fermi model, finding that localization of a zero-dimensional state at the saddle point is favored whenever the applied confinement potential is sufficiently soft compared to the Coulomb energy. Our results provide a direct demonstration of Coulomb-driven reconstruction at the boundary of a quantum Hall system.


title: Some coefficient estimates on complex valued kernel $\alpha$-harmonic mappings

abstract: We call a kind of mappings induced by a kind of weighted Laplace operator as complex valued kernel $\alpha$-harmonic mappings. In this article, for this class of mappings, the Heinz type lemma is established, and the best Heinz type inequality is obtained. Next, the extremal function of Schwartz's Lemma is discussed. Finally, the coefficients are estimated for the subclass of complex valued kernel alpha harmonic mappings whose coefficients are real numbers.


title: Several properties of a class of generalized harmonic mappings

abstract: We call the solution of a kind of second order homogeneous partial differential equation as real kernel alpha-harmonic mappings. In this paper, the representation theorem, the Lipschitz continuity, the univalency and the related problems of the real kernel alpha-harmonic mappings are explored.


title: Fractal Quantum Transport on MoS2 Superlattices: a System with Tunable Symmetry

abstract: Electron doping is an excellent tuning knob to explore different phases of matter in two-dimensional (2D) materials. For example, tuning the Fermi level at a van Hove singularity in twisted bilayer graphene can enhance electron-electron interactions and induce a diverse range of correlated phases. Here, using a single-particle picture, we study the electronic reconstruction of the band edges of a 2D semiconductor, monolayer MoS2, on a hexagonal moire potential induced by another MoS2 monolayer. We find that such system transitions from a honeycomb to a hexagonal symmetry when the Fermi level is tuned from the conduction to the valence side. We also study the system under magnetic fields, and construct the Hofstadter's butterfly in the electron- and hole-doped side. Our findings are confirmed by simulating the conductance across a large-scale two-terminal device. We conclude that this duality is a general property that MoS2 and other transition-metal-dichalcogenides exhibit under non-symmetric superlattice potentials.


title: Optimal Sensor Allocation with Multiple Linear Dispersion Processes

abstract: This paper considers the optimal sensor allocation for estimating the emission rates of multiple sources in a two-dimensional spatial domain. Locations of potential emission sources are known (e.g., factory stacks), and the number of sources is much greater than the number of sensors that can be deployed, giving rise to the optimal sensor allocation problem. In particular, we consider linear dispersion forward models, and the optimal sensor allocation is formulated as a bilevel optimization problem. The outer problem determines the optimal sensor locations by minimizing the overall Mean Squared Error of the estimated emission rates over various wind conditions, while the inner problem solves an inverse problem that estimates the emission rates. Two algorithms, including the repeated Sample Average Approximation and the Stochastic Gradient Descent based bilevel approximation, are investigated in solving the sensor allocation problem. Convergence analysis is performed to obtain the performance guarantee, and numerical examples are presented to illustrate the proposed approach.


title: Diffusion of intrinsically disordered proteins within viscoelastic membraneless droplets

abstract: In living cells, intrinsically disordered proteins (IDPs), such as FUS and DDX4, undergo phase separation, forming biomolecular condensates. Using molecular dynamics simulations, we investigate their behavior in their respective homogenous droplets. We find that the proteins exhibit transient subdiffusion due to the viscoelastic nature and confinement effects in the droplets. The conformation and the instantaneous diffusivity of the proteins significantly vary between the interior and the interface of the droplet, resulting in non-Gaussianity in the displacement distributions. This study highlights key aspects of IDP behavior in biomolecular condensates.

categories: cond-mat.soft cond-mat.stat-mech physics.bio-ph physics.comp-ph q-bio.BM


title: Ecosystem models cannot predict the consequences of conservation decisions

abstract: Ecosystem models are often used to predict the consequences of management decisions in applied ecology, including fisheries management and threatened species conservation. These models are high-dimensional, parameter-rich, and nonlinear, yet limited data is available to calibrate them, and they are rarely tested or validated. Consequently, the accuracy of their forecasts, and their utility as decision-support tools is a matter of debate. In this paper, we calibrate ecosystem models to time-series data from 110 different experimental microcosm ecosystems, each containing between three and five interacting species. We then assess how often these calibrated models offer accurate and useful predictions about how the ecosystem will respond to a set of standard management interventions. Our results show that for each timeseries dataset, a large number of very different parameter sets offer equivalent, good fits. However, these calibrated ecosystem models have poor predictive accuracy when forecasting future dynamics and offer ambiguous predictions about how species in the ecosystem will respond to management interventions. Closer inspection reveals that the ecosystem models fail because calibration cannot determine the types of interactions that occur within the ecosystem. Our findings call into question claims that ecosystem modelling can support applied ecological decision-making when they are calibrated against real-world datasets.


title: Breaking the Curse of Multilinguality with Cross-lingual Expert Language Models

abstract: Despite their popularity in non-English NLP, multilingual language models often underperform monolingual ones due to inter-language competition for model parameters. We propose Cross-lingual Expert Language Models (X-ELM), which mitigate this competition by independently training language models on subsets of the multilingual corpus. This process specializes X-ELMs to different languages while remaining effective as a multilingual ensemble. Our experiments show that when given the same compute budget, X-ELM outperforms jointly trained multilingual models across all considered languages and that these gains transfer to downstream tasks. X-ELM provides additional benefits over performance improvements: new experts can be iteratively added, adapting X-ELM to new languages without catastrophic forgetting. Furthermore, training is asynchronous, reducing the hardware requirements for multilingual training and democratizing multilingual modeling.


title: Fully automated planning for anatomical fetal brain MRI on 0.55T

abstract: Purpose: Widening the availability of fetal MRI with fully automatic real-time planning of radiological brain planes on 0.55T MRI. Methods: Deep learning-based detection of key brain landmarks on a whole-uterus EPI scan enables the subsequent fully automatic planning of the radiological single-shot Turbo Spin Echo acquisitions. The landmark detection pipeline was trained on over 120 datasets from varying field strength, echo times and resolutions and quantitatively evaluated. The entire automatic planning solution was tested prospectively in nine fetal subjects between 20 and 37 weeks. Comprehensive evaluation of all steps, the distance between manual and automatic landmarks, the planning quality and the resulting image quality was conducted. Results: Prospective automatic planning was performed in real-time without latency in all subjects. The landmark detection accuracy was 4.21+-2.56 mm for the fetal eyes and 6.47+-3.23 for the cerebellum, planning quality was 2.44/3 (compared to 2.56/3 for manual planning) and diagnostic image quality was 2.14 compared to 2.07 for manual planning. Conclusions: Real-time automatic planning of all three key fetal brain planes was successfully achieved and will pave the way towards simplifying the acquisition of fetal MRI thereby widening the availability of this modality in non-specialist centres.


title: Path Choice Matters for Clear Attribution in Path Methods

abstract: Rigorousness and clarity are both essential for interpretations of DNNs to engender human trust. Path methods are commonly employed to generate rigorous attributions that satisfy three axioms. However, the meaning of attributions remains ambiguous due to distinct path choices. To address the ambiguity, we introduce \textbf{Concentration Principle}, which centrally allocates high attributions to indispensable features, thereby endowing aesthetic and sparsity. We then present \textbf{SAMP}, a model-agnostic interpreter, which efficiently searches the near-optimal path from a pre-defined set of manipulation paths. Moreover, we propose the infinitesimal constraint (IC) and momentum strategy (MS) to improve the rigorousness and optimality. Visualizations show that SAMP can precisely reveal DNNs by pinpointing salient image pixels. We also perform quantitative experiments and observe that our method significantly outperforms the counterparts. Code: https://github.com/zbr17/SAMP.


title: Towards Automated Driving Violation Cause Analysis in Scenario-Based Testing for Autonomous Driving Systems

abstract: The rapid advancement of Autonomous Vehicles (AVs), exemplified by companies like Waymo and Cruise offering 24/7 paid taxi services, highlights the paramount importance of ensuring AVs' compliance with various policies, such as safety regulations, traffic rules, and mission directives. Despite significant progress in the development of Autonomous Driving System (ADS) testing tools, there has been a notable absence of research on attributing the causes of driving violations. Counterfactual causality analysis has emerged as a promising approach for identifying the root cause of program failures. While it has demonstrated effectiveness in pinpointing error-inducing inputs, its direct application to the AV context to determine which computation result, generated by which component, serves as the root cause poses a considerable challenge. A key obstacle lies in our inability to straightforwardly eliminate the influence of a specific internal message to establish the causal relationship between the output of each component and a system-level driving violation. In this work, we propose a novel driving violation cause analysis (DVCA) tool. We design idealized component substitutes to enable counterfactual analysis of ADS components by leveraging the unique opportunity provided by the simulation. We evaluate our tool on a benchmark with real bugs and injected faults. The results show that our tool can achieve perfect component-level attribution accuracy (100%) and almost (>98%) perfect message-level accuracy. Our tool can reduce the debugging scope from hundreds of complicated interdependent messages to one single computation result generated by one component.


title: Can A Cognitive Architecture Fundamentally Enhance LLMs? Or Vice Versa?

abstract: The paper discusses what is needed to address the limitations of current LLM-centered AI systems. The paper argues that incorporating insights from human cognition and psychology, as embodied by a computational cognitive architecture, can help develop systems that are more capable, more reliable, and more human-like. It emphasizes the importance of the dual-process architecture and the hybrid neuro-symbolic approach in addressing the limitations of current LLMs. In the opposite direction, the paper also highlights the need for an overhaul of computational cognitive architectures to better reflect advances in AI and computing technology. Overall, the paper advocates for a multidisciplinary, mutually beneficial approach towards developing better models both for AI and for understanding the human mind.


title: Multidimensional nonhomogeneous quasi-linear systems and their Hamiltonian structures

abstract: In this paper we investigate multidimensional first-order quasi-linear systems and find necessary conditions for them to admit Hamiltonian formulation. The insufficiency of the conditions is related to the Poisson cohomology of the admissible Hamiltonian operators. We present in detail the example of two-dimensional, two-components systems of hydrodynamic type and of a real reduction of the 3-waves system.


title: Large Language Models are Efficient Learners of Noise-Robust Speech Recognition

abstract: Recent advances in large language models (LLMs) have promoted generative error correction (GER) for automatic speech recognition (ASR), which leverages the rich linguistic knowledge and powerful reasoning ability of LLMs to improve recognition results. The latest work proposes a GER benchmark with HyPoradise dataset to learn the mapping from ASR N-best hypotheses to ground-truth transcription by efficient LLM finetuning, which shows great effectiveness but lacks specificity on noise-robust ASR. In this work, we extend the benchmark to noisy conditions and investigate if we can teach LLMs to perform denoising for GER just like what robust ASR do}, where one solution is introducing noise information as a conditioner into LLM. However, directly incorporating noise embeddings from audio encoder could harm the LLM tuning due to cross-modality gap. To this end, we propose to extract a language-space noise embedding from the N-best list to represent the noise conditions of source speech, which can promote the denoising process in GER. Furthermore, in order to enhance its representation ability of audio noise, we design a knowledge distillation (KD) approach via mutual information estimation to distill the real noise information in audio embeddings to our language embedding. Experiments on various latest LLMs demonstrate our approach achieves a new breakthrough with up to 53.9% correction improvement in terms of word error rate while with limited training data. Analysis shows that our language-space noise embedding can well represent the noise conditions of source speech, under which off-the-shelf LLMs show strong ability of language-space denoising.


title: Investigating Training Strategies and Model Robustness of Low-Rank Adaptation for Language Modeling in Speech Recognition

abstract: The use of low-rank adaptation (LoRA) with frozen pretrained language models (PLMs) has become increasing popular as a mainstream, resource-efficient modeling approach for memory-constrained hardware. In this study, we first explore how to enhance model performance by introducing various LoRA training strategies, achieving relative word error rate reductions of 3.50\% on the public Librispeech dataset and of 3.67\% on an internal dataset in the messaging domain. To further characterize the stability of LoRA-based second-pass speech recognition models, we examine robustness against input perturbations. These perturbations are rooted in homophone replacements and a novel metric called N-best Perturbation-based Rescoring Robustness (NPRR), both designed to measure the relative degradation in the performance of rescoring models. Our experimental results indicate that while advanced variants of LoRA, such as dynamic rank-allocated LoRA, lead to performance degradation in $1$-best perturbation, they alleviate the degradation in $N$-best perturbation. This finding is in comparison to fully-tuned models and vanilla LoRA tuning baselines, suggesting that a comprehensive selection is needed when using LoRA-based adaptation for compute-cost savings and robust language modeling.


title: Engaging activities for teaching linear algebra

abstract: This paper discusses several linear algebra activities designed to help enhance students' skills in collaborating, exploring mathematics, and linking together abstract and visual ways of approaching mathematics. Most of these activities are short, accessible, engaging, and easy to incorporate into any classroom. In addition, we discuss some questions instructors can ask themselves to design novel and engaging activities when constrained to teaching from a particular curriculum.


title: Contextualized Automatic Speech Recognition with Attention-Based Bias Phrase Boosted Beam Search

abstract: End-to-end (E2E) automatic speech recognition (ASR) methods exhibit remarkable performance. However, since the performance of such methods is intrinsically linked to the context present in the training data, E2E-ASR methods do not perform as desired for unseen user contexts (e.g., technical terms, personal names, and playlists). Thus, E2E-ASR methods must be easily contextualized by the user or developer. This paper proposes an attention-based contextual biasing method that can be customized using an editable phrase list (referred to as a bias list). The proposed method can be trained effectively by combining a bias phrase index loss and special tokens to detect the bias phrases in the input speech data. In addition, to improve the contextualization performance during inference further, we propose a bias phrase boosted (BPB) beam search algorithm based on the bias phrase index probability. Experimental results demonstrate that the proposed method consistently improves the word error rate and the character error rate of the target phrases in the bias list on both the Librispeech-960 (English) and our in-house (Japanese) dataset, respectively.


title: Observation of tunable topological polaritons in a cavity waveguide

abstract: Topological polaritons characterized by light-matter interactions have become a pivotal platform in exploring new topological phases of matter. Recent theoretical advances unveiled a novel mechanism for tuning topological phases of polaritons by modifying the surrounding photonic environment (light-matter interactions) without altering the lattice structure. Here, by embedding a dimerized chain of microwave helical resonators (electric dipole emitters) in a metallic cavity waveguide, we report the pioneering observation of tunable topological phases of polaritons by varying the cavity width which governs the surrounding photonic environment and the strength of light-matter interactions. Moreover, we experimentally identified a new type of topological phase transition which includes three non-coincident critical points in the parameter space: the closure of the polaritonic bandgap, the transition of the Zak phase, and the hybridization of the topological edge states with the bulk states. These results reveal some remarkable and uncharted properties of topological matter when strongly coupled to light and provide an innovative design principle for tunable topological photonic devices.


title: Learning-assisted Stochastic Capacity Expansion Planning: A Bayesian Optimization Approach

abstract: Solving large-scale capacity expansion problems (CEPs) is central to cost-effective decarbonization of regional-scale energy systems. To ensure the intended outcomes of CEPs, modeling uncertainty due to weather-dependent variable renewable energy (VRE) supply and energy demand becomes crucially important. However, the resulting stochastic optimization models are often less computationally tractable than their deterministic counterparts. Here, we propose a learning-assisted approximate solution method to tractably solve two-stage stochastic CEPs. Our method identifies low-cost planning decisions by constructing and solving a sequence of tractable temporally aggregated surrogate problems. We adopt a Bayesian optimization approach to searching the space of time series aggregation hyperparameters and compute approximate solutions that minimize costs on a validation set of supply-demand projections. Importantly, we evaluate solved planning outcomes on a held-out set of test projections. We apply our approach to generation and transmission expansion planning for a joint power-gas system spanning New England. We show that our approach yields an estimated cost savings of up to 3.8% in comparison to benchmark time series aggregation approaches.


title: Raman scattering signatures of spinons and triplons in frustrated antiferromagnets

abstract: Magnetically frustrated spin systems compose a significant proportion of topological quantum spin liquid candidates. Evidence for spin liquids in these materials comes largely from the detection of fractionalised spin-1/2 quasiparticles, known as spinons. However, the one-dimensional Heisenberg chain, which is topologically trivial, also hosts spinons. Thus, observing spinons does not necessarily signify long-range entanglement. Here, we show that spinons arising from one-dimensional physics leave a clear fingerprint in magnetic Raman scattering. We achieve this by calculating the magnetic Raman intensity of coupled Heisenberg chains. Our findings are in excellent agreement with the magnetic Raman scattering measurements on the anisotropic triangular antiferromagnet Ca$_3$ReO$_5$Cl$_2$.


title: 3D Room Geometry Inference from Multichannel Room Impulse Response using Deep Neural Network

abstract: Room geometry inference (RGI) aims at estimating room shapes from measured room impulse responses (RIRs) and has received lots of attention for its importance in environment-aware audio rendering and virtual acoustic representation of a real venue. A lot of estimation models utilizing time difference of arrival (TDoA) or time of arrival (ToA) information in RIRs have been proposed. However, an estimation model should be able to handle more general features and complex relations between reflections to cope with various room shapes and uncertainties such as the unknown number of walls. In this study, we propose a deep neural network that can estimate various room shapes without prior assumptions on the shape or number of walls. The proposed model consists of three sub-networks: a feature extractor, parameter estimation, and evaluation networks, which extract key features from RIRs, estimate parameters, and evaluate the confidence of estimated parameters, respectively. The network is trained by about 40,000 RIRs simulated in rooms of different shapes using a single source and spherical microphone array and tested for rooms of unseen shapes and dimensions. The proposed algorithm achieves almost perfect accuracy in finding the true number of walls and shows negligible errors in room shapes.


title: The Second-order Version of Morley's Theorem on the Number of Countable Models does not Require Large Cardinals

abstract: The consistency of a second-order version of a theorem of Morley on the number of countable models was proved in arXiv:2107.07636 with the aid of large cardinals. We here dispense with them.


title: Microwave single-photon detection using a hybrid spin-optomechanical quantum interface

abstract: While infrared and optical single-photon detectors exist at high quantum efficiencies, detecting single microwave photons has been an ongoing challenge. Specifically, microwave photon detection is challenging compared to its optical counterpart as its energy scale is four to five orders of magnitude smaller, necessitating lower operating temperatures. Here, we propose a hybrid spin-optomechanical interface to detect single microwave photons. The microwave photons are coupled to a phononic resonator via piezoelectric actuation. This phononic cavity also acts as a photonic cavity with an embedded Silicon-Vacancy (SiV) center in diamond. Phonons mediate the quantum state transfer of the microwave cavity to the SiV spin, in order to allow for high spin-mechanical coupling at the single quantum level. From this, the optical cavity is used to perform a cavity-enhanced single-shot readout of the spin-state. Here, starting with a set of experimentally realizable parameters, we simulate the complete protocol and estimate an overall detection success probability $P_s^0$ of $0.972$, Shannon's mutual information $I^{0}(X;Y)$ of $0.82\ln(2)$, and a total detection time of $\sim2$ $\mu s$. We also talk about the experimental regimes in which $P_s^0$ tends to near unity and $I^{0}(X;Y)$ tends to $\ln(2)$ indicating exactly one bit of information retrieval about the presence or absence of a microwave photon.


title: Asymptotic behavior of solution of the non-resistive 2D MHD equations on the half space

abstract: In this paper, we obtain the global well-posedness and the asymptotic behavior of solution of non-resistive 2D MHD problem on the half space. We overcome the difficulty of zero spectrum gap by building the relationship between half space and the whole space, and get the resolvent estimate for the weak diffusion system. We use the two-tier energy method that couples the boundedness of high-order $(H^3)$ energy to the decay of low-order energy, the latter of which is necessary to control the growth of the highest energy.


title: The Alpha-Proton Differential Flow in the Alfv\'enic Young Solar Wind: From Sub-Alfv\'enic to Super-Alfv\'enic

abstract: Data obtained from Parker Solar Probe (PSP) since 2021 April have shown the first in situ observation of the solar corona, where the solar wind is formed and accelerated. Here we investigate the alpha-proton differential flow and its characteristics across the critical Alfv\'en surface (CAS) using data from PSP during encounters 8-10 and 12-13. We first show the positive correlation between the alpha-proton differential velocity and the bulk solar wind speed at PSP encounter distances. Then we explore how the characteristics of the differential flow vary across the CAS and how they are affected by Alfv\'enic fluctuations including switchbacks. We find that the differential velocity below the CAS is generally smaller than that above the CAS, and the local Alfv\'en speed well limits the differential speed both above and below the CAS. The deviations from the alignment between the differential velocity and the local magnetic field vector are accompanied by large-amplitude Alfv\'enic fluctuations and decreases in the differential speed. Moreover, we observe that $V_{\alpha p}$ increases from $M_A < 1$ to $M_A \simeq 2$ and then starts to decrease, which suggests that alphas may remain preferentially accelerated well above the CAS. Our results also reveal that in the sub-Alfv\'enic solar wind both protons and alphas show a strong correlation between their velocity fluctuations and magnetic field fluctuations, with a weaker correlation for alphas. In contrast, in the super-Alfv\'enic regime the correlation remains high for protons, but is reduced for alphas.


title: Contrastive Unlearning: A Contrastive Approach to Machine Unlearning

abstract: Machine unlearning aims to eliminate the influence of a subset of training samples (i.e., unlearning samples) from a trained model. Effectively and efficiently removing the unlearning samples without negatively impacting the overall model performance is still challenging. In this paper, we propose a contrastive unlearning framework, leveraging the concept of representation learning for more effective unlearning. It removes the influence of unlearning samples by contrasting their embeddings against the remaining samples so that they are pushed away from their original classes and pulled toward other classes. By directly optimizing the representation space, it effectively removes the influence of unlearning samples while maintaining the representations learned from the remaining samples. Experiments on a variety of datasets and models on both class unlearning and sample unlearning showed that contrastive unlearning achieves the best unlearning effects and efficiency with the lowest performance loss compared with the state-of-the-art algorithms.


title: On the undefinability of pathological Banach spaces

abstract: Motivated by Tsirelson's implicitly defined pathological Banach space, T. Gowers asked whether explicitly defined Banach spaces must include either $c_0$ or some $\ell^p$. J. Iovino and P. Casazza gave an affirmative answer for first-order continuous logic. We greatly extend their work to logics with much weaker requirements than compactness on their type spaces. Noteworthy is our extensive use of the topology of function spaces ($C_p$-theory) as developed by Arhangel'skii, and our use of double limit conditions studied by H. K\"onig and N. Kuhn.


title: Ultra-lightweight Neural Differential DSP Vocoder For High Quality Speech Synthesis

abstract: Neural vocoders model the raw audio waveform and synthesize high-quality audio, but even the highly efficient ones, like MB-MelGAN and LPCNet, fail to run real-time on a low-end device like a smartglass. A pure digital signal processing (DSP) based vocoder can be implemented via lightweight fast Fourier transforms (FFT), and therefore, is a magnitude faster than any neural vocoder. A DSP vocoder often gets a lower audio quality due to consuming over-smoothed acoustic model predictions of approximate representations for the vocal tract. In this paper, we propose an ultra-lightweight differential DSP (DDSP) vocoder that uses a jointly optimized acoustic model with a DSP vocoder, and learns without an extracted spectral feature for the vocal tract. The model achieves audio quality comparable to neural vocoders with a high average MOS of 4.36 while being efficient as a DSP vocoder. Our C++ implementation, without any hardware-specific optimization, is at 15 MFLOPS, surpasses MB-MelGAN by 340 times in terms of FLOPS, and achieves a vocoder-only RTF of 0.003 and overall RTF of 0.044 while running single-threaded on a 2GHz Intel Xeon CPU.


title: Learning to Robustly Reconstruct Low-light Dynamic Scenes from Spike Streams

abstract: As a neuromorphic sensor with high temporal resolution, spike camera can generate continuous binary spike streams to capture per-pixel light intensity. We can use reconstruction methods to restore scene details in high-speed scenarios. However, due to limited information in spike streams, low-light scenes are difficult to effectively reconstruct. In this paper, we propose a bidirectional recurrent-based reconstruction framework, including a Light-Robust Representation (LR-Rep) and a fusion module, to better handle such extreme conditions. LR-Rep is designed to aggregate temporal information in spike streams, and a fusion module is utilized to extract temporal features. Additionally, we have developed a reconstruction benchmark for high-speed low-light scenes. Light sources in the scenes are carefully aligned to real-world conditions. Experimental results demonstrate the superiority of our method, which also generalizes well to real spike streams. Related codes and proposed datasets will be released after publication.


title: Exact analytical algorithm for solvent accessible surface area and derivatives in implicit solvent molecular simulations on GPUs

abstract: In this paper, we present dSASA (differentiable SASA), an exact geometric method to calculate solvent accessible surface area (SASA) analytically along with atomic derivatives on GPUs. The atoms in a molecule are first assigned to tetrahedra in groups of four atoms by Delaunay tetrahedrization adapted for efficient GPU implementation and the SASA values for atoms and molecules are calculated based on the tetrahedrization information and inclusion-exclusion method. The SASA values from the numerical icosahedral-based method can be reproduced with more than 98% accuracy for both proteins and RNAs. Having been implemented on GPUs and incorporated into the software Amber, we can apply dSASA to implicit solvent molecular dynamics simulations with inclusion of this nonpolar term. The current GPU version of GB/SA simulations has been accelerated up to nearly 20-fold compared to the CPU version, outperforming LCPO, a commonly used, fast algorithm for calculating SASA, as the system size increases. While we focus on the accuracy of the SASA calculations for proteins and nucleic acids, we also demonstrate stable GB/SA MD mini-protein simulations.


title: Critical Data Size of Language Models from a Grokking Perspective

abstract: We explore the critical data size in language models, a threshold that marks a fundamental shift from quick memorization to slow generalization. We formalize the phase transition under the grokking configuration into the Data Efficiency Hypothesis and identify data insufficiency, sufficiency, and surplus regimes in language models training dynamics. We develop a grokking configuration to reproduce grokking on simplistic language models stably by rescaling initialization and weight decay. We show that generalization occurs only when language models reach a critical size. We analyze grokking across sample-wise and model-wise, verifying the proposed data efficiency hypothesis. Our experiments reveal smoother phase transitions occurring at the critical dataset size for language datasets. As the model size increases, this critical point also becomes larger, indicating that larger models require more data. Our results deepen the understanding of language model training, offering a novel perspective on the role of data in the learning mechanism of language models.


title: PhotoScout: Synthesis-Powered Multi-Modal Image Search

abstract: Due to the availability of increasingly large amounts of visual data, there is a growing need for tools that can help users find relevant images. While existing tools can perform image retrieval based on similarity or metadata, they fall short in scenarios that necessitate semantic reasoning about the content of the image. This paper explores a new multi-modal image search approach that allows users to conveniently specify and perform semantic image search tasks. With our tool, PhotoScout, the user interactively provides natural language descriptions, positive and negative examples, and object tags to specify their search tasks. Under the hood, PhotoScout is powered by a program synthesis engine that generates visual queries in a domain-specific language and executes the synthesized program to retrieve the desired images. In a study with 25 participants, we observed that PhotoScout allows users to perform image retrieval tasks more accurately and with less manual effort.


title: Data-driven grapheme-to-phoneme representations for a lexicon-free text-to-speech

abstract: Grapheme-to-Phoneme (G2P) is an essential first step in any modern, high-quality Text-to-Speech (TTS) system. Most of the current G2P systems rely on carefully hand-crafted lexicons developed by experts. This poses a two-fold problem. Firstly, the lexicons are generated using a fixed phoneme set, usually, ARPABET or IPA, which might not be the most optimal way to represent phonemes for all languages. Secondly, the man-hours required to produce such an expert lexicon are very high. In this paper, we eliminate both of these issues by using recent advances in self-supervised learning to obtain data-driven phoneme representations instead of fixed representations. We compare our lexicon-free approach against strong baselines that utilize a well-crafted lexicon. Furthermore, we show that our data-driven lexicon-free method performs as good or even marginally better than the conventional rule-based or lexicon-based neural G2Ps in terms of Mean Opinion Score (MOS) while using no prior language lexicon or phoneme set, i.e. no linguistic expertise.


title: Quantitative Selection of Sample Structures in Small-Angle Scattering Using Bayesian Methods

abstract: Small-angle scattering (SAS) is a key experimental technique for analyzing nano-scale structures in various materials.In SAS data analysis, selecting an appropriate mathematical model for the scattering intensity is critical, as it generates a hypothesis of the structure of the experimental sample. Traditional model selection methods either rely on qualitative approaches or are prone to overfitting.This paper introduces an analytical method that applies Bayesian model selection to SAS measurement data, enabling a quantitative evaluation of the validity of mathematical models.We assess the performance of our method through numerical experiments using artificial data for multicomponent spherical materials, demonstrating that our proposed method analysis approach yields highly accurate and interpretable results.We also discuss the ability of our method to analyze a range of mixing ratios and particle size ratios for mixed components, along with its precision in model evaluation by the degree of fitting.Our proposed method effectively facilitates quantitative analysis of nano-scale sample structures in SAS, which has traditionally been challenging, and is expected to significantly contribute to advancements in a wide range of fields.


title: Learning Backdoors for Mixed Integer Programs with Contrastive Learning

abstract: Many real-world problems can be efficiently modeled as Mixed Integer Programs (MIPs) and solved with the Branch-and-Bound method. Prior work has shown the existence of MIP backdoors, small sets of variables such that prioritizing branching on them when possible leads to faster running times. However, finding high-quality backdoors that improve running times remains an open question. Previous work learns to estimate the relative solver speed of randomly sampled backdoors through ranking and then decide whether to use it. In this paper, we utilize the Monte-Carlo tree search method to collect backdoors for training, rather than relying on random sampling, and adapt a contrastive learning framework to train a Graph Attention Network model to predict backdoors. Our method, evaluated on four common MIP problem domains, demonstrates performance improvements over both Gurobi and previous models.


title: A structure theory for regular graphs with fixed smallest eigenvalue

abstract: In this paper we will give a structure theory for regular graphs with fixed smallest eigenvalue. As a consequence of this theory, we show that a $k$-regular graph with smallest eigenvalue $-\lambda$ has clique number linear in $k$ if $k$ is large with respect to $\lambda$.


title: A Stable Matching Assignment for Cancer Treatment Centers using Survival Analysis

abstract: The treatment of cancer is one of the most discussed issues in the realm of contemporary public health research. One of the primary concerns of both the general public and the government is the development of the most effective cancer treatment at the most affordable price. This is due to the fact that the number of persons diagnosed with cancer increases on an annual basis. Within the scope of this project, we propose the development of a system for the recommendation of treatment centers. This system would initially select patients who posed a higher risk value, and then it would recommend the most appropriate cancer treatment center for those patients based on their income and the location where they lived using a stable matching algorithm.


title: Shape enumerators of self-dual NRT codes over finite fields

abstract: We use invariant theory of finite groups to study shape enumerators of self-dual linear codes in a finite NRT metric space. We provide a new approach that avoids applying Molien's formula to compute all possible shape enumerators. Enhancing existing methods, we describe the shape enumerators of all self-dual NRT codes over an arbitrary finite field.


title: DeepEdit: Knowledge Editing as Decoding with Constraints

abstract: How to edit the knowledge in multi-step reasoning has become the major challenge in the knowledge editing (KE) of large language models (LLMs). The difficulty arises because the hallucinations of LLMs during multi-step reasoning often lead to incorrect use of new knowledge and incorrect answers. To address this issue, we design decoding constraints to "regulate" LLMs' reasoning, enhancing logical coherence when incorporating new knowledge. We propose a new KE framework: DEEPEDIT (Depth-first Search-based Constrained Decoding for Knowledge Editing), which enhances LLMs's ability to generate coherent reasoning chains with new knowledge through depth-first search. Our search selects the most important knowledge that satisfies our constraints as the reasoning step to efficiently increase the reasoning depth. In addition to DEEPEDIT, we propose two new KE benchmarks: MQUAKE-2002 and MQUAKE-HARD, which provide more precise and challenging assessments of KE approaches. Qualitatively, DEEPEDIT enables LLMs to produce succinct and coherent reasoning chains involving new knowledge. Quantitatively, it yields significant improvements on multiple KE benchmarks.


title: Named Entity Recognition Under Domain Shift via Metric Learning for Life Sciences

abstract: Named entity recognition is a key component of Information Extraction (IE), particularly in scientific domains such as biomedicine and chemistry, where large language models (LLMs), e.g., ChatGPT, fall short. We investigate the applicability of transfer learning for enhancing a named entity recognition model trained in the biomedical domain (the source domain) to be used in the chemical domain (the target domain). A common practice for training such a model in a few-shot learning setting is to pretrain the model on the labeled source data, and then, to finetune it on a hand-full of labeled target examples. In our experiments, we observed that such a model is prone to mislabeling the source entities, which can often appear in the text, as the target entities. To alleviate this problem, we propose a model to transfer the knowledge from the source domain to the target domain, but, at the same time, to project the source entities and target entities into separate regions of the feature space. This diminishes the risk of mislabeling the source entities as the target entities. Our model consists of two stages: 1) entity grouping in the source domain, which incorporates knowledge from annotated events to establish relations between entities, and 2) entity discrimination in the target domain, which relies on pseudo labeling and contrastive learning to enhance discrimination between the entities in the two domains. We conduct our extensive experiments across three source and three target datasets, demonstrating that our method outperforms the baselines by up to 5% absolute value.


title: Dynamic Programming: Finite States

abstract: This book is about dynamic programming and its applications in economics, finance, and adjacent fields. It brings together recent innovations in the theory of dynamic programming and provides applications and code that can help readers approach the research frontier. The book is aimed at graduate students and researchers, although most chapters are accessible to undergraduate students with solid quantitative backgrounds.


title: LDReg: Local Dimensionality Regularized Self-Supervised Learning

abstract: Representations learned via self-supervised learning (SSL) can be susceptible to dimensional collapse, where the learned representation subspace is of extremely low dimensionality and thus fails to represent the full data distribution and modalities. Dimensional collapse also known as the "underfilling" phenomenon is one of the major causes of degraded performance on downstream tasks. Previous work has investigated the dimensional collapse problem of SSL at a global level. In this paper, we demonstrate that representations can span over high dimensional space globally, but collapse locally. To address this, we propose a method called $\textit{local dimensionality regularization (LDReg)}$. Our formulation is based on the derivation of the Fisher-Rao metric to compare and optimize local distance distributions at an asymptotically small radius for each data point. By increasing the local intrinsic dimensionality, we demonstrate through a range of experiments that LDReg improves the representation quality of SSL. The results also show that LDReg can regularize dimensionality at both local and global levels.


title: CBVS: A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios

abstract: Vision-Language Models pre-trained on large-scale image-text datasets have shown superior performance in downstream tasks such as image retrieval. Most of the images for pre-training are presented in the form of open domain common-sense visual elements. Differently, video covers in short video search scenarios are presented as user-originated contents that provide important visual summaries of videos. In addition, a portion of the video covers come with manually designed cover texts that provide semantic complements. In order to fill in the gaps in short video cover data, we establish the first large-scale cover-text benchmark for Chinese short video search scenarios. Specifically, we release two large-scale datasets CBVS-5M/10M to provide short video covers, and the manual fine-labeling dataset CBVS-20K to provide real user queries, which serves as an image-text benchmark test in the Chinese short video search field. To integrate the semantics of cover text in the case of modality missing, we propose UniCLIP where cover texts play a guiding role during training, however are not relied upon by inference. Extensive evaluation on CBVS-20K demonstrates the excellent performance of our proposal. UniCLIP has been deployed to Tencent's online video search systems with hundreds of millions of visits and achieved significant gains. The dataset and code are available at https://github.com/QQBrowserVideoSearch/CBVS-UniCLIP.


title: Quickly Determining Who Won an Election

abstract: This paper considers elections in which voters choose one candidate each, independently according to known probability distributions. A candidate receiving a strict majority (absolute or relative, depending on the version) wins. After the voters have made their choices, each vote can be inspected to determine which candidate received that vote. The time (or cost) to inspect each of the votes is known in advance. The task is to (possibly adaptively) determine the order in which to inspect the votes, so as to minimize the expected time to determine which candidate has won the election. We design polynomial-time constant-factor approximation algorithms for both the absolute-majority and the relative-majority version. Both algorithms are based on a two-phase approach. In the first phase, the algorithms reduce the number of relevant candidates to $O(1)$, and in the second phase they utilize techniques from the literature on stochastic function evaluation to handle the remaining candidates. In the case of absolute majority, we show that the same can be achieved with only two rounds of adaptivity.


title: Dynamical Property of Black Hole Matter

abstract: Matter loses its original characteristics after entering a black hole, thus becoming a new kind of (black hole) matter. The property of this new matter cannot be measured experimentally, but some of it can be deduced theoretically from the Einstein equations and the conservation laws which it must still satisfy. In a previous paper, this matter is modelled by an ideal fluid, with an equation of state $p(r)=-\xi\r(r)$ between the pressure $p(r)$ and the density $\rho(r)$. In order for this matter to fill the inside of a black hole so that its property can be teased out from the Einstein and conservation equations, it must possess a negative pressure ($\xi>0$) to counter the gravitation attraction which draws all matter to the center. In that case a solution of the Einstein and conservation equations exists if and only if the constant $\xi$ is confined within a narrow range, between 0.1429 and 0.1716. In the present paper, we try to find out its dynamical response by injecting additional matter into the black hole over a period of time. The resulting solutions of the six time-dependent Einstein equations and conservation laws are presented in perturbation theory, valid if the total amount of injection is small. Even in perturbation, the solutions can be obtained only with a special trick. The result shows that the equation of state $p(r,t)=-\xi\r(r,t)$ remains unchanged with the same $\xi$ when the injection rate is constant. When the rate changes with time, $\xi$ requires a correction, $\xi\to\xi+\xi_1(r,t)$, where $\xi_1(r,t)$ appears to be correlated with the acceleration of the injected matter in a way to be shown in the text.


title: Budgeted Online Model Selection and Fine-Tuning via Federated Learning

abstract: Online model selection involves selecting a model from a set of candidate models 'on the fly' to perform prediction on a stream of data. The choice of candidate models henceforth has a crucial impact on the performance. Although employing a larger set of candidate models naturally leads to more flexibility in model selection, this may be infeasible in cases where prediction tasks are performed on edge devices with limited memory. Faced with this challenge, the present paper proposes an online federated model selection framework where a group of learners (clients) interacts with a server with sufficient memory such that the server stores all candidate models. However, each client only chooses to store a subset of models that can be fit into its memory and performs its own prediction task using one of the stored models. Furthermore, employing the proposed algorithm, clients and the server collaborate to fine-tune models to adapt them to a non-stationary environment. Theoretical analysis proves that the proposed algorithm enjoys sub-linear regret with respect to the best model in hindsight. Experiments on real datasets demonstrate the effectiveness of the proposed algorithm.


title: Response to a critique of "Cotton Gravity"

abstract: We address in this article the criticism in a recently submitted article by Clement and Noiucer (arXiv:2312.17662 [gr-qc]) on "Cotton Gravity" (CG), a gravity theory alternative to General Relativity. These authors claim that CG is "not predictive" for producing "too many" spherically symmetric vacuum solutions, while taking the Bianchi I vacuum as test case they argue that geometric constraint on the Cotton tensor lead to an undetermined problem, concluding in the end that CG "is not a physical theory". We provide arguments showing that this critique is incorrect and misrepresents the theory.


title: Escape Sky-high Cost: Early-stopping Self-Consistency for Multi-step Reasoning

abstract: Self-consistency (SC) has been a widely used decoding strategy for chain-of-thought reasoning. Despite bringing significant performance improvements across a variety of multi-step reasoning tasks, it is a high-cost method that requires multiple sampling with the preset size. In this paper, we propose a simple and scalable sampling process, \textbf{E}arly-Stopping \textbf{S}elf-\textbf{C}onsistency (ESC), to greatly reduce the cost of SC without sacrificing performance. On this basis, one control scheme for ESC is further derivated to dynamically choose the performance-cost balance for different tasks and models. To demonstrate ESC's effectiveness, we conducted extensive experiments on three popular categories of reasoning tasks: arithmetic, commonsense and symbolic reasoning over language models with varying scales. The empirical results show that ESC reduces the average number of sampling of chain-of-thought reasoning by a significant margin on six benchmarks, including MATH (-33.8%), GSM8K (-80.1%), StrategyQA (-76.8%), CommonsenseQA (-78.5%), Coin Flip (-84.2%) and Last Letters (-67.4%), while attaining comparable performances.


title: Two-dimensional quantum droplets in binary quadrupolar condensates

abstract: We study the stability and characteristics of two-dimensional (2D) quasi-isotropic quantum droplets (QDs) of fundamental and vortex types, formed by binary Bose-Einstein condensate with magnetic quadrupole-quadrupole interactions (MQQIs). The magnetic quadrupoles are built as pairs of dipoles and antidipoles polarized along the x-axis. The MQQIs are induced by applying an external magnetic field that varies along the x-axis. The system is modeled by the Gross-Pitaevskii equations including the MQQIs and Lee-Huang-Yang correction to the mean-field approximation. Stable 2D fundamental QDs and quasi-isotropic vortex QDs with topological charges S<4 are produced by means of the imaginary-time-integration method for configurations with the quadrupoles polarized parallel to the systems two-dimensional plane. Effects of the norm and MQQI strength on the QDs are studied in detail. Some results, including an accurate prediction of the effective area, chemical potential, and peak density of QDs, are obtained in an analytical form by means of the Thomas-Fermi approximation. Collisions between moving QDs are studied by means of systematic simulations.


title: Periodic orbits of the Stark problem

abstract: The Stark problem is Kepler problem with an external constant acceleration. In this paper, we study the periodic orbits for Stark problem for both planar case and spatial case. We have conducted a detailed analysis of the invariant tori and periodic orbits appearing in the Stark problem, providing a more refined characterization of the properties of the orbits. Interestingly, there exists a family of circular orbits in the spatial case, some of which are quite stable with $L$ being fixed.


title: Accurate Excitation Energies of Point Defects from Fast Particle-Particle Random Approximation Calculations

abstract: We present an efficient particle-particle random phase approximation (ppRPA) approach that predicts accurate excitation energies of point defects, including the nitrogen-vacancy (NV$^-$) and the silicon-vacancy (SiV$^0$) centers in diamond and the divacancy center (VV$^0$) in 4H silicon carbide, with errors within 0.2 eV compared with experimental values. Starting from the ($N+2$)-electron ground state calculated with the density functional theory (DFT), the ppRPA excitation energies of the $N$-electron system are calculated as the differences between the two-electron removal energies of the ($N+2$)-electron system. We demonstrate that the ppRPA excitation energies converge rapidly with a few hundred of canonical active-space orbitals. We also show that active-space ppRPA has weak DFT starting-point dependence and is significantly cheaper than the corresponding ground-state DFT calculation. This work establishes ppRPA as an accurate and low-cost tool for investigating excited-state properties of point defects and opens up new opportunities for applications of ppRPA to periodic bulk materials.


title: Enhancing Scalability in Recommender Systems through Lottery Ticket Hypothesis and Knowledge Distillation-based Neural Network Pruning

abstract: This study introduces an innovative approach aimed at the efficient pruning of neural networks, with a particular focus on their deployment on edge devices. Our method involves the integration of the Lottery Ticket Hypothesis (LTH) with the Knowledge Distillation (KD) framework, resulting in the formulation of three distinct pruning models. These models have been developed to address scalability issue in recommender systems, whereby the complexities of deep learning models have hindered their practical deployment. With judicious application of the pruning techniques, we effectively curtail the power consumption and model dimensions without compromising on accuracy. Empirical evaluation has been performed using two real world datasets from diverse domains against two baselines. Gratifyingly, our approaches yielded a GPU computation-power reduction of up to 66.67%. Notably, our study contributes to the field of recommendation system by pioneering the application of LTH and KD.


title: Sign-changing concentration phenomena of an anisotropic sinh-Poisson type equation with a Hardy or H\'{e}non term

abstract: We consider the following anisotropic sinh-Poisson tpye equation with a Hardy or H\'{e}non term: $${\begin{array}{ll} -\Div (a(x)\nabla u)+ a(x)u=\varepsilon^2a(x)|x-q|^{2\alpha}(e^u-e^{-u}) &\mbox{in $\Omega$,} \\ \frac{\partial u}{\partial n}=0, &\mbox{on $\Omega$,} \end{array}$$ where $\varepsilon>0$, $q\in \bar\Omega\subset \R^2$, $\alpha \in(-1,\infty)\char92 \N$, $\Omega\subset \R^2$ is a smooth bounded domain, $n$ is the unit outward normal vector of $\partial \Omega$ and $a(x)$ is a smooth positive function defined on $\bar\Omega$. From finite dimensional reduction method, we proved that the problem \eqref{115} has a sequence of sign-changing solutions with arbitrarily many interior spikes accumulating to $q$, provided $q\in \Omega$ is a local maximizer of $a(x)$. However, if $q\in \partial \Omega$ is a strict local maximum point of $a(x)$ and satisfies $\langle \nabla a(q),n \rangle=0$, we proved that \eqref{115} has a family of sign-changing solutions with arbitrarily many mixed interior and boundary spikes accumulating to $q$. Under the same condition, we could also construct a sequence of blow-up solutions for the following problem $$ {\begin{array}{ll} -\Div (a(x)\nabla u)+ a(x)u=\varepsilon^2a(x)|x-q|^{2\alpha}e^u &\mbox{in $\Omega$,} \\ \frac{\partial u}{\partial n}=0, &\mbox{on $\partial\Omega$.} \end{array}$$


title: Two-Point Concentration of the Domination Number of Random Graphs

abstract: We show that the domination number of the binomial random graph G_{n,p} with edge-probability p is concentrated on two values for p \ge n^{-2/3+\eps}, and not concentrated on two values for general p \le n^{-2/3}. This refutes a conjecture of Glebov, Liebenau and Szabo, who showed two-point concentration for p \ge n^{-1/2+\eps}, and conjectured that two-point concentration fails for p \ll n^{-1/2}. The proof of our main result requires a Poisson type approximation for the probability that a random bipartite graph has no isolated vertices, in a regime where standard tools are unavailable (as the expected number of isolated vertices is relatively large). We achieve this approximation by adapting the proof of Janson's inequality to this situation, and this adaptation may be of broader interest.


title: Generative Dense Retrieval: Memory Can Be a Burden

abstract: Generative Retrieval (GR), autoregressively decoding relevant document identifiers given a query, has been shown to perform well under the setting of small-scale corpora. By memorizing the document corpus with model parameters, GR implicitly achieves deep interaction between query and document. However, such a memorizing mechanism faces three drawbacks: (1) Poor memory accuracy for fine-grained features of documents; (2) Memory confusion gets worse as the corpus size increases; (3) Huge memory update costs for new documents. To alleviate these problems, we propose the Generative Dense Retrieval (GDR) paradigm. Specifically, GDR first uses the limited memory volume to achieve inter-cluster matching from query to relevant document clusters. Memorizing-free matching mechanism from Dense Retrieval (DR) is then introduced to conduct fine-grained intra-cluster matching from clusters to relevant documents. The coarse-to-fine process maximizes the advantages of GR's deep interaction and DR's scalability. Besides, we design a cluster identifier constructing strategy to facilitate corpus memory and a cluster-adaptive negative sampling strategy to enhance the intra-cluster mapping ability. Empirical results show that GDR obtains an average of 3.0 R@100 improvement on NQ dataset under multiple settings and has better scalability.


title: Bi-$\overline{\mathbb{Q}}$-structures on Hermitian symmetric spaces and quadratic relations between CM periods

abstract: In this paper, we introduce the notion of a bi-$\overline{\mathbb{Q}}$-structure on the tangent space at a CM point on a locally Hermitian symmetric domain. We prove that this bi-$\overline{\mathbb{Q}}$-structure decomposes into the direct sum of $1$-dimensional bi-$\overline{\mathbb{Q}}$-subspaces, and make this decomposition explicit for the moduli space of abelian varieties $\mathbb{A}_g$. We propose an Analytic Subspace Conjecture, which is the analogue of the W\"{u}stholz's Analytic Subgroup Theorem in this context. We show that this conjecture, applied to $\mathbb{A}_g$, implies that all quadratic $\overline{\mathbb{Q}}$-relations among the holomorphic periods of CM abelian varieties arise from elementary ones.


title: Diffusive coupling facilitates and impedes noise-induced escape in interacting bistable elements

abstract: Diverse complex systems often undergo sudden changes in their states, such as epileptic seizures, climate changes, and social uprisings. Such behavior has been modeled by noise-induced escape of bistable elements, which is the escape from an attracting state driven by a fluctuation in the system's state. We consider a system of interacting bistable elements and investigate the effect of diffusive coupling among elements on the process of noise-induced escape. We focus on the influence of the coupling strength over the escape time, which is the time it takes for noise-induced escape to occur. We performed numerical simulations and observed that weak coupling reduced the mean escape time, whereas strong coupling impeded escape. We argue that, although diffusive coupling both facilitates and impedes escape, the facilitating effect is dominant when coupling is weak. For weak coupling cases, we develop an approximate theory that can predict the mean and variance of escape times. In contrast, strong coupling reduces the effective noise intensity to impede escape. Our results suggest that diffusive coupling among multistable elements contributes to regulating the rate of transitions among attracting states.


title: Generalization Error Guaranteed Auto-Encoder-Based Nonlinear Model Reduction for Operator Learning

abstract: Many physical processes in science and engineering are naturally represented by operators between infinite-dimensional function spaces. The problem of operator learning, in this context, seeks to extract these physical processes from empirical data, which is challenging due to the infinite or high dimensionality of data. An integral component in addressing this challenge is model reduction, which reduces both the data dimensionality and problem size. In this paper, we utilize low-dimensional nonlinear structures in model reduction by investigating Auto-Encoder-based Neural Network (AENet). AENet first learns the latent variables of the input data and then learns the transformation from these latent variables to corresponding output data. Our numerical experiments validate the ability of AENet to accurately learn the solution operator of nonlinear partial differential equations. Furthermore, we establish a mathematical and statistical estimation theory that analyzes the generalization error of AENet. Our theoretical framework shows that the sample complexity of training AENet is intricately tied to the intrinsic dimension of the modeled process, while also demonstrating the remarkable resilience of AENet to noise.


title: Knowledge Fusion of Large Language Models

abstract: While training large language models (LLMs) from scratch can generate models with distinct functionalities and strengths, it comes at significant costs and may result in redundant capabilities. Alternatively, a cost-effective and compelling approach is to merge existing pre-trained LLMs into a more potent model. However, due to the varying architectures of these LLMs, directly blending their weights is impractical. In this paper, we introduce the notion of knowledge fusion for LLMs, aimed at combining the capabilities of existing LLMs and transferring them into a single LLM. By leveraging the generative distributions of source LLMs, we externalize their collective knowledge and unique strengths, thereby potentially elevating the capabilities of the target model beyond those of any individual source LLM. We validate our approach using three popular LLMs with different architectures--Llama-2, MPT, and OpenLLaMA--across various benchmarks and tasks. Our findings confirm that the fusion of LLMs can improve the performance of the target model across a range of capabilities such as reasoning, commonsense, and code generation. Our code, model weights, and data are public at \url{https://github.com/fanqiwan/FuseLLM}.


title: Betti numbers for connected sums of graded Gorenstein artinian algebras

abstract: The connected sum construction, which takes as input Gorenstein rings and produces new Gorenstein rings, can be considered as an algebraic analogue for the topological construction having the same name. We determine the graded Betti numbers for connected sums of graded Artinian Gorenstein algebras. Along the way, we find the graded Betti numbers for fiber products of graded rings; an analogous result was obtained in the local case by Geller. We relate the connected sum construction to the doubling construction, which also produces Gorenstein rings. Specifically, we show that a connected sum of doublings is the doubling of a fiber product ring.


title: Elliptic curves and their principal homogeneous spaces: splitting Severi--Brauer varieties

abstract: We consider the question: which elliptic curves appear as the Jacobian of a smooth curve of genus one splitting a Severi--Brauer variety? We provide three new examples. First, we show that if $E$ is any elliptic curve over an algebraically closed field $k$ and if $F/k$ is a perfect field extension, then there exists a principal homogeneous space for $E_F$ splitting a Severi--Brauer variety $X=\mathrm{SB}(A)$ over $F$ if and only if $A$ is Brauer equivalent to a cyclic algebra. Along the way, we also give a uniform proof of a generalization of results due to O'Neil, Clark and Sharif, and Antieau and Auel. Second, we give an example of an elliptic curve $E$ over a field $k$ together with a central simple algebra $A/k$ of degree $4$ such that $E$ is the Jacobian of a smooth genus one curve $C$ embedded in the Severi--Brauer variety $X=\mathrm{SB}(A)$ as a degree 8 curve and such that $E$ is not the Jacobian of any genus one curve of smaller degree contained in $X$. Our example is, in some sense, as small as possible in both dimension and arithmetic complexity. Third, we show that for any odd integer $n\geq 3$ there is a central simple algebra $A$ of degree $n$ over a local field $k$ which is split by the principal homogeneous space of an elliptic curve $E/k$ but not by any principal homogeneous space for any quadratic twist of $E$. This generalizes a recent result of Saltman in the case of surfaces to arbitrary even dimension.


title: A Two-Stage Framework in Cross-Spectrum Domain for Real-Time Speech Enhancement

abstract: Two-stage pipeline is popular in speech enhancement tasks due to its superiority over traditional single-stage methods. The current two-stage approaches usually enhance the magnitude spectrum in the first stage, and further modify the complex spectrum to suppress the residual noise and recover the speech phase in the second stage. The above whole process is performed in the short-time Fourier transform (STFT) spectrum domain. In this paper, we re-implement the above second sub-process in the short-time discrete cosine transform (STDCT) spectrum domain. The reason is that we have found STDCT performs greater noise suppression capability than STFT. Additionally, the implicit phase of STDCT ensures simpler and more efficient phase recovery, which is challenging and computationally expensive in the STFT-based methods. Therefore, we propose a novel two-stage framework called the STFT-STDCT spectrum fusion network (FDFNet) for speech enhancement in cross-spectrum domain. Experimental results demonstrate that the proposed FDFNet outperforms the previous two-stage methods and also exhibits superior performance compared to other advanced systems.


title: Causal Layering via Conditional Entropy

abstract: Causal discovery aims to recover information about an unobserved causal graph from the observable data it generates. Layerings are orderings of the variables which place causes before effects. In this paper, we provide ways to recover layerings of a graph by accessing the data via a conditional entropy oracle, when distributions are discrete. Our algorithms work by repeatedly removing sources or sinks from the graph. Under appropriate assumptions and conditioning, we can separate the sources or sinks from the remainder of the nodes by comparing their conditional entropy to the unconditional entropy of their noise. Our algorithms are provably correct and run in worst-case quadratic time. The main assumptions are faithfulness and injective noise, and either known noise entropies or weakly monotonically increasing noise entropies along directed paths. In addition, we require one of either a very mild extension of faithfulness, or strictly monotonically increasing noise entropies, or expanding noise injectivity to include an additional single argument in the structural functions.


title: On the locally self-similar blowup for the generalized SQG equation

abstract: We analyze finite-time blowup scenarios of locally self-similar type for the inviscid generalized surface quasi-geostrophic equation (gSQG) in $\mathbb{R}^2$. Under an $L^r$ growth assumption on the self-similar profile and its gradient, we identify appropriate ranges of the self-similar parameter where the profile is either identically zero, and hence blowup cannot occur, or its $L^p$ asymptotic behavior can be characterized, for suitable $r, p$. Furthermore, we also generalize and improve on an analogous result proved in [Xue; Journal of Differential Equations, 2016] concerning the SQG equation and recover the results proved in [Cannone, Xue; Proceedings of the American Mathematical Society, 2015] concerning the globally self-similar solutions of the gSQG equation.


title: An Elementary Method For Fast Modular Exponentiation With Factored Modulus

abstract: We present a fast algorithm for modular exponentiation when the factorization of the modulus is known. Let $a,n,m$ be positive integers and suppose $m$ factors canonically as $\prod_{i=1}^k p_i^{e_i}$. Choose integer parameters $t_i\in [0, e_i]$ for $1\le i\le k$. Then we can compute the modular exponentiation $a^n\pmod{m}$ in $O(\max(e_i/t_i)+\sum_{i=1}^k t_i\log p_i)$ steps (i.e. modular operations). We go on to analyze this algorithm mathematically and programmatically, showing significant asymptotic improvement in specific cases. Specifically, for an infinite family of $m$ we achieve a complexity of $O(\sqrt{\log m})$. Additionally, we extend our algorithm to matrices and hence general linear recurrences. The complexity is similar; with the same setup we can exponentiate matrices in $GL_d(\mathbb{Z}/m\mathbb{Z})$ in less than $O(\max(e_i/t_i)+d^2\sum_{i=1}^k t_i\log p_i)$ steps. This improves Fiduccia's algorithm and the results of Bostan and Mori in the case of $\mathbb{Z}/m\mathbb{Z}$. Finally, we prove analogous results for $\mathbb{Z}/p^k\mathbb{Z}$ ring extensions.


title: Efficient Probabilistic Optimal Power Flow Assessment Using an Adaptive Stochastic Spectral Embedding Surrogate Model

abstract: This paper presents an adaptive stochastic spectral embedding (ASSE) method to solve the probabilistic AC optimal power flow (AC-OPF), a critical aspect of power system operation. The proposed method can efficiently and accurately estimate the probabilistic characteristics of AC-OPF solutions. An adaptive domain partition strategy and expansion coefficient calculation algorithm are integrated to enhance its performance. Numerical studies on a 9-bus system demonstrate that the proposed ASSE method offers accurate and fast evaluations compared to the Monte Carlo simulations. A comparison with a sparse polynomial chaos expansion method, an existing surrogate model, further demonstrates its efficacy in accurately assessing the responses with strongly local behaviors.


title: Scaling Relations of Spectrum Form Factor and Krylov Complexity at Finite Temperature

abstract: In the study of quantum chaos diagnostics, considerable attention has been attributed to the Krylov complexity and spectrum form factor (SFF) for systems at infinite temperature. These investigations have unveiled universal properties of quantum chaotic systems. By extending the analysis to include the finite temperature effects on the Krylov complexity and SFF, we demonstrate that the Lanczos coefficients $b_n$, which are associated with the Wightman inner product, display consistency with the universal hypothesis presented in PRX 9, 041017 (2019). This result contrasts with the behavior of Lanczos coefficients associated with the standard inner product. Our results indicate that the slope $\alpha$ of the $b_n$ is bounded by $\pi k_BT$, where $k_B$ is the Boltzmann constant and $T$ the temperature. We also investigate the SFF, which characterizes the two-point correlation of the spectrum and encapsulates an indicator of ergodicity denoted by $g$ in chaotic systems. Our analysis demonstrates that as the temperature decreases, the value of $g$ decreases as well. Considering that $\alpha$ also represents the operator growth rate, we establish a quantitative relationship between ergodicity indicator and Lanczos coefficients slope. To support our findings, we provide evidence using the Gaussian orthogonal ensemble and a random spin model. Our work deepens the understanding of the finite temperature effects on Krylov complexity, SFF, and the connection between ergodicity and operator growth.

categories: cond-mat.stat-mech cond-mat.dis-nn cond-mat.quant-gas quant-ph


title: Listing superspecial curves of genus three by using Richelot isogeny graph

abstract: In algebraic geometry, superspecial curves are important research objects. While the number of superspecial genus-3 curves in characteristic $p$ is known, the number of hyperelliptic ones among them has not been determined even for small $p$. In this paper, in order to compute the latter number, we give an algorithm for computing the Richelot isogeny graph of superspecial abelian threefolds by using theta functions. Our algorithm enables us to efficiently list superspecial genus-3 curves, and we succeeded in counting hyperelliptic curves among them when $11 \leq p < 100$ by executing our algorithm in Magma.


title: Enhancing medical vision-language contrastive learning via inter-matching relation modelling

abstract: Medical image representations can be learned through medical vision-language contrastive learning (mVLCL) where medical imaging reports are used as weak supervision through image-text alignment. These learned image representations can be transferred to and benefit various downstream medical vision tasks such as disease classification and segmentation. Recent mVLCL methods attempt to align image sub-regions and the report keywords as local-matchings. However, these methods aggregate all local-matchings via simple pooling operations while ignoring the inherent relations between them. These methods therefore fail to reason between local-matchings that are semantically related, e.g., local-matchings that correspond to the disease word and the location word (semantic-relations), and also fail to differentiate such clinically important local-matchings from others that correspond to less meaningful words, e.g., conjunction words (importance-relations). Hence, we propose a mVLCL method that models the inter-matching relations between local-matchings via a relation-enhanced contrastive learning framework (RECLF). In RECLF, we introduce a semantic-relation reasoning module (SRM) and an importance-relation reasoning module (IRM) to enable more fine-grained report supervision for image representation learning. We evaluated our method using four public benchmark datasets on four downstream tasks, including segmentation, zero-shot classification, supervised classification, and cross-modal retrieval. Our results demonstrated the superiority of our RECLF over the state-of-the-art mVLCL methods with consistent improvements across single-modal and cross-modal tasks. These results suggest that our RECLF, by modelling the inter-matching relations, can learn improved medical image representations with better generalization capabilities.


title: Predicting the Timing of the the Solar Cycle 25 Polar Field Reversal

abstract: The process of the Sun's polar field cancellation reversal commences with the emergence of new cycle Hale's polarity active regions. Once the Sun undergoes polarity reversal, typically occurring near the peak of solar activity, it begins the process of accumulating the seed field for the forthcoming solar cycle. In recent years, the Advective Flux Transport (AFT) model has proven highly effective in forecasting the progression of polar fields by leveraging observations of surface flows and magnetic flux emergence. In this study, we make use of the predictive capability of the AFT model to simulate the evolution of the polar fields and estimate the timing of the Solar Cycle 25 polarity reversal in both hemispheres of the Sun. We use the statistical properties of active regions along with Solar Cycle~13, which closely resembles the current solar cycle (Cycle~25), to generate synthetic active regions in order to simulate future magnetic flux emergence in AFT to predict the evolution of the polar field. Based on our simulations, we anticipate that the Northern hemisphere of the Sun will undergo a polarity reversal between June 2024 and November 2024, with the center of our distribution at August 2024. In the Southern hemisphere, we anticipate a polarity reversal between November 2024 and July 2025, centered around February 2025. Additionally, assuming that the reversal of the axial dipole moment coincides with the peak of the solar cycle, our findings indicate that Cycle 25 is expected to peak in 2024 (likely between April to August 2024).


title: Multiple measurements on the cosmic curvature using Gaussian process regression without calibration and a cosmological model

abstract: In this letter, we propose an improved cosmological model-independent method to measure cosmic curvature, combining the recent measurements of transverse and line-of-sight directions in the baryon acoustic oscillations (BAO) with cosmic chronometers (CC) datasets. Considering that the CC dataset is discrete and includes only 32 $H(z)$ measurements, we apply Gaussian process (GP) regression to fit the CC dataset and reconstruct them. Our methodology, which does not need the calibration or selection of any cosmological model, provide multiple measurements of spatial curvature ($\Omega_K$) at different redshifts (depending on the redshift coverage of BAO dataset). For combination of all BAO data, we find that the constraint result on cosmic curvature is $\Omega_K=-0.096^{+0.190}_{-0.195}$ with $1\sigma$ observational uncertainty. Although the measured $\Omega_K$ is in good agreement with zero cosmic curvature within 1$\sigma$ confidence level, our result revels the fact of a closed universe. More importantly, our results show that the obtained $\Omega_K$ measurements are almost unaffected by different priors of the Hubble constant. This could help solve the issue of the Hubble tension that may be caused by inconsistencies in the spatial curvature between the early and late universes.


title: A multi-dimensional analysis of usage counts, Mendeley readership, and citations for journal and conference papers

abstract: This study analyzed 16,799 journal papers and 98,773 conference papers published by IEEE Xplore in 2016 to investigate the relationships among usage counts, Mendeley readership, and citations through descriptive, regression, and mediation analyses. Differences in the relationship among these metrics between journal and conference papers are also studied. Results showed that there is no significant difference between journal and conference papers in the distribution patterns and accumulation rates of the three metrics. However, the correlation coefficients of the interrelationships between the three metrics were lower in conference papers compared to journal papers. Secondly, funding, international collaboration, and open access are positively associated with all three metrics, except for the case of funding on the usage metrics of conference papers. Furthermore, early Mendeley readership is a better predictor of citations than early usage counts and performs better for journal papers. Finally, we reveal that early Mendeley readership partially mediates between early usage counts and citation counts in the journal and conference papers. The main difference is that conference papers rely more on the direct effect of early usage counts on citations. This study contributes to expanding the existing knowledge on the relationships among usage counts, Mendeley readership, and citations in journal and conference papers, providing new insights into the relationship between the three metrics through mediation analysis.


title: Lower bounds for the first eigenvalue of the $p$-Laplacian on quaternionic K\"ahler manifolds

abstract: We study the first nonzero eigenvalues for the $p$-Laplacian on quaternionic K\"ahler manifolds. Our first result is a lower bound for the first nonzero closed (Neumann) eigenvalue of the $p$-Laplacian on compact quaternionic K\"ahler manifolds. Our second result is a lower bound for the first Dirichlet eigenvalue of the $p$-Laplacian on compact quaternionic K\"ahler manifolds with smooth boundary. Our results generalize corresponding results for the Laplacian eigenvalues on quaternionic K\"ahler manifolds proved in [22].


title: FinSQL: Model-Agnostic LLMs-based Text-to-SQL Framework for Financial Analysis

abstract: Text-to-SQL, which provides zero-code interface for operating relational databases, has gained much attention in financial analysis; because, financial professionals may not well-skilled in SQL programming. However, until now, there is no practical Text-to-SQL benchmark dataset for financial analysis, and existing Text-to-SQL methods have not considered the unique characteristics of databases in financial applications, such as commonly existing wide tables. To address these issues, we collect a practical Text-to-SQL benchmark dataset and propose a model-agnostic Large Language Model (LLMs)-based Text-to-SQL framework for financial analysis. The benchmark dataset, BULL, is collected from the practical financial analysis business of Hundsun Technologies Inc., including databases for fund, stock, and macro economy. Besides, the proposed LLMs-based Text-to-SQL framework, FinSQL, provides a systematic treatment for financial Text-to-SQL from the perspectives of prompt construction, parameter-efficient fine-tuning and output calibration. Extensive experimental results on BULL demonstrate that FinSQL achieves the state-of-the-art Text-to-SQL performance at a small cost; furthermore, FinSQL can bring up to 36.64% performance improvement in scenarios requiring few-shot cross-database model transfer.


title: A scaling limit of $\mathrm{SU}(2)$ lattice Yang-Mills-Higgs theory

abstract: The construction of non-Abelian Euclidean Yang-Mills theories in dimension four, as scaling limits of lattice Yang-Mills theories or otherwise, is a central open question of mathematical physics. This paper takes the following small step towards this goal. In any dimension $d\ge 2$, we construct a scaling limit of $\mathrm{SU}(2)$ lattice Yang-Mills theory coupled to a Higgs field transforming in the fundamental representation of $\mathrm{SU}(2)$. The scaling limit is obtained by sending the gauge coupling constant $g$ to zero and the Higgs length $\alpha$ to infinity slower than $g^{-1}$, but faster than $g^{-1+1/49d}$. After unitary gauge fixing and taking the lattice scaling to zero as a constant multiple of $\alpha g$, a stereographic projection of the gauge field is shown to converge to a scale-invariant massive Gaussian field. This gives the first construction of a scaling limit of a non-Abelian lattice Yang-Mills theory in a dimension higher than two, as well as the first rigorous proof of mass generation by the Higgs mechanism in such a theory. Analogous results are proved for $\mathrm{U}(1)$ theory as well. The question of constructing a non-Gaussian scaling limit remains open.


title: Photonic Supercoupling in Silicon Topological Waveguides

abstract: Electromagnetic wave coupling between photonic systems relies on the evanescent field typically confined within a single wavelength. Extending evanescent coupling distance requires low refractive index contrast and perfect momentum matching for achieving a large coupling ratio. Here, we report the discovery of photonic supercoupling in a topological valley Hall pair of waveguides, showing a substantial improvement in coupling efficiency across multiple wavelengths. Experimentally, we realize ultra-high coupling ratios between waveguides through valley-conserved vortex flow of electromagnetic energy, attaining 95% coupling efficiency for separations of up to three wavelengths. This demonstration of photonic supercoupling in topological systems significantly extends the coupling distance between on-chip waveguides and components, paving the path for the development of supercoupled photonic integrated devices, optical sensing, and telecommunications.

categories: physics.optics cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph quant-ph


title: ICECAP: a 3-in-1 integrated cryogenic system for emission, collection and photon-detection from near infrared quantum nanophotonic devices

abstract: Deployment of quantum telecommunication technologies requires single-photon light emission, collection and detection capability at each network node in cryogenic environments. We combine recent technological advancements in single-photon detectors and cryogenics to demonstrate a 3-in-1 system that incorporates superconducting nanowire single-photon detectors into an optical cryostat operating at temperatures below 2 K. Dubbed the ICECAP system, this cryostation cools samples, collects emission, and detects single photons in one efficient environment suitable for a variety of near infrared quantum emitters. We utilize this system to characterize emission from silicon carbide color centers in photoluminescence and time-resolved measurements. Moreover, we demonstrate the first optical characterization of nitrogen-vacancy centers integrated in 4H-SiC nanopillars.


title: A match made in consistency heaven: when large language models meet evolutionary algorithms

abstract: Pre-trained large language models (LLMs) have powerful capabilities for generating creative natural text. Evolutionary algorithms (EAs) can discover diverse solutions to complex real-world problems. Motivated by the common collective and directionality of text sequence generation and evolution, this paper illustrates the strong consistency of LLMs and EAs, which includes multiple one-to-one key characteristics: token embedding and genotype-phenotype mapping, position encoding and fitness shaping, position embedding and selection, attention and crossover, feed-forward neural network and mutation, model training and parameter update, and multi-task learning and multi-objective optimization. Based on this consistency perspective, existing coupling studies are analyzed, including evolutionary fine-tuning and LLM-enhanced EAs. Leveraging these insights, we outline a fundamental roadmap for future research in coupling LLMs and EAs, while highlighting key challenges along the way. The consistency not only reveals the evolution mechanism behind LLMs but also facilitates the development of evolved artificial agents that approach or surpass biological organisms.


title: GMC-IQA: Exploiting Global-correlation and Mean-opinion Consistency for No-reference Image Quality Assessment

abstract: Due to the subjective nature of image quality assessment (IQA), assessing which image has better quality among a sequence of images is more reliable than assigning an absolute mean opinion score for an image. Thus, IQA models are evaluated by global correlation consistency (GCC) metrics like PLCC and SROCC, rather than mean opinion consistency (MOC) metrics like MAE and MSE. However, most existing methods adopt MOC metrics to define their loss functions, due to the infeasible computation of GCC metrics during training. In this work, we construct a novel loss function and network to exploit Global-correlation and Mean-opinion Consistency, forming a GMC-IQA framework. Specifically, we propose a novel GCC loss by defining a pairwise preference-based rank estimation to solve the non-differentiable problem of SROCC and introducing a queue mechanism to reserve previous data to approximate the global results of the whole data. Moreover, we propose a mean-opinion network, which integrates diverse opinion features to alleviate the randomness of weight learning and enhance the model robustness. Experiments indicate that our method outperforms SOTA methods on multiple authentic datasets with higher accuracy and generalization. We also adapt the proposed loss to various networks, which brings better performance and more stable training.


title: Exploring Color Invariance through Image-Level Ensemble Learning

abstract: In the field of computer vision, the persistent presence of color bias, resulting from fluctuations in real-world lighting and camera conditions, presents a substantial challenge to the robustness of models. This issue is particularly pronounced in complex wide-area surveillance scenarios, such as person re-identification and industrial dust segmentation, where models often experience a decline in performance due to overfitting on color information during training, given the presence of environmental variations. Consequently, there is a need to effectively adapt models to cope with the complexities of camera conditions. To address this challenge, this study introduces a learning strategy named Random Color Erasing, which draws inspiration from ensemble learning. This strategy selectively erases partial or complete color information in the training data without disrupting the original image structure, thereby achieving a balanced weighting of color features and other features within the neural network. This approach mitigates the risk of overfitting and enhances the model's ability to handle color variation, thereby improving its overall robustness. The approach we propose serves as an ensemble learning strategy, characterized by robust interpretability. A comprehensive analysis of this methodology is presented in this paper. Across various tasks such as person re-identification and semantic segmentation, our approach consistently improves strong baseline methods. Notably, in comparison to existing methods that prioritize color robustness, our strategy significantly enhances performance in cross-domain scenarios. The code available at \url{https://github.com/layumi/Person\_reID\_baseline\_pytorch/blob/master/random\_erasing.py} or \url{https://github.com/finger-monkey/Data-Augmentation}.


title: SAGE-HB: Swift Adaptation and Generalization in Massive MIMO Hybrid Beamforming

abstract: Deep learning (DL)-based solutions have emerged as promising candidates for beamforming in massive Multiple-Input Multiple-Output (mMIMO) systems. Nevertheless, it remains challenging to seamlessly adapt these solutions to practical deployment scenarios, typically necessitating extensive data for fine-tuning while grappling with domain adaptation and generalization issues. In response, we propose a novel approach combining Meta-Learning Domain Generalization (MLDG) with novel data augmentation techniques during fine-tuning. This approach not only accelerates adaptation to new channel environments but also significantly reduces the data requirements for fine-tuning, thereby enhancing the practicality and efficiency of DL-based mMIMO systems. The proposed approach is validated by simulating the performance of a backbone model when deployed in a new channel environment, and with different antenna configurations, path loss, and base station height parameters. Our proposed approach demonstrates superior zero-shot performance compared to existing methods and also achieves near-optimal performance with significantly fewer fine-tuning data samples.


title: A spectral theorem for a non-Archimedean valued field whose residue field is formally real

abstract: In this paper, we will prove a spectral theorem for self-adjoint compactoid operators. Also, we will study the condition on which the coefficient field must be imposed. In order to get the theorems, we will use the Fredholm theory for compactoid operators. Moreover, the property of maximal complete field is important for our study. These facts will allow us to find that the spectral theorem depends only on the residue class field, and is independent of the valuation group of the coefficient field. As a result, we can settle the problem of the spectral theorem in the case where the residue class field is formally real.


title: New Pathways in Coevolutionary Computation

abstract: The simultaneous evolution of two or more species with coupled fitness -- coevolution -- has been put to good use in the field of evolutionary computation. Herein, we present two new forms of coevolutionary algorithms, which we have recently designed and applied with success. OMNIREP is a cooperative coevolutionary algorithm that discovers both a representation and an encoding for solving a particular problem of interest. SAFE is a commensalistic coevolutionary algorithm that maintains two coevolving populations: a population of candidate solutions and a population of candidate objective functions needed to measure solution quality during evolution.


title: Episodic Reinforcement Learning with Expanded State-reward Space

abstract: Empowered by deep neural networks, deep reinforcement learning (DRL) has demonstrated tremendous empirical successes in various domains, including games, health care, and autonomous driving. Despite these advancements, DRL is still identified as data-inefficient as effective policies demand vast numbers of environmental samples. Recently, episodic control (EC)-based model-free DRL methods enable sample efficiency by recalling past experiences from episodic memory. However, existing EC-based methods suffer from the limitation of potential misalignment between the state and reward spaces for neglecting the utilization of (past) retrieval states with extensive information, which probably causes inaccurate value estimation and degraded policy performance. To tackle this issue, we introduce an efficient EC-based DRL framework with expanded state-reward space, where the expanded states used as the input and the expanded rewards used in the training both contain historical and current information. To be specific, we reuse the historical states retrieved by EC as part of the input states and integrate the retrieved MC-returns into the immediate reward in each interactive transition. As a result, our method is able to simultaneously achieve the full utilization of retrieval information and the better evaluation of state values by a Temporal Difference (TD) loss. Empirical results on challenging Box2d and Mujoco tasks demonstrate the superiority of our method over a recent sibling method and common baselines. Further, we also verify our method's effectiveness in alleviating Q-value overestimation by additional experiments of Q-value comparison.


title: Hamiltonian Stationary Lagrangian Surfaces with Non-Negative Gaussian Curvature in K\"ahler-Einstein Surfaces

abstract: In this paper, we give some simple conditions under which a Hamiltonian stationary Lagrangian submanifold of a K\"ahler-Einstein manifold must have a Euclidean factor or be a fiber bundle over a circle. We also characterize the Hamiltonian stationary Lagrangian surfaces whose Gaussian curvature is non-negative and whose mean curvature vector is in some $L^p$ space when the ambient space is a simply connected complex space form.