title: World Models with Hints of Large Language Models for Goal Achieving

abstract: Reinforcement learning struggles in the face of long-horizon tasks and sparse goals due to the difficulty in manual reward specification. While existing methods address this by adding intrinsic rewards, they may fail to provide meaningful guidance in long-horizon decision-making tasks with large state and action spaces, lacking purposeful exploration. Inspired by human cognition, we propose a new multi-modal model-based RL approach named Dreaming with Large Language Models (DLLM). DLLM integrates the proposed hinting subgoals from the LLMs into the model rollouts to encourage goal discovery and reaching in challenging tasks. By assigning higher intrinsic rewards to samples that align with the hints outlined by the language model during model rollouts, DLLM guides the agent toward meaningful and efficient exploration. Extensive experiments demonstrate that the DLLM outperforms recent methods in various challenging, sparse-reward environments such as HomeGrid, Crafter, and Minecraft by 27.7\%, 21.1\%, and 9.9\%, respectively.


title: Fast Adaptive Meta-Heuristic for Large-Scale Facility Location Problem

abstract: Facility location problems have been a major research area of interest in the last several decades. In particular, uncapacitated location problems (ULP) have enormous applications. Variations of ULP often appear, especially as large-scale subproblems in more complex combinatorial optimization problems. Although many researchers have studied different versions of ULP (e.g., uncapacitated facility location problem (UCFLP) and p-Median problem), most of these authors have considered small to moderately sized problems. In this paper, we address the ULP and provide a fast adaptive meta-heuristic for large-scale problems. The approach is based on critical event memory tabu search. For the diversification component of the algorithm, we have chosen a procedure based on a sequencing problem commonly used for traveling salesman-type problems. The efficacy of this approach is evaluated across a diverse range of benchmark problems sourced from the Internet, with a comprehensive comparison against four prominent algorithms in the literature. The proposed adaptive critical event tabu search (ACETS) demonstrates remarkable effectiveness for large-scale problems. The algorithm successfully solved all problems optimally within a short computing time. Notably, ACETS discovered three best new solutions for benchmark problems, specifically for Asymmetric 500A-1, Asymmetric 750A-1, and Symmetric 750B-4, underscoring its innovative and robust nature.


title: Federated Multi-Agent DRL for Radio Resource Management in Industrial 6G in-X subnetworks

abstract: Recently, 6G in-X subnetworks have been proposed as low-power short-range radio cells to support localized extreme wireless connectivity inside entities such as industrial robots, vehicles, and the human body. Deployment of in-X subnetworks within these entities may result in rapid changes in interference levels and thus, varying link quality. This paper investigates distributed dynamic channel allocation to mitigate inter-subnetwork interference in dense in-factory deployments of 6G in-X subnetworks. This paper introduces two new techniques, Federated Multi-Agent Double Deep Q-Network (F-MADDQN) and Federated Multi-Agent Deep Proximal Policy Optimization (F-MADPPO), for channel allocation in 6G in-X subnetworks. These techniques are based on a client-to-server horizontal federated reinforcement learning framework. The methods require sharing only local model weights with a centralized gNB for federated aggregation thereby preserving local data privacy and security. Simulations were conducted using a practical indoor factory environment proposed by 5G-ACIA and 3GPP models for in-factory environments. The results showed that the proposed methods achieved slightly better performance than baseline schemes with significantly reduced signaling overhead compared to the baseline solutions. The schemes also showed better robustness and generalization ability to changes in deployment densities and propagation parameters.


title: Strong Repulsive Lifshitz-van der Waals Forces on Suspended Graphene

abstract: Understanding surface forces of two-dimensional (2D) materials is of fundamental importance as they govern molecular dynamics and atomic deposition in nanoscale proximity. Despite recent observations in wetting transparency and remote epitaxy on substrate-supported graphene, very little is known about the many-body effects on their van der Waals (vdW) interactions, such as the role of surrounding vacuum in wettability of suspended 2D monolayers. Here we report on a stark repulsive Lifshitz-van der Waals (vdW) force generated at surfaces of suspended 2D materials, arising from quantum fluctuation coupled with the atomic thickness and birefringence of 2D monolayer. In combination with our theoretical framework taking into account the many-body Lifshitz formulism, we present direct measurement of Lifshitz-vdW repulsion on suspended graphene using atomic force microscopy. We report a repulsive force of up to 1.4 kN/m$^2$ at a separation of 8.8 nm between a gold-coated AFM tip and a sheet of suspended graphene, more than two orders of magnitude greater than the Casimir-Lifshitz repulsion demonstrated in fluids. Our findings suggest that suspended 2D materials are intrinsically repulsive surfaces with substantially lowered wettability. The amplified Lifshitz-vdW repulsion could offer technological opportunities such as molecular actuation and controlled atomic assembly.


title: Disrupting Bipartite Trading Networks: Matching for Revenue Maximization

abstract: We model the role of an online platform disrupting a market with unit-demand buyers and unit-supply sellers. Each seller can transact with a subset of the buyers whom she already knows, as well as with any additional buyers to whom she is introduced by the platform. Given these constraints on trade, prices and transactions are induced by a competitive equilibrium. The platform's revenue is proportional to the total price of all trades between platform-introduced buyers and sellers. In general, we show that the platform's revenue-maximization problem is computationally intractable. We provide structural results for revenue-optimal matchings and isolate special cases in which the platform can efficiently compute them. Furthermore, in a market where the maximum increase in social welfare that the platform can create is $\Delta W$, we prove that the platform can attain revenue $\Omega(\Delta W/\log(\min\{n,m\}))$, where $n$ and $m$ are the numbers of buyers and sellers, respectively. When $\Delta W$ is large compared to welfare without the platform, this gives a polynomial-time algorithm that guarantees a logarithmic approximation of the optimal welfare as revenue. We also show that even when the platform optimizes for revenue, the social welfare is at least an $O(\log(\min\{n,m\}))$-approximation to the optimal welfare. Finally, we prove significantly stronger bounds for revenue and social welfare in homogeneous-goods markets.


title: Spin-orbit coupling induced orbital entanglement in a three-band Hubbard model

abstract: The effect of the spin-orbit coupling on the ground state properties of the square-lattice three-band Hubbard model with a single electron per site is studied by a generalized Hartree-Fock approximation. We calculate the full phase diagram and show that there appear additional orbital-entangled phases brought about by competition of various exchange channels or by the spin-orbit coupling in addition to conventional states stabilized by the Kugel-Khomskii mechanism. One of these phases previously proposed to explain magnetic properties of Sr$_2$VO$_4$ is characterized by vanishing dipolar magnetic moments and antiferro-octupolar ordering. We calculated microscopic parameters for this material and demonstrate that it is located near a phase boundary of two orbital-entangled and two conventional antiferromagnetic ferro-orbital states.


title: Machine Learning-Based Channel Prediction for RIS-assisted MIMO Systems With Channel Aging

abstract: Reconfigurable intelligent surfaces (RISs) have emerged as a promising technology to enhance the performance of sixth-generation (6G) and beyond communication systems. The passive nature of RISs and their large number of reflecting elements pose challenges to the channel estimation process. The associated complexity further escalates when the channel coefficients are fast-varying as in scenarios with user mobility. In this paper, we propose an extended channel estimation framework for RIS-assisted multiple-input multiple-output (MIMO) systems based on a convolutional neural network (CNN) integrated with an autoregressive (AR) predictor. The implemented framework is designed for identifying the aging pattern and predicting enhanced estimates of the wireless channels in correlated fast-fading environments. Insightful simulation results demonstrate that our proposed CNN-AR approach is robust to channel aging, exhibiting a high-precision estimation accuracy. The results also show that our approach can achieve high spectral efficiency and low pilot overhead compared to traditional methods.


title: Probabilistic models and statistics for electronic financial markets in the digital age

abstract: The scope of this manuscript is to review some recent developments in statistics for discretely observed semimartingales which are motivated by applications for financial markets. Our journey through this area stops to take closer looks at a few selected topics discussing recent literature. We moreover highlight and explain the important role played by some classical concepts of probability and statistics. We focus on three main aspects: Testing for jumps; rough fractional stochastic volatility; and limit order microstructure noise. We review jump tests based on extreme value theory and complement the literature proposing new statistical methods. They are based on asymptotic theory of order statistics and the R\'{e}nyi representation. The second stage of our journey visits a recent strand of research showing that volatility is rough. We further investigate this and establish a minimax lower bound exploring frontiers to what extent the regularity of latent volatility can be recovered in a more general framework. Finally, we discuss a stochastic boundary model with one-sided microstructure noise for high-frequency limit order prices and its probabilistic and statistical foundation.


title: Robust Image Semantic Coding with Learnable CSI Fusion Masking over MIMO Fading Channels

abstract: Though achieving marvelous progress in various scenarios, existing semantic communication frameworks mainly consider single-input single-output Gaussian channels or Rayleigh fading channels, neglecting the widely-used multiple-input multiple-output (MIMO) channels, which hinders the application into practical systems. One common solution to combat MIMO fading is to utilize feedback MIMO channel state information (CSI). In this paper, we incorporate MIMO CSI into system designs from a new perspective and propose the learnable CSI fusion semantic communication (LCFSC) framework, where CSI is treated as side information by the semantic extractor to enhance the semantic coding. To avoid feature fusion due to abrupt combination of CSI with features, we present a non-invasive CSI fusion multi-head attention module inside the Swin Transformer. With the learned attention masking map determined by both source and channel states, more robust attention distribution could be generated. Furthermore, the percentage of mask elements could be flexibly adjusted by the learnable mask ratio, which is produced based on the conditional variational interference in an unsupervised manner. In this way, CSI-aware semantic coding is achieved through learnable CSI fusion masking. Experiment results testify the superiority of LCFSC over traditional schemes and state-of-the-art Swin Transformer-based semantic communication frameworks in MIMO fading channels.


title: DiffCom: Channel Received Signal is a Natural Condition to Guide Diffusion Posterior Sampling

abstract: End-to-end visual communication systems typically optimize a trade-off between channel bandwidth costs and signal-level distortion metrics. However, under challenging physical conditions, this traditional discriminative communication paradigm often results in unrealistic reconstructions with perceptible blurring and aliasing artifacts, despite the inclusion of perceptual or adversarial losses for optimizing. This issue primarily stems from the receiver's limited knowledge about the underlying data manifold and the use of deterministic decoding mechanisms. To address these limitations, this paper introduces DiffCom, a novel end-to-end generative communication paradigm that utilizes off-the-shelf generative priors and probabilistic diffusion models for decoding, thereby improving perceptual quality without heavily relying on bandwidth costs and received signal quality. Unlike traditional systems that rely on deterministic decoders optimized solely for distortion metrics, our DiffCom leverages raw channel-received signal as a fine-grained condition to guide stochastic posterior sampling. Our approach ensures that reconstructions remain on the manifold of real data with a novel confirming constraint, enhancing the robustness and reliability of the generated outcomes. Furthermore, DiffCom incorporates a blind posterior sampling technique to address scenarios with unknown forward transmission characteristics. Extensive experimental validations demonstrate that DiffCom not only produces realistic reconstructions with details faithful to the original data but also achieves superior robustness against diverse wireless transmission degradations. Collectively, these advancements establish DiffCom as a new benchmark in designing generative communication systems that offer enhanced robustness and generalization superiorities.


title: Any topological recursion on a rational spectral curve is KP integrable

abstract: We prove that for any initial data on a genus zero spectral curve the corresponding correlation differentials of topological recursion are KP integrable. As an application we prove KP integrability of partition functions associated via ELSV-type formulas to the $r$-th roots of the twisted powers of the log canonical bundles.


title: Net Zero Averted Temperature Increase

abstract: Using feedback-free estimates of the warming by increased atmospheric carbon dioxide (CO2) and observed rates of increase, we estimate that if the United States (U.S.) eliminated net CO2 emissions by the year 2050, this would avert a warming of 0.0084 C (0.015 F), which is below our ability to accurately measure. If the entire world forced net zero CO2 emissions by the year 2050, a warming of only 0.070 C (0.13 F) would be averted. If one assumes that the warming is a factor of 4 larger because of positive feedbacks, as asserted by the Intergovernmental Panel on Climate Change (IPCC), the warming averted by a net zero U.S. policy would still be very small, 0.034 C (0.061 F). For worldwide net zero emissions by 2050 and the 4-times larger IPCC climate sensitivity, the averted warming would be 0.28 C (0.50 F).


title: Limited Out-of-Context Knowledge Reasoning in Large Language Models

abstract: Large Language Models (LLMs) have demonstrated strong capabilities as knowledge bases and significant in-context reasoning capabilities. However, previous work challenges their out-of-context reasoning ability, i.e., the ability to infer information from their training data, instead of from the context or prompt. This paper focuses on a significant facet of out-of-context reasoning: Out-of-Context Knowledge Reasoning (OCKR), which is to combine multiple knowledge to infer new knowledge. We designed a synthetic dataset with seven representative OCKR tasks to systematically assess the OCKR capabilities of LLMs. Using this dataset, we evaluated the LLaMA2-13B-chat model and discovered that its proficiency in this aspect is limited, regardless of whether the knowledge is trained in a separate or adjacent training settings. Moreover, training the model to reason with complete reasoning data did not result in significant improvement. Training the model to perform explicit knowledge retrieval helps in only one of the tasks, indicating that the model's limited OCKR capabilities are due to difficulties in retrieving relevant knowledge. Furthermore, we treat cross-lingual knowledge transfer as a distinct form of OCKR, and evaluate this ability. Our results show that the evaluated model also exhibits limited ability in transferring knowledge across languages. The dataset used in this study is available at https://github.com/NJUNLP/ID-OCKR.


title: Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8B

abstract: This paper introduces the MCT Self-Refine (MCTSr) algorithm, an innovative integration of Large Language Models (LLMs) with Monte Carlo Tree Search (MCTS), designed to enhance performance in complex mathematical reasoning tasks. Addressing the challenges of accuracy and reliability in LLMs, particularly in strategic and mathematical reasoning, MCTSr leverages systematic exploration and heuristic self-refine mechanisms to improve decision-making frameworks within LLMs. The algorithm constructs a Monte Carlo search tree through iterative processes of Selection, self-refine, self-evaluation, and Backpropagation, utilizing an improved Upper Confidence Bound (UCB) formula to optimize the exploration-exploitation balance. Extensive experiments demonstrate MCTSr's efficacy in solving Olympiad-level mathematical problems, significantly improving success rates across multiple datasets, including GSM8K, GSM Hard, MATH, and Olympiad-level benchmarks, including Math Odyssey, AIME, and OlympiadBench. The study advances the application of LLMs in complex reasoning tasks and sets a foundation for future AI integration, enhancing decision-making accuracy and reliability in LLM-driven applications.


title: Holographic reconstruction of black hole spacetime: machine learning and entanglement entropy

abstract: We investigate the bulk reconstruction of AdS black hole spacetime emergent from quantum entanglement within a machine learning framework. Utilizing neural ordinary differential equations alongside Monte-Carlo integration, we develop a method tailored for continuous training functions to extract the general isotropic bulk metric from entanglement entropy data. To validate our approach, we first apply our machine learning algorithm to holographic entanglement entropy data derived from the Gubser-Rocha and superconductor models, which serve as representative models of strongly coupled matters in holography. Our algorithm successfully extracts the corresponding bulk metrics from these data. Additionally, we extend our methodology to many-body systems by employing entanglement entropy data from a fermionic tight-binding chain at half filling, exemplifying critical one-dimensional systems, and derive the associated bulk metric. We find that the metrics for a tight-binding chain and the Gubser-Rocha model are similar. We speculate this similarity is due to the metallic property of these models.


title: Impact of the nuclear equation of state on the formation of twin stars

abstract: Twin stars-two stable neutron stars (NSs) with the same mass but different radii have long been proposed to appear as a consequence of a possible first-order phase transition in NS matter. Within a meta-model for the EOS of hybrid stars, we revisit the viability of twin stars and its dependence on numerous parameters characterizing the EOS of nuclear matter, quark matter, and the phase transition between them. While essentially no experimental constraint exists for the last two, parameters characterizing the EOS of neutron-rich nucleonic matter have been constrained within various ranges by terrestrial experiments and astrophysical observations. Within these ranges, the impact of nuclear EOS on the formation of twin stars is studied. It is found that the symmetry energy of neutron-rich nucleonic matter notably influences the formation of twin stars, particularly through its slope $L$ and curvature $K_{\rm sym}$. Conversely, the EOS of symmetric nuclear matter shows minimal influence on the formation of twin stars, partially owing to its relatively well-constrained parameters.


title: Stable SAP-like collective charging of ultracold atoms quantum batteries

abstract: We propose a novel quantum battery realized with a few interacting particles in a three-well system with different on-site energies, which could be realized with ultracold atom platforms. We prepare the initial state in the lowest energy well and charge the battery using a Spatial Adiabatic Passage (SAP)-based protocol, enabling the population of a higher energy well. We examine the charging under varying interaction strengths and reveal that the consideration of collective charging results in an intriguing oscillatory behavior of the final charge for finite interactions, through diabatic evolution. Our findings open a new avenue for building stable and controllable quantum batteries.


title: Visual Representation Learning with Stochastic Frame Prediction

abstract: Self-supervised learning of image representations by predicting future frames is a promising direction but still remains a challenge. This is because of the under-determined nature of frame prediction; multiple potential futures can arise from a single current frame. To tackle this challenge, in this paper, we revisit the idea of stochastic video generation that learns to capture uncertainty in frame prediction and explore its effectiveness for representation learning. Specifically, we design a framework that trains a stochastic frame prediction model to learn temporal information between frames. Moreover, to learn dense information within each frame, we introduce an auxiliary masked image modeling objective along with a shared decoder architecture. We find this architecture allows for combining both objectives in a synergistic and compute-efficient manner. We demonstrate the effectiveness of our framework on a variety of tasks from video label propagation and vision-based robot learning domains, such as video segmentation, pose tracking, vision-based robotic locomotion, and manipulation tasks. Code is available on the project webpage: https://sites.google.com/view/2024rsp.


title: Redefining Automotive Radar Imaging: A Domain-Informed 1D Deep Learning Approach for High-Resolution and Efficient Performance

abstract: Millimeter-wave (mmWave) radars are indispensable for perception tasks of autonomous vehicles, thanks to their resilience in challenging weather conditions. Yet, their deployment is often limited by insufficient spatial resolution for precise semantic scene interpretation. Classical super-resolution techniques adapted from optical imaging inadequately address the distinct characteristics of radar signal data. In response, our study redefines radar imaging super-resolution as a one-dimensional (1D) signal super-resolution spectra estimation problem by harnessing the radar signal processing domain knowledge, introducing innovative data normalization and a domain-informed signal-to-noise ratio (SNR)-guided loss function. Our tailored deep learning network for automotive radar imaging exhibits remarkable scalability, parameter efficiency and fast inference speed, alongside enhanced performance in terms of radar imaging quality and resolution. Extensive testing confirms that our SR-SPECNet sets a new benchmark in producing high-resolution radar range-azimuth images, outperforming existing methods across varied antenna configurations and dataset sizes. Source code and new radar dataset will be made publicly available online.


title: Guiding LLM Temporal Logic Generation with Explicit Separation of Data and Control

abstract: Temporal logics are powerful tools that are widely used for the synthesis and verification of reactive systems. The recent progress on Large Language Models (LLMs) has the potential to make the process of writing such specifications more accessible. However, writing specifications in temporal logics remains challenging for all but the most expert users. A key question in using LLMs for temporal logic specification engineering is to understand what kind of guidance is most helpful to the LLM and the users to easily produce specifications. Looking specifically at the problem of reactive program synthesis, we explore the impact of providing an LLM with guidance on the separation of control and data--making explicit for the LLM what functionality is relevant for the specification, and treating the remaining functionality as an implementation detail for a series of pre-defined functions and predicates. We present a benchmark set and find that this separation of concerns improves specification generation. Our benchmark provides a test set against which to verify future work in LLM generation of temporal logic specifications.


title: The Tannaka group $E_6$ only arises from cubic threefolds

abstract: We show that under mild assumptions, the Fano surfaces of lines on smooth cubic threefolds are the only smooth subvarieties of abelian varieties whose Tannaka group for the convolution of perverse sheaves is an exceptional simple group. This in particular leads to a considerable strengthening of our previous work on the Shafarevich conjecture. A key idea is to control the Hodge decomposition on cohomology by a cocharacter of the Tannaka group of Hodge modules, and to play this off against an improvement of the Hodge number estimates for irregular varieties by Lazarsfeld-Popa and Lombardi.


title: A Survey on Recent Random Walk-based Methods for Embedding Knowledge Graphs

abstract: Machine learning, deep learning, and NLP methods on knowledge graphs are present in different fields and have important roles in various domains from self-driving cars to friend recommendations on social media platforms. However, to apply these methods to knowledge graphs, the data usually needs to be in an acceptable size and format. In fact, knowledge graphs normally have high dimensions and therefore we need to transform them to a low-dimensional vector space. An embedding is a low-dimensional space into which you can translate high dimensional vectors in a way that intrinsic features of the input data are preserved. In this review, we first explain knowledge graphs and their embedding and then review some of the random walk-based embedding methods that have been developed recently.


title: Optimal Marital Strategies: How Couples Develop Successful Interaction Styles

abstract: The study of marriage dynamics and of strategies to reduce the likelihood of divorce has been an important research area for many years. Gottman's research on successful marriages revealed three matched interaction styles: conflict-avoiding, validating, and volatile. There has, however, been little progress in explaining how couples develop these styles of interaction and why failure to do so leads to failed marriages. In this paper, we show that these interaction styles arise as solutions to an optimal control problem where the couples jointly maximize a common goal. The validating style arises when the benefit from achieving joint happiness is balanced by the emotional cost of adopting a particular style. The ubiquitous conflict-avoider style arises naturally when the couple does not care about the cost. The volatile style is not an optimal solution, but volatile marriages may still be successful for couples with highly positive natural dispositions. The problem of the spouses having different goals in marriage is relevant to marriage repair, and this problem will be studied in the next paper using differential game theory.


title: Enhancing Tabular Data Optimization with a Flexible Graph-based Reinforced Exploration Strategy

abstract: Tabular data optimization methods aim to automatically find an optimal feature transformation process that generates high-value features and improves the performance of downstream machine learning tasks. Current frameworks for automated feature transformation rely on iterative sequence generation tasks, optimizing decision strategies through performance feedback from downstream tasks. However, these approaches fail to effectively utilize historical decision-making experiences and overlook potential relationships among generated features, thus limiting the depth of knowledge extraction. Moreover, the granularity of the decision-making process lacks dynamic backtracking capabilities for individual features, leading to insufficient adaptability when encountering inefficient pathways, adversely affecting overall robustness and exploration efficiency. To address the limitations observed in current automatic feature engineering frameworks, we introduce a novel method that utilizes a feature-state transformation graph to effectively preserve the entire feature transformation journey, where each node represents a specific transformation state. During exploration, three cascading agents iteratively select nodes and idea mathematical operations to generate new transformation states. This strategy leverages the inherent properties of the graph structure, allowing for the preservation and reuse of valuable transformations. It also enables backtracking capabilities through graph pruning techniques, which can rectify inefficient transformation paths. To validate the efficacy and flexibility of our approach, we conducted comprehensive experiments and detailed case studies, demonstrating superior performance in diverse scenarios.


title: Persistent currents in mesoscopic spin-orbit coupled rings due to an applied Zeeman field

abstract: Persistent currents (PCs) in mesoscopic rings have been a subject of intense investigation since their proposal by B\"uttiker, Landauer, and Imry in 1983. In this paper, we explore the behavior of PC in spin-orbit coupled rings under the influence of a Zeeman field, contrasting it with traditional PC observed in rings threaded by magnetic flux. Our study reveals that the emergence of PC in our setup crucially depends on nonzero values of spin-orbit coupling and the Zeeman field. Through theoretical analysis and numerical calculations, we uncover several intriguing phenomena. Specifically, in ballistic rings, we observe an inverse proportionality between PC and system size, with PC being zero at half filling for even numbers of sites. Additionally, the introduction of on-site disorder leads to the suppression of PC, with exponential decay observed for large disorder strengths and quadratic decay for smaller disorder strengths. Notably, disorder can enhance PC in individual samples, albeit with a configuration-averaged PC of zero. Furthermore, we find that the standard deviation of PC increases with disorder strength, reaching a maximum before decreasing to zero at high disorder strengths. Our findings shed light on the intricate interplay between spin-orbit coupling, Zeeman fields, and disorder in mesoscopic quantum systems, offering new avenues for theoretical exploration and experimental verification.


title: Entropy, slicing problem and functional Mahler's conjecture

abstract: In a recent work, Bo'az Klartag showed that, given a convex body with minimal volume product, its isotropic constant is related to its volume product. As a consequence, he obtained that a strong version of the slicing conjecture implies Mahler's conjecture. In this work, we extend these geometrical results to the realm of log-concave functions. In this regard, the functional analogues of the projective perturbations of the body are the log-Laplace perturbations of the function. The differentiation along these transformations is simplified thanks to the known properties of the log-Laplace transform. Moreover, we show that achieving such an analogous result requires the consideration of the suitable version of the isotropic constant, notably the one incorporating the entropy. Finally, an investigation into the equivalences between the functional and geometrical strong forms of the slicing conjecture is provided.


title: Private Geometric Median

abstract: In this paper, we study differentially private (DP) algorithms for computing the geometric median (GM) of a dataset: Given $n$ points, $x_1,\dots,x_n$ in $\mathbb{R}^d$, the goal is to find a point $\theta$ that minimizes the sum of the Euclidean distances to these points, i.e., $\sum_{i=1}^{n} \|\theta - x_i\|_2$. Off-the-shelf methods, such as DP-GD, require strong a priori knowledge locating the data within a ball of radius $R$, and the excess risk of the algorithm depends linearly on $R$. In this paper, we ask: can we design an efficient and private algorithm with an excess error guarantee that scales with the (unknown) radius containing the majority of the datapoints? Our main contribution is a pair of polynomial-time DP algorithms for the task of private GM with an excess error guarantee that scales with the effective diameter of the datapoints. Additionally, we propose an inefficient algorithm based on the inverse smooth sensitivity mechanism, which satisfies the more restrictive notion of pure DP. We complement our results with a lower bound and demonstrate the optimality of our polynomial-time algorithms in terms of sample complexity.


title: ADDOPT: An Additive Manufacturing Optimal Control Framework Demonstrated in Minimizing Layer-Level Thermal Variance in Electron Beam Powder Bed Fusion

abstract: Additive manufacturing (AM) techniques hold promise but face significant challenges in process planning and optimization. The large temporal and spatial variations in temperature that can occur in layer-wise AM lead to thermal excursions, resulting in property variations and defects. These variations cannot always be fully mitigated by simple static parameter search. To address this challenge, we propose a general approach based on modeling AM processes on the part-scale in state-space and framing AM process planning as a numerical optimal control problem. We demonstrate this approach on the problem of minimizing thermal variation in a given layer in the electron beam powder bed fusion (EB-PBF) AM process, and are able to compute globally optimal dynamic process plans. These optimized process plans are then evaluated in simulation, achieving an 87% and 86% reduction in cumulative variance compared to random spot melting and a uniform power field respectively, and are further validated in experiment. This one-shot feedforward planning approach expands the capabilities of AM technology by minimizing the need for experimentation and iteration to achieve process optimization. Further, this work opens the possibility for the application of optimal control theory to part-scale optimization and control in AM.


title: Accelerating Ill-conditioned Hankel Matrix Recovery via Structured Newton-like Descent

abstract: This paper studies the robust Hankel recovery problem, which simultaneously removes the sparse outliers and fulfills missing entries from the partial observation. We propose a novel non-convex algorithm, coined Hankel Structured Newton-Like Descent (HSNLD), to tackle the robust Hankel recovery problem. HSNLD is highly efficient with linear convergence, and its convergence rate is independent of the condition number of the underlying Hankel matrix. The recovery guarantee has been established under some mild conditions. Numerical experiments on both synthetic and real datasets show the superior performance of HSNLD against state-of-the-art algorithms.

categories: stat.ML cs.IT cs.LG eess.SP math.IT math.OC


title: Clever Hans Effect Found in Automatic Detection of Alzheimer's Disease through Speech

abstract: We uncover an underlying bias present in the audio recordings produced from the picture description task of the Pitt corpus, the largest publicly accessible database for Alzheimer's Disease (AD) detection research. Even by solely utilizing the silent segments of these audio recordings, we achieve nearly 100% accuracy in AD detection. However, employing the same methods to other datasets and preprocessed Pitt recordings results in typical levels (approximately 80%) of AD detection accuracy. These results demonstrate a Clever Hans effect in AD detection on the Pitt corpus. Our findings emphasize the crucial importance of maintaining vigilance regarding inherent biases in datasets utilized for training deep learning models, and highlight the necessity for a better understanding of the models' performance.


title: VersiCode: Towards Version-controllable Code Generation

abstract: Significant research has focused on improving the performance of large language model on code-related tasks due to their practical importance. Although performance is typically evaluated using public benchmark datasets, the existing datasets do not account for the concept of \emph{version}, which is crucial in professional software development. In this paper, we introduce VersiCode, the first comprehensive dataset designed to assess the ability of large language models to generate verifiable code for specific library versions. VersiCode encompasses 300 libraries across more than 2,000 versions spanning 9 years. We design two dedicated evaluation tasks: version-specific code completion (VSCC) and version-aware code editing (VACE). Comprehensive experiments are conducted to benchmark the performance of LLMs, revealing the challenging nature of these tasks and VersiCode, that even state-of-the-art LLMs struggle to generate version-correct code. This dataset, together with the proposed tasks, sheds light on LLMs' capabilities and limitations in handling version-specific code generation, and opens up an important new area of research for further investigation. The resources can be found at https://github.com/wutong8023/VersiCode.


title: Helium-4 gravitational form factors: exchange currents

abstract: We evaluate the leading exchange corrections to the Helium-4 gravitational form factors (GFFs) upto momenta of the order of the nucleon mass. We use both the K-harmonic method with simple pair nucleon potential, and a Jastrow trial function using the Argonne $v_{14}$ potential, to evaluate the Helium-4 GFFs. The exchange current contributions include the pair interaction, plus the seagull and the pion exchange interactions, modulo the recoil corrections. To estimate the off-shellness of the pion nucleon coupling in this momenta range, we discuss the results using either the pseudo-scalar (PS) or pseudo-vector (PV) pion-nucleon couplings. When the PV coupling is used, the pair diagram contribution is higher order in the non relativistic expansion. The results for the Helium-4 A-GFF are comparable to those given by the impulse approximation, especially for the PS coupling using both the K-Harmonic method and variational method. The exchange current contributions with the PS coupling for the charge form factor of Helium-4, yield better agreement with the existing data over a broad range of momenta, especially when the Argonne $v_{14}$ potential including the D-wave admixture is used.


title: Holistic Memory Diversification for Incremental Learning in Growing Graphs

abstract: This paper addresses the challenge of incremental learning in growing graphs with increasingly complex tasks. The goal is to continually train a graph model to handle new tasks while retaining its inference ability on previous tasks. Existing methods usually neglect the importance of memory diversity, limiting in effectively selecting high-quality memory from previous tasks and remembering broad previous knowledge within the scarce memory on graphs. To address that, we introduce a novel holistic Diversified Memory Selection and Generation (DMSG) framework for incremental learning in graphs, which first introduces a buffer selection strategy that considers both intra-class and inter-class diversities, employing an efficient greedy algorithm for sampling representative training nodes from graphs into memory buffers after learning each new task. Then, to adequately rememorize the knowledge preserved in the memory buffer when learning new tasks, we propose a diversified memory generation replay method. This method first utilizes a variational layer to generate the distribution of buffer node embeddings and sample synthesized ones for replaying. Furthermore, an adversarial variational embedding learning method and a reconstruction-based decoder are proposed to maintain the integrity and consolidate the generalization of the synthesized node embeddings, respectively. Finally, we evaluate our model on node classification tasks involving increasing class numbers. Extensive experimental results on publicly accessible datasets demonstrate the superiority of DMSG over state-of-the-art methods.


title: Adic curves: stable reduction, skeletons and metric structure

abstract: We study the structure of adic curves over an affinoid field of arbitrary rank. In particular, quite analogously to Berkovich geometry we classify points on curves, prove a semistable reduction theorem in the version of Ducros' triangulations, define associated curve skeletons and prove that they are deformational retracts in a suitable sense. An important new technical tool is an appropriate compactification of ordered groups that we call the ranger compactification. Intervals of rangers are then used to define metric structures and construct deformational retractions.


title: The geometry of polynomial representations in positive characteristic

abstract: A $\mathbf{GL}$-variety is a (typically infinite dimensional) variety modeled on the polynomial representation theory of the general linear group. In previous work, we studied these varieties in characteristic 0. In this paper, we obtain results in positive characteristic: for example, we prove a version of Chevalley's theorem on constructible sets. We give an application of our theory to strength of polynomials.


title: Heat operators and isometry groups of Cuntz-Krieger algebras

abstract: This paper introduces heat semigroups of topological Markov chains and Cuntz-Krieger algebras by means of spectral noncommutative geometry. Using recent advances on the logarithmic Dirichlet Laplacian on Ahlfors regular metric-measure spaces, we construct spectral triples on Cuntz-Krieger algebras from singular integral operators. These spectral triples exhaust K-homology and for Cuntz algebras we can compute their heat operators explicitly as Riesz potential operators. We also describe their isometry group in terms of the automorphism group of the underlying directed graph and prove that the Voiculescu noncommutative topological entropy vanishes on isometries.


title: Average-exact mixed anomalies and compatible phases

abstract: The quantum anomaly of a global symmetry is known to strongly constrain the allowed low-energy physics in a clean and isolated quantum system. However, the effect of quantum anomalies in disordered systems is much less understood, especially when the global symmetry is only preserved on average by the disorder. In this work, we focus on disordered systems with both average and exact symmetries $A\times K$, where the exact symmetry $K$ is respected in every disorder configuration, and the average $A$ is only preserved on average by the disorder ensemble. When there is a mixed quantum anomaly between the average and exact symmetries, we argue that the mixed state representing the ensemble of disordered ground states cannot be featureless. While disordered mixed states smoothly connected to the anomaly-compatible phases in clean limit are certainly allowed, we also found disordered phases that have no clean-limit counterparts, including the glassy states with strong-to-weak symmetry breaking, and average topological orders for certain anomalies. We construct solvable lattice models to demonstrate each of these possibilities. We also provide a field-theoretic argument to provide a criterion for whether a given average-exact mixed anomaly admits a compatible average topological order.


title: Enhanced Gene Selection in Single-Cell Genomics: Pre-Filtering Synergy and Reinforced Optimization

abstract: Recent advancements in single-cell genomics necessitate precision in gene panel selection to interpret complex biological data effectively. Those methods aim to streamline the analysis of scRNA-seq data by focusing on the most informative genes that contribute significantly to the specific analysis task. Traditional selection methods, which often rely on expert domain knowledge, embedded machine learning models, or heuristic-based iterative optimization, are prone to biases and inefficiencies that may obscure critical genomic signals. Recognizing the limitations of traditional methods, we aim to transcend these constraints with a refined strategy. In this study, we introduce an iterative gene panel selection strategy that is applicable to clustering tasks in single-cell genomics. Our method uniquely integrates results from other gene selection algorithms, providing valuable preliminary boundaries or prior knowledge as initial guides in the search space to enhance the efficiency of our framework. Furthermore, we incorporate the stochastic nature of the exploration process in reinforcement learning (RL) and its capability for continuous optimization through reward-based feedback. This combination mitigates the biases inherent in the initial boundaries and harnesses RL's adaptability to refine and target gene panel selection dynamically. To illustrate the effectiveness of our method, we conducted detailed comparative experiments, case studies, and visualization analysis.


title: Single and merger soliton dynamics in scalar field dark matter with and without self-interactions

abstract: (abridged)Scalar field dark matter (SFDM) made of bosons has become a popular alternative to the CDM paradigm, especially for its potential to cure the so-called "small-scale problems" of CDM. Cosmological simulations have determined that SFDM halos exhibit a core-envelope structure, but they are computationally expensive. Halo cores have been found to be well approximated by "solitons". The study of single soliton and multiple soliton merger dynamics constitutes a more feasible approach to investigate in detail the genuine quantum dynamics of SFDM and its interplay with self-gravity for a multitude of free boson parameters. In this paper, we present dedicated simulations of single solitons and binary soliton mergers, for models without and with a 2-boson, repulsive, weak to intermediate self-interaction (SI), as well as multiple soliton mergers without SI. We adapt the open-source code Pyultralight to simulate solitons with SI. We derive numerical scaling relations between the central density and mass of solitons for several values of SI and find deviations from the monotonic relations known from fuzzy dark matter (no SI), or the strongly repulsive Thomas-Fermi regime. Solitons with SI exemplify larger cores and lower central densities, compared to solitons without SI. Using our simulations, we extract numerical density profiles for solitons and post-merger objects, and fit them to analytic functions of previous literature. We find a mild preference for Gaussian cores for objects with SI, while the envelopes of post-mergers can be fit to NFW profiles albeit with some caution as we discuss. Similar to previous work, we find global, persistent oscillations for solitons as well as post-mergers, confirming that self-gravitating SFDM has very long relaxation times, although objects with SI exhibit oscillations of comparatively smaller amplitude.


title: Graph Reasoning for Explainable Cold Start Recommendation

abstract: The cold start problem, where new users or items have no interaction history, remains a critical challenge in recommender systems (RS). A common solution involves using Knowledge Graphs (KG) to train entity embeddings or Graph Neural Networks (GNNs). Since KGs incorporate auxiliary data and not just user/item interactions, these methods can make relevant recommendations for cold users or items. Graph Reasoning (GR) methods, however, find paths from users to items to recommend using relations in the KG and, in the context of RS, have been used for interpretability. In this study, we propose GRECS: a framework for adapting GR to cold start recommendations. By utilizing explicit paths starting for users rather than relying only on entity embeddings, GRECS can find items corresponding to users' preferences by navigating the graph, even when limited information about users is available. Our experiments show that GRECS mitigates the cold start problem and outperforms competitive baselines across 5 standard datasets while being explainable. This study highlights the potential of GR for developing explainable recommender systems better suited for managing cold users and items.


title: A Comprehensive Investigation on Speaker Augmentation for Speaker Recognition

abstract: Data augmentation (DA) has played a pivotal role in the success of deep speaker recognition. Current DA techniques primarily focus on speaker-preserving augmentation, which does not change the speaker trait of the speech and does not create new speakers. Recent research has shed light on the potential of speaker augmentation, which generates new speakers to enrich the training dataset. In this study, we delve into two speaker augmentation approaches: speed perturbation (SP) and vocal tract length perturbation (VTLP). Despite the empirical utilization of both methods, a comprehensive investigation into their efficacy is lacking. Our study, conducted using two public datasets, VoxCeleb and CN-Celeb, revealed that both SP and VTLP are proficient at generating new speakers, leading to significant performance improvements in speaker recognition. Furthermore, they exhibit distinct properties in sensitivity to perturbation factors and data complexity, hinting at the potential benefits of their fusion. Our research underscores the substantial potential of speaker augmentation, highlighting the importance of in-depth exploration and analysis.


title: Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation

abstract: The multi-codebook speech codec enables the application of large language models (LLM) in TTS but bottlenecks efficiency and robustness due to multi-sequence prediction. To avoid this obstacle, we propose Single-Codec, a single-codebook single-sequence codec, which employs a disentangled VQ-VAE to decouple speech into a time-invariant embedding and a phonetically-rich discrete sequence. Furthermore, the encoder is enhanced with 1) contextual modeling with a BLSTM module to exploit the temporal information, 2) a hybrid sampling module to alleviate distortion from upsampling and downsampling, and 3) a resampling module to encourage discrete units to carry more phonetic information. Compared with multi-codebook codecs, e.g., EnCodec and TiCodec, Single-Codec demonstrates higher reconstruction quality with a lower bandwidth of only 304bps. The effectiveness of Single-Code is further validated by LLM-TTS experiments, showing improved naturalness and intelligibility.


title: Beyond ELBOs: A Large-Scale Evaluation of Variational Methods for Sampling

abstract: Monte Carlo methods, Variational Inference, and their combinations play a pivotal role in sampling from intractable probability distributions. However, current studies lack a unified evaluation framework, relying on disparate performance measures and limited method comparisons across diverse tasks, complicating the assessment of progress and hindering the decision-making of practitioners. In response to these challenges, our work introduces a benchmark that evaluates sampling methods using a standardized task suite and a broad range of performance criteria. Moreover, we study existing metrics for quantifying mode collapse and introduce novel metrics for this purpose. Our findings provide insights into strengths and weaknesses of existing sampling methods, serving as a valuable reference for future developments. The code is publicly available here.


title: MINERS: Multilingual Language Models as Semantic Retrievers

abstract: Words have been represented in a high-dimensional vector space that encodes their semantic similarities, enabling downstream applications such as retrieving synonyms, antonyms, and relevant contexts. However, despite recent advances in multilingual language models (LMs), the effectiveness of these models' representations in semantic retrieval contexts has not been comprehensively explored. To fill this gap, this paper introduces the MINERS, a benchmark designed to evaluate the ability of multilingual LMs in semantic retrieval tasks, including bitext mining and classification via retrieval-augmented contexts. We create a comprehensive framework to assess the robustness of LMs in retrieving samples across over 200 diverse languages, including extremely low-resource languages in challenging cross-lingual and code-switching settings. Our results demonstrate that by solely retrieving semantically similar embeddings yields performance competitive with state-of-the-art approaches, without requiring any fine-tuning.


title: On 2nd-order fully-nonlinear equations with links to 3rd-order fully-nonlinear equations

abstract: We derive the general conditions for fully-nonlinear symmetry-integrable second-order evolution equations and their first-order recursion operators. We then apply the established Propositions to find links between a class of fully-nonlinear third-order symmetry-integrable evolution equations and fully-nonlinear second-order symmetry-integrable evolution equations.


title: DERM12345: A Large, Multisource Dermatoscopic Skin Lesion Dataset with 38 Subclasses

abstract: Skin lesion datasets provide essential information for understanding various skin conditions and developing effective diagnostic tools. They aid the artificial intelligence-based early detection of skin cancer, facilitate treatment planning, and contribute to medical education and research. Published large datasets have partially coverage the subclassifications of the skin lesions. This limitation highlights the need for more expansive and varied datasets to reduce false predictions and help improve the failure analysis for skin lesions. This study presents a diverse dataset comprising 12,345 dermatoscopic images with 38 subclasses of skin lesions collected in Turkiye which comprises different skin types in the transition zone between Europe and Asia. Each subgroup contains high-resolution photos and expert annotations, providing a strong and reliable basis for future research. The detailed analysis of each subgroup provided in this study facilitates targeted research endeavors and enhances the depth of understanding regarding the skin lesions. This dataset distinguishes itself through a diverse structure with 5 super classes, 15 main classes, 38 subclasses and its 12,345 high-resolution dermatoscopic images.


title: Support for fragile porous dust in a gravitationally self-regulated disk around IM Lup

abstract: Protoplanetary disks, the birthplace of planets, are expected to be gravitationally unstable in their early phase of evolution. IM Lup, a well-known T-Tauri star, is surrounded by a protoplanetary disk with spiral arms likely caused by gravitational instability. The IM Lup disk has been observed using various methods, but developing a unified explanatory model is challenging. Here we present a physical model of the IM Lup disk that offers a comprehensive explanation for diverse observations spanning from near-infrared to millimeter wavelengths. Our findings underscore the importance of dust fragility in retaining the observed millimeter emission and reveal the preference for moderately porous dust to explain observed millimeter polarization. We also find that the inner disk region is likely heated by gas accretion, providing a natural explanation for bright millimeter emission within 20 au. The actively heated inner region in the model casts a 100-au-scale shadow, aligning seamlessly with the near-infrared scattered light observation. The presence of accretion heating also supports the fragile dust scenario in which accretion efficiently heat the disk midplane. Due to the fragility of dust, it is unlikely that a potential embedded planet at 100 au formed via pebble accretion in a smooth disk, pointing to local dust enhancement boosting pebble accretion or alternative pathways such as outward migration or gravitational fragmentation.


title: GemNet: Menu-Based, Strategy-Proof Multi-Bidder Auctions Through Deep Learning

abstract: Differentiable economics uses deep learning for automated mechanism design. Despite strong progress, it has remained an open problem to learn multi-bidder, general, and fully strategy-proof (SP) auctions. We introduce GEneral Menu-based NETwork (GemNet), which significantly extends the menu-based approach of RochetNet [D\"utting et al., 2023] to the multi-bidder setting. The challenge in achieving SP is to learn bidder-independent menus that are feasible, so that the optimal menu choices for each bidder do not over-allocate items when taken together (we call this menu compatibility). GemNet penalizes the failure of menu compatibility during training, and transforms learned menus after training through price changes, by considering a set of discretized bidder values and reasoning about Lipschitz smoothness to guarantee menu compatibility on the entire value space. This approach is general, leaving undisturbed trained menus that already satisfy menu compatibility and reducing to RochetNet for a single bidder. Mixed-integer linear programs are used for menu transforms and through a number of optimizations, including adaptive grids and methods to skip menu elements, we scale to large auction design problems. GemNet learns auctions with better revenue than affine maximization methods, achieves exact SP whereas previous general multi-bidder methods are approximately SP, and offers greatly enhanced interpretability.


title: Making 'syscall' a Privilege not a Right

abstract: Browsers, Library OSes, and system emulators rely on sandboxes and in-process isolation to emulate system resources and securely isolate untrusted components. All access to system resources like system calls (syscall) need to be securely mediated by the application. Otherwise system calls may allow untrusted components to evade the emulator or sandbox monitor, and hence, escape and attack the entire application or system. Existing approaches, such as ptrace, require additional context switches between kernel and userspace, which introduce high performance overhead. And, seccomp-bpf supports only limited policies, which restricts its functionality, or it still requires ptrace to provide assistance. In this paper, we present nexpoline, a secure syscall interception mechanism combining Memory Protection Keys (MPK) and Seccomp or Syscall User Dispatch (SUD). Our approach transforms an application's syscall instruction into a privilege reserved for the trusted monitor within the address space, allowing flexible user defined policy. To execute a syscall, the application must switch contexts via nexpoline. It offers better efficiency than secure interception techniques like ptrace, as nexpoline can intercept syscalls through binary rewriting securely. Consequently, nexpoline ensures the safety, flexibility and efficiency for syscall interception. Notably, it operates without kernel modifications, making it viable on current Linux systems without needing root privileges. Our benchmarks demonstrate improved performance over ptrace in interception overhead while achieving the same security guarantees. When compared to similarly performing firejail, nexpoline supports more complex policies and enables the possibility to emulate system resources.


title: Learning Domain-Invariant Features for Out-of-Context News Detection

abstract: Multimodal out-of-context news is a common type of misinformation on online media platforms. This involves posting a caption, alongside an invalid out-of-context news image. Reflecting its importance, researchers have developed models to detect such misinformation. However, a common limitation of these models is that they only consider the scenario where pre-labeled data is available for each domain, failing to address the out-of-context news detection on unlabeled domains (e.g., unverified news on new topics or agencies). In this work, we therefore focus on domain adaptive out-of-context news detection. In order to effectively adapt the detection model to unlabeled news topics or agencies, we propose ConDA-TTA (Contrastive Domain Adaptation with Test-Time Adaptation) which applies contrastive learning and maximum mean discrepancy (MMD) to learn the domain-invariant feature. In addition, it leverages target domain statistics during test-time to further assist domain adaptation. Experimental results show that our approach outperforms baselines in 5 out of 7 domain adaptation settings on two public datasets, by as much as 2.93% in F1 and 2.08% in accuracy.


title: Active Scout: Multi-Target Tracking Using Neural Radiance Fields in Dense Urban Environments

abstract: We study pursuit-evasion games in highly occluded urban environments, e.g. tall buildings in a city, where a scout (quadrotor) tracks multiple dynamic targets on the ground. We show that we can build a neural radiance field (NeRF) representation of the city -- online -- using RGB and depth images from different vantage points. This representation is used to calculate the information gain to both explore unknown parts of the city and track the targets -- thereby giving a completely first-principles approach to actively tracking dynamic targets. We demonstrate, using a custom-built simulator using Open Street Maps data of Philadelphia and New York City, that we can explore and locate 20 stationary targets within 300 steps. This is slower than a greedy baseline which which does not use active perception. But for dynamic targets that actively hide behind occlusions, we show that our approach maintains, at worst, a tracking error of 200m; the greedy baseline can have a tracking error as large as 600m. We observe a number of interesting properties in the scout's policies, e.g., it switches its attention to track a different target periodically, as the quality of the NeRF representation improves over time, the scout also becomes better in terms of target tracking.


title: Matryoshka Representation Learning for Recommendation

abstract: Representation learning is essential for deep-neural-network-based recommender systems to capture user preferences and item features within fixed-dimensional user and item vectors. Unlike existing representation learning methods that either treat each user preference and item feature uniformly or categorize them into discrete clusters, we argue that in the real world, user preferences and item features are naturally expressed and organized in a hierarchical manner, leading to a new direction for representation learning. In this paper, we introduce a novel matryoshka representation learning method for recommendation (MRL4Rec), by which we restructure user and item vectors into matryoshka representations with incrementally dimensional and overlapping vector spaces to explicitly represent user preferences and item features at different hierarchical levels. We theoretically establish that constructing training triplets specific to each level is pivotal in guaranteeing accurate matryoshka representation learning. Subsequently, we propose the matryoshka negative sampling mechanism to construct training triplets, which further ensures the effectiveness of the matryoshka representation learning in capturing hierarchical user preferences and item features. The experiments demonstrate that MRL4Rec can consistently and substantially outperform a number of state-of-the-art competitors on several real-life datasets. Our code is publicly available at https://github.com/Riwei-HEU/MRL.


title: Shortcuts to adiabaticity designed via time-rescaling follow the same transitionless route

abstract: Time-rescaling (TR) has been recently proposed as a method to engineer fast processes, also known as shortcuts to adiabaticity (STA), which enables the coherent control of quantum systems beyond the adiabatic regime [B. L. Bernardo, Phys. Rev. Res. 2, 013133 (2020)]. The method provides the Hamiltonians that generate the fast processes without requiring information about the instantaneous eigenstates of a reference protocol, whereas experimental implementations dismiss additional coupling fields when compared with adiabatic protocols. Here, we revisit the technique and show that the obtained fast dynamics are transitionless, similar to the ones designed via the famous counterdiabatic (CD) approach. We also show that the time evolution of the STA found via TR relates to that of the reference adiabatic protocol by a simple reparametrization of time. To illustrate our findings, we studied the problem of speeding up the stimulated Raman adiabatic passage (STIRAP) and found out that TR revealed quantum dynamics more robust to parameter variations than those provided by the CD technique. Our results shed new light on the application of TR in the control of larger quantum systems.


title: RE-algebras, quasi-determinants and the full Toda system

abstract: In 1991, Gelfand and Retakh embodied the idea of a noncommutative Dieudonne determinant in the case of RTT algebra, namely, they found a representation of the quantum determinant of RTT algebra in the form of a product of principal quasi-determinants. In this note we construct an analogue of the above statement for the RE-algebra corresponding to the Drinfeld R-matrix for the order $n=2,3$. Namely, we have found a family of quasi-determinants that are principal with respect to the antidiagonal, commuting among themselves, whose product turns out to be the quantum determinant of this algebra. This family generalizes the construction of integrals of the full Toda system due to Deift et al. for the quantum case of RE-algebras. In our opinion, this result also clarifies the role of RE-algebras as a quantum homogeneous spaces and can be used to construct effective quantum field theories with a boundary.


title: Beware of Aliases -- Signal Preservation is Crucial for Robust Image Restoration

abstract: Image restoration networks are usually comprised of an encoder and a decoder, responsible for aggregating image content from noisy, distorted data and to restore clean, undistorted images, respectively. Data aggregation as well as high-resolution image generation both usually come at the risk of involving aliases, i.e.~standard architectures put their ability to reconstruct the model input in jeopardy to reach high PSNR values on validation data. The price to be paid is low model robustness. In this work, we show that simply providing alias-free paths in state-of-the-art reconstruction transformers supports improved model robustness at low costs on the restoration performance. We do so by proposing BOA-Restormer, a transformer-based image restoration model that executes downsampling and upsampling operations partly in the frequency domain to ensure alias-free paths along the entire model while potentially preserving all relevant high-frequency information.


title: McEval: Massively Multilingual Code Evaluation

abstract: Code large language models (LLMs) have shown remarkable advances in code understanding, completion, and generation tasks. Programming benchmarks, comprised of a selection of code challenges and corresponding test cases, serve as a standard to evaluate the capability of different LLMs in such tasks. However, most existing benchmarks primarily focus on Python and are still restricted to a limited number of languages, where other languages are translated from the Python samples (e.g. MultiPL-E) degrading the data diversity. To further facilitate the research of code LLMs, we propose a massively multilingual code benchmark covering 40 programming languages (McEval) with 16K test samples, which substantially pushes the limits of code LLMs in multilingual scenarios. The benchmark contains challenging code completion, understanding, and generation evaluation tasks with finely curated massively multilingual instruction corpora McEval-Instruct. In addition, we introduce an effective multilingual coder mCoder trained on McEval-Instruct to support multilingual programming language generation. Extensive experimental results on McEval show that there is still a difficult journey between open-source models and closed-source LLMs (e.g. GPT-series models) in numerous languages. The instruction corpora, evaluation benchmark, and leaderboard are available at \url{https://mceval.github.io/}.


abstract: Exploring proper way to conduct multi-speech feature fusion for cross-corpus speech emotion recognition is crucial as different speech features could provide complementary cues reflecting human emotion status. While most previous approaches only extract a single speech feature for emotion recognition, existing fusion methods such as concatenation, parallel connection, and splicing ignore heterogeneous patterns in the interaction between features and features, resulting in performance of existing systems. In this paper, we propose a novel graph-based fusion method to explicitly model the relationships between every pair of speech features. Specifically, we propose a multi-dimensional edge features learning strategy called Graph-based multi-Feature fusion method for speech emotion recognition. It represents each speech feature as a node and learns multi-dimensional edge features to explicitly describe the relationship between each feature-feature pair in the context of emotion recognition. This way, the learned multi-dimensional edge features encode speech feature-level information from both the vertex and edge dimensions. Our Approach consists of three modules: an Audio Feature Generation(AFG)module, an Audio-Feature Multi-dimensional Edge Feature(AMEF) module and a Speech Emotion Recognition (SER) module. The proposed methodology yielded satisfactory outcomes on the SEWA dataset. Furthermore, the method demonstrated enhanced performance compared to the baseline in the AVEC 2019 Workshop and Challenge. We used data from two cultures as our training and validation sets: two cultures containing German and Hungarian on the SEWA dataset, the CCC scores for German are improved by 17.28% for arousal and 7.93% for liking. The outcomes of our methodology demonstrate a 13% improvement over alternative fusion techniques, including those employing one dimensional edge-based feature fusion approach.


title: DeformTime: Capturing Variable Dependencies with Deformable Attention for Time Series Forecasting

abstract: In multivariate time series (MTS) forecasting, existing state-of-the-art deep learning approaches tend to focus on autoregressive formulations and overlook the information within exogenous indicators. To address this limitation, we present DeformTime, a neural network architecture that attempts to capture correlated temporal patterns from the input space, and hence, improve forecasting accuracy. It deploys two core operations performed by deformable attention blocks (DABs): learning dependencies across variables from different time steps (variable DAB), and preserving temporal dependencies in data from previous time steps (temporal DAB). Input data transformation is explicitly designed to enhance learning from the deformed series of information while passing through a DAB. We conduct extensive experiments on 6 MTS data sets, using previously established benchmarks as well as challenging infectious disease modelling tasks with more exogenous variables. The results demonstrate that DeformTime improves accuracy against previous competitive methods across the vast majority of MTS forecasting tasks, reducing the mean absolute error by 10% on average. Notably, performance gains remain consistent across longer forecasting horizons.


title: Search for photons above 10$^{18}$ eV by simultaneously measuring the atmospheric depth and the muon content of air showers at the Pierre Auger Observatory

abstract: The Pierre Auger Observatory is the most sensitive instrument to detect photons with energies above $10^{17}$ eV. It measures extensive air showers generated by ultra high energy cosmic rays using a hybrid technique that exploits the combination of a fluorescence detector with a ground array of particle detectors. The signatures of a photon-induced air shower are a larger atmospheric depth of the shower maximum ($X_{max}$) and a steeper lateral distribution function, along with a lower number of muons with respect to the bulk of hadron-induced cascades. In this work, a new analysis technique in the energy interval between 1 and 30 EeV (1 EeV = $10^{18}$ eV) has been developed by combining the fluorescence detector-based measurement of $X_{max}$ with the specific features of the surface detector signal through a parameter related to the air shower muon content, derived from the universality of the air shower development. No evidence of a statistically significant signal due to photon primaries was found using data collected in about 12 years of operation. Thus, upper bounds to the integral photon flux have been set using a detailed calculation of the detector exposure, in combination with a data-driven background estimation. The derived 95% confidence level upper limits are 0.0403, 0.01113, 0.0035, 0.0023, and 0.0021 km$^{-2}$ sr$^{-1}$ yr$^{-1}$ above 1, 2, 3, 5, and 10 EeV, respectively, leading to the most stringent upper limits on the photon flux in the EeV range. Compared with past results, the upper limits were improved by about 40% for the lowest energy threshold and by a factor 3 above 3 EeV, where no candidates were found and the expected background is negligible. The presented limits can be used to probe the assumptions on chemical composition of ultra-high energy cosmic rays and allow for the constraint of the mass and lifetime phase space of super-heavy dark matter particles.


title: Textual Similarity as a Key Metric in Machine Translation Quality Estimation

abstract: Machine Translation (MT) Quality Estimation (QE) assesses translation reliability without reference texts. This study introduces "textual similarity" as a new metric for QE, using sentence transformers and cosine similarity to measure semantic closeness. Analyzing data from the MLQE-PE dataset, we found that textual similarity exhibits stronger correlations with human scores than traditional metrics (hter, model evaluation etc.). Employing GAMMs as a statistical tool, we demonstrated that textual similarity consistently outperforms other metrics across multiple language pairs in predicting human scores. We also found that "hter" actually failed to predict human scores in QE. Our findings highlight the effectiveness of textual similarity as a robust QE metric, recommending its integration with other metrics into QE frameworks and MT system training for improved accuracy and usability.


title: GPU Accelerated Implicit Kinetic Meshfree Method based on Modified LU-SGS

abstract: This report presents the GPU acceleration of implicit kinetic meshfree methods using modified LU-SGS algorithms. The meshfree scheme is based on the least squares kinetic upwind method (LSKUM). In the existing matrix-free LU-SGS approaches for kinetic meshfree methods, the products of split flux Jacobians and increments in conserved vectors are approximated by increments in the split fluxes. In our modified LU-SGS approach, the Jacobian vector products are computed exactly using algorithmic differentiation (AD). The implicit GPU solvers with exact and approximate computation of the Jacobian vector products are applied to the standard test cases for two-dimensional inviscid flows. Numerical results have shown that the GPU solvers with the exact computation of the Jacobian vector products are computationally more efficient and yield better convergence rates than the solvers with approximations to the Jacobian vector products. Benchmarks are presented to assess the performance of implicit GPU solvers compared to the explicit GPU solver and the implicit serial LSKUM solver.


title: QCD in the chiral SU(3) limit from baryon masses on Lattice QCD ensembles

abstract: The baryon masses on CLS ensembles are used to determine the LEC that characterize QCD in the flavor-SU(3) limit with vanishing up, down, and strange quark masses. Here we reevaluate some of the baryon masses on flavor-symmetric ensembles with much-improved statistical precision, in particular for the decuplet states. These additional results then lead to a more significant chiral extrapolation of the Lattice data set to its chiral SU(3) limit. Our results are based on the chiral Lagrangian with baryon octet and decuplet fields considered at the one-loop level. Finite-box and discretization effects of the Lattice data are considered systematically. While in our global fit of the data we insist on large-Nc sum rules for the LEC that enter at N3LO, all other LEC are unconstrained. In particular, we obtain values for the chiral limit of the pion decay constant and the isospin-limit of the quark-mass ratio compatible with the FLAG report.


title: Constructions of Tur\'an systems that are tight up to a multiplicative constant

abstract: For positive integers $n\ge s> r$, the Tur\'an function $T(n,s,r)$ is the smallest size of an r-graph with n vertices such that every set of s vertices contains at least one edge. Also, define the Tur\'an density $t(s,r)$ as the limit of $T(n,s,r)/ {n\choose r}$ as $n\to\infty$. The question of estimating these parameters received a lot of attention after it was first raised by Tur\'an in 1941. A trivial lower bound is $t(s,r)\ge 1/{s\choose s-r}$. In the early 1990s, de Caen conjectured that $r\cdot t(r+1,r)\to\infty$ as $r\to\infty$ and offered 500 Canadian dollars for resolving this question. We disprove this conjecture by showing more strongly that for every integer $R\ge1$ there is $\mu_R$ (in fact, $\mu_R$ can be taken to grow as $(1+o(1))\, R\ln R$) such that $t(r+R,r)\le (\mu_R+o(1))/ {r+R\choose R}$ as $r\to\infty$, that is, the trivial lower bound is tight for every $R$ up to a multiplicative constant $\mu_R$.


title: On the Robustness of Document-Level Relation Extraction Models to Entity Name Variations

abstract: Driven by the demand for cross-sentence and large-scale relation extraction, document-level relation extraction (DocRE) has attracted increasing research interest. Despite the continuous improvement in performance, we find that existing DocRE models which initially perform well may make more mistakes when merely changing the entity names in the document, hindering the generalization to novel entity names. To this end, we systematically investigate the robustness of DocRE models to entity name variations in this work. We first propose a principled pipeline to generate entity-renamed documents by replacing the original entity names with names from Wikidata. By applying the pipeline to DocRED and Re-DocRED datasets, we construct two novel benchmarks named Env-DocRED and Env-Re-DocRED for robustness evaluation. Experimental results show that both three representative DocRE models and two in-context learned large language models consistently lack sufficient robustness to entity name variations, particularly on cross-sentence relation instances and documents with more entities. Finally, we propose an entity variation robust training method which not only improves the robustness of DocRE models but also enhances their understanding and reasoning capabilities. We further verify that the basic idea of this method can be effectively transferred to in-context learning for DocRE as well.


title: Metastability in networks of nonlinear stochastic integrate-and-fire neurons

abstract: Neurons in the brain continuously process the barrage of sensory inputs they receive from the environment. A wide array of experimental work has shown that the collective activity of neural populations encodes and processes this constant bombardment of information. How these collective patterns of activity depend on single neuron properties is often unclear. Single-neuron recordings have shown that individual neural responses to inputs are nonlinear, which prevents a straightforward extrapolation from single neuron features to emergent collective states. In this work, we use a field theoretic formulation of a stochastic leaky integrate-and-fire model to study the impact of nonlinear intensity functions on macroscopic network activity. We show that the interplay between nonlinear spike emission and membrane potential resets can i) give rise to metastable transitions between active firing rate states, and ii) can enhance or suppress mean firing rates and membrane potentials in opposite directions.


title: Holographic and Gravity-Thermodynamic Approaches in Entropic Cosmology: Bayesian Assessment using late-time Data

abstract: We investigate the cosmological implications of entropy-based approaches in the context of Holographic Dark Energy (HDE) and Gravity-Thermodynamics (GT) formalisms. We utilise the extended Barrow entropy form, with the index parameter $\Delta$, representing the fractal dimension of the horizon. We also test implementing different parameter ranges for $\Delta$, which can be extended to Tsallis' interpretation within the same formal cosmology. We perform a Bayesian analysis to constrain the cosmological parameters using the Pantheon+, more recent DESy5, DESI, and, as a supplement, Quasar datasets. We find that the HDE model within almost all data combinations performs extremely well in comparison to the GT approach, which is usually strongly disfavored. Using the combination of DESy5+DESI alone, we find that the GT approaches are disfavored at $|\log \mathcal{B}| \sim 5.8$ and $|\log \mathcal{B}| \sim 6.2$ for the Barrow and Tsallis limits on $\Delta$, respectively, wrt $\Lambda$CDM model. While the HDE approach is statistically equivalent to $\Lambda$CDM when comparing the Bayesian evidence. We also investigate the evolution of the dark energy equation of state and place limits on the same, consistent with quintessence-like behaviour in the HDE approaches.


title: Calculating the two-photon exchange contribution to $K_L\rightarrow\mu^+\mu^-$ decay

abstract: We present a theoretical framework within which both the real and imaginary parts of the complex, two-photon exchange amplitude contributing to $K_L\rightarrow\mu^+\mu^-$ decay can be calculated using lattice QCD. The real part of this two-photon amplitude is of approximately the same size as that coming from a second-order weak strangeness-changing neutral-current process. Thus a test of the standard model prediction for this second-order weak process depends on an accurate result of this two-photon amplitude. A limiting factor of our proposed method comes from low-energy three-particle $\pi\pi\gamma$ states. The contribution from these states will be significantly distorted by the finite volume of our calculation -- a distortion for which there is no available correction. However, a simple estimate of the contribution of these three-particle states suggests their contribution to be at most a few percent allowing their neglect in a lattice calculation with a 10% target accuracy.


title: Accuracy and limitations of the bond polarizability model in modeling of Raman scattering from molecular dynamics simulations

abstract: Calculation of Raman scattering from molecular dynamics (MD) simulations requires accurate modeling of the evolution of the electronic polarizability of the system along its MD trajectory. For large systems, this necessitates the use of atomistic models to represent the dependence of electronic polarizability on atomic coordinates. The bond polarizability model (BPM) is the simplest such model and has been used for modeling the Raman spectra of molecular systems but has not been applied to solid-state systems. Here, we systematically investigate the accuracy and limitations of the BPM parameterized from density functional theory (DFT) results for a series of simple molecules such as CO2, SO2, H2S, H2O, NH3, and CH4, the more complex CH2O, CH3OH and CH3CH2OH and thiophene molecules and the BaTiO3 and CsPbBr3 perovskite solids. We find that BPM can reliably reproduce the overall features of the Raman spectra such as shifts of peak positions. However, with the exception of highly symmetric systems, the assumption of non-interacting bonds limits the quantitative accuracy of the BPM; this assumption also leads to qualitatively inaccurate polarizability evolution and Raman spectra for systems where large deviations from the ground state structure are present.


title: Boosted Conformal Prediction Intervals

abstract: This paper introduces a boosted conformal procedure designed to tailor conformalized prediction intervals toward specific desired properties, such as enhanced conditional coverage or reduced interval length. We employ machine learning techniques, notably gradient boosting, to systematically improve upon a predefined conformity score function. This process is guided by carefully constructed loss functions that measure the deviation of prediction intervals from the targeted properties. The procedure operates post-training, relying solely on model predictions and without modifying the trained model (e.g., the deep network). Systematic experiments demonstrate that starting from conventional conformal methods, our boosted procedure achieves substantial improvements in reducing interval length and decreasing deviation from target conditional coverage.


title: Benchmarking Vision-Language Contrastive Methods for Medical Representation Learning

abstract: We perform a comprehensive benchmarking of contrastive frameworks for learning multimodal representations in the medical domain. Through this study, we aim to answer the following research questions: (i) How transferable are general-domain representations to the medical domain? (ii) Is multimodal contrastive training sufficient, or does it benefit from unimodal training as well? (iii) What is the impact of feature granularity on the effectiveness of multimodal medical representation learning? To answer these questions, we investigate eight contrastive learning approaches under identical training setups, and train them on 2.8 million image-text pairs from four datasets, and evaluate them on 25 downstream tasks, including classification (zero-shot and linear probing), image-to-text and text-to-image retrieval, and visual question-answering. Our findings suggest a positive answer to the first question, a negative answer to the second question, and the benefit of learning fine-grained features. Finally, we make our code publicly available.


title: An Optimism-based Approach to Online Evaluation of Generative Models

abstract: Existing frameworks for evaluating and comparing generative models typically target an offline setting, where the evaluator has access to full batches of data produced by the models. However, in many practical scenarios, the goal is to identify the best model using the fewest generated samples to minimize the costs of querying data from the models. Such an online comparison is challenging with current offline assessment methods. In this work, we propose an online evaluation framework to find the generative model that maximizes a standard assessment score among a group of available models. Our method uses an optimism-based multi-armed bandit framework to identify the model producing data with the highest evaluation score, quantifying the quality and diversity of generated data. Specifically, we study the online assessment of generative models based on the Fr\'echet Inception Distance (FID) and Inception Score (IS) metrics and propose the FID-UCB and IS-UCB algorithms leveraging the upper confidence bound approach in online learning. We prove sub-linear regret bounds for these algorithms and present numerical results on standard image datasets, demonstrating their effectiveness in identifying the score-maximizing generative model.


title: Function spaces on Corson-like compacta

abstract: For an index set $\Gamma$ and a cardinal number $\kappa$ the $\Sigma_{\kappa}$-product of real lines $\Sigma_{\kappa}(\mathbb{R}^{\Gamma})$ consist of all elements of $\mathbb{R}^{\Gamma}$ with $<\kappa$ nonzero coordinates. A compact space is $\kappa$-Corson if it can be embedded into $\Sigma_{\kappa}(\mathbb{R}^{\Gamma})$ for some $\Gamma$. We also consider a class of compact spaces wider than the class of $\omega$-Corson compact spaces, investigated by Nakhmanson and Yakovlev as well as Marciszewski, Plebanek and Zakrzewski called $NY$ compact spaces. For a Tychonoff space $X$, let $C_{p}(X)$ be the space of real continuous functions on the space $X$, endowed with the pointwise convergence topology. We present here a characterisation of $\kappa$-Corson compact spaces $K$ for regular, uncountable cardinal numbers $\kappa$ in terms of function spaces $C_{p}(K)$, extending a theorem of Bell and Marciszewski and a theorem of Pol. We also prove that classes of $NY$ compact spaces and $\omega$-Corson compact spaces $K$ are preserved by linear homeomorphisms of function spaces $C_{p}(K)$.


title: HTVM: Efficient Neural Network Deployment On Heterogeneous TinyML Platforms

abstract: Optimal deployment of deep neural networks (DNNs) on state-of-the-art Systems-on-Chips (SoCs) is crucial for tiny machine learning (TinyML) at the edge. The complexity of these SoCs makes deployment non-trivial, as they typically contain multiple heterogeneous compute cores with limited, programmer-managed memory to optimize latency and energy efficiency. We propose HTVM - a compiler that merges TVM with DORY to maximize the utilization of heterogeneous accelerators and minimize data movements. HTVM allows deploying the MLPerf(TM) Tiny suite on DIANA, an SoC with a RISC-V CPU, and digital and analog compute-in-memory AI accelerators, at 120x improved performance over plain TVM deployment.


title: Reserve Provision from Electric Vehicles: Aggregate Boundaries and Stochastic Model Predictive Control

abstract: Controlled charging of electric vehicles, EVs, is a major potential source of flexibility to facilitate the integration of variable renewable energy and reduce the need for stationary energy storage. To offer system services from EVs, fleet aggregators must address the uncertainty of individual driving and charging behaviour. This paper introduces a means of forecasting the service volume available from EVs by considering several EV batteries as one conceptual battery with aggregate power and energy boundaries. This avoids the impossible task of predicting individual driving behaviour by taking advantage of the law of large numbers. The forecastability of the boundaries is demonstrated in a multiple linear regression model which achieves an $R^2$ of 0.7 for a fleet of 1,000 EVs. A two-stage stochastic model predictive control algorithm is used to schedule reserve services on a day-ahead basis addressing risk trade-offs by including Conditional Value-at-Risk in the objective function. A case study with 1.2 million domestic EV charge records from Great Britain shows that increasing fleet size improves prediction accuracy, thereby increasing reserve revenues and decreasing effective charging costs. For fleet sizes of 400 or above, charging cost reductions plateau at 60\%, with an average of 1.8kW of reserve provided per vehicle.


title: Reinforcement Learning from Human Feedback without Reward Inference: Model-Free Algorithm and Instance-Dependent Analysis

abstract: In this paper, we study reinforcement learning from human feedback (RLHF) under an episodic Markov decision process with a general trajectory-wise reward model. We developed a model-free RLHF best policy identification algorithm, called $\mathsf{BSAD}$, without explicit reward model inference, which is a critical intermediate step in the contemporary RLHF paradigms for training large language models (LLM). The algorithm identifies the optimal policy directly from human preference information in a backward manner, employing a dueling bandit sub-routine that constantly duels actions to identify the superior one. $\mathsf{BSAD}$ adopts a reward-free exploration and best-arm-identification-like adaptive stopping criteria to equalize the visitation among all states in the same decision step while moving to the previous step as soon as the optimal action is identifiable, leading to a provable, instance-dependent sample complexity $\tilde{\mathcal{O}}(c_{\mathcal{M}}SA^3H^3M\log\frac{1}{\delta})$ which resembles the result in classic RL, where $c_{\mathcal{M}}$ is the instance-dependent constant and $M$ is the batch size. Moreover, $\mathsf{BSAD}$ can be transformed into an explore-then-commit algorithm with logarithmic regret and generalized to discounted MDPs using a frame-based approach. Our results show: (i) sample-complexity-wise, RLHF is not significantly harder than classic RL and (ii) end-to-end RLHF may deliver improved performance by avoiding pitfalls in reward inferring such as overfit and distribution shift.


title: fKAN: Fractional Kolmogorov-Arnold Networks with trainable Jacobi basis functions

abstract: Recent advancements in neural network design have given rise to the development of Kolmogorov-Arnold Networks (KANs), which enhance speed, interpretability, and precision. This paper presents the Fractional Kolmogorov-Arnold Network (fKAN), a novel neural network architecture that incorporates the distinctive attributes of KANs with a trainable adaptive fractional-orthogonal Jacobi function as its basis function. By leveraging the unique mathematical properties of fractional Jacobi functions, including simple derivative formulas, non-polynomial behavior, and activity for both positive and negative input values, this approach ensures efficient learning and enhanced accuracy. The proposed architecture is evaluated across a range of tasks in deep learning and physics-informed deep learning. Precision is tested on synthetic regression data, image classification, image denoising, and sentiment analysis. Additionally, the performance is measured on various differential equations, including ordinary, partial, and fractional delay differential equations. The results demonstrate that integrating fractional Jacobi functions into KANs significantly improves training speed and performance across diverse fields and applications.


title: Estimating the Hallucination Rate of Generative AI

abstract: This work is about estimating the hallucination rate for in-context learning (ICL) with Generative AI. In ICL, a conditional generative model (CGM) is prompted with a dataset and asked to make a prediction based on that dataset. The Bayesian interpretation of ICL assumes that the CGM is calculating a posterior predictive distribution over an unknown Bayesian model of a latent parameter and data. With this perspective, we define a \textit{hallucination} as a generated prediction that has low-probability under the true latent parameter. We develop a new method that takes an ICL problem -- that is, a CGM, a dataset, and a prediction question -- and estimates the probability that a CGM will generate a hallucination. Our method only requires generating queries and responses from the model and evaluating its response log probability. We empirically evaluate our method on synthetic regression and natural language ICL tasks using large language models.


title: Resummation of Multi-Stress Tensors in Higher Dimensions

abstract: In the context of holographic conformal field theories (CFTs), a system of linear partial differential equations was recently proposed to be the higher-dimensional analogs of the null-state equations in $d=2$ CFTs at large central charge. Solving these equations in a near-lightcone expansion yields solutions that match the minimal-twist multi-stress tensor contributions to a heavy-light four-point correlator (or a thermal two-point correlator) computed using holography, the conformal bootstrap, and other methods. This note explores the exact solutions to these equations. We begin by observing that, in an expansion in terms of the ratio between the heavy operator's dimension and the central charge, the $d=2$ correlator involving the level-two degenerate scalars at each order can be represented as a Bessel function; the resummation yields the Virasoro vacuum block. We next observe a relation between the $d=2$ correlator and the $d=4$ near-lightcone correlator involving light scalars with the same conformal dimension. The resummed $d=4$ correlator takes a simple form in the complex frequency domain. Unlike the Virasoro vacuum block, the resummation in $d=4$ leads to essential singularities. Similar expressions are also obtained when the light scalar's dimension takes other finite values. These CFT results correspond to a holographic computation with a spherical black hole. In addition, using the differential equations, we demonstrate that the correlators can be reconstructed via certain modes. In $d=2$, these modes are related to the Virasoro algebra.


title: Hodge structures on conformal blocks

abstract: We prove existence and uniqueness of complex Hodge structures on modular functors, under the assumptions that their conformal blocks are semisimple as representations of mapping class groups and that the associated categories are ribbon. These $2$ assumptions are satisfied by modular functors coming from Lie algebras, and it is an open conjecture that they are always satisfied. The proof is based on the non-abelian Hodge correspondence and Ocneanu rigidity. Given a modular functor, we explain how its Hodge numbers fit into a Frobenius algebra and the Chern characters of its Hodge decompositions into a new cohomological field theory (CohFT). In the case of $\mathrm{SU}(2)$ modular functors of level $2$ times an odd number, we give explicit formulas for all Hodge numbers, in any genus $g$.