title: A Deep Learning Method for Optimal Investment Under Relative Performance Criteria Among Heterogeneous Agents

abstract: Graphon games have been introduced to study games with many players who interact through a weighted graph of interaction. By passing to the limit, a game with a continuum of players is obtained, in which the interactions are through a graphon. In this paper, we focus on a graphon game for optimal investment under relative performance criteria, and we propose a deep learning method. The method builds upon two key ingredients: first, a characterization of Nash equilibria by forward-backward stochastic differential equations and, second, recent advances of machine learning algorithms for stochastic differential games. We provide numerical experiments on two different financial models. In each model, we compare the effect of several graphons, which correspond to different structures of interactions.


title: Bayesian Deep Learning Via Expectation Maximization and Turbo Deep Approximate Message Passing

abstract: Efficient learning and model compression algorithm for deep neural network (DNN) is a key workhorse behind the rise of deep learning (DL). In this work, we propose a message passing based Bayesian deep learning algorithm called EM-TDAMP to avoid the drawbacks of traditional stochastic gradient descent (SGD) based learning algorithms and regularization-based model compression methods. Specifically, we formulate the problem of DNN learning and compression as a sparse Bayesian inference problem, in which group sparse prior is employed to achieve structured model compression. Then, we propose an expectation maximization (EM) framework to estimate posterior distributions for parameters (E-step) and update hyperparameters (M-step), where the E-step is realized by a newly proposed turbo deep approximate message passing (TDAMP) algorithm. We further extend the EM-TDAMP and propose a novel Bayesian federated learning framework, in which and the clients perform TDAMP to efficiently calculate the local posterior distributions based on the local data, and the central server first aggregates the local posterior distributions to update the global posterior distributions and then update hyperparameters based on EM to accelerate convergence. We detail the application of EM-TDAMP to Boston housing price prediction and handwriting recognition, and present extensive numerical results to demonstrate the advantages of EM-TDAMP.


title: Utilizing Large LanguageModels to Detect Privacy Leaks in Mini-App Code

abstract: Mini-applications, commonly referred to as mini-apps, are compact software programs embedded within larger applications or platforms, offering targeted functionality without the need for separate installations. Typically web-based or cloud-hosted, these mini-apps streamline user experiences by providing focused services accessible through web browsers or mobile apps. Their simplicity, speed, and integration capabilities make them valuable additions to messaging platforms, social media networks, e-commerce sites, and various digital environments. WeChat Mini Programs, a prominent feature of China's leading messaging app, exemplify this trend, offering users a seamless array of services without additional downloads. Leveraging WeChat's extensive user base and payment infrastructure, Mini Programs facilitate efficient transactions and bridge online and offline experiences, shaping China's digital landscape significantly. This paper investigates the potential of employing Large Language Models (LLMs) to detect privacy breaches within WeChat Mini Programs. Given the widespread use of Mini Programs and growing concerns about data privacy, this research seeks to determine if LLMs can effectively identify instances of privacy leakage within this ecosystem. Through meticulous analysis and experimentation, we aim to highlight the efficacy of LLMs in safeguarding user privacy and security within the WeChat Mini Program environment, thereby contributing to a more secure digital landscape.


title: Assessing Generalization for Subpopulation Representative Modeling via In-Context Learning

abstract: This study evaluates the ability of Large Language Model (LLM)-based Subpopulation Representative Models (SRMs) to generalize from empirical data, utilizing in-context learning with data from the 2016 and 2020 American National Election Studies. We explore generalization across response variables and demographic subgroups. While conditioning with empirical data improves performance on the whole, the benefit of in-context learning varies considerably across demographics, sometimes hurting performance for one demographic while helping performance for others. The inequitable benefits of in-context learning for SRM present a challenge for practitioners implementing SRMs, and for decision-makers who might come to rely on them. Our work highlights a need for fine-grained benchmarks captured from diverse subpopulations that test not only fidelity but generalization.


title: Diff-RNTraj: A Structure-aware Diffusion Model for Road Network-constrained Trajectory Generation

abstract: Trajectory data is essential for various applications as it records the movement of vehicles. However, publicly available trajectory datasets remain limited in scale due to privacy concerns, which hinders the development of trajectory data mining and trajectory-based applications. To address this issue, some methods for generating synthetic trajectories have been proposed to expand the scale of the dataset. However, all existing methods generate trajectories in the geographical coordinate system, which poses two limitations for their utilization in practical applications: 1) the inability to ensure that the generated trajectories are constrained on the road. 2) the lack of road-related information. In this paper, we propose a new problem to meet the practical application need, \emph{i.e.}, road network-constrained trajectory (RNTraj) generation, which can directly generate trajectories on the road network with road-related information. RNTraj is a hybrid type of data, in which each point is represented by a discrete road segment and a continuous moving rate. To generate RNTraj, we design a diffusion model called Diff-RNTraj. This model can effectively handle the hybrid RNTraj using a continuous diffusion framework by incorporating a pre-training strategy to embed hybrid RNTraj into continuous representations. During the sampling stage, a RNTraj decoder is designed to map the continuous representation generated by the diffusion model back to the hybrid RNTraj format. Furthermore, Diff-RNTraj introduces a novel loss function to enhance the spatial validity of the generated trajectories. Extensive experiments conducted on two real-world trajectory datasets demonstrate the effectiveness of the proposed model.


title: SelfSwapper: Self-Supervised Face Swapping via Shape Agnostic Masked AutoEncoder

abstract: Face swapping has gained significant attention for its varied applications. The majority of previous face swapping approaches have relied on the seesaw game training scheme, which often leads to the instability of the model training and results in undesired samples with blended identities due to the target identity leakage problem. This paper introduces the Shape Agnostic Masked AutoEncoder (SAMAE) training scheme, a novel self-supervised approach designed to enhance face swapping model training. Our training scheme addresses the limitations of traditional training methods by circumventing the conventional seesaw game and introducing clear ground truth through its self-reconstruction training regime. It effectively mitigates identity leakage by masking facial regions of the input images and utilizing learned disentangled identity and non-identity features. Additionally, we tackle the shape misalignment problem with new techniques including perforation confusion and random mesh scaling, and establishes a new state-of-the-art, surpassing other baseline methods, preserving both identity and non-identity attributes, without sacrificing on either aspect.


title: Real-World Atmospheric Turbulence Correction via Domain Adaptation

abstract: Atmospheric turbulence, a common phenomenon in daily life, is primarily caused by the uneven heating of the Earth's surface. This phenomenon results in distorted and blurred acquired images or videos and can significantly impact downstream vision tasks, particularly those that rely on capturing clear, stable images or videos from outdoor environments, such as accurately detecting or recognizing objects. Therefore, people have proposed ways to simulate atmospheric turbulence and designed effective deep learning-based methods to remove the atmospheric turbulence effect. However, these synthesized turbulent images can not cover all the range of real-world turbulence effects. Though the models have achieved great performance for synthetic scenarios, there always exists a performance drop when applied to real-world cases. Moreover, reducing real-world turbulence is a more challenging task as there are no clean ground truth counterparts provided to the models during training. In this paper, we propose a real-world atmospheric turbulence mitigation model under a domain adaptation framework, which links the supervised simulated atmospheric turbulence correction with the unsupervised real-world atmospheric turbulence correction. We will show our proposed method enhances performance in real-world atmospheric turbulence scenarios, improving both image quality and downstream vision tasks.


title: Entropy and Heat Capacity of the transverse momentum distribution for pp collisions at RHIC and LHC energies

abstract: We investigate the transverse momentum distribution (TMD) statistics from three different theoretical approaches. In particular, we explore the framework used for string models, wherein the particle production is given by the Schwinger mechanism. The thermal distribution arises from the Gaussian fluctuations of the string tension. The hard part of the TMD can be reproduced by considering heavy tailed string tension fluctuations, for instance, the Tsallis $q$-Gaussian function, giving rise to a confluent hypergeometric function that fits the entire experimental TMD data. We also discuss the QCD-based Hagerdon function, another family of fitting functions frequently used to describe the spectrum. We analyze the experimental data of minimum bias pp collisions reported by the BNL Relativistic Heavy Ion Collider (RHIC) and the CERN Large Hadron Collider (LHC) experiments (from $\sqrt{s}=0.2$ TeV to $\sqrt{s}=13$ TeV). We extracted the corresponding temperature by studying the behavior of the spectra at low transverse momentum values. For the three approaches, we compute all moments, highlighting the average, variance, and kurtosis. Finally, we compute the Shannon entropy and the heat capacity through the entropy derivative with respect to the temperature. We found that the $q$-Gaussian string tension fluctuations lead to a monotonically increasing heat capacity as a function of the center of mass energy, which is also observed for the Hagedorn fitting function. This behavior is consistent with the experimental observation that the temperature slowly rises with increments of the collision energy.


title: A Functional Coefficients Network Autoregressive Model

abstract: The paper introduces a flexible model for the analysis of multivariate nonlinear time series data. The proposed Functional Coefficients Network Autoregressive (FCNAR) model considers the response of each node in the network to depend in a nonlinear fashion to each own past values (autoregressive component), as well as past values of each neighbor (network component). Key issues of model stability/stationarity, together with model parameter identifiability, estimation and inference are addressed for error processes that can be heavier than Gaussian for both fixed and growing number of network nodes. The performance of the estimators for the FCNAR model is assessed on synthetic data and the applicability of the model is illustrated on multiple indicators of air pollution data.


title: The White-light Emissions in Two X-class Flares Observed by ASO-S and CHASE

abstract: The white-light continuum emissions in solar flares (i.e., white-light flares) are usually observed on the solar disk but, in a few cases, off the limb. Here we present on-disk as well as off-limb continuum emissions at 3600 {\AA} (in the Balmer continuum) in an X2.1 flare (SOL2023-03-03T17:52) and an X1.5 flare (SOL2023-08-07T20:46), respectively, observed by the White-light Solar Telescope (WST) on the Advanced Space-based Solar Observatory (ASO-S). These continuum emissions are seen at the ribbons for the X2.1 flare and on loops during the X1.5 event, in which the latter also appears in the decay phase. These emissions also show up in the pseudo-continuum images at Fe I {\lambda}6173 from the Helioseismic and Magnetic Imager (HMI) on the Solar Dynamics Observatory (SDO). In addition, the ribbon sources in the X2.1 flare exhibit significant enhancements in the Fe I line at 6569.2 {\AA} and the nearby continuum observed by the Chinese H{\alpha} Solar Explorer (CHASE). It is found that the on-disk continuum emissions in the X2.1 flare are related to a nonthermal electron-beam heating either directly or indirectly, while the off-limb emissions in the X1.5 flare are associated with thermal plasma cooling or due to Thomson scattering. These comprehensive continuum observations can provide good constraints on flare energy deposition models, which helps well understand the physical mechanism of white-light flares.


title: A Unified MPC Strategy for a Tilt-rotor VTOL UAV Towards Seamless Mode Transitioning

abstract: Capabilities of long-range flight and vertical take-off and landing (VTOL) are essential for Urban Air Mobility (UAM). Tiltrotor VTOLs have the advantage of balancing control simplicity and system complexity due to their redundant control authority. Prior work on controlling these aircraft either requires separate controllers and switching modes for different vehicle configurations or performs the control allocation on separate actuator sets, which cannot fully use the potential of the redundancy of tiltrotor. This paper introduces a unified MPC-based control strategy for a customized tiltrotor VTOL Unmanned Aerial Vehicle (UAV), which does not require mode-switching and can perform the control allocation in a consistent way. The incorporation of four independently controllable rotors in VTOL design offers an extra level of redundancy, allowing the VTOL to accommodate actuator failures. The result shows that our approach outperforms PID controllers while maintaining unified control. It allows the VTOL to perform smooth acceleration/deceleration, and precise coordinated turns. In addition, the independently controlled tilts enable the vehicle to handle actuator failures, ensuring that the aircraft remains operational even in the event of a servo or motor malfunction.


title: Unsupervised Discovery of Object-Centric Neural Fields

abstract: We study inferring 3D object-centric scene representations from a single image. While recent methods have shown potential in unsupervised 3D object discovery from simple synthetic images, they fail to generalize to real-world scenes with visually rich and diverse objects. This limitation stems from their object representations, which entangle objects' intrinsic attributes like shape and appearance with extrinsic, viewer-centric properties such as their 3D location. To address this bottleneck, we propose Unsupervised discovery of Object-Centric neural Fields (uOCF). uOCF focuses on learning the intrinsics of objects and models the extrinsics separately. Our approach significantly improves systematic generalization, thus enabling unsupervised learning of high-fidelity object-centric scene representations from sparse real-world images. To evaluate our approach, we collect three new datasets, including two real kitchen environments. Extensive experiments show that uOCF enables unsupervised discovery of visually rich objects from a single real image, allowing applications such as 3D object segmentation and scene manipulation. Notably, uOCF demonstrates zero-shot generalization to unseen objects from a single real image. Project page: https://red-fairy.github.io/uOCF/


title: Young double-slit interference with single hard x-ray photons

abstract: Young double-slit experiments using monochromatic hard X-rays with the energy of 25 keV are presented. The experiments were performed at a synchrotron source with a distance of 110 m between the interferometer and the detector to produce an interference pattern with a sufficiently broad period that could be adequately sampled by a photon-counting detector with 75 micrometre pixels. In the single-particle version of the experiment, over one million image frames with a single registered photon in each one were collected. The sum of these frames showed a clear presence of the interference pattern with the expected period. Subsequent analysis provided an objective estimation of the minimal number of detected photons required to determine, in accordance with the Rose criterion, the presence of the photon interference. Apart from a general theoretical interest, these investigations were aimed at exploring the possibility of medical X-ray phase-contrast imaging in photon-counting mode at minimal radiation doses.


title: Combination of crystal growth with optical floating zone and evaluation of Nd3+:LaAlO3 crystals with the dynamic nuclear polarization of 139La and 27Al

abstract: Producing a polarized lanthanum (La) target with high polarization and long relaxation time is crucial for realizing time-reversal violation experiments using polarized neutron beams. We use a LaAlO3 crystal doped with a small amount of Nd3+ ions for the polarized lanthanum target. Optimizing the amount of Nd3+ ions is considerably important because the achievable polarization and relaxation time strongly depend on this amount. We established a fundamental method to grow single crystals of Nd3+:LaAlO3 using an optical floating zone method that employs halogen lamps and evaluated the crystals with the dynamic nuclear polarization (DNP) method for polarizing nuclear spins. Two crystal samples were grown by ourselves and evaluated with the DNP at 1.3 K and 2.3 T for the first time except for the target materials of protons. The enhancement of NMR signals for 139La and 27Al was successfully observed, and the enhancement factors were eventually 3.5+-0.3 and 13+-3 for the samples with Nd3+ ions of 0.05 and 0.01 mol%, respectively. These enhancement factors correspond to absolute vector polarizations of 0.27+-0.02% (Nd 0.05 mol%) and 1.4+-0.3% (Nd 0.01 mol%). Although the obtained polarizations are still low, they are acceptable as a first step. The combination scheme of the crystal growth and evaluation of the crystals is found to be effectively applicable for optimizing the amount of Nd3+ ions for improving the performance of the polarized target.


title: Distribution Locational Marginal Emission for Carbon Alleviation in Distribution Networks: Formulation, Calculation, and Implication

abstract: Regulating the proper carbon-aware intervention policy is one of the keys to emission alleviation in the distribution network, whose basis lies in effectively attributing the emission responsibility using emission factors. This paper establishes the distribution locational marginal emission (DLME) to calculate the marginal change of emission from the marginal change of both active and reactive load demand for incentivizing carbon alleviation. It first formulates the day-head distribution network scheduling model based on the second-order cone program (SOCP). The emission propagation and responsibility are analyzed from demand to supply to system emission. Considering the complex and implicit mapping of the SOCP-based scheduling model, the implicit theorem is leveraged to exploit the optimal condition of SOCP. The corresponding SOCP-based implicit derivation approach is proposed to calculate the DLMEs effectively in a model-based way. Comprehensive numerical studies are conducted to verify the superiority of the proposed method by comparing its calculation efficacy to the conventional marginal estimation approach, assessing its effectiveness in carbon alleviation with comparison to the average emission factors, and evaluating its carbon alleviation ability of reactive DLME.


title: The highest mass Kepler red giants -- I. Global asteroseismic parameters of 48 stars

abstract: When low- and intermediate-mass stars evolve off the main sequence, they expand and cool into the red giant stages of evolution, which include those associated with shell H burning (the red giant branch), core He burning (the red clump), and shell He burning (the asymptotic giant branch). The majority of red giants have masses $< 2 M_\odot$, and red giants more massive than this are often excluded from major studies. Here we present a study of the highest-mass stars ($M > 3.0 M_\odot$) in the Kepler sample of 16,000 red giants. We begin by re-estimating their global seismic properties with new light curves, highlighting the differences between using the SAP and PDCSAP light curves provided by Kepler. We use the re-estimated properties to derive new mass estimates for the stars, ending with a final sample of 48 confirmed high-mass stars. We explore their oscillation envelopes, confirming the trends found in recent works such as low mean mode amplitude and wide envelopes. We find, through probabilistic means, that our sample is likely all core He burning stars. We measure their dipole and quadrupole mode visibilities and confirm that the dipole mode visibility tends to decrease with mass.


title: RIS-Empowered LEO Satellite Networks for 6G: Promising Usage Scenarios and Future Directions

abstract: Low-Earth orbit (LEO) satellite systems have been deemed a promising key enabler for current 5G and the forthcoming 6G wireless networks. Such LEO satellite constellations can provide worldwide three-dimensional coverage, high data rate, and scalability, thus enabling truly ubiquitous connectivity. On the other hand, another promising technology, reconfigurable intelligent surfaces (RISs), has emerged with favorable features, such as flexible deployment, cost & power efficiency, less transmission delay, noise-free nature, and in-band full-duplex structure. LEO satellite networks have many practical imperfections and limitations; however, exploiting RISs has been shown to be a potential solution to overcome these challenges. Particularly, RISs can enhance link quality, reduce the Doppler shift effect, and mitigate inter-/intra beam interference. In this article, we delve into exploiting RISs in LEO satellite networks. First, we present a holistic overview of LEO satellite communication and RIS technology, highlighting potential benefits and challenges. Second, we describe promising usage scenarios and applications in detail. Finally, we discuss potential future directions and challenges on RIS-empowered LEO networks, offering futuristic visions of the upcoming 6G era.


title: Constructive Coordinatization of Desarguesian Planes

abstract: A classical theory of Desarguesian geometry, originating with D. Hilbert in his 1899 treatise, Grundlagen der Geometrie, leads from axioms to the construction of a division ring from which coordinates may be assigned to points, and equations to lines; this theory is highly nonconstructive. The present paper develops this coordinatization theory constructively, in accordance with the principles introduced by Errett Bishop in his 1967 book, Foundations of Constructive Analysis. The traditional geometric axioms are adopted, together with two supplementary axioms which are constructively stronger versions of portions of the usual axioms. Stronger definitions, with enhanced constructive meaning, are also selected; these are based on a single primitive notion, and are classically equivalent to the traditional definitions. Brouwerian counterexamples are included; these point out specific nonconstructivities in the classical theory, and the consequent need for strengthened definitions and results in a constructive theory. All the major results of the classical theory are established, in their original form, revealing their hidden constructive content.


title: Making Flow-Matching-Based Zero-Shot Text-to-Speech Laugh as You Like

abstract: Laughter is one of the most expressive and natural aspects of human speech, conveying emotions, social cues, and humor. However, most text-to-speech (TTS) systems lack the ability to produce realistic and appropriate laughter sounds, limiting their applications and user experience. While there have been prior works to generate natural laughter, they fell short in terms of controlling the timing and variety of the laughter to be generated. In this work, we propose ELaTE, a zero-shot TTS that can generate natural laughing speech of any speaker based on a short audio prompt with precise control of laughter timing and expression. Specifically, ELaTE works on the audio prompt to mimic the voice characteristic, the text prompt to indicate the contents of the generated speech, and the input to control the laughter expression, which can be either the start and end times of laughter, or the additional audio prompt that contains laughter to be mimicked. We develop our model based on the foundation of conditional flow-matching-based zero-shot TTS, and fine-tune it with frame-level representation from a laughter detector as additional conditioning. With a simple scheme to mix small-scale laughter-conditioned data with large-scale pre-training data, we demonstrate that a pre-trained zero-shot TTS model can be readily fine-tuned to generate natural laughter with precise controllability, without losing any quality of the pre-trained zero-shot TTS model. Through objective and subjective evaluations, we show that ELaTE can generate laughing speech with significantly higher quality and controllability compared to conventional models. See https://aka.ms/elate/ for demo samples.


title: Exploring Perceptual Limitation of Multimodal Large Language Models

abstract: Multimodal Large Language Models (MLLMs) have recently shown remarkable perceptual capability in answering visual questions, however, little is known about the limits of their perception. In particular, while prior works have provided anecdotal evidence of MLLMs' sensitivity to object size, this phenomenon and its underlying causes have not been explored comprehensively. In this work, we quantitatively study the perception of small visual objects in several state-of-the-art MLLMs and reveal a pervasive limitation in answering questions about small objects in images. Next, we identify four independent factors that can contribute to this limitation -- object quality, size, distractors, and location -- and conduct controlled intervention studies to measure the effect of each factor on MLLMs' perception. In particular, we find that lower object quality and smaller object size can both independently reduce MLLMs' ability to answer visual questions. More surprisingly, we find that the location of the object in the image and the presence of visual distractors can also significantly reduce MLLMs' question answering accuracy. Our study provides a better understanding of the perceptual limitation of MLLMs and contributes new evaluation protocols for analyzing the perception of future MLLMs. To facilitate further investigations, we release our code and data.


title: An Efficient Wireless Channel Estimation Model for Environment Sensing

abstract: This paper presents a novel and efficient wireless channel estimation scheme based on a tapped delay line (TDL) model of wireless signal propagation, where a data-driven machine learning approach is used to estimate the path delays and gains. The key motivation for our novel channel estimation model is to gain environment awareness, i.e., detecting changes in path delays and gains related to interesting objects and events in the field. The estimated channel state provides a more detailed measure to sense the field than the single-tap channel state indicator (CSI) in current OFDM systems. Advantages of this approach also include low computation time and training data requirements, making it suitable for environment awareness applications. We evaluate this model's performance using Matlab's ray-tracing tool under static and dynamic conditions for increased realism instead of the standard evaluation approaches that rely on classical statistical channel models. Our results show that our TDL-based model can accurately estimate the path delays and associated gains for a broad-range of locations and operating conditions. Root-mean-square estimation error was less than $10^{-4}$, or $-40$dB, for SNR $\geq 60$dB in all of our experiments. Our results show that interference of a flying drone on signal multipaths, in a preliminary experiment, can be detected in estimated channel states which, otherwise, remains obscured in conventional CSI.


title: Chain-of-Layer: Iteratively Prompting Large Language Models for Taxonomy Induction from Limited Examples

abstract: Automatic taxonomy induction is crucial for web search, recommendation systems, and question answering. Manual curation of taxonomies is expensive in terms of human effort, making automatic taxonomy construction highly desirable. In this work, we introduce Chain-of-Layer which is an in-context learning framework designed to induct taxonomies from a given set of entities. Chain-of-Layer breaks down the task into selecting relevant candidate entities in each layer and gradually building the taxonomy from top to bottom. To minimize errors, we introduce the Ensemble-based Ranking Filter to reduce the hallucinated content generated at each iteration. Through extensive experiments, we demonstrate that Chain-of-Layer achieves state-of-the-art performance on four real-world benchmarks.


title: Magnetic field of gas giant exoplanets and its influence on the retention of their exomoons

abstract: We study the magnetic and tidal interactions of a gas-giant exoplanet with its host star and with its exomoons, and focus on their retention. We briefly revisit the scaling law for planetary dynamo in terms of its mass, radius and luminosity. Based on the virial theorem, we construct an evolution law for planetary magnetic field and find that its initial entropy is important for the field evolution of a high-mass planet. We estimate the magnetic torques on orbit arising from the star-planet and planet-moon magnetic interactions, and find that it can compensate tidal torques and bypass frequency valleys where dynamical-tide response is ineffective. For exomoon's retention we consider two situations. In the presence of a circumplanetary disk (CPD), by comparison between CPD's inner and outer radii, we find that planets with too strong magnetic fields or too small distance from its host star tend not to host exomoons. During the subsequent CPD-free evolution, we find, by comparison between planet's spindown and moon's migration timescales, that hot Jupiters with periods of several days are unlikely to retain large exomoons, albeit they could be surrounded by rings from the debris of tidally disrupted moons. In contrast, moons, if formed around warm or cold Jupiters, can be preserved. Finally, we estimate the radio power and flux density due to the star-planet and planet-moon magnetic interactions and give the upper limit of detection distance by FAST.


title: The Limits of Assumption-free Tests for Algorithm Performance

abstract: Algorithm evaluation and comparison are fundamental questions in machine learning and statistics -- how well does an algorithm perform at a given modeling task, and which algorithm performs best? Many methods have been developed to assess algorithm performance, often based around cross-validation type strategies, retraining the algorithm of interest on different subsets of the data and assessing its performance on the held-out data points. Despite the broad use of such procedures, the theoretical properties of these methods are not yet fully understood. In this work, we explore some fundamental limits for answering these questions with limited amounts of data. In particular, we make a distinction between two questions: how good is an algorithm $A$ at the problem of learning from a training set of size $n$, versus, how good is a particular fitted model produced by running $A$ on a particular training data set of size $n$? Our main results prove that, for any test that treats the algorithm $A$ as a ``black box'' (i.e., we can only study the behavior of $A$ empirically), there is a fundamental limit on our ability to carry out inference on the performance of $A$, unless the number of available data points $N$ is many times larger than the sample size $n$ of interest. (On the other hand, evaluating the performance of a particular fitted model is easy as long as a holdout data set is available -- that is, as long as $N-n$ is not too small.) We also ask whether an assumption of algorithmic stability might be sufficient to circumvent this hardness result. Surprisingly, we find that this is not the case: the same hardness result still holds for the problem of evaluating the performance of $A$, aside from a high-stability regime where fitted models are essentially nonrandom. Finally, we also establish similar hardness results for the problem of comparing multiple algorithms.


title: Chemical inhomogeneities in high-entropy alloys help mitigate the strength-ductility trade-off

abstract: Metallurgists have long been accustomed to a trade-off between yield strength and tensile ductility. Extending previously known strain-hardening mechanisms, the emerging multi-principal-element alloys (MPEAs) offer additional help in promoting the strength-ductility synergy, towards gigapascal yield strength simultaneously with pure-metal-like tensile ductility. The highly concentrated chemical make-up in these 'high-entropy' alloys (HEAs) adds, at ultrafine spatial scale from sub-nanometer to tens of nanometers, inherent chemical inhomogeneities in local composition and local chemical order (LCO). These institute a 'nano-cocktail' environment that exerts extra dragging forces, rendering a much wavier motion of dislocation lines (in stick-slip mode) different from dilute solutions. The variable fault energy landscape also makes the dislocation movement sluggish, increasing their chances to hit one another and react to increase entanglement. The accumulation of dislocations (plus faults) dynamically stores obstacles against ensuing dislocation motion to sustain an adequate strain-hardening rate at high flow stresses, delaying plastic instability to enable large (uniform) elongation. The successes summarized advocate MPEAs as an effective recipe towards ultrahigh strength at little expense of tensile ductility. The insight gained also answers the question as to what new mechanical behavior the HEAs have to offer, beyond what has been well documented for traditional metals and solid solutions.


title: Drift wave soliton formation via forced-driven zonal flow and implication on plasma confinement

abstract: In this work, gyrokinetic theory of drift waves (DWs) self-regulation via the forced driven zonal flow (ZF) is presented, and finite diamagnetic drift frequency due to plasma nonuniformity is shown to play dominant role in ZF forced generation. The obtained nonlinear DW equation is a nonlinear Schr\"odinger equation, in which the linear dispersiveness, linear growth, nonuniformity of diamagnetic drift frequency, and cubic nonlinearity induced by feedback of forced-driven ZF to DWs are self-consistently included. The nonlinear DW equation is solved numerically in both uniform and nonuniform plasmas. It is shown that DWenvelope soliton may form due to the balance of linear dispersiveness and nonlinearity, and lead to turbulence spreading to linearly stable region. It is further found that though the threshold on DW amplitude for soliton formation is well within the relevant parameter regimes of realistic tokamak experiments, solitons can not extend beyond the range bounded by the turning points of the wave packet when plasma nonuniformity is self-consistently accounted for.


title: Replicability is Asymptotically Free in Multi-armed Bandits

abstract: This work is motivated by the growing demand for reproducible machine learning. We study the stochastic multi-armed bandit problem. In particular, we consider a replicable algorithm that ensures, with high probability, that the algorithm's sequence of actions is not affected by the randomness inherent in the dataset. We observe that existing algorithms require $O(1/\rho^2)$ times more regret than nonreplicable algorithms, where $\rho$ is the level of nonreplication. However, we demonstrate that this additional cost is unnecessary when the time horizon $T$ is sufficiently large for a given $\rho$, provided that the magnitude of the confidence bounds is chosen carefully. We introduce an explore-then-commit algorithm that draws arms uniformly before committing to a single arm. Additionally, we examine a successive elimination algorithm that eliminates suboptimal arms at the end of each phase. To ensure the replicability of these algorithms, we incorporate randomness into their decision-making processes. We extend the use of successive elimination to the linear bandit problem as well. For the analysis of these algorithms, we propose a principled approach to limiting the probability of nonreplication. This approach elucidates the steps that existing research has implicitly followed. Furthermore, we derive the first lower bound for the two-armed replicable bandit problem, which implies the optimality of the proposed algorithms up to a $\log\log T$ factor for the two-armed case.


title: Study on the $\phi$-meson photoproduction off the proton target with the pentaquark-like $K^*\Sigma$ bound state $P_s$

abstract: We utilize the effective Lagrangian method within the tree-level Born approximation to explore $\phi$-meson photoproduction, i.e., $\gamma p \to \phi p$. Our analysis encompasses contributions from various sources, including the Pomeron, $f_1$-Regge, pseudoscalar particles ($\pi$, $\eta$), scalar particles ($a_0$, $f_0$), protons, and three-nucleon resonance states. In addition, we consider a possible pentaquark-like $K^* \Sigma$-bound state $P_s$. The findings indicate that, apart from the region near the threshold, contributions other than the Pomeron generally have a limited impact on the total cross section. However, at specific angles, alternative contributions become crucial, particularly at smaller values of ${\rm cos}\,\theta$. The incorporation of $P_s$ and other nucleon resonances proves essential to elucidate the bump observed near $W \sim 2.15$ GeV at very forward angles and behaviors within the range of $W=(2.0-2.3)$ GeV. Furthermore, in the region with $W\ge 2.5$ GeV, where nucleon resonances become negligible, contributions from the t-channel mesons become pivotal. Our calculations for spin density matrix components, examined in various frames, exhibit improvement when considering all contributions. This comprehensive approach successfully reproduces the observed bump by including $P_s$. We also briefly estimate the $P_s$ production via $\phi$-meson photoproduction in the future Electron-Ion Collider (EIC), resulting in the luminosity of 10 fb$^{-1}$ per month.


title: TeMPO: Efficient Time-Multiplexed Dynamic Photonic Tensor Core for Edge AI with Compact Slow-Light Electro-Optic Modulator

abstract: Electronic-photonic computing systems offer immense potential in energy-efficient artificial intelligence (AI) acceleration tasks due to the superior computing speed and efficiency of optics, especially for real-time, low-energy deep neural network (DNN) inference tasks on resource-restricted edge platforms. However, current optical neural accelerators based on foundry-available devices and conventional system architecture still encounter a performance gap compared to highly customized electronic counterparts. To bridge the performance gap due to lack of domain specialization, we present a time-multiplexed dynamic photonic tensor accelerator, dubbed TeMPO, with cross-layer device/circuit/architecture customization. At the device level, we present foundry-compatible, customized photonic devices, including a slow-light electro-optic modulator with experimental demonstration, optical splitters, and phase shifters that significantly reduce the footprint and power in input encoding and dot-product calculation. At the circuit level, partial products are hierarchically accumulated via parallel photocurrent aggregation, lightweight capacitive temporal integration, and sequential digital summation, considerably relieving the analog-to-digital conversion bottleneck. We also employ a multi-tile, multi-core architecture to maximize hardware sharing for higher efficiency. Across diverse edge AI workloads, TeMPO delivers digital-comparable task accuracy with superior quantization/noise tolerance. We achieve a 368.6 TOPS peak performance, 22.3 TOPS/W energy efficiency, and 1.2 TOPS/mm$^2$ compute density, pushing the Pareto frontier in edge AI hardware. This work signifies the power of cross-layer co-design and domain-specific customization, paving the way for future electronic-photonic accelerators with even greater performance and efficiency.


title: Cloud-cloud collision and cluster formation in the W5-NW complex

abstract: We present a detailed structural and gas kinematic study of the star-forming complex W5-NW. A cloud-cloud collision scenario unravels with evidences of collision induced star and cluster formation. Various signatures of cloud-cloud collision such as "complementary distribution" and "bridging-features" are explored. At the colliding region, the two clouds have complementary morphologies, where W5-NWb has a filamentary key-like shape which fits into the U-shaped cavity in W5-NWa that behaves like a keyhole. The interaction region between the two clouds is characterised by bridging features with intermediate velocities connecting the two clouds. A skewed V-shaped bridging feature is also detected at the site of collision. A robust picture of the molecular gas distribution highlighting the bridges is seen in the position-position-velocity diagram obtained using the SCOUSEPY algorithm. Star cluster formation with an over-density of Class I and Class II young stellar objects is also seen towards this cloud complex, likely triggered by the cloud collision event.


title: Comparing the willingness to share for human-generated vs. AI-generated fake news

abstract: Generative artificial intelligence (AI) presents large risks for society when it is used to create fake news. A crucial factor for fake news to go viral on social media is that users share such content. Here, we aim to shed light on the sharing behavior of users across human-generated vs. AI-generated fake news. Specifically, we study: (1) What is the perceived veracity of human-generated fake news vs. AI-generated fake news? (2) What is the user's willingness to share human-generated fake news vs. AI-generated fake news on social media? (3) What socio-economic characteristics let users fall for AI-generated fake news? To this end, we conducted a pre-registered, online experiment with $N=$ 988 subjects and 20 fake news from the COVID-19 pandemic generated by GPT-4 vs. humans. Our findings show that AI-generated fake news is perceived as less accurate than human-generated fake news, but both tend to be shared equally. Further, several socio-economic factors explain who falls for AI-generated fake news.


title: Robust Quantum Control via a Model Predictive Control Strategy

abstract: This article presents a robust control strategy using Time-Optimal Model Predictive Control (TOMPC) for a two-level quantum system subject to bounded uncertainties. In this method, the control field is optimized over a finite horizon using a nominal quantum system as the reference and then the optimal control for the first time interval is applied and a projective measurement is implemented on the uncertain system. The new control field for the next time interval will be iteratively optimized based on the measurement result. We present theoretical results to guarantee the stability of the TOMPC algorithm. We also characterize the robustness and the convergence rate of the TOMPC strategy for the control of two-level systems. Numerical simulations further demonstrate that, in the presence of uncertainties, our quantum TOMPC algorithm enhances robustness and steers the state to the desired state with high fidelity. This work contributes to the progress of Model Predictive Control in quantum control and explores its potential in practical applications of quantum technology.


title: Leveraging AI to Advance Science and Computing Education across Africa: Challenges, Progress and Opportunities

abstract: Across the African continent, students grapple with various educational challenges, including limited access to essential resources such as computers, internet connectivity, reliable electricity, and a shortage of qualified teachers. Despite these challenges, recent advances in AI such as BERT, and GPT-4 have demonstrated their potential for advancing education. Yet, these AI tools tend to be deployed and evaluated predominantly within the context of Western educational settings, with limited attention directed towards the unique needs and challenges faced by students in Africa. In this chapter, we discuss challenges with using AI to advance education across Africa. Then, we describe our work developing and deploying AI in Education tools in Africa for science and computing education: (1) SuaCode, an AI-powered app that enables Africans to learn to code using their smartphones, (2) AutoGrad, an automated grading, and feedback tool for graphical and interactive coding assignments, (3) a tool for code plagiarism detection that shows visual evidence of plagiarism, (4) Kwame, a bilingual AI teaching assistant for coding courses, (5) Kwame for Science, a web-based AI teaching assistant that provides instant answers to students' science questions and (6) Brilla AI, an AI contestant for the National Science and Maths Quiz competition. Finally, we discuss potential opportunities to leverage AI to advance education across Africa.


title: VisLingInstruct: Elevating Zero-Shot Learning in Multi-Modal Language Models with Autonomous Instruction Optimization

abstract: This paper presents VisLingInstruct, a novel approach to advancing Multi-Modal Language Models (MMLMs) in zero-shot learning. Current MMLMs show impressive zero-shot abilities in multi-modal tasks, but their performance depends heavily on the quality of instructions. VisLingInstruct tackles this by autonomously evaluating and optimizing instructional texts through In-Context Learning, improving the synergy between visual perception and linguistic expression in MMLMs. Alongside this instructional advancement, we have also optimized the visual feature extraction modules in MMLMs, further augmenting their responsiveness to textual content. Our comprehensive experiments on MMLMs, based on FlanT5 and Vicuna, show that VisLingInstruct significantly improves zero-shot performance in visual multi-modal tasks. Notably, it achieves a 13.1% and 9% increase in accuracy over the prior state-of-the-art on the TextVQA and HatefulMemes datasets. Our main code is available at https://github.com/Zhudongsheng75/VisLingInstruct.


title: On beat-driven and spontaneous excitations of zonal flows by drift waves

abstract: Using the slab plasma as a paradigm model, we have derived analytically equations for the nonlinear generation of zero-frequency zonal flows by electron drift waves including, on the same footing, both the beat-driven and spontaneous excitations. It is found that the beat-driven zonal flow tends to reduce the frequency mismatch between the electron drift waves and, thereby, contributes to a significant O(1) enhancement of the modulational instability drive and lowering its threshold. Implications to tokamaks plasmas as well as drift-wave soliton formation are also discussed.


title: The ALMaQUEST Survey XIII: Understanding radial trends in star formation quenching via the relative roles of gas availability and star formation efficiency

abstract: Star formation quenching is one of the key processes that shape the evolution of galaxies. In this study, we investigate the changes in molecular gas and star formation properties as galaxies transit from the star-forming main sequence to the passive regime. Our analysis reveals that as galaxies move away from the main sequence towards the green valley the radial profile of specific star formation rate surface density ($\Sigma_\mathrm{sSFR}$) is suppressed compared with main sequence galaxies out to a galactocentric radius of 1.5 $R_{e}$ ($\sim$ 7 kpc for our sample). By combining radial profiles of gas fraction ($f_\mathrm{gas}$) and star formation efficiency (SFE), we can discern the underlying mechanism that determines $\Sigma_\mathrm{sSFR}$ at different galactocentric radii. Analysis of relative contributions of $f_\mathrm{gas}$ and SFE to $\Sigma_\mathrm{sSFR}$ uncovers a diverse range of quenching modes. Star formation in approximately half of our quenching galaxies is primarily driven by a single mode (i.e. either $f_\mathrm{gas}$ or SFE), or a combination of both. A collective analysis of all galaxies reveals that the reduction in star formation within the central regions ($R$ $<$ 0.5 $R_{e}$) is primarily attributable to a decrease in SFE. Conversely, in the disk regions ($R$ $>$ 0.5 $R_{e}$), both $f_\mathrm{gas}$ and SFE contribute to the suppression of star formation. Our findings suggest that multiple quenching mechanisms may be at play in our sample galaxies, and even within a single galaxy. We also compare our observational outcomes with those from galaxy simulations and discuss the implications of our data.


title: Can LLMs Produce Faithful Explanations For Fact-checking? Towards Faithful Explainable Fact-Checking via Multi-Agent Debate

abstract: Fact-checking research has extensively explored verification but less so the generation of natural-language explanations, crucial for user trust. While Large Language Models (LLMs) excel in text generation, their capability for producing faithful explanations in fact-checking remains underexamined. Our study investigates LLMs' ability to generate such explanations, finding that zero-shot prompts often result in unfaithfulness. To address these challenges, we propose the Multi-Agent Debate Refinement (MADR) framework, leveraging multiple LLMs as agents with diverse roles in an iterative refining process aimed at enhancing faithfulness in generated explanations. MADR ensures that the final explanation undergoes rigorous validation, significantly reducing the likelihood of unfaithful elements and aligning closely with the provided evidence. Experimental results demonstrate that MADR significantly improves the faithfulness of LLM-generated explanations to the evidence, advancing the credibility and trustworthiness of these explanations.


title: BDIQA: A New Dataset for Video Question Answering to Explore Cognitive Reasoning through Theory of Mind

abstract: As a foundational component of cognitive intelligence, theory of mind (ToM) can make AI more closely resemble human thought processes, thereby enhancing their interaction and collaboration with human. In particular, it can significantly improve a model's comprehension of videos in complex scenes. However, current video question answer (VideoQA) datasets focus on studying causal reasoning within events few of them genuinely incorporating human ToM. Consequently, there is a lack of development in ToM reasoning tasks within the area of VideoQA. This paper presents BDIQA, the first benchmark to explore the cognitive reasoning capabilities of VideoQA models in the context of ToM. BDIQA is inspired by the cognitive development of children's ToM and addresses the current deficiencies in machine ToM within datasets and tasks. Specifically, it offers tasks at two difficulty levels, assessing Belief, Desire and Intention (BDI) reasoning in both simple and complex scenarios. We conduct evaluations on several mainstream methods of VideoQA and diagnose their capabilities with zero shot, few shot and supervised learning. We find that the performance of pre-trained models on cognitive reasoning tasks remains unsatisfactory. To counter this challenge, we undertake thorough analysis and experimentation, ultimately presenting two guidelines to enhance cognitive reasoning derived from ablation analysis.


title: Make it more specific: A novel uncertainty based airway segmentation application on 3D U-Net and its variants

abstract: Each medical segmentation task should be considered with a specific AI algorithm based on its scenario so that the most accurate prediction model can be obtained. The most popular algorithms in medical segmentation, 3D U-Net and its variants, can directly implement the task of lung trachea segmentation, but its failure to consider the special tree-like structure of the trachea suggests that there is much room for improvement in its segmentation accuracy. Therefore, a research gap exists because a great amount of state-of-the-art DL algorithms are vanilla 3D U-Net structures, which do not introduce the various performance-enhancing modules that come with special natural image modality in lung airway segmentation. In this paper, we proposed two different network structures Branch-Level U-Net (B-UNet) and Branch-Level CE-UNet (B-CE-UNet) which are based on U-Net structure and compared the prediction results with the same dataset. Specially, both of the two networks add branch loss and central line loss to learn the feature of fine branch endings of the airways. Uncertainty estimation algorithms are also included to attain confident predictions and thereby, increase the overall trustworthiness of our whole model. In addition, predictions of the lung trachea based on the maximum connectivity rate were calculated and extracted during post-processing for segmentation refinement and pruning.


title: Enhancing Multi-Criteria Decision Analysis with AI: Integrating Analytic Hierarchy Process and GPT-4 for Automated Decision Support

abstract: Our study presents a new framework that incorporates the Analytic Hierarchy Process (AHP) and Generative Pre-trained Transformer 4 (GPT-4) large language model (LLM), bringing novel approaches to cybersecurity Multiple-criteria Decision Making (MCDA). By utilizing the capabilities of GPT-4 autonomous agents as virtual experts, we automate the decision-making process, enhancing both efficiency and reliability. This new approach focuses on leveraging LLMs for sophisticated decision analysis, highlighting the synergy between traditional decision-making models and cutting-edge AI technologies. Our innovative methodology demonstrates significant advancements in using AI-driven agents for complex decision-making scenarios, highlighting the importance of AI in strategic cybersecurity applications. The findings reveal the transformative potential of combining AHP and LLMs, establishing a new paradigm for intelligent decision support systems in cybersecurity and beyond.


title: D\'olares or Dollars? Unraveling the Bilingual Prowess of Financial LLMs Between Spanish and English

abstract: Despite Spanish's pivotal role in the global finance industry, a pronounced gap exists in Spanish financial natural language processing (NLP) and application studies compared to English, especially in the era of large language models (LLMs). To bridge this gap, we unveil Tois\'on de Oro, the first bilingual framework that establishes instruction datasets, finetuned LLMs, and evaluation benchmark for financial LLMs in Spanish joint with English. We construct a rigorously curated bilingual instruction dataset including over 144K Spanish and English samples from 15 datasets covering 7 tasks. Harnessing this, we introduce FinMA-ES, an LLM designed for bilingual financial applications. We evaluate our model and existing LLMs using FLARE-ES, the first comprehensive bilingual evaluation benchmark with 21 datasets covering 9 tasks. The FLARE-ES benchmark results reveal a significant multilingual performance gap and bias in existing LLMs. FinMA-ES models surpass SOTA LLMs such as GPT-4 in Spanish financial tasks, due to strategic instruction tuning and leveraging data from diverse linguistic resources, highlighting the positive impact of cross-linguistic transfer. All our datasets, models, and benchmarks have been released.


title: Asymptotic Equivalency of Two Different Approaches of L-statistics

abstract: There are several ways to establish the asymptotic normality of $L$-statistics, depending upon the selection of the weights generating function and the cumulative distribution function of the underlying model. Here, in this paper it is shown that the two of the asymptotic approaches are equivalent/equal for a particular choice of the weights generating function.


title: Conformal Predictive Programming for Chance Constrained Optimization

abstract: Motivated by the advances in conformal prediction (CP), we propose conformal predictive programming (CPP), an approach to solve chance constrained optimization (CCO) problems, i.e., optimization problems with nonlinear constraint functions affected by arbitrary random parameters. CPP utilizes samples from these random parameters along with the quantile lemma -- which is central to CP -- to transform the CCO problem into a deterministic optimization problem. We then present two tractable reformulations of CPP by: (1) writing the quantile as a linear program along with its KKT conditions (CPP-KKT), and (2) using mixed integer programming (CPP-MIP). CPP comes with marginal probabilistic feasibility guarantees for the CCO problem that are conceptually different from existing approaches, e.g., the sample approximation and the scenario approach. While we explore algorithmic similarities with the sample approximation approach, we emphasize that the strength of CPP is that it can easily be extended to incorporate different variants of CP. To illustrate this, we present robust conformal predictive programming to deal with distribution shifts in the uncertain parameters of the CCO problem.


title: Large Language Models are Few-shot Generators: Proposing Hybrid Prompt Algorithm To Generate Webshell Escape Samples

abstract: The frequent occurrence of cyber-attacks has made webshell attacks and defense gradually become a research hotspot in the field of network security. However, the lack of publicly available benchmark datasets and the over-reliance on manually defined rules for webshell escape sample generation have slowed down the progress of research related to webshell escape sample generation and artificial intelligence (AI)-based webshell detection. To address the drawbacks of weak webshell sample escape capabilities, the lack of webshell datasets with complex malicious features, and to promote the development of webshell detection, we propose the Hybrid Prompt algorithm for webshell escape sample generation with the help of large language models. As a prompt algorithm specifically developed for webshell sample generation, the Hybrid Prompt algorithm not only combines various prompt ideas including Chain of Thought, Tree of Thought, but also incorporates various components such as webshell hierarchical module and few-shot example to facilitate the LLM in learning and reasoning webshell escape strategies. Experimental results show that the Hybrid Prompt algorithm can work with multiple LLMs with excellent code reasoning ability to generate high-quality webshell samples with high Escape Rate (88.61% with GPT-4 model on VirusTotal detection engine) and (Survival Rate 54.98% with GPT-4 model).


title: Splitting Quantum Graphs

abstract: We derive a counting formula for the eigenvalues of Schr\"odinger operators with self-adjoint boundary conditions on quantum star graphs. More specifically, we develop techniques using Evans functions to reduce full quantum graph eigenvalue problems into smaller subgraph eigenvalue problems. These methods provide a simple way to calculate the spectra of operators with localized potentials.


title: A Closer Look at the Robustness of Contrastive Language-Image Pre-Training (CLIP)

abstract: Contrastive Language-Image Pre-training (CLIP) models have demonstrated remarkable generalization capabilities across multiple challenging distribution shifts. However, there is still much to be explored in terms of their robustness to the variations of specific visual factors. In real-world applications, reliable and safe systems must consider other safety objectives beyond classification accuracy, such as predictive uncertainty. Yet, the effectiveness of CLIP models on such safety-related features is less-explored. Driven by the above, this work comprehensively investigates the safety objectives of CLIP models, specifically focusing on three key properties: resilience to visual factor variations, calibrated uncertainty estimations, and the ability to detect anomalous inputs. To this end, we study 83 CLIP models and 127 ImageNet classifiers. They are diverse in architecture, (pre)training distribution and training strategies. We consider 10 visual factors (e.g., shape and pattern), 5 types of out-of-distribution data, and 8 natural and challenging test conditions with different shift types, such as texture, style, and perturbation shifts. Our study has unveiled several previously unknown insights into CLIP models. For instance, they are not consistently more calibrated than other ImageNet models, which contradicts existing findings. Additionally, our analysis underscores the significance of training source design by showcasing its profound influence on the three safety-related properties. We believe our comprehensive study can shed light on and help guide the development of more robust and reliable CLIP models.


title: Potential-Based Reward Shaping For Intrinsic Motivation

abstract: Recently there has been a proliferation of intrinsic motivation (IM) reward-shaping methods to learn in complex and sparse-reward environments. These methods can often inadvertently change the set of optimal policies in an environment, leading to suboptimal behavior. Previous work on mitigating the risks of reward shaping, particularly through potential-based reward shaping (PBRS), has not been applicable to many IM methods, as they are often complex, trainable functions themselves, and therefore dependent on a wider set of variables than the traditional reward functions that PBRS was developed for. We present an extension to PBRS that we prove preserves the set of optimal policies under a more general set of functions than has been previously proven. We also present {\em Potential-Based Intrinsic Motivation} (PBIM), a method for converting IM rewards into a potential-based form that is useable without altering the set of optimal policies. Testing in the MiniGrid DoorKey and Cliff Walking environments, we demonstrate that PBIM successfully prevents the agent from converging to a suboptimal policy and can speed up training.


title: Auxiliary Reward Generation with Transition Distance Representation Learning

abstract: Reinforcement learning (RL) has shown its strength in challenging sequential decision-making problems. The reward function in RL is crucial to the learning performance, as it serves as a measure of the task completion degree. In real-world problems, the rewards are predominantly human-designed, which requires laborious tuning, and is easily affected by human cognitive biases. To achieve automatic auxiliary reward generation, we propose a novel representation learning approach that can measure the ``transition distance'' between states. Building upon these representations, we introduce an auxiliary reward generation technique for both single-task and skill-chaining scenarios without the need for human knowledge. The proposed approach is evaluated in a wide range of manipulation tasks. The experiment results demonstrate the effectiveness of measuring the transition distance between states and the induced improvement by auxiliary rewards, which not only promotes better learning efficiency but also increases convergent stability.


title: Spectral transform for the Ising model

abstract: We prove a correspondence between Ising models in a torus and the algebro-geometric data of a Harnack curve with a certain symmetry and a point in the real part of its Prym variety, extending the correspondence between dimer models and Harnack curves and their Jacobians due to Kenyon and Okounkov.


title: Epsilon near zero metal oxide based spectrally selective reflectors

abstract: Epsilon near zero (ENZ) materials can contribute significantly to the advancement of spectrally selective coatings aimed at enhancing efficient use of solar radiation and thermal energy management. Here, we demonstrate a subwavelength thick, multilayer optical coating that imparts a spectrally "step function" like reflectivity onto diverse surfaces, from stainless steel to glass, employing indium tin oxide as the key ENZ material. The coating, harnessing the ENZ and plasmonic properties of nominally nanostructured ITO along with ultrathin layers of Cr and Cr2O3 show 15% reflectivity over the visible to near-infrared and 80% reflectivity (and low emissivity) beyond a cut-in wavelength around 1500 nm, which is tunable in the infrared. A combination of simulations and experimental results are used to optimize the coating architecture and gain insights into the relevance of the components. The straightforward design with high thermal stability will find applications requiring passive cooling.


title: Context-aware Multi-Model Object Detection for Diversely Heterogeneous Compute Systems

abstract: In recent years, deep neural networks (DNNs) have gained widespread adoption for continuous mobile object detection (OD) tasks, particularly in autonomous systems. However, a prevalent issue in their deployment is the one-size-fits-all approach, where a single DNN is used, resulting in inefficient utilization of computational resources. This inefficiency is particularly detrimental in energy-constrained systems, as it degrades overall system efficiency. We identify that, the contextual information embedded in the input data stream (e.g. the frames in the camera feed that the OD models are run on) could be exploited to allow a more efficient multi-model-based OD process. In this paper, we propose SHIFT which continuously selects from a variety of DNN-based OD models depending on the dynamically changing contextual information and computational constraints. During this selection, SHIFT uniquely considers multi-accelerator execution to better optimize the energy-efficiency while satisfying the latency constraints. Our proposed methodology results in improvements of up to 7.5x in energy usage and 2.8x in latency compared to state-of-the-art GPU-based single model OD approaches.


title: Reply to "Comment" on "Regular evaporating black holes with stable cores"

abstract: We reply to the ``Comment'' on ``Regular evaporating black holes with stable cores'' by R. Carballo-Rubio, F. Di Filippo, S. Liberati, C. Pacilio, and M. Visser. As a key result, we show that the regime of mass-inflation identified in the comment connects smoothly to the late-time attractors discovered in our works [A. Bonanno et. al., Regular black holes with stable cores, Phys. Rev. D 103, 124027 (2021) and Regular evaporating black holes with stable cores, Phys. Rev. D 107, 024005 (2023)]. Hence, the late-time stability of regular black holes is not affected by this intermediate phase.


title: An Empirical Study Into What Matters for Calibrating Vision-Language Models

abstract: Vision-Language Models (VLMs) have emerged as the dominant approach for zero-shot recognition, adept at handling diverse scenarios and significant distribution changes. However, their deployment in risk-sensitive areas requires a deeper understanding of their uncertainty estimation capabilities, a relatively uncharted area. In this study, we explore the calibration properties of VLMs across different architectures, datasets, and training strategies. In particular, we analyze the uncertainty estimation performance of VLMs when calibrated in one domain, label set or hierarchy level, and tested in a different one. Our findings reveal that while VLMs are not inherently calibrated for uncertainty, temperature scaling significantly and consistently improves calibration, even across shifts in distribution and changes in label set. Moreover, VLMs can be calibrated with a very small set of examples. Through detailed experimentation, we highlight the potential applications and importance of our insights, aiming for more reliable and effective use of VLMs in critical, real-world scenarios.


title: SemTra: A Semantic Skill Translator for Cross-Domain Zero-Shot Policy Adaptation

abstract: This work explores the zero-shot adaptation capability of semantic skills, semantically interpretable experts' behavior patterns, in cross-domain settings, where a user input in interleaved multi-modal snippets can prompt a new long-horizon task for different domains. In these cross-domain settings, we present a semantic skill translator framework SemTra which utilizes a set of multi-modal models to extract skills from the snippets, and leverages the reasoning capabilities of a pretrained language model to adapt these extracted skills to the target domain. The framework employs a two-level hierarchy for adaptation: task adaptation and skill adaptation. During task adaptation, seq-to-seq translation by the language model transforms the extracted skills into a semantic skill sequence, which is tailored to fit the cross-domain contexts. Skill adaptation focuses on optimizing each semantic skill for the target domain context, through parametric instantiations that are facilitated by language prompting and contrastive learning-based context inferences. This hierarchical adaptation empowers the framework to not only infer a complex task specification in one-shot from the interleaved multi-modal snippets, but also adapt it to new domains with zero-shot learning abilities. We evaluate our framework with Meta-World, Franka Kitchen, RLBench, and CARLA environments. The results clarify the framework's superiority in performing long-horizon tasks and adapting to different domains, showing its broad applicability in practical use cases, such as cognitive robots interpreting abstract instructions and autonomous vehicles operating under varied configurations.


title: Conditional Generative Models are Sufficient to Sample from Any Causal Effect Estimand

abstract: Causal inference from observational data has recently found many applications in machine learning. While sound and complete algorithms exist to compute causal effects, many of these algorithms require explicit access to conditional likelihoods over the observational distribution, which is difficult to estimate in the high-dimensional regime, such as with images. To alleviate this issue, researchers have approached the problem by simulating causal relations with neural models and obtained impressive results. However, none of these existing approaches can be applied to generic scenarios such as causal graphs on image data with latent confounders, or obtain conditional interventional samples. In this paper, we show that any identifiable causal effect given an arbitrary causal graph can be computed through push-forward computations of conditional generative models. Based on this result, we devise a diffusion-based approach to sample from any (conditional) interventional distribution on image data. To showcase our algorithm's performance, we conduct experiments on a Colored MNIST dataset having both the treatment ($X$) and the target variables ($Y$) as images and obtain interventional samples from $P(y|do(x))$. As an application of our algorithm, we evaluate two large conditional generative models that are pre-trained on the CelebA dataset by analyzing the strength of spurious correlations and the level of disentanglement they achieve.


title: On the Transit Obfuscation Problem

abstract: Concealing an intermediate point on a route or visible from a route is an important goal in some transportation and surveillance scenarios. This paper studies the Transit Obfuscation Problem, the problem of traveling from some start location to an end location while "covering" a specific transit point that needs to be concealed from adversaries. We propose the notion of transit anonymity, a quantitative guarantee of the anonymity of a specific transit point, even with a powerful adversary with full knowledge of the path planning algorithm. We propose and evaluate planning/search algorithms that satisfy this anonymity criterion.


title: Origin of the Near-Surface Shear Layer of Solar Rotation

abstract: Helioseismology has revealed an increase in the rotation rate with depth in a thin ($\sim$30 Mm) near-surface layer. The normalized rotational shear in this layer is independent of latitude. This rotational state is shown to be a consequence of the short characteristic time of near-surface convection compared to the rotation period, and the radial anisotropy of the convective turbulence. Analytical derivations within mean-field hydrodynamics reproduce the observed normalized rotational shear and are in agreement with numerical experiments on the radiative hydrodynamics of solar convection. The near-surface shear layer is the source of the global meridional flow important for the solar dynamo.


abstract: This paper explores the area of news recommendation, a key component of online information sharing. Initially, we provide a clear introduction to news recommendation, defining the core problem and summarizing current methods and notable recent algorithms. We then present our work on implementing the NRAM (News Recommendation with Attention Mechanism), an attention-based approach for news recommendation, and assess its effectiveness. Our evaluation shows that NRAM has the potential to significantly improve how news content is personalized for users on digital news platforms.


title: Ext branching laws for the general linear group

abstract: Let $F$ be a non-archimedean local field. Let $\pi_1$ and $\pi_2$ be irreducible Arthur type representations of $\mathrm{GL}_n(F)$ and $\mathrm{GL}_{n-1}(F)$ respectively. We study Ext branching laws when $\pi_1$ and $\pi_2$ are products of discrete series representations and their Aubert-Zelevinsky duals. We obtain an Ext analogue of the local non-tempered Gan-Gross-Prasad conjecture in this case.


title: Special values of Grothendieck polynomials in terms of hypergeometric functions

abstract: We give some special values of Grothendieck polynomials and an explicit formula for the number of set-valued tableaux. For Young diagrams consisting of a single row or a single column, both the value and number are written by the Gauss' hypergeometric function ${}_2F_1$. For general Young diagrams, the Holman hypergeometric function $F^{(n)}$ is used to represent both the value and count. As an application, we derive a summation formula for $F^{(n)}$.


title: Debiasing Recommendation with Personal Popularity

abstract: Global popularity (GP) bias is the phenomenon that popular items are recommended much more frequently than they should be, which goes against the goal of providing personalized recommendations and harms user experience and recommendation accuracy. Many methods have been proposed to reduce GP bias but they fail to notice the fundamental problem of GP, i.e., it considers popularity from a \textit{global} perspective of \textit{all users} and uses a single set of popular items, and thus cannot capture the interests of individual users. As such, we propose a user-aware version of item popularity named \textit{personal popularity} (PP), which identifies different popular items for each user by considering the users that share similar interests. As PP models the preferences of individual users, it naturally helps to produce personalized recommendations and mitigate GP bias. To integrate PP into recommendation, we design a general \textit{personal popularity aware counterfactual} (PPAC) framework, which adapts easily to existing recommendation models. In particular, PPAC recognizes that PP and GP have both direct and indirect effects on recommendations and controls direct effects with counterfactual inference techniques for unbiased recommendations. All codes and datasets are available at \url{https://github.com/Stevenn9981/PPAC}.


title: Computational Aspects of Bayesian Persuasion under Approximate Best Response

abstract: We study Bayesian persuasion under approximate best response, where the receiver may choose any action that is not too much suboptimal given their posterior belief upon receiving the signal. We focus on the computational aspects of the problem, aiming to design algorithms that efficiently compute (almost) optimal strategies for the sender. Despite the absence of the revelation principle -- which has been one of the most powerful tools in Bayesian persuasion -- we design polynomial-time exact algorithms for the problem when either the state space or the action space is small, as well as a quasi-polynomial-time approximation scheme (QPTAS) for the general problem. On the negative side, we show there is no polynomial-time exact algorithm for the general problem unless $\mathsf{P} = \mathsf{NP}$. Our results build on several new algorithmic ideas, which might be useful in other principal-agent problems where robustness is desired.


title: Insights into Spatio-temporal dynamics during shock -- droplet flame interaction

abstract: The study comprehensively investigates the response of a combusting droplet during its interaction with a high-speed transient flow that is imposed by a coaxially propagating blast wave. The blast wave is generated using a specially designed unique miniature shock generation apparatus that generates blast waves using the wire-explosion technique which facilitates a wide range of shock Mach number (1.03 < Ms < 1.8). The experiments are performed in two configurations: Open field blast wave and focused blast wave. The charging voltage and the configuration determine the shock Mach number (Ms) and flow characteristics. The flame is found to exhibit two major response patterns: partial extinction followed by re-ignition and full extinction. Simultaneously, the droplet also interacts with the flow imposed by the blast wave exhibiting different modes of response ranging from pure deformation, Rayleigh-Taylor piercing bag breakup, and shear-induced stripping. The KH instability is exhibited along the windward side interface of the droplet during the interaction with the blast wave decay profile which gets aggravated when the induced flow interaction ensues. Increasing the Mach number (Ms > 1.1) makes the droplet flame more vulnerable to extinction. However, the flame exhibits stretching and shedding, followed by re-ignition at lower Mach numbers (Ms < 1.06). In all cases, the flame base lifts off in response to the imposed flow, and the advection of the flame base interacting with the flame tip results in flame extinction. The entire interaction occurs in two stages: 1) interaction with the blast wave and the decaying velocity profile associated with it, and 2) interaction with the induced flow behind the blast wave as a result of the entrainment (delayed response). The criteria for partial and complete extinction of flame have been postulated which is in good agreement with the experiments.


title: Netload Range Cost Curves for a Transmission-Aware Distribution System Planning under DER Growth Uncertainty

abstract: In the face of a substantial and uncertain growth of behind-the-meter Distributed Energy Resources (DERs), utilities and regulators are currently in the search for new network planning strategies for facilitating an efficient Transmission & Distribution (T&D) coordination. In this context, here we propose a novel distribution system planning methodology to facilitate coordinated planning exercises with transmission system planners through the management of long-term DER growth uncertainty and its impact on the substation netload. The proposed approach is based on the design of a transmission-aware distribution planning model embedding DER growth uncertainty, which is used to determine a "menu" of secure distribution network upgrade options with different associated costs and peak netload guarantees observed from the transmission-side, referred here as Netload Range Cost Curves (NRCCs). NRCCs can provide a practical approach for coordinating T&D planning exercises, as these curves can be integrated into existing transmission planning workflows, and specify a direct incentive for distribution planners to evaluate peak netload reduction alternatives in their planning process. We perform computational experiments based on a realistic distribution network that demonstrate the benefits and applicability of our proposed planning approach.


title: Particle Filter SLAM for Vehicle Localization

abstract: Simultaneous Localization and Mapping (SLAM) presents a formidable challenge in robotics, involving the dynamic construction of a map while concurrently determining the precise location of the robotic agent within an unfamiliar environment. This intricate task is further compounded by the inherent "chicken-and-egg" dilemma, where accurate mapping relies on a dependable estimation of the robot's location, and vice versa. Moreover, the computational intensity of SLAM adds an additional layer of complexity, making it a crucial yet demanding topic in the field. In our research, we address the challenges of SLAM by adopting the Particle Filter SLAM method. Our approach leverages encoded data and fiber optic gyro (FOG) information to enable precise estimation of vehicle motion, while lidar technology contributes to environmental perception by providing detailed insights into surrounding obstacles. The integration of these data streams culminates in the establishment of a Particle Filter SLAM framework, representing a key endeavor in this paper to effectively navigate and overcome the complexities associated with simultaneous localization and mapping in robotic systems.


title: Advecting Scaffolds: Controlling The Remodelling Of Actomyosin With Anillin

abstract: We propose and analyse an active hydrodynamic theory that characterises the effects of the scaffold protein anillin. Anillin is found at major sites of cortical activity, such as adherens junctions and the cytokinetic furrow, where the canonical regulator of actomyosin remodelling is the small GTPase, RhoA. RhoA acts via intermediary 'effectors' to increase both the rates of activation of myosin motors and the polymerisation of actin filaments. Anillin has been shown to scaffold this action of RhoA - improving critical rates in the signalling pathway without altering the essential biochemistry - but its contribution to the wider spatio-temporal organisation of the cortical cytoskeleton remains poorly understood. Here, we combine analytics and numerics to show how anillin can non-trivially regulate the cytoskeleton at hydrodynamic scales. At short times, anillin can amplify or dampen existing contractile instabilities, as well as alter the parameter ranges over which they occur. At long times, it can change both the size and speed of steady-state travelling pulses. The primary mechanism that underpins these behaviours is established to be the advection of anillin by myosin II motors, with the specifics relying on the values of two coupling parameters. These codify anillin's effect on local signalling kinetics and can be traced back to its interaction with the acidic phospholipid phosphatidylinositol 4,5-bisphosphate (PIP2), thereby establishing a putative connection between actomyosin remodelling and membrane composition.


title: SALAD: Smart AI Language Assistant Daily

abstract: SALAD is an AI-driven language-learning application designed to help foreigners learn Japanese. It offers translations in Kanji-Kana-Romaji, speech recognition, translated audio, vocabulary tracking, grammar explanations, and songs generated from newly learned words. The app targets beginners and intermediate learners, aiming to make language acquisition more accessible and enjoyable. SALAD uses daily translations to enhance fluency and comfort in communication with native speakers. The primary objectives include effective Japanese language learning, user engagement, and progress tracking. A survey by us found that 39% of foreigners in Japan face discomfort in conversations with Japanese speakers. Over 60% of foreigners expressed confidence in SALAD's ability to enhance their Japanese language skills. The app uses large language models, speech recognition, and diffusion models to bridge the language gap and foster a more inclusive community in Japan.


title: Intrinsic Task-based Evaluation for Referring Expression Generation

abstract: Recently, a human evaluation study of Referring Expression Generation (REG) models had an unexpected conclusion: on \textsc{webnlg}, Referring Expressions (REs) generated by the state-of-the-art neural models were not only indistinguishable from the REs in \textsc{webnlg} but also from the REs generated by a simple rule-based system. Here, we argue that this limitation could stem from the use of a purely ratings-based human evaluation (which is a common practice in Natural Language Generation). To investigate these issues, we propose an intrinsic task-based evaluation for REG models, in which, in addition to rating the quality of REs, participants were asked to accomplish two meta-level tasks. One of these tasks concerns the referential success of each RE; the other task asks participants to suggest a better alternative for each RE. The outcomes suggest that, in comparison to previous evaluations, the new evaluation protocol assesses the performance of each REG model more comprehensively and makes the participants' ratings more reliable and discriminable.


title: Logical Synchrony Networks: A formal model for deterministic distribution

abstract: Kahn Process Networks (KPNs) are a deterministic Model of Computation (MoC) for distributed systems. KPNs supports non-blocking writes and blocking reads, with the consequent assumption of unbounded buffers between processes. Variants such as Finite FIFO Platforms (FFP) have been developed, which enforce boundedness. One issue with existing models is that they mix process synchronisation with process execution. In this paper we address how these two facets may be decoupled. This paper explores a recent alternative called bittide, which decouples the execution of a process from the control needed for process synchronisation, and thus preserves determinism and boundedness while ensuring pipelined execution for better throughput. Our intuition is that such an approach could leverage not only determinism and buffer boundedness but may potentially offer better overall throughput. To understand the behavior of these systems we define a formal model -- a deterministic MoC called Logical Synchrony Networks (LSNs). LSNs describes a network of processes modelled as a graph, with edges representing invariant logical delays between a producer process and the corresponding consumer process. We show that this abstraction is satisfied by KPNs. Subsequently, we show that both FFPs and bittide faithfully implement this abstraction. Thus, we show for the first time that FFPs and bittide offer two alternative ways of implementing deterministic distributed systems with the latter being more performant.


title: Parameterizations for Gradient-based Markov Chain Monte Carlo on the Stiefel Manifold: A Comparative Study

abstract: Orthogonal matrices play an important role in probability and statistics, particularly in high-dimensional statistical models. Parameterizing these models using orthogonal matrices facilitates dimension reduction and parameter identification. However, establishing the theoretical validity of statistical inference in these models from a frequentist perspective is challenging, leading to a preference for Bayesian approaches because of their ability to offer consistent uncertainty quantification. Markov chain Monte Carlo methods are commonly used for numerical approximation of posterior distributions, and sampling on the Stiefel manifold, which comprises orthogonal matrices, poses significant difficulties. While various strategies have been proposed for this purpose, gradient-based Markov chain Monte Carlo with parameterizations is the most efficient. However, a comprehensive comparison of these parameterizations is lacking in the existing literature. This study aims to address this gap by evaluating numerical efficiency of the four alternative parameterizations of orthogonal matrices under equivalent conditions. The evaluation was conducted for four problems. The results suggest that polar expansion parameterization is the most efficient, particularly for the high-dimensional and complex problems. However, all parameterizations exhibit limitations in significantly high-dimensional or difficult tasks, emphasizing the need for further advancements in sampling methods for orthogonal matrices.


title: Analyzing Currency Fluctuations: A Comparative Study of GARCH, EWMA, and IV Models for GBP/USD and EUR/GBP Pairs

abstract: In this study, we examine the fluctuation in the value of the Great Britain Pound (GBP). We focus particularly on its relationship with the United States Dollar (USD) and the Euro (EUR) currency pairs. Utilizing data from June 15, 2018, to June 15, 2023, we apply various mathematical models to assess their effectiveness in predicting the 20-day variation in the pairs' daily returns. Our analysis involves the implementation of Exponentially Weighted Moving Average (EWMA), Generalized Autoregressive Conditional Heteroskedasticity (GARCH) models, and Implied Volatility (IV) models. To evaluate their performance, we compare the accuracy of their predictions using Root Mean Square Error (RMSE) and Mean Absolute Error (MAE) metrics. We delve into the intricacies of GARCH models, examining their statistical characteristics when applied to the provided dataset. Our findings suggest the existence of asymmetric returns in the EUR/GBP pair, while such evidence is inconclusive for the GBP/USD pair. Additionally, we observe that GARCH-type models better fit the data when assuming residuals follow a standard t-distribution rather than a standard normal distribution. Furthermore, we investigate the efficacy of different forecasting techniques within GARCH-type models. Comparing rolling window forecasts to expanding window forecasts, we find no definitive superiority in either approach across the tested scenarios. Our experiments reveal that for the GBP/USD pair, the most accurate volatility forecasts stem from the utilization of GARCH models employing a rolling window methodology. Conversely, for the EUR/GBP pair, optimal forecasts are derived from GARCH models and Ordinary Least Squares (OLS) models incorporating the annualized implied volatility of the exchange rate as an independent variable.


title: Novel definition and quantitative analysis of branch structure with topological data analysis

abstract: While branching network structures abound in nature, their objective analysis is more difficult than expected because existing quantitative methods often rely on the subjective judgment of branch structures. This problem is particularly pronounced when dealing with images comprising discrete particles. Here we propose an objective framework for quantitative analysis of branching networks by introducing the mathematical definitions for internal and external structures based on topological data analysis, specifically, persistent homology. We compare persistence diagrams constructed from images with and without plots on the convex hull. The unchanged points in the two diagrams are the internal structures and the difference between the two diagrams is the external structures. We construct a mathematical theory for our method and show that the internal structures have a monotonicity relationship with respect to the plots on the convex hull, while the external structures do not. This is the phenomenon related to the resolution of the image. Our method can be applied to a wide range of branch structures in biology, enabling objective analysis of numbers, spatial distributions, sizes, and more. Additionally, our method has the potential to be combined with other tools in topological data analysis, such as the generalized persistence landscape.


title: Learning Optimal Tax Design in Nonatomic Congestion Games

abstract: We study how to learn the optimal tax design to maximize the efficiency in nonatomic congestion games. It is known that self-interested behavior among the players can damage the system's efficiency. Tax mechanisms is a common method to alleviate this issue and induce socially optimal behavior. In this work, we take the initial step for learning the optimal tax that can minimize the social cost with \emph{equilibrium feedback}, i.e., the tax designer can only observe the equilibrium state under the enforced tax. Existing algorithms are not applicable due to the exponentially large tax function space, nonexistence of the gradient, and nonconvexity of the objective. To tackle these challenges, our algorithm leverages several novel components: (1) piece-wise linear tax to approximate the optimal tax; (2) an extra linear term to guarantee a strongly convex potential function; (3) efficient subroutine to find the ``boundary'' tax. The algorithm can find an $\epsilon$-optimal tax with $O(\beta F^2/\epsilon)$ sample complexity, where $\beta$ is the smoothness of the cost function and $F$ is the number of facilities.


title: The Powell Conjecture for the genus-three Heegaard splitting of the $3$-sphere

abstract: The Powell Conjecture states that four specific elements suffice to generate the Goeritz group of the Heegaard splitting of the $3$-sphere. We present an alternative proof of the Powell Conjecture when the genus of the splitting is $3$, and suggest a strategy for the case of higher genera.


title: Joint estimation of the predictive ability of experts using a multi-output Gaussian process

abstract: A multi-output Gaussian process (GP) is introduced as a model for the joint posterior distribution of the local predictive ability of set of models and/or experts, conditional on a vector of covariates, from historical predictions in the form of log predictive scores. Following a power transformation of the log scores, a GP with Gaussian noise can be used, which allows faster computation by first using Hamiltonian Monte Carlo to sample the hyper-parameters of the GP from a model where the latent GP surface has been marginalized out, and then using these draws to generate draws of joint predictive ability conditional on a new vector of covariates. Linear pools based on learned joint local predictive ability are applied to predict daily bike usage in Washington DC.


title: Benchmarking and Building Long-Context Retrieval Models with LoCo and M2-BERT

abstract: Retrieval pipelines-an integral component of many machine learning systems-perform poorly in domains where documents are long (e.g., 10K tokens or more) and where identifying the relevant document requires synthesizing information across the entire text. Developing long-context retrieval encoders suitable for these domains raises three challenges: (1) how to evaluate long-context retrieval performance, (2) how to pretrain a base language model to represent both short contexts (corresponding to queries) and long contexts (corresponding to documents), and (3) how to fine-tune this model for retrieval under the batch size limitations imposed by GPU memory constraints. To address these challenges, we first introduce LoCoV1, a novel 12 task benchmark constructed to measure long-context retrieval where chunking is not possible or not effective. We next present the M2-BERT retrieval encoder, an 80M parameter state-space encoder model built from the Monarch Mixer architecture, capable of scaling to documents up to 32K tokens long. We describe a pretraining data mixture which allows this encoder to process both short and long context sequences, and a finetuning approach that adapts this base model to retrieval with only single-sample batches. Finally, we validate the M2-BERT retrieval encoder on LoCoV1, finding that it outperforms competitive Transformer-based models by at least 23.3 points, despite containing upwards of 90x fewer parameters.


title: Fully Dynamic Geometric Vertex Cover and Matching

abstract: In this work, we study two fundamental graph optimization problems, minimum vertex cover (MVC) and maximum-cardinality matching (MCM), for intersection graphs of geometric objects, e.g., disks, rectangles, hypercubes, etc., in $d$-dimensional Euclidean space. We consider the problems in fully dynamic settings, allowing insertions and deletions of objects. We develop a general framework for dynamic MVC in intersection graphs, achieving sublinear amortized update time for most natural families of geometric objects. In particular, we show that - - For a dynamic collection of disks in $\mathbb{R}^2$ or hypercubes in $\mathbb{R}^d$ (for constant $d$), it is possible to maintain a $(1+\varepsilon)$-approximate vertex cover in polylog amortized update time. These results also hold in the bipartite case. - For a dynamic collection of rectangles in $\mathbb{R}^2$, it is possible to maintain a $(\frac{3}{2}+\varepsilon)$-approximate vertex cover in polylog amortized update time. Along the way, we obtain the first near-linear time static algorithms for MVC in the above two cases with the same approximation factors. Next, we turn our attention to the MCM problem. Although our MVC algorithms automatically allow us to approximate the size of the MCM in bipartite geometric intersection graphs, they do not produce a matching. We give another general framework to maintain an approximate maximum matching, and further extend the approach to handle non-bipartite intersection graphs. In particular, we show that - - For a dynamic collection of (bichromatic or monochromatic) disks in $\mathbb{R}^2$ or hypercubes in $\mathbb{R}^d$ (for constant $d$), it is possible to maintain a $(1+\varepsilon)$-approximate matching in polylog amortized update time.