title: Experimental benchmarking of quantum state overlap estimation strategies with photonic systems

abstract: Accurately estimating the overlap between quantum states is a fundamental task in quantum information processing. While various strategies using distinct quantum measurements have been proposed for overlap estimation, the lack of experimental benchmarks on estimation precision limits strategy selection in different situations. Here we compare the performance of four practical strategies for overlap estimation, including tomography-tomography, tomography-projection, Schur collective measurement and optical swap test. With a photonic system, the overlap-dependent estimation precision for each strategy is quantified in terms of the average estimation variance over uniformly sampled states, which highlight the different performance of different strategies. We further propose an adaptive strategy with optimized precision in full-range overlap estimation. Our results shed new light on extracting the parameter of interest from quantum systems, prompting the design of efficient quantum protocols.


title: Learning Continually by Spectral Regularization

abstract: Loss of plasticity is a phenomenon where neural networks become more difficult to train during the course of learning. Continual learning algorithms seek to mitigate this effect by sustaining good predictive performance while maintaining network trainability. We develop new techniques for improving continual learning by first reconsidering how initialization can ensure trainability during early phases of learning. From this perspective, we derive new regularization strategies for continual learning that ensure beneficial initialization properties are better maintained throughout training. In particular, we investigate two new regularization techniques for continual learning: (i) Wasserstein regularization toward the initial weight distribution, which is less restrictive than regularizing toward initial weights; and (ii) regularizing weight matrix singular values, which directly ensures gradient diversity is maintained throughout training. We present an experimental analysis that shows these alternative regularizers can improve continual learning performance across a range of supervised learning tasks and model architectures. The alternative regularizers prove to be less sensitive to hyperparameters while demonstrating better training in individual tasks, sustaining trainability as new tasks arrive, and achieving better generalization performance.


title: On Learning what to Learn: heterogeneous observations of dynamics and establishing (possibly causal) relations among them

abstract: Before we attempt to learn a function between two (sets of) observables of a physical process, we must first decide what the inputs and what the outputs of the desired function are going to be. Here we demonstrate two distinct, data-driven ways of initially deciding ``the right quantities'' to relate through such a function, and then proceed to learn it. This is accomplished by processing multiple simultaneous heterogeneous data streams (ensembles of time series) from observations of a physical system: multiple observation processes of the system. We thus determine (a) what subsets of observables are common between the observation processes (and therefore observable from each other, relatable through a function); and (b) what information is unrelated to these common observables, and therefore particular to each observation process, and not contributing to the desired function. Any data-driven function approximation technique can subsequently be used to learn the input-output relation, from k-nearest neighbors and Geometric Harmonics to Gaussian Processes and Neural Networks. Two particular ``twists'' of the approach are discussed. The first has to do with the identifiability of particular quantities of interest from the measurements. We now construct mappings from a single set of observations of one process to entire level sets of measurements of the process, consistent with this single set. The second attempts to relate our framework to a form of causality: if one of the observation processes measures ``now'', while the second observation process measures ``in the future'', the function to be learned among what is common across observation processes constitutes a dynamical model for the system evolution.


title: Stable Neighbor Denoising for Source-free Domain Adaptive Segmentation

abstract: We study source-free unsupervised domain adaptation (SFUDA) for semantic segmentation, which aims to adapt a source-trained model to the target domain without accessing the source data. Many works have been proposed to address this challenging problem, among which uncertainty-based self-training is a predominant approach. However, without comprehensive denoising mechanisms, they still largely fall into biased estimates when dealing with different domains and confirmation bias. In this paper, we observe that pseudo-label noise is mainly contained in unstable samples in which the predictions of most pixels undergo significant variations during self-training. Inspired by this, we propose a novel mechanism to denoise unstable samples with stable ones. Specifically, we introduce the Stable Neighbor Denoising (SND) approach, which effectively discovers highly correlated stable and unstable samples by nearest neighbor retrieval and guides the reliable optimization of unstable samples by bi-level learning. Moreover, we compensate for the stable set by object-level object paste, which can further eliminate the bias caused by less learned classes. Our SND enjoys two advantages. First, SND does not require a specific segmentor structure, endowing its universality. Second, SND simultaneously addresses the issues of class, domain, and confirmation biases during adaptation, ensuring its effectiveness. Extensive experiments show that SND consistently outperforms state-of-the-art methods in various SFUDA semantic segmentation settings. In addition, SND can be easily integrated with other approaches, obtaining further improvements.


title: Temporal Link Prediction in Social Networks Based on Agent Behavior Synchrony and a Cognitive Mechanism

abstract: Temporality, a crucial characteristic in the formation of social relationships, was used to quantify the long-term time effects of networks for link prediction models, ignoring the heterogeneity of time effects on different time scales. In this work, we propose a novel approach to link prediction in temporal networks, extending existing methods with a cognitive mechanism that captures the dynamics of the interactions. Our approach computes the weight of the edges and their change over time, similar to memory traces in the human brain, by simulating the process of forgetting and strengthening connections depending on the intensity of interactions. We utilized five ground-truth datasets, which were used to predict social ties, missing events, and potential links. We found: (a) the cognitive mechanism enables more accurate capture of the heterogeneity of the temporal effect, leading to an average precision improvement of 9\% compared to baselines with competitive AUC. (b) the local structure and synchronous agent behavior contribute differently to different types of datasets. (c) appropriately increasing the time intervals, which may reduce the negative impact from noise when dividing time windows to calculate the behavioral synchrony of agents, is effective for link prediction tasks.


title: Bounds on the fractal uncertainty exponent and a spectral gap

abstract: We prove two results on Fractal Uncertainty Principle (FUP) for discrete Cantor sets with large alphabets. First, we give an example of an alphabet with dimension $\delta \in (\frac12,1)$ where the FUP exponent is exponentially small as the size of the alphabet grows. Secondly, for $\delta \in (0,\frac12]$ we show that a similar alphabet has a large FUP exponent, arbitrarily close to the optimal upper bound of $\frac12-\frac\delta2$, if we dilate the Fourier transform by a factor satisfying a generic Diophantine condition. We give an application of the latter result to spectral gaps for open quantum baker's maps.


title: Evaluating the local bandgap across InxGa1-xAs multiple quantum wells in a metamorphic laser via low-loss EELS

abstract: We investigate spatially resolved variations in the bandgap energy across multiple InxGa1-xAs quantum wells (QWs) on a GaAs substrate within a metamorphic laser structure. Using high resolution scanning transmission electron microscopy and low-loss electron energy loss spectroscopy, we present a detailed analysis of the local bandgap energy, indium concentration, and strain distribution within the QWs. Our findings reveal significant inhomogeneities, particularly near the interfaces, in both the strain and indium content, and a bandgap variability across QWs. These results are correlated with density functional theory simulations to further elucidate the interplay between strain, composition, and bandgap energy. This work underscores the importance of spatially resolved analysis in understanding, and optimising, the electronic and optical properties of semiconductor devices. The study suggests that the collective impact of individual QWs might affect the emission and performance of the final device, providing insights for the design of next-generation metamorphic lasers with multiple QWs as the active region.


title: The Legal Duty to Search for Less Discriminatory Algorithms

abstract: Work in computer science has established that, contrary to conventional wisdom, for a given prediction problem there are almost always multiple possible models with equivalent performance--a phenomenon often termed model multiplicity. Critically, different models of equivalent performance can produce different predictions for the same individual, and, in aggregate, exhibit different levels of impacts across demographic groups. Thus, when an algorithmic system displays a disparate impact, model multiplicity suggests that developers could discover an alternative model that performs equally well, but has less discriminatory impact. Indeed, the promise of model multiplicity is that an equally accurate, but less discriminatory algorithm (LDA) almost always exists. But without dedicated exploration, it is unlikely developers will discover potential LDAs. Model multiplicity and the availability of LDAs have significant ramifications for the legal response to discriminatory algorithms, in particular for disparate impact doctrine, which has long taken into account the availability of alternatives with less disparate effect when assessing liability. A close reading of legal authorities over the decades reveals that the law has on numerous occasions recognized that the existence of a less discriminatory alternative is sometimes relevant to a defendant's burden of justification at the second step of disparate impact analysis. Indeed, under disparate impact doctrine, it makes little sense to say that a given algorithmic system used by an employer, creditor, or housing provider is "necessary" if an equally accurate model that exhibits less disparate effect is available and possible to discover with reasonable effort. As a result, we argue that the law should place a duty of a reasonable search for LDAs on entities that develop and deploy predictive models in covered civil rights domains.


title: Conformal Prediction for Class-wise Coverage via Augmented Label Rank Calibration

abstract: Conformal prediction (CP) is an emerging uncertainty quantification framework that allows us to construct a prediction set to cover the true label with a pre-specified marginal or conditional probability. Although the valid coverage guarantee has been extensively studied for classification problems, CP often produces large prediction sets which may not be practically useful. This issue is exacerbated for the setting of class-conditional coverage on imbalanced classification tasks. This paper proposes the Rank Calibrated Class-conditional CP (RC3P) algorithm to reduce the prediction set sizes to achieve class-conditional coverage, where the valid coverage holds for each class. In contrast to the standard class-conditional CP (CCP) method that uniformly thresholds the class-wise conformity score for each class, the augmented label rank calibration step allows RC3P to selectively iterate this class-wise thresholding subroutine only for a subset of classes whose class-wise top-k error is small. We prove that agnostic to the classifier and data distribution, RC3P achieves class-wise coverage. We also show that RC3P reduces the size of prediction sets compared to the CCP method. Comprehensive experiments on multiple real-world datasets demonstrate that RC3P achieves class-wise coverage and 26.25% reduction in prediction set sizes on average.


title: Classification of nilpotent almost abelian Lie groups admitting left-invariant complex or symplectic structures

abstract: We classify the nilpotent almost abelian Lie algebras admitting complex or symplectic structures. It turns out that if a nilpotent almost abelian Lie algebra admits a complex structure, then it necessarily admits a symplectic structure. Given an even dimensional almost abelian Lie algebra, we show that it always admits a complex structure when it is 2-step nilpotent and it always admits a symplectic structure when it is $k$-step nilpotent for $k=2, \, 3$ or $4$. Several consequences of the classification theorems are obtained.


title: Adapters Strike Back

abstract: Adapters provide an efficient and lightweight mechanism for adapting trained transformer models to a variety of different tasks. However, they have often been found to be outperformed by other adaptation mechanisms, including low-rank adaptation. In this paper, we provide an in-depth study of adapters, their internal structure, as well as various implementation choices. We uncover pitfalls for using adapters and suggest a concrete, improved adapter architecture, called Adapter+, that not only outperforms previous adapter implementations but surpasses a number of other, more complex adaptation mechanisms in several challenging settings. Despite this, our suggested adapter is highly robust and, unlike previous work, requires little to no manual intervention when addressing a novel scenario. Adapter+ reaches state-of-the-art average accuracy on the VTAB benchmark, even without a per-task hyperparameter optimization.


title: Streaming Algorithms with Few State Changes

abstract: In this paper, we study streaming algorithms that minimize the number of changes made to their internal state (i.e., memory contents). While the design of streaming algorithms typically focuses on minimizing space and update time, these metrics fail to capture the asymmetric costs, inherent in modern hardware and database systems, of reading versus writing to memory. In fact, most streaming algorithms write to their memory on every update, which is undesirable when writing is significantly more expensive than reading. This raises the question of whether streaming algorithms with small space and number of memory writes are possible. We first demonstrate that, for the fundamental $F_p$ moment estimation problem with $p\ge 1$, any streaming algorithm that achieves a constant factor approximation must make $\Omega(n^{1-1/p})$ internal state changes, regardless of how much space it uses. Perhaps surprisingly, we show that this lower bound can be matched by an algorithm that also has near-optimal space complexity. Specifically, we give a $(1+\varepsilon)$-approximation algorithm for $F_p$ moment estimation that uses a near-optimal $\widetilde{\mathcal{O}}_\varepsilon(n^{1-1/p})$ number of state changes, while simultaneously achieving near-optimal space, i.e., for $p\in[1,2]$, our algorithm uses $\text{poly}\left(\log n,\frac{1}{\varepsilon}\right)$ bits of space, while for $p>2$, the algorithm uses $\widetilde{\mathcal{O}}_\varepsilon(n^{1-2/p})$ space. We similarly design streaming algorithms that are simultaneously near-optimal in both space complexity and the number of state changes for the heavy-hitters problem, sparse support recovery, and entropy estimation. Our results demonstrate that an optimal number of state changes can be achieved without sacrificing space complexity.


title: An LLM-Assisted Easy-to-Trigger Backdoor Attack on Code Completion Models: Injecting Disguised Vulnerabilities against Strong Detection

abstract: Large Language Models (LLMs) have transformed code completion tasks, providing context-based suggestions to boost developer productivity in software engineering. As users often fine-tune these models for specific applications, poisoning and backdoor attacks can covertly alter the model outputs. To address this critical security challenge, we introduce CodeBreaker, a pioneering LLM-assisted backdoor attack framework on code completion models. Unlike recent attacks that embed malicious payloads in detectable or irrelevant sections of the code (e.g., comments), CodeBreaker leverages LLMs (e.g., GPT-4) for sophisticated payload transformation (without affecting functionalities), ensuring that both the poisoned data for fine-tuning and generated code can evade strong vulnerability detection. CodeBreaker stands out with its comprehensive coverage of vulnerabilities, making it the first to provide such an extensive set for evaluation. Our extensive experimental evaluations and user studies underline the strong attack performance of CodeBreaker across various settings, validating its superiority over existing approaches. By integrating malicious payloads directly into the source code with minimal transformation, CodeBreaker challenges current security measures, underscoring the critical need for more robust defenses for code completion.


title: Locally Interdependent Multi-Agent MDP: Theoretical Framework for Decentralized Agents with Dynamic Dependencies

abstract: Many multi-agent systems in practice are decentralized and have dynamically varying dependencies. There has been a lack of attempts in the literature to analyze these systems theoretically. In this paper, we propose and theoretically analyze a decentralized model with dynamically varying dependencies called the Locally Interdependent Multi-Agent MDP. This model can represent problems in many disparate domains such as cooperative navigation, obstacle avoidance, and formation control. Despite the intractability that general partially observable multi-agent systems suffer from, we propose three closed-form policies that are theoretically near-optimal in this setting and can be scalable to compute and store. Consequentially, we reveal a fundamental property of Locally Interdependent Multi-Agent MDP's that the partially observable decentralized solution is exponentially close to the fully observable solution with respect to the visibility radius. We then discuss extensions of our closed-form policies to further improve tractability. We conclude by providing simulations to investigate some long horizon behaviors of our closed-form policies.


title: Modified Legendre-Gauss Collocation Method for Solving Optimal Control Problems with Nonsmooth Solutions

abstract: A modified form of Legendre-Gauss orthogonal direct collocation is developed for solving optimal control problems whose solutions are nonsmooth due to control discontinuities. This new method adds switch-time variables, control variables, and collocation conditions at both endpoints of a mesh interval, whereas these new variables and collocation conditions are not included in standard Legendre-Gauss orthogonal collocation. The modified Legendre-Gauss collocation method alters the search space of the resulting nonlinear programming problem and enables determining accurately the location of the nonsmoothness in the optimal control. The transformed adjoint system of the modified Legendre-Gauss collocation method is then derived and shown to satisfy a discrete form of the continuous variational necessary conditions for optimality. The method is motivated via a control-constrained triple-integrator minimum-time optimal control problem where the solution possesses a two-switch bang-bang optimal control structure. In addition, the method developed in this paper is compared with existing Gaussian quadrature collocation methods. The method developed in this paper is shown to be capable of accurately solving optimal control problems with a discontinuous optimal control.


title: A local squared Wasserstein-2 method for efficient reconstruction of models with uncertainty

abstract: In this paper, we propose a local squared Wasserstein-2 (W_2) method to solve the inverse problem of reconstructing models with uncertain latent variables or parameters. A key advantage of our approach is that it does not require prior information on the distribution of the latent variables or parameters in the underlying models. Instead, our method can efficiently reconstruct the distributions of the output associated with different inputs based on empirical distributions of observation data. We demonstrate the effectiveness of our proposed method across several uncertainty quantification (UQ) tasks, including linear regression with coefficient uncertainty, training neural networks with weight uncertainty, and reconstructing ordinary differential equations (ODEs) with a latent random variable.


title: Experimental Measurement of Assembly Indices are Required to Determine The Threshold for Life

abstract: Assembly Theory (AT) was developed to help distinguish living from non-living systems. The theory is simple as it posits that the amount of selection or Assembly is a function of the number of complex objects where their complexity can be objectively determined using assembly indices. The assembly index of a given object relates to the number of recursive joining operations required to build that object and can be not only rigorously defined mathematically but can be experimentally measured. In pervious work we outlined the theoretical basis, but also extensive experimental measurements that demonstrated the predictive power of AT. These measurements showed that is a threshold in assembly indices for organic molecules whereby abiotic chemical systems could not randomly produce molecules with an assembly index greater or equal than 15. In a recent paper by Hazen et al [1] the authors not only confused the concept of AT with the algorithms used to calculate assembly indices, but also attempted to falsify AT by calculating theoretical assembly indices for objects made from inorganic building blocks. A fundamental misunderstanding made by the authors is that the threshold is a requirement of the theory, rather than experimental observation. This means that exploration of inorganic assembly indices similarly requires an experimental observation, correlated with the theoretical calculations. Then and only then can the exploration of complex inorganic molecules be done using AT and the threshold for living systems, as expressed with such building blocks, be determined. Since Hazen et al.[1] present no experimental measurements of assembly theory, their analysis is not falsifiable.


title: Predictions for a Low-mass Cutoff for the Primordial Black Hole Mass Spectrum

abstract: In this note we outline how a modest violation in the conservation of mass during the merger of two PBHs affects the PBH mass spectrum that we previously obtained using a Boltzmann equation model for the evolution of the mass spectrum with no mass loss. We find that if the initial cosmological redshift is on the order 10$^{12}$, then the fraction of primordial holes with masses greater than $10^{3}$ solar masses appears be close to what is required to provide the seeds for galaxies. In addition we note that as a result of rapid collisions and strong coupling to electromagnetic radiation for temperatures $>$ GeV (Chapline 2018), there will be an effective low mass cutoff in the mass spectrum for PBH masses less than a certain PBH mass less than than $0.1M_{\odot}$. We also point out that this cutoff in the mass spectrum below $\sim 0.1 M_\odot$ can be confirmed by combining future microlensing observations from the Roman Space Telescope and the Vera C. Rubin Observatory with astrometric observations.


title: CCAT: Comparisons of 280 GHz TiN and Al Kinetic Inductance Detector Arrays

abstract: The CCAT Collaboration's six-meter Fred Young Submillimeter Telescope is scheduled to begin observing in the Chilean Atacama in 2025, targeting a variety of science goals throughout cosmic history. Prime-Cam is a 1.8-meter diameter cryostat that will host up to seven independent instrument modules designed for simultaneous spectroscopic and broadband, polarimetric surveys at millimeter to submillimeter wavelengths. The first of these instrument modules, the 280 GHz module, will include ${\sim}$10,000 kinetic inductance detectors (KIDs) across three arrays. While the first array was fabricated out of tri-layer TiN/Ti/TiN, the other two arrays were fabricated out of a single layer of Al. This combination of materials within the same instrument provides a unique opportunity to directly compare the performance and noise properties of two different detector materials that are seeing increasing use within the field. We present preliminary comparisons here based on lab testing, along with a discussion of the potential impacts on operation when observing and translating raw data to science-grade maps.


title: Personalized Binomial DAGs Learning with Network Structured Covariates

abstract: The causal dependence in data is often characterized by Directed Acyclic Graphical (DAG) models, widely used in many areas. Causal discovery aims to recover the DAG structure using observational data. This paper focuses on causal discovery with multi-variate count data. We are motivated by real-world web visit data, recording individual user visits to multiple websites. Building a causal diagram can help understand user behavior in transitioning between websites, inspiring operational strategy. A challenge in modeling is user heterogeneity, as users with different backgrounds exhibit varied behaviors. Additionally, social network connections can result in similar behaviors among friends. We introduce personalized Binomial DAG models to address heterogeneity and network dependency between observations, which are common in real-world applications. To learn the proposed DAG model, we develop an algorithm that embeds the network structure into a dimension-reduced covariate, learns each node's neighborhood to reduce the DAG search space, and explores the variance-mean relation to determine the ordering. Simulations show our algorithm outperforms state-of-the-art competitors in heterogeneous data. We demonstrate its practical usefulness on a real-world web visit dataset.


title: Cosmological Stasis from Dynamical Scalars: Tracking Solutions and the Possibility of a Stasis-Induced Inflation

abstract: It has recently been realized that many theories of physics beyond the Standard Model give rise to cosmological histories exhibiting extended epochs of cosmological stasis. During such epochs, the abundances of different energy components such as matter, radiation, and vacuum energy each remain fixed despite cosmological expansion. In previous analyses of the stasis phenomenon, these different energy components were modeled as fluids with fixed, unchanging equations of state. In this paper, by contrast, we consider more realistic systems involving dynamical scalars which pass through underdamping transitions as the universe expands. Indeed, such systems might be highly relevant for BSM scenarios involving higher-dimensional bulk moduli and inflatons. Remarkably, we find that stasis emerges even in such situations, despite the appearance of time-varying equations of state. Moreover, this stasis includes several new features which might have important phenomenological implications and applications. For example, in the presence of an additional "background" energy component, we find that the scalars evolve into a "tracking" stasis in which the stasis equation of state automatically tracks that of the background. This phenomenon exists even if the background has only a small initial abundance. We also discuss the intriguing possibility that our results might form the basis of a new "Stasis Inflation" scenario in which no ad-hoc inflaton potential is needed and in which there is no graceful-exit problem. Within such a scenario, the number of e-folds of cosmological expansion produced is directly related to the hierarchies between physical BSM mass scales. Moreover, non-zero matter and radiation abundances can be sustained throughout the inflationary epoch.


title: Gielis superformula and wildfire models

abstract: Experimental data on the propagation of wildfires show that its short-time spread has a double semi-elliptical shape. Our main goal is to show that this shape can be accurately approximated in polar coordinates by choosing suitable parameters in Gielis superformula and, then, implemented in a geometrical model for wildfire propagation. In this model, the firefront can be determined by computing the lightlike geodesics of a specific Finsler spacetime, and we derive a concise and efficient expression of the geodesic equations in these coordinates.


title: Hidden correlations in stochastic photoinduced dynamics of a solid-state electrolyte

abstract: Photoexcitation by ultrashort laser pulses plays a crucial role in controlling reaction pathways, creating nonequilibrium material properties, and offering a microscopic view of complex dynamics at the molecular level. The photo response following a laser pulse is, in general, non-identical between multiple exposures due to spatiotemporal fluctuations in a material or the stochastic nature of dynamical pathways. However, most ultrafast experiments using a stroboscopic pump-probe scheme struggle to distinguish intrinsic sample fluctuations from extrinsic apparatus noise, often missing seemingly random deviations from the averaged shot-to-shot response. Leveraging the stability and high photon-flux of time-resolved X-ray micro-diffraction at a synchrotron, we developed a method to quantitatively characterize the shot-to-shot variation of the photoinduced dynamics in a solid-state electrolyte. By analyzing temporal evolutions of the lattice parameter of a single grain in a powder ensemble, we found that the sample responses after different shots contain random fluctuations that are, however, not independent. Instead, there is a correlation between the nonequilibrium lattice trajectories following adjacent laser shots with a characteristic "correlation length" of approximately 1,500 shots, which represents an energy barrier of 0.38~eV for switching the photoinduced pathway, a value interestingly commensurate with the activation energy of lithium ion diffusion. Not only does our nonequilibrium noise correlation spectroscopy provide a new strategy for studying fluctuations that are central to phase transitions in both condensed matter and molecular systems, it also paves the way for discovering hidden correlations and novel metastable states buried in oft-presumed random, uncorrelated fluctuating dynamics.


title: Data-driven Power Flow Linearization: Simulation

abstract: Building on the theoretical insights of Part I, this paper, as the second part of the tutorial, dives deeper into data-driven power flow linearization (DPFL), focusing on comprehensive numerical testing. The necessity of these simulations stems from the theoretical analysis's inherent limitations, particularly the challenge of identifying the differences in real-world performance among DPFL methods with overlapping theoretical capabilities and/or limitations. The absence of a comprehensive numerical comparison of DPFL approaches in the literature also motivates this paper, especially given the fact that over 95% of existing DPFL studies have not provided any open-source codes. To bridge the gap, this paper first reviews existing DPFL experiments, examining the adopted test scenarios, load fluctuation settings, data sources, considerations for data noise/outliers, and the comparison made so far. Subsequently, this paper evaluates a total of 44 methods, containing over 30 existing DPFL approaches, some innovative DPFL techniques, and several classic physics-driven power flow linearization methods for benchmarking. The evaluation spans various dimensions, including generalizability, applicability, accuracy, and computational efficiency, using various different test cases scaling from 9-bus to 1354-bus systems. The numerical analysis identifies and examines significant trends and consistent findings across all methods under various test cases. It also offers theoretical insights into phenomena like under-performance, failure, excessive computation times, etc. Overall, this paper identifies the differences in the performances of the wide range of DPFL methods, reveals gaps not evident from theoretical discussions, assists in method selection for real-world applications, and provides thorough discussions on open questions within DPFL research, indicating ten potential future directions.


title: Power Analysis for Experiments with Clustered Data, Ratio Metrics, and Regression for Covariate Adjustment

abstract: We describe how to calculate standard errors for A/B tests that include clustered data, ratio metrics, and/or covariate adjustment. We may do this for power analysis/sample size calculations prior to running an experiment using historical data, or after an experiment for hypothesis testing and confidence intervals. The different applications have a common framework, using the sample variance of certain residuals. The framework is compatible with modular software, can be plugged into standard tools, doesn't require computing covariance matrices, and is numerically stable. Using this approach we estimate that covariate adjustment gives a median 66% variance reduction for a key metric, reducing experiment run time by 66%.


title: Large language models for generating rules, yay or nay?

abstract: Engineering safety-critical systems such as medical devices and digital health intervention systems is complex, where long-term engagement with subject-matter experts (SMEs) is needed to capture the systems' expected behaviour. In this paper, we present a novel approach that leverages Large Language Models (LLMs), such as GPT-3.5 and GPT-4, as a potential world model to accelerate the engineering of software systems. This approach involves using LLMs to generate logic rules, which can then be reviewed and informed by SMEs before deployment. We evaluate our approach using a medical rule set, created from the pandemic intervention monitoring system in collaboration with medical professionals during COVID-19. Our experiments show that 1) LLMs have a world model that bootstraps implementation, 2) LLMs generated less number of rules compared to experts, and 3) LLMs do not have the capacity to generate thresholds for each rule. Our work shows how LLMs augment the requirements' elicitation process by providing access to a world model for domains.


title: Comparative Study of Quantum Transpilers: Evaluating the Performance of qiskit-braket-provider, qBraid-SDK, and Pytket Extensions

abstract: In this study, we conducted a comprehensive evaluation of several quantum transpilers, including the qiskit-braket-provider, the qBraid-SDK, and the pytket extensions, focusing on critical metrics such as correctness, failure rate, and transpilation time. Our results demonstrate that the qiskit-braket-provider exhibits superior performance achieving a remarkably low failure rate of 0.2%. the qiskit-braket-provider utilizes a combination of one-to-one transpilation and gate decomposition for unsupported gates, enhancing transpiler capabilities and speed. The qBraid-SDK offers a more generalized approach, suitable for transpilation across multiple SDKs, albeit with slower performance compared to the qiskit-braket-provider. The pytket extensions, while fast, exhibit limitations in handling complex circuits due to their one-to-one transpilation scheme. We also provide recommendations for future development, advocating for the adoption of the method employed by the qiskit-braket-provider to enhance transpiler capabilities and speed. This study contributes to the growing body of knowledge in quantum transpiler benchmarking, fostering interoperability and guiding the development of quantum computing applications in a diverse hardware and software landscape.


title: A Dynamic Likelihood Approach to Filtering for Advection-Diffusion Dynamics

abstract: A Bayesian data assimilation scheme is formulated for advection-dominated advective and diffusive evolutionary problems, based upon the Dynamic Likelihood (DLF) approach to filtering. The DLF was developed specifically for hyperbolic problems -waves-, and in this paper, it is extended via a split step formulation, to handle advection-diffusion problems. In the dynamic likelihood approach, observations and their statistics are used to propagate probabilities along characteristics, evolving the likelihood in time. The estimate posterior thus inherits phase information. For advection-diffusion the advective part of the time evolution is handled on the basis of observations alone, while the diffusive part is informed through the model as well as observations. We expect, and indeed show here, that in advection-dominated problems, the DLF approach produces better estimates than other assimilation approaches, particularly when the observations are sparse and have low uncertainty. The added computational expense of the method is cubic in the total number of observations over time, which is on the same order of magnitude as a standard Kalman filter and can be mitigated by bounding the number of forward propagated observations, discarding the least informative data.


title: Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes

abstract: We study the generalization of two-layer ReLU neural networks in a univariate nonparametric regression problem with noisy labels. This is a problem where kernels (\emph{e.g.} NTK) are provably sub-optimal and benign overfitting does not happen, thus disqualifying existing theory for interpolating (0-loss, global optimal) solutions. We present a new theory of generalization for local minima that gradient descent with a constant learning rate can \emph{stably} converge to. We show that gradient descent with a fixed learning rate $\eta$ can only find local minima that represent smooth functions with a certain weighted \emph{first order total variation} bounded by $1/\eta - 1/2 + \widetilde{O}(\sigma + \sqrt{\mathrm{MSE}})$ where $\sigma$ is the label noise level, $\mathrm{MSE}$ is short for mean squared error against the ground truth, and $\widetilde{O}(\cdot)$ hides a logarithmic factor. Under mild assumptions, we also prove a nearly-optimal MSE bound of $\widetilde{O}(n^{-4/5})$ within the strict interior of the support of the $n$ data points. Our theoretical results are validated by extensive simulation that demonstrates large learning rate training induces sparse linear spline fits. To the best of our knowledge, we are the first to obtain generalization bound via minima stability in the non-interpolation case and the first to show ReLU NNs without regularization can achieve near-optimal rates in nonparametric regression.


title: EAVE: Efficient Product Attribute Value Extraction via Lightweight Sparse-layer Interaction

abstract: Product attribute value extraction involves identifying the specific values associated with various attributes from a product profile. While existing methods often prioritize the development of effective models to improve extraction performance, there has been limited emphasis on extraction efficiency. However, in real-world scenarios, products are typically associated with multiple attributes, necessitating multiple extractions to obtain all corresponding values. In this work, we propose an Efficient product Attribute Value Extraction (EAVE) approach via lightweight sparse-layer interaction. Specifically, we employ a heavy encoder to separately encode the product context and attribute. The resulting non-interacting heavy representations of the context can be cached and reused for all attributes. Additionally, we introduce a light encoder to jointly encode the context and the attribute, facilitating lightweight interactions between them. To enrich the interaction within the lightweight encoder, we design a sparse-layer interaction module to fuse the non-interacting heavy representation into the lightweight encoder. Comprehensive evaluation on two benchmarks demonstrate that our method achieves significant efficiency gains with neutral or marginal loss in performance when the context is long and number of attributes is large. Our code is available \href{https://anonymous.4open.science/r/EAVE-EA18}{here}.


title: Silent Signals, Loud Impact: LLMs for Word-Sense Disambiguation of Coded Dog Whistles

abstract: A dog whistle is a form of coded communication that carries a secondary meaning to specific audiences and is often weaponized for racial and socioeconomic discrimination. Dog whistling historically originated from United States politics, but in recent years has taken root in social media as a means of evading hate speech detection systems and maintaining plausible deniability. In this paper, we present an approach for word-sense disambiguation of dog whistles from standard speech using Large Language Models (LLMs), and leverage this technique to create a dataset of 16,550 high-confidence coded examples of dog whistles used in formal and informal communication. Silent Signals is the largest dataset of disambiguated dog whistle usage, created for applications in hate speech detection, neology, and political science. The dataset can be found at https://huggingface.co/datasets/SALT-NLP/silent_signals.


title: Compass: A Comprehensive Tool for Accurate and Efficient Molecular Docking in Inference and Fine-Tuning

abstract: While there has been discussion about noise levels in molecular docking datasets such as PDBBind, a thorough analysis of their physical/chemical and bioactivity noise characteristics is still lacking. PoseCheck addresses this issue by examining molecular strain energy, molecular-protein clashes, and interactions, but it is primarily created for $de$ $novo$ drug design. Another important metric in molecular docking, Binding Affinity Energy, is better assessed by the new empirical score function, AA-Score, which has demonstrated improved performance over existing methods. To tackle these challenges, we propose the COMPASS method, which integrates the PoseCheck and AA-Score modules. This approach evaluates dataset noise levels and the physical/chemical and bioactivity feasibility of docked molecules. Our analysis of the PDBBind dataset using COMPASS reveals significant noise in the ground truth data. Additionally, we incorporate COMPASS with the state-of-the-art molecular docking method, DiffDock, in inference mode to achieve efficient and accurate assessments of docked ligands. Finally, we propose a new paradigm to enhance model performance for molecular docking through fine-tuning and discuss the potential benefits of this approach. The source code is available publicly at https://github.com/BIMSBbioinfo/Compass.


title: Aerial Relay to Achieve Covertness and Security

abstract: In this work, a delay-tolerant unmanned aerial vehicle (UAV) relayed covert and secure communication framework is investigated. In this framework, a legitimate UAV serves as an aerial relay to realize communication when the direct link between the terrestrial transmitter and receiver is blocked and also acts as a friendly jammer to suppress the malicious nodes presented on the ground. Subsequently, considering the uncertainty of malicious nodes' positions, a robust fractional programming optimization problem is built to maximize energy efficiency by jointly optimizing the trajectory of the UAV, the transmit power of the transmitter, and the time-switching factor. For the extremely complicated covert constraint, Pinsker's inequality, Jensen's inequality, and the bisection search method are employed to construct a tractable shrunken one. After this, an alternate optimization-based algorithm is proposed to solve the fractional programming optimization problem. To achieve low complexity, we design the primal-dual search-based algorithm and the successive convex approximation-based algorithm, respectively, for each sub-problem. Numerical results show the effectiveness of our proposed algorithm.


title: HO-Cap: A Capture System and Dataset for 3D Reconstruction and Pose Tracking of Hand-Object Interaction

abstract: We introduce a data capture system and a new dataset named HO-Cap that can be used to study 3D reconstruction and pose tracking of hands and objects in videos. The capture system uses multiple RGB-D cameras and a HoloLens headset for data collection, avoiding the use of expensive 3D scanners or mocap systems. We propose a semi-automatic method to obtain annotations of shape and pose of hands and objects in the collected videos, which significantly reduces the required annotation time compared to manual labeling. With this system, we captured a video dataset of humans using objects to perform different tasks, as well as simple pick-and-place and handover of an object from one hand to the other, which can be used as human demonstrations for embodied AI and robot manipulation research. Our data capture setup and annotation framework can be used by the community to reconstruct 3D shapes of objects and human hands and track their poses in videos.


title: A game-theoretic, market-based approach to extract flexibility from distributed energy resources

abstract: In this paper, we propose a market design based on game theory to optimally utilize the flexibility of distributed energy resources (DERs) such as solar PV, batteries, electric vehicles, and flexible loads. Market agents perform multiperiod optimization to determine their feasible flexibility limits for power injections while satisfying all constraints of their DERs. This is followed by a Stackelberg game between the market operator and the agents. The market operator as the leader aims to regulate the aggregate power injection around a desired value by leveraging the flexibility of their agents, and computes optimal prices for both electricity and flexibility services. The agents follow by optimally bidding their desired flexible power injections in response to these prices. We show the existence of an equilibrium among the market agents between all agents and the operator, along with simulation results for a small example system.


title: Time-dependent Relativistic Hartree-Fock model with spherical symmetry

abstract: This work establishes the time-dependent relativistic Hartree-Fock (TD-RHF) model with spherical symmetry for the first time. The time-dependent integro-differential Dirac equations are solved by expanding Dirac spinors on the spherical Dirac Woods-Saxon (DWS) basis. The numerical verification demonstrates the high conservation qualities for both the total binding energy and the particle number, as well as the time-reversal invariance of the system, which ensures the precision and reliability of the newly developed TD-RHF model. Subsequently, the isoscalar giant monopole resonance (ISGMR) mode of $^{208}$Pb is investigated using the RHF Lagrangian PKO1. The constrained energy of the ISGMR calculated by PKO1 is found to be in close agreement with the experimental data, and the strength function is similar to the results given by the relativistic Hartree-Fock plus random phase approximation. Based on the advantage of the TD-RHF model in avoiding complicated calculations of the residual interactions, the ISGMR mode of $^{208}$Pb is calculated by twelve relativistic effective Lagrangians. The results indicate that the value of the incompressibility of nuclear matter $K_\infty$ constrained by relativistic effective Lagrangians is in the range of $237\sim246$ MeV, which is lower than the previous investigations based on the relativistic models.


title: Relativistic Hartree-Fock model for axial-symmetric nuclei with quadruple and octupole deformations

abstract: \textbf{Background:} The initial observation of a negative-parity state in proximity to the ground state in the 1950s marked the advent of extensive research into octupole deformed nuclei. Since then, the physics of octupole deformed nuclei has consistently held a special interest within the field of nuclear physics. In the present era, with the advent of sophisticated radioactive ion beam (RIB) facilities and advanced detectors, coupled with the remarkable capabilities of high-performance computing, extensive and intensive explorations are being conducted from both experimental and theoretical perspectives to elucidate the physics of octupole deformed nuclei. \textbf{Results:} This work establishes the OD-RHF model, which provides a reliable tool for studying octupole nuclei over a fairly wide range. The reliability of the newly developed OD-RHF model is illustrated by taking the octupole nucleus $^{144}$Ba as an example. Furthermore, the octupole deformation effects in $^{144}$Ba is verified by using the RHF Lagrangians PKO$i$ ($i=1,2,3$) and the RMF one DD-ME2. The intrusion of the neutron $1i_{13/2}$ and proton $1h_{11/2}$ components is demonstrated to play an essential role in determining the notable octupole deformation of $^{144}$Ba using PKO$i$ ($i=1,2,3$) and DD-ME2. It is indicated that the Fock terms play an important role in stabilizing the octupole deformation. More specifically, due to the repulsive tensor coupling between the intrude components and the core of $^{144}$Ba, the tensor force component carried by the $\pi$-PV coupling, that contributes only via the Fock terms, plays an opposing role in the formation of the octupole deformation of $^{144}$Ba.


title: Generalized W-Net: Arbitrary-style Chinese Character Synthesization

abstract: Synthesizing Chinese characters with consistent style using few stylized examples is challenging. Existing models struggle to generate arbitrary style characters with limited examples. In this paper, we propose the Generalized W-Net, a novel class of W-shaped architectures that addresses this. By incorporating Adaptive Instance Normalization and introducing multi-content, our approach can synthesize Chinese characters in any desired style, even with limited examples. It handles seen and unseen styles during training and can generate new character contents. Experimental results demonstrate the effectiveness of our approach.


title: Taxes Are All You Need: Integration of Taxonomical Hierarchy Relationships into the Contrastive Loss

abstract: In this work, we propose a novel supervised contrastive loss that enables the integration of taxonomic hierarchy information during the representation learning process. A supervised contrastive loss operates by enforcing that images with the same class label (positive samples) project closer to each other than images with differing class labels (negative samples). The advantage of this approach is that it directly penalizes the structure of the representation space itself. This enables greater flexibility with respect to encoding semantic concepts. However, the standard supervised contrastive loss only enforces semantic structure based on the downstream task (i.e. the class label). In reality, the class label is only one level of a \emph{hierarchy of different semantic relationships known as a taxonomy}. For example, the class label is oftentimes the species of an animal, but between different classes there are higher order relationships such as all animals with wings being ``birds". We show that by explicitly accounting for these relationships with a weighting penalty in the contrastive loss we can out-perform the supervised contrastive loss. Additionally, we demonstrate the adaptability of the notion of a taxonomy by integrating our loss into medical and noise-based settings that show performance improvements by as much as 7%.


title: Flexible Parametric Inference for Space-Time Hawkes Processes

abstract: Many modern spatio-temporal data sets, in sociology, epidemiology or seismology, for example, exhibit self-exciting characteristics, triggering and clustering behaviors both at the same time, that a suitable Hawkes space-time process can accurately capture. This paper aims to develop a fast and flexible parametric inference technique to recover the parameters of the kernel functions involved in the intensity function of a space-time Hawkes process based on such data. Our statistical approach combines three key ingredients: 1) kernels with finite support are considered, 2) the space-time domain is appropriately discretized, and 3) (approximate) precomputations are used. The inference technique we propose then consists of a $\ell_2$ gradient-based solver that is fast and statistically accurate. In addition to describing the algorithmic aspects, numerical experiments have been carried out on synthetic and real spatio-temporal data, providing solid empirical evidence of the relevance of the proposed methodology.


title: The PAU Survey: Photometric Calibration of Narrow Band Images

abstract: The Physics of the Accelerating Universe (PAU) camera is an optical narrow band and broad band imaging instrument mounted at the prime focus of the William Herschel Telescope. We describe the image calibration procedure of the PAU Survey data. We rely on an external photometric catalogue to calibrate our narrow band data using stars that have been observed by both datasets. We fit stellar templates to the stellar broad band photometry of the Sloan Digital Sky Survey and synthesise narrow band photometry that we compare to the PAUS narrow band data to determine their calibration. Consequently, the PAUS data are in the AB system as inherited from its reference calibrator. We do several tests to check the performance of the calibration. We find it self-consistent when comparing repeated observations of the same objects, with a good overall accuracy to the AB system which we estimate to be at the 2\% precision level and no significant trends as a function of narrow band filter or wavelength. Repeated observations allow us to build a spatial map of the illumination pattern of the system. We also check the wavelength dependence of the calibration comparing to stellar spectra. We find that using only blue stars reduces the effects of variations in the stellar template fitting to broad-band colours, improving the overall precision of the calibration to around 1\% and its wavelength uniformity. The photometric redshift performance obtained with the PAUS data attests to the validity of our calibration to reach the PAUS science goals.


title: Unbiased Markov Chain Monte Carlo: what, why, and how

abstract: This document presents methods to remove the initialization or burn-in bias from Markov chain Monte Carlo (MCMC) estimates, with consequences on parallel computing, convergence diagnostics and performance assessment. The document is written as an introduction to these methods for MCMC users. Some theoretical results are mentioned, but the focus is on the methodology.


title: A Survey of Backdoor Attacks and Defenses on Large Language Models: Implications for Security Measures

abstract: The large language models (LLMs), which bridge the gap between human language understanding and complex problem-solving, achieve state-of-the-art performance on several NLP tasks, particularly in few-shot and zero-shot settings. Despite the demonstrable efficacy of LMMs, due to constraints on computational resources, users have to engage with open-source language models or outsource the entire training process to third-party platforms. However, research has demonstrated that language models are susceptible to potential security vulnerabilities, particularly in backdoor attacks. Backdoor attacks are designed to introduce targeted vulnerabilities into language models by poisoning training samples or model weights, allowing attackers to manipulate model responses through malicious triggers. While existing surveys on backdoor attacks provide a comprehensive overview, they lack an in-depth examination of backdoor attacks specifically targeting LLMs. To bridge this gap and grasp the latest trends in the field, this paper presents a novel perspective on backdoor attacks for LLMs by focusing on fine-tuning methods. Specifically, we systematically classify backdoor attacks into three categories: full-parameter fine-tuning, parameter-efficient fine-tuning, and attacks without fine-tuning. Based on insights from a substantial review, we also discuss crucial issues for future research on backdoor attacks, such as further exploring attack algorithms that do not require fine-tuning, or developing more covert attack algorithms.


title: Gap theorems in Yang-Mills theory for complete four-dimensional manifolds with positive Yamabe constant

abstract: In this paper we prove gap theorems in Yang-Mills theory for complete four-dimensional manifolds with positive Yamabe constant. We extend the results of Gursky-Kelleher-Streets to complete manifolds. We also describe the equality in the gap theorem in terms of the basic instanton, which is interesting even for compact manifolds.


title: Current-readout technique for ultra-high-rate experiments

abstract: This study developed a new current-readout technique capable of handling measurements with high count rates reaching 1 Gcps. By directly capturing the output current of a photomultiplier as a digitized waveform, we estimated event rates, overcoming the limitations imposed by pulse pileup constraints and deadtimes. This innovative method was applied to a muon spin rotation/relaxation/resonance experiment at the Japan Proton Accelerator Research Complex, demonstrating its anticipated performance. Furthermore, we explored methods for estimating statistical uncertainty and investigated potential applications in analog-logic OR/AND gates. Overall, our findings reveal that the developed technique opens up avenues for the development of future non-binary logic circuits operating based on n-adic numbers.


title: Design and Scheduling of an AI-based Queueing System

abstract: To leverage prediction models to make optimal scheduling decisions in service systems, we must understand how predictive errors impact congestion due to externalities on the delay of other jobs. Motivated by applications where prediction models interact with human servers (e.g., content moderation), we consider a large queueing system comprising of many single server queues where the class of a job is estimated using a prediction model. By characterizing the impact of mispredictions on congestion cost in heavy traffic, we design an index-based policy that incorporates the predicted class information in a near-optimal manner. Our theoretical results guide the design of predictive models by providing a simple model selection procedure with downstream queueing performance as a central concern, and offer novel insights on how to design queueing systems with AI-based triage. We illustrate our framework on a content moderation task based on real online comments, where we construct toxicity classifiers by finetuning large language models.


title: Sample Complexity Reduction via Policy Difference Estimation in Tabular Reinforcement Learning

abstract: In this paper, we study the non-asymptotic sample complexity for the pure exploration problem in contextual bandits and tabular reinforcement learning (RL): identifying an epsilon-optimal policy from a set of policies with high probability. Existing work in bandits has shown that it is possible to identify the best policy by estimating only the difference between the behaviors of individual policies, which can be substantially cheaper than estimating the behavior of each policy directly. However, the best-known complexities in RL fail to take advantage of this and instead estimate the behavior of each policy directly. Does it suffice to estimate only the differences in the behaviors of policies in RL? We answer this question positively for contextual bandits but in the negative for tabular RL, showing a separation between contextual bandits and RL. However, inspired by this, we show that it almost suffices to estimate only the differences in RL: if we can estimate the behavior of a single reference policy, it suffices to only estimate how any other policy deviates from this reference policy. We develop an algorithm which instantiates this principle and obtains, to the best of our knowledge, the tightest known bound on the sample complexity of tabular RL.


title: A survey on the Le-Murakami-Ohtsuki invariant for closed 3-manifolds

abstract: We review the original approach to the Le-Murakami-Ohtsuki (LMO) invariant of closed 3-manifolds (as opposed to the later approach based on the Aarhus integral). Following the ideas of surgery presentation, we introduce a class of combinatorial structures, called Kirby structures, which we prove to yield multiplicative 3-manifold invariants. We illustrate this with the Reshetikhin-Turaev invariants. We then introduce a class of combinatorial structures, called pre-LMO structures, and prove that they give rise to Kirby structures. We show how the Kontsevich integral can be used to construct a pre-LMO structure. This yields two families of multiplicative 3-manifolds invariants $\{\Omega_n^{\mathfrak{c}}\}_{n\geq 1}$ and $\{\Omega_n^{\mathfrak{d}}\}_{n\geq 1}$. We review the elimination of redundant information in the latter family, leading to the construction of the LMO invariant. We also provide uniqueness results of some aspects of the LMO construction. The family of invariants $\{\Omega_n^{\mathfrak{c}}\}_{n\geq 1}$ is not discussed explicitly in the literature; whereas $\Omega_n^{\mathfrak{c}}$ enables one to recover $\Omega_n^{\mathfrak{d}}$ for any $n \geq 1$, we show that these invariants coincide for $n = 1$.


title: FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion

abstract: Large deep learning models have demonstrated strong ability to solve many tasks across a wide range of applications. Those large models typically require training and inference to be distributed. Tensor parallelism is a common technique partitioning computation of an operation or layer across devices to overcome the memory capacity limitation of a single processor, and/or to accelerate computation to meet a certain latency requirement. However, this kind of parallelism introduces additional communication that might contribute a significant portion of overall runtime. Thus limits scalability of this technique within a group of devices with high speed interconnects, such as GPUs with NVLinks in a node. This paper proposes a novel method, Flux, to significantly hide communication latencies with dependent computations for GPUs. Flux over-decomposes communication and computation operations into much finer-grained operations and further fuses them into a larger kernel to effectively hide communication without compromising kernel efficiency. Flux can potentially overlap up to 96% of communication given a fused kernel. Overall, it can achieve up to 1.24x speedups for training over Megatron-LM on a cluster of 128 GPUs with various GPU generations and interconnects, and up to 1.66x and 1.30x speedups for prefill and decoding inference over vLLM on a cluster with 8 GPUs with various GPU generations and interconnects.


title: On Sequences with at Most a Finite Number of Zero Coordinates

abstract: In this paper, we analyze the existence of algebraic and topological structures in the set of sequences that contain only a finite number of zero coordinates. Inspired by the work of Daniel Cariello and Juan B. Seoane-Sep\'ulveda, our research reveals new insights and complements their notable results beyond the classical \( \ell_p \) spaces for \( p \) in the interval from 1 to infinity, including the intriguing case where \( p \) is between 0 and 1. Our exploration employs notions such as S-lineability, pointwise lineability, and (alpha, beta)-spaceability. This investigation allowed us to verify, for instance, that the set \( F \setminus Z(F) \), where \( F \) is a closed subspace of \( \ell_p \) containing \( c_0 \), is (alpha, c)-spaceable if and only if alpha is finite.


title: Cluster GARCH

abstract: We introduce a novel multivariate GARCH model with flexible convolution-t distributions that is applicable in high-dimensional systems. The model is called Cluster GARCH because it can accommodate cluster structures in the conditional correlation matrix and in the tail dependencies. The expressions for the log-likelihood function and its derivatives are tractable, and the latter facilitate a score-drive model for the dynamic correlation structure. We apply the Cluster GARCH model to daily returns for 100 assets and find it outperforms existing models, both in-sample and out-of-sample. Moreover, the convolution-t distribution provides a better empirical performance than the conventional multivariate t-distribution.


title: Exploring flavour space of an economical SU(5) GUT in future proton decay measurements

abstract: We discuss the potential of future proton decay experiments on the exploration of the flavour space of grand unification. We focus on an economical SU(5) grand unified model (GUT) with the fermion sector extended by including only one copy of 24-plet. Neutrino masses are generated via type-(I+III) seesaw mechanism with the lightest neutrino massless. Gauge unification requires masses of fermions in the 24-plet to be hierarchical, in particular, the electroweak singlet and triplet heavy leptons to be around the canonical seesaw scale and TeV scale, respectively. We address how extra parameters in the flavour space which cannot be touched in flavour measurements can be tested by a multi-channel analysis in future proton decay measurements.


title: Dispersive interaction between two atoms in Proca Quantum Electrodynamics

abstract: We analyze the influence of a massive photon in the dispersive interaction between two atoms in their fundamental states. We work in the context of Proca Quantum Electrodynamics. The photon mass not only introduces a new length scale but also gives rise to a longitudinal polarization for the electromagnetic field. We obtain explicitly the interaction energy between the atoms for any distance regime and consider several particular cases. We show that, for a given interatomic distance, the greater the photon mass the better it is the non-retarded approximation.


title: Ollabench: Evaluating LLMs' Reasoning for Human-centric Interdependent Cybersecurity

abstract: Large Language Models (LLMs) have the potential to enhance Agent-Based Modeling by better representing complex interdependent cybersecurity systems, improving cybersecurity threat modeling and risk management. However, evaluating LLMs in this context is crucial for legal compliance and effective application development. Existing LLM evaluation frameworks often overlook the human factor and cognitive computing capabilities essential for interdependent cybersecurity. To address this gap, I propose OllaBench, a novel evaluation framework that assesses LLMs' accuracy, wastefulness, and consistency in answering scenario-based information security compliance and non-compliance questions. OllaBench is built on a foundation of 24 cognitive behavioral theories and empirical evidence from 38 peer-reviewed papers. OllaBench was used to evaluate 21 LLMs, including both open-weight and commercial models from OpenAI, Anthropic, Google, Microsoft, Meta and so on. The results reveal that while commercial LLMs have the highest overall accuracy scores, there is significant room for improvement. Smaller low-resolution open-weight LLMs are not far behind in performance, and there are significant differences in token efficiency and consistency among the evaluated models. OllaBench provides a user-friendly interface and supports a wide range of LLM platforms, making it a valuable tool for researchers and solution developers in the field of human-centric interdependent cybersecurity and beyond.


title: Validating LLM-Generated Programs with Metamorphic Prompt Testing

abstract: The latest paradigm shift in software development brings in the innovation and automation afforded by Large Language Models (LLMs), showcased by Generative Pre-trained Transformer (GPT), which has shown remarkable capacity to generate code autonomously, significantly reducing the manual effort required for various programming tasks. Although, the potential benefits of LLM-generated code are vast, most notably in efficiency and rapid prototyping, as LLMs become increasingly integrated into the software development lifecycle and hence the supply chain, complex and multifaceted challenges arise as the code generated from these language models carry profound questions on quality and correctness. Research is required to comprehensively explore these critical concerns surrounding LLM-generated code. In this paper, we propose a novel solution called metamorphic prompt testing to address these challenges. Our intuitive observation is that intrinsic consistency always exists among correct code pieces but may not exist among flawed code pieces, so we can detect flaws in the code by detecting inconsistencies. Therefore, we can vary a given prompt to multiple prompts with paraphrasing, and to ask the LLM to acquire multiple versions of generated code, so that we can validate whether the semantic relations still hold in the acquired code through cross-validation. Our evaluation on HumanEval shows that metamorphic prompt testing is able to detect 75 percent of the erroneous programs generated by GPT-4, with a false positive rate of 8.6 percent.


title: Eyeballing Combinatorial Problems: A Case Study of Using Multimodal Large Language Models to Solve Traveling Salesman Problems

abstract: Multimodal Large Language Models (MLLMs) have demonstrated proficiency in processing di-verse modalities, including text, images, and audio. These models leverage extensive pre-existing knowledge, enabling them to address complex problems with minimal to no specific training examples, as evidenced in few-shot and zero-shot in-context learning scenarios. This paper investigates the use of MLLMs' visual capabilities to 'eyeball' solutions for the Traveling Salesman Problem (TSP) by analyzing images of point distributions on a two-dimensional plane. Our experiments aimed to validate the hypothesis that MLLMs can effectively 'eyeball' viable TSP routes. The results from zero-shot, few-shot, self-ensemble, and self-refine zero-shot evaluations show promising outcomes. We anticipate that these findings will inspire further exploration into MLLMs' visual reasoning abilities to tackle other combinatorial problems.


title: On Lepton and Baryon Numbers as Local Gauge Symmetries

abstract: A simple theory where the total lepton number is a local gauge symmetry is proposed. In this context, the gauge anomalies are cancelled with the minimal number of extra fermionic fields and one predicts that the neutrinos are Majorana fermions. The properties of the neutrino sector are discussed showing that this theory predicts a $3+2$ light neutrino sector. We show that using the same fermionic fields one can gauge the baryon number and define a simple theory where the lepton and baryon numbers can be spontaneously broken at the low scale in agreement with experiments.


title: Electrically Tunable Magnetoconductance of Close-Packed CVD Bilayer Graphene Layer Stacking Walls

abstract: Quantum valley Hall (QVH) domain wall states are a new class of one-dimensional (1D) one-way conductors that are topologically protected in the absence of valley mixing. Development beyond a single QVH channel raises important new questions as to how QVH channels in close spatial proximity interact with each other, and how that interaction may be controlled. Scalable epitaxial bilayer graphene synthesis produces layer stacking wall (LSW) bundles, where QVH channels are bound, providing an excellent platform to study QVH channel interactions. Here we show that distinct strain sources lead to the formation of both well-separated LSWs and close packed LSW bundles. Comparative studies of electronic transport in these two regimes reveal that close-packed LSW bundles support electrically tunable magnetoconductance. The coexistence of different strain sources offers a potential pathway to realize scalable quantum transport platform based on LSWs where electrically tunability enables programmable functionality.


title: Causality for Complex Continuous-time Functional Longitudinal Studies with Dynamic Treatment Regimes

abstract: Causal inference in longitudinal studies is often hampered by treatment-confounder feedback. Existing methods typically assume discrete time steps or step-like data changes, which we term ``regular and irregular functional studies,'' limiting their applicability to studies with continuous monitoring data, like intensive care units or continuous glucose monitoring. These studies, which we formally term ``functional longitudinal studies,'' require new approaches. Moreover, existing methods tailored for ``functional longitudinal studies'' can only investigate static treatment regimes, which are independent of historical covariates or treatments, leading to either stringent parametric assumptions or strong positivity assumptions. This restriction has limited the range of causal questions these methods can answer and their practicality. We address these limitations by developing a nonparametric framework for functional longitudinal data, accommodating dynamic treatment regimes that depend on historical covariates or treatments, and may or may not depend on the actual treatment administered. To build intuition and explain our approach, we provide a comprehensive review of existing methods for regular and irregular longitudinal studies. We then formally define the potential outcomes and causal effects of interest, develop identification assumptions, and derive g-computation and inverse probability weighting formulas through novel applications of stochastic process and measure theory. Additionally, we compute the efficient influence curve using semiparametric theory. Our framework generalizes existing literature, and achieves double robustness under specific conditions. Finally, to aid interpretation, we provide sufficient and intuitive conditions for our identification assumptions, enhancing the applicability of our methodology to real-world scenarios.


title: Experimentally Tractable Generation of High-Order Rogue Waves in Bose-Einstein Condensates

abstract: In this work, we study a prototypical, experimentally accessible scenario that enables the systematic generation of so-called high-order rogue waves in atomic Bose-Einstein condensates. These waveforms lead to significantly and controllably more extreme focusing events than the famous Peregrine soliton. In one spatial dimension, we showcase conclusive numerical evidence that our scheme generates the focusing behavior associated with the first four rogue waves from the relevant hierarchy. We then extend considerations to anisotropic two-dimensional and even three-dimensional settings, establishing that the scheme can generate second order rogue waves despite the well-known limitation of finite-time blow up of focusing nonlinear Schr\"odinger equations.


title: What's in an embedding? Would a rose by any embedding smell as sweet?

abstract: Large Language Models (LLMs) are often criticized for lacking true "understanding" and the ability to "reason" with their knowledge, being seen merely as autocomplete systems. We believe that this assessment might be missing a nuanced insight. We suggest that LLMs do develop a kind of empirical "understanding" that is "geometry"-like, which seems adequate for a range of applications in NLP, computer vision, coding assistance, etc. However, this "geometric" understanding, built from incomplete and noisy data, makes them unreliable, difficult to generalize, and lacking in inference capabilities and explanations, similar to the challenges faced by heuristics-based expert systems decades ago. To overcome these limitations, we suggest that LLMs should be integrated with an "algebraic" representation of knowledge that includes symbolic AI elements used in expert systems. This integration aims to create large knowledge models (LKMs) that not only possess "deep" knowledge grounded in first principles, but also have the ability to reason and explain, mimicking human expert capabilities. To harness the full potential of generative AI safely and effectively, a paradigm shift is needed from LLM to more comprehensive LKM.


title: Microfluidic front dynamic for the characterization of pumps for long-term autonomous microsystems

abstract: To facilitate the use and portability of Lab on a chip technology, it is desirable to avoid the use of bulky electronic systems for flow control. Developed self-powered microsystems typically move only small volumes of fluid performing up to one or two hours. We have previously shown that polymeric micropumps combined with plastic microfluidic cartridges constitute a universal self-powered modular microfluidic architecture suitable for moving large volumes of fluids in short times. Herein, we show that polymeric micropumps can provide self-powered flow control for long periods of time in the range of hours and days. The calibration curves of various types of micropumps were obtained including one that maintained the movement of the fluid for 23 hours, advancing the fluid front up to 1.8 meters through a channel with a section of 0.127 mm2. We found that the actuation time of the pump was related to degassing time, the effective surface area and the air recovery rate of the pump. This is the first example of a long operating self-powered microsystem, which may have a great impact in those cases where controlled flow is needed for a long period of time and the use of electronic equipment is not desirable.


title: Revolutionizing Wireless Networks with Self-Supervised Learning: A Pathway to Intelligent Communications

abstract: With the rapid proliferation of mobile devices and data, next-generation wireless communication systems face stringent requirements for ultra-low latency, ultra-high reliability, and massive connectivity. Traditional AI-driven wireless network designs, while promising, often suffer from limitations such as dependency on labeled data and poor generalization. To address these challenges, we present an integration of self-supervised learning (SSL) into wireless networks. SSL leverages large volumes of unlabeled data to train models, enhancing scalability, adaptability, and generalization. This paper offers a comprehensive overview of SSL, categorizing its application scenarios in wireless network optimization and presenting a case study on its impact on semantic communication. Our findings highlight the potentials of SSL to significantly improve wireless network performance without extensive labeled data, paving the way for more intelligent and efficient communication systems.


title: Pushing the limits of the Cosmic Origin Spectrograph (COS) with an optimized background correction

abstract: Observations utilizing the ultraviolet capabilities of the Cosmic Origin Spectrograph (COS) onboard the Hubble Space Telescope are of unique value to the astronomy community. Spectroscopy down to 900 A with COS has enabled new science areas. However, contrary to the situation at longer wavelengths, these observations are limited by detector background noise. The background correction currently applied by the standard calibration pipeline (CalCOS) is not optimized for faint targets, limiting the scientific value of low signal-to-noise observations. In this work we investigate a possible dependence of the variations of the dark rate in both segments of the COS far-ultraviolet (FUV) detector on time, detector high voltage (HV), and solar activity. Through our analysis we identified a number of detector states (on a configuration basis, e.g., HV and segment) characterizing the spatial distribution of dark counts, and created superdarks to be used in an optimized 2-dimensional (2D) background correction. We have developed and tested Another COS Dark Correction (ACDC), a dedicated pipeline to perform a 2D background correction based on statistical methods, producing background-corrected and flux-calibrated spectra. While our testing of ACDC showed an average improvement in S/N values of ~10%, in a few cases the improvements in S/N reached 60% across the whole wavelength range of individual segments.


title: Joint Demonstration and Preference Learning Improves Policy Alignment with Human Feedback

abstract: Aligning human preference and value is an important requirement for building contemporary foundation models and embodied AI. However, popular approaches such as reinforcement learning with human feedback (RLHF) break down the task into successive stages, such as supervised fine-tuning (SFT), reward modeling (RM), and reinforcement learning (RL), each performing one specific learning task. Such a sequential approach results in serious issues such as significant under-utilization of data and distribution mismatch between the learned reward model and generated policy, which eventually lead to poor alignment performance. We develop a single stage approach named Alignment with Integrated Human Feedback (AIHF), capable of integrating both human preference and demonstration to train reward models and the policy. The proposed approach admits a suite of efficient algorithms, which can easily reduce to, and leverage, popular alignment algorithms such as RLHF and Directly Policy Optimization (DPO), and only requires minor changes to the existing alignment pipelines. We demonstrate the efficiency of the proposed solutions with extensive experiments involving alignment problems in LLMs and robotic control problems in MuJoCo. We observe that the proposed solutions outperform the existing alignment algorithms such as RLHF and DPO by large margins, especially when the amount of high-quality preference data is relatively limited.


title: Random Disks of Constant Curvature: the Lattice Story

abstract: We lay the groundwork for a UV-complete formulation of the Euclidean Jackiw-Teitelboim two-dimensional models of quantum gravity when the boundary lengths are finite, emphasizing the discretized approach. The picture that emerges is qualitatively new. For the disk topology, the problem reduces to counting so-called self-overlapping curves, that are closed loops that bound a distorted disk, with an appropriate multiplicity. We build a matrix model that does the correct counting. The theories in negative, zero and positive curvatures have the same UV description but drastically different macroscopic properties. The Schwarzian theory emerges in the limit of very large and negative cosmological constant in the negative curvature model, as an effective theory valid on distance scales much larger than the curvature length scale. In positive curvature, we argue that large geometries are ubiquitous and that the theory exists only for positive cosmological constant. Our discussion is pedagogical and includes a review of several relevant topics.


title: Boundedness for maximal operators over hypersurfaces in $\mathbb{R}^3$

abstract: In this article, we study maximal functions related to hypersurfaces with vanishing Gaussian curvature in $\mathbb{R}^3$. Firstly, we characterize the $L^p\rightarrow L^q$ boundedness of local maximal operators along homogeneous hypersurfaces. Moreover, weighted $L^p$-estimates are obtained for the corresponding global operators. Secondly, for a class of hypersurfaces that lack a homogeneous structure and pass through the origin, we attempt to look for other geometric properties instead of height of hypersurfaces to characterize the optimal $L^p$-boundedness of the corresponding global maximal operators.


title: Inclusive reactions from finite Minkowski spacetime correlation functions

abstract: The need to determine scattering amplitudes of few-hadron systems for arbitrary kinematics expands a broad set of subfields of modern-day nuclear and hadronic physics. In this work, we expand upon previous explorations on the use of real-time methods, like quantum computing or tensor networks, to determine few-body scattering amplitudes. Such calculations must be performed in a finite Minkowski spacetime, where scattering amplitudes are not well defined. Our previous work presented a conjecture of a systematically improvable estimator for scattering amplitudes constructed from finite-volume correlation functions. Here we provide further evidence that the prescription works for larger kinematic regions than previously explored as well as a broader class of scattering amplitudes. Finally, we devise a new method for estimating the order of magnitude of the error associated with finite time separations needed for such calculations. In units of the lightest mass of the theory, we find that to constrain amplitudes using real-time methods within $\mathcal{O}(10\%)$, the spacetime volumes must satisfy $mL \sim \mathcal{O}(10-10^2)$ and $ mT\sim \mathcal{O}(10^2-10^4)$.


title: Modeling language contact with the Iterated Learning Model

abstract: Contact between languages has the potential to transmit vocabulary and other language features; however, this does not always happen. Here, an iterated learning model is used to examine, in a simple way, the resistance of languages to change during language contact. Iterated learning models are agent-based models of language change, they demonstrate that languages that are expressive and compositional arise spontaneously as a consequence of a language transmission bottleneck. A recently introduced type of iterated learning model, the Semi-Supervised ILM is used to simulate language contact. These simulations do not include many of the complex factors involved in language contact and do not model a population of speakers; nonetheless the model demonstrates that the dynamics which lead languages in the model to spontaneously become expressive and compositional, also cause a language to maintain its core traits even after mixing with another language.


title: SpikePipe: Accelerated Training of Spiking Neural Networks via Inter-Layer Pipelining and Multiprocessor Scheduling

abstract: Spiking Neural Networks (SNNs) have gained popularity due to their high energy efficiency. Prior works have proposed various methods for training SNNs, including backpropagation-based methods. Training SNNs is computationally expensive compared to their conventional counterparts and would benefit from multiprocessor hardware acceleration. This is the first paper to propose inter-layer pipelining to accelerate training in SNNs using systolic array-based processors and multiprocessor scheduling. The impact of training using delayed gradients is observed using three networks training on different datasets, showing no degradation for small networks and < 10% degradation for large networks. The mapping of various training tasks of the SNN onto systolic arrays is formulated, and the proposed scheduling method is evaluated on the three networks. The results are compared against standard pipelining algorithms. The results show that the proposed method achieves an average speedup of 1.6X compared to standard pipelining algorithms, with an upwards of 2X improvement in some cases. The incurred communication overhead due to the proposed method is less than 0.5% of the total required communication of training.


title: Multi-Objective Sizing Optimization Method of Microgrid Considering Cost and Carbon Emissions

abstract: Microgrid serves as a promising solution to integrate and manage distributed renewable energy resources. In this paper, we establish a stochastic multi-objective sizing optimization (SMOSO) model for microgrid planning, which fully captures the battery degradation characteristics and the total carbon emissions. The microgrid operator aims to simultaneously maximize the economic benefits and minimize carbon emissions, and the degradation of the battery energy storage system (BESS) is modeled as a nonlinear function of power throughput. A self-adaptive multi-objective genetic algorithm (SAMOGA) is proposed to solve the SMOSO model, and this algorithm is enhanced by pre-grouped hierarchical selection and self-adaptive probabilities of crossover and mutation. Several case studies are conducted to determine the microgrid size by analyzing Pareto frontiers, and the simulation results validate that the proposed method has superior performance over other algorithms on the solution quality of optimum and diversity.


title: Pseudo-Entanglement is Necessary for EFI Pairs

abstract: Regarding minimal assumptions, most of classical cryptography is known to depend on the existence of One-Way Functions (OWFs). However, recent evidence has shown that this is not the case when considering quantum resources. Besides the well known unconditional security of Quantum Key Distribution, it is now known that computational cryptography may be built on weaker primitives than OWFs, e.g., pseudo-random states [JLS18], one-way state generators [MY23], or EFI pairs of states [BCQ23]. We consider a new quantum resource, pseudo-entanglement, and show that the existence of EFI pairs, one of the current main candidates for the weakest computational assumption for cryptography (necessary for commitments, oblivious transfer, secure multi-party computation, computational zero-knowledge proofs), implies the existence of pseudo-entanglement, as defined by [ABF+24, ABV23] under some reasonable adaptations. We prove this by constructing a new family of pseudo-entangled quantum states given only EFI pairs. Our result has important implications for the field of computational cryptography. It shows that if pseudo-entanglement does not exist, then most of cryptography cannot exist either. Moreover, it establishes pseudo-entanglement as a new minimal assumption for most of computational cryptography, which may pave the way for the unification of other assumptions into a single primitive. Finally, pseudo-entanglement connects physical phenomena and efficient computation, thus, our result strengthens the connection between cryptography and the physical world.


title: A Characterization for Tightness of the Sparse Moment-SOS Hierarchy

abstract: This paper studies the sparse Moment-SOS hierarchy of relaxations for solving sparse polynomial optimization problems. We show that this sparse hierarchy is tight if and only if the objective can be written as a sum of sparse nonnegative polynomials, each of which belongs to the sum of the ideal and quadratic module generated by the corresponding sparse constraints. Based on this characterization, we give several sufficient conditions for the sparse Moment-SOS hierarchy to be tight. In particular, we show that this sparse hierarchy is tight under some assumptions such as convexity, optimality conditions or finiteness of constraining sets.


title: A way to identify whether a DFT gap is from right reasons or error cancellations: The case of copper chalcogenides

abstract: Gap opening remains elusive in copper chalcogenides (Cu$_{2}X$, $X$ = S, Se and Te), not least because Hubbard + $U$, hybrid functional and ${GW}$ methods have also failed. In this work, we elucidate that their failure originates from a severe underestimation of the 4$s$-3$d$ orbital splitting of the Cu atom, which leads to a band-order inversion in the presence of an anionic crystal field. As a result, the Fermi energy is pinned due to symmetry, yielding an invariant zero gap. Utilizing the hybrid pseudopotentials to correct the underestimation on the atomic side opens up gaps of experimental magnitude in Cu$_{2}X$, suggesting their predominantly electronic nature. Our work not only clarifies the debate about the Cu$_{2}X$ gap, but also provides a way to identify which of the different methods really captures the physical essence and which is the result of error cancellation.


title: Szemer\'edi-Trotter bounds for tubes and applications

abstract: We prove sharp estimates for incidences involving planar tubes that satisfy packing conditions. We apply them to improve the estimates for the Fourier transform of fractal measures supported on planar curves.


title: The Prevalence of Resonance Among Young, Close-in Planets

abstract: Multiple planets undergoing disk migration may be captured into a chain of mean-motion resonances with the innermost planet parked near the disk's inner edge. Subsequent dynamical evolution may disrupt these resonances, leading to the non-resonant configurations typically observed among {\it Kepler} planets that are Gyrs old. In this scenario, resonant configurations are expected to be more common in younger systems. This prediction can now be tested, thanks to recent discoveries of young planets, particularly those in stellar clusters, by NASA's {\it TESS} mission. We divided the known planetary systems into three age groups: young ($<$100-Myr-old), adolescent (0.1-1-Gyr-old), and mature ($>1$-Gyr-old). The fraction of neighboring planet pairs having period ratios within a few percent of a first-order commensurability (e.g.~4:3, 3:2, or 2:1) is 70$\pm$15\% for young pairs, 24$\pm$8\% for adolescent pairs, and 15$\pm$2\% for mature pairs. The fraction of systems with at least one nearly commensurable pair (either first or second-order) is 86$\pm13$\% among young systems, 38$\pm12$\% for adolescent systems, and 23$\pm3$\% for mature systems. First-order commensurabilities prevail across all age groups, with an admixture of second-order commensurabilities. Commensurabilities are more common in systems with high planet multiplicity and low mutual inclinations. Observed period ratios often deviate from perfect commensurability by $\sim$1\% even among young planets, too large to be explained by resonant repulsion with equilibrium eccentricity tides. We also find that super-Earths in the radius gap ($1.5-1.9R_\oplus$) are less likely to be near-resonant (11.9$\pm2.0\%$) compared to Earth-sized planets ($R_p<1R_\oplus$; 25.3$\pm4.4\%$) or mini-Neptunes ($1.9R_\oplus \leq R_p<2.5R_\oplus$; 14.4$\pm1.8\%$).


title: Enabling Data Dependency-based Query Optimization

abstract: Data dependency-based query optimization techniques can considerably improve database system performance: we apply three such optimization techniques to five database management systems (DBMSs) and observe throughput improvements between 5 % and 33 %. We address two key challenges to achieve these results: (i) efficiently identifying and extracting relevant dependencies from the data, and (ii) making use of the dependencies through SQL rewrites or as transformation rules in the optimizer. First, the schema does not provide all relevant dependencies. We present a workload-driven dependency discovery approach to find additional dependencies within milliseconds. Second, the throughput improvement of a state-of-the-art DBMS is 13 % using only SQL rewrites, but 20 % when we integrate dependency-based optimization into the optimizer and execution engine, e. g., by employing dependency propagation and subquery handling. Using all relevant dependencies, the runtime of four standard benchmarks improves by up to 10 % compared to using only primary and foreign keys, and up to 22 % compared to not using dependencies. The dependency discovery overhead amortizes after a single workload execution.


title: PLUM: Preference Learning Plus Test Cases Yields Better Code Language Models

abstract: Instruction-finetuned code language models (LMs) have shown promise in various programming tasks. They are trained, using a language modeling objective, on natural language instructions and gold code snippet pairs. Recent evidence suggests that these models, never exposed to incorrect solutions during training, often struggle to distinguish between correct and incorrect solutions. This observation raises our inquiry: Can preference learning, which trains models to prefer correct solutions over incorrect ones, help push the boundaries of code LMs even further? We propose PLUM, a novel \textbf{p}reference \textbf{l}earning framework a\textbf{u}gmented with test cases tailored for code L\textbf{M}s.PLUM aims to investigate the key success factors and potential benefits of preference learning in code LMs, which remain elusive despite its success in aligning LMs with human values. PLUM consists of three stages: (1) Generating test cases for natural language instructions, (2) sampling candidate solutions from the policy and evaluating them against the test cases to create a preference dataset, which is then used to (3) train the policy with a preference learning algorithm. Experiments demonstrate that PLUM substantially improves the performance of existing code LMs on established code generation benchmarks such as HumanEval (+) and MBPP (+), even for the state-of-the-art open-source language model CodeQwen-1.5-7B-Chat. PLUM complements the supervised fine-tuning (SFT) stage, demonstrating synergistic effects.


title: A Subjective Quality Evaluation of 3D Mesh with Dynamic Level of Detail in Virtual Reality

abstract: 3D meshes are one of the main components of Virtual Reality applications. However, many network and computational resources are required to process 3D meshes in real-time. A potential solution to this challenge is to dynamically adapt the Level of Detail (LoD) of a 3D mesh based on the object's position and the user's viewpoint. In this paper, we conduct a subjective study to investigate users' quality perception of 3D meshes with dynamic Level of Detail in a Virtual Reality environment. The subjective experiment is carried out with five 3D meshes of different characteristics, four Levels of Detail, and four distance settings. The results of the experiment show that the impact of the dynamic level of detail depends on both the position of the 3D object in the virtual world and the number of vertices of the original mesh. In addition, we present a quality model that can accurately predict the MOS score of a LoD version of a 3D mesh from the number of vertices and the distance from the viewpoint.