title: Scalable and Configurable Tracking for Any Rowhammer Threshold

abstract: The Rowhammer vulnerability continues to get worse, with the Rowhammer Threshold (TRH) reducing from 139K activations to 4.8K activations over the last decade. Typical Rowhammer mitigations rely on tracking aggressor rows. The number of possible aggressors increases with lowering thresholds, making it difficult to reliably track such rows in a storage-efficient manner. At lower thresholds, academic trackers such as Graphene require prohibitive SRAM overheads (hundreds of KBs to MB). Recent in-DRAM trackers from industry, such as DSAC-TRR, perform approximate tracking, sacrificing guaranteed protection for reduced storage overheads, leaving DRAM vulnerable to Rowhammer attacks. Ideally, we seek a scalable tracker that tracks securely and precisely, and incurs negligible dedicated SRAM and performance overheads, while still being able to track arbitrarily low thresholds. To that end, we propose START - a Scalable Tracker for Any Rowhammer Threshold. Rather than relying on dedicated SRAM structures, START dynamically repurposes a small fraction the Last-Level Cache (LLC) to store tracking metadata. START is based on the observation that while the memory contains millions of rows, typical workloads touch only a small subset of rows within a refresh period of 64ms, so allocating tracking entries on demand significantly reduces storage. If the application does not access many rows in memory, START does not reserve any LLC capacity. Otherwise, START dynamically uses 1-way, 2-way, or 8-way of the cache set based on demand. START consumes, on average, 9.4% of the LLC capacity to store metadata, which is 5x lower compared to dedicating a counter in LLC for each row in memory. We also propose START-M, a memory-mapped START for large-memory systems. Our designs require only 4KB SRAM for newly added structures and perform within 1% of idealized tracking even at TRH of less than 100.


title: QCMATH: Mathematica modules for electronic structure calculations

abstract: We introduce \textsc{qcmath}, a user-friendly quantum chemistry software tailored for electronic structure calculations, implemented using the Wolfram Mathematica language and available at \url{https://github.com/LCPQ/qcmath}. This software, designed with accessibility in mind, takes advantage of the symbolic capabilities intrinsic to Mathematica. Its primary goal is to provide a supportive environment for newcomers to the field of quantum chemistry, enabling them to easily conceptualize, develop, and test their own ideas. The functionalities of \textsc{qcmath} encompass a broad spectrum of methods, catering to both ground- and excited-state calculations. We provide a comprehensive overview of these capabilities, complemented by essential theoretical insights. To facilitate ease of use, we offer an exhaustive blueprint of the software's architecture. Furthermore, we provide users with comprehensive guides, addressing both the operational aspects and the more intricate programming facets of \textsc{qcmath}.

categories: physics.chem-ph cond-mat.str-el nucl-th physics.comp-ph


title: Mass formula for non-ordinary curves in one dimensional families

abstract: This paper is about one dimensional families of cyclic covers of the projective line in positive characteristic. For each such family, we study the mass formula for the number of non-ordinary curves in the family. We prove two equations for the mass formula: the first relies on tautological intersection theory; and the second relies on the $a$-numbers of non-ordinary curves in the family. Our results generalize the Eichler--Deuring mass formula for supersingular elliptic curves; they also generalize some theorems of Ibukiyama, Katsura, and Oort about supersingular curves of genus $2$ that have an automorphism of order $3$ or order $4$. We determine the mass formula in many new cases, including linearized families of hyperelliptic curves of every genus and all families of cyclic covers of the projective line branched at four points. For certain families of curves of genus $3$ to $7$, we determine the exact rate of growth of the number of non-ordinary curves in the family as a linear function of the characteristic $p$. keywords: curve, hyperelliptic curve, cyclic cover, Jacobian, mass formula, cycle class, tautological ring, Hodge bundle, intersection theory, Frobenius, non-ordinary, $p$-rank, $a$-number.


title: Perturbation theory analysis of the strain-dependent superconducting phase diagram for Sr$_2$RuO$_4$

abstract: Previously, it was shown that a superconducting state dominated by singlet $d_{x^2-y^2}$ intra-band pairs emerges from the fluctuation exchange approximation (FLEX) applied to a realistic model for Sr$_2$RuO$_4$, a result that is increasingly in alignment with experimental data. Here we apply FLEX to model the strain-dependent phase diagram of Sr$_2$RuO$_4$ and show that we are able to reproduce its unusual features. This adds weight to the argument that a predominantly $d_{x^2-y^2}$ singlet pairing state represents a reasonable starting point for describing the superconducting properties of Sr$_2$RuO$_4$.


title: When hard negative sampling meets supervised contrastive learning

abstract: State-of-the-art image models predominantly follow a two-stage strategy: pre-training on large datasets and fine-tuning with cross-entropy loss. Many studies have shown that using cross-entropy can result in sub-optimal generalisation and stability. While the supervised contrastive loss addresses some limitations of cross-entropy loss by focusing on intra-class similarities and inter-class differences, it neglects the importance of hard negative mining. We propose that models will benefit from performance improvement by weighting negative samples based on their dissimilarity to positive counterparts. In this paper, we introduce a new supervised contrastive learning objective, SCHaNe, which incorporates hard negative sampling during the fine-tuning phase. Without requiring specialized architectures, additional data, or extra computational resources, experimental results indicate that SCHaNe outperforms the strong baseline BEiT-3 in Top-1 accuracy across various benchmarks, with significant gains of up to $3.32\%$ in few-shot learning settings and $3.41\%$ in full dataset fine-tuning. Importantly, our proposed objective sets a new state-of-the-art for base models on ImageNet-1k, achieving an 86.14\% accuracy. Furthermore, we demonstrate that the proposed objective yields better embeddings and explains the improved effectiveness observed in our experiments.


title: Multiscale Contextual Learning for Speech Emotion Recognition in Emergency Call Center Conversations

abstract: Emotion recognition in conversations is essential for ensuring advanced human-machine interactions. However, creating robust and accurate emotion recognition systems in real life is challenging, mainly due to the scarcity of emotion datasets collected in the wild and the inability to take into account the dialogue context. The CEMO dataset, composed of conversations between agents and patients during emergency calls to a French call center, fills this gap. The nature of these interactions highlights the role of the emotional flow of the conversation in predicting patient emotions, as context can often make a difference in understanding actual feelings. This paper presents a multi-scale conversational context learning approach for speech emotion recognition, which takes advantage of this hypothesis. We investigated this approach on both speech transcriptions and acoustic segments. Experimentally, our method uses the previous or next information of the targeted segment. In the text domain, we tested the context window using a wide range of tokens (from 10 to 100) and at the speech turns level, considering inputs from both the same and opposing speakers. According to our tests, the context derived from previous tokens has a more significant influence on accurate prediction than the following tokens. Furthermore, taking the last speech turn of the same speaker in the conversation seems useful. In the acoustic domain, we conducted an in-depth analysis of the impact of the surrounding emotions on the prediction. While multi-scale conversational context learning using Transformers can enhance performance in the textual modality for emergency call recordings, incorporating acoustic context is more challenging.


title: Conformal Meta-learners for Predictive Inference of Individual Treatment Effects

abstract: We investigate the problem of machine learning-based (ML) predictive inference on individual treatment effects (ITEs). Previous work has focused primarily on developing ML-based meta-learners that can provide point estimates of the conditional average treatment effect (CATE); these are model-agnostic approaches for combining intermediate nuisance estimates to produce estimates of CATE. In this paper, we develop conformal meta-learners, a general framework for issuing predictive intervals for ITEs by applying the standard conformal prediction (CP) procedure on top of CATE meta-learners. We focus on a broad class of meta-learners based on two-stage pseudo-outcome regression and develop a stochastic ordering framework to study their validity. We show that inference with conformal meta-learners is marginally valid if their (pseudo outcome) conformity scores stochastically dominate oracle conformity scores evaluated on the unobserved ITEs. Additionally, we prove that commonly used CATE meta-learners, such as the doubly-robust learner, satisfy a model- and distribution-free stochastic (or convex) dominance condition, making their conformal inferences valid for practically-relevant levels of target coverage. Whereas existing procedures conduct inference on nuisance parameters (i.e., potential outcomes) via weighted CP, conformal meta-learners enable direct inference on the target parameter (ITE). Numerical experiments show that conformal meta-learners provide valid intervals with competitive efficiency while retaining the favorable point estimation properties of CATE meta-learners.


title: Buoyancy response of a disk to an embedded planet: a cross-code comparison at high resolution

abstract: In radiatively inefficient, laminar protoplanetary disks, embedded planets can excite a buoyancy response as gas gets deflected vertically near the planet. This results in vertical oscillations that drive a vortensity growth in the planet's corotating region, speeding up inward migration in the type-I regime. We present a comparison between PLUTO/IDEFIX and FARGO3D using 3D, inviscid, adiabatic numerical simulations of planet-disk interaction that feature the buoyancy response of the disk, and show that PLUTO/IDEFIX struggle to resolve higher-order modes of the buoyancy-related oscillations, weakening vortensity growth and the associated torque. We interpret this as a drawback of total-energy-conserving, finite-volume schemes. Our results indicate that a very high resolution or high-order scheme is required in shock-capturing codes in order to adequately capture this effect.


title: Statistically Efficient Variance Reduction with Double Policy Estimation for Off-Policy Evaluation in Sequence-Modeled Reinforcement Learning

abstract: Offline reinforcement learning aims to utilize datasets of previously gathered environment-action interaction records to learn a policy without access to the real environment. Recent work has shown that offline reinforcement learning can be formulated as a sequence modeling problem and solved via supervised learning with approaches such as decision transformer. While these sequence-based methods achieve competitive results over return-to-go methods, especially on tasks that require longer episodes or with scarce rewards, importance sampling is not considered to correct the policy bias when dealing with off-policy data, mainly due to the absence of behavior policy and the use of deterministic evaluation policies. To this end, we propose DPE: an RL algorithm that blends offline sequence modeling and offline reinforcement learning with Double Policy Estimation (DPE) in a unified framework with statistically proven properties on variance reduction. We validate our method in multiple tasks of OpenAI Gym with D4RL benchmarks. Our method brings a performance improvements on selected methods which outperforms SOTA baselines in several tasks, demonstrating the advantages of enabling double policy estimation for sequence-modeled reinforcement learning.


title: Proceedings 39th International Conference on Logic Programming

abstract: This volume contains the Technical Communications presented at the 39th International Conference on Logic Programming (ICLP 2023), held at Imperial College London, UK from July 9 to July 15, 2023. Technical Communications included here concern the Main Track, the Doctoral Consortium, the Application and Systems/Demo track, the Recently Published Research Track, the Birds-of-a-Feather track, the Thematic Tracks on Logic Programming and Machine Learning, and Logic Programming and Explainability, Ethics, and Trustworthiness.


title: RobustCLEVR: A Benchmark and Framework for Evaluating Robustness in Object-centric Learning

abstract: Object-centric representation learning offers the potential to overcome limitations of image-level representations by explicitly parsing image scenes into their constituent components. While image-level representations typically lack robustness to natural image corruptions, the robustness of object-centric methods remains largely untested. To address this gap, we present the RobustCLEVR benchmark dataset and evaluation framework. Our framework takes a novel approach to evaluating robustness by enabling the specification of causal dependencies in the image generation process grounded in expert knowledge and capable of producing a wide range of image corruptions unattainable in existing robustness evaluations. Using our framework, we define several causal models of the image corruption process which explicitly encode assumptions about the causal relationships and distributions of each corruption type. We generate dataset variants for each causal model on which we evaluate state-of-the-art object-centric methods. Overall, we find that object-centric methods are not inherently robust to image corruptions. Our causal evaluation approach exposes model sensitivities not observed using conventional evaluation processes, yielding greater insight into robustness differences across algorithms. Lastly, while conventional robustness evaluations view corruptions as out-of-distribution, we use our causal framework to show that even training on in-distribution image corruptions does not guarantee increased model robustness. This work provides a step towards more concrete and substantiated understanding of model performance and deterioration under complex corruption processes of the real-world.


title: BIT: Bi-Level Temporal Modeling for Efficient Supervised Action Segmentation

abstract: We address the task of supervised action segmentation which aims to partition a video into non-overlapping segments, each representing a different action. Recent works apply transformers to perform temporal modeling at the frame-level, which suffer from high computational cost and cannot well capture action dependencies over long temporal horizons. To address these issues, we propose an efficient BI-level Temporal modeling (BIT) framework that learns explicit action tokens to represent action segments, in parallel performs temporal modeling on frame and action levels, while maintaining a low computational cost. Our model contains (i) a frame branch that uses convolution to learn frame-level relationships, (ii) an action branch that uses transformer to learn action-level dependencies with a small set of action tokens and (iii) cross-attentions to allow communication between the two branches. We apply and extend a set-prediction objective to allow each action token to represent one or multiple action segments, thus can avoid learning a large number of tokens over long videos with many segments. Thanks to the design of our action branch, we can also seamlessly leverage textual transcripts of videos (when available) to help action segmentation by using them to initialize the action tokens. We evaluate our model on four video datasets (two egocentric and two third-person) for action segmentation with and without transcripts, showing that BIT significantly improves the state-of-the-art accuracy with much lower computational cost (30 times faster) compared to existing transformer-based methods.


title: On minimal subshifts of linear word complexity with slope less than 3/2

abstract: We prove that every infinite minimal subshift with word complexity $p(q)$ satisfying $\limsup p(q)/q < 3/2$ is measure-theoretically isomorphic to its maximal equicontinuous factor; in particular, it has measurably discrete spectrum. Among other applications, this provides a proof of Sarnak's conjecture for all subshifts with $\limsup p(q)/q < 3/2$ (which can be thought of as a much stronger version of zero entropy). As in \cite{creutzpavlov}, our main technique is proving that all low-complexity minimal subshifts have a specific type of representation via a sequence $\{\tau_k\}$ of substitutions, usually called an S-adic decomposition. The maximal equicontinuous factor is the product of an odometer with a rotation on a compact abelian connected one-dimensional group, for which we can give an explicit description in terms of the substitutions $\tau_k$. We also prove that all such odometers and groups may appear for minimal subshifts with $\limsup p(q)/q = 1$, demonstrating that lower complexity thresholds do not further restrict the possible structure.


title: Ad-Rec: Advanced Feature Interactions to Address Covariate-Shifts in Recommendation Networks

abstract: Recommendation models are vital in delivering personalized user experiences by leveraging the correlation between multiple input features. However, deep learning-based recommendation models often face challenges due to evolving user behaviour and item features, leading to covariate shifts. Effective cross-feature learning is crucial to handle data distribution drift and adapting to changing user behaviour. Traditional feature interaction techniques have limitations in achieving optimal performance in this context. This work introduces Ad-Rec, an advanced network that leverages feature interaction techniques to address covariate shifts. This helps eliminate irrelevant interactions in recommendation tasks. Ad-Rec leverages masked transformers to enable the learning of higher-order cross-features while mitigating the impact of data distribution drift. Our approach improves model quality, accelerates convergence, and reduces training time, as measured by the Area Under Curve (AUC) metric. We demonstrate the scalability of Ad-Rec and its ability to achieve superior model quality through comprehensive ablation studies.


title: MEMORY-VQ: Compression for Tractable Internet-Scale Memory

abstract: Retrieval augmentation is a powerful but expensive method to make language models more knowledgeable about the world. Memory-based methods like LUMEN pre-compute token representations for retrieved passages to drastically speed up inference. However, memory also leads to much greater storage requirements from storing pre-computed representations. We propose MEMORY-VQ, a new method to reduce storage requirements of memory-augmented models without sacrificing performance. Our method uses a vector quantization variational autoencoder (VQ-VAE) to compress token representations. We apply MEMORY-VQ to the LUMEN model to obtain LUMEN-VQ, a memory model that achieves a 16x compression rate with comparable performance on the KILT benchmark. LUMEN-VQ enables practical retrieval augmentation even for extremely large retrieval corpora.


title: Maturity-Aware Active Learning for Semantic Segmentation with Hierarchically-Adaptive Sample Assessment

abstract: Active Learning (AL) for semantic segmentation is challenging due to heavy class imbalance and different ways of defining "sample" (pixels, areas, etc.), leaving the interpretation of the data distribution ambiguous. We propose "Maturity-Aware Distribution Breakdown-based Active Learning'' (MADBAL), an AL method that benefits from a hierarchical approach to define a multiview data distribution, which takes into account the different "sample" definitions jointly, hence able to select the most impactful segmentation pixels with comprehensive understanding. MADBAL also features a novel uncertainty formulation, where AL supporting modules are included to sense the features' maturity whose weighted influence continuously contributes to the uncertainty detection. In this way, MADBAL makes significant performance leaps even in the early AL stage, hence reducing the training burden significantly. It outperforms state-of-the-art methods on Cityscapes and PASCAL VOC datasets as verified in our extensive experiments.


title: Neural approaches to spoken content embedding

abstract: Comparing spoken segments is a central operation to speech processing. Traditional approaches in this area have favored frame-level dynamic programming algorithms, such as dynamic time warping, because they require no supervision, but they are limited in performance and efficiency. As an alternative, acoustic word embeddings -- fixed-dimensional vector representations of variable-length spoken word segments -- have begun to be considered for such tasks as well. However, the current space of such discriminative embedding models, training approaches, and their application to real-world downstream tasks is limited. We start by considering ``single-view" training losses where the goal is to learn an acoustic word embedding model that separates same-word and different-word spoken segment pairs. Then, we consider ``multi-view" contrastive losses. In this setting, acoustic word embeddings are learned jointly with embeddings of character sequences to generate acoustically grounded embeddings of written words, or acoustically grounded word embeddings. In this thesis, we contribute new discriminative acoustic word embedding (AWE) and acoustically grounded word embedding (AGWE) approaches based on recurrent neural networks (RNNs). We improve model training in terms of both efficiency and performance. We take these developments beyond English to several low-resource languages and show that multilingual training improves performance when labeled data is limited. We apply our embedding models, both monolingual and multilingual, to the downstream tasks of query-by-example speech search and automatic speech recognition. Finally, we show how our embedding approaches compare with and complement more recent self-supervised speech models.


abstract: In real-world scenarios like traffic and energy, massive time-series data with missing values and noises are widely observed, even sampled irregularly. While many imputation methods have been proposed, most of them work with a local horizon, which means models are trained by splitting the long sequence into batches of fit-sized patches. This local horizon can make models ignore global trends or periodic patterns. More importantly, almost all methods assume the observations are sampled at regular time stamps, and fail to handle complex irregular sampled time series arising from different applications. Thirdly, most existing methods are learned in an offline manner. Thus, it is not suitable for many applications with fast-arriving streaming data. To overcome these limitations, we propose BayOTIDE: Bayesian Online Multivariate Time series Imputation with functional decomposition. We treat the multivariate time series as the weighted combination of groups of low-rank temporal factors with different patterns. We apply a group of Gaussian Processes (GPs) with different kernels as functional priors to fit the factors. For computational efficiency, we further convert the GPs into a state-space prior by constructing an equivalent stochastic differential equation (SDE), and developing a scalable algorithm for online inference. The proposed method can not only handle imputation over arbitrary time stamps, but also offer uncertainty quantification and interpretability for the downstream application. We evaluate our method on both synthetic and real-world datasets.We release the code at {https://github.com/xuangu-fang/BayOTIDE}


title: Randomized Line-to-Row Mapping for Low-Overhead Rowhammer Mitigations

abstract: Modern systems mitigate Rowhammer using victim refresh, which refreshes the two neighbours of an aggressor row when it encounters a specified number of activations. Unfortunately, complex attack patterns like Half-Double break victim-refresh, rendering current systems vulnerable. Instead, recently proposed secure Rowhammer mitigations rely on performing mitigative action on the aggressor rather than the victims. Such schemes employ mitigative actions such as row-migration or access-control and include AQUA, SRS, and Blockhammer. While these schemes incur only modest slowdowns at Rowhammer thresholds of few thousand, they incur prohibitive slowdowns (15%-600%) for lower thresholds that are likely in the near future. The goal of our paper is to make secure Rowhammer mitigations practical at such low thresholds. Our paper provides the key insights that benign application encounter thousands of hot rows (receiving more activations than the threshold) due to the memory mapping, which places spatially proximate lines in the same row to maximize row-buffer hitrate. Unfortunately, this causes row to receive activations for many frequently used lines. We propose Rubix, which breaks the spatial correlation in the line-to-row mapping by using an encrypted address to access the memory, reducing the likelihood of hot rows by 2 to 3 orders of magnitude. To aid row-buffer hits, Rubix randomizes a group of 1-4 lines. We also propose Rubix-D, which dynamically changes the line-to-row mapping. Rubix-D minimizes hot-rows and makes it much harder for an adversary to learn the spatial neighbourhood of a row. Rubix reduces the slowdown of AQUA (from 15% to 1%), SRS (from 60% to 2%), and Blockhammer (from 600% to 3%) while incurring a storage of less than 1 Kilobyte.


title: The Stochastic Gravitational-Wave Background from Primordial Black Holes in R-Symmetric $SU(5)$ Inflation

abstract: This study explores the realization of nonminimally coupled Higgs inflation in the context of no-scale supergravity, investigates the formation of primordial black holes, and examines the potential for observable proton decay within the framework of the R-symmetric $SU(5)$ model. For inflation, both single and multifield scenarios are investigated. The prediction of the single-field model for the tensor-to-scalar ratio, $r$, is approximately $10^{-3}$, and the scalar spectral index falls within Plank's 1$\sigma$ range. The running of the scalar spectral index, $-{dn_{s}}/{d\ln{k}}$, is approximately $10^{-4}$. A realistic scenario of reheating and non-thermal leptogenesis is employed with reheat temperature $T_r\sim10^9$ GeV. In the multifield case, we mainly focus on Primordial Black Holes (PBHs) and Gravitational Waves (GWs). In this inflationary framework, we demonstrate how a suitable choice of parameters can result in an enhanced scalar power spectrum, leading to the production of primordial black holes (PBHs) capable of fully accounting for dark matter. We also show that this scenario leads to Scalar Induced Gravitational Waves (SIGW) which can be detected in current and future GW detectors. We explore different proton decay channels to look for observable predictions for the next-generation proton decay experiments Hyper-K and DUNE consistent with gauge coupling unification and cosmological bounds.


title: Pruning Self-Attention for Zero-Shot Multi-Speaker Text-to-Speech

abstract: For personalized speech generation, a neural text-to-speech (TTS) model must be successfully implemented with limited data from a target speaker. To this end, the baseline TTS model needs to be amply generalized to out-of-domain data (i.e., target speaker's speech). However, approaches to address this out-of-domain generalization problem in TTS have yet to be thoroughly studied. In this work, we propose an effective pruning method for a transformer known as sparse attention, to improve the TTS model's generalization abilities. In particular, we prune off redundant connections from self-attention layers whose attention weights are below the threshold. To flexibly determine the pruning strength for searching optimal degree of generalization, we also propose a new differentiable pruning method that allows the model to automatically learn the thresholds. Evaluations on zero-shot multi-speaker TTS verify the effectiveness of our method in terms of voice quality and speaker similarity.


title: Magnetically threaded accretion disks in resistive magnetohydrodynamic simulations and asymptotic expansion

abstract: Aims. A realistic model of magnetic linkage between a central object and its accretion disk is a prerequisite for understanding the spin history of stars and stellar remnants. To this end, we aim to provide an analytic model in agreement with magnetohydrodynamic (MHD) simulations. Methods. For the first time, we wrote a full set of stationary asymptotic expansion equations of a thin magnetic accretion disk, including the induction and energy equations. We also performed a resistive MHD simulation of an accretion disk around a star endowed with a magnetic dipole, using the publicly available code PLUTO. We compared the analytical results with the numerical solutions, and discussed the results in the context of previous solutions of the induction equation describing the star-disk magnetospheric interaction. Results. We found that the magnetic field threading the disk is suppressed by orders of magnitude inside thin disks, so the presence of the stellar magnetic field does not strongly affect the velocity field, nor the density profile inside the disk. Density and velocity fields found in the MHD simulations match the radial and vertical profiles of the analytic solution. Qualitatively, the MHD simulations result in an internal magnetic field similar to the solutions previously obtained by solving the induction equation in the disk alone. However, the magnetic field configuration is quantitatively affected by magnetic field inflation outside the disk; this is reflected in the net torque. The torque on the star is an order of magnitude larger in the magnetic than in the non-magnetic case. Spin-up of the star occurs on a timescale comparable to the accretion timescale in the MHD case, and is an order of magnitude slower in the absence of a stellar magnetic field.


title: The multiplication table constant and sums of two squares

abstract: We will show that the number of integers $\leq x$ that can be written as the square of an integer plus the square of a prime equals $\frac{\pi}{2} \cdot \frac {x}{\log x}$ minus a secondary term of size $x/(\log x)^{ 1+\delta+o(1)}$, where $\delta := 1 - \frac{1+\log\log 2}{\log 2} = 0.0860713320\dots$ is the multiplication table constant. Detailed heuristics suggest that this secondary term is asymptotic to $\frac{1 }{\sqrt{\log\log x}} \cdot \frac x{(\log x)^{ 1+\delta}} $ times a bounded, positive, $1$-periodic, non-constant function of $\frac{\log\log x}{\log 2}$.


title: Multi-wavelength observations of a B-class flare using XSM, AIA, and XRT

abstract: We present multi-wavelength observations by Chandrayaan-2/XSM, SDO/AIA and Hinode/XRT of a B-class flare observed on 25th February, 2021, originating from an active region (AR 12804) near the North-West limb. The microflare lasts for approx 30 mins and is composed of hot loops reaching temperatures of 10 MK. We report excellent agreement (within 20 percent) for the average effective temperatures obtained at the flare peak from all the three instruments, which have different temperature sensitivities. The XRT filter combination of Be-thin and Be-med provides an excellent opportunity to measure the high-temperatures in such microflare events. The elemental abundances during the evolution of the microflare are also studied and observed to drop towards photospheric values at the flare peak time, compared to coronal values during the rise and decay phase. This is consistent with previous XSM studies.


title: Generalization of Gisin's Theorem to Quantum Fields

abstract: We generalize Gisin's theorem on the relation between the entanglement of pure states and Bell non-classicality to the case of mode entanglement of separated groups of modes of quantum fields extending the theorem to cover also states with undefined particle number. We show that any pure state of the field which contains entanglement between two groups of separated modes violates some Clauser-Horne inequality. In order to construct the observables leading to a violation in the first step, we show an isomorphism between the Fock space built from a single-particle space involving two separated groups of modes and a tensor product of two abstract separable Hilbert spaces spanned by formal monomials of creation operators. In the second step, we perform a Schmidt decomposition of a given entangled state mapped to this tensor product space and then we map back the obtained Schmidt decomposition to the original Fock space of the system under consideration. Such obtained Schmidt decomposition in Fock space allows for construction of observables leading to a violation of the Clauser-Horne inequality. We also show that our generalization of Gisin's theorem holds for the case of states on non-separable Hilbert spaces, which physically represent states with actually infinite number of particles. Such states emerge, for example, in the discussion of quantum phase transitions. Finally, we discuss the experimental feasibility of constructed Bell test and provide a necessary condition for realizability of this test within the realm of passive linear optics.


title: Exploring sustainable pathways for urban traffic decarbonization: vehicle technologies, management strategies, and driving behaviour

abstract: The global fight against climate change and air pollution prioritizes the transition to sustainable transportation options. Understanding the impacts of various sustainable pathways on emissions, travel time, and costs is crucial for researchers and policymakers. This research conducts a comprehensive microsimulation of traffic and emissions in downtown Toronto, Canada, to examine decarbonization scenarios. The resulting 140 scenarios involve different fuel types, Connected and Automated Vehicles (CAV) penetration rates, and routing strategies combined with driving style. To achieve this, transformers-based prediction models accurately forecast Greenhouse Gas (GHG) and Nitrogen Oxides (NOx) emissions and average speed for eco-routing. The study finds that 100% battery electric vehicles have the lowest GHG emissions, showing their potential as a sustainable transportation solution. However, challenges related to cost and availability persist. Hybrid Electric Vehicles and e-fuels demonstrate considerable emission reductions, emerging as promising alternatives. Integrating CAVs with anticipatory routing strategies significantly reduces GHG emissions. Additionally, eco-driving practices and eco-routing strategies have a notable impact on NOx emissions and travel time. Comprehensive cost analysis provides valuable insights into the economic implications of various strategies and technologies. These findings offer guidance to various stakeholders in formulating effective strategies, behaviour changes, and policies for emission reduction and sustainable transportation development.


title: Information-driven Affordance Discovery for Efficient Robotic Manipulation

abstract: Robotic affordances, providing information about what actions can be taken in a given situation, can aid robotic manipulation. However, learning about affordances requires expensive large annotated datasets of interactions or demonstrations. In this work, we argue that well-directed interactions with the environment can mitigate this problem and propose an information-based measure to augment the agent's objective and accelerate the affordance discovery process. We provide a theoretical justification of our approach and we empirically validate the approach both in simulation and real-world tasks. Our method, which we dub IDA, enables the efficient discovery of visual affordances for several action primitives, such as grasping, stacking objects, or opening drawers, strongly improving data efficiency in simulation, and it allows us to learn grasping affordances in a small number of interactions, on a real-world setup with a UFACTORY XArm 6 robot arm.


title: RecRec: Algorithmic Recourse for Recommender Systems

abstract: Recommender systems play an essential role in the choices people make in domains such as entertainment, shopping, food, news, employment, and education. The machine learning models underlying these recommender systems are often enormously large and black-box in nature for users, content providers, and system developers alike. It is often crucial for all stakeholders to understand the model's rationale behind making certain predictions and recommendations. This is especially true for the content providers whose livelihoods depend on the recommender system. Drawing motivation from the practitioners' need, in this work, we propose a recourse framework for recommender systems, targeted towards the content providers. Algorithmic recourse in the recommendation setting is a set of actions that, if executed, would modify the recommendations (or ranking) of an item in the desired manner. A recourse suggests actions of the form: "if a feature changes X to Y, then the ranking of that item for a set of users will change to Z." Furthermore, we demonstrate that RecRec is highly effective in generating valid, sparse, and actionable recourses through an empirical evaluation of recommender systems trained on three real-world datasets. To the best of our knowledge, this work is the first to conceptualize and empirically test a generalized framework for generating recourses for recommender systems.


title: Interstellar Diplomacy

abstract: The Defense Department and NASA are investigating the possibility that aliens are currently surveilling Earth. This aligns with some search-for-extraterrestrial-intelligence (SETI) theorists who have concluded that ET's best strategy for opening a channel of communication is to send artificially intelligent probes to our Solar System for that purpose. This is a golden age for traditional SETI, which is currently well funded, with most of the world's radio telescopes now engaged in the hunt. One way or another, contact with aliens may be imminent. There has been no planning among nations for the aftermath of a first detection. This paper advocates for such planning and diplomacy.


title: Multi-site Integrated Optical Addressing of Trapped Ions

abstract: One of the most effective ways to advance the performance of quantum computers and quantum sensors is to increase the number of qubits or quantum resources in the system. A major technical challenge that must be solved to realize this goal for trapped-ion systems is scaling the delivery of optical signals to many individual ions. In this paper we demonstrate an approach employing waveguides and multi-mode interferometer splitters to optically address multiple $^{171}\textrm{Yb}^+$ ions in a surface trap by delivering all wavelengths required for full qubit control. Measurements of hyperfine spectra and Rabi flopping were performed on the E2 clock transition, using integrated waveguides for delivering the light needed for Doppler cooling, state preparation, coherent operations, and detection. We describe the use of splitters to address multiple ions using a single optical input per wavelength and use them to demonstrate simultaneous Rabi flopping on two different transitions occurring at distinct trap sites. This work represents an important step towards the realization of scalable integrated photonics for atomic clocks and trapped-ion quantum information systems.


title: On Reward Structures of Markov Decision Processes

abstract: A Markov decision process can be parameterized by a transition kernel and a reward function. Both play essential roles in the study of reinforcement learning as evidenced by their presence in the Bellman equations. In our inquiry of various kinds of "costs" associated with reinforcement learning inspired by the demands in robotic applications, rewards are central to understanding the structure of a Markov decision process and reward-centric notions can elucidate important concepts in reinforcement learning. Specifically, we study the sample complexity of policy evaluation and develop a novel estimator with an instance-specific error bound of $\tilde{O}(\sqrt{\frac{\tau_s}{n}})$ for estimating a single state value. Under the online regret minimization setting, we refine the transition-based MDP constant, diameter, into a reward-based constant, maximum expected hitting cost, and with it, provide a theoretical explanation for how a well-known technique, potential-based reward shaping, could accelerate learning with expert knowledge. In an attempt to study safe reinforcement learning, we model hazardous environments with irrecoverability and proposed a quantitative notion of safe learning via reset efficiency. In this setting, we modify a classic algorithm to account for resets achieving promising preliminary numerical results. Lastly, for MDPs with multiple reward functions, we develop a planning algorithm that computationally efficiently finds Pareto-optimal stochastic policies.


title: Matbench Discovery -- A framework to evaluate machine learning crystal stability predictions

abstract: Matbench Discovery simulates the deployment of machine learning (ML) energy models in a high-throughput search for stable inorganic crystals. We address the disconnect between (i) thermodynamic stability and formation energy and (ii) in-domain vs out-of-distribution performance. Alongside this paper, we publish a Python package to aid with future model submissions and a growing online leaderboard with further insights into trade-offs between various performance metrics. To answer the question which ML methodology performs best at materials discovery, our initial release explores a variety of models including random forests, graph neural networks (GNN), one-shot predictors, iterative Bayesian optimizers and universal interatomic potentials (UIP). Ranked best-to-worst by their test set F1 score on thermodynamic stability prediction, we find CHGNet > M3GNet > MACE > ALIGNN > MEGNet > CGCNN > CGCNN+P > Wrenformer > BOWSR > Voronoi tessellation fingerprints with random forest. The top 3 models are UIPs, the winning methodology for ML-guided materials discovery, achieving F1 scores of ~0.6 for crystal stability classification and discovery acceleration factors (DAF) of up to 5x on the first 10k most stable predictions compared to dummy selection from our test set. We also highlight a sharp disconnect between commonly used global regression metrics and more task-relevant classification metrics. Accurate regressors are susceptible to unexpectedly high false-positive rates if those accurate predictions lie close to the decision boundary at 0 eV/atom above the convex hull where most materials are. Our results highlight the need to focus on classification metrics that actually correlate with improved stability hit rate.


title: Gender bias and stereotypes in Large Language Models

abstract: Large Language Models (LLMs) have made substantial progress in the past several months, shattering state-of-the-art benchmarks in many domains. This paper investigates LLMs' behavior with respect to gender stereotypes, a known issue for prior models. We use a simple paradigm to test the presence of gender bias, building on but differing from WinoBias, a commonly used gender bias dataset, which is likely to be included in the training data of current LLMs. We test four recently published LLMs and demonstrate that they express biased assumptions about men and women's occupations. Our contributions in this paper are as follows: (a) LLMs are 3-6 times more likely to choose an occupation that stereotypically aligns with a person's gender; (b) these choices align with people's perceptions better than with the ground truth as reflected in official job statistics; (c) LLMs in fact amplify the bias beyond what is reflected in perceptions or the ground truth; (d) LLMs ignore crucial ambiguities in sentence structure 95% of the time in our study items, but when explicitly prompted, they recognize the ambiguity; (e) LLMs provide explanations for their choices that are factually inaccurate and likely obscure the true reason behind their predictions. That is, they provide rationalizations of their biased behavior. This highlights a key property of these models: LLMs are trained on imbalanced datasets; as such, even with the recent successes of reinforcement learning with human feedback, they tend to reflect those imbalances back at us. As with other types of societal biases, we suggest that LLMs must be carefully tested to ensure that they treat minoritized individuals and communities equitably.


title: Automated Conversion of Music Videos into Lyric Videos

abstract: Musicians and fans often produce lyric videos, a form of music videos that showcase the song's lyrics, for their favorite songs. However, making such videos can be challenging and time-consuming as the lyrics need to be added in synchrony and visual harmony with the video. Informed by prior work and close examination of existing lyric videos, we propose a set of design guidelines to help creators make such videos. Our guidelines ensure the readability of the lyric text while maintaining a unified focus of attention. We instantiate these guidelines in a fully automated pipeline that converts an input music video into a lyric video. We demonstrate the robustness of our pipeline by generating lyric videos from a diverse range of input sources. A user study shows that lyric videos generated by our pipeline are effective in maintaining text readability and unifying the focus of attention.


title: Well-posed problem for a combustion model in a multilayer porous medium

abstract: Combustion occurring in porous media has various practical applications, such as in in-situ combustion processes in oil reservoirs, the combustion of biogas in sanitary landfills, and many others. A porous medium where combustion takes place can consist of layers with different physical properties. This study demonstrates that the initial value problem for a combustion model in a multi-layer porous medium has a unique solution, which is continuous with respect to the initial data and parameters in $\mathtt{L}^2(\mathbb{R})^n$. In summary, it establishes that the initial value problem is well-posed in $\mathtt{L}^2(\mathbb{R})^n$. The model is governed by a one-dimensional reaction-diffusion-convection system, where the unknowns are the temperatures in the layers. Previous studies have addressed the same problem in $\mathtt{H}^2(\mathbb{R})^n$. However, in this study, we solve the problem in a less restrictive space, namely $\mathtt{L}^2(\mathbb{R})^n$. The proof employs a novel approach to combustion problems in porous media, utilizing an evolution operator defined from the theory of semigroups in Hilbert space and Kato's theory for a well-posed associated initial value problem.


title: Optimal Economic Gas Turbine Dispatch with Deep Reinforcement Learning

abstract: Dispatching strategies for gas turbines (GTs) are changing in modern electricity grids. A growing incorporation of intermittent renewable energy requires GTs to operate more but shorter cycles and more frequently on partial loads. Deep reinforcement learning (DRL) has recently emerged as a tool that can cope with this development and dispatch GTs economically. The key advantages of DRL are a model-free optimization and the ability to handle uncertainties, such as those introduced by varying loads or renewable energy production. In this study, three popular DRL algorithms are implemented for an economic GT dispatch problem on a case study in Alberta, Canada. We highlight the benefits of DRL by incorporating an existing thermodynamic software provided by Siemens Energy into the environment model and by simulating uncertainty via varying electricity prices, loads, and ambient conditions. Among the tested algorithms and baseline methods, Deep Q-Networks (DQN) obtained the highest rewards while Proximal Policy Optimization (PPO) was the most sample efficient. We further propose and implement a method to assign GT operation and maintenance cost dynamically based on operating hours and cycles. Compared to existing methods, our approach better approximates the true cost of modern GT dispatch and hence leads to more realistic policies.


title: Patient-specific, mechanistic models of tumor growth incorporating artificial intelligence and big data

abstract: Despite the remarkable advances in cancer diagnosis, treatment, and management that have occurred over the past decade, malignant tumors remain a major public health problem. Further progress in combating cancer may be enabled by personalizing the delivery of therapies according to the predicted response for each individual patient. The design of personalized therapies requires patient-specific information integrated into an appropriate mathematical model of tumor response. A fundamental barrier to realizing this paradigm is the current lack of a rigorous, yet practical, mathematical theory of tumor initiation, development, invasion, and response to therapy. In this review, we begin by providing an overview of different approaches to modeling tumor growth and treatment, including mechanistic as well as data-driven models based on ``big data" and artificial intelligence. Next, we present illustrative examples of mathematical models manifesting their utility and discussing the limitations of stand-alone mechanistic and data-driven models. We further discuss the potential of mechanistic models for not only predicting, but also optimizing response to therapy on a patient-specific basis. We then discuss current efforts and future possibilities to integrate mechanistic and data-driven models. We conclude by proposing five fundamental challenges that must be addressed to fully realize personalized care for cancer patients driven by computational models.


title: Monus semantics in vector addition systems with states

abstract: Vector addition systems with states (VASS) are a popular model for concurrent systems. However, many decision problems have prohibitively high complexity. Therefore, it is sometimes useful to consider overapproximating semantics in which these problems can be decided more efficiently. We study an overapproximation, called monus semantics, that slightly relaxes the semantics of decrements: A key property of a vector addition systems is that in order to decrement a counter, this counter must have a positive value. In contrast, our semantics allows decrements of zero-valued counters: If such a transition is executed, the counter just remains zero. It turns out that if only a subset of transitions is used with monus semantics (and the others with classical semantics), then reachability is undecidable. However, we show that if monus semantics is used throughout, reachability remains decidable. In particular, we show that reachability for VASS with monus semantics is as hard as that of classical VASS (i.e. Ackermann-hard), while the zero-reachability and coverability are easier (i.e. EXPSPACE-complete and NP-complete, respectively). We provide a comprehensive account of the complexity of the general reachability problem, reachability of zero configurations, and coverability under monus semantics. We study these problems in general VASS, two-dimensional VASS, and one-dimensional VASS, with unary and binary counter updates.


title: Cluster Cosmology Redux: A Compact Model of the Halo Mass Function

abstract: Massive halos hosting groups and clusters of galaxies imprint coherent, arcminute-scale features across the spectrophotometric sky, especially optical-IR clusters of galaxies, distortions in the sub-mm CMB, and extended sources of X-ray emission. Statistical modeling of such features often rely upon the evolving space-time density of dark matter halos -- the halo mass function (HMF) -- as a common theoretical ground for cosmological, astrophysical and fundamental physics studies. We propose a compact (eight parameter) representation of the HMF with readily interpretable parameters that stem from polynomial expansions, first in terms of log-mass, then expanding those coefficients similarly in redshift. We demonstrate good ($\sim \! 5\%$) agreement of this form, referred to as the dual-quadratic (DQ-HMF), with Mira-Titan N-body emulator estimates for halo masses above $10^{13.7} h^{-1} {\rm M}_\odot$ over the redshift range $0.1 < z < 1.5$, present best-fit parameters for a Planck 2018 cosmology, and present parameter variation in the $\sigma_8 - \Omega_{\rm m}$ plane. Convolving with a minimal mass-observable relation (MOR) yields closed-form expressions for counts, mean mass, and mass variance of cluster samples characterized by some observable property. Performing information-matrix forecasts of potential parameter constraints from existing and future surveys under different levels of systematic uncertainties, we demonstrate the potential for percent-level constraints on model parameters by an LSST-like optical cluster survey of 300,000 clusters and a richness-mass variance of $0.3^2$. Even better constraints could potentially be achieved by a survey with one-tenth the sample size but with a reduced selection property variance of $0.1^2$. Potential benefits and extensions to the basic MOR parameterization are discussed.


title: Human-Scale Computing: A Case for Progressive Narrow Waist for Internet Applications

abstract: In the era where personal devices and applications are pervasive, individuals are continuously generating and interacting with a vast amount of data. Despite this, access to and control over such data remains challenging due to its scattering across various app providers and formats. This paper presents Human-Scale Computing, a vision and an approach where every individual has straightforward, unified access to their data across all devices, apps, and services. Key to this solution is the Human Scale Portal, a progressively designed intermediary that integrates different applications and service providers. This design adopts a transitional development and deployment strategy, involving an initial bootstrapping phase to engage application providers, an acceleration phase to enhance the convenience of access, and an eventual solution. We believe that this progressive "narrow waist" design can bridge the gap between the current state of data access and our envisioned future of human-scale access.


title: Maestro: Uncovering Low-Rank Structures via Trainable Decomposition

abstract: Deep Neural Networks (DNNs) have been a large driver for AI breakthroughs in recent years. However, these models have been getting increasingly large as they become more accurate and safe. This means that their training becomes increasingly costly and time-consuming and typically yields a single model to fit all targets. Various techniques have been proposed in the literature to mitigate this, including pruning, sparsification, or quantization of model weights and updates. While achieving high compression rates, they often incur significant computational overheads at training or lead to non-negligible accuracy penalty. Alternatively, factorization methods have been leveraged for low-rank compression of DNNs. Similarly, such techniques (e.g., SVD) frequently rely on heavy iterative decompositions of layers and are potentially sub-optimal for non-linear models, such as DNNs. We take a further step in designing efficient low-rank models and propose Maestro, a framework for trainable low-rank layers. Instead of iteratively applying a priori decompositions, the low-rank structure is baked into the training process through LoD, a low-rank ordered decomposition. Not only is this the first time importance ordering via sampling is applied on the decomposed DNN structure, but it also allows selecting ranks at a layer granularity. Our theoretical analysis demonstrates that in special cases LoD recovers the SVD decomposition and PCA. Applied to DNNs, Maestro enables the extraction of lower footprint models that preserve performance. Simultaneously, it enables the graceful trade-off between accuracy-latency for deployment to even more constrained devices without retraining.


title: Application of Quantum Pre-Processing Filter for Binary Image Classification with Small Samples

abstract: Over the past few years, there has been significant interest in Quantum Machine Learning (QML) among researchers, as it has the potential to transform the field of machine learning. Several models that exploit the properties of quantum mechanics have been developed for practical applications. In this study, we investigated the application of our previously proposed quantum pre-processing filter (QPF) to binary image classification. We evaluated the QPF on four datasets: MNIST (handwritten digits), EMNIST (handwritten digits and alphabets), CIFAR-10 (photographic images) and GTSRB (real-life traffic sign images). Similar to our previous multi-class classification results, the application of QPF improved the binary image classification accuracy using neural network against MNIST, EMNIST, and CIFAR-10 from 98.9% to 99.2%, 97.8% to 98.3%, and 71.2% to 76.1%, respectively, but degraded it against GTSRB from 93.5% to 92.0%. We then applied QPF in cases using a smaller number of training and testing samples, i.e. 80 and 20 samples per class, respectively. In order to derive statistically stable results, we conducted the experiment with 100 trials choosing randomly different training and testing samples and averaging the results. The result showed that the application of QPF did not improve the image classification accuracy against MNIST and EMNIST but improved it against CIFAR-10 and GTSRB from 65.8% to 67.2% and 90.5% to 91.8%, respectively. Further research will be conducted as part of future work to investigate the potential of QPF to assess the scalability of the proposed approach to larger and complex datasets.


title: Coherent Spin-Phonon Coupling in the Layered Ferrimagnet Mn3Si2Te6

abstract: We utilize ultrafast photoexcitation to drive coherent lattice oscillations in the layered ferrimagnetic crystal Mn3Si2Te6, which significantly stiffen below the magnetic ordering temperature. We suggest that this is due to an exchange-mediated contraction of the lattice, stemming from strong magneto-structural coupling in this material. Additionally, simulations of the transient incoherent dynamics reveal the importance of spin relaxation channels mediated by optical and acoustic phonon scattering. Our findings highlight the importance of spin-lattice coupling in van der Waals magnets and a promising route for their dynamic optical control through their intertwined electronic, lattice, and spin degrees of freedom.


title: Generalized Loewy length of Cohen-Macaulay local and graded rings

abstract: We generalize a theorem of Ding relating the generalized Loewy length $\text{g}\ell\ell(R)$ and index of a one-dimensional Cohen-Macaulay local ring $(R,\mathfrak{m},k)$. Ding proved that if $R$ is Gorenstein, the associated graded ring is Cohen-Macaulay, and $k$ is infinite, then the generalized Loewy length and index of $R$ are equal. However, if $k$ is finite, equality may not hold. We prove that if the index of a one-dimensional Cohen-Macaulay local ring is finite and the associated graded ring has a homogeneous nonzerodivisor of degree $t$, then $\text{g}\ell\ell(R) \leq \text{index}(R)+t-1$. Next we prove that if $R$ is a one-dimensional hypersurface ring with a witness to the generalized Loewy length that induces a regular initial form on the associated graded ring, then the generalized Loewy length achieves this upper bound. We then compute the generalized Loewy lengths of several families of examples of one-dimensional hypersurface rings over finite fields. Finally, we study a graded version of the generalized Loewy length and determine its value for numerical semigroup rings.


title: A hybridizable discontinuous Galerkin method for the dual-porosity-Stokes problem

abstract: We introduce and analyze a hybridizable discontinuous Galerkin (HDG) method for the dual-porosity-Stokes problem. This coupled problem describes the interaction between free flow in macrofractures/conduits, governed by the Stokes equations, and flow in microfractures/matrix, governed by a dual-porosity model. We prove that the HDG method is strongly conservative, well-posed, and give an a priori error analysis showing dependence on the problem parameters. Our theoretical findings are corroborated by numerical examples


title: Can a chemotaxis-consumption system recover from a measure-type aggregation state in arbitrary dimension?

abstract: We consider the chemotaxis-consumption system \[ \left\{ \begin{aligned} u_t &= \Delta u - \chi \nabla \cdot (u\nabla v) \\ v_t &= \Delta v - uv \end{aligned} \right. \] in a smooth bounded domain $\Omega \subseteq \mathbb{R}^n$, $n \geq 2$, with parameter $\chi > 0$ and Neumann boundary conditions. It is well known that, for sufficiently smooth nonnegative initial data and under a smallness condition for the initial state of $v$, solutions of the above system never blow up and are even globally bounded. Going in a sense a step further in this paper, we ask the question whether the system can even recover from an initial state that already resembles measure-type blowup. To answer this, we show that, given an arbitrarily large positive Radon measure $u_0$ with $u_0(\overline{\Omega}) > 0$ as the initial data for the first equation and a nonnegative $L^\infty(\Omega)$ function $v_0$ with \[ 0 < \|v_0\|_{L^{\infty}(\Omega)} < \frac{2}{3n\chi} \] as initial data for the second equation, it is still possible to construct a global classic solution to the above system.


title: Distributionally Robust Variational Quantum Algorithms with Shifted Noise

abstract: Given their potential to demonstrate near-term quantum advantage, variational quantum algorithms (VQAs) have been extensively studied. Although numerous techniques have been developed for VQA parameter optimization, it remains a significant challenge. A practical issue is that quantum noise is highly unstable and thus it is likely to shift in real time. This presents a critical problem as an optimized VQA ansatz may not perform effectively under a different noise environment. For the first time, we explore how to optimize VQA parameters to be robust against unknown shifted noise. We model the noise level as a random variable with an unknown probability density function (PDF), and we assume that the PDF may shift within an uncertainty set. This assumption guides us to formulate a distributionally robust optimization problem, with the goal of finding parameters that maintain effectiveness under shifted noise. We utilize a distributionally robust Bayesian optimization solver for our proposed formulation. This provides numerical evidence in both the Quantum Approximate Optimization Algorithm (QAOA) and the Variational Quantum Eigensolver (VQE) with hardware-efficient ansatz, indicating that we can identify parameters that perform more robustly under shifted noise. We regard this work as the first step towards improving the reliability of VQAs influenced by shifted noise from the parameter optimization perspective.


title: AutoProSAM: Automated Prompting SAM for 3D Multi-Organ Segmentation

abstract: Segment Anything Model (SAM) is one of the pioneering prompt-based foundation models for image segmentation and has been rapidly adopted for various medical imaging applications. However, in clinical settings, creating effective prompts is notably challenging and time-consuming, requiring the expertise of domain specialists such as physicians. This requirement significantly diminishes SAM's primary advantage - its interactive capability with end users - in medical applications. Moreover, recent studies have indicated that SAM, originally designed for 2D natural images, performs sub optimally on 3D medical image segmentation tasks. This subpar performance is attributed to the domain gaps between natural and medical images and the disparities in spatial arrangements between 2D and 3D images, particularly in multi-organ segmentation applications. To overcome these challenges, we present a novel technique termed AutoProSAM. This method automates 3D multi-organ CT-based segmentation by leveraging SAM's foundational model capabilities without relying on domain experts for prompts. The approach utilizes parameter-efficient adaptation techniques to adapt SAM for 3D medical imagery and incorporates an effective automatic prompt learning paradigm specific to this domain. By eliminating the need for manual prompts, it enhances SAM's capabilities for 3D medical image segmentation and achieves state-of-the-art (SOTA) performance in CT-based multi-organ segmentation tasks.


title: A Brillouin torus decomposition for two-dimensional topological insulators

abstract: Two-band Chern insulators are topologically classified by the Chern number, $c$, which is given by the integral of the Berry curvature of the occupied band over the Brillouin torus. The curvature itself comes from the imaginary part of a more basic object, the quantum geometric tensor, $Q$. On the other hand, the integral over the Brillouin torus of the real part of $Q$ gives rise to another magnitude, the quantum volume, $v_{g}$, that like $c$, jumps when the system undergoes a topological phase transition and satisfies the inequality $v_{g}\ge 2\vert c \vert$. The information contained in $v_g$ about the topology of the system has been investigated recently. In this paper we present new results regarding the underlying geometric structure of two-dimensional two-band topological insulators. Since a generic model describing the system can be characterized by a map, the classifying map, from the Brillouin torus to the two-sphere, we study its properties at the geometric level. We present a procedure for splitting the Brillouin torus into different sectors in such a way that the classifying map when restricted to each of them is a local diffeomorphism. By doing so, in the topological phases we are able to isolate a region contained in the Brillouin torus whose volume is the minimal one, $v_{min}=2\vert c \vert$ and the integral of the Berry curvature on it is $c$. For cases in which $v_{g}> 2\vert c \vert$, the regions contributing to the excess of volume, $v_{ex}=v_{g}-2\vert c \vert$, are found and characterized. In addition, the present work makes contact with, and clarifies, some interpretations of the quantum volume in terms of the Euler characteristic number that were done in the recent literature. We illustrate our findings with a careful analysis of some selected models for Chern insulators corresponding to tight-binding Hamiltonians.


title: Entropy-based Guidance of Deep Neural Networks for Accelerated Convergence and Improved Performance

abstract: Neural networks have dramatically increased our capacity to learn from large, high-dimensional datasets across innumerable disciplines. However, their decisions are not easily interpretable, their computational costs are high, and building and training them are uncertain processes. To add structure to these efforts, we derive new mathematical results to efficiently measure the changes in entropy as fully-connected and convolutional neural networks process data, and introduce entropy-based loss terms. Experiments in image compression and image classification on benchmark datasets demonstrate these losses guide neural networks to learn rich latent data representations in fewer dimensions, converge in fewer training epochs, and achieve better test metrics.


title: Laser-enhanced magnetism in SmFeO$_3$

abstract: To coherently enhance inherent weak magnetic interactions in rare-earth orthoferrite SmFeO$_3$ as a functional material for spintronic applications, we simulate the dissipative spin dynamics that are linearly and quadratically coupled to laser-driven infrared-active phonons. When linear coupling dominates, we discover a magnetophononic dynamical first-order phase transition in the nonequilibrium steady state which can inhibit strong enhancement of magnetic interactions. By contrast, when quadratic spin-phonon coupling dominates, no phase transition exists at experimentally relevant parameters. By utilizing a chirp protocol, the phase transition can be engineered, enabling stronger magnetic interactions. We also discuss the route for experimental observation of our results.


title: DoubleCheck: Designing Community-based Assessability for Historical Person Identification

abstract: Historical photos are valuable for their cultural and economic significance, but can be difficult to identify accurately due to various challenges such as low-quality images, lack of corroborating evidence, and limited research resources. Misidentified photos can have significant negative consequences, including lost economic value, incorrect historical records, and the spread of misinformation that can lead to perpetuating conspiracy theories. To accurately assess the credibility of a photo identification (ID), it may be necessary to conduct investigative research, use domain knowledge, and consult experts. In this paper, we introduce DoubleCheck, a quality assessment framework for verifying historical photo IDs on Civil War Photo Sleuth (CWPS), a popular online platform for identifying American Civil War-era photos using facial recognition and crowdsourcing. DoubleCheck focuses on improving CWPS's user experience and system architecture to display information useful for assessing the quality of historical photo IDs on CWPS. In a mixed-methods evaluation of DoubleCheck, we found that users contributed a wide diversity of sources for photo IDs, which helped facilitate the community's assessment of these IDs through DoubleCheck's provenance visualizations. Further, DoubleCheck's quality assessment badges and visualizations supported users in making accurate assessments of photo IDs, even in cases involving ID conflicts.


title: Borel versions of the Local Lemma and LOCAL algorithms for graphs of finite asymptotic separation index

abstract: Asymptotic separation index is a parameter that measures how easily a Borel graph can be approximated by its subgraphs with finite components. In contrast to the more classical notion of hyperfiniteness, asymptotic separation index is well-suited for combinatorial applications in the Borel setting. The main result of this paper is a Borel version of the Lov\'asz Local Lemma -- a powerful general-purpose tool in probabilistic combinatorics -- under a finite asymptotic separation index assumption. As a consequence, we show that locally checkable labeling problems that are solvable by efficient randomized distributed algorithms admit Borel solutions on bounded degree Borel graphs with finite asymptotic separation index. From this we derive a number of corollaries, for example a Borel version of Brooks's theorem for graphs with finite asymptotic separation index.


title: Woolf et als GWAS by subtraction is not useful for cross-generational Mendelian randomization studies

abstract: Mendelian randomization (MR) is an epidemiological method that can be used to strengthen causal inference regarding the relationship between a modifiable environmental exposure and a medically relevant trait and to estimate the magnitude of this relationship1. Recently, there has been considerable interest in using MR to examine potential causal relationships between parental phenotypes and outcomes amongst their offspring. In a recent issue of BMC Research Notes, Woolf et al (2023) present a new method, GWAS by subtraction, to derive genome-wide summary statistics for paternal smoking and other paternal phenotypes with the goal that these estimates can then be used in downstream (including two sample) MR studies. Whilst a potentially useful goal, Woolf et al. (2023) focus on the wrong parameter of interest for useful genome-wide association studies (GWAS) and downstream cross-generational MR studies, and the estimator that they derive is neither efficient nor appropriate for such use.


title: Transfusor: Transformer Diffusor for Controllable Human-like Generation of Vehicle Lane Changing Trajectories

abstract: With ongoing development of autonomous driving systems and increasing desire for deployment, researchers continue to seek reliable approaches for ADS systems. The virtual simulation test (VST) has become a prominent approach for testing autonomous driving systems (ADS) and advanced driver assistance systems (ADAS) due to its advantages of fast execution, low cost, and high repeatability. However, the success of these simulation-based experiments heavily relies on the realism of the testing scenarios. It is needed to create more flexible and high-fidelity testing scenarios in VST in order to increase the safety and reliabilityof ADS and ADAS.To address this challenge, this paper introduces the "Transfusor" model, which leverages the transformer and diffusor models (two cutting-edge deep learning generative technologies). The primary objective of the Transfusor model is to generate highly realistic and controllable human-like lane-changing trajectories in highway scenarios. Extensive experiments were carried out, and the results demonstrate that the proposed model effectively learns the spatiotemporal characteristics of humans' lane-changing behaviors and successfully generates trajectories that closely mimic real-world human driving. As such, the proposed model can play a critical role of creating more flexible and high-fidelity testing scenarios in the VST, ultimately leading to safer and more reliable ADS and ADAS.


title: The Effects of Non-Equilibrium Velocity Distributions on Alfv\'en Ion-Cyclotron Waves in the Solar Wind

abstract: In this work, we investigate how the complex structure found in solar wind proton velocity distribution functions (VDFs), rather than the commonly assumed two-component bi-Maxwellian structure, affects the onset and evolution of parallel-propagating microinstabilities. We use the Arbitrary Linear Plasma Solver (ALPS), a numerical dispersion solver, to find the real frequencies and growth/damping rates of the Alfv\'en modes calculated for proton VDFs extracted from Wind spacecraft observations of the solar wind. We compare this wave behavior to that obtained by applying the same procedure to core-and-beam bi-Maxwellian fits of the Wind proton VDFs. We find several significant differences in the plasma waves obtained for the extracted data and bi-Maxwellian fits, including a strong dependence of the growth/damping rate on the shape of the VDF. By application of the quasilinear diffusion operator to these VDFs, we pinpoint resonantly interacting regions in velocity space where differences in VDF structure significantly affect the wave growth and damping rates. This demonstration of the sensitive dependence of Alfv\'en mode behavior on VDF structure may explain why the Alfv\'en ion-cyclotron instability thresholds predicted by linear theory for bi-Maxwellian models of solar wind proton background VDFs do not entirely constrain spacecraft observations of solar wind proton VDFs, such as those made by the Wind spacecraft.


title: Noise-Free Sampling Algorithms via Regularized Wasserstein Proximals

abstract: We consider the problem of sampling from a distribution governed by a potential function. This work proposes an explicit score based MCMC method that is deterministic, resulting in a deterministic evolution for particles rather than a stochastic differential equation evolution. The score term is given in closed form by a regularized Wasserstein proximal, using a kernel convolution that is approximated by sampling. We demonstrate fast convergence on various problems and show improved dimensional dependence of mixing time bounds for the case of Gaussian distributions compared to the unadjusted Langevin algorithm (ULA) and the Metropolis-adjusted Langevin algorithm (MALA). We additionally derive closed form expressions for the distributions at each iterate for quadratic potential functions, characterizing the variance reduction. Empirical results demonstrate that the particles behave in an organized manner, lying on level set contours of the potential. Moreover, the posterior mean estimator of the proposed method is shown to be closer to the maximum a-posteriori estimator compared to ULA and MALA in the context of Bayesian logistic regression. Additional examples demonstrate competitive performance for Bayesian neural network training.


title: Reinforcement Learning for Sampling on Temporal Medical Imaging Sequences

abstract: Accelerated magnetic resonance imaging resorts to either Fourier-domain subsampling or better reconstruction algorithms to deal with fewer measurements while still generating medical images of high quality. Determining the optimal sampling strategy given a fixed reconstruction protocol often has combinatorial complexity. In this work, we apply double deep Q-learning and REINFORCE algorithms to learn the sampling strategy for dynamic image reconstruction. We consider the data in the format of time series, and the reconstruction method is a pre-trained autoencoder-typed neural network. We present a proof of concept that reinforcement learning algorithms are effective to discover the optimal sampling pattern which underlies the pre-trained reconstructor network (i.e., the dynamics in the environment). The code for replicating experiments can be found at https://github.com/zhishenhuang/RLsamp.


title: Improving Generalization in Reinforcement Learning Training Regimes for Social Robot Navigation

abstract: In order for autonomous mobile robots to navigate in human spaces, they must abide by our social norms. Reinforcement learning (RL) has emerged as an effective method to train sequential decision-making policies that are able to respect these norms. However, a large portion of existing work in the field conducts both RL training and testing in simplistic environments. This limits the generalization potential of these models to unseen environments, and the meaningfulness of their reported results. We propose a method to improve the generalization performance of RL social navigation methods using curriculum learning. By employing multiple environment types and by modeling pedestrians using multiple dynamics models, we are able to progressively diversify and escalate difficulty in training. Our results show that the use of curriculum learning in training can be used to achieve better generalization performance than previous training methods. We also show that results presented in many existing state-of-the-art RL social navigation works do not evaluate their methods outside of their training environments, and thus do not reflect their policies' failure to adequately generalize to out-of-distribution scenarios. In response, we validate our training approach on larger and more crowded testing environments than those used in training, allowing for more meaningful measurements of model performance.


title: Machine Learning for Mini-EUSO Telescope Data Analysis

abstract: Neural networks as well as other methods of machine learning (ML) are known to be highly efficient in different classification tasks, including classification of images and videos. Mini- EUSO is a wide-field-of-view imaging telescope that operates onboard the International Space Station since 2019 collecting data on miscellaneous processes that take place in the atmosphere of Earth in the UV range. Here we briefly present our results on the development of ML-based approaches for recognition and classification of track-like signals in the Mini-EUSO data, among them meteors, space debris and signals the light curves and kinematics of which are similar to those expected from extensive air showers generated by ultra-high-energy cosmic rays. We show that even simple neural networks demonstrate impressive performance in solving these tasks.


title: Low-bit Quantization for Deep Graph Neural Networks with Smoothness-aware Message Propagation

abstract: Graph Neural Network (GNN) training and inference involve significant challenges of scalability with respect to both model sizes and number of layers, resulting in degradation of efficiency and accuracy for large and deep GNNs. We present an end-to-end solution that aims to address these challenges for efficient GNNs in resource constrained environments while avoiding the oversmoothing problem in deep GNNs. We introduce a quantization based approach for all stages of GNNs, from message passing in training to node classification, compressing the model and enabling efficient processing. The proposed GNN quantizer learns quantization ranges and reduces the model size with comparable accuracy even under low-bit quantization. To scale with the number of layers, we devise a message propagation mechanism in training that controls layer-wise changes of similarities between neighboring nodes. This objective is incorporated into a Lagrangian function with constraints and a differential multiplier method is utilized to iteratively find optimal embeddings. This mitigates oversmoothing and suppresses the quantization error to a bound. Significant improvements are demonstrated over state-of-the-art quantization methods and deep GNN approaches in both full-precision and quantized models. The proposed quantizer demonstrates superior performance in INT2 configurations across all stages of GNN, achieving a notable level of accuracy. In contrast, existing quantization approaches fail to generate satisfactory accuracy levels. Finally, the inference with INT2 and INT4 representations exhibits a speedup of 5.11 $\times$ and 4.70 $\times$ compared to full precision counterparts, respectively.


title: Note on the electromagnetic radius of proton

abstract: We have analyzed the proton form factor data by using a number of phenomenological parameterizations (models) and extracting the proton electric and magnetic radii. To this end we performed a global fit to all available form factor data, with the virtual photon momentum squared $Q^2$ from $0.0002$ to nearly 10 GeV$^2$ for electric form factor and from $0.015$ to 31 GeV$^2$ for magnetic one. Special attention was given to the small structure shown by the form factor data near $Q^2 = 0.2$ GeV$^2$. It was found that different models yield different structures with different numbers of minimum at this kinematics. Since the slope of form factor in the limit of $Q^2\to 0$ is influenced by this structure, the extracted proton radii are consequently different for different models. Our finding recommends that future experiments should focus on this kinematics instead of low $Q^2$. Experimental data with accuracies comparable to those of the latest data at low $Q^2$ would clearly help to clarify the effect of this structure on the proton charge radius. Interestingly, most of the extracted proton charge radii were found to be closer to the value obtained from the muonic hydrogen atom spectroscopy.


title: Robust Open-Set Spoken Language Identification and the CU MultiLang Dataset

abstract: Most state-of-the-art spoken language identification models are closed-set; in other words, they can only output a language label from the set of classes they were trained on. Open-set spoken language identification systems, however, gain the ability to detect when an input exhibits none of the original languages. In this paper, we implement a novel approach to open-set spoken language identification that uses MFCC and pitch features, a TDNN model to extract meaningful feature embeddings, confidence thresholding on softmax outputs, and LDA and pLDA for learning to classify new unknown languages. We present a spoken language identification system that achieves 91.76% accuracy on trained languages and has the capability to adapt to unknown languages on the fly. To that end, we also built the CU MultiLang Dataset, a large and diverse multilingual speech corpus which was used to train and evaluate our system.


title: Stochastic Variational Inference for GARCH Models

abstract: Stochastic variational inference algorithms are derived for fitting various heteroskedastic time series models. We examine Gaussian, t, and skew-t response GARCH models and fit these using Gaussian variational approximating densities. We implement efficient stochastic gradient ascent procedures based on the use of control variates or the reparameterization trick and demonstrate that the proposed implementations provide a fast and accurate alternative to Markov chain Monte Carlo sampling. Additionally, we present sequential updating versions of our variational algorithms, which are suitable for efficient portfolio construction and dynamic asset allocation.


title: An Open Community-Driven Model For Sustainable Research Software: Sustainable Research Software Institute

abstract: Research software plays a crucial role in advancing scientific knowledge, but ensuring its sustainability, maintainability, and long-term viability is an ongoing challenge. To address these concerns, the Sustainable Research Software Institute (SRSI) Model presents a comprehensive framework designed to promote sustainable practices in the research software community. This white paper provides an in-depth overview of the SRSI Model, outlining its objectives, services, funding mechanisms, collaborations, and the significant potential impact it could have on the research software community. It explores the wide range of services offered, diverse funding sources, extensive collaboration opportunities, and the transformative influence of the SRSI Model on the research software landscape


title: Transitioning ECP Software Technology into a Foundation for Sustainable Research Software

abstract: Research software plays a crucial role in advancing scientific knowledge, but ensuring its sustainability, maintainability, and long-term viability is an ongoing challenge. The Sustainable Research Software Institute (SRSI) Model has been designed to address the concerns, and presents a comprehensive framework designed to promote sustainable practices in the research software community. However the SRSI Model does not address the transitional requirements for the Exascale Computing Project (ECP) Software Technology (ECP-ST) focus area specifically. This white paper provides an overview and detailed description of how ECP-ST will transition into the SRSI in a compressed time frame that a) meets the needs of the ECP end-of-technical-activities deadline; and b) ensures the continuity of the sustainability efforts that are already underway.


title: Viscoelastic materials are most energy efficient when loaded and unloaded at equal rates

abstract: Biological springs can be used in nature for energy conservation and ultra-fast motion. The loading and unloading rates of elastic materials can play an important role in determining how the properties of these springs affect movements. We investigate the mechanical energy efficiency of biological springs (American bullfrog plantaris tendons and guinea fowl lateral gastrocnemius tendons) and synthetic elastomers. We measure these materials under symmetric rates (equal loading and unloading durations) and asymmetric rates (unequal loading and unloading durations) using novel dynamic mechanical analysis measurements. We find that mechanical efficiency is highest at symmetric rates and significantly decreases with a larger degree of asymmetry. A generalized 1D Maxwell model with no fitting parameters captures the experimental results based on the independently-characterized linear viscoelastic properties of the materials. The model further shows that a broader viscoelastic relaxation spectrum enhances the effect of rate-asymmetry on efficiency. Overall, our study provides valuable insights into the interplay between material properties and unloading dynamics in both biological and synthetic elastic systems.


title: Bose condensation of upper-branch exciton-polaritons in a transferrable microcavity

abstract: Exciton-polaritons are composite bosonic quasiparticles arising from the strong coupling of excitonic transitions and optical modes. Exciton-polaritons have triggered wide exploration in the past decades not only due to their rich quantum phenomena such as superfluidity, superconductivity and quantized vortices but also due to their potential applications for unconventional coherent light sources and all-optical control elements. Here, we report the observation of Bose-Einstein condensation of the upper polariton branch in a transferrable WS$_2$ monolayer microcavity. Near the condensation threshold, we observe a nonlinear increase in upper polariton intensity. This sharp increase in intensity is accompanied by a decrease of the linewidth and an increase of the upper polariton temporal coherence, all of which are hallmarks of Bose-Einstein condensation. By simulating the quantum Boltzmann equation, we show that the upper polariton condensation only occurs for a particular range of particle density. We can attribute the creation of Bose condensation of the upper polariton to the following requirements: 1) the upper polariton is more excitonic than the lower one; 2) there is relatively more pumping in the upper branch; and 3) the conversion time from the upper to the lower polariton branch is long compared to the lifetime of the upper polaritons.


title: The Manin-Peyre conjecture for three del Pezzo surfaces

abstract: The Manin-Peyre conjecture is established for a split singular quintic del Pezzo surface with singularity type $\mathbf{A}_2$ and two split singular quartic del Pezzo surfaces with singularity types $\mathbf{A}_3+\mathbf{A}_1$ and $\mathbf{A}_4$ respectively. We use a unified and different slightly method from the previous and improve their error terms. Our method is general and can handle most of singular del Pezzo surfaces of degree $d\geq 3$.


title: Robust topology optimisation of lattice structures with spatially correlated uncertainties

abstract: The uncertainties in material and other properties of structures are usually spatially correlated. We introduce an efficient technique for representing and processing spatially correlated random fields in robust topology optimisation of lattice structures. Robust optimisation considers the statistics of the structural response to obtain a design whose performance is less sensitive to the specific realisation of the random field. We represent Gaussian random fields on lattices by leveraging the established link between random fields and stochastic partial differential equations (SPDEs). It is known that the precision matrix, i.e. the inverse of the covariance matrix, of a random field with Mat\'ern covariance is equal to the finite element stiffness matrix of a possibly fractional PDE with a second-order elliptic operator. We consider the discretisation of the PDE on the lattice to obtain a random field which, by design, considers its geometry and connectivity. The so-obtained random field can be interpreted as a physics-informed prior by the hypothesis that the elliptic SPDE models the physical processes occurring during manufacturing, like heat and mass diffusion. Although the proposed approach is general, we demonstrate its application to lattices modelled as pin-jointed trusses with uncertainties in member Young's moduli. We consider as a cost function the weighted sum of the expectation and standard deviation of the structural compliance. To compute the expectation and standard deviation and their gradients with respect to member cross-sections we use a first-order Taylor series approximation. The cost function and its gradient are computed using only sparse matrix operations. We demonstrate the efficiency of the proposed approach using several lattice examples with isotropic, anisotropic and non-stationary random fields and up to eighty thousand random and optimisation variables.


title: Two ways game-theoretic probability can improve data analysis

abstract: When testing a statistical hypothesis, is it legitimate to deliberate on the basis of initial data about whether and how to collect further data? Game-theoretic probability's fundamental principle for testing by betting says yes, provided that you are testing by betting and do not risk more capital than initially committed. Standard statistical theory uses Cournot's principle, which does not allow such optional continuation. Cournot's principle can be extended to allow optional continuation when testing is carried out by multiplying likelihood ratios, but the extension lacks the simplicity and generality of testing by betting. Game-theoretic probability can also help us with descriptive data analysis. To obtain a purely and honestly descriptive analysis using competing probability distributions, we have them bet against each other using the Kelly principle. The place of confidence intervals is then taken by a sets of distributions that do relatively well in the competition. In the simplest implementation, these sets coincide with R. A. Fisher's likelihood intervals.


title: Read-only Prompt Optimization for Vision-Language Few-shot Learning

abstract: In recent years, prompt tuning has proven effective in adapting pre-trained vision-language models to downstream tasks. These methods aim to adapt the pre-trained models by introducing learnable prompts while keeping pre-trained weights frozen. However, learnable prompts can affect the internal representation within the self-attention module, which may negatively impact performance variance and generalization, especially in data-deficient settings. To address these issues, we propose a novel approach, Read-only Prompt Optimization (RPO). RPO leverages masked attention to prevent the internal representation shift in the pre-trained model. Further, to facilitate the optimization of RPO, the read-only prompts are initialized based on special tokens of the pre-trained model. Our extensive experiments demonstrate that RPO outperforms CLIP and CoCoOp in base-to-new generalization and domain generalization while displaying better robustness. Also, the proposed method achieves better generalization on extremely data-deficient settings, while improving parameter efficiency and computational overhead. Code is available at https://github.com/mlvlab/RPO.


title: Lower Rate Bounds for Hermitian-Lifted Codes for Odd Prime Characteristic

abstract: Locally recoverable codes are error correcting codes with the additional property that every symbol of any codeword can be recovered from a small set of other symbols. This property is particularly desirable in cloud storage applications. A locally recoverable code is said to have availability $t$ if each position has $t$ disjoint recovery sets. Hermitian-lifted codes are locally recoverable codes with high availability first described by Lopez, Malmskog, Matthews, Pi\~nero-Gonzales, and Wootters. The codes are based on the well-known Hermitian curve and incorporate the novel technique of lifting to increase the rate of the code. Lopez et al. lower bounded the rate of the codes defined over fields with characteristic 2. This paper generalizes their work to show that the rate of Hermitian-lifted codes is bounded below by a positive constant depending on $p$ when $q=p^l$ for any odd prime $p$.


title: Streaming Compression of Scientific Data via weak-SINDy

abstract: In this paper a streaming weak-SINDy algorithm is developed specifically for compressing streaming scientific data. The production of scientific data, either via simulation or experiments, is undergoing an stage of exponential growth, which makes data compression important and often necessary for storing and utilizing large scientific data sets. As opposed to classical ``offline" compression algorithms that perform compression on a readily available data set, streaming compression algorithms compress data ``online" while the data generated from simulation or experiments is still flowing through the system. This feature makes streaming compression algorithms well-suited for scientific data compression, where storing the full data set offline is often infeasible. This work proposes a new streaming compression algorithm, streaming weak-SINDy, which takes advantage of the underlying data characteristics during compression. The streaming weak-SINDy algorithm constructs feature matrices and target vectors in the online stage via a streaming integration method in a memory efficient manner. The feature matrices and target vectors are then used in the offline stage to build a model through a regression process that aims to recover equations that govern the evolution of the data. For compressing high-dimensional streaming data, we adopt a streaming proper orthogonal decomposition (POD) process to reduce the data dimension and then use the streaming weak-SINDy algorithm to compress the temporal data of the POD expansion. We propose modifications to the streaming weak-SINDy algorithm to accommodate the dynamically updated POD basis. By combining the built model from the streaming weak-SINDy algorithm and a small amount of data samples, the full data flow could be reconstructed accurately at a low memory cost, as shown in the numerical tests.


title: Vector Search with OpenAI Embeddings: Lucene Is All You Need

abstract: We provide a reproducible, end-to-end demonstration of vector search with OpenAI embeddings using Lucene on the popular MS MARCO passage ranking test collection. The main goal of our work is to challenge the prevailing narrative that a dedicated vector store is necessary to take advantage of recent advances in deep neural networks as applied to search. Quite the contrary, we show that hierarchical navigable small-world network (HNSW) indexes in Lucene are adequate to provide vector search capabilities in a standard bi-encoder architecture. This suggests that, from a simple cost-benefit analysis, there does not appear to be a compelling reason to introduce a dedicated vector store into a modern "AI stack" for search, since such applications have already received substantial investments in existing, widely deployed infrastructure.