title: Multi-Agent Deep Reinforcement Learning for Distributed Satellite Routing

abstract: This paper introduces a Multi-Agent Deep Reinforcement Learning (MA-DRL) approach for routing in Low Earth Orbit Satellite Constellations (LSatCs). Each satellite is an independent decision-making agent with a partial knowledge of the environment, and supported by feedback received from the nearby agents. Building on our previous work that introduced a Q-routing solution, the contribution of this paper is to extend it to a deep learning framework able to quickly adapt to the network and traffic changes, and based on two phases: (1) An offline exploration learning phase that relies on a global Deep Neural Network (DNN) to learn the optimal paths at each possible position and congestion level; (2) An online exploitation phase with local, on-board, pre-trained DNNs. Results show that MA-DRL efficiently learns optimal routes offline that are then loaded for an efficient distributed routing online.


title: The Cost of Emulating a Small Quantum Annealing Problem in the Circuit-Model

abstract: Demonstrations of quantum advantage for certain sampling problems has generated considerable excitement for quantum computing and has further spurred the development of circuit-model quantum computers, which represent quantum programs as a sequence of quantum gates acting on a finite number of qubits. Amongst this excitement, analog quantum computation has become less prominent, with the expectation that circuit-model quantum computers will eventually be sufficient for emulating analog quantum computation and thus rendering analog quantum computation obsolete. In this work we explore the basic requirements for emulating a specific analog quantum computation in the circuit model: the preparation of a biased superposition of degenerate ground states of an Ising Hamiltonian using an adiabatic evolution. We show that the overhead of emulation is substantial even for this simple problem. This supports using analog quantum computation for solving time-dependent Hamiltonian dynamics in the short and mid-term, assuming analog errors can be made low enough and coherence times long enough to solve problems of practical interest.


title: Spectral Gap Superposition States

abstract: This work introduces a novel NISQ-friendly procedure for estimating spectral gaps in quantum systems. By leveraging Adiabatic Thermalization, we are able to create the Spectral Gap Superposition state, a newly defined quantum state exhibiting observable fluctuations in time that allow for the accurate estimation of any energy gap. Our method is tested by estimating the energy gap between the ground and the first excited state for the 1D and 2D Ising model, the Hydrogen molecule H2 and Helium molecule He2. Despite limiting our circuit design to have at most 40 Trotter steps, our numerical experiments of both noiseless and noisy devices for the presented systems give relative errors in the order of $10^{-2}$ and $10^{-1}$. Further experiments on the IonQ Aria device lead to spectral gap estimations with a relative error of $10^{-2}$ for a 4-site Ising chain, demonstrating the validity of the procedure for NISQ devices and charting a path towards a new way of calculating energy gaps.


title: Contractility-driven cell motility against a viscoelastic resistance

abstract: We study a model of contraction-based cell motility inside a microchannel to investigate the regulation of cell polarization and motion by the mechanical resistance of the environment. A positive feedback between the asymmetry of the acto-myosin cortex density and cell motion gives rise to a spontaneous symmetry breaking beyond a threshold contractility that depends on the resistance of extracellular medium. In highly viscous environments, we predict bistability under moderate contractility, so that symmetry breaking needs to be activated. In a viscoelastic environment, we find periodic oscillations in cortex density and velocity polarization. At the boundary between viscous and viscoelastic environments, the cell may either cross into the viscoelastic medium, bounce back into the viscous medium, or become trapped at the boundary. The different scenarios defined different phase diagram that are confirmed by numerical simulations.


title: The lower plus and upper plus constructions for fibered biset functors

abstract: Let A be an abelian group, not necessarily finite. The main objective of this paper is to provide two constructions for a fibered A-biset functor. The first is the lower plus construction, and the other is the upper plus construction. These constructions coincide with the lower plus and upper plus constructions for biset functors (see [2]) when the fiber is the trivial group {.}.


title: Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models

abstract: As foundation models (FMs) continue to shape the landscape of AI, the in-context learning (ICL) paradigm thrives but also encounters issues such as toxicity, hallucination, disparity, adversarial vulnerability, and inconsistency. Ensuring the reliability and responsibility of FMs is crucial for the sustainable development of the AI ecosystem. In this concise overview, we investigate recent advancements in enhancing the reliability and trustworthiness of FMs within ICL frameworks, focusing on four key methodologies, each with its corresponding subgoals. We sincerely hope this paper can provide valuable insights for researchers and practitioners endeavoring to build safe and dependable FMs and foster a stable and consistent ICL environment, thereby unlocking their vast potential.


title: SDF2Net: Shallow to Deep Feature Fusion Network for PolSAR Image Classification

abstract: Polarimetric synthetic aperture radar (PolSAR) images encompass valuable information that can facilitate extensive land cover interpretation and generate diverse output products. Extracting meaningful features from PolSAR data poses challenges distinct from those encountered in optical imagery. Deep learning (DL) methods offer effective solutions for overcoming these challenges in PolSAR feature extraction. Convolutional neural networks (CNNs) play a crucial role in capturing PolSAR image characteristics by leveraging kernel capabilities to consider local information and the complex-valued nature of PolSAR data. In this study, a novel three-branch fusion of complex-valued CNN, named the Shallow to Deep Feature Fusion Network (SDF2Net), is proposed for PolSAR image classification. To validate the performance of the proposed method, classification results are compared against multiple state-of-the-art approaches using the airborne synthetic aperture radar (AIRSAR) datasets of Flevoland and San Francisco, as well as the ESAR Oberpfaffenhofen dataset. The results indicate that the proposed approach demonstrates improvements in overallaccuracy, with a 1.3% and 0.8% enhancement for the AIRSAR datasets and a 0.5% improvement for the ESAR dataset. Analyses conducted on the Flevoland data underscore the effectiveness of the SDF2Net model, revealing a promising overall accuracy of 96.01% even with only a 1% sampling ratio.


title: Scaling properties of the action in the Riemann-Liouville fractional standard map

abstract: The Riemann-Liouville fractional standard map (RL-fSM) is a two-dimensional nonlinear map with memory given in action-angle variables $(I,\theta)$. The RL-fSM is parameterized by $K$ and $\alpha\in(1,2]$ which control the strength of nonlinearity and the fractional order of the Riemann-Liouville derivative, respectively. In this work, we present a scaling study of the average squared action $\left< I^2 \right>$ of the RL-fSM along strongly chaotic orbits, i.e. for $K\gg1$. We observe two scenarios depending on the initial action $I_0$, $I_0\ll K$ or $I_0\gg K$. However, we can show that $\left< I^2 \right>/I_0^2$ is a universal function of the scaled discrete time $nK^2/I_0^2$ ($n$ being the $n$th iteration of the RL-fSM). In addition, we note that $\left< I^2 \right>$ is independent of $\alpha$ for $K\gg1$. Analytical estimations support our numerical results.


title: Highly-Efficient Persistent FIFO Queues

abstract: In this paper, we study the question whether techniques employed, in a conventional system, by state-of-the-art concurrent algorithms to avoid contended hot spots are still efficient for recoverable computing in settings with Non-Volatile Memory (NVM). We focus on concurrent FIFO queues that have two end-points, head and tail, which are highly contended. We present a persistent FIFO queue implementation that performs a pair of persistence instructions per operation (enqueue or dequeue). The algorithm achieves to perform these instructions on variables of low contention by employing Fetch&Increment and using the state-of-the-art queue implementation by Afek and Morrison (PPoPP'13). These result in performance that is up to 2x faster than state-of-the-art persistent FIFO queue implementations.


title: Symmetry breaking mechanisms of the 3BF action for the Standard Model coupled to gravity

abstract: We study the details of the explicit and spontaneous symmetry breaking of the constrained 3BF action representing the Standard Model coupled to Einstein-Cartan gravity. First we discuss how each particular constraint breaks the original symmetry of the topological 3BF action. Then we investigate the spontaneous symmetry breaking and the Higgs mechanism for the electroweak theory in the constrained 3BF form, in order to demonstrate that they can indeed be performed in the framework of higher gauge theory. A formulation of the Proca action as a constrained 3BF theory is also studied in detail.


title: Porosity of the Free Boundary in a Class of Higher-Dimensional Elliptic Problems

abstract: We investigate a class of n-dimensional free boundary elliptic problems which includes the dam problem, the aluminum problem, and the lubrication problem. We establish that the free boundary in this class is a porous set, which implies its Hausdorff dimension being less than $n$, which in turn leads to its Lebesgue measure being zero. Our proof relies on the comparison of the solution with an appropriately constructed barrier function.


title: Deformations of I-surfaces with elliptic singularities

abstract: An I-surface $S$ is an algebraic surface of general type with $K_S^2 = 1$ and $p_g(S) = 2$. Recent research has centered on trying to give an explicit description of the KSBA compactification of the moduli space of these surfaces. The possible normal Gorenstein examples have been enumerated by work of Franciosi-Pardini-Rollenske. The goal of this paper is to give a more precise description of such surfaces in case their singularities are simple elliptic and/or cusp singularities, and to work out their deformation theory. In particular, under some mild general position assumptions, we show that deformations of the surfaces in question are versal for deformations of the singular points, with two exceptions where the discrepancy is analyzed in detail.


title: CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attention

abstract: Reverse engineering in the realm of Computer-Aided Design (CAD) has been a longstanding aspiration, though not yet entirely realized. Its primary aim is to uncover the CAD process behind a physical object given its 3D scan. We propose CAD-SIGNet, an end-to-end trainable and auto-regressive architecture to recover the design history of a CAD model represented as a sequence of sketch-and-extrusion from an input point cloud. Our model learns visual-language representations by layer-wise cross-attention between point cloud and CAD language embedding. In particular, a new Sketch instance Guided Attention (SGA) module is proposed in order to reconstruct the fine-grained details of the sketches. Thanks to its auto-regressive nature, CAD-SIGNet not only reconstructs a unique full design history of the corresponding CAD model given an input point cloud but also provides multiple plausible design choices. This allows for an interactive reverse engineering scenario by providing designers with multiple next-step choices along with the design process. Extensive experiments on publicly available CAD datasets showcase the effectiveness of our approach against existing baseline models in two settings, namely, full design history recovery and conditional auto-completion from point clouds.


title: The Emergence of Large Language Models in Static Analysis: A First Look through Micro-Benchmarks

abstract: The application of Large Language Models (LLMs) in software engineering, particularly in static analysis tasks, represents a paradigm shift in the field. In this paper, we investigate the role that current LLMs can play in improving callgraph analysis and type inference for Python programs. Using the PyCG, HeaderGen, and TypeEvalPy micro-benchmarks, we evaluate 26 LLMs, including OpenAI's GPT series and open-source models such as LLaMA. Our study reveals that LLMs show promising results in type inference, demonstrating higher accuracy than traditional methods, yet they exhibit limitations in callgraph analysis. This contrast emphasizes the need for specialized fine-tuning of LLMs to better suit specific static analysis tasks. Our findings provide a foundation for further research towards integrating LLMs for static analysis tasks.


title: MCF-VC: Mitigate Catastrophic Forgetting in Class-Incremental Learning for Multimodal Video Captioning

abstract: To address the problem of catastrophic forgetting due to the invisibility of old categories in sequential input, existing work based on relatively simple categorization tasks has made some progress. In contrast, video captioning is a more complex task in multimodal scenario, which has not been explored in the field of incremental learning. After identifying this stability-plasticity problem when analyzing video with sequential input, we originally propose a method to Mitigate Catastrophic Forgetting in class-incremental learning for multimodal Video Captioning (MCF-VC). As for effectively maintaining good performance on old tasks at the macro level, we design Fine-grained Sensitivity Selection (FgSS) based on the Mask of Linear's Parameters and Fisher Sensitivity to pick useful knowledge from old tasks. Further, in order to better constrain the knowledge characteristics of old and new tasks at the specific feature level, we have created the Two-stage Knowledge Distillation (TsKD), which is able to learn the new task well while weighing the old task. Specifically, we design two distillation losses, which constrain the cross modal semantic information of semantic attention feature map and the textual information of the final outputs respectively, so that the inter-model and intra-model stylized knowledge of the old class is retained while learning the new class. In order to illustrate the ability of our model to resist forgetting, we designed a metric CIDER_t to detect the stage forgetting rate. Our experiments on the public dataset MSR-VTT show that the proposed method significantly resists the forgetting of previous tasks without replaying old samples, and performs well on the new task.


title: JKO schemes with general transport costs

abstract: We modify the JKO scheme, which is a time discretization of Wasserstein gradient flows, by replacing the Wasserstein distance with more general transport costs on manifolds. We show when the cost function has a mixed Hessian which defines a Riemannian metric, our modified JKO scheme converges under suitable conditions to the corresponding Riemannian Fokker--Planck equation. Thus on a Riemannian manifold one may replace the (squared) Riemannian distance with any cost function which induces the metric. Of interest is when the Riemannian distance is computationally intractable, but a suitable cost has a simple analytic expression. We consider the Fokker--Planck equation on compact submanifolds with the Neumann boundary condition and on complete Riemannian manifolds with a finite drift condition. As an application we consider Hessian manifolds, taking as a cost the Bregman divergence.


title: NextLevelBERT: Masked Language Modeling with Higher-Level Representations for Long Documents

abstract: While (large) language models have significantly improved over the last years, they still struggle to sensibly process long sequences found, e.g., in books, due to the quadratic scaling of the underlying attention mechanism. To address this, we propose NextLevelBERT, a Masked Language Model operating not on tokens, but on higher-level semantic representations in the form of text embeddings. We pretrain NextLevelBERT to predict the vector representation of entire masked text chunks and evaluate the effectiveness of the resulting document vectors on three types of tasks: 1) Semantic Textual Similarity via zero-shot document embeddings, 2) Long document classification, 3) Multiple-choice question answering. We find that next-level Masked Language Modeling is an effective technique to tackle long-document use cases and can outperfor much larger embedding models as long as the required level of detail of semantic information is not too fine. Our models and code are publicly available online.


title: Inversion of a restricted transverse ray transform with sources on a curve

abstract: In this paper, a restricted transverse ray transform acting on vector and symmetric $m$-tensor fields is studied. We developed inversion algorithms using restricted transverse ray transform data to recover symmetric $m$-tensor fields in $\mathbb{R}^3$ and vector fields in $\mathbb{R}^n$. We restrict the transverse ray transform to all lines going through a fixed curve $\gamma$ that satisfies the Kirillov-Tuy condition. We show that the known restricted data can be used to reconstruct a specific weighted Radon transform of the unknown vector/tensor field's components, which we then use to explicitly recover the unknown field.


title: Stochastic expansion for the pricing of Asian and basket options

abstract: We present closed analytical approximations for the pricing of basket options, also applicable to Asian options with discrete averaging under the Black-Scholes model with time-dependent parameters. The formulae are obtained by using a stochastic Taylor expansion around a log-normal proxy model and are found to be highly accurate for Asian options in practice as well as for vanilla options with discrete dividends.


title: Attosecond X-ray Chronoscopy of Core-level Photoemission

abstract: Attosecond photoemission or photoionization delays are a unique probe of the structure and the electronic dynamics of matter. However, spectral congestion and spatial delocalization of valence electron wave functions set fundamental limits to the complexity of systems that can be studied and the information that can be retrieved, respectively. Using attosecond X-ray pulses from LCLS, we demonstrate the key advantages of measuring core-level delays: the photoelectron spectra remain atom-like, the measurements become element specific and the observed scattering dynamics originate from a point-like source. We exploit these unique features to reveal the effects of electronegativity and symmetry on attosecond scattering dynamics by measuring the photoionization delays between N-1s and C-1s core shells of a series of aromatic azabenzene molecules. Remarkably, the delays systematically increase with the number of nitrogen atoms in the molecule and reveal multiple resonances. We identify two previously unknown mechanisms regulating the associated attosecond dynamics, namely the enhanced confinement of the trapped wavefunction with increasing electronegativity of the atoms and the decrease of the coupling strength among the photoemitted partial waves with increasing symmetry. This study demonstrates the unique opportunities opened by measurements of core-level photoionization delays for unravelling attosecond electron dynamics in complex matter.


title: Outlier-Detection for Reactive Machine Learned Potential Energy Surfaces

abstract: Uncertainty quantification (UQ) to detect samples with large expected errors (outliers) is applied to reactive molecular potential energy surfaces (PESs). Three methods - Ensembles, Deep Evidential Regression (DER), and Gaussian Mixture Models (GMM) - were applied to the H-transfer reaction between ${\it syn-}$Criegee and vinyl hydroxyperoxide. The results indicate that ensemble models provide the best results for detecting outliers, followed by GMM. For example, from a pool of 1000 structures with the largest uncertainty, the detection quality for outliers is $\sim 90$ \% and $\sim 50$ \%, respectively, if 25 or 1000 structures with large errors are sought. On the contrary, the limitations of the statistical assumptions of DER greatly impacted its prediction capabilities. Finally, a structure-based indicator was found to be correlated with large average error, which may help to rapidly classify new structures into those that provide an advantage for refining the neural network.


title: On the maximum intersecting sets of the general semilinear group of degree $2$

abstract: Let $p$ be a prime and $q = p^k$. A subset $\mathcal{F} \subset \operatorname{\Gamma L}_{2}(q)$ is intersecting if any two semilinear transformations in $\mathcal{F}$ agree on some non-zero vector in $\mathbb{F}_q^2$. We show that any intersecting set of $\operatorname{\Gamma L}_{2}(q)$ is of size at most that of a stabilizer of a non-zero vector, and we characterize the intersecting sets of this size. Our proof relies on finding a subgraph which is a lexicographic product in the derangement graph of $\operatorname{\Gamma L}_{2}(q)$ in its action on non-zero vectors of $\mathbb{F}_q^2$. This method is also applied to give a new proof that the only maximal intersecting sets of $\operatorname{GL}_{2}(q)$ are the maximum intersecting sets.


title: Novel spectral methods for shock capturing and the removal of tygers in computational fluid dynamics

abstract: Spectral methods yield numerical solutions of the Galerkin-truncated versions of nonlinear partial differential equations involved especially in fluid dynamics. In the presence of discontinuities, such as shocks, spectral approximations develop Gibbs oscillations near the discontinuity. This causes the numerical solution to deviate quickly from the true solution. For spectral approximations of the 1D inviscid Burgers equation, nonlinear wave resonances lead to the formation of tygers in well-resolved areas of the flow, far from the shock. Recently, Besse(to be published) has proposed novel spectral relaxation (SR) and spectral purging (SP) schemes for the removal of tygers and Gibbs oscillations in spectral approximations of nonlinear conservation laws. For the 1D inviscid Burgers equation, it is shown that the novel SR and SP approximations of the solution converge strongly in L2 norm to the entropic weak solution, under an appropriate choice of kernels and related parameters. In this work, we carry out a detailed numerical investigation of SR and SP schemes when applied to the 1D inviscid Burgers equation and report the efficiency of shock capture and the removal of tygers. We then extend our study to systems of nonlinear hyperbolic conservation laws - such as the 2x2 system of the shallow water equations and the standard 3x3 system of 1D compressible Euler equations. For the latter, we generalise the implementation of SR methods to non-periodic problems using Chebyshev polynomials. We then turn to singular flow in the 1D wall approximation of the 3D-axisymmetric wall-bounded incompressible Euler equation. Here, in order to determine the blowup time of the solution, we compare the decay of the width of the analyticity strip, obtained from the pure pseudospectral method, with the improved estimate obtained using the novel spectral relaxation scheme.


title: QoS prediction in radio vehicular environments via prior user information

abstract: Reliable wireless communications play an important role in the automotive industry as it helps to enhance current use cases and enable new ones such as connected autonomous driving, platooning, cooperative maneuvering, teleoperated driving, and smart navigation. These and other use cases often rely on specific quality of service (QoS) levels for communication. Recently, the area of predictive quality of service (QoS) has received a great deal of attention as a key enabler to forecast communication quality well enough in advance. However, predicting QoS in a reliable manner is a notoriously difficult task. In this paper, we evaluate ML tree-ensemble methods to predict QoS in the range of minutes with data collected from a cellular test network. We discuss radio environment characteristics and we showcase how these can be used to improve ML performance and further support the uptake of ML in commercial networks. Specifically, we use the correlations of the measurements coming from the radio environment by including information of prior vehicles to enhance the prediction of the target vehicles. Moreover, we are extending prior art by showing how longer prediction horizons can be supported.


title: Autonomous Vehicles: Evolution of Artificial Intelligence and Learning Algorithms

abstract: The advent of autonomous vehicles has heralded a transformative era in transportation, reshaping the landscape of mobility through cutting-edge technologies. Central to this evolution is the integration of Artificial Intelligence (AI) and learning algorithms, propelling vehicles into realms of unprecedented autonomy. This paper provides a comprehensive exploration of the evolutionary trajectory of AI within autonomous vehicles, tracing the journey from foundational principles to the most recent advancements. Commencing with a current landscape overview, the paper delves into the fundamental role of AI in shaping the autonomous decision-making capabilities of vehicles. It elucidates the steps involved in the AI-powered development life cycle in vehicles, addressing ethical considerations and bias in AI-driven software development for autonomous vehicles. The study presents statistical insights into the usage and types of AI/learning algorithms over the years, showcasing the evolving research landscape within the automotive industry. Furthermore, the paper highlights the pivotal role of parameters in refining algorithms for both trucks and cars, facilitating vehicles to adapt, learn, and improve performance over time. It concludes by outlining different levels of autonomy, elucidating the nuanced usage of AI and learning algorithms, and automating key tasks at each level. Additionally, the document discusses the variation in software package sizes across different autonomy levels


title: Expansion dynamics of Bose-Einstein condensates in a synthetic magnetic field

abstract: We investigate the expansion dynamics of spin-orbit-coupled Bose-Einstein condensates subjected to a synthetic magnetic field, after their release from an external harmonic trap. Our findings reveal that the condensate experiences a spin-dependent rotation and separation due to the rigid-like rotational velocity field, which leads to a spin density deflection. The deflection angle reaches a peak at a time that is inversely related to the frequency of the harmonic trap. When the detuning gradient is below a critical value for vortex nucleation, our analytical results derived from a spinor hydrodynamic theory align closely with numerical results using the coupled Gross-Pitaevskii equations. Beyond this critical value, we also numerically simulated the expansion dynamics of the condensates containing vortices with negative circulation. Our findings highlight the pivotal role of the rigid-like rotational velocity field on the dynamics of the condensate and may stimulate further experimental investigations into the rich superfluid dynamics induced by synthetic magnetic fields.


title: Survival analysis for AdVerse events with VarYing follow-up times (SAVVY): summary of findings and a roadmap for the future of safety analyses in clinical trials

abstract: The SAVVY project aims to improve the analyses of adverse events (AEs) in clinical trials through the use of survival techniques appropriately dealing with varying follow-up times and competing events (CEs). This paper summarizes key features and conclusions from the various SAVVY papers. Through theoretical investigations using simulations and in an empirical study including randomized clinical trials from several sponsor organisations, biases from ignoring varying follow-up times or CEs are investigated. The bias of commonly used estimators of the absolute and relative AE risk is quantified. Furthermore, we provide a cursory assessment of how pertinent guidelines for the analysis of safety data deal with the features of varying follow-up time and CEs. SAVVY finds that for both, avoiding bias and categorization of evidence with respect to treatment effect on AE risk into categories, the choice of the estimator is key and more important than features of the underlying data such as percentage of censoring, CEs, amount of follow-up, or value of the gold-standard. The choice of the estimator of the cumulative AE probability and the definition of CEs are crucial. SAVVY recommends using the Aalen-Johansen estimator (AJE) with an appropriate definition of CEs whenever the risk for AEs is to be quantified. There is an urgent need to improve the guidelines of reporting AEs so that incidence proportions or one minus Kaplan-Meier estimators are finally replaced by the AJE with appropriate definition of CEs.


title: A Complete Graphical Language for Linear Optical Circuits with Finite-Photon-Number Sources and Detectors

abstract: Linear optical circuits can be used to manipulate the quantum states of photons as they pass through components including beam splitters and phase shifters. Those photonic states possess a particularly high level of expressiveness, as they reside within the bosonic Fock space, an infinite-dimensional Hilbert space. However, in the domain of linear optical quantum computation, these basic components may not be sufficient to efficiently perform all computations of interest, such as universal quantum computation. To address this limitation it is common to add auxiliary sources and detectors, which enable projections onto auxiliary photonic states and thus increase the versatility of the processes. In this paper, we introduce the $\textbf{LO}_{fi}$-calculus, a graphical language to reason on the infinite-dimensional bosonic Fock space with circuits composed of four core elements of linear optics: the phase shifter, the beam splitter, and auxiliary sources and detectors with bounded photon number. We present an equational theory that we prove to be complete: two $\textbf{LO}_{fi}$-circuits represent the same quantum process if and only if one can be transformed into the other with the rules of the $\textbf{LO}_{fi}$-calculus. We give a unique and compact universal form for such circuits.


title: Optimal Control Barrier Functions: Maximizing the Action Space Subject to Control Bounds

abstract: This letter addresses the constraint compatibility problem of control barrier functions (CBFs), which occurs when a safety-critical CBF requires a system to apply more control effort than it is capable of generating. This inevitably leads to a safety violation, which transitions the system to an unsafe (and possibly dangerous) trajectory. We resolve the constraint compatibility problem by constructing a control barrier function that maximizes the feasible action space for first and second-order constraints, and we prove that the optimal CBF encodes a dynamical motion primitive. Furthermore, we show that this dynamical motion primitive contains an implicit model for the future trajectory for time-varying components of the system. We validate our optimal CBF in simulation, and compare its behavior with a linear CBF.


title: Geometric Deep Learning for Computer-Aided Design: A Survey

abstract: Geometric Deep Learning techniques have become a transformative force in the field of Computer-Aided Design (CAD), and have the potential to revolutionize how designers and engineers approach and enhance the design process. By harnessing the power of machine learning-based methods, CAD designers can optimize their workflows, save time and effort while making better informed decisions, and create designs that are both innovative and practical. The ability to process the CAD designs represented by geometric data and to analyze their encoded features enables the identification of similarities among diverse CAD models, the proposition of alternative designs and enhancements, and even the generation of novel design alternatives. This survey offers a comprehensive overview of learning-based methods in computer-aided design across various categories, including similarity analysis and retrieval, 2D and 3D CAD model synthesis, and CAD generation from point clouds. Additionally, it provides a complete list of benchmark datasets and their characteristics, along with open-source codes that have propelled research in this domain. The final discussion delves into the challenges prevalent in this field, followed by potential future research directions in this rapidly evolving field.


title: Adaptive waveform inversion for transmitted wave data

abstract: Adaptive Waveform Inversion applied to transient transmitted wave data yields estimates of index of refraction (or wave velocity) similar to those obtained by travel time inversion, provided that the data contain a single smooth wavefront.


title: Testing approximate infrared scattering radiative-transfer methods for hot Jupiter atmospheres

abstract: The calculation of internal atmospheric (longwave) fluxes is a key component of any model of exoplanet atmospheres that requires radiative-transfer (RT) calculations. For atmospheres containing a strong scattering component such as cloud particles, most 1D multiple-scattering RT methods typically involve numerically expensive matrix inversions. This computational bottleneck is exacerbated when multitudes of RT calculations are required, such as in general circulation models (GCMs) and retrieval methods. In an effort to increase the speed of RT calculations without sacrificing too much accuracy, we investigate the applicability of approximate longwave scattering methods developed for the Earth science community to hot Jupiter atmospheres. We test the absorption approximation (AA) and variational iteration method (VIM) applied to typical cloudy hot Jupiter scenarios, using 64 stream DISORT calculations as reference solutions. We find the four-stream VIM variant is a highly promising method to explore using for hot Jupiter GCM and retrieval modelling, showing excellent speed characteristics, with typical errors $\sim$1\% for outgoing fluxes and within $\sim$50\%, but with larger errors in the deep cloud layer test case, for vertical heating rates. Other methods explored in this study were found to typically produce similar error characteristics in vertical heating rates.


title: Learning reduced-order Quadratic-Linear models in Process Engineering using Operator Inference

abstract: In this work, we address the challenge of efficiently modeling dynamical systems in process engineering. We use reduced-order model learning, specifically operator inference. This is a non-intrusive, data-driven method for learning dynamical systems from time-domain data. The application in our study is carbon dioxide methanation, an important reaction within the Power-to-X framework, to demonstrate its potential. The numerical results show the ability of the reduced-order models constructed with operator inference to provide a reduced yet accurate surrogate solution. This represents an important milestone towards the implementation of fast and reliable digital twin architectures.


title: Gradient-based Discrete Sampling with Automatic Cyclical Scheduling

abstract: Discrete distributions, particularly in high-dimensional deep models, are often highly multimodal due to inherent discontinuities. While gradient-based discrete sampling has proven effective, it is susceptible to becoming trapped in local modes due to the gradient information. To tackle this challenge, we propose an automatic cyclical scheduling, designed for efficient and accurate sampling in multimodal discrete distributions. Our method contains three key components: (1) a cyclical step size schedule where large steps discover new modes and small steps exploit each mode; (2) a cyclical balancing schedule, ensuring ``balanced" proposals for given step sizes and high efficiency of the Markov chain; and (3) an automatic tuning scheme for adjusting the hyperparameters in the cyclical schedules, allowing adaptability across diverse datasets with minimal tuning. We prove the non-asymptotic convergence and inference guarantee for our method in general discrete distributions. Extensive experiments demonstrate the superiority of our method in sampling complex multimodal discrete distributions.


title: RAVEL: Evaluating Interpretability Methods on Disentangling Language Model Representations

abstract: Individual neurons participate in the representation of multiple high-level concepts. To what extent can different interpretability methods successfully disentangle these roles? To help address this question, we introduce RAVEL (Resolving Attribute-Value Entanglements in Language Models), a dataset that enables tightly controlled, quantitative comparisons between a variety of existing interpretability methods. We use the resulting conceptual framework to define the new method of Multi-task Distributed Alignment Search (MDAS), which allows us to find distributed representations satisfying multiple causal criteria. With Llama2-7B as the target language model, MDAS achieves state-of-the-art results on RAVEL, demonstrating the importance of going beyond neuron-level analyses to identify features distributed across activations. We release our benchmark at https://github.com/explanare/ravel.


title: Real-time Low-latency Music Source Separation using Hybrid Spectrogram-TasNet

abstract: There have been significant advances in deep learning for music demixing in recent years. However, there has been little attention given to how these neural networks can be adapted for real-time low-latency applications, which could be helpful for hearing aids, remixing audio streams and live shows. In this paper, we investigate the various challenges involved in adapting current demixing models in the literature for this use case. Subsequently, inspired by the Hybrid Demucs architecture, we propose the Hybrid Spectrogram Time-domain Audio Separation Network HS-TasNet, which utilises the advantages of spectral and waveform domains. For a latency of 23 ms, the HS-TasNet obtains an overall signal-to-distortion ratio (SDR) of 4.65 on the MusDB test set, and increases to 5.55 with additional training data. These results demonstrate the potential of efficient demixing for real-time low-latency music applications.


title: The SCIP Optimization Suite 9.0

abstract: The SCIP Optimization Suite provides a collection of software packages for mathematical optimization, centered around the constraint integer programming (CIP) framework SCIP. This report discusses the enhancements and extensions included in the SCIP Optimization Suite 9.0. The updates in SCIP 9.0 include improved symmetry handling, additions and improvements of nonlinear handlers and primal heuristics, a new cut generator and two new cut selection schemes, a new branching rule, a new LP interface, and several bug fixes. The SCIP Optimization Suite 9.0 also features new Rust and C++ interfaces for SCIP, new Python interface for SoPlex, along with enhancements to existing interfaces. The SCIP Optimization Suite 9.0 also includes new and improved features in the LP solver SoPlex, the presolving library PaPILO, the parallel framework UG, the decomposition framework GCG, and the SCIP extension SCIP-SDP. These additions and enhancements have resulted in an overall performance improvement of SCIP in terms of solving time, number of nodes in the branch-and-bound tree, as well as the reliability of the solver.


title: Model Free Deep Deterministic Policy Gradient Controller for Setpoint Tracking of Non-minimum Phase Systems

abstract: Deep Reinforcement Learning (DRL) techniques have received significant attention in control and decision-making algorithms. Most applications involve complex decision-making systems, justified by the algorithms' computational power and cost. While model-based versions are emerging, model-free DRL approaches are intriguing for their independence from models, yet they remain relatively less explored in terms of performance, particularly in applied control. This study conducts a thorough performance analysis comparing the data-driven DRL paradigm with a classical state feedback controller, both designed based on the same cost (reward) function of the linear quadratic regulator (LQR) problem. Twelve additional performance criteria are introduced to assess the controllers' performance, independent of the LQR problem for which they are designed. Two Deep Deterministic Policy Gradient (DDPG)-based controllers are developed, leveraging DDPG's widespread reputation. These controllers are aimed at addressing a challenging setpoint tracking problem in a Non-Minimum Phase (NMP) system. The performance and robustness of the controllers are assessed in the presence of operational challenges, including disturbance, noise, initial conditions, and model uncertainties. The findings suggest that the DDPG controller demonstrates promising behavior under rigorous test conditions. Nevertheless, further improvements are necessary for the DDPG controller to outperform classical methods in all criteria. While DRL algorithms may excel in complex environments owing to the flexibility in the reward function definition, this paper offers practical insights and a comparison framework specifically designed to evaluate these algorithms within the context of control engineering.


title: Transfer Learning Bayesian Optimization to Design Competitor DNA Molecules for Use in Diagnostic Assays

abstract: With the rise in engineered biomolecular devices, there is an increased need for tailor-made biological sequences. Often, many similar biological sequences need to be made for a specific application meaning numerous, sometimes prohibitively expensive, lab experiments are necessary for their optimization. This paper presents a transfer learning design of experiments workflow to make this development feasible. By combining a transfer learning surrogate model with Bayesian optimization, we show how the total number of experiments can be reduced by sharing information between optimization tasks. We demonstrate the reduction in the number of experiments using data from the development of DNA competitors for use in an amplification-based diagnostic assay. We use cross-validation to compare the predictive accuracy of different transfer learning models, and then compare the performance of the models for both single objective and penalized optimization tasks.


title: Federated Learning for Estimating Heterogeneous Treatment Effects

abstract: Machine learning methods for estimating heterogeneous treatment effects (HTE) facilitate large-scale personalized decision-making across various domains such as healthcare, policy making, education, and more. Current machine learning approaches for HTE require access to substantial amounts of data per treatment, and the high costs associated with interventions makes centrally collecting so much data for each intervention a formidable challenge. To overcome this obstacle, in this work, we propose a novel framework for collaborative learning of HTE estimators across institutions via Federated Learning. We show that even under a diversity of interventions and subject populations across clients, one can jointly learn a common feature representation, while concurrently and privately learning the specific predictive functions for outcomes under distinct interventions across institutions. Our framework and the associated algorithm are based on this insight, and leverage tabular transformers to map multiple input data to feature representations which are then used for outcome prediction via multi-task learning. We also propose a novel way of federated training of personalised transformers that can work with heterogeneous input feature spaces. Experimental results on real-world clinical trial data demonstrate the effectiveness of our method.


title: Adaptive quantization with mixed-precision based on low-cost proxy

abstract: It is critical to deploy complicated neural network models on hardware with limited resources. This paper proposes a novel model quantization method, named the Low-Cost Proxy-Based Adaptive Mixed-Precision Model Quantization (LCPAQ), which contains three key modules. The hardware-aware module is designed by considering the hardware limitations, while an adaptive mixed-precision quantization module is developed to evaluate the quantization sensitivity by using the Hessian matrix and Pareto frontier techniques. Integer linear programming is used to fine-tune the quantization across different layers. Then the low-cost proxy neural architecture search module efficiently explores the ideal quantization hyperparameters. Experiments on the ImageNet demonstrate that the proposed LCPAQ achieves comparable or superior quantization accuracy to existing mixed-precision models. Notably, LCPAQ achieves 1/200 of the search time compared with existing methods, which provides a shortcut in practical quantization use for resource-limited devices.


title: Rolling vesicles: From confined rotational flows to surface-enabled motion

abstract: The interaction of surfaces in relative motion in wet environments is dominated by lubrication forces, which play a pivotal role in the dynamics of microscopic systems. Here, we develop motile vesicles that exploit lubrication forces to roll on substrates. The activity of the vesicle comes from the confined rotational flow generated by a driven rotating particle encapsulated within the vesicle by droplet-microfluidics. Lubrication forces driving vesicle rolling are controlled by membrane mechanics and its tribological properties. This provides the design principles for motile vesicles that exploit frictional forces to efficiently navigate through complex environments.


title: Noise Aware Path Planning and Power Management of Hybrid Fuel UAVs

abstract: Hybrid fuel Unmanned Aerial Vehicles (UAV), through their combination of multiple energy sources, offer several advantages over the standard single fuel source configuration, the primary one being increased range and efficiency. Multiple power or fuel sources also allow the distinct pitfalls of each source to be mitigated while exploiting the advantages within the mission or path planning. We consider here a UAV equipped with a combustion engine-generator and battery pack as energy sources. We consider the path planning and power-management of this platform in a noise-aware manner. To solve the path planning problem, we first present the Mixed Integer Linear Program (MILP) formulation of the problem. We then present and analyze a label-correcting algorithm, for which a pseudo-polynomial running time is proven. Results of extensive numerical testing are presented which analyze the performance and scalability of the labeling algorithm for various graph structures, problem parameters, and search heuristics. It is shown that the algorithm can solve instances on graphs as large as twenty thousand nodes in only a few seconds.


title: Case-Based or Rule-Based: How Do Transformers Do the Math?

abstract: Despite the impressive performance in a variety of complex tasks, modern large language models (LLMs) still have trouble dealing with some math problems that are simple and intuitive for humans, such as addition. While we can easily learn basic rules of addition and apply them to new problems of any length, LLMs struggle to do the same. Instead, they may rely on similar cases seen in the training corpus for help. We define these two different reasoning mechanisms as "rule-based reasoning" and "case-based reasoning". Since rule-based reasoning is essential for acquiring systematic generalization ability, we aim to explore exactly whether transformers use rule-based or case-based reasoning for math problems. Through carefully designed intervention experiments on five math tasks, we confirm that transformers are performing case-based reasoning, no matter whether scratchpad is used, which aligns with the previous observations that transformers use subgraph matching/shortcut learning to reason. To mitigate such problems, we propose a Rule-Following Fine-Tuning (RFFT) technique to teach transformers to perform rule-based reasoning. Specifically, we provide explicit rules in the input and then instruct transformers to recite and follow the rules step by step. Through RFFT, we successfully enable LLMs fine-tuned on 1-5 digit addition to generalize to up to 12-digit addition with over 95% accuracy, which is over 40% higher than scratchpad. The significant improvement demonstrates that teaching LLMs to use rules explicitly helps them learn rule-based reasoning and generalize better in length.


title: Understanding Neural Network Binarization with Forward and Backward Proximal Quantizers

abstract: In neural network binarization, BinaryConnect (BC) and its variants are considered the standard. These methods apply the sign function in their forward pass and their respective gradients are backpropagated to update the weights. However, the derivative of the sign function is zero whenever defined, which consequently freezes training. Therefore, implementations of BC (e.g., BNN) usually replace the derivative of sign in the backward computation with identity or other approximate gradient alternatives. Although such practice works well empirically, it is largely a heuristic or ''training trick.'' We aim at shedding some light on these training tricks from the optimization perspective. Building from existing theory on ProxConnect (PC, a generalization of BC), we (1) equip PC with different forward-backward quantizers and obtain ProxConnect++ (PC++) that includes existing binarization techniques as special cases; (2) derive a principled way to synthesize forward-backward quantizers with automatic theoretical guarantees; (3) illustrate our theory by proposing an enhanced binarization algorithm BNN++; (4) conduct image classification experiments on CNNs and vision transformers, and empirically verify that BNN++ generally achieves competitive results on binarizing these models.


title: Interior penalty discontinuous Galerkin methods for the nearly incompressible elasticity eigenvalue problem with heterogeneous media

abstract: This paper studies the family of interior penalty discontinuous Galerkin methods for solving the Herrmann formulation of the linear elasticity eigenvalue problem in heterogeneous media. By employing a weighted Lam\'e coefficient norm within the framework of non-compact operators theory, we prove convergence of both continuous and discrete eigenvalue problems as the mesh size approaches zero, independently of the Lam\'e constants. Additionally, we conduct an a posteriori analysis and propose a reliable and efficient estimator. The theoretical findings are supported by numerical experiments.


title: A $p$-version of convolution quadrature in wave propagation

abstract: We consider a novel way of discretizing wave scattering problems using the general formalism of convolution quadrature, but instead of reducing the timestep size ($h$-method), we achieve accuracy by increasing the order of the method ($p$-method). We base this method on discontinuous Galerkin timestepping and use the Z-transform. We show that for a certain class of incident waves, the resulting schemes observes(root)-exponential convergence rate with respect to the number of boundary integral operators that need to be applied. Numerical experiments confirm the findings.


title: An all-frequency stable surface integral equation algorithm for electromagnetism in 3-D unbounded penetrable media: Continuous and fully-discrete model analysis

abstract: We use the time-harmonic Maxwell partial differential equations (PDEs) to model the wave propagation in 3-D space, which comprises a closed penetrable scatterer and its unbounded free-space complement. Surface integral equations (SIEs) that are equivalent to the time-harmonic Maxwell PDEs provide an efficient framework to directly model the surface electromagnetic fields and hence the RCS.The equivalent SIE system on the interface has the advantages that: (a) it avoids truncation of the unbounded region and the solution exactly satisfies the radiation condition; and (b) the surface-fields solution yields the unknowns in the Maxwell PDEs through surface potential representations of the interior and exterior fields. The Maxwell PDE system has been proven (several decades ago) to be stable for all frequencies, that is, (i) it does not possess eigenfrequencies (it is well-posed); and (ii) it does not suffer from low-frequency. However, weakly-singular SIE reformulations of the PDE satisfying these two properties, subject to a stabilization constraint, were derived and mathematically proven only about a decade ago (see {J. Math. Anal. Appl. 412 (2014) 277-300}). The aim of this article is two-fold: (I) To effect a robust coupling of the stabilization constraint to the weakly singular SIE and use mathematical analysis to establish that the resulting continuous weakly-singular second-kind self-adjoint SIE system (without constraints) retains all-frequency stability; and (II) To apply a fully-discrete spectral algorithm for the all-frequency-stable weakly-singular second-kind SIE, and prove spectral accuracy of the algorithm. We numerically demonstrate the high-order accuracy of the algorithm using several dielectric and absorbing benchmark scatterers with curved surfaces.


title: Cluster Scanning: a novel approach to resonance searches

abstract: We propose a new model-independent method for new physics searches called Cluster Scanning. It uses the k-means algorithm to perform clustering in the space of low-level event or jet observables, and separates potentially anomalous clusters to construct a signal-enriched region. The spectra of a selected observable (e.g. invariant mass) in these two regions are then used to determine whether a resonant signal is present. A pseudo-analysis on the LHC Olympics dataset with a $Z'$ resonance shows that Cluster Scanning outperforms the widely used 4-parameter functional background fitting procedures, reducing the number of signal events needed to reach a $3\sigma$ significant access by a factor of 0.61. Emphasis is placed on the speed of the method, which allows the test statistic to be calibrated on synthetic data.


title: On Central Primitives for Quantum Cryptography with Classical Communication

abstract: Recent work has introduced the "Quantum-Computation Classical-Communication" (QCCC) (Chung et. al.) setting for cryptography. There has been some evidence that One Way Puzzles (OWPuzz) are the natural central cryptographic primitive for this setting (Khurana and Tomer). For a primitive to be considered central it should have several characteristics. It should be well behaved (which for this paper we will think of as having amplification, combiners, and universal constructions); it should be implied by a wide variety of other primitives; and it should be equivalent to some class of useful primitives. We present combiners, correctness and security amplification, and a universal construction for OWPuzz. Our proof of security amplification uses a new and cleaner version construction of EFI from OWPuzz (in comparison to the result of Khurana and Tomer) that generalizes to weak OWPuzz and is the most technically involved section of the paper. It was previously known that OWPuzz are implied by other primitives of interest including commitments, symmetric key encryption, one way state generators (OWSG), and therefore pseudorandom states (PRS). However we are able to rule out OWPuzz's equivalence to many of these primitives by showing a black box separation between general OWPuzz and a restricted class of OWPuzz (those with efficient verification, which we call EV-OWPuzz). We then show that EV-OWPuzz are also implied by most of these primitives, which separates them from OWPuzz as well. This separation also separates extending PRS from highly compressing PRS answering an open question of Ananth et. al.


title: Attention-based Neural Network Emulators for Multi-Probe Data Vectors Part I: Forecasting the Growth-Geometry split

abstract: We present a new class of machine-learning emulators that accurately model the cosmic shear, galaxy-galaxy lensing, and galaxy clustering real space correlation functions in the context of Rubin Observatory year one simulated data. To illustrate its capabilities in forecasting models beyond the standard $\Lambda$CDM, we forecast how well LSST Year 1 data will be able to probe the consistency between geometry $\Omega^{\rm geo}_\mathrm{m}$ and growth $\Omega^{\rm growth}_\mathrm{m}$ dark matter densities in the so-called split $\Lambda$CDM parameterization. When trained with a few million samples, our emulator shows uniform accuracy across a wide range in an 18-dimensional parameter space. We provide a detailed comparison of three neural network designs, illustrating the importance of adopting state-of-the-art Transformer blocks. Our study also details their performance when computing Bayesian evidence for cosmic shear on three fiducial cosmologies. The transformers-based emulator is always accurate within PolyChord's precision. As an application, we use our emulator to study the degeneracies between dark energy models and growth geometry split parameterizations. We find that the growth-geometry split remains to be a meaningful test of the smooth dark energy assumption.


title: AmbigNLG: Addressing Task Ambiguity in Instruction for NLG

abstract: In this study, we introduce AmbigNLG, a new task designed to tackle the challenge of task ambiguity in instructions for Natural Language Generation (NLG) tasks. Despite the impressive capabilities of Large Language Models (LLMs) in understanding and executing a wide range of tasks through natural language interaction, their performance is significantly hindered by the ambiguity present in real-world instructions. To address this, AmbigNLG seeks to identify and mitigate such ambiguities, aiming to refine instructions to match user expectations better. We introduce a dataset, AmbigSNI-NLG, consisting of 2,500 instances, and develop an ambiguity taxonomy for categorizing and annotating instruction ambiguities. Our approach demonstrates substantial improvements in text generation quality, highlighting the critical role of clear and specific instructions in enhancing LLM performance in NLG tasks.


title: Towards a Digital Twin Framework in Additive Manufacturing: Machine Learning and Bayesian Optimization for Time Series Process Optimization

abstract: Laser-directed-energy deposition (DED) offers advantages in additive manufacturing (AM) for creating intricate geometries and material grading. Yet, challenges like material inconsistency and part variability remain, mainly due to its layer-wise fabrication. A key issue is heat accumulation during DED, which affects the material microstructure and properties. While closed-loop control methods for heat management are common in DED research, few integrate real-time monitoring, physics-based modeling, and control in a unified framework. Our work presents a digital twin (DT) framework for real-time predictive control of DED process parameters to meet specific design objectives. We develop a surrogate model using Long Short-Term Memory (LSTM)-based machine learning with Bayesian Inference to predict temperatures in DED parts. This model predicts future temperature states in real time. We also introduce Bayesian Optimization (BO) for Time Series Process Optimization (BOTSPO), based on traditional BO but featuring a unique time series process profile generator with reduced dimensions. BOTSPO dynamically optimizes processes, identifying optimal laser power profiles to attain desired mechanical properties. The established process trajectory guides online optimizations, aiming to enhance performance. This paper outlines the digital twin framework's components, promoting its integration into a comprehensive system for AM.


title: Computation of the expectation value of the spin operator $\hat{S}^2$ for the Spin-Flip Bethe-Salpeter Equation

abstract: Spin-flip methods applied to excited-state approaches like the Bethe-Salpeter Equation allow access to the excitation energies of open-shell systems, such as molecules and defects in solids. The eigenstates of these solutions, however, are generally not eigenstates of the spin operator $\hat{S}^2$. Even for simple cases where the excitation vector is expected to be, for example, a triplet state, the value of $\langle \hat{S}^2 \rangle$ may be found to differ from 2.00; this difference is called ``spin contamination.'' The expectation values $\langle \hat{S}^2 \rangle$ must be computed for each excitation vector, to assist with the characterization of the particular excitation and to determine the amount of spin contamination of the state. Our aim is to provide for the first time in the spin-flip methods literature a comprehensive resource on the derivation of the formulas for $\langle \hat{S}^2 \rangle$ as well as its computational implementation. After a brief discussion of the theory of the Spin-Flip Bethe-Salpeter Equation and some examples further illustrating the need for calculating $\langle \hat{S}^2 \rangle$, we present the derivation for the general equation for computing $\langle \hat{S}^2 \rangle$ with the eigenvectors from an SF-BSE calculation, how it is implemented in a Python script, and timing information on how this calculation scales with the size of the SF-BSE Hamiltonian.


title: The SMART approach to instance-optimal online learning

abstract: We devise an online learning algorithm -- titled Switching via Monotone Adapted Regret Traces (SMART) -- that adapts to the data and achieves regret that is instance optimal, i.e., simultaneously competitive on every input sequence compared to the performance of the follow-the-leader (FTL) policy and the worst case guarantee of any other input policy. We show that the regret of the SMART policy on any input sequence is within a multiplicative factor $e/(e-1) \approx 1.58$ of the smaller of: 1) the regret obtained by FTL on the sequence, and 2) the upper bound on regret guaranteed by the given worst-case policy. This implies a strictly stronger guarantee than typical `best-of-both-worlds' bounds as the guarantee holds for every input sequence regardless of how it is generated. SMART is simple to implement as it begins by playing FTL and switches at most once during the time horizon to the worst-case algorithm. Our approach and results follow from an operational reduction of instance optimal online learning to competitive analysis for the ski-rental problem. We complement our competitive ratio upper bounds with a fundamental lower bound showing that over all input sequences, no algorithm can get better than a $1.43$-fraction of the minimum regret achieved by FTL and the minimax-optimal policy. We also present a modification of SMART that combines FTL with a ``small-loss" algorithm to achieve instance optimality between the regret of FTL and the small loss regret bound.


title: Content-Centric Prototyping of Generative AI Applications: Emerging Approaches and Challenges in Collaborative Software Teams

abstract: Generative AI models are increasingly powering software applications, offering the capability to produce expressive content across varied contexts. However, unlike previous iterations of human-AI design, the emerging design process for generative capabilities primarily hinges on prompt engineering strategies. Given this fundamental shift in approach, our work aims to understand how collaborative software teams set up and apply design guidelines and values, iteratively prototype prompts, and evaluate prompts to achieve desired outcomes. We conducted design studies with 39 industry professionals, including designers, software engineers, and product managers. Our findings reveal a content-centric prototyping approach in which teams begin with the content they want to generate, then identify specific attributes, constraints, and values, and explore methods to give users the ability to influence and interact with those attributes. Based on associated challenges, such as the lack of model interpretability and overfitting the design to examples, we outline considerations for generative AI prototyping.


title: Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence

abstract: This paper revisits the convergence of Stochastic Mirror Descent (SMD) in the contemporary nonconvex optimization setting. Existing results for batch-free nonconvex SMD restrict the choice of the distance generating function (DGF) to be differentiable with Lipschitz continuous gradients, thereby excluding important setups such as Shannon entropy. In this work, we present a new convergence analysis of nonconvex SMD supporting general DGF, that overcomes the above limitations and relies solely on the standard assumptions. Moreover, our convergence is established with respect to the Bregman Forward-Backward envelope, which is a stronger measure than the commonly used squared norm of gradient mapping. We further extend our results to guarantee high probability convergence under sub-Gaussian noise and global convergence under the generalized Bregman Proximal Polyak-{\L}ojasiewicz condition. Additionally, we illustrate the advantages of our improved SMD theory in various nonconvex machine learning tasks by harnessing nonsmooth DGFs. Notably, in the context of nonconvex differentially private (DP) learning, our theory yields a simple algorithm with a (nearly) dimension-independent utility bound. For the problem of training linear neural networks, we develop provably convergent stochastic algorithms.


title: Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners

abstract: Video and audio content creation serves as the core technique for the movie industry and professional users. Recently, existing diffusion-based methods tackle video and audio generation separately, which hinders the technique transfer from academia to industry. In this work, we aim at filling the gap, with a carefully designed optimization-based framework for cross-visual-audio and joint-visual-audio generation. We observe the powerful generation ability of off-the-shelf video or audio generation models. Thus, instead of training the giant models from scratch, we propose to bridge the existing strong models with a shared latent representation space. Specifically, we propose a multimodality latent aligner with the pre-trained ImageBind model. Our latent aligner shares a similar core as the classifier guidance that guides the diffusion denoising process during inference time. Through carefully designed optimization strategy and loss functions, we show the superior performance of our method on joint video-audio generation, visual-steered audio generation, and audio-steered visual generation tasks. The project website can be found at https://yzxing87.github.io/Seeing-and-Hearing/


title: Elliptic Reconstruction and A Posteriori Error Estimates for Parabolic Variational Inequalities

abstract: Elliptic reconstruction property, originally introduced by Makridakis and Nochetto for linear parabolic problems, is a well-known tool to derive optimal a posteriori error estimates. No such results are known for nonlinear and nonsmooth problems such as parabolic variational inequalities (VIs). This article establishes the elliptic reconstruction property for parabolic VIs and derives a posteriori error estimates in $L^{\infty}(0,T;L^{2}(\Omega))$. The estimator consists of discrete complementarity terms and standard residual. As an application, the residual-type error estimates are presented.


title: MedContext: Learning Contextual Cues for Efficient Volumetric Medical Segmentation

abstract: Volumetric medical segmentation is a critical component of 3D medical image analysis that delineates different semantic regions. Deep neural networks have significantly improved volumetric medical segmentation, but they generally require large-scale annotated data to achieve better performance, which can be expensive and prohibitive to obtain. To address this limitation, existing works typically perform transfer learning or design dedicated pretraining-finetuning stages to learn representative features. However, the mismatch between the source and target domain can make it challenging to learn optimal representation for volumetric data, while the multi-stage training demands higher compute as well as careful selection of stage-specific design choices. In contrast, we propose a universal training framework called MedContext that is architecture-agnostic and can be incorporated into any existing training framework for 3D medical segmentation. Our approach effectively learns self supervised contextual cues jointly with the supervised voxel segmentation task without requiring large-scale annotated volumetric medical data or dedicated pretraining-finetuning stages. The proposed approach induces contextual knowledge in the network by learning to reconstruct the missing organ or parts of an organ in the output segmentation space. The effectiveness of MedContext is validated across multiple 3D medical datasets and four state-of-the-art model architectures. Our approach demonstrates consistent gains in segmentation performance across datasets and different architectures even in few-shot data scenarios. Our code and pretrained models are available at https://github.com/hananshafi/MedContext


title: VRP-SAM: SAM with Visual Reference Prompt

abstract: In this paper, we propose a novel Visual Reference Prompt (VRP) encoder that empowers the Segment Anything Model (SAM) to utilize annotated reference images as prompts for segmentation, creating the VRP-SAM model. In essence, VRP-SAM can utilize annotated reference images to comprehend specific objects and perform segmentation of specific objects in target image. It is note that the VRP encoder can support a variety of annotation formats for reference images, including \textbf{point}, \textbf{box}, \textbf{scribble}, and \textbf{mask}. VRP-SAM achieves a breakthrough within the SAM framework by extending its versatility and applicability while preserving SAM's inherent strengths, thus enhancing user-friendliness. To enhance the generalization ability of VRP-SAM, the VRP encoder adopts a meta-learning strategy. To validate the effectiveness of VRP-SAM, we conducted extensive empirical studies on the Pascal and COCO datasets. Remarkably, VRP-SAM achieved state-of-the-art performance in visual reference segmentation with minimal learnable parameters. Furthermore, VRP-SAM demonstrates strong generalization capabilities, allowing it to perform segmentation of unseen objects and enabling cross-domain segmentation. The source code and models will be available at \url{https://github.com/syp2ysy/VRP-SAM}


title: Note on simple and consistent gateset characterization including calibration and decoherence errors

abstract: Building high-fidelity quantum computers requires efficient methods for the characterization of gate errors that provide actionable information that may be fed back into engineering efforts. Extraction of realistic error models is also critical to accurate simulation and design of quantum circuits, including those used in quantum error correction. We provide a method for determining the parameters corresponding to decoherence in a model gateset. We demonstrate that this method is robust to SPAM and pulse area errors, and describe a simple and intuitive method for interpreting the quality and precision of the resulting error model.


title: Linking Order to Strength in Metals

abstract: The metallurgy and materials communities have long known and exploited fundamental links between chemical and structural ordering in metallic solids and their mechanical properties. The highest reported strength achievable through the combination of multiple metals (alloying) has rapidly climbed and given rise to new classifications of materials with extraordinary properties. Metallic glasses and high-entropy alloys are two limiting examples of how tailored order can be used to manipulate mechanical behavior. Here, we show that the complex electronic-structure mechanisms governing the peak strength of alloys and pure metals can be reduced to a few physically-meaningful parameters based on their atomic arrangements and used (with no fitting parameters) to predict the maximum strength of any metallic solid, regardless of degree of structural or chemical ordering. Predictions of maximum strength based on the activation energy for a stress-driven phase transition to an amorphous state is shown to accurately describe the breakdown in Hall-Petch behavior at the smallest crystallite sizes for pure metals, intermetallic compounds, metallic glasses, and high-entropy alloys. This activation energy is also shown to be directly proportional to interstitial (electronic) charge density, which is a good predictor of ductility, stiffness (moduli), and phase stability in high-entropy alloys, and in solid metals generally. The proposed framework suggests the possibility of coupling ordering and intrinsic strength to mechanisms like dislocation nucleation, hydrogen embrittlement, and transport properties. It additionally opens the prospect for greatly accelerated structural materials design and development to address materials challenges limiting more sustainable and efficient use of energy.


title: Towards Fairness-Aware Adversarial Learning

abstract: Although adversarial training (AT) has proven effective in enhancing the model's robustness, the recently revealed issue of fairness in robustness has not been well addressed, i.e. the robust accuracy varies significantly among different categories. In this paper, instead of uniformly evaluating the model's average class performance, we delve into the issue of robust fairness, by considering the worst-case distribution across various classes. We propose a novel learning paradigm, named Fairness-Aware Adversarial Learning (FAAL). As a generalization of conventional AT, we re-define the problem of adversarial training as a min-max-max framework, to ensure both robustness and fairness of the trained model. Specifically, by taking advantage of distributional robust optimization, our method aims to find the worst distribution among different categories, and the solution is guaranteed to obtain the upper bound performance with high probability. In particular, FAAL can fine-tune an unfair robust model to be fair within only two epochs, without compromising the overall clean and robust accuracies. Extensive experiments on various image datasets validate the superior performance and efficiency of the proposed FAAL compared to other state-of-the-art methods.


title: Markovletics: Methods and A Novel Application for Learning Continuous-Time Markov Chain Mixtures

abstract: Sequential data naturally arises from user engagement on digital platforms like social media, music streaming services, and web navigation, encapsulating evolving user preferences and behaviors through continuous information streams. A notable unresolved query in stochastic processes is learning mixtures of continuous-time Markov chains (CTMCs). While there is progress in learning mixtures of discrete-time Markov chains with recovery guarantees [GKV16,ST23,KTT2023], the continuous scenario uncovers unique unexplored challenges. The intrigue in CTMC mixtures stems from their potential to model intricate continuous-time stochastic processes prevalent in various fields including social media, finance, and biology. In this study, we introduce a novel framework for exploring CTMCs, emphasizing the influence of observed trails' length and mixture parameters on problem regimes, which demands specific algorithms. Through thorough experimentation, we examine the impact of discretizing continuous-time trails on the learnability of the continuous-time mixture, given that these processes are often observed via discrete, resource-demanding observations. Our comparative analysis with leading methods explores sample complexity and the trade-off between the number of trails and their lengths, offering crucial insights for method selection in different problem instances. We apply our algorithms on an extensive collection of Lastfm's user-generated trails spanning three years, demonstrating the capability of our algorithms to differentiate diverse user preferences. We pioneer the use of CTMC mixtures on a basketball passing dataset to unveil intricate offensive tactics of NBA teams. This underscores the pragmatic utility and versatility of our proposed framework. All results presented in this study are replicable, and we provide the implementations to facilitate reproducibility.


title: Effect of impurity phase and high-pressure synthesis on the superconducting properties of CaKFe4As4

abstract: AeAFe4As4 (Ae = Ca, A = K; 1144) having a transition temperature of 35 K is a stoichiometric family of iron-based superconductors (FBS). Here, we present a detailed study of a high-pressure synthesis of CaKFe4As4 bulks to investigate the impact of these conditions on the superconducting properties of the 1144 family. Additionally, these samples are also prepared by conventional synthesis method at ambient pressure (CSP) and studied the influence of impurities on the superconducting properties of CaKFe4As4. Structural, microstructural, transport and magnetization measurements have been performed to reach the final conclusions. Interestingly, the high-pressure synthesis of the parent CaKFe4As4 compound enhances the transition temperature (Tc) by 2 K and the critical current density (Jc) by one order of magnitude in the whole magnetic field range of 9 T than that of the 1144 bulks prepared by CSP. It suggests the improvement of the pinning centers and grain connections by the high-pressure synthesis approach. Interestingly, our results depict the superconducting onset transition temperature (Tconset) of this stoichiometric 1144 family is robust with the presence of the common 122 (CaFe2As2 or KFe2As2) impurity phases, which is a different behavior compared to other FBS families. However, these impurity phases reduce the grain connections and lead to the phase separation during the formation of the superconducting (1144) phase.


title: Batched Nonparametric Contextual Bandits

abstract: We study nonparametric contextual bandits under batch constraints, where the expected reward for each action is modeled as a smooth function of covariates, and the policy updates are made at the end of each batch of observations. We establish a minimax regret lower bound for this setting and propose a novel batch learning algorithm that achieves the optimal regret (up to logarithmic factors). In essence, our procedure dynamically splits the covariate space into smaller bins, carefully aligning their widths with the batch size. Our theoretical results suggest that for nonparametric contextual bandits, a nearly constant number of policy updates can attain optimal regret in the fully online setting.


title: Tower: An Open Multilingual Large Language Model for Translation-Related Tasks

abstract: While general-purpose large language models (LLMs) demonstrate proficiency on multiple tasks within the domain of translation, approaches based on open LLMs are competitive only when specializing on a single task. In this paper, we propose a recipe for tailoring LLMs to multiple tasks present in translation workflows. We perform continued pretraining on a multilingual mixture of monolingual and parallel data, creating TowerBase, followed by finetuning on instructions relevant for translation processes, creating TowerInstruct. Our final model surpasses open alternatives on several tasks relevant to translation workflows and is competitive with general-purpose closed LLMs. To facilitate future research, we release the Tower models, our specialization dataset, an evaluation framework for LLMs focusing on the translation ecosystem, and a collection of model generations, including ours, on our benchmark.


title: Automated Scheduling of Doppler Exoplanet Observations at Keck Observatory

abstract: Precise Doppler studies of extrasolar planets require fine-grained control of observational cadence, i.e. the timing of and spacing between observations. We present a novel framework for scheduling a set of Doppler campaigns with different cadence requirements at the W. M. Keck Observatory (WMKO). For a set of observing programs and allocated nights on an instrument, our software optimizes the timing and ordering of ~1000 observations within a given observing semester. We achieve a near-optimal solution in real-time using a hierarchical Integer Linear Programming (ILP) framework. Our scheduling formulation optimizes over the roughly 10^3000 possible orderings. A top level optimization finds the most regular sequence of allocated nights by which to observe each host star in the request catalog based on a frequency specified in the request. A second optimization scheme minimizes the slews and downtime of the instrument. We have assessed our algorithms performance with simulated data and with the real suite of Doppler observations of the California Planet Search in 2023.


title: High-Fidelity Neural Phonetic Posteriorgrams

abstract: A phonetic posteriorgram (PPG) is a time-varying categorical distribution over acoustic units of speech (e.g., phonemes). PPGs are a popular representation in speech generation due to their ability to disentangle pronunciation features from speaker identity, allowing accurate reconstruction of pronunciation (e.g., voice conversion) and coarse-grained pronunciation editing (e.g., foreign accent conversion). In this paper, we demonstrably improve the quality of PPGs to produce a state-of-the-art interpretable PPG representation. We train an off-the-shelf speech synthesizer using our PPG representation and show that high-quality PPGs yield independent control over pitch and pronunciation. We further demonstrate novel uses of PPGs, such as an acoustic pronunciation distance and fine-grained pronunciation control.


title: Learning-Based Algorithms for Graph Searching Problems

abstract: We consider the problem of graph searching with prediction recently introduced by Banerjee et al. (2022). In this problem, an agent, starting at some vertex $r$ has to traverse a (potentially unknown) graph $G$ to find a hidden goal node $g$ while minimizing the total distance travelled. We study a setting in which at any node $v$, the agent receives a noisy estimate of the distance from $v$ to $g$. We design algorithms for this search task on unknown graphs. We establish the first formal guarantees on unknown weighted graphs and provide lower bounds showing that the algorithms we propose have optimal or nearly-optimal dependence on the prediction error. Further, we perform numerical experiments demonstrating that in addition to being robust to adversarial error, our algorithms perform well in typical instances in which the error is stochastic. Finally, we provide alternative simpler performance bounds on the algorithms of Banerjee et al. (2022) for the case of searching on a known graph, and establish new lower bounds for this setting.


title: Decompositions of hyperbolic Kac-Moody algebras with respect to imaginary root groups

abstract: We propose a novel way to define imaginary root subgroups associated with (timelike) imaginary roots of hyperbolic Kac-Moody algebras. Using in an essential way the theory of unitary irreducible representation of covers of the group SO(2,1), these imaginary root subgroups act on the complex Kac-Moody algebra viewed as a Hilbert space. We illustrate our new view on Kac-Moody groups by considering the example of a rank-two hyperbolic algebra that is related to the Fibonacci numbers. We also point out some open issues and new avenues for further research, and briefly discuss the potential relevance of the present results for physics and current attempts at unification.


title: Observation of the $\Xi^-_\mathrm{b}$ $\to$ $\psi$(2S)$\Xi^-$ decay and studies of the $\Xi_\mathrm{b}^{\ast{}0}$ baryon in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: The first observation of the decay $\Xi^-_\mathrm{b}$ $\to$ $\psi$(2S)$\Xi^-$ and measurement of the branching ratio of $\Xi^-_\mathrm{b}$ $\to$ $\psi$(2S)$\Xi^-$ to $\Xi^-_\mathrm{b}$ $\to$ J/$\psi$$\Xi^-$ are presented. The J/$\psi$ and $\psi$(2S) mesons are reconstructed using their dimuon decay modes. The results are based on proton-proton colliding beam data from the LHC collected by the CMS experiment at $\sqrt{s}$ = 13 TeV in 2016-2018, corresponding to an integrated luminosity of 140 fb$^{-1}$. The branching fraction ratio is measured to be $\mathcal{B}$($\Xi^-_\mathrm{b}$ $\to$ $\psi$(2S)$\Xi^-$)/$\mathcal{B}$($\Xi^-_\mathrm{b}$ $\to$ J/$\psi$$\Xi^-$) = 0.84$^{+0.21}_{-0.19}$ (stat) $\pm$ 0.10 (syst) $\pm$ 0.02 ($\mathcal{B}$), where the last uncertainty comes from the uncertainties in the branching fractions of the charmonium states. New measurements of the $\Xi_\mathrm{b}^{\ast{}0}$ baryon mass and natural width are also presented, using the $\Xi_\mathrm{b}^-\pi^+$ final state, where the $\Xi^-_\mathrm{b}$ baryon is reconstructed through the decays J/$\psi \Xi^-$, $\psi$(2S)$\Xi^-$, J/$\psi \Lambda$K$^-$, and J/$\psi \Sigma^0$K$^-$. Finally, the fraction of the $\Xi^-_\mathrm{b}$ baryons produced from $\Xi_\mathrm{b}^{\ast{}0}$ decays is determined.


title: reBandit: Random Effects based Online RL algorithm for Reducing Cannabis Use

abstract: The escalating prevalence of cannabis use, and associated cannabis-use disorder (CUD), poses a significant public health challenge globally. With a notably wide treatment gap, especially among emerging adults (EAs; ages 18-25), addressing cannabis use and CUD remains a pivotal objective within the 2030 United Nations Agenda for Sustainable Development Goals (SDG). In this work, we develop an online reinforcement learning (RL) algorithm called reBandit which will be utilized in a mobile health study to deliver personalized mobile health interventions aimed at reducing cannabis use among EAs. reBandit utilizes random effects and informative Bayesian priors to learn quickly and efficiently in noisy mobile health environments. Moreover, reBandit employs Empirical Bayes and optimization techniques to autonomously update its hyper-parameters online. To evaluate the performance of our algorithm, we construct a simulation testbed using data from a prior study, and compare against commonly used algorithms in mobile health studies. We show that reBandit performs equally well or better than all the baseline algorithms, and the performance gap widens as population heterogeneity increases in the simulation environment, proving its adeptness to adapt to diverse population of study participants.


title: Multistable Kuramoto splay states in a crystal of mode-locked laser pulses

abstract: We demonstrate the existence of a multiplicity of co-existing frequency combs in a harmonically mode-locked laser that we link to the splay phases of the Kuramoto model with short range interactions. These splay states are multistable and the laser may wander between them under the influence of stochastic forces. Consequently, the many pulses circulating in the cavity are not necessarily coherent with each other. We show that this partially disordered state for the phase of the optical field features regular train of pulses in the field intensity, a state that we term an incoherent crystal of optical pulses. We provide evidence that the notion of coherence should be interpreted by comparing the duration of the measurement time with the Kramers' escape time of each splay state. Our results are confirmed experimentally by studying a passively mode-locked vertical external-cavity surface-emitting laser.


title: Testing the isotropy of cosmic acceleration with Pantheon+ and SH0ES: A cosmographic analysis

abstract: We use a recent Pantheon+SH0ES compilation of Type Ia Supernova distance measurements at low-redshift, i.e., $0.01 \leq z \leq 0.10$, in order to investigate the directional dependency of the deceleration parameter ($q_0$) in different patches ($60^{\circ}$ size) across the sky, as a probe of the statistical isotropy of the Universe. We adopt a cosmographic approach to compute the cosmological distances, fixing $H_0$ and $M_B$ to reference values provided by the collaboration. By looking at 500 different patches randomly taken across the sky, we find a maximum $\sim 3\sigma$ CL anisotropy level for $q_0$, whose direction points orthogonally to the cosmic microwave background (CMB) dipole axis, i.e., $(RA^{\rm SN},DEC^{\rm SN}) = (267^{\circ},6^{\circ})$ vs $(RA^{\rm CMB},DEC^{\rm CMB}) = (167^{\circ},-7^{\circ})$. We assessed the statistical significance of those results, finding that such a signal is expected due to the limitations of the observational sample. These results support that there is no significant evidence for a departure from the cosmic isotropy assumption, one of the pillars of the standard cosmological model.


title: Approaching Periodic Systems in Ensemble Density Functional Theory via Finite One-Dimensional Models

abstract: Ensemble Density Functional Theory (EDFT) is a generalization of ground-state Density Functional Theory (GS DFT), which is based on an exact formal theory of finite collections of a system's ground and excited states. EDFT in various forms has been shown to improve the accuracy of calculated energy level differences in isolated model systems, atoms, and molecules, but it is not yet clear how EDFT could be used to calculate band gaps for periodic systems. We extend the application of EDFT toward periodic systems by estimating the thermodynamic limit with increasingly large finite one-dimensional ``particle in a box'' systems, which approach the uniform electron gas (UEG). Using ensemble-generalized Hartree and Local Spin Density Approximation (LSDA) exchange-correlation functionals, we find that corrections go to zero in the infinite limit, as expected for a metallic system. However, there is a correction to the effective mass, with results comparable to other calculations on 1D, 2D, and 3D UEGs, which indicates promise for non-trivial results from EDFT on periodic systems.


title: Rose: Composable Autodiff for the Interactive Web

abstract: Reverse-mode automatic differentiation (autodiff) has been popularized by deep learning, but its ability to compute gradients is also valuable for interactive use cases such as bidirectional computer-aided design, embedded physics simulations, visualizing causal inference, and more. Unfortunately, the web is ill-served by existing autodiff frameworks, which use autodiff strategies that are unperformant on dynamic scalar programs, and pull in heavy dependencies that would result in unacceptable webpage sizes. This work introduces Rose, a lightweight autodiff framework for the web using a new hybrid approach to reverse-mode autodiff, blending conventional tracing and transformation techniques in a way that uses the host language for metaprogramming while also allowing the programmer to explicitly define reusable functions that compose a larger differentiable computation. We demonstrate the value of the Rose design by porting two differentiable physics simulations, and evaluate its performance on an optimization-based diagramming application, showing Rose outperforming the state-of-the-art in web-based autodiff by multiple orders of magnitude.


title: Analyzing Regional Organization of the Human Hippocampus in 3D-PLI Using Contrastive Learning and Geometric Unfolding

abstract: Understanding the cortical organization of the human brain requires interpretable descriptors for distinct structural and functional imaging data. 3D polarized light imaging (3D-PLI) is an imaging modality for visualizing fiber architecture in postmortem brains with high resolution that also captures the presence of cell bodies, for example, to identify hippocampal subfields. The rich texture in 3D-PLI images, however, makes this modality particularly difficult to analyze and best practices for characterizing architectonic patterns still need to be established. In this work, we demonstrate a novel method to analyze the regional organization of the human hippocampus in 3D-PLI by combining recent advances in unfolding methods with deep texture features obtained using a self-supervised contrastive learning approach. We identify clusters in the representations that correspond well with classical descriptions of hippocampal subfields, lending validity to the developed methodology.


title: LoDIP: Low light phase retrieval with deep image prior

abstract: Phase retrieval (PR) is a fundamental challenge in scientific imaging, enabling nanoscale techniques like coherent diffractive imaging (CDI). Imaging at low radiation doses becomes important in applications where samples are susceptible to radiation damage. However, most PR methods struggle in low dose scenario due to the presence of very high shot noise. Advancements in the optical data acquisition setup, exemplified by in-situ CDI, have shown potential for low-dose imaging. But these depend on a time series of measurements, rendering them unsuitable for single-image applications. Similarly, on the computational front, data-driven phase retrieval techniques are not readily adaptable to the single-image context. Deep learning based single-image methods, such as deep image prior, have been effective for various imaging tasks but have exhibited limited success when applied to PR. In this work, we propose LoDIP which combines the in-situ CDI setup with the power of implicit neural priors to tackle the problem of single-image low-dose phase retrieval. Quantitative evaluations demonstrate the superior performance of LoDIP on this task as well as applicability to real experimental scenarios.


title: A geometric characterization of $\mathbb{N}$-manifolds and the Frobenius theorem

abstract: This paper studies graded manifolds with local coordinates concentrated in non-negative degrees. We provide a canonical description of these objects in terms of classical geometric data and, building on this geometric viewpoint, we prove the Frobenius theorem for distributions in this graded setting.


title: When Your AIs Deceive You: Challenges of Partial Observability in Reinforcement Learning from Human Feedback

abstract: Past analyses of reinforcement learning from human feedback (RLHF) assume that the human evaluators fully observe the environment. What happens when human feedback is based only on partial observations? We formally define two failure cases: deceptive inflation and overjustification. Modeling the human as Boltzmann-rational w.r.t. a belief over trajectories, we prove conditions under which RLHF is guaranteed to result in policies that deceptively inflate their performance, overjustify their behavior to make an impression, or both. Under the new assumption that the human's partial observability is known and accounted for, we then analyze how much information the feedback process provides about the return function. We show that sometimes, the human's feedback determines the return function uniquely up to an additive constant, but in other realistic cases, there is irreducible ambiguity. We propose exploratory research directions to help tackle these challenges and caution against blindly applying RLHF in partially observable settings.


title: Exploring the Market Dynamics of Liquid Staking Derivatives (LSDs)

abstract: Staking has emerged as a crucial concept following Ethereum's transition to Proof-of-Stake consensus. The introduction of Liquid Staking Derivatives (LSDs) has effectively addressed the illiquidity issue associated with solo staking, gaining significant market attention. This paper analyzes the LSD market dynamics from the perspectives of both liquidity takers (LTs) and liquidity providers (LPs). We first quantify the price discrepancy between the LSD primary and secondary markets. Then we investigate and empirically measure how LTs can leverage such discrepancy to exploit arbitrage opportunities, unveiling the potential barriers to LSD arbitrages. In addition, we evaluate the financial profit and losses experienced by LPs who supply LSDs for liquidity provision. Our results show that 66% of LSD liquidity positions generate returns lower than those from simply holding the corresponding LSDs.