title: Bragg-like microcavity formed by collision of single-cycle self-induced transparency light pulses in a resonant medium

abstract: The coherent interaction of extremely short light pulses with a resonant medium can result in formation of population difference gratings. Such gratings have been created by pulses that are pi/2 or smaller. This paper demonstrates that a microcavity with Bragg-like mirrors can be formed by colliding two single-cycle attosecond self-induced transparency pulses in the center of a two-level medium. The parameters of this structure can be quickly adjusted by increasing the number of collisions, which showcases the ability to control the dynamic properties of the medium on a sub-cycle time scale by using attosecond pulses.


title: Immediate generalisation in humans but a generalisation lag in deep neural networks -- evidence for representational divergence?

abstract: Recent research has seen many behavioral comparisons between humans and deep neural networks (DNNs) in the domain of image classification. Often, comparison studies focus on the end-result of the learning process by measuring and comparing the similarities in the representations of object categories once they have been formed. However, the process of how these representations emerge -- that is, the behavioral changes and intermediate stages observed during the acquisition -- is less often directly and empirically compared. Here we report a detailed investigation of how transferable representations are acquired in human observers and various classic and state-of-the-art DNNs. We develop a constrained supervised learning environment in which we align learning-relevant parameters such as starting point, input modality, available input data and the feedback provided. Across the whole learning process we evaluate and compare how well learned representations can be generalized to previously unseen test data. Our findings indicate that in terms of absolute classification performance DNNs demonstrate a level of data efficiency comparable to -- and sometimes even exceeding that -- of human learners, challenging some prevailing assumptions in the field. However, comparisons across the entire learning process reveal significant representational differences: while DNNs' learning is characterized by a pronounced generalisation lag, humans appear to immediately acquire generalizable representations without a preliminary phase of learning training set-specific information that is only later transferred to novel data.


title: A pulsar-like swing in the polarisation position angle of a nearby fast radio burst

abstract: Fast radio bursts (FRBs) last for milliseconds and arrive at Earth from cosmological distances. While their origin(s) and emission mechanism(s) are presently unknown, their signals bear similarities with the much less luminous radio emission generated by pulsars within our Galaxy and several lines of evidence point toward neutron star origins. For pulsars, the linear polarisation position angle (PA) often exhibits evolution over the pulse phase that is interpreted within a geometric framework known as the rotating vector model (RVM). Here, we report on a fast radio burst, FRB 20221022A, detected by the Canadian Hydrogen Intensity Mapping Experiment (CHIME) and localized to a nearby host galaxy ($\sim 65\; \rm{Mpc}$), MCG+14-02-011. This one-off FRB displays a $\sim 130$ degree rotation of its PA over its $\sim 2.5\; \rm{ms}$ burst duration, closely resembling the "S"-shaped PA evolution commonly seen from pulsars and some radio magnetars. The PA evolution disfavours emission models involving shocks far from the source and instead suggests magnetospheric origins for this source which places the emission region close to the FRB central engine, echoing similar conclusions drawn from tempo-polarimetric studies of some repeating sources. This FRB's PA evolution is remarkably well-described by the RVM and, although we cannot determine the inclination and magnetic obliquity due to the unknown period/duty cycle of the source, we can dismiss extremely short-period pulsars (e.g., recycled millisecond pulsars) as potential progenitors. RVM-fitting appears to favour a source occupying a unique position in the period/duty cycle phase space that implies tight opening angles for the beamed emission, significantly reducing burst energy requirements of the source.


title: Embracing the black box: Heading towards foundation models for causal discovery from time series data

abstract: Causal discovery from time series data encompasses many existing solutions, including those based on deep learning techniques. However, these methods typically do not endorse one of the most prevalent paradigms in deep learning: End-to-end learning. To address this gap, we explore what we call Causal Pretraining. A methodology that aims to learn a direct mapping from multivariate time series to the underlying causal graphs in a supervised manner. Our empirical findings suggest that causal discovery in a supervised manner is possible, assuming that the training and test time series samples share most of their dynamics. More importantly, we found evidence that the performance of Causal Pretraining can increase with data and model size, even if the additional data do not share the same dynamics. Further, we provide examples where causal discovery for real-world data with causally pretrained neural networks is possible within limits. We argue that this hints at the possibility of a foundation model for causal discovery.


title: Optimal design of equilibrium solutions of the Vlasov-Poisson system by an external electric field

abstract: A new optimization framework to design steady equilibrium solutions of the Vlasov-Poisson system by means of external electric fields is presented. This optimization framework requires the minimization of an ensemble functional with Tikhonov regularization of the control field under the differential constraint of a nonlinear elliptic equation that models equilibrium solutions of the Vlasov-Poisson system. Existence of optimal control fields and their characterization as solutions to first-order optimality conditions are discussed. Numerical approximations and optimization schemes are developed to validate the proposed framework.


title: CMOS photonic integrated source of ultrabroadband polarization-entangled photons

abstract: We showcase a fully on-chip CMOS-fabricated silicon photonic integrated circuit employing a bidirectionally pumped microring and polarization splitter-rotators tailored for the generation of ultrabroadband ($>$9 THz), high-fidelity (90-98%) polarization-entangled photons. Spanning the optical C+L-band and producing over 116 frequency-bin pairs on a 38.4 GHz-spaced grid, this source is ideal for flex-grid wavelength-multiplexed entanglement distribution in multiuser networks.


title: Wave-particle correlations in multiphoton resonances of coherent light-matter interaction

abstract: We discuss the conditional measurement of field amplitudes by a nonclassical photon sequence in the Jaynes-Cummings (JC) model under multiphoton operation. We do so by employing a correlator of immediate experimental relevance to reveal a distinct nonclassical evolution in the spirit of [G. T. Foster et al., Phys. Rev. Lett. 85 3149 (2000)]. The correlator relies on the complementary nature of the pictures obtained from different unravelings of a JC source master equation. We demonstrate that direct photodetection entails a conditioned separation of timescales, a quantum beat and a semiclassical oscillation, produced by the coherent light-matter interaction in its strong-coupling limit. We single the quantum beat out in the analytical expression for the waiting-time distribution, pertaining to the particle nature of the scattered light, and find a negative spectrum of quadrature amplitude squeezing, characteristic of its wave nature for certain operation settings. Finally, we jointly detect the dual aspects through the wave-particle correlator, showing an asymmetric regression of fluctuations to the steady state which depends on the quadrature amplitude being measured.


title: On Betti numbers for symmetric powers of modules

abstract: Let $M$ be a finitely generated module over a local ring $(R,\mathfrak{m})$. By $\mathcal{S}_j(M)$, we denote the $j$th symmetric power of $M$ ($j$th graded component of the symmetric algebra $\mathcal{S}_R(M)$). The purpose of this paper is to investigate the minimal free resolutions $\mathcal{S}_j(M)$ as $R$-module for each $j\geq 2$ and determine the Betti numbers of $\mathcal{S}_j(M)$ in terms of the Betti numbers of $M$. This has some applications, for example for linear type ideals $I$, we obtain formulas of the Betti numbers $I^j$ in terms of the Betti numbers of $I$. In addition, we establish upper and lower bounds of Betti numbers of $\mathcal{S}_j(M)$ in terms of Betti numbers of $M$. In particular, obtain some applications of the famous Buchsbaum-Eisenbud-Horrocks conjecture.


title: Phase transition catalyzed by primordial black holes

abstract: We investigate the first-order phase transition catalyzed by primordial black holes~(PBHs) in the early Universe. We find that super-horizon curvature perturbations generated in this scenario lead to the production of gravitational waves when the scalar modes re-enter the horizon. If PBHs with masses about $10^{-13}M_{\odot}$ constitute all dark matter, the first-order electroweak phase transition catalyzed by PBHs can explain the gravitational wave signal observed by pulsar timing array collaborations without the overproduction of PBHs.


title: Quantized Thouless pumps protected by interactions in dimerized Rydberg tweezer arrays

abstract: We study Thouless pumps, i.e., adiabatic topological transport, in an interacting spin chain described by the dimerized XXZ Hamiltonian. In the noninteracting case, quantized Thouless pumps can only occur when a topological singularity is encircled adiabatically. In contrast, here we show that, in the presence of interactions, such topological transport can even persist for exotic paths in which the system gets arbitrarily close to the singularity. We illustrate the robustness of these exotic Thouless pumps through the behavior of the noninteracting singularity, which for sufficiently strong interactions splits into two singularities separated by a spontaneous antiferromagnetic insulator. We perform a numerical benchmark of these phenomena by means of tensor network simulations of ground-state physics and real-time adiabatic dynamics. Finally, we propose an experimental protocol with Floquet-driven Rydberg tweezer arrays.


title: Topologies of maximally extended non-Hausdorff Misner Space

abstract: Misner (1967) space is a portion of 2-dimensional Minkowski spacetime, identified under a boost $\mathcal B$. It is well known that the maximal analytic extension of Misner space that is Hausdorff consists of one half of Minkowski spacetime, identified under $\mathcal B$; and Hawking and Ellis (1973) have shown that the maximal analytic extension that is non-Hausdorff is equal to the full Minkowski spacetime with the point $Q$ at the origin removed, identifed under $\mathcal B$. In this paper I show that, in fact, there is an infinite set of non-Hausdorff maximal analytic extensions, each with a different causal structure. The extension constructed by Hawking and Ellis is the simplest of these. Another extension is obtained by wrapping an infinite number of copies of Minkowski spacetime around the removed $Q$ as a helicoid or Riemann surface and then identifying events under the boost $\mathcal B$. The other extensions are obtained by wrapping some number $n$ of successive copies of Minkowski spacetime around the missing $Q$ as a helicoid, then identifying the end of the $n$'th copy with the beginning of the initial copy, and then identifying events under $\mathcal B$. I discuss the causal structure and covering spaces of each of these extensions.


title: Mixture to Mixture: Leveraging Close-talk Mixtures as Weak-supervision for Speech Separation

abstract: We propose mixture to mixture (M2M) training, a weakly-supervised neural speech separation algorithm that leverages close-talk mixtures as a weak supervision for training discriminative models to separate far-field mixtures. Our idea is that, for a target speaker, its close-talk mixture has a much higher signal-to-noise ratio (SNR) of the target speaker than any far-field mixtures, and hence could be utilized to design a weak supervision for separation. To realize this, at each training step we feed a far-field mixture to a deep neural network (DNN) to produce an intermediate estimate for each speaker, and, for each of considered close-talk and far-field microphones, we linearly filter the DNN estimates and optimize a loss so that the filtered estimates of all the speakers can sum up to the mixture captured by each of the considered microphones. Evaluation results on a 2-speaker separation task in simulated reverberant conditions show that M2M can effectively leverage close-talk mixtures as a weak supervision for separating far-field mixtures.


title: Bolometric detection of Josephson radiation

abstract: A Josephson junction (JJ) has been under intensive study ever since 1960's. Yet even in the present era of building quantum information processing devices based on many JJs, open questions regarding a single junction remain unsolved, such as quantum phase transitions, coupling of the JJ to an environment and improving coherence of a superconducting qubit. Here we design and build an engineered on-chip reservoir that acts as an efficient bolometer for detecting the Josephson radiation under non-equilibrium (biased) conditions. The bolometer converts ac Josephson current at microwave frequencies, up to about $100\,$GHz, into a measurable dc temperature rise. The present experiment demonstrates an efficient, wide-band, thermal detection scheme of microwave photons and provides a sensitive detector of Josephson dynamics beyond the standard conductance measurements. Using a circuit model, we capture both the current-voltage characteristics and the measured power quantitatively.


title: Few-Shot Object Detection with Sparse Context Transformers

abstract: Few-shot detection is a major task in pattern recognition which seeks to localize objects using models trained with few labeled data. One of the mainstream few-shot methods is transfer learning which consists in pretraining a detection model in a source domain prior to its fine-tuning in a target domain. However, it is challenging for fine-tuned models to effectively identify new classes in the target domain, particularly when the underlying labeled training data are scarce. In this paper, we devise a novel sparse context transformer (SCT) that effectively leverages object knowledge in the source domain, and automatically learns a sparse context from only few training images in the target domain. As a result, it combines different relevant clues in order to enhance the discrimination power of the learned detectors and reduce class confusion. We evaluate the proposed method on two challenging few-shot object detection benchmarks, and empirical results show that the proposed method obtains competitive performance compared to the related state-of-the-art.


title: Only My Model On My Data: A Privacy Preserving Approach Protecting one Model and Deceiving Unauthorized Black-Box Models

abstract: Deep neural networks are extensively applied to real-world tasks, such as face recognition and medical image classification, where privacy and data protection are critical. Image data, if not protected, can be exploited to infer personal or contextual information. Existing privacy preservation methods, like encryption, generate perturbed images that are unrecognizable to even humans. Adversarial attack approaches prohibit automated inference even for authorized stakeholders, limiting practical incentives for commercial and widespread adaptation. This pioneering study tackles an unexplored practical privacy preservation use case by generating human-perceivable images that maintain accurate inference by an authorized model while evading other unauthorized black-box models of similar or dissimilar objectives, and addresses the previous research gaps. The datasets employed are ImageNet, for image classification, Celeba-HQ dataset, for identity classification, and AffectNet, for emotion classification. Our results show that the generated images can successfully maintain the accuracy of a protected model and degrade the average accuracy of the unauthorized black-box models to 11.97%, 6.63%, and 55.51% on ImageNet, Celeba-HQ, and AffectNet datasets, respectively.


title: Extended mean-field games with multi-dimensional singular controls and non-linear jump impact

abstract: We establish a probabilistic framework for analysing extended mean-field games with multi-dimensional singular controls and state-dependent jump dynamics and costs. Two key challenges arise when analysing such games: the state dynamics may not depend continuously on the control and the reward function may not be u.s.c.~Both problems can be overcome by restricting the set of admissible singular controls to controls that can be approximated by continuous ones. We prove that the corresponding set of admissible weak controls is given by the weak solutions to a Marcus-type SDE and provide an explicit characterisation of the reward function. The reward function will in general only be u.s.c.~To address the lack of continuity we introduce a novel class of MFGs with a broader set of admissible controls, called MFGs of parametrisations. Parametrisations are laws of state/control processes that continuously interpolate jumps. We prove that the reward functional is continuous on the set of parametrisations, establish the existence of equilibria in MFGs of parametrisations, and show that the set of Nash equilibria in MFGs of parametrisations and in the underlying MFG with singular controls coincide. This shows that MFGs of parametrisations provide a canonical framework for analysing MFGs with singular controls and non-linear jump impact.


title: Leveraging Pre-Trained Autoencoders for Interpretable Prototype Learning of Music Audio

abstract: We present PECMAE, an interpretable model for music audio classification based on prototype learning. Our model is based on a previous method, APNet, which jointly learns an autoencoder and a prototypical network. Instead, we propose to decouple both training processes. This enables us to leverage existing self-supervised autoencoders pre-trained on much larger data (EnCodecMAE), providing representations with better generalization. APNet allows prototypes' reconstruction to waveforms for interpretability relying on the nearest training data samples. In contrast, we explore using a diffusion decoder that allows reconstruction without such dependency. We evaluate our method on datasets for music instrument classification (Medley-Solos-DB) and genre recognition (GTZAN and a larger in-house dataset), the latter being a more challenging task not addressed with prototypical networks before. We find that the prototype-based models preserve most of the performance achieved with the autoencoder embeddings, while the sonification of prototypes benefits understanding the behavior of the classifier.


title: Eulerian Formulation of the Tensor-Based Morphology Equations for Strain-Based Blood Damage Modeling

abstract: The development of blood-handling medical devices, such as ventricular assist devices, requires the analysis of their biocompatibility. Among other aspects, this includes hemolysis, i.e., red blood cell damage. For this purpose, computational fluid dynamics (CFD) methods are employed to predict blood flow in prototypes. The most basic hemolysis models directly estimate red blood cell damage from fluid stress in the resulting flow field. More advanced models explicitly resolve cell deformation. On the downside, these models are typically written in a Lagrangian formulation, i.e., they require pathline tracking. We present a new Eulerian description of cell deformation, enabling the evaluation of the solution across the whole domain. The resulting hemolysis model can be applied to any converged CFD simulation due to one-way coupling with the fluid velocity field. We discuss the efficient numerical treatment of the model equations in a stabilized finite element context. We verify the model by comparison to the original Lagrangian formulation in selected benchmark flows. Two more complex test cases demonstrate the method's capabilities in real-world applications. The results highlight the advantages over previous hemolysis models. In conclusion, the model holds great potential for the design process of future generations of medical devices.


title: ICDPO: Effectively Borrowing Alignment Capability of Others via In-context Direct Preference Optimization

abstract: Large Language Models (LLMs) rely on Human Preference Alignment (HPA) to ensure the generation of safe content. Due to the heavy cost associated with fine-tuning, fine-tuning-free methods have emerged, typically modifying LLM decoding with external auxiliary methods. However, these methods do not essentially enhance the LLM itself. In this paper, we rethink the derivation procedures of DPO, based on which we conversely build an instant scorer using the states of the LLM before and after In-context Learning (ICL). Accordingly, we propose a novel approach called In-Context Direct Preference Optimization (ICDPO). It enables LLMs to borrow the HPA capabilities from superior LLMs with ICL, generating well-aligned responses as estimated by the aforementioned instant scorer, thereby enhancing the final performance. ICDPO can be further enhanced with a two-stage retriever and an upgraded scorer, both offering benefits. Extensive experiments show its effectiveness, particularly in outperforming two fine-tuning-free baselines, and it exhibits competitiveness with SFT + LoRA. We also conduct detailed analyses to offer comprehensive insights into ICDPO.


title: Collusion-Resilience in Transaction Fee Mechanism Design

abstract: Users bid in a transaction fee mechanism (TFM) to get their transactions included and confirmed by a blockchain protocol. Roughgarden (EC'21) initiated the formal treatment of TFMs and proposed three requirements: user incentive compatibility (UIC), miner incentive compatibility (MIC), and a form of collusion-resilience called OCA-proofness. Ethereum's EIP-1559 mechanism satisfies all three properties simultaneously when there is no contention between transactions, but loses the UIC property when there are too many eligible transactions to fit in a single block. Chung and Shi (SODA'23) considered an alternative notion of collusion-resilience, called c-side-contract-proofness (c-SCP), and showed that, when there is contention between transactions, no TFM can satisfy UIC, MIC, and c-SCP for any c at least 1. OCA-proofness asserts that the users and a miner should not be able to "steal from the protocol." On the other hand, the c-SCP condition requires that a coalition of a miner and a subset of users should not be able to profit through strategic deviations (whether at the expense of the protocol or of the users outside the coalition). Our main result is the first proof that, when there is contention between transactions, no (possibly randomized) TFM in which users are expected to bid truthfully satisfies UIC, MIC, and OCA-proofness. This result resolves the main open question in Roughgarden (EC'21). We also suggest several relaxations of the basic model that allow our impossibility result to be circumvented.


title: A new mass and radius determination of the ultra-short period planet K2-106b and the fluffy planet K2-106c

abstract: Ultra-short period planets have orbital periods of less than one day. Since their masses and radii can be determined to a higher precision than long-period planets, they are the preferred targets to determine the density of planets which constrains their composition. The K2-106 system is particularly interesting because it contains two planets of nearly identical masses. One is a high density USP, the other is a low-density planet that has an orbital period of 13 days. Combining the Gaia DR3 results with new ESPRESSO data allows us to determine the masses and radii of the two planets more precisely than before. We find that the USP K2-106b has a density consistent with an Earth-like composition, and K2-106c is a low-density planet that presumably has an extended atmosphere. We measure a radius of Rp=1.676-0.037+0.037 REarth, a mass of Mp=7.80-0.70+0.71 MEarth and a density of rho=9.09-0.98+0.98 gcm-3 for K2-106b. For K2-106c, we derive Rp=2.84-0.08+0.10 REarth, Mp=7.3-2.4+2.5 MEarth, and a density of rho= 1.72-0.58+0.66 gcm-3. We finally discuss the possible structures of the two planets with respect to other low-mass planets.


title: Uniqueness of indecomposable idempotents in algebras with involution

abstract: We prove uniqueness of a decomposition of $1$ into indecomposable Hermitian idempotents in an order of a finite-dimensional $\mathbb{Q}$-algebra with positive involution, by generalising a result of Eichler on unique decomposition of lattices. We use this result to prove that polarised abelian varieties over any field admit a unique decomposition into indecomposable polarised abelian subvarieties, a result previously shown by Debarre and Serre with different methods and over algebraically closed fields. We prove that an analogous uniqueness result holds true for arbitrary polarised integral Hodge structures, and derive a consequence for their automorphism groups.


title: Development of a gyrokinetic-MHD energetic particle simulation code Part I: MHD version

abstract: A new magnetohydrodynamics (MHD) code based on initial value approach, GMEC_I, has been developed for simulating various MHD physics in tokamak plasmas, as the MHD foundation of the gyrokinetic-MHD energetic particle simulation code (GMEC) family. GMEC_I solves multi-level reduced-MHD models that form a hierarchy of physics complexity, which provide conveniences for the cross-code verification and the identification of key physics effect in tokamak geometry. The field-aligned coordinates are used to represent mode structure efficiently. High-order finite difference methods are used for spatial discretization. The shifted metric methods are used for numerical stability. The discrete expansion forms of physics equations in the code are generated symbolically using the compile-time symbolic solver (CSS), which is specifically developed to reduce the complexity of the high-order finite difference form of the MHD equations. Advanced computational techniques have been implemented for optimizing memory access and code parallelization that show a good efficiency using both Thread Building Block (TBB) and Message Passing Interface (MPI). Benchmarks between GMEC_I and the eigenvalue code MAS are presented for ballooning modes without and with diamagnetic drift effects, and tearing modes, which show excellent agreements.


title: PC-NeRF: Parent-Child Neural Radiance Fields Using Sparse LiDAR Frames in Autonomous Driving Environments

abstract: Large-scale 3D scene reconstruction and novel view synthesis are vital for autonomous vehicles, especially utilizing temporally sparse LiDAR frames. However, conventional explicit representations remain a significant bottleneck towards representing the reconstructed and synthetic scenes at unlimited resolution. Although the recently developed neural radiance fields (NeRF) have shown compelling results in implicit representations, the problem of large-scale 3D scene reconstruction and novel view synthesis using sparse LiDAR frames remains unexplored. To bridge this gap, we propose a 3D scene reconstruction and novel view synthesis framework called parent-child neural radiance field (PC-NeRF). Based on its two modules, parent NeRF and child NeRF, the framework implements hierarchical spatial partitioning and multi-level scene representation, including scene, segment, and point levels. The multi-level scene representation enhances the efficient utilization of sparse LiDAR point cloud data and enables the rapid acquisition of an approximate volumetric scene representation. With extensive experiments, PC-NeRF is proven to achieve high-precision novel LiDAR view synthesis and 3D reconstruction in large-scale scenes. Moreover, PC-NeRF can effectively handle situations with sparse LiDAR frames and demonstrate high deployment efficiency with limited training epochs. Our approach implementation and the pre-trained models are available at https://github.com/biter0088/pc-nerf.


title: Stability and Multigroup Fairness in Ranking with Uncertain Predictions

abstract: Rankings are ubiquitous across many applications, from search engines to hiring committees. In practice, many rankings are derived from the output of predictors. However, when predictors trained for classification tasks have intrinsic uncertainty, it is not obvious how this uncertainty should be represented in the derived rankings. Our work considers ranking functions: maps from individual predictions for a classification task to distributions over rankings. We focus on two aspects of ranking functions: stability to perturbations in predictions and fairness towards both individuals and subgroups. Not only is stability an important requirement for its own sake, but -- as we show -- it composes harmoniously with individual fairness in the sense of Dwork et al. (2012). While deterministic ranking functions cannot be stable aside from trivial scenarios, we show that the recently proposed uncertainty aware (UA) ranking functions of Singh et al. (2021) are stable. Our main result is that UA rankings also achieve multigroup fairness through successful composition with multiaccurate or multicalibrated predictors. Our work demonstrates that UA rankings naturally interpolate between group and individual level fairness guarantees, while simultaneously satisfying stability guarantees important whenever machine-learned predictions are used.


title: Information Complexity of Stochastic Convex Optimization: Applications to Generalization and Memorization

abstract: In this work, we investigate the interplay between memorization and learning in the context of \emph{stochastic convex optimization} (SCO). We define memorization via the information a learning algorithm reveals about its training data points. We then quantify this information using the framework of conditional mutual information (CMI) proposed by Steinke and Zakynthinou (2020). Our main result is a precise characterization of the tradeoff between the accuracy of a learning algorithm and its CMI, answering an open question posed by Livni (2023). We show that, in the $L^2$ Lipschitz--bounded setting and under strong convexity, every learner with an excess error $\varepsilon$ has CMI bounded below by $\Omega(1/\varepsilon^2)$ and $\Omega(1/\varepsilon)$, respectively. We further demonstrate the essential role of memorization in learning problems in SCO by designing an adversary capable of accurately identifying a significant fraction of the training samples in specific SCO problems. Finally, we enumerate several implications of our results, such as a limitation of generalization bounds based on CMI and the incompressibility of samples in SCO problems.


title: Connecting Algorithmic Fairness to Quality Dimensions in Machine Learning in Official Statistics and Survey Production

abstract: National Statistical Organizations (NSOs) increasingly draw on Machine Learning (ML) to improve the timeliness and cost-effectiveness of their products. When introducing ML solutions, NSOs must ensure that high standards with respect to robustness, reproducibility, and accuracy are upheld as codified, e.g., in the Quality Framework for Statistical Algorithms (QF4SA; Yung et al. 2022). At the same time, a growing body of research focuses on fairness as a pre-condition of a safe deployment of ML to prevent disparate social impacts in practice. However, fairness has not yet been explicitly discussed as a quality aspect in the context of the application of ML at NSOs. We employ Yung et al. (2022)'s QF4SA quality framework and present a mapping of its quality dimensions to algorithmic fairness. We thereby extend the QF4SA framework in several ways: we argue for fairness as its own quality dimension, we investigate the interaction of fairness with other dimensions, and we explicitly address data, both on its own and its interaction with applied methodology. In parallel with empirical illustrations, we show how our mapping can contribute to methodology in the domains of official statistics, algorithmic fairness, and trustworthy machine learning.


title: YOLOv8-AM: YOLOv8 with Attention Mechanisms for Pediatric Wrist Fracture Detection

abstract: Wrist trauma and even fractures occur frequently in daily life, particularly among children who account for a significant proportion of fracture cases. Before performing surgery, surgeons often request patients to undergo X-ray imaging first and prepare for it based on the analysis of the radiologist. With the development of neural networks, You Only Look Once (YOLO) series models have been widely used in fracture detection as computer-assisted diagnosis (CAD). In 2023, Ultralytics presented the latest version of the YOLO models, which has been employed for detecting fractures across various parts of the body. Attention mechanism is one of the hottest methods to improve the model performance. This research work proposes YOLOv8-AM, which incorporates the attention mechanism into the original YOLOv8 architecture. Specifically, we respectively employ four attention modules, Convolutional Block Attention Module (CBAM), Global Attention Mechanism (GAM), Efficient Channel Attention (ECA), and Shuffle Attention (SA), to design the improved models and train them on GRAZPEDWRI-DX dataset. Experimental results demonstrate that the mean Average Precision at IoU 50 (mAP 50) of the YOLOv8-AM model based on ResBlock + CBAM (ResCBAM) increased from 63.6% to 65.8%, which achieves the state-of-the-art (SOTA) performance. Conversely, YOLOv8-AM model incorporating GAM obtains the mAP 50 value of 64.2%, which is not a satisfactory enhancement. Therefore, we combine ResBlock and GAM, introducing ResGAM to design another new YOLOv8-AM model, whose mAP 50 value is increased to 65.0%. The implementation code for this study is available on GitHub at https://github.com/RuiyangJu/Fracture_Detection_Improved_YOLOv8.


title: 3D-based RNA function prediction tools in rnaglib

abstract: Understanding the connection between complex structural features of RNA and biological function is a fundamental challenge in evolutionary studies and in RNA design. However, building datasets of RNA 3D structures and making appropriate modeling choices remains time-consuming and lacks standardization. In this chapter, we describe the use of rnaglib, to train supervised and unsupervised machine learning-based function prediction models on datasets of RNA 3D structures.


title: Tuning to the Edge of the Abyss in SU(5)

abstract: I show that if a dimensionless parameter is tuned to be close to the boundary of the positivity domain and symmetry breaking is driven by a cubic term in the Lagrangian, the scale of the physics of symmetry breaking in a quantum field theory as measured by the Higgs mass can be much greater than the dimensional scales in the classical Lagrangian. Radiative corrections produce large and physically important corrections, helping to stabilize the large VEV. The resulting picture contrasts sharply with the "modern" view of QFT as an effective field theory. I describe how this mechanism might produce the GUT scale in an SU(5) model in which the dimensional parameters in the Lagrangian are at the low scale.


title: Nonparametric identification and efficient estimation of causal effects with instrumental variables

abstract: Instrumental variables are widely used in econometrics and epidemiology for identifying and estimating causal effects when an exposure of interest is confounded by unmeasured factors. Despite this popularity, the assumptions invoked to justify the use of instruments differ substantially across the literature. Similarly, statistical approaches for estimating the resulting causal quantities vary considerably, and often rely on strong parametric assumptions. In this work, we compile and organize structural conditions that nonparametrically identify conditional average treatment effects, average treatment effects among the treated, and local average treatment effects, with a focus on identification formulae invoking the conditional Wald estimand. Moreover, we build upon existing work and propose nonparametric efficient estimators of functionals corresponding to marginal and conditional causal contrasts resulting from the various identification paradigms. We illustrate the proposed methods on an observational study examining the effects of operative care on adverse events for cholecystitis patients, and a randomized trial assessing the effects of market participation on political views.


title: Bosonic Pauli+: Efficient Simulation of Concatenated Gottesman-Kitaev-Preskill Codes

abstract: A promising route towards fault-tolerant quantum error correction is the concatenation of a Gottesman-Kitaev-Preskill (GKP) code with a qubit code. Development of such concatenated codes requires simulation tools which realistically model noise, while being able to simulate the dynamics of many modes. However, so far, large-scale simulation tools for concatenated GKP codes have been limited to idealized noise models and GKP code implementations. Here, we introduce the Bosonic Pauli+ model (BP+), which can be simulated efficiently for a large number of modes, while capturing the rich dynamics in the bosonic multi-mode Hilbert space. We demonstrate the method by simulating a hybrid surface code, where the data qubits are finite-energy GKP qubits stabilized using the small-Big-small (sBs) protocol, and the syndrome qubits are standard two-level systems. Using BP+, we present logical error rates of such an implementation. Confidence in the accuracy of the method is gained by comparing its predictions with full time evolution simulations for several relevant quantum circuits. While developed specifically for GKP qubits stabilized using the sBs protocol, the mathematical structure of BP+ is generic and may be applicable also to the simulation of concatenations using other bosonic codes.


title: AuditLLM: A Tool for Auditing Large Language Models Using Multiprobe Approach

abstract: As Large Language Models (LLMs) are integrated into various sectors, ensuring their reliability and safety is crucial. This necessitates rigorous probing and auditing to maintain their effectiveness and trustworthiness in practical applications. Subjecting LLMs to varied iterations of a single query can unveil potential inconsistencies in their knowledge base or functional capacity. However, a tool for performing such audits with a easy to execute workflow, and low technical threshold is lacking. In this demo, we introduce ``AuditLLM,'' a novel tool designed to audit the performance of various LLMs in a methodical way. AuditLLM's primary function is to audit a given LLM by deploying multiple probes derived from a single question, thus detecting any inconsistencies in the model's comprehension or performance. A robust, reliable, and consistent LLM is expected to generate semantically similar responses to variably phrased versions of the same question. Building on this premise, AuditLLM generates easily interpretable results that reflect the LLM's consistency based on a single input question provided by the user. A certain level of inconsistency has been shown to be an indicator of potential bias, hallucinations, and other issues. One could then use the output of AuditLLM to further investigate issues with the aforementioned LLM. To facilitate demonstration and practical uses, AuditLLM offers two key modes: (1) Live mode which allows instant auditing of LLMs by analyzing responses to real-time queries; and (2) Batch mode which facilitates comprehensive LLM auditing by processing multiple queries at once for in-depth analysis. This tool is beneficial for both researchers and general users, as it enhances our understanding of LLMs' capabilities in generating responses, using a standardized auditing platform.


title: Efficient Unitary T-designs from Random Sums

abstract: Unitary $T$-designs play an important role in quantum information, with diverse applications in quantum algorithms, benchmarking, tomography, and communication. Until now, the most efficient construction of unitary $T$-designs for $n$-qudit systems has been via random local quantum circuits, which have been shown to converge to approximate $T$-designs in the diamond norm using $O(T^{5+o(1)} n^2)$ quantum gates. In this work, we provide a new construction of $T$-designs via random matrix theory using $\tilde{O}(T^2 n^2)$ quantum gates. Our construction leverages two key ideas. First, in the spirit of central limit theorems, we approximate the Gaussian Unitary Ensemble (GUE) by an i.i.d. sum of random Hermitian matrices. Second, we show that the product of just two exponentiated GUE matrices is already approximately Haar random. Thus, multiplying two exponentiated sums over rather simple random matrices yields a unitary $T$-design, via Hamiltonian simulation. A central feature of our proof is a new connection between the polynomial method in quantum query complexity and the large-dimension ($N$) expansion in random matrix theory. In particular, we show that the polynomial method provides exponentially improved bounds on the high moments of certain random matrix ensembles, without requiring intricate Weingarten calculations. In doing so, we define and solve a new type of moment problem on the unit circle, asking whether a finite number of equally weighted points, corresponding to eigenvalues of unitary matrices, can reproduce a given set of moments.


title: A Modern Approach to Electoral Delimitation using the Quadtree Data Structure

abstract: The boundaries of electoral constituencies for assembly and parliamentary seats are drafted using a process referred to as delimitation, which ensures fair and equal representation of all citizens. The current delimitation exercise suffers from a number of drawbacks viz. inefficiency, gerrymandering and an uneven seat-to-population ratio, owing to existing legal and constitutional dictates. The existing methods allocate seats to every state but remain silent about their actual shape and location within the state. The main purpose of this research is to study and analyse the performance of existing delimitation algorithms and further propose a potential solution, along with its merits, that involves using a computational model based on the quadtree data structure to automate the districting process by optimizing objective population criteria. The paper presents an approach to electoral delimitation using the quadtree data structure, which is used to partition a two-dimensional geographical space by recursively subdividing it into four quadrants or regions on the basis of population as a parameter value associated with the node. The quadtree makes use of a quadrant schema of the geographical space for representing constituencies, which not only keeps count of the allocated constituencies but also holds their location-specific information. The performance of the proposed algorithm is analysed and evaluated against existing techniques and proves to be an efficient solution in terms of algorithmic complexity and boundary visualisation to the process of political districting.


title: Lattice $B$-field correlators for heavy quarks

abstract: We analyze the color-magnetic (or "$B$") field two-point function that encodes the finite-mass correction to the heavy quark momentum diffusion coefficient. The simulations are done on fine isotropic lattices in the quenched approximation at $1.5\,T_c$, using a range of gradient flow times for noise suppression and operator renormalization. The continuum extrapolation is performed at fixed flow time followed by a second extrapolation to zero flow time. Perturbative calculations to next-to-leading order of this correlation function, matching gradient-flowed correlators to MS-bar, are used to resolve nontrivial renormalization issues. We perform a spectral reconstruction based on perturbative model fits to estimate the coefficient $\kappa_B$ of the finite-mass correction to the heavy quark momentum diffusion coefficient. The approach we present here yields high-precision data for the correlator with all renormalization issues incorporated at next-to-leading order, and is also applicable for actions with dynamical fermions.


title: Neural Networks Asymptotic Behaviours for the Resolution of Inverse Problems

abstract: This paper presents a study of the effectiveness of Neural Network (NN) techniques for deconvolution inverse problems relevant for applications in Quantum Field Theory, but also in more general contexts. We consider NN's asymptotic limits, corresponding to Gaussian Processes (GPs), where non-linearities in the parameters of the NN can be neglected. Using these resulting GPs, we address the deconvolution inverse problem in the case of a quantum harmonic oscillator simulated through Monte Carlo techniques on a lattice. In this simple toy model, the results of the inversion can be compared with the known analytical solution. Our findings indicate that solving the inverse problem with a NN yields less performing results than those obtained using the GPs derived from NN's asymptotic limits. Furthermore, we observe the trained NN's accuracy approaching that of GPs with increasing layer width. Notably, one of these GPs defies interpretation as a probabilistic model, offering a novel perspective compared to established methods in the literature. Our results suggest the need for detailed studies of the training dynamics in more realistic set-ups.


title: Robust quasi-isometric embeddings inapproximable by Anosov representations

abstract: Let $\mathbb{K}=\mathbb{R}$ or $\mathbb{C}$. For all but finitely many $m\in \mathbb{N}$, we exhibit the first examples of non-locally rigid, Zariski dense, robust quasi-isometric embeddings of hyperbolic groups in $\mathsf{SL}_m(\mathbb{K})$ which are not limits of Anosov representations. As a consequence, we show that an analogue of Sullivan's structural stabilty theorem for Kleinian groups fails for Anosov representations in $\mathsf{SL}_m(\mathbb{C}), m\geq 30$.


title: Radical-Induced Changes in Transition Metal Interfacial Magnetic Properties: A Blatter Derivative on Polycrystalline Cobalt

abstract: In this work, we study the cobalt radical interface obtained by depositing a monolayer of a derivative of the Blatter radical on polycrystalline cobalt. By examining the occupied and unoccupied states at the interface, using soft X-ray techniques, and combining them with ab initio calculations, we can completely determine the electronic structure at the interface, simultaneously, on both the molecular and ferromagnetic sides, and thus obtain a full understanding of the magnetic properties at the interface. We find that the molecule is strongly hybridized with the surface. Changes in the core level spectra reflect the modification of the molecule and cobalt electronic structure induced by the bonding across the interface. This causes a decrease in the magnetic moments of the cobalt atoms bonded to the molecules that lose their radical character. Our method allows screening, beforehand, the organic ferromagnetic interfaces in view of potential applications in spintronic.


title: Registration of Longitudinal Spine CTs for Monitoring Lesion Growth

abstract: Accurate and reliable registration of longitudinal spine images is essential for assessment of disease progression and surgical outcome. Implementing a fully automatic and robust registration is crucial for clinical use, however, it is challenging due to substantial change in shape and appearance due to lesions. In this paper we present a novel method to automatically align longitudinal spine CTs and accurately assess lesion progression. Our method follows a two-step pipeline where vertebrae are first automatically localized, labeled and 3D surfaces are generated using a deep learning model, then longitudinally aligned using a Gaussian mixture model surface registration. We tested our approach on 37 vertebrae, from 5 patients, with baseline CTs and 3, 6, and 12 months follow-ups leading to 111 registrations. Our experiment showed accurate registration with an average Hausdorff distance of 0.65 mm and average Dice score of 0.92.


title: Changing disc compositions via internal photoevaporation

abstract: The chemical evolution of protoplanetary discs is not fully understood, several factors influence the final distribution of disc material. One such factor are inward drifting and evaporating pebbles that enrich the inner disc with vapour. In particular, it is first enriched with water vapour, resulting in a low C/O ratio, before carbon-rich gas from the outer disc is transported inwards elevating the C/O ratio again. However, it is unclear how internal photoevaporation, which carries away gas and opens gaps that block inward drifting pebbles, affects the chemical composition of the disc. We aim to study these effects in discs around solar-like stars, where we especially focus on the C/O ratio and the water content. The simulations are carried out using a semi-analytical 1D disc model. Our code chemcomp includes viscous evolution and heating, pebble growth and drift, pebble evaporation and condensation, and a simple chemical partitioning model. We show that internal photoevaporation plays a major role in the (chemical) evolution of protoplanetary discs: As it opens a gap, inward drifting pebbles are stopped and cannot contribute to the volatile content any more. In addition, gas from the outer disc is carried away by photoevaporative winds. Consequently, the C/O ratio in the inner disc is low. In contrast, gaps opened by giant planets allow the gas to pass, resulting in an elevated C/O ratio, similar to viscous discs without internal photoevaporation. This will enable us to distinguish observationally between these two scenarios when measuring the C/O ratio, implying that we can infer the cause of gap structures in disc observations. In the case of a photoevaporative disc, we additionally find an elevated water content in the inner disc as the water vapour and ice undergo a cycle of evaporation/re-condensation, preventing its inward accretion onto the star.


title: Fractional part correlations and the M\"obius function

abstract: We show that under the Riemann hypothesis $$ \sum_{n\neq m}\frac{\mu(n)\mu(m)}{nm}E_{X}\left(\{nx\}\{mx\}\right)=-\frac{9}{2\pi^{2}}+O\left(\frac{1}{X}\right), $$ where $x$ is uniformly distributed in $[0,X]$ with $X\in \mathbb{N}$, $E_{X}(.)$ denotes the expected value, $\mu(.)$ denotes the M\"obius function, and $\{.\}$ denotes the fractional part function.


title: Generating Diverse Translation with Perturbed kNN-MT

abstract: Generating multiple translation candidates would enable users to choose the one that satisfies their needs. Although there has been work on diversified generation, there exists room for improving the diversity mainly because the previous methods do not address the overcorrection problem -- the model underestimates a prediction that is largely different from the training data, even if that prediction is likely. This paper proposes methods that generate more diverse translations by introducing perturbed k-nearest neighbor machine translation (kNN-MT). Our methods expand the search space of kNN-MT and help incorporate diverse words into candidates by addressing the overcorrection problem. Our experiments show that the proposed methods drastically improve candidate diversity and control the degree of diversity by tuning the perturbation's magnitude.


title: InfoRM: Mitigating Reward Hacking in RLHF via Information-Theoretic Reward Modeling

abstract: Despite the success of reinforcement learning from human feedback (RLHF) in aligning language models with human values, reward hacking, also termed reward overoptimization, remains a critical challenge. This issue primarily arises from reward misgeneralization, where reward models (RMs) compute reward using spurious features that are irrelevant to human preferences. In this work, we tackle this problem from an information-theoretic perspective and propose a framework for reward modeling, namely InfoRM, by introducing a variational information bottleneck objective to filter out irrelevant information. Notably, we further identify a correlation between overoptimization and outliers in the IB latent space of InfoRM, establishing it as a promising tool for detecting reward overoptimization. Inspired by this finding, we propose the Cluster Separation Index (CSI), which quantifies deviations in the IB latent space, as an indicator of reward overoptimization to facilitate the development of online mitigation strategies. Extensive experiments on a wide range of settings and RM scales (70M, 440M, 1.4B, and 7B) demonstrate the effectiveness of InfoRM. Further analyses reveal that InfoRM's overoptimization detection mechanism is not only effective but also robust across a broad range of datasets, signifying a notable advancement in the field of RLHF. The code will be released upon acceptance.


title: LLMAuditor: A Framework for Auditing Large Language Models Using Human-in-the-Loop

abstract: As Large Language Models (LLMs) become more pervasive across various users and scenarios, identifying potential issues when using these models becomes essential. Examples of such issues include: bias, inconsistencies, and hallucination. Although auditing the LLM for these problems is often warranted, such a process is neither easy nor accessible for most. An effective method is to probe the LLM using different versions of the same question. This could expose inconsistencies in its knowledge or operation, indicating potential for bias or hallucination. However, to operationalize this auditing method at scale, we need an approach to create those probes reliably and automatically. In this paper we propose the LLMAuditor framework which is an automatic, and scalable solution, where one uses a different LLM along with human-in-the-loop (HIL). This approach offers verifiability and transparency, while avoiding circular reliance on the same LLM, and increasing scientific rigor and generalizability. Specifically, LLMAuditor includes two phases of verification using humans: standardized evaluation criteria to verify responses, and a structured prompt template to generate desired probes. A case study using questions from the TruthfulQA dataset demonstrates that we can generate a reliable set of probes from one LLM that can be used to audit inconsistencies in a different LLM. This process is enhanced by our structured prompt template with HIL, which not only boosts the reliability of our approach in auditing but also yields the delivery of less hallucinated results. The novelty of our research stems from the development of a comprehensive, general-purpose framework that includes a HIL verified prompt template for auditing responses generated by LLMs.


title: Irreducible representations of the crystallization of the quantized function algebras $C(SU_{q}(n+1))$

abstract: Crystallization of the $C^*$-algebras $C(SU_{q}(n+1))$ was introduced by Giri and Pal as a $C^*$-algebra $C(SU_{0}(n+1))$ given by a finite set of generators and relations. Here we study representations of the $C^*$-algebra $C(SU_{0}(n+1))$ and prove a factorization theorem for its irreducible representations. This leads to a complete classification of all irreducible representations of this $C^*$-algebra. As an important consequence, we prove that all the irreducible representations of $C(SU_{0}(n+1))$ arise exactly as $q\to 0+$ limits of irreducible representations of $C(SU_{q}(n+1))$. We also present a few other important corollaries of the classification theorem.


title: On the system size dependence of the diffusion coefficients in MD simulations: A simple correction formula for pure dense fluids

abstract: A practical correction formula relating the self-diffusion coefficient of dense liquids from molecular dynamics simulations with periodic boundary conditions to the self-diffusion coefficient in the thermodynamic limit is discussed. This formula applies to pure dense fluids and has a very simple form $D=D_0(1-\gamma N^{-1/3})$, where $D_0$ is the self-diffusion coefficient in the thermodynamic limit and $N$ is the number of particles in the simulation. The numerical factor $\gamma$ depends on the geometry of the simulation cell. Remarkably, $\gamma\simeq 1.0$ for the most popular cubic geometry. The success of this formula is supported by results from MD simulations, including very recent simulations with a ``magic'' simulation geometry.


title: Monoclinic LaSb$_2$ Superconducting Thin Films

abstract: Rare-earth diantimondes exhibit coupling between structural and electronic orders which are tunable under pressure and temperature. Here we present the discovery of a new polymorph of LaSb$_2$ stabilized in thin films synthesized using molecular beam epitaxy. Using diffraction, electron microscopy, and first principles calculations we identify a YbSb$_2$-type monoclinic lattice as a yet-uncharacterized stacking configuration. The material hosts superconductivity with a $T_\mathrm{c}$ = 2 K, which is enhanced relative to the bulk ambient phase, and a long superconducting coherence length of 140 nm. This result highlights the potential thin film growth has in stabilizing novel stacking configurations in quasi-two dimensional compounds with competing layered structures.


title: Schauder-Orlicz decompositions, $\ell_{\Phi}$-decompositions and pseudo-Daugavet property

abstract: The concept of $\ell_{\Phi}$-decomposition, extending the concept of $\ell_{p}$-decomposition of a Banach space, is presented and basic properties of Schauder-Orlicz decompositions and $\ell_{\Phi}$-decompositions are studied. We show that Schauder-Orlicz decompositions are orthogonal in a sense of Grinblyum-James and Singer. Simple constructions of $\ell_{p}$-decompositions and Schauder-Orlicz decompositions in $L_p$ are presented. We prove that in the class of spaces possessing pseudo-Daugavet property, which includes classical $L_p$, $1\leq p\neq 2$, and $C$, Schauder-Orlicz decompositions with at least one finite dimensional subspace do not exist. It follows that Kato theorem on similarity for sequences of projections [1] cannot be extended to spaces from this class. Moreover we show that Banach spaces, possessing Schauder-Orlicz decompositions with at least one finite dimensional subspace, do not have pseudo-Daugavet property. Thus for Banach spaces $X$ possessing Schauder-Orlicz decompositions we obtain the following characterization of pseudo-Daugavet property: $X$ has pseudo-Daugavet property if and only if there is no Schauder-Orlicz decomposition in $X$ with at least one finite dimensional subspace if and only if there is no Schauder-Orlicz decomposition in $X$, which is an FDD.


title: Extensions and paracanonical curves of genus 6

abstract: In this note we give a computationally easy to use method to compute a maximal extension of certain varieties. As a application we prove that a general paracanonical curve C genus 6 as a codimension three subvarieties of P^4 extend to precisely 26 families of surfaces Y in P^5.


title: Sign of the $hZZ$ coupling and implication for new physics

abstract: The magnitudes of the couplings of the scalar resonance at 125 GeV with the SM particles are found to be consistent with those of the SM Higgs boson. However, the signs are not experimentally determined in most of the cases, a prime example being that with the $Z$-boson pair. In other words, $\kappa_Z^h$, the ratio of the couplings of the actual 125 GeV resonance with $ZZ$ and that of the SM Higgs boson with the same, is consistent with both $+1$ and $-1$, the latter being the `wrong-sign'. We argue that the wrong-sign $hZZ$ coupling will necessitate the intervention of new physics below $\mathcal{O}\left(620\right)$ GeV to safeguard the underlying theory from unitarity violation. The strength of the new nonstandard couplings can be derived from the unitarity sum rules, which are comparable to the SM-Higgs couplings in magnitude. Thus the strong limits from the direct searches at the LHC can help us rule out the existence of such nonstandard particles with unusually large couplings thereby disfavoring the possibility of a wrong-sign $hZZ$ coupling.


title: DoRA: Weight-Decomposed Low-Rank Adaptation

abstract: Among the widely used parameter-efficient fine-tuning (PEFT) methods, LoRA and its variants have gained considerable popularity because of avoiding additional inference costs. However, there still often exists an accuracy gap between these methods and full fine-tuning (FT). In this work, we first introduce a novel weight decomposition analysis to investigate the inherent differences between FT and LoRA. Aiming to resemble the learning capacity of FT from the findings, we propose Weight-Decomposed Low-Rank Adaptation (DoRA). DoRA decomposes the pre-trained weight into two components, magnitude and direction, for fine-tuning, specifically employing LoRA for directional updates to efficiently minimize the number of trainable parameters. By employing \ours, we enhance both the learning capacity and training stability of LoRA while avoiding any additional inference overhead. \ours~consistently outperforms LoRA on fine-tuning LLaMA, LLaVA, and VL-BART on various downstream tasks, such as commonsense reasoning, visual instruction tuning, and image/video-text understanding. Code is available at https://github.com/NVlabs/DoRA.


title: Investigation of Ga interstitial and vacancy diffusion in $\beta$-Ga$_2$O$_3$ via split defects: a direct approach via master diffusion equations

abstract: The low symmetry of monoclinic $\beta$-Ga$_2$O$_3$ leads to elaborate intrinsic defects, such as Ga vacancies split amongst multiple lattice sites. These defects contribute to fast, anisotropic Ga diffusion, yet their complexity makes it challenging to understand dominant diffusion mechanisms. Here, we predict the 3D diffusivity tensors for Ga interstitials (Ga${_i^{3+}}$) and vacancies (V${_{Ga}^{3-}}$) via first principles and direct solution of the master diffusion equations. We first explore the maximum extent of configurationally complex ''$N$-split'' Ga interstitials and vacancies. With dominant low-energy defects identified, we enumerate all possible elementary hops connecting defect configurations to each other, including interstitialcy hops. Hopping barriers are obtained from nudged elastic band simulations. Finally, the comprehensive sets of (i) defect configurations and their energies and (ii) the hopping barriers that connect them are used to construct the master diffusion equations for both Ga${_i^{3+}}$ and V${_{Ga}^{3-}}$. The solution to these equations yields the Onsager transport coefficients, i.e. the components of the 3D diffusivity tensors $D_{{Ga}_i}$ and $D_{V_{Ga}}$ for Ga${_i^{3+}}$ and V${_{Ga}^{3-}}$, respectively. It further reveals the active diffusion paths along all crystallographic directions. We find that both Ga${_i^{3+}}$ and V${_{{Ga}}^{3-}}$ diffusion are fastest along the $c$-axis, due to 3-split defects that bridge neighboring unit cells along the $c$-axis and divert diffusing species around high-energy bottlenecks. Although isolated Ga${_i^{3+}}$ diffuse faster than isolated V${_{Ga}^{3-}}$, self-diffusion of Ga is predominantly mediated by V$_{Ga}^{3-}$ due to the higher V$_{Ga}^{3-}$ defect concentration under most thermodynamic environments.


title: Single-Reset Divide & Conquer Imitation Learning

abstract: Demonstrations are commonly used to speed up the learning process of Deep Reinforcement Learning algorithms. To cope with the difficulty of accessing multiple demonstrations, some algorithms have been developed to learn from a single demonstration. In particular, the Divide & Conquer Imitation Learning algorithms leverage a sequential bias to learn a control policy for complex robotic tasks using a single state-based demonstration. The latest version, DCIL-II demonstrates remarkable sample efficiency. This novel method operates within an extended Goal-Conditioned Reinforcement Learning framework, ensuring compatibility between intermediate and subsequent goals extracted from the demonstration. However, a fundamental limitation arises from the assumption that the system can be reset to specific states along the demonstrated trajectory, confining the application to simulated systems. In response, we introduce an extension called Single-Reset DCIL (SR-DCIL), designed to overcome this constraint by relying on a single initial state reset rather than sequential resets. To address this more challenging setting, we integrate two mechanisms inspired by the Learning from Demonstrations literature, including a Demo-Buffer and Value Cloning, to guide the agent toward compatible success states. In addition, we introduce Approximate Goal Switching to facilitate training to reach goals distant from the reset state. Our paper makes several contributions, highlighting the importance of the reset assumption in DCIL-II, presenting the mechanisms of SR-DCIL variants and evaluating their performance in challenging robotic tasks compared to DCIL-II. In summary, this work offers insights into the significance of reset assumptions in the framework of DCIL and proposes SR-DCIL, a first step toward a versatile algorithm capable of learning control policies under a weaker reset assumption.


title: On the Impact of Spatial Covariance Matrix Ordering on Tile Low-Rank Estimation of Mat\'ern Parameters

abstract: Spatial statistical modeling and prediction involve generating and manipulating an n*n symmetric positive definite covariance matrix, where n denotes the number of spatial locations. However, when n is large, processing this covariance matrix using traditional methods becomes prohibitive. Thus, coupling parallel processing with approximation can be an elegant solution to this challenge by relying on parallel solvers that deal with the matrix as a set of small tiles instead of the full structure. Each processing unit can process a single tile, allowing better performance. The approximation can also be performed at the tile level for better compression and faster execution. The Tile Low-Rank (TLR) approximation, a tile-based approximation algorithm, has recently been used in spatial statistics applications. However, the quality of TLR algorithms mainly relies on ordering the matrix elements. This order can impact the compression quality and, therefore, the efficiency of the underlying linear solvers, which highly depends on the individual ranks of each tile. Thus, herein, we aim to investigate the accuracy and performance of some existing ordering algorithms that are used to order the geospatial locations before generating the spatial covariance matrix. Furthermore, we highlight the pros and cons of each ordering algorithm in the context of spatial statistics applications and give hints to practitioners on how to choose the ordering algorithm carefully. We assess the quality of the compression and the accuracy of the statistical parameter estimates of the Mat\'ern covariance function using TLR approximation under various ordering algorithms and settings of correlations.


title: Mechanism Design for Automated Market Makers

abstract: Blockchains have popularized automated market makers (AMMs). An AMM exchange is an application running on a blockchain which maintains a pool of crypto-assets and automatically trades assets with users governed by some pricing function that prices the assets based on their relative demand/supply. AMMs have created an important challenge commonly known as the Miner Extractable Value (MEV). In particular, the miners who control the contents and ordering of transactions in a block can extract value by front-running and back-running users' transactions, leading to arbitrage opportunities that guarantee them risk-free returns. In this paper, we consider how to design AMM mechanisms that eliminate MEV opportunities. Specifically, we propose a new AMM mechanism that processes all transactions contained within a block in a batch. We show that our new mechanism satisfies two tiers of guarantees. First, for legacy blockchains where each block is proposed by a single (possibly rotating) miner, we prove that our mechanism satisfies arbitrage resilience, i.e., a miner cannot gain risk-free profit. Moreover, we also guarantee fair treatment among all transactions within the same block, such that the miner is unable to sell off favorable positions in the block to users or arbitragers. Second, for blockchains where the block proposal process is decentralized and offers sequencing-fairness, we prove a stronger notion called incentive compatibility -- roughly speaking, we guarantee that any individual user's best response is to follow the honest strategy.


title: Integrating ChatGPT into Secure Hospital Networks: A Case Study on Improving Radiology Report Analysis

abstract: This study demonstrates the first in-hospital adaptation of a cloud-based AI, similar to ChatGPT, into a secure model for analyzing radiology reports, prioritizing patient data privacy. By employing a unique sentence-level knowledge distillation method through contrastive learning, we achieve over 95% accuracy in detecting anomalies. The model also accurately flags uncertainties in its predictions, enhancing its reliability and interpretability for physicians with certainty indicators. These advancements represent significant progress in developing secure and efficient AI tools for healthcare, suggesting a promising future for in-hospital AI applications with minimal supervision.


title: Pruning Sparse Tensor Neural Networks Enables Deep Learning for 3D Ultrasound Localization Microscopy

abstract: Ultrasound Localization Microscopy (ULM) is a non-invasive technique that allows for the imaging of micro-vessels in vivo, at depth and with a resolution on the order of ten microns. ULM is based on the sub-resolution localization of individual microbubbles injected in the bloodstream. Mapping the whole angioarchitecture requires the accumulation of microbubbles trajectories from thousands of frames, typically acquired over a few minutes. ULM acquisition times can be reduced by increasing the microbubble concentration, but requires more advanced algorithms to detect them individually. Several deep learning approaches have been proposed for this task, but they remain limited to 2D imaging, in part due to the associated large memory requirements. Herein, we propose to use sparse tensor neural networks to reduce memory usage in 2D and to improve the scaling of the memory requirement for the extension of deep learning architecture to 3D. We study several approaches to efficiently convert ultrasound data into a sparse format and study the impact of the associated loss of information. When applied in 2D, the sparse formulation reduces the memory requirements by a factor 2 at the cost of a small reduction of performance when compared against dense networks. In 3D, the proposed approach reduces memory requirements by two order of magnitude while largely outperforming conventional ULM in high concentration settings. We show that Sparse Tensor Neural Networks in 3D ULM allow for the same benefits as dense deep learning based method in 2D ULM i.e. the use of higher concentration in silico and reduced acquisition time.


title: HiRE: High Recall Approximate Top-$k$ Estimation for Efficient LLM Inference

abstract: Autoregressive decoding with generative Large Language Models (LLMs) on accelerators (GPUs/TPUs) is often memory-bound where most of the time is spent on transferring model parameters from high bandwidth memory (HBM) to cache. On the other hand, recent works show that LLMs can maintain quality with significant sparsity/redundancy in the feedforward (FFN) layers by appropriately training the model to operate on a top-$k$ fraction of rows/columns (where $k \approx 0.05$), there by suggesting a way to reduce the transfer of model parameters, and hence latency. However, exploiting this sparsity for improving latency is hindered by the fact that identifying top rows/columns is data-dependent and is usually performed using full matrix operations, severely limiting potential gains. To address these issues, we introduce HiRE (High Recall Approximate Top-k Estimation). HiRE comprises of two novel components: (i) a compression scheme to cheaply predict top-$k$ rows/columns with high recall, followed by full computation restricted to the predicted subset, and (ii) DA-TOP-$k$: an efficient multi-device approximate top-$k$ operator. We demonstrate that on a one billion parameter model, HiRE applied to both the softmax as well as feedforward layers, achieves almost matching pretraining and downstream accuracy, and speeds up inference latency by $1.47\times$ on a single TPUv5e device.


title: Small instanton-induced flavor invariants and the axion potential

abstract: Small instantons which increase the axion mass due to an appropriate modification of QCD at a UV scale $\Lambda_{\rm SI}$, can also enhance the effect of CP-violating operators to shift the axion potential minimum by an amount, $\theta_{\rm ind}$, proportional to the flavorful couplings in the SMEFT. Since physical observables must be flavor basis independent, we construct a basis of determinant-like flavor invariants that arise from instanton calculations containing the effects of dimension-six CP-odd operators at the scale $\require{cancel}\Lambda_{\cancel{\rm CP}}$. This new basis provides a more reliable estimate of the shift $\theta_{\rm ind}$, that is severely constrained by neutron electric dipole moment experiments. In particular, for the case of four-quark, semi-leptonic and gluon dipole operators, these invariants are then used to provide improved limits on the ratio of scales $\require{cancel}\Lambda_{\rm SI}/\Lambda_{\cancel{\rm CP}}$ for different flavor scenarios. The CP-odd flavor invariants also provide a classification of the leading effects from Wilson coefficients, and as an example, we show that a semi-leptonic four-fermion operator is subdominant compared to the four-quark operators. More generally, the flavor invariants, together with an instanton NDA, can be used to more accurately estimate small instanton effects in the axion potential that arise from any SMEFT operator.


title: Long-Distance Nuclear Matrix Elements for Neutrinoless Double-Beta Decay from Lattice QCD

abstract: Neutrinoless double-beta ($0\nu\beta\beta$) decay is a heretofore unobserved process which, if observed, would imply that neutrinos are Majorana particles. Interpretations of the stringent experimental constraints on $0\nu\beta\beta$-decay half-lives require calculations of nuclear matrix elements. This work presents the first lattice quantum-chromodynamics (LQCD) calculation of the matrix element for $0\nu\beta\beta$ decay in a multi-nucleon system, specifically the $nn \rightarrow pp ee$ transition, mediated by a light left-handed Majorana neutrino propagating over nuclear-scale distances. This calculation is performed with quark masses corresponding to a pion mass of $m_\pi = 806$ MeV at a single lattice spacing and volume. The statistically cleaner $\Sigma^- \rightarrow \Sigma^+ ee$ transition is also computed in order to investigate various systematic uncertainties. The prospects for matching the results of LQCD calculations onto a nuclear effective field theory to determine a leading-order low-energy constant relevant for $0\nu\beta\beta$ decay with a light Majorana neutrino are investigated. This work, therefore, sets the stage for future calculations at physical values of the quark masses that, combined with effective field theory and nuclear many-body studies, will provide controlled theoretical inputs to experimental searches of $0\nu\beta\beta$ decay.


title: Copyright Traps for Large Language Models

abstract: Questions of fair use of copyright-protected content to train Large Language Models (LLMs) are being actively debated. Document-level inference has been proposed as a new task: inferring from black-box access to the trained model whether a piece of content has been seen during training. SOTA methods however rely on naturally occurring memorization of (part of) the content. While very effective against models that memorize significantly, we hypothesize--and later confirm--that they will not work against models that do not naturally memorize, e.g. medium-size 1B models. We here propose to use copyright traps, the inclusion of fictitious entries in original content, to detect the use of copyrighted materials in LLMs with a focus on models where memorization does not naturally occur. We carefully design a randomized controlled experimental setup, inserting traps into original content (books) and train a 1.3B LLM from scratch. We first validate that the use of content in our target model would be undetectable using existing methods. We then show, contrary to intuition, that even medium-length trap sentences repeated a significant number of times (100) are not detectable using existing methods. However, we show that longer sequences repeated a large number of times can be reliably detected (AUC=0.75) and used as copyright traps. Beyond copyright applications, our findings contribute to the study of LLM memorization: the randomized controlled setup enables us to draw causal relationships between memorization and certain sequence properties such as repetition in model training data and perplexity.


title: Performance-Complexity-Latency Trade-offs of Concatenated RS-BCH Codes

abstract: Using a generating function approach, a computationally tractable expression is derived to predict the frame error rate arising at the output of the binary symmetric channel when a number of outer Reed--Solomon codes are concatenated with a number of inner Bose--Ray-Chaudhuri--Hocquenghem codes, thereby obviating the need for time-consuming Monte Carlo simulations. Measuring (a) code performance via the gap to the Shannon limit, (b) decoding complexity via an estimate of the number of operations per decoded bit, and (c) decoding latency by the overall frame length, a code search is performed to determine the Pareto frontier for performance-complexity-latency trade-offs.


title: A Note on the Origin of Inertia

abstract: The question of where the inertial properties of matter come from has been open for a long time. Isaac Newton considered inertia an intrinsic property of matter. Ernst Mach held a different view whereby the inertia of a body comes from its interaction with the rest of the universe. This idea is known today as Mach's principle. We discuss Mach's principle based on transactional gravity, the recently developed completion of the entropic gravity program by the physics of quantum events induced by transactions. A consequence of the analysis is a fundamental relation between the gravitational constant G and the total mass in the causal universe, derived by means of entropic principles.


title: A 350-MHz Green Bank Telescope Survey of Unassociated Fermi LAT Sources: Discovery and Timing of Ten Millisecond Pulsars

abstract: We have searched for radio pulsations towards 49 Fermi Large Area Telescope (LAT) 1FGL Catalog $\gamma$-ray sources using the Green Bank Telescope at 350 MHz. We detected 18 millisecond pulsars (MSPs) in blind searches of the data; 10 of these were discoveries unique to our survey. Sixteen are binaries, with eight having short orbital periods $P_B < 1$ day. No radio pulsations from young pulsars were detected, although three targets are coincident with apparently radio-quiet $\gamma$-ray pulsars discovered in LAT data. Here, we give an overview of the survey and present radio and $\gamma$-ray timing results for the 10 MSPs discovered. These include the only isolated MSP discovered in our survey and six short-$P_B$ binary MSPs. Of these, three have very low-mass companions ($M_c$ $\ll$ 0.1M$_{\odot}$) and hence belong to the class of black widow pulsars. Two have more massive, non-degenerate companions with extensive radio eclipses and orbitally modulated X-ray emission consistent with the redback class. Significant $\gamma$-ray pulsations have been detected from nine of the discoveries. This survey and similar efforts suggest that the majority of Galactic $\gamma$-ray sources at high Galactic latitudes are either MSPs or relatively nearby non-recycled pulsars, with the latter having on average a much smaller radio/$\gamma$-ray beaming ratio as compared to MSPs. It also confirms that past surveys suffered from an observational bias against finding short-$P_B$ MSP systems.


title: Prediction of Activated Sludge Settling Characteristics from Microscopy Images with Deep Convolutional Neural Networks and Transfer Learning

abstract: Microbial communities play a key role in biological wastewater treatment processes. Activated sludge settling characteristics, for example, are affected by microbial community composition, varying by changes in operating conditions and influent characteristics of wastewater treatment plants (WWTPs). Timely assessment and prediction of changes in microbial composition leading to settling problems, such as filamentous bulking (FB), can prevent operational challenges, reductions in treatment efficiency, and adverse environmental impacts. This study presents an innovative computer vision-based approach to assess activated sludge-settling characteristics based on the morphological properties of flocs and filaments in microscopy images. Implementing the transfer learning of deep convolutional neural network (CNN) models, this approach aims to overcome the limitations of existing quantitative image analysis techniques. The offline microscopy image dataset was collected over two years, with weekly sampling at a full-scale industrial WWTP in Belgium. Multiple data augmentation techniques were employed to enhance the generalizability of the CNN models. Various CNN architectures, including Inception v3, ResNet18, ResNet152, ConvNeXt-nano, and ConvNeXt-S, were tested to evaluate their performance in predicting sludge settling characteristics. The sludge volume index was used as the final prediction variable, but the method can easily be adjusted to predict any other settling metric of choice. The results showed that the suggested CNN-based approach provides less labour-intensive, objective, and consistent assessments, while transfer learning notably minimises the training phase, resulting in a generalizable system that can be employed in real-time applications.


title: Magic-Me: Identity-Specific Video Customized Diffusion

abstract: Creating content with specified identities (ID) has attracted significant interest in the field of generative models. In the field of text-to-image generation (T2I), subject-driven creation has achieved great progress with the identity controlled via reference images. However, its extension to video generation is not well explored. In this work, we propose a simple yet effective subject identity controllable video generation framework, termed Video Custom Diffusion (VCD). With a specified identity defined by a few images, VCD reinforces the identity characteristics and injects frame-wise correlation at the initialization stage for stable video outputs. To achieve this, we propose three novel components that are essential for high-quality identity preservation and stable video generation: 1) a noise initialization method with 3D Gaussian Noise Prior for better inter-frame stability; 2) an ID module based on extended Textual Inversion trained with the cropped identity to disentangle the ID information from the background 3) Face VCD and Tiled VCD modules to reinforce faces and upscale the video to higher resolution while preserving the identity's features. We conducted extensive experiments to verify that VCD is able to generate stable videos with better ID over the baselines. Besides, with the transferability of the encoded identity in the ID module, VCD is also working well with personalized text-to-image models available publicly. The codes are available at https://github.com/Zhen-Dong/Magic-Me.


title: Massively Multi-Cultural Knowledge Acquisition & LM Benchmarking

abstract: Pretrained large language models have revolutionized many applications but still face challenges related to cultural bias and a lack of cultural commonsense knowledge crucial for guiding cross-culture communication and interactions. Recognizing the shortcomings of existing methods in capturing the diverse and rich cultures across the world, this paper introduces a novel approach for massively multicultural knowledge acquisition. Specifically, our method strategically navigates from densely informative Wikipedia documents on cultural topics to an extensive network of linked pages. Leveraging this valuable source of data collection, we construct the CultureAtlas dataset, which covers a wide range of sub-country level geographical regions and ethnolinguistic groups, with data cleaning and preprocessing to ensure textual assertion sentence self-containment, as well as fine-grained cultural profile information extraction. Our dataset not only facilitates the evaluation of language model performance in culturally diverse contexts but also serves as a foundational tool for the development of culturally sensitive and aware language models. Our work marks an important step towards deeper understanding and bridging the gaps of cultural disparities in AI, to promote a more inclusive and balanced representation of global cultures in the digital domain.


title: Pseudorandom Error-Correcting Codes

abstract: We construct pseudorandom error-correcting codes (or simply pseudorandom codes), which are error-correcting codes with the property that any polynomial number of codewords are pseudorandom to any computationally-bounded adversary. Efficient decoding of corrupted codewords is possible with the help of a decoding key. We build pseudorandom codes that are robust to substitution and deletion errors, where pseudorandomness rests on standard cryptographic assumptions. Specifically, pseudorandomness is based on either $2^{O(\sqrt{n})}$-hardness of LPN, or polynomial hardness of LPN and the planted XOR problem at low density. As our primary application of pseudorandom codes, we present an undetectable watermarking scheme for outputs of language models that is robust to cropping and a constant rate of random substitutions and deletions. The watermark is undetectable in the sense that any number of samples of watermarked text are computationally indistinguishable from text output by the original model. This is the first undetectable watermarking scheme that can tolerate a constant rate of errors. Our second application is to steganography, where a secret message is hidden in innocent-looking content. We present a constant-rate stateless steganography scheme with robustness to a constant rate of substitutions. Ours is the first stateless steganography scheme with provable steganographic security and any robustness to errors.


title: Transformers Can Achieve Length Generalization But Not Robustly

abstract: Length generalization, defined as the ability to extrapolate from shorter training sequences to longer test ones, is a significant challenge for language models. This issue persists even with large-scale Transformers handling relatively straightforward tasks. In this paper, we test the Transformer's ability of length generalization using the task of addition of two integers. We show that the success of length generalization is intricately linked to the data format and the type of position encoding. Using the right combination of data format and position encodings, we show for the first time that standard Transformers can extrapolate to a sequence length that is 2.5x the input length. Nevertheless, unlike in-distribution generalization, length generalization remains fragile, significantly influenced by factors like random weight initialization and training data order, leading to large variances across different random seeds.


title: Deep Rib Fracture Instance Segmentation and Classification from CT on the RibFrac Challenge

abstract: Rib fractures are a common and potentially severe injury that can be challenging and labor-intensive to detect in CT scans. While there have been efforts to address this field, the lack of large-scale annotated datasets and evaluation benchmarks has hindered the development and validation of deep learning algorithms. To address this issue, the RibFrac Challenge was introduced, providing a benchmark dataset of over 5,000 rib fractures from 660 CT scans, with voxel-level instance mask annotations and diagnosis labels for four clinical categories (buckle, nondisplaced, displaced, or segmental). The challenge includes two tracks: a detection (instance segmentation) track evaluated by an FROC-style metric and a classification track evaluated by an F1-style metric. During the MICCAI 2020 challenge period, 243 results were evaluated, and seven teams were invited to participate in the challenge summary. The analysis revealed that several top rib fracture detection solutions achieved performance comparable or even better than human experts. Nevertheless, the current rib fracture classification solutions are hardly clinically applicable, which can be an interesting area in the future. As an active benchmark and research resource, the data and online evaluation of the RibFrac Challenge are available at the challenge website. As an independent contribution, we have also extended our previous internal baseline by incorporating recent advancements in large-scale pretrained networks and point-based rib segmentation techniques. The resulting FracNet+ demonstrates competitive performance in rib fracture detection, which lays a foundation for further research and development in AI-assisted rib fracture detection and diagnosis.


title: Loss Shaping Constraints for Long-Term Time Series Forecasting

abstract: Several applications in time series forecasting require predicting multiple steps ahead. Despite the vast amount of literature in the topic, both classical and recent deep learning based approaches have mostly focused on minimising performance averaged over the predicted window. We observe that this can lead to disparate distributions of errors across forecasting steps, especially for recent transformer architectures trained on popular forecasting benchmarks. That is, optimising performance on average can lead to undesirably large errors at specific time-steps. In this work, we present a Constrained Learning approach for long-term time series forecasting that aims to find the best model in terms of average performance that respects a user-defined upper bound on the loss at each time-step. We call our approach loss shaping constraints because it imposes constraints on the loss at each time step, and leverage recent duality results to show that despite its non-convexity, the resulting problem has a bounded duality gap. We propose a practical Primal-Dual algorithm to tackle it, and demonstrate that the proposed approach exhibits competitive average performance in time series forecasting benchmarks, while shaping the distribution of errors across the predicted window.


title: Varentropy Estimation via Nearest Neighbor Graphs

abstract: The Varentropy is a measure of the variability of the information content of random vector and it is invariant under affine transformations. We introduce the statistical estimate of varentropy of random vector based on the nearest neighbor graphs (distances). The asymptotic unbiasedness and L2-consistency of the estimates are established.


title: Local work-function manipulation by external optical stimulation

abstract: Strongly differing static dipole moments of the trans and cis isomers of photochromic azobenzene allow for optical switching the work function of azobenzene-functionalized self-assembled monolayers (SAMs). We apply these properties in a fundamental experiment to manipulate the area size of the switched SAM. Azobenzene molecules were excited by ultraviolet laser illumination and the transient isomerization profile of the SAM was spatially resolved recording photoemission electron microscopy (PEEM) images. Thereby we demonstrate the spatial tuning of the SAM work-function and discuss the role of the laser spot-profile in generating sharp edges or gradual changes of the work function.


title: Exactly solvable Hamiltonian fragments obtained from a direct sum of Lie algebras

abstract: Exactly solvable Hamiltonians are useful in the study of quantum many-body systems using quantum computers. In the variational quantum eigensolver, a decomposition of the target Hamiltonian into exactly solvable fragments can be used for evaluation of the energies via repeated quantum measurements. In this work, we apply more general classes of exactly solvable qubit Hamiltonians than previously considered to address the Hamiltonian measurement problem. The most general exactly solvable Hamiltonians are defined by the condition that, within each simultaneous eigenspace of a set of Pauli symmetries, the Hamiltonian acts effectively as an element of a direct sum of so(N) Lie algebras, and can therefore be measured using a combination of unitaries in the associated Lie group, Clifford unitaries, and mid-circuit measurements. Application of such Hamiltonians to decomposing molecular electronic Hamiltonians via graph partitioning techniques shows a reduction in the total number of measurements required to estimate the expectation value compared with previously used exactly solvable qubit Hamiltonians.


title: Limitless FaaS: Overcoming serverless functions execution time limits with invoke driven architecture and memory checkpoints

abstract: Function-as-a-Service (FaaS) allows to directly submit function code to a cloud provider without the burden of managing infrastructure resources. Each cloud provider establishes execution time limits to their FaaS offerings, which impose the risk of spending computation time without achieving partial results. In this work, a framework that enables limitless execution time in FaaS, with little to no modifications to the user-provided function code, is presented. After a thorough literature and theoretical framework review, Apache OpenWhisk Actions and the DMCTP checkpoint-and-restore (CR) tool were selected. With these, dependent successive serverless same-function invocations that exploit the persistence of partial results were implemented. The solution was submitted to the FaaSDom benchmark and time metrics were collected. Additionally, the solution was characterized in terms of the Serverless Trilemma. The resultant system, even at this proof-of-concept state, offers a lot of value to companies that rely heavily on serverless architecture.


title: MobileSpeech: A Fast and High-Fidelity Framework for Mobile Zero-Shot Text-to-Speech

abstract: Zero-shot text-to-speech (TTS) has gained significant attention due to its powerful voice cloning capabilities, requiring only a few seconds of unseen speaker voice prompts. However, all previous work has been developed for cloud-based systems. Taking autoregressive models as an example, although these approaches achieve high-fidelity voice cloning, they fall short in terms of inference speed, model size, and robustness. Therefore, we propose MobileSpeech, which is a fast, lightweight, and robust zero-shot text-to-speech system based on mobile devices for the first time. Specifically: 1) leveraging discrete codec, we design a parallel speech mask decoder module called SMD, which incorporates hierarchical information from the speech codec and weight mechanisms across different codec layers during the generation process. Moreover, to bridge the gap between text and speech, we introduce a high-level probabilistic mask that simulates the progression of information flow from less to more during speech generation. 2) For speaker prompts, we extract fine-grained prompt duration from the prompt speech and incorporate text, prompt speech by cross attention in SMD. We demonstrate the effectiveness of MobileSpeech on multilingual datasets at different levels, achieving state-of-the-art results in terms of generating speed and speech quality. MobileSpeech achieves RTF of 0.09 on a single A100 GPU and we have successfully deployed MobileSpeech on mobile devices. Audio samples are available at \url{https://mobilespeech.github.io/} .


title: Fixed-sparsity matrix approximation from matrix-vector products

abstract: We study the problem of approximating a matrix $\mathbf{A}$ with a matrix that has a fixed sparsity pattern (e.g., diagonal, banded, etc.), when $\mathbf{A}$ is accessed only by matrix-vector products. We describe a simple randomized algorithm that returns an approximation with the given sparsity pattern with Frobenius-norm error at most $(1+\varepsilon)$ times the best possible error. When each row of the desired sparsity pattern has at most $s$ nonzero entries, this algorithm requires $O(s/\varepsilon)$ non-adaptive matrix-vector products with $\mathbf{A}$. We also prove a matching lower-bound, showing that, for any sparsity pattern with $\Theta(s)$ nonzeros per row and column, any algorithm achieving $(1+\epsilon)$ approximation requires $\Omega(s/\varepsilon)$ matrix-vector products in the worst case. We thus resolve the matrix-vector product query complexity of the problem up to constant factors, even for the well-studied case of diagonal approximation, for which no previous lower bounds were known.


title: On the thermodynamic limit of two-times measurement entropy production

abstract: We provide a justification, via the thermodynamic limit, of the modular formula for entropy production in two-times measurement proposed in [Benoist, Bruneau, Jak\v{s}i\'c, Panati and Pillet: arxiv:2310.10582]. We consider the cases of open quantum systems in which all thermal reservoirs are either (discrete) quantum spin systems or free Fermi gases.