title: Double-tough and ultra-strong ceramics: leveraging multiscale toughening mechanisms through Bayesian Optimization

abstract: We present an optimization-driven approach to creating a double-tough ceramic material with a brick-and-mortar microstructure, where the mortar is itself transformation-toughened, engineered with the goal of simultaneously achieving high strength and fracture toughness levels. Specifically, we design a material where high-strength alumina bricks are interconnected via a ceria-stabilized zirconia mortar. As the design of such a material, driven by multiscale toughening mechanisms, requires a laborious trial-and-error approach, we propose a Bayesian optimization framework as an integral part of our methodology to streamline and accelerate the design process. We use a Gaussian process to emulate the material's mechanical response and implement a cost-aware batch Bayesian optimization to efficiently identify optimal design process parameters, accounting for the cost of experimentally varying them. This approach expedites the optimization of the material's mechanical properties. As a result, we develop a bio-inspired all-ceramic composite that exhibits an exceptional balance between bending strength (704 MPa), and fracture toughness (13.6 MPa m^0.5).


title: CascadeServe: Unlocking Model Cascades for Inference Serving

abstract: Machine learning (ML) models are increasingly deployed to production, calling for efficient inference serving systems. Efficient inference serving is complicated by two challenges: (i) ML models incur high computational costs, and (ii) the request arrival rates of practical applications have frequent, high, and sudden variations which make it hard to correctly provision hardware. Model cascades are positioned to tackle both of these challenges, as they (i) save work while maintaining accuracy, and (ii) expose a high-resolution trade-off between work and accuracy, allowing for fine-grained adjustments to request arrival rates. Despite their potential, model cascades haven't been used inside an online serving system. This comes with its own set of challenges, including workload adaption, model replication onto hardware, inference scheduling, request batching, and more. In this work, we propose CascadeServe, which automates and optimizes end-to-end inference serving with cascades. CascadeServe operates in an offline and online phase. In the offline phase, the system pre-computes a gear plan that specifies how to serve inferences online. In the online phase, the gear plan allows the system to serve inferences while making near-optimal adaptations to the query load at negligible decision overheads. We find that CascadeServe saves 2-3x in cost across a wide spectrum of the latency-accuracy space when compared to state-of-the-art baselines on different workloads.


title: SynDARin: Synthesising Datasets for Automated Reasoning in Low-Resource Languages

abstract: Question Answering (QA) datasets have been instrumental in developing and evaluating Large Language Model (LLM) capabilities. However, such datasets are scarce for languages other than English due to the cost and difficulties of collection and manual annotation. This means that producing novel models and measuring the performance of multilingual LLMs in low-resource languages is challenging. To mitigate this, we propose $\textbf{S}$yn$\textbf{DAR}$in, a method for generating and validating QA datasets for low-resource languages. We utilize parallel content mining to obtain $\textit{human-curated}$ paragraphs between English and the target language. We use the English data as context to $\textit{generate}$ synthetic multiple-choice (MC) question-answer pairs, which are automatically translated and further validated for quality. Combining these with their designated non-English $\textit{human-curated}$ paragraphs form the final QA dataset. The method allows to maintain the content quality, reduces the likelihood of factual errors, and circumvents the need for costly annotation. To test the method, we created a QA dataset with $1.2$K samples for the Armenian language. The human evaluation shows that $98\%$ of the generated English data maintains quality and diversity in the question types and topics, while the translation validation pipeline can filter out $\sim70\%$ of data with poor quality. We use the dataset to benchmark state-of-the-art LLMs, showing their inability to achieve human accuracy with some model performances closer to random chance. This shows that the generated dataset is non-trivial and can be used to evaluate reasoning capabilities in low-resource language.


title: Transferable Boltzmann Generators

abstract: The generation of equilibrium samples of molecular systems has been a long-standing problem in statistical physics. Boltzmann Generators are a generative machine learning method that addresses this issue by learning a transformation via a normalizing flow from a simple prior distribution to the target Boltzmann distribution of interest. Recently, flow matching has been employed to train Boltzmann Generators for small molecular systems in Cartesian coordinates. We extend this work and propose a first framework for Boltzmann Generators that are transferable across chemical space, such that they predict zero-shot Boltzmann distributions for test molecules without being retrained for these systems. These transferable Boltzmann Generators allow approximate sampling from the target distribution of unseen systems, as well as efficient reweighting to the target Boltzmann distribution. The transferability of the proposed framework is evaluated on dipeptides, where we show that it generalizes efficiently to unseen systems. Furthermore, we demonstrate that our proposed architecture enhances the efficiency of Boltzmann Generators trained on single molecular systems.

categories: stat.ML cs.LG physics.chem-ph physics.comp-ph


title: Control when confidence is costly

abstract: We develop a version of stochastic control that accounts for computational costs of inference. Past studies identified efficient coding without control, or efficient control that neglects the cost of synthesizing information. Here we combine these concepts into a framework where agents rationally approximate inference for efficient control. Specifically, we study Linear Quadratic Gaussian (LQG) control with an added internal cost on the relative precision of the posterior probability over the world state. This creates a trade-off: an agent can obtain more utility overall by sacrificing some task performance, if doing so saves enough bits during inference. We discover that the rational strategy that solves the joint inference and control problem goes through phase transitions depending on the task demands, switching from a costly but optimal inference to a family of suboptimal inferences related by rotation transformations, each misestimate the stability of the world. In all cases, the agent moves more to think less. This work provides a foundation for a new type of rational computations that could be used by both brains and machines for efficient but computationally constrained control.


title: Blow-up for a double nonlocal heat equation

abstract: We study the blow-up question for the diffusion equation involving a nonlocal derivative in time defined by convolution with a nonnegative and nonincreasing kernel, and a nonlocal operator in space driven by a nonnegative radial L\'evy kernel. We show that the existence of solutions that blow up in finite time or exist globally depends only on the behaviour of the spatial kernel at infinity. A main difficulty of the work stems from estimating the fundamental pair defining the solution through a Duhamel formula, due to the generality of the setting, which includes singular or not, at the origin, spatial kernels, that can be either positive or compactly supported. As a byproduct we obtain that the Fujita exponent for the fractional type operators similar to the Caputo fractional derivative and the fractional Laplacian.


title: CollaFuse: Collaborative Diffusion Models

abstract: In the landscape of generative artificial intelligence, diffusion-based models have emerged as a promising method for generating synthetic images. However, the application of diffusion models poses numerous challenges, particularly concerning data availability, computational requirements, and privacy. Traditional approaches to address these shortcomings, like federated learning, often impose significant computational burdens on individual clients, especially those with constrained resources. In response to these challenges, we introduce a novel approach for distributed collaborative diffusion models inspired by split learning. Our approach facilitates collaborative training of diffusion models while alleviating client computational burdens during image synthesis. This reduced computational burden is achieved by retaining data and computationally inexpensive processes locally at each client while outsourcing the computationally expensive processes to shared, more efficient server resources. Through experiments on the common CelebA dataset, our approach demonstrates enhanced privacy by reducing the necessity for sharing raw data. These capabilities hold significant potential across various application areas, including the design of edge computing solutions. Thus, our work advances distributed machine learning by contributing to the evolution of collaborative diffusion models.


title: Adaptive Deep Neural Network-Based Control Barrier Functions

abstract: Safety constraints of nonlinear control systems are commonly enforced through the use of control barrier functions (CBFs). Uncertainties in the dynamic model can disrupt forward invariance guarantees or cause the state to be restricted to an overly conservative subset of the safe set. In this paper, adaptive deep neural networks (DNNs) are combined with CBFs to produce a family of controllers that ensure safety while learning the system's dynamics in real-time without the requirement for pre-training. By basing the least squares adaptation law on a state derivative estimator-based identification error, the DNN parameter estimation error is shown to be uniformly ultimately bounded. The convergent bound on the parameter estimation error is then used to formulate CBF-constraints in an optimization-based controller to guarantee safety despite model uncertainty. Furthermore, the developed method is applicable for use under intermittent loss of state-feedback. Comparative simulation results demonstrate the ability of the developed method to ensure safety in an adaptive cruise control problem and when feedback is lost, unlike baseline methods.


title: Some remarks on a K\"unneth formula for foliated de Rham cohomology

abstract: The K\"unneth formula is one of the basic tools for computing cohomology. Its validity for foliated cohomology, that is, for the tangential de Rham cohomology of a foliated manifold, is investigated. The main difficulty encountered is the non-Hausdorff nature of the foliated cohomology spaces, forbidding the completion of the tensor product. The results presented here are a K\"unneth formula when both factors have Hausdorff foliated cohomology, a K\"unneth formula when one factor has Hausdorff finite-dimensional foliated cohomology and a counterexample to an alternative version of the K\"unneth formula. The proof of the second result involves a right inverse for the foliated de Rham differential.


title: Inverse population genetic problems with noise: inferring extent and structure of haplotype blocks from point allele frequencies

abstract: A haplotype block, or simply a block, is a chromosomal segment, DNA base sequence or string that occurs in only a few variants or types in the genomes of a population of interest, and that has an encapsulated or 'private' frequency distribution of the string types that is not shared by neighbouring blocks or regions on the same chromosome. We consider two inverse problems of genetic interest: from just the frequencies of the symbol types (4 base types, possible single-base alleles) at each position (point, base/nucleotide) along the string, infer the location of the left and right boundaries of the block (block extent), and the number and relative frequencies of the string types occurring in the block (block structure). The large majority of variable positions in human and also other (e.g., fungal) genomes appear to be biallelic, i.e., the position allows only a choice between two possible symbols. The symbols can then be encoded as 0 (major) and 1 (minor), or as $\uparrow$ and $\downarrow$ as in Ising models, so the scenario reduces to problems on Boolean strings/bitstrings and Boolean matrices. The specifying of major allele frequencies (MAF) as used in genetics fits naturally into this framework. A simple example from human chromosome 9 is presented.


title: Structural and Electrical Properties of Grafted Si/GaAsSb Heterojunction

abstract: The short-wave infrared (SWIR) wavelength, especially 1.55 um, has attracted significant attention in various areas such as high-speed optical communication and LiDAR systems. Avalanche photodiodes (APDs) are a critical component as a receiver in these systems due to their internal gain which enhances the system performance. Silicon-based APDs are promising since they are CMOS compatible, but they are limited in detecting 1.55 um light detection. This study proposes a p-type Si on n-type GaAs0.51Sb0.49 (GaAsSb) lattice matched to InP substrates heterojunction formed using a grafting technique for future GaAsSb/Si APD technology. A p+Si nanomembrane is transferred onto the GaAsSb/AlInAs/InP substrate, with an ultrathin ALD-Al2O3 oxide at the interface, which behaves as both double-side passivation and quantum tunneling layers. The devices exhibit excellent surface morphology and interface quality, confirmed by atomic force microscope (AFM) and transmission electron microscope (TEM). Also, the current-voltage (I-V) of the p+Si/n-GaAsSb heterojunction shows ideal rectifying characteristics with an ideality factor of 1.15. The I-V tests across multiple devices confirm high consistency and yield. Furthermore, the X-ray photoelectron spectroscopy (XPS) measurement reveals that GaAsSb and Si are found to have type-II band alignment with a conduction band offset of 50 meV which is favorable for the high-bandwidth APD application. The demonstration of the GaAsSb/Si heterojunction highlights the potential to advance current SWIR PD technologies.


title: Towards Truthful Multilingual Large Language Models: Benchmarking and Alignment Strategies

abstract: In the era of large language models (LLMs), building multilingual large language models (MLLMs) that can serve users worldwide holds great significance. However, existing research seldom focuses on the truthfulness of MLLMs. Meanwhile, contemporary multilingual aligning technologies struggle to balance massive languages and often exhibit serious truthfulness gaps across different languages, especially those that differ greatly from English. In our work, we construct a benchmark for truthfulness evaluation in multilingual scenarios and explore the ways to align facts across languages to enhance the truthfulness of MLLMs. Furthermore, we propose Fact-aware Multilingual Selective Synergy (FaMSS) to optimize the data allocation across a large number of languages and different data types. Experimental results demonstrate that our approach can effectively reduce the multilingual representation disparity and enhance the multilingual capabilities of LLMs.


title: The superconducting clock-circuit: Improving the coherence of Josephson radiation beyond the thermodynamic uncertainty relation

abstract: In the field of superconducting electronics, the on-chip generation of AC radiation is essential for further advancements. Although a Josephson junction can emit AC radiation from a purely DC voltage bias, the coherence of this radiation is significantly limited by Johnson-Nyquist noise. We relate this limitation to the thermodynamic uncertainty relation (TUR) in the field of stochastic thermodynamics. Recent findings indicate that the thermodynamic uncertainty relation can be broken by a classical pendulum clock. We demonstrate how the violation of the TUR can be used as a design principle for radiation sources by showing that a superconducting clock circuit emits coherent AC radiation from a DC bias.


title: Video Generation with Learned Action Prior

abstract: Stochastic video generation is particularly challenging when the camera is mounted on a moving platform, as camera motion interacts with observed image pixels, creating complex spatio-temporal dynamics and making the problem partially observable. Existing methods typically address this by focusing on raw pixel-level image reconstruction without explicitly modelling camera motion dynamics. We propose a solution by considering camera motion or action as part of the observed image state, modelling both image and action within a multi-modal learning framework. We introduce three models: Video Generation with Learning Action Prior (VG-LeAP) treats the image-action pair as an augmented state generated from a single latent stochastic process and uses variational inference to learn the image-action latent prior; Causal-LeAP, which establishes a causal relationship between action and the observed image frame at time $t$, learning an action prior conditioned on the observed image states; and RAFI, which integrates the augmented image-action state concept into flow matching with diffusion generative processes, demonstrating that this action-conditioned image generation concept can be extended to other diffusion-based models. We emphasize the importance of multi-modal training in partially observable video generation problems through detailed empirical studies on our new video action dataset, RoAM.


title: Complex Dark Photon Dark Matter EFT

abstract: We construct an effective field theory for complex Stueckelberg dark photon dark matter. Such an effective construction can be realized by writing down a complete set of operators up to dimension six built with the complex dark photon and Standard Model fields. Classifying the effective operators, we find that in order to properly take into account the non-renormalizable nature of an interacting massive vector, the size of the Wilson coefficients should be naturally smaller than naively expected. This can be consistently taken into account by a proper power counting, that we suggest. First we apply this to collider bounds on light dark matter, then to direct detection searches by extending the list of non-relativistic operators to include the case of complex vectors. In the former we correctly find scaling limits for small masses, while in the latter we mostly focus on electric dipole interactions, that are the smoking gun of this type of dark matter. Simple UV completions that effectively realize the above scenarios are also outlined.


title: Cycle conjectures and birational invariants over finite fields

abstract: We study a natural birational invariant for varieties over finite fields and show that its vanishing on projective space is equivalent to the Tate conjecture, the Beilinson conjecture, and the Grothendieck--Serre semi-simplicity conjecture for all smooth projective varieties over finite fields. We further show that the Tate, Beilinson, and 1-semi-simplicity conjecture in half of the degrees implies those conjectures in all degrees.


title: Invariant rings of the special orthogonal group have nonunimodal $h$-vectors

abstract: For $K$ an infinite field of characteristic other than two, consider the action of the special orthogonal group $\operatorname{SO}_t(K)$ on a polynomial ring via copies of the regular representation. When $K$ has characteristic zero, Boutot's theorem implies that the invariant ring has rational singularities; when $K$ has positive characteristic, the invariant ring is $F$-regular, as proven by Hashimoto using good filtrations. We give a new proof of this, viewing the invariant ring for $\operatorname{SO}_t(K)$ as a cyclic cover of the invariant ring for the corresponding orthogonal group; this point of view has a number of useful consequences, for example it readily yields the $a$-invariant and information on the Hilbert series. Indeed, we use this to show that the $h$-vector of the invariant ring for $\operatorname{SO}_t(K)$ need not be unimodal.


title: LLM4CP: Adapting Large Language Models for Channel Prediction

abstract: Channel prediction is an effective approach for reducing the feedback or estimation overhead in massive multi-input multi-output (m-MIMO) systems. However, existing channel prediction methods lack precision due to model mismatch errors or network generalization issues. Large language models (LLMs) have demonstrated powerful modeling and generalization abilities, and have been successfully applied to cross-modal tasks, including the time series analysis. Leveraging the expressive power of LLMs, we propose a pre-trained LLM-empowered channel prediction method (LLM4CP) to predict the future downlink channel state information (CSI) sequence based on the historical uplink CSI sequence. We fine-tune the network while freezing most of the parameters of the pre-trained LLM for better cross-modality knowledge transfer. To bridge the gap between the channel data and the feature space of the LLM, preprocessor, embedding, and output modules are specifically tailored by taking into account unique channel characteristics. Simulations validate that the proposed method achieves SOTA prediction performance on full-sample, few-shot, and generalization tests with low training and inference costs.


title: Vahana.jl -- A framework (not only) for large-scale agent-based models

abstract: Agent-based models (ABMs) offer a powerful framework for understanding complex systems. However, their computational demands often become a significant barrier as the number of agents and complexity of the simulation increase. Traditional ABM platforms often struggle to fully exploit modern computing resources, hindering the development of large-scale simulations. This paper presents Vahana.jl, a high performance computing open source framework that aims to address these limitations. Building on the formalism of synchronous graph dynamical systems, Vahana.jl is especially well suited for models with a focus on (social) networks. The framework seamlessly supports distribution across multiple compute nodes, enabling simulations that would otherwise be beyond the capabilities of a single machine. Implemented in Julia, Vahana.jl leverages the interactive Read-Eval-Print Loop (REPL) environment, facilitating rapid model development and experimentation.


title: Graph Representation Learning Strategies for Omics Data: A Case Study on Parkinson's Disease

abstract: Omics data analysis is crucial for studying complex diseases, but its high dimensionality and heterogeneity challenge classical statistical and machine learning methods. Graph neural networks have emerged as promising alternatives, yet the optimal strategies for their design and optimization in real-world biomedical challenges remain unclear. This study evaluates various graph representation learning models for case-control classification using high-throughput biological data from Parkinson's disease and control samples. We compare topologies derived from sample similarity networks and molecular interaction networks, including protein-protein and metabolite-metabolite interactions (PPI, MMI). Graph Convolutional Network (GCNs), Chebyshev spectral graph convolution (ChebyNet), and Graph Attention Network (GAT), are evaluated alongside advanced architectures like graph transformers, the graph U-net, and simpler models like multilayer perceptron (MLP). These models are systematically applied to transcriptomics and metabolomics data independently. Our comparative analysis highlights the benefits and limitations of various architectures in extracting patterns from omics data, paving the way for more accurate and interpretable models in biomedical research.


title: Thin Film Synthesis, Structural Analysis, and Magnetic Properties of Novel Ternary Transition Metal Nitride MnCoN2

abstract: Recent high-throughput computational searches have predicted many novel ternary nitride compounds providing new opportunities for materials discovery in under explored phase spaces. Nevertheless, there are hardly any predictions and/or syntheses that incorporate only transition metals into new ternary nitrides. Here, we report on the synthesis, structure, and properties of MnCoN$_2$, a new ternary nitride material comprising only transition metals and N. We find that crystalline MnCoN$_2$ can be stabilized over its competing binaries, and over a tendency of this system to become amorphous, by controlling growth temperature within a narrow window slightly above ambient condition. We find that single-phase MnCoN$_2$ thin films form in a cation-disordered rocksalt crystal structure, which is supported by ab-initio calculations. X-ray photoelectron spectroscopy analysis suggests that MnCoN$_2$ is sensitive to oxygen through various oxides and hydroxides binding to cobalt on the surface. X-ray absorption spectroscopy is used to verify that Mn$^{3+}$ and Co$^{3+}$ cations exist in an octahedrally-coordinated environment, which is distinct from a combination of CoN and MnN binaries and in agreement with the rocksalt-based crystal structure prediction. Magnetic measurements suggest that MnCoN$_2$ has a canted antiferromagnetic ground state below 10 K. We extract a Weiss temperature of $\theta$ = -49.7 K, highlighting the antiferromagnetic correlations in MnCoN$_2$.


title: Combining reference-star and angular differential imaging for high-contrast imaging of extended sources

abstract: High-contrast imaging (HCI) is a technique designed to observe faint signals near bright sources, such as exoplanets and circumstellar disks. The primary challenge in revealing the faint circumstellar signal near a star is the presence of quasi-static speckles, which can produce patterns on the science images that are as bright, or even brighter, than the signal of interest. Strategies such as angular differential imaging (ADI) or reference-star differential imaging (RDI) aim to provide a means of removing the quasi-static speckles in post-processing. In this paper, we present and discuss the adaptation of state-of-the-art algorithms, initially designed for ADI, to jointly leverage angular and reference-star differential imaging (ARDI) for direct high-contrast imaging of circumstellar disks. Using a collection of high-contrast imaging data sets, we assess the performance of ARDI in comparison to ADI and RDI based on iterative principal component analysis (IPCA). These diverse data sets are acquired under various observing conditions and include the injection of synthetic disk models at various contrast levels. Our results demonstrate that ARDI with IPCA improves the quality of recovered disk images and the sensitivity to planets embedded in disks, compared to ADI or RDI individually. This enhancement is particularly pronounced when dealing with extended sources exhibiting highly ambiguous structures that cannot be accurately retrieved using ADI alone, and when the quality of the reference frames is suboptimal, leading to an underperformance of RDI. We finally apply our method to a sample of real observations of protoplanetary disks taken in star-hopping mode, and propose to revisit the protoplanetary claims associated with these disks.


title: High-threshold, low-overhead and single-shot decodable fault-tolerant quantum memory

abstract: We present a new family of quantum low-density parity-check codes, which we call radial codes, obtained from the lifted product of a specific subset of classical quasi-cyclic codes. The codes are defined using a pair of integers $(r,s)$ and have parameters $[\![2r^2s,2(r-1)^2,\leq2s]\!]$, with numerical studies suggesting average-case distance linear in $s$. In simulations of circuit-level noise, we observe comparable error suppression to surface codes of similar distance while using approximately five times fewer physical qubits. This is true even when radial codes are decoded using a single-shot approach, which can allow for faster logical clock speeds and reduced decoding complexity. We describe an intuitive visual representation, canonical basis of logical operators and optimal-length stabiliser measurement circuits for these codes, and argue that their error correction capabilities, tunable parameters and small size make them promising candidates for implementation on near-term quantum devices.


title: Maintenance Required: Updating and Extending Bootstrapped Human Activity Recognition Systems for Smart Homes

abstract: Developing human activity recognition (HAR) systems for smart homes is not straightforward due to varied layouts of the homes and their personalized settings, as well as idiosyncratic behaviors of residents. As such, off-the-shelf HAR systems are effective in limited capacity for an individual home, and HAR systems often need to be derived "from scratch", which comes with substantial efforts and often is burdensome to the resident. Previous work has successfully targeted the initial phase. At the end of this initial phase, we identify seed points. We build on bootstrapped HAR systems and introduce an effective updating and extension procedure for continuous improvement of HAR systems with the aim of keeping up with ever changing life circumstances. Our method makes use of the seed points identified at the end of the initial bootstrapping phase. A contrastive learning framework is trained using these seed points and labels obtained for the same. This model is then used to improve the segmentation accuracy of the identified prominent activities. Improvements in the activity recognition system through this procedure help model the majority of the routine activities in the smart home. We demonstrate the effectiveness of our procedure through experiments on the CASAS datasets that show the practical value of our approach.


title: Pursuing Coxeter theory for Kac-Moody affine Hecke algebras

abstract: The Kac-Moody affine Hecke algebra $\mathcal{H}$ was first constructed as the Iwahori-Hecke algebra of a $p$-adic Kac-Moody group by work of Braverman, Kazhdan, and Patnaik, and by work of Bardy-Panse, Gaussent, and Rousseau. Since $\mathcal{H}$ has a Bernstein presentation, for affine types it is a positive-level variation of Cherednik's double affine Hecke algebra. Moreover, as $\mathcal{H}$ is realized as a convolution algebra, it has an additional "$T$-basis" corresponding to indicator functions of double cosets. For classical affine Hecke algebras, this $T$-basis reflects the Coxeter group structure of the affine Weyl group. In the Kac-Moody affine context, the indexing set $W_{\mathcal{T}}$ for the $T$-basis is no longer a Coxeter group. Nonetheless, $W_{\mathcal{T}}$ carries some Coxeter-like structures: a Bruhat order, a length function, and a notion of inversion sets. This paper contains the first steps toward a Coxeter theory for Kac-Moody affine Hecke algebras. We prove three results. The first is a construction of the length function via a representation of $\mathcal{H}$. The second concerns the support of products in classical affine Hecke algebras. The third is a characterization of length deficits in the Kac-Moody affine setting via inversion sets. Using this characterization, we phrase our support theorem as a precise conjecture for Kac-Moody affine Hecke algebras. Lastly, we give a conjectural definition of a Kac-Moody affine Demazure product via the $q=0$ specialization of $\mathcal{H}$.


title: Polarisation-insensitive state preparation for trapped-ion hyperfine qubits

abstract: Quantum state preparation for trapped-ion qubits often relies on high-quality circularly-polarised light, which may be difficult to achieve with chip-based integrated optics technology. We propose and implement a hybrid optical/microwave scheme for intermediate-field hyperfine qubits which instead relies on frequency selectivity. Experimentally, we achieve $99.94\%$ fidelity for linearly-polarised ($\sigma^+$/$\sigma^-$) light, using $^{43}$Ca$^+$ at 28.8 mT. We find that the fidelity remains above $99.8\%$ for a mixture of all polarisations ($\sigma^+$/$\sigma^-$/$\pi$). We calculate that the method is capable of $99.99\%$ fidelity in $^{43}$Ca$^+$, and even higher fidelities in heavier ions such as $^\text{137}$Ba$^\text{+}$.


title: APEER: Automatic Prompt Engineering Enhances Large Language Model Reranking

abstract: Large Language Models (LLMs) have significantly enhanced Information Retrieval (IR) across various modules, such as reranking. Despite impressive performance, current zero-shot relevance ranking with LLMs heavily relies on human prompt engineering. Existing automatic prompt engineering algorithms primarily focus on language modeling and classification tasks, leaving the domain of IR, particularly reranking, underexplored. Directly applying current prompt engineering algorithms to relevance ranking is challenging due to the integration of query and long passage pairs in the input, where the ranking complexity surpasses classification tasks. To reduce human effort and unlock the potential of prompt optimization in reranking, we introduce a novel automatic prompt engineering algorithm named APEER. APEER iteratively generates refined prompts through feedback and preference optimization. Extensive experiments with four LLMs and ten datasets demonstrate the substantial performance improvement of APEER over existing state-of-the-art (SoTA) manual prompts. Furthermore, we find that the prompts generated by APEER exhibit better transferability across diverse tasks and LLMs. Code is available at https://github.com/jincan333/APEER.


title: Hydrodynamics of Relativistic Superheated Bubbles

abstract: Relativistic, charged, superheated bubbles may play an important role in neutron star mergers if first-order phase transitions are present in the phase diagram of Quantum Chromodynamics. We describe the properties of these bubbles in the hydrodynamic regime. We find two qualitative differences with supercooled bubbles. First, the pressure inside an expanding superheated bubble can be higher or lower than the pressure outside the bubble. Second, some fluid flows develop metastable regions behind the bubble wall. We consider the possible role of a conserved charge akin to baryon number. The fluid flow profiles are unaffected by this charge if the speed of sound is constant in each phase, but they are modified for more general equations of state. We compute the efficiency factor relevant for gravitational wave production.


title: Gradient Estimation via Differentiable Metropolis-Hastings

abstract: Metropolis-Hastings estimates intractable expectations - can differentiating the algorithm estimate their gradients? The challenge is that Metropolis-Hastings trajectories are not conventionally differentiable due to the discrete accept/reject steps. Using a technique based on recoupling chains, our method differentiates through the Metropolis-Hastings sampler itself, allowing us to estimate gradients with respect to a parameter of otherwise intractable expectations. Our main contribution is a proof of strong consistency and a central limit theorem for our estimator under assumptions that hold in common Bayesian inference problems. The proofs augment the sampler chain with latent information, and formulate the estimator as a stopping tail functional of this augmented chain. We demonstrate our method on examples of Bayesian sensitivity analysis and optimizing a random walk Metropolis proposal.


title: Science in a Blink: Supporting Ensemble Perception in Scalar Fields

abstract: Visualizations support rapid analysis of scientific datasets, allowing viewers to glean aggregate information (e.g., the mean) within split-seconds. While prior research has explored this ability in conventional charts, it is unclear if spatial visualizations used by computational scientists afford a similar ensemble perception capacity. We investigate people's ability to estimate two summary statistics, mean and variance, from pseudocolor scalar fields. In a crowdsourced experiment, we find that participants can reliably characterize both statistics, although variance discrimination requires a much stronger signal. Multi-hue and diverging colormaps outperformed monochromatic, luminance ramps in aiding this extraction. Analysis of qualitative responses suggests that participants often estimate the distribution of hotspots and valleys as visual proxies for data statistics. These findings suggest that people's summary interpretation of spatial datasets is likely driven by the appearance of discrete color segments, rather than assessments of overall luminance. Implicit color segmentation in quantitative displays could thus prove more useful than previously assumed by facilitating quick, gist-level judgments about color-coded visualizations.


title: The Effective Number of Parameters in Kernel Density Estimation

abstract: The quest for a formula that satisfactorily measures the effective degrees of freedom in kernel density estimation (KDE) is a long standing problem with few solutions. Starting from the orthogonal polynomial sequence (OPS) expansion for the ratio of the empirical to the oracle density, we show how convolution with the kernel leads to a new OPS with respect to which one may express the resulting KDE. The expansion coefficients of the two OPS systems can then be related via a kernel sensitivity matrix, and this then naturally leads to a definition of effective parameters by taking the trace of a symmetrized positive semi-definite normalized version. The resulting effective degrees of freedom (EDoF) formula is an oracle-based quantity; the first ever proposed in the literature. Asymptotic properties of the empirical EDoF are worked out through influence functions. Numerical investigations confirm the theoretical insights.


title: Collective description of low energy mesonic states

abstract: The phenomenology of hadronic states at high energy is well described in the framework of Quantum Chromodynamics. The theory, well established by now, cannot be applied to the description of quark-antiquark states at low energy unless their degrees of freedom are treated as effective ones, a condition resulting from confinement. Own to the similarities with other quantum many-body systems we have adopted a non-perturbative scheme where quarks are treated as quasiparticles, which further interact between them, allowing meson-like states to be described as collective superposition of quasiparticle-pairs. The results of the calculations, performed in the context of the random phase approximation method, show that this scheme is a suitable one to describe meson states up to energies of the order of couple of GeV.


title: MM-GTUNets: Unified Multi-Modal Graph Deep Learning for Brain Disorders Prediction

abstract: Graph deep learning (GDL) has demonstrated impressive performance in predicting population-based brain disorders (BDs) through the integration of both imaging and non-imaging data. However, the effectiveness of GDL based methods heavily depends on the quality of modeling the multi-modal population graphs and tends to degrade as the graph scale increases. Furthermore, these methods often constrain interactions between imaging and non-imaging data to node-edge interactions within the graph, overlooking complex inter-modal correlations, leading to suboptimal outcomes. To overcome these challenges, we propose MM-GTUNets, an end-to-end graph transformer based multi-modal graph deep learning (MMGDL) framework designed for brain disorders prediction at large scale. Specifically, to effectively leverage rich multi-modal information related to diseases, we introduce Modality Reward Representation Learning (MRRL) which adaptively constructs population graphs using a reward system. Additionally, we employ variational autoencoder to reconstruct latent representations of non-imaging features aligned with imaging features. Based on this, we propose Adaptive Cross-Modal Graph Learning (ACMGL), which captures critical modality-specific and modality-shared features through a unified GTUNet encoder taking advantages of Graph UNet and Graph Transformer, and feature fusion module. We validated our method on two public multi-modal datasets ABIDE and ADHD-200, demonstrating its superior performance in diagnosing BDs. Our code is available at https://github.com/NZWANG/MM-GTUNets.


title: Capturing Temporal Components for Time Series Classification

abstract: Analyzing sequential data is crucial in many domains, particularly due to the abundance of data collected from the Internet of Things paradigm. Time series classification, the task of categorizing sequential data, has gained prominence, with machine learning approaches demonstrating remarkable performance on public benchmark datasets. However, progress has primarily been in designing architectures for learning representations from raw data at fixed (or ideal) time scales, which can fail to generalize to longer sequences. This work introduces a \textit{compositional representation learning} approach trained on statistically coherent components extracted from sequential data. Based on a multi-scale change space, an unsupervised approach is proposed to segment the sequential data into chunks with similar statistical properties. A sequence-based encoder model is trained in a multi-task setting to learn compositional representations from these temporal components for time series classification. We demonstrate its effectiveness through extensive experiments on publicly available time series classification benchmarks. Evaluating the coherence of segmented components shows its competitive performance on the unsupervised segmentation task.


title: Rewarding What Matters: Step-by-Step Reinforcement Learning for Task-Oriented Dialogue

abstract: Reinforcement learning (RL) is a powerful approach to enhance task-oriented dialogue (TOD) systems. However, existing RL methods tend to mainly focus on generation tasks, such as dialogue policy learning (DPL) or response generation (RG), while neglecting dialogue state tracking (DST) for understanding. This narrow focus limits the systems to achieve globally optimal performance by overlooking the interdependence between understanding and generation. Additionally, RL methods face challenges with sparse and delayed rewards, which complicates training and optimization. To address these issues, we extend RL into both understanding and generation tasks by introducing step-by-step rewards throughout the token generation. The understanding reward increases as more slots are correctly filled in DST, while the generation reward grows with the accurate inclusion of user requests. Our approach provides a balanced optimization aligned with task completion. Experimental results demonstrate that our approach effectively enhances the performance of TOD systems and achieves new state-of-the-art results on three widely used datasets, including MultiWOZ2.0, MultiWOZ2.1, and In-Car. Our approach also shows superior few-shot ability in low-resource settings compared to current models.


title: Centimeter Positioning Accuracy using AI/ML for 6G Applications

abstract: This research looks at using AI/ML to achieve centimeter-level user positioning in 6G applications such as the Industrial Internet of Things (IIoT). Initial results show that our AI/ML-based method can estimate user positions with an accuracy of 17 cm in an indoor factory environment. In this proposal, we highlight our approaches and future directions.


title: Healing Powers of BERT: How Task-Specific Fine-Tuning Recovers Corrupted Language Models

abstract: Language models like BERT excel at sentence classification tasks due to extensive pre-training on general data, but their robustness to parameter corruption is unexplored. To understand this better, we look at what happens if a language model is "broken", in the sense that some of its parameters are corrupted and then recovered by fine-tuning. Strategically corrupting BERT variants at different levels, we find corrupted models struggle to fully recover their original performance, with higher corruption causing more severe degradation. Notably, bottom-layer corruption affecting fundamental linguistic features is more detrimental than top-layer corruption. Our insights contribute to understanding language model robustness and adaptability under adverse conditions, informing strategies for developing resilient NLP systems against parameter perturbations.


title: Podcast Outcasts: Understanding Rumble's Podcast Dynamics

abstract: Podcasting on Rumble, an alternative video-sharing platform, attracts controversial figures known for spreading divisive and often misleading content, which sharply contrasts with YouTube's more regulated environment. Motivated by the growing impact of podcasts on political discourse, as seen with figures like Joe Rogan and Andrew Tate, this paper explores the political biases and content strategies used by these platforms. In this paper, we conduct a comprehensive analysis of over 13K podcast videos from both YouTube and Rumble, focusing on their political content and the dynamics of their audiences. Using advanced speech-to-text transcription, topic modeling, and contrastive learning techniques, we explore three critical aspects: the presence of political bias in podcast channels, the nature of content that drives podcast views, and the usage of visual elements in these podcasts. Our findings reveal a distinct right-wing orientation in Rumble's podcasts, contrasting with YouTube's more diverse and apolitical content.


title: Generation of many-body entanglement by collective coupling of atom pairs to cavity photons

abstract: The generation of many-body entangled states in atomic samples should be fast, as this process always involves a subtle interplay between desired quantum effects and unwanted decoherence. Here we identify a controllable and scalable catalyst that allows metrologically useful entangled states to be generated at a high rate. This is achieved by immersing a collection of bosonic atoms, trapped in a double-well potential, in an optical cavity. In the dispersive regime, cavity photons collectively couple pairs of atoms in their ground state to a molecular state, effectively generating, photon-number dependent atom-atom interactions. These effective interactions entangle atoms at a rate that strongly scales with both the number of photons and the number of atoms. As a consequence, the characteristic time scale of entanglement formation can be much shorter than for bare atom-atom interactions, effectively eliminating the decoherence due to photon losses. Here, the control of the entanglement generation rate does not require the use of Feshbach resonances, where magnetic field fluctuations can contribute to decoherence. Our protocol may find applications in future quantum sensors or other systems where controllable and scalable many-body entanglement is desired.


title: Explicit and Implicit Large Language Model Personas Generate Opinions but Fail to Replicate Deeper Perceptions and Biases

abstract: Large language models (LLMs) are increasingly being used in human-centered social scientific tasks, such as data annotation, synthetic data creation, and engaging in dialog. However, these tasks are highly subjective and dependent on human factors, such as one's environment, attitudes, beliefs, and lived experiences. Thus, employing LLMs (which do not have such human factors) in these tasks may result in a lack of variation in data, failing to reflect the diversity of human experiences. In this paper, we examine the role of prompting LLMs with human-like personas and asking the models to answer as if they were a specific human. This is done explicitly, with exact demographics, political beliefs, and lived experiences, or implicitly via names prevalent in specific populations. The LLM personas are then evaluated via (1) subjective annotation task (e.g., detecting toxicity) and (2) a belief generation task, where both tasks are known to vary across human factors. We examine the impact of explicit vs. implicit personas and investigate which human factors LLMs recognize and respond to. Results show that LLM personas show mixed results when reproducing known human biases, but generate generally fail to demonstrate implicit biases. We conclude that LLMs lack the intrinsic cognitive mechanisms of human thought, while capturing the statistical patterns of how people speak, which may restrict their effectiveness in complex social science applications.


title: Hydrodynamic-like behaviour of glasma

abstract: At the earliest stage of ultrarelativistic heavy-ion collisions the produced matter is a highly populated system of gluons called glasma which can be approximately described in terms of classical chromodynamic fields. Although the system's dynamics is governed by Yang-Mills equations, glasma evolution is shown to strongly resemble hydrodynamic behaviour.


title: A Review of Common Online Speaker Diarization Methods

abstract: Speaker diarization provides the answer to the question "who spoke when?" for an audio file. This information can be used to complete audio transcripts for further processing steps. Most speaker diarization systems assume that the audio file is available as a whole. However, there are scenarios in which the speaker labels are needed immediately after the arrival of an audio segment. Speaker diarization with a correspondingly low latency is referred to as online speaker diarization. This paper provides an overview. First the history of online speaker diarization is briefly presented. Next a taxonomy and datasets for training and evaluation are given. In the sections that follow, online diarization methods and systems are discussed in detail. This paper concludes with the presentation of challenges that still need to be solved by future research in the field of online speaker diarization.


title: AC conductivity and magnetic dichroism of two-dimensional antiferromagnetic Dirac semimetals

abstract: We investigate the magneto-optical properties of two-dimensional nonsymmorphic Dirac semimetals in the presence of antiferromagnetic order. Using the Kubo formula, we calculate the conductivity tensor of two-dimensional CuMnAs, a prototype antiferromagnetic Dirac material, as a function of light frequency. From the finite-frequency conductivity tensor, we derive the dynamic dielectric function and magnetic linear dichroism, demonstrating how they are influenced by the orientation of the N{\'e}el order parameter. Adjusting the N{\'e}el vector changes both the sign and amplitude of the system's magneto-optical response. We propose that magnetic linear dichroism spectroscopy is a powerful technique for determining the orientation of the N{\'e}el vector.


title: The Radius of the High Mass Pulsar PSR J0740+6620 With 3.6 Years of NICER Data

abstract: We report an updated analysis of the radius, mass, and heated surface regions of the massive pulsar PSR J0740+6620 using NICER data from 2018 September 21 to 2022 April 21, a substantial increase in data set size compared to previous analyses. Using a tight mass prior from radio timing measurements and jointly modeling the new NICER data with XMM-Newton data, the inferred equatorial radius and gravitational mass are $12.49_{-0.88}^{+1.28}$ km and $2.073_{-0.069}^{+0.069}$ $M_\odot$ respectively, each reported as the posterior credible interval bounded by the $16\,\%$ and $84\,\%$ quantiles, with an estimated systematic error $\lesssim 0.1$ km. This result was obtained using the best computationally feasible sampler settings providing a strong radius lower limit but a slightly more uncertain radius upper limit. The inferred radius interval is also close to the $R=12.76_{-1.02}^{+1.49}$ km obtained by Dittmann et al. 2024, when they require the radius to be less than $16$ km as we do. The results continue to disfavor very soft equations of state for dense matter, with $R<11.15$ km for this high mass pulsar excluded at the $95\,\%$ probability. The results do not depend significantly on the assumed cross-calibration uncertainty between NICER and XMM-Newton. Using simulated data that resemble the actual observations, we also show that our pipeline is capable of recovering parameters for the inferred models reported in this paper.


title: A More Precise Measurement of the Radius of PSR J0740+6620 Using Updated NICER Data

abstract: PSR J0740+6620 is the neutron star with the highest precisely determined mass, inferred from radio observations to be $2.08\pm0.07\,\rm M_\odot$. Measurements of its radius therefore hold promise to constrain the properties of the cold, catalyzed, high-density matter in neutron star cores. Previously, Miller et al. (2021) and Riley et al. (2021) reported measurements of the radius of PSR J0740+6620 based on Neutron Star Interior Composition Explorer (NICER) observations accumulated through 17 April 2020, and an exploratory analysis utilizing NICER background estimates and a data set accumulated through 28 December 2021 was presented in Salmi et al. (2022). Here we report an updated radius measurement, derived by fitting models of X-ray emission from the neutron star surface to NICER data accumulated through 21 April 2022, totaling $\sim1.1$ Ms additional exposure compared to the data set analyzed in Miller et al. (2021) and Riley et al. (2021), and to data from X-ray Multi-Mirror (XMM-Newton) observations. We find that the equatorial circumferential radius of PSR J0740+6620 is $12.92_{-1.13}^{+2.09}$ km (68% credibility), a fractional uncertainty $\sim83\%$ the width of that reported in Miller et al. (2021), in line with statistical expectations given the additional data. If we were to require the radius to be less than 16 km, as was done in Salmi et al. (2024), then our 68% credible region would become $R=12.76^{+1.49}_{-1.02}$ km, which is close to the headline result of Salmi et al. (2024). Our updated measurements, along with other laboratory and astrophysical constraints, imply a slightly softer equation of state than that inferred from our previous measurements.


title: On $k$-uniform tight cycles: the Ramsey number for $C_{kn}^{(k)}$ and an approximate Lehel's conjecture

abstract: A $k$-uniform tight cycle is a $k$-graph with a cyclic ordering of its vertices such that its edges are precisely the sets of $k$ consecutive vertices in that ordering. We show that, for each $k \geq 3$, the Ramsey number of the $k$-uniform tight cycle on $kn$ vertices is $(1+o(1))(k+1)n$. This is an extension to all uniformities of previous results for $k = 3$ by Haxell, {\L}uczak, Peng, R\"odl, Ruci\'nski, and Skokan and for $k = 4$ by Lo and the author and confirms a special case of a conjecture by the former set of authors. Lehel's conjecture, which was proved by Bessy and Thomass\'e, states that every red-blue edge-coloured complete graph contains a red cycle and a blue cycle that are vertex-disjoint and together cover all the vertices. We also prove an approximate version of this for $k$-uniform tight cycles. We show that, for every $k \geq 3$, every red-blue edge-coloured complete $k$-graph on $n$ vertices contains a red tight cycle and a blue tight cycle that are vertex-disjoint and together cover $n - o(n)$ vertices.


title: Fusion of Movement and Naive Predictions for Point Forecasting in Univariate Random Walks

abstract: Traditional methods for point forecasting in univariate random walks often fail to surpass naive benchmarks due to data unpredictability. This study introduces a novel forecasting method that fuses movement prediction (binary classification) with naive forecasts for accurate one-step-ahead point forecasting. The method's efficacy is demonstrated through theoretical analysis, simulations, and real-world data experiments. It reliably exceeds naive forecasts with movement prediction accuracies as low as 0.55, outperforming baseline models like ARIMA, linear regression, MLP, and LSTM networks in forecasting the S\&P 500 index and Bitcoin prices. This method is particularly advantageous when accurate point predictions are challenging but accurate movement predictions are attainable, translating movement predictions into point forecasts in random walk contexts.


title: Model-driven realization of IDTA submodel specifications: The good, the bad, the incompatible?

abstract: Asset Administration Shells are trending in Industry 4.0. In February 2024, the Industrial Digital Twin Association announced 84 and released 18 AAS submodel specifications. As an enabler on programming level, dedicated APIs are needed, for which, at this level of scale, automated creation is desirable. In this paper, we present a model-driven approach, which transforms extracted information from IDTA specifications into an intermediary meta-model and, from there, generates API code and tests. We show we can process all current IDTA specifications successfully leading in total to more than 50000 lines of code. However, syntactical variations and issues in the specifications impose obstacles that require human intervention or AI support. We also discuss experiences that we made and lessons learned.


title: Sharp Estimates for the Optimal Matching Problem on the 2-Torus

abstract: In this paper, we prove sharp estimates for the average cost of the optimal matching problem on the flat 2-torus, using quantitative linearization and the method of trajectories.


title: Self-supervised Multi-actor Social Activity Understanding in Streaming Videos

abstract: This work addresses the problem of Social Activity Recognition (SAR), a critical component in real-world tasks like surveillance and assistive robotics. Unlike traditional event understanding approaches, SAR necessitates modeling individual actors' appearance and motions and contextualizing them within their social interactions. Traditional action localization methods fall short due to their single-actor, single-action assumption. Previous SAR research has relied heavily on densely annotated data, but privacy concerns limit their applicability in real-world settings. In this work, we propose a self-supervised approach based on multi-actor predictive learning for SAR in streaming videos. Using a visual-semantic graph structure, we model social interactions, enabling relational reasoning for robust performance with minimal labeled data. The proposed framework achieves competitive performance on standard group activity recognition benchmarks. Evaluation on three publicly available action localization benchmarks demonstrates its generalizability to arbitrary action localization.


title: Data-Centric AI in the Age of Large Language Models

abstract: This position paper proposes a data-centric viewpoint of AI research, focusing on large language models (LLMs). We start by making the key observation that data is instrumental in the developmental (e.g., pretraining and fine-tuning) and inferential stages (e.g., in-context learning) of LLMs, and yet it receives disproportionally low attention from the research community. We identify four specific scenarios centered around data, covering data-centric benchmarks and data curation, data attribution, knowledge transfer, and inference contextualization. In each scenario, we underscore the importance of data, highlight promising research directions, and articulate the potential impacts on the research community and, where applicable, the society as a whole. For instance, we advocate for a suite of data-centric benchmarks tailored to the scale and complexity of data for LLMs. These benchmarks can be used to develop new data curation methods and document research efforts and results, which can help promote openness and transparency in AI and LLM research.


title: Spatio-temporal Patterns between ENSO and Weather-related Power Outages in the Continental United States

abstract: El Ni\~no-Southern Oscillation (ENSO) exhibits significant impacts on the frequency of extreme weather events and its socio-economic implications prevail on a global scale. However, a fundamental gap still exists in understanding the relationship between the ENSO and weather-related power outages in the continental United States. Through 24-year (2000-2023) composite and statistical analysis, our study reveals that higher power outage numbers (PONs) are observed from the developing winter to the decaying summer of La Ni\~na phases. In particular, during the decaying spring, high La Ni\~na intensity favors the occurrences of power outage over the west coast and east of the United States, by modulating the frequency of extreme precipitations and heatwaves. Furthermore, projected increasing heatwaves from the Coupled Model Intercomparison Project Phase 6 (CMIP6) indicate that spring-time PONs over the eastern United States occur about 11 times higher for the mid-term future (2041-2060) and almost 26 times higher for the long-term future (2081-2100), compared with 2000-2023. Our study provides a strong recommendation for building a more climate-resilient power system.


title: The feasibility of weak lensing and 21cm intensity mapping cross-correlation measurements

abstract: One of the most promising probes to complement current standard cosmological surveys is the HI intensity map, i.e. the distribution of temperature fluctuations in neutral hydrogen. In this paper we present calculations of the 2-point function between HI (at redshift $z$ < 1) and lensing convergence ($\kappa$). We also construct HI intensity maps from N-body simulations, and measure 2-point functions between HI and lensing convergence. HI intensity mapping requires stringent removal of bright foregrounds, including emission from our galaxy. The removal of large-scale radial modes during this HI foreground removal will reduce the HI-lensing cross-power spectrum signal, as radial modes are integrated to find the convergence; here we wish to characterise this reduction in signal. We find that after a simple model of foreground removal, the cross-correlation signal is reduced by $\sim$50-70\%; we present the angular and redshift dependence of the effect, which is a weak function of these variables. We then calculate S/N of $\kappa$HI detection, including cases with cut sky observations, and noise from radio and lensing measurements. We present Fisher forecasts based on the resulting 2-point functions; these forecasts show that by measuring $\kappa\Delta$$T_\mathrm{HI}$ correlation functions in a sufficient number of redshift bins, constraints on cosmology and HI bias will be possible


title: Learning telic-controllable state representations

abstract: Computational accounts of purposeful behavior consist of descriptive and normative aspects. The former enable agents to ascertain the current (or future) state of affairs in the world and the latter to evaluate the desirability, or lack thereof, of these states with respect to the agent's goals. In Reinforcement Learning, the normative aspect (reward and value functions) is assumed to depend on a pre-defined and fixed descriptive one (state representation). Alternatively, these two aspects may emerge interdependently: goals can be, and indeed often are, expressed in terms of state representation features, but they may also serve to shape state representations themselves. Here, we illustrate a novel theoretical framing of state representation learning in bounded agents, coupling descriptive and normative aspects via the notion of goal-directed, or telic, states. We define a new controllability property of telic state representations to characterize the tradeoff between their granularity and the policy complexity capacity required to reach all telic states. We propose an algorithm for learning controllable state representations and demonstrate it using a simple navigation task with changing goals. Our framework highlights the crucial role of deliberate ignorance - knowing what to ignore - for learning state representations that are both goal-flexible and simple. More broadly, our work provides a concrete step towards a unified theoretical view of natural and artificial learning through the lens of goals.


title: SafeSora: Towards Safety Alignment of Text2Video Generation via a Human Preference Dataset

abstract: To mitigate the risk of harmful outputs from large vision models (LVMs), we introduce the SafeSora dataset to promote research on aligning text-to-video generation with human values. This dataset encompasses human preferences in text-to-video generation tasks along two primary dimensions: helpfulness and harmlessness. To capture in-depth human preferences and facilitate structured reasoning by crowdworkers, we subdivide helpfulness into 4 sub-dimensions and harmlessness into 12 sub-categories, serving as the basis for pilot annotations. The SafeSora dataset includes 14,711 unique prompts, 57,333 unique videos generated by 4 distinct LVMs, and 51,691 pairs of preference annotations labeled by humans. We further demonstrate the utility of the SafeSora dataset through several applications, including training the text-video moderation model and aligning LVMs with human preference by fine-tuning a prompt augmentation module or the diffusion model. These applications highlight its potential as the foundation for text-to-video alignment research, such as human preference modeling and the development and validation of alignment algorithms.


title: Toward data-driven research: preliminary study to predict surface roughness in material extrusion using previously published data with Machine Learning

abstract: Material extrusion is one of the most commonly used approaches within the additive manufacturing processes available. Despite its popularity and related technical advancements, process reliability and quality assurance remain only partially solved. In particular, the surface roughness caused by this process is a key concern. To solve this constraint, experimental plans have been exploited to optimize surface roughness in recent years. However, the latter empirical trial and error process is extremely time- and resource-consuming. Thus, this study aims to avoid using large experimental programs to optimize surface roughness in material extrusion. Methodology. This research provides an in-depth analysis of the effect of several printing parameters: layer height, printing temperature, printing speed and wall thickness. The proposed data-driven predictive modeling approach takes advantage of Machine Learning models to automatically predict surface roughness based on the data gathered from the literature and the experimental data generated for testing. Findings. Using 10-fold cross-validation of data gathered from the literature, the proposed Machine Learning solution attains a 0.93 correlation with a mean absolute percentage error of 13 %. When testing with our own data, the correlation diminishes to 0.79 and the mean absolute percentage error reduces to 8 %. Thus, the solution for predicting surface roughness in extrusion-based printing offers competitive results regarding the variability of the analyzed factors. Originality. As available manufacturing data continue to increase on a daily basis, the ability to learn from these large volumes of data is critical in future manufacturing and science. Specifically, the power of Machine Learning helps model surface roughness with limited experimental tests.


title: On Layer-wise Representation Similarity: Application for Multi-Exit Models with a Single Classifier

abstract: Analyzing the similarity of internal representations within and across different models has been an important technique for understanding the behavior of deep neural networks. Most existing methods for analyzing the similarity between representations of high dimensions, such as those based on Canonical Correlation Analysis (CCA) and widely used Centered Kernel Alignment (CKA), rely on statistical properties of the representations for a set of data points. In this paper, we focus on transformer models and study the similarity of representations between the hidden layers of individual transformers. In this context, we show that a simple sample-wise cosine similarity metric is capable of capturing the similarity and aligns with the complicated CKA. Our experimental results on common transformers reveal that representations across layers are positively correlated, albeit the similarity decreases when layers are far apart. We then propose an aligned training approach to enhance the similarity between internal representations, with trained models that enjoy the following properties: (1) the last-layer classifier can be directly applied right after any hidden layers, yielding intermediate layer accuracies much higher than those under standard training, (2) the layer-wise accuracies monotonically increase and reveal the minimal depth needed for the given task, (3) when served as multi-exit models, they achieve on-par performance with standard multi-exit architectures which consist of additional classifiers designed for early exiting in shallow layers. To our knowledge, our work is the first to show that one common classifier is sufficient for multi-exit models. We conduct experiments on both vision and NLP tasks to demonstrate the performance of the proposed aligned training.


title: $P$ & $m_e$

abstract: Curiously in the minimal left right symmetric model, chiral ($\chi$) symmetry that protects the electron's mass ($m_e$), due to parity (P) implies the vanishing of its neutrino mixing angles. We break the $\chi$ symmetry to generate the observed neutrino mixing which causes the electron to acquire its mass on RGE running, and in turn determines the B-L gauge symmetry breaking scale ($v_R$) to be $10^{10} GeV \lesssim v_R \leq 10^{15} GeV $ (and with fine-tuning can be at $10 TeV$ scale). If the muon's mass is also generated radiatively, the B-L breaking scale is $\sim 10^{14-15}$ GeV. Regardless of how the high scale $v_R$ is, this is a testable model for obtaining the mass of the electron (and muon), since on RGE running and P breaking, a large strong CP phase ($\bar{\theta} >> 10^{-10}$) which depends logarithmically on $v_R$ is generated if there is O(1) CP violation in leptonic Yukawa couplings. Hence we expect that leptonic CP phases including the Dirac CP phase $\delta_{CP}$ of the PMNS matrix must be consistent with $0$ or $180^o$ to within a degree, which can be verified or excluded by neutrino experiments such as DUNE and Hyper-Kamiokande. In lieu of P, if charge conjugation C is used, the same results follow. However with C and no P, axions would likely need to be added anyway, in which case there is no constraint on $\delta_{CP}$.


title: Revealing Vision-Language Integration in the Brain with Multimodal Networks

abstract: We use (multi)modal deep neural networks (DNNs) to probe for sites of multimodal integration in the human brain by predicting stereoencephalography (SEEG) recordings taken while human subjects watched movies. We operationalize sites of multimodal integration as regions where a multimodal vision-language model predicts recordings better than unimodal language, unimodal vision, or linearly-integrated language-vision models. Our target DNN models span different architectures (e.g., convolutional networks and transformers) and multimodal training techniques (e.g., cross-attention and contrastive learning). As a key enabling step, we first demonstrate that trained vision and language models systematically outperform their randomly initialized counterparts in their ability to predict SEEG signals. We then compare unimodal and multimodal models against one another. Because our target DNN models often have different architectures, number of parameters, and training sets (possibly obscuring those differences attributable to integration), we carry out a controlled comparison of two models (SLIP and SimCLR), which keep all of these attributes the same aside from input modality. Using this approach, we identify a sizable number of neural sites (on average 141 out of 1090 total sites or 12.94%) and brain regions where multimodal integration seems to occur. Additionally, we find that among the variants of multimodal training techniques we assess, CLIP-style training is the best suited for downstream prediction of the neural activity in these sites.


title: Visible-Thermal Tiny Object Detection: A Benchmark Dataset and Baselines

abstract: Small object detection (SOD) has been a longstanding yet challenging task for decades, with numerous datasets and algorithms being developed. However, they mainly focus on either visible or thermal modality, while visible-thermal (RGBT) bimodality is rarely explored. Although some RGBT datasets have been developed recently, the insufficient quantity, limited category, misaligned images and large target size cannot provide an impartial benchmark to evaluate multi-category visible-thermal small object detection (RGBT SOD) algorithms. In this paper, we build the first large-scale benchmark with high diversity for RGBT SOD (namely RGBT-Tiny), including 115 paired sequences, 93K frames and 1.2M manual annotations. RGBT-Tiny contains abundant targets (7 categories) and high-diversity scenes (8 types that cover different illumination and density variations). Note that, over 81% of targets are smaller than 16x16, and we provide paired bounding box annotations with tracking ID to offer an extremely challenging benchmark with wide-range applications, such as RGBT fusion, detection and tracking. In addition, we propose a scale adaptive fitness (SAFit) measure that exhibits high robustness on both small and large targets. The proposed SAFit can provide reasonable performance evaluation and promote detection performance. Based on the proposed RGBT-Tiny dataset and SAFit measure, extensive evaluations have been conducted, including 23 recent state-of-the-art algorithms that cover four different types (i.e., visible generic detection, visible SOD, thermal SOD and RGBT object detection). Project is available at https://github.com/XinyiYing24/RGBT-Tiny.


title: Valid Error Bars for Neural Weather Models using Conformal Prediction

abstract: Neural weather models have shown immense potential as inexpensive and accurate alternatives to physics-based models. However, most models trained to perform weather forecasting do not quantify the uncertainty associated with their forecasts. This limits the trust in the model and the usefulness of the forecasts. In this work we construct and formalise a conformal prediction framework as a post-processing method for estimating this uncertainty. The method is model-agnostic and gives calibrated error bounds for all variables, lead times and spatial locations. No modifications are required to the model and the computational cost is negligible compared to model training. We demonstrate the usefulness of the conformal prediction framework on a limited area neural weather model for the Nordic region. We further explore the advantages of the framework for deterministic and probabilistic models.


title: A two-dimensional optomechanical crystal for quantum transduction

abstract: Integrated optomechanical systems are one of the leading platforms for manipulating, sensing, and distributing quantum information. The temperature increase due to residual optical absorption sets the ultimate limit on performance for these applications. In this work, we demonstrate a two-dimensional optomechanical crystal geometry, named \textbf{b-dagger}, that alleviates this problem through increased thermal anchoring to the surrounding material. Our mechanical mode operates at 7.4 GHz, well within the operation range of standard cryogenic microwave hardware and piezoelectric transducers. The enhanced thermalization combined with the large optomechanical coupling rates, $g_0/2\pi \approx 880~\mathrm{kHz}$, and high optical quality factors, $Q_\text{opt} = 2.4 \times 10^5$, enables the ground-state cooling of the acoustic mode to phononic occupancies as low as $n_\text{m} = 0.35$ from an initial temperature of 3 kelvin, as well as entering the optomechanical strong-coupling regime. Finally, we perform pulsed sideband asymmetry of our devices at a temperature below 10 millikelvin and demonstrate ground-state operation ($n_\text{m} < 0.45$) for repetition rates as high as 3 MHz. Our results extend the boundaries of optomechanical system capabilities and establish a robust foundation for the next generation of microwave-to-optical transducers with entanglement rates overcoming the decoherence rates of state-of-the-art superconducting qubits.


title: Proceedings of The second international workshop on eXplainable AI for the Arts (XAIxArts)

abstract: This second international workshop on explainable AI for the Arts (XAIxArts) brought together a community of researchers in HCI, Interaction Design, AI, explainable AI (XAI), and digital arts to explore the role of XAI for the Arts. Workshop held at the 16th ACM Conference on Creativity and Cognition (C&C 2024), Chicago, USA.


title: Rule-based outlier detection of AI-generated anatomy segmentations

abstract: There is a dire need for medical imaging datasets with accompanying annotations to perform downstream patient analysis. However, it is difficult to manually generate these annotations, due to the time-consuming nature, and the variability in clinical conventions. Artificial intelligence has been adopted in the field as a potential method to annotate these large datasets, however, a lack of expert annotations or ground truth can inhibit the adoption of these annotations. We recently made a dataset publicly available including annotations and extracted features of up to 104 organs for the National Lung Screening Trial using the TotalSegmentator method. However, the released dataset does not include expert-derived annotations or an assessment of the accuracy of the segmentations, limiting its usefulness. We propose the development of heuristics to assess the quality of the segmentations, providing methods to measure the consistency of the annotations and a comparison of results to the literature. We make our code and related materials publicly available at https://github.com/ImagingDataCommons/CloudSegmentatorResults and interactive tools at https://huggingface.co/spaces/ImagingDataCommons/CloudSegmentatorResults.


title: Dynamical properties of critical exponent functions

abstract: An error in the statement and proof of Theorem 7 in [D.Corona, A. Della Corte. The critical exponent functions. Comptes Rendus Math\'ematique, 360(G4), 315-332, 2024] has been identified. The theorem was used to prove analytical and dynamical properties of a class of interval maps there introduced, called the critical exponent functions. We show here that most of the properties of these maps established in [D.Corona, A. Della Corte. The critical exponent functions. Comptes Rendus Math\'ematique, 360(G4), 315-332, 2024] can be recovered with minor adjustments. Moreover, we propose as a conjecture a weaker form of Theorem 7.


title: Multi-epoch X-ray spectral analysis of Centaurus A: revealing new constraints on iron emission line origins

abstract: We conduct X-ray reverberation mapping and spectral analysis of the radio galaxy Centaurus A to uncover its central structure. We compare the light curve of the hard X-ray continuum from Swift Burst Alert Telescope observations with that of the Fe K$\alpha$ fluorescence line, derived from the Nuclear Spectroscopic Telescope Array (NuSTAR), Suzaku, XMM-Newton, and Swift X-ray Telescope observations. The analysis of the light curves suggests that a top-hat transfer function, commonly employed in reverberation mapping studies, is improbable. Instead, the relation between these light curves can be described by a transfer function featuring two components: one with a lag of $0.19_{- 0.02}^{+ 0.10}~\mathrm{pc}/c$, and another originating at $r > 1.7~\mathrm{pc}$ that produces an almost constant light curve. Further, we analyze the four-epoch NuSTAR and six-epoch Suzaku spectra, considering the time lag of the reflection component relative to the primary continuum. This spectral analysis supports that the reflecting material is Compton-thin, with $N_{\mathrm{H}} = 3.14_{-0.74}^{+0.44} \times 10^{23}~ \mathrm{cm}^{-2}$. These results suggest that the Fe K$\alpha$ emission may originate from Compton-thin circumnuclear material located at sub-parsec scale, likely a dust torus, and materials at a greater distance.


title: A Fuzzy Logic-Based Quality Model For Identifying Microservices With Low Maintainability

abstract: Microservice Architecture (MSA) is a popular architectural style that offers many advantages regarding quality attributes, including maintainability and scalability. Developing a system as a set of microservices with expected benefits requires a quality assessment strategy that is established on the measurements of the system's properties. This paper proposes a hierarchical quality model based on fuzzy logic to measure and evaluate the maintainability of MSAs considering ISO/IEC 250xy SQuaRE (System and Software Quality Requirements and Evaluation) standards. Since the qualitative bounds of low-level quality attributes are inherently ambiguous, we use a fuzzification technique to transform crisp values of code metrics into fuzzy levels and apply them as inputs to our quality model. The model generates fuzzy values for the quality sub-characteristics of the maintainability, i.e., modifiability and testability, converted to numerical values through defuzzification. In the last step, using the values of the sub-characteristics, we calculate numerical scores indicating the maintainability level of each microservice in the examined software system. This score was used to assess the quality of the microservices and decide whether they need refactoring. We evaluated our approach by creating a test set with the assistance of three developers, who reviewed and categorized the maintainability levels of the microservices in an open-source project based on their knowledge and experience. They labeled microservices as low, medium, or high, with low indicating the need for refactoring. Our method for identifying low-labeled microservices in the given test set achieved 94% accuracy, 78% precision, and 100% recall. These results indicate that our approach can assist designers in evaluating the maintainability quality of microservices.


title: One point functions in large $N$ vector models at finite chemical potential

abstract: We evaluate the thermal one point function of higher spin currents in the critical model of $U(N)$ complex scalars interacting with a quartic potential and the $U(N)$ Gross-Neveu model of Dirac fermions at large $N$ and strong coupling using the Euclidean inversion formula. These models are considered in odd space time dimensions $d$ and held at finite temperature and finite real chemical potential $\mu$ measured in units of the temperature. We show that these one point functions simplify both at large spin and large $d$. At large spin, the one point functions behave as though the theory is free, the chemical potential appears through a simple pre-factor which is either $\cosh\mu$ or $\sinh\mu$ depending on whether the spin is even or odd. At large $d$, but at finite spin and chemical potential, the 1-point functions are suppressed exponentially in $d$ compared to the free theory. We study a fixed point of the critical Gross-Neveu model in $d=3$ with 1-point functions exhibiting a branch cut in the chemical potential plane. The critical exponent for the free energy or the pressure at the branch point is $3/2$ which coincides with the mean field exponent of the Lee-Yang edge singularity for repulsive core interactions.


title: Instruction Pre-Training: Language Models are Supervised Multitask Learners

abstract: Unsupervised multitask pre-training has been the critical method behind the recent success of language models (LMs). However, supervised multitask learning still holds significant promise, as scaling it in the post-training stage trends towards better generalization. In this paper, we explore supervised multitask pre-training by proposing Instruction Pre-Training, a framework that scalably augments massive raw corpora with instruction-response pairs to pre-train LMs. The instruction-response pairs are generated by an efficient instruction synthesizer built on open-source models. In our experiments, we synthesize 200M instruction-response pairs covering 40+ task categories to verify the effectiveness of Instruction Pre-Training. In pre-training from scratch, Instruction Pre-Training not only consistently enhances pre-trained base models but also benefits more from further instruction tuning. In continual pre-training, Instruction Pre-Training enables Llama3-8B to be comparable to or even outperform Llama3-70B. Our model, code, and data are available at https://github.com/microsoft/LMOps.


title: Does Object Grounding Really Reduce Hallucination of Large Vision-Language Models?

abstract: Large vision-language models (LVLMs) have recently dramatically pushed the state of the art in image captioning and many image understanding tasks (e.g., visual question answering). LVLMs, however, often \textit{hallucinate} and produce captions that mention concepts that cannot be found in the image. These hallucinations erode the trustworthiness of LVLMs and are arguably among the main obstacles to their ubiquitous adoption. Recent work suggests that addition of grounding objectives -- those that explicitly align image regions or objects to text spans -- reduces the amount of LVLM hallucination. Although intuitive, this claim is not empirically justified as the reduction effects have been established, we argue, with flawed evaluation protocols that (i) rely on data (i.e., MSCOCO) that has been extensively used in LVLM training and (ii) measure hallucination via question answering rather than open-ended caption generation. In this work, in contrast, we offer the first systematic analysis of the effect of fine-grained object grounding on LVLM hallucination under an evaluation protocol that more realistically captures LVLM hallucination in open generation. Our extensive experiments over three backbone LLMs reveal that grounding objectives have little to no effect on object hallucination in open caption generation.


title: On the modular Plesken Lie algebra

abstract: Let G be a finite group. The Plesken Lie algebra L[G] is a subalgebra of the complex group algebra C[G] and admits a direct-sum decomposition into simple Lie algebras based on the ordinary character theory of G. In this paper we review the known results on L[G] and related Lie algebras, as well as introduce a conjecture on a characteristic p analog L_p[G], with a focus on when p divides the order of G.


title: Teaching Software Metrology: The Science of Measurement for Software Engineering

abstract: While the methodological rigor of computing research has improved considerably in the past two decades, quantitative software engineering research is hampered by immature measures and inattention to theory. Measurement-the principled assignment of numbers to phenomena-is intrinsically difficult because observation is predicated upon not only theoretical concepts but also the values and perspective of the research. Despite several previous attempts to raise awareness of more sophisticated approaches to measurement and the importance of quantitatively assessing reliability and validity, measurement issues continue to be widely ignored. The reasons are unknown, but differences in typical engineering and computer science graduate training programs (compared to psychology and management, for example) are involved. This chapter therefore reviews key concepts in the science of measurement and applies them to software engineering research. A series of exercises for applying important measurement concepts to the reader's research are included, and a sample dataset for the reader to try some of the statistical procedures mentioned is provided.


title: rKAN: Rational Kolmogorov-Arnold Networks

abstract: The development of Kolmogorov-Arnold networks (KANs) marks a significant shift from traditional multi-layer perceptrons in deep learning. Initially, KANs employed B-spline curves as their primary basis function, but their inherent complexity posed implementation challenges. Consequently, researchers have explored alternative basis functions such as Wavelets, Polynomials, and Fractional functions. In this research, we explore the use of rational functions as a novel basis function for KANs. We propose two different approaches based on Pade approximation and rational Jacobi functions as trainable basis functions, establishing the rational KAN (rKAN). We then evaluate rKAN's performance in various deep learning and physics-informed tasks to demonstrate its practicality and effectiveness in function approximation.


title: African or European Swallow? Benchmarking Large Vision-Language Models for Fine-Grained Object Classification

abstract: Recent Large Vision-Language Models (LVLMs) demonstrate impressive abilities on numerous image understanding and reasoning tasks. The task of fine-grained object classification (e.g., distinction between \textit{animal species}), however, has been probed insufficiently, despite its downstream importance. We fill this evaluation gap by creating \texttt{FOCI} (\textbf{F}ine-grained \textbf{O}bject \textbf{C}lass\textbf{I}fication), a difficult multiple-choice benchmark for fine-grained object classification, from existing object classification datasets: (1) multiple-choice avoids ambiguous answers associated with casting classification as open-ended QA task; (2) we retain classification difficulty by mining negative labels with a CLIP model. \texttt{FOCI}\xspace complements five popular classification datasets with four domain-specific subsets from ImageNet-21k. We benchmark 12 public LVLMs on \texttt{FOCI} and show that it tests for a \textit{complementary skill} to established image understanding and reasoning benchmarks. Crucially, CLIP models exhibit dramatically better performance than LVLMs. Since the image encoders of LVLMs come from these CLIP models, this points to inadequate alignment for fine-grained object distinction between the encoder and the LLM and warrants (pre)training data with more fine-grained annotation. We release our code at \url{https://github.com/gregor-ge/FOCI-Benchmark}.


title: CodeRAG-Bench: Can Retrieval Augment Code Generation?

abstract: While language models (LMs) have proven remarkably adept at generating code, many programs are challenging for LMs to generate using their parametric knowledge alone. Providing external contexts such as library documentation can facilitate generating accurate and functional code. Despite the success of retrieval-augmented generation (RAG) in various text-oriented tasks, its potential for improving code generation remains under-explored. In this work, we conduct a systematic, large-scale analysis by asking: in what scenarios can retrieval benefit code generation models? and what challenges remain? We first curate a comprehensive evaluation benchmark, CodeRAG-Bench, encompassing three categories of code generation tasks, including basic programming, open-domain, and repository-level problems. We aggregate documents from five sources for models to retrieve contexts: competition solutions, online tutorials, library documentation, StackOverflow posts, and GitHub repositories. We examine top-performing models on CodeRAG-Bench by providing contexts retrieved from one or multiple sources. While notable gains are made in final code generation by retrieving high-quality contexts across various settings, our analysis reveals room for improvement -- current retrievers still struggle to fetch useful contexts especially with limited lexical overlap, and generators fail to improve with limited context lengths or abilities to integrate additional contexts. We hope CodeRAG-Bench serves as an effective testbed to encourage further development of advanced code-oriented RAG methods.


title: LLaSA: Large Multimodal Agent for Human Activity Analysis Through Wearable Sensors

abstract: Integrating inertial measurement units (IMUs) with large language models (LLMs) advances multimodal AI by enhancing human activity understanding. We introduce SensorCaps, a dataset of 26,288 IMU-derived activity narrations, and OpenSQA, an instruction-following dataset with 257,562 question-answer pairs. Combining LIMU-BERT and Llama, we develop LLaSA, a Large Multimodal Agent capable of interpreting and responding to activity and motion analysis queries. Our evaluation demonstrates LLaSA's effectiveness in activity classification and question answering, highlighting its potential in healthcare, sports science, and human-computer interaction. These contributions advance sensor-aware language models and open new research avenues. Our code repository and datasets can be found on https://github.com/BASHLab/LLaSA.


title: Finite Groups of Symplectic Automorphisms of Supersingular K3 surfaces in Odd Characteristics

abstract: In 2009, Dolgachev-Keum classify finite groups of tame symplectic automorphisms of K3 surfaces in positive characteristics. They show all such groups are subgroups of the Mathieu group of degree 23. In this paper, we utilize lattice-theoretic methods to investigate symplectic actions of finite groups G on K3 surfaces in odd characteristics. In the tame cases (i.e., the order of G is coprime with p) and all the superspecial cases, one can associate with the action a Leech pair which can be detected via H\"ohn-Mason's list. Notice that the superspecial case has been recently resolved by Ohashi-Sch\"utt. If the K3 surface is supersingular with Artin invariant at least two, we develop a new machinery called p-root pairs to detect possible symplectic finite group actions (without the assumption of tameness). The concept of p-root pair is closely related to root systems and Weyl groups. In particular, we recover many results by Dolgachev-Keum with a different method and give an upper bound for the exponent of p in |G|.


title: Improving Expert Radiology Report Summarization by Prompting Large Language Models with a Layperson Summary

abstract: Radiology report summarization (RRS) is crucial for patient care, requiring concise "Impressions" from detailed "Findings." This paper introduces a novel prompting strategy to enhance RRS by first generating a layperson summary. This approach normalizes key observations and simplifies complex information using non-expert communication techniques inspired by doctor-patient interactions. Combined with few-shot in-context learning, this method improves the model's ability to link general terms to specific findings. We evaluate this approach on the MIMIC-CXR, CheXpert, and MIMIC-III datasets, benchmarking it against 7B/8B parameter state-of-the-art open-source large language models (LLMs) like Meta-Llama-3-8B-Instruct. Our results demonstrate improvements in summarization accuracy and accessibility, particularly in out-of-domain tests, with improvements as high as 5% for some metrics.


title: Quantum limits of superconducting-photonic links and their extension to mm-waves

abstract: Photonic addressing of superconducting circuits has been proposed to overcome wiring complexity and heat load challenges, but superconducting-photonic links suffer from an efficiency-noise trade-off that limits scalability. This trade-off arises because increasing power conversion efficiency requires reducing optical power, which makes the converted signal susceptible to shot noise. We analyze this trade-off and find the infidelity of qubit gates driven by photonic signals scales inversely with the number of photons used, and therefore the power efficiency of the converter. While methods like nonlinear detection or squeezed light could mitigate this effect, we consider generating higher frequency electrical signals, such as millimeter-waves (100 GHz), using laser light. At these higher frequencies, circuits have higher operating temperatures and cooling power budgets. We demonstrate an optically-driven cryogenic millimeter-wave source with a power efficiency of $10^{-4}$ that can generate ${1}~\mathrm{\mu W}$ of RF power at 80 GHz with 1500 thermal photons of added noise at 4 K. Using this source, we perform frequency-domain spectroscopy of superconducting NbTiN resonators at 80-90 GHz. Our results show a promising approach to alleviate the efficiency-noise constraints on optically-driven superconducting circuits while leveraging the benefits of photonic signal delivery. Further optimization of power efficiency and noise at high frequencies could make photonic control of superconducting qubits viable at temperatures exceeding 1 kelvin.


title: High Bulk Modulus Pentamodes: the Three-Dimensional Metal Water

abstract: Despite significant advances in the field of phononic crystals, the development of acoustic metafluids that replicate the behaviour of liquids in three dimensions remains elusive. For instance, water - the quintessential pentamode (PM) material - has a bulk modulus two orders of magnitude higher than current state-of-the-art PMs. The need for a low shear modulus inherently conflicts with the desire of high bulk modulus and density. In this letter, we shed light on the limitations of existing PM geometries and propose an innovative shape for the links that constitute the network. Inspired by the kinematics of ropes, these links are constructed from thin fibres and demonstrate the potential to create PMs with properties akin to those of liquids. As a prime example, we present the design of the first metamaterial that fully deserves the name 3D metal water, since its acoustic properties in the low frequency regime are indistinguishable with water. Additionally, we highlight a shear band gap in the lattice dispersion diagram, and illustrate the influence of geometric parameters on the dynamic properties at higher frequencies. This novel design of metafluids holds promise for applications requiring anisotropic materials such as acoustic lenses, waveguides, and cloaks.