title: A General Identification Algorithm For Data Fusion Problems Under Systematic Selection

abstract: Causal inference is made challenging by confounding, selection bias, and other complications. A common approach to addressing these difficulties is the inclusion of auxiliary data on the superpopulation of interest. Such data may measure a different set of variables, or be obtained under different experimental conditions than the primary dataset. Analysis based on multiple datasets must carefully account for similarities between datasets, while appropriately accounting for differences. In addition, selection of experimental units into different datasets may be systematic; similar difficulties are encountered in missing data problems. Existing methods for combining datasets either do not consider this issue, or assume simple selection mechanisms. In this paper, we provide a general approach, based on graphical causal models, for causal inference from data on the same superpopulation that is obtained under different experimental conditions. Our framework allows both arbitrary unobserved confounding, and arbitrary selection processes into different experimental regimes in our data. We describe how systematic selection processes may be organized into a hierarchy similar to censoring processes in missing data: selected completely at random (SCAR), selected at random (SAR), and selected not at random (SNAR). In addition, we provide a general identification algorithm for interventional distributions in this setting.


title: Physics of acceptors in GaN: Koopmans tuned HSE hybrid functional calculations and experiment

abstract: The Heyd-Scuseria-Ernzerhof (HSE) hybrid functional has become a widely used tool for theoretical calculations of point defects in semiconductors. It generally offers a satisfactory qualitative description of defect properties, including the donor/acceptor nature of defects, lowest energy charge states, thermodynamic and optical transition levels, Franck-Condon shifts, photoluminescence (PL) band shapes, and carrier capture cross sections. However, there are noticeable quantitative discrepancies in these properties when compared to experimental results. Some of these discrepancies arise from the presence of self-interaction in various parametrizations of the HSE. Other errors are due to the use of the periodic boundary conditions. In this study, we demonstrate that the error corrections scheme based on extrapolation to the dilute limit effectively eliminates the errors due to artificial electrostatic interactions of periodic images and interactions due to the defect state delocalization. This yields parametrizations of HSE that satisfy the generalized Koopmans' condition, essentially eliminating self-interaction from defect state orbitals. We apply this HSE Koopmans tuning individually to a range of cation site acceptors in GaN (Be\textsubscript{Ga}, Mg\textsubscript{Ga}, Zn\textsubscript{Ga}, Ca\textsubscript{Ga}, Cd\textsubscript{Ga}, and Hg\textsubscript{Ga}) and compare the HSE results with experimental data from PL spectra. The Koopmans-compliant HSE calculations show a significantly improved quantitative agreement with the experiment.


title: Resource Management in RIS-Assisted Rate Splitting Multiple Access for Next Generation (xG) Wireless Communications: Models, State-of-the-Art, and Future Directions

abstract: Next generation wireless networks require more stringent performance levels. New technologies such as Reconfigurable intelligent surfaces (RISs) and rate-splitting multiple access (RSMA) are candidates for meeting some of the performance requirements, including higher user rates at reduced costs. RSMA provides a new way of mixing the messages of multiple users, and the RIS provides a controllable wireless environment. This paper provides a comprehensive survey on the various aspects of the synergy between reconfigurable intelligent surfaces (RISs) and rate splitting multiple access (RSMA) for next-generation (xG) wireless communications systems. In particular, the paper studies more than 60 articles considering over 20 different system models where the RIS-aided RSMA system shows performance advantage (in terms of sum-rate or outage probability) over traditional RSMA models. These models include reflective RIS, simultaneously transmitting and reflecting surfaces (STAR-RIS), as well as transmissive surfaces. The state-of-the-art resource management methods for RIS-assisted RSMA communications employ traditional optimization techniques and/or machine learning techniques. We outline major research challenges and multiple future research directions.


title: RoadBEV: Road Surface Reconstruction in Bird's Eye View

abstract: Road surface conditions, especially geometry profiles, enormously affect driving performance of autonomous vehicles. Vision-based online road reconstruction promisingly captures road information in advance. Existing solutions like monocular depth estimation and stereo matching suffer from modest performance. The recent technique of Bird's-Eye-View (BEV) perception provides immense potential to more reliable and accurate reconstruction. This paper uniformly proposes two simple yet effective models for road elevation reconstruction in BEV named RoadBEV-mono and RoadBEV-stereo, which estimate road elevation with monocular and stereo images, respectively. The former directly fits elevation values based on voxel features queried from image view, while the latter efficiently recognizes road elevation patterns based on BEV volume representing discrepancy between left and right voxel features. Insightful analyses reveal their consistence and difference with perspective view. Experiments on real-world dataset verify the models' effectiveness and superiority. Elevation errors of RoadBEV-mono and RoadBEV-stereo achieve 1.83cm and 0.50cm, respectively. The estimation performance improves by 50\% in BEV based on monocular image. Our models are promising for practical applications, providing valuable references for vision-based BEV perception in autonomous driving. The code is released at https://github.com/ztsrxh/RoadBEV.


title: Internal Lagrangians and spatial-gauge symmetries

abstract: A direct reformulation of the Hamiltonian formalism in terms of the intrinsic geometry of infinitely prolonged differential equations is obtained. Concepts of spatial equation and spatial-gauge symmetry of a Lagrangian system of equations are introduced. A non-covariant canonical variational principle is proposed and demonstrated using the Maxwell equations as an example. A covariant canonical variational principle is formulated. The results obtained are applicable to any variational equations, including those that do not originate in physics.


title: An isoperimetric inequality for the first Robin-Dirichlet eigenvalue of the Laplacian

abstract: In this paper, we study the first eigenvalue of the Laplacian on doubly connected domains when Robin and Dirichlet conditions are imposed on the outer and the inner part of the boundary, respectively. We provide that the spherical shell reaches the maximum of the first eigenvalue of this problem among the domains with fixed measure, outer perimeter and inner $(n-1)^{th}$ quermassintegral.


title: A Family of Slow Exact $k$-Nim Games

abstract: Slow Exact $k$-Nim is a variant of the well-known game of Nim. The rules of this variant are that in each move, $k$ of the $n$ stacks are selected and then one token is removed from each of the $k$ stacks. We will extend known results by proving results on the structure of the P-positions for the infinite family of Slow Exact $k$-Nim games where we play on all but one of the $n$ stacks. In addition, we will introduce a more general family of "slow" Nim variants, Slow SetNim($n$,$A$) which specifies the allowed moves via the set $A$. This family of games contains both Slow Exact $k$-Nim and the slow version of Moore's $k$-Nim. We give results for the infinite family of Slow SetNim($n$,$A$) for $A=\{n-1,n\}$, whose P-positions are closely related to those of Slow Exact $k$-Nim for $k=n-1$.


title: GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigation

abstract: The Embodied AI community has made significant strides in visual navigation tasks, exploring targets from 3D coordinates, objects, language descriptions, and images. However, these navigation models often handle only a single input modality as the target. With the progress achieved so far, it is time to move towards universal navigation models capable of handling various goal types, enabling more effective user interaction with robots. To facilitate this goal, we propose GOAT-Bench, a benchmark for the universal navigation task referred to as GO to AnyThing (GOAT). In this task, the agent is directed to navigate to a sequence of targets specified by the category name, language description, or image in an open-vocabulary fashion. We benchmark monolithic RL and modular methods on the GOAT task, analyzing their performance across modalities, the role of explicit and implicit scene memories, their robustness to noise in goal specifications, and the impact of memory in lifelong scenarios.


title: Localizations of the category of $A_\infty$ categories and internal Homs over a ring

abstract: We show that, over an arbitrary commutative ring, the localizations of the categories of dg categories, of unital and of strictly unital $A_\infty$ categories with respect to the corresponding classes of quasi-equivalences are all equivalent. The same result is also proved at the $\infty$-categorical level in the strictly unital case. As an application, we provide a new proof of the existence of internal Homs for the homotopy category of dg categories in terms of the category of unital $A_\infty$ functors, thus yielding a complete proof of a claim by Kontsevich and Keller.


title: Modeling social interaction dynamics using temporal graph networks

abstract: Integrating intelligent systems, such as robots, into dynamic group settings poses challenges due to the mutual influence of human behaviors and internal states. A robust representation of social interaction dynamics is essential for effective human-robot collaboration. Existing approaches often narrow their focus to facial expressions or speech, overlooking the broader context. We propose employing an adapted Temporal Graph Networks to comprehensively represent social interaction dynamics while enabling its practical implementation. Our method incorporates temporal multi-modal behavioral data including gaze interaction, voice activity and environmental context. This representation of social interaction dynamics is trained as a link prediction problem using annotated gaze interaction data. The F1-score outperformed the baseline model by 37.0%. This improvement is consistent for a secondary task of next speaker prediction which achieves an improvement of 29.0%. Our contributions are two-fold, including a model to representing social interaction dynamics which can be used for many downstream human-robot interaction tasks like human state inference and next speaker prediction. More importantly, this is achieved using a more concise yet efficient message passing method, significantly reducing it from 768 to 14 elements, while outperforming the baseline model.


title: Small fluctuations for time-dependent spherical random fields

abstract: We consider time-dependent space isotropic and time stationary spherical Gaussian random fields. We establish Chung's law of the iterated logarithm and solve the small probabilities problem. Our results depend on the high-frequency behaviour of the angular power spectrum: the speed of decay of the small ball probability is faster as either the memory parameter or the space-parameter decreases.


title: Figuring Out Gas & Galaxies In Enzo (FOGGIE) VIII: Complex and Stochastic Metallicity Gradients at z > 2

abstract: Gas-phase metallicity gradients are a crucial element in understanding the chemical evolution of galaxies. We use the FOGGIE simulations to study the metallicity gradients ($\nabla Z$) of six Milky Way-like galaxies throughout their evolution. FOGGIE galaxies generally exhibit steep negative gradients for most of their history, with only a few short-lived instances reaching positive slopes that appear to arise mainly from interactions with other galaxies. FOGGIE concurs with other simulation results but disagrees with the robust observational finding that flat and positive gradients are common at $z>1$. By tracking the metallicity gradient at a rapid cadence of simulation outputs ($\sim 5$--10 Myr), we find that theoretical gradients are highly stochastic: the FOGGIE galaxies spend $\sim 30-50$\% of their time far away from a smoothed trajectory inferred from analytic models or other, less high-cadence simulations. This rapid variation makes instantaneous gradients from observations more difficult to interpret in terms of physical processes. Because of these geometric and stochastic complications, we explore non-parametric methods of quantifying the evolving metallicity distribution at $z > 1$. We investigate how efficiently non-parametric measures of the 2-D metallicity distribution respond to metal production and mixing. Our results suggest that new methods of quantifying and interpreting gas-phase metallicity will be needed to relate trends in upcoming high-$z$ {\it JWST} observations with the underlying physics of gas accretion, expulsion, and recycling in early galaxies.


title: The CMS statistical analysis and combination tool: COMBINE

abstract: This paper describes the COMBINE software package used for statistical analyses by the CMS Collaboration. The package, originally designed to perform searches for a Higgs boson and the combined analysis of those searches, has evolved to become the statistical analysis tool presently used in the majority of measurements and searches performed by the CMS Collaboration. It is not specific to the CMS experiment, and this paper is intended to serve as a reference for users outside of the CMS Collaboration, providing an outline of the most salient features and capabilities. Readers are provided with the possibility to run COMBINE and reproduce examples provided in this paper using a publicly available container image. Since the package is constantly evolving to meet the demands of ever-increasing data sets and analysis sophistication, this paper cannot cover all details of COMBINE. However, the online documentation referenced within this paper provides an up-to-date and complete user guide.


title: Inertial active matter with Coulomb friction

abstract: Friction is central to the motion of active (self-propelled) objects, such as bacteria, animals or robots. While in a viscous fluid friction is typically described by Stokes' law, objects in contact with other solid bodies are often governed by more complex empirical friction laws. We study active dry particles subject to dry Coulomb friction force numerically and analytically. The interplay of friction and activity forces induces a rich behavior resulting in three distinct dynamical regimes. While for low activity levels, active Brownian motion is recovered, for large activity we observe a dynamical Stop & Go regime continuously switching from diffusion and accelerated motion. For further activity values, we observe a super-mobile dynamical regime characterized by a fully accelerated motion which is described by an anomalous scaling of the diffusion coefficient with the activity. These findings cannot be observed with Stokes viscous forces typical of active swimmers but are central in dry active objects.


title: Binary Trees and Taxicab Correspondence Analysis of Extremely Sparse Binary Textual Data: A Case Study

abstract: This is a case study, where Taxicab Correspondence Analysis reveals that the underlying structure of an extremely sparse binary textual data set can be represented by a binary tree, where the nodes representing clusters of words can be interpreted as topics. The textual data set represents Israel's Declaration of Independence text and 40 diverse Israeli Interviewees. The analysis provides for a compare and contrast study of textual data coming from two different sources. Furthermore, we propose an adjusted sparsity index which takes into account the size of the data table.


title: No evidence for anisotropy in galaxy spin directions

abstract: Modern cosmology rests on the cosmological principle, that on large enough scales the Universe is both homogeneous and isotropic. A corollary is that galaxies' spin vectors should be isotropically distributed on the sky. This has been challenged by multiple authors for over a decade, with claims to have detected a statistically significant dipole pattern of spins. We collect all publicly available datasets with spin classifications (binary clockwise/anticlockwise), and analyse them for large-angle anisotropies ($\ell \le 2$). We perform each inference in both a Bayesian and frequentist fashion, the former establishing posterior probabilities on the multipole parameters and the latter calculating $p$-values for rejection of the null hypothesis of isotropy (i.e. no power at $\ell>0$). All analysis indicate consistency with isotropy to within $3\sigma$. We isolate the differences with contrary claims in the ad hoc or biased statistics that they employ.


title: Invariant splitting principles for the Lipshitz--Ozsv\'ath--Thurston correspondence

abstract: We prove that the Lipshitz-Ozsv\'ath-Thurston correspondence between extended type D structures of knot complements and $\mathbb{F}[U, V]/(UV)$ knot Floer complexes can be arranged so that $\iota_K$-invariant splittings of knot Floer chain complexes correspond to $\iota_{S^3 \setminus K}$-invariant splittings of bordered Floer homology of knot complements. For patterns satisfying the satellite extension property, which include cabling patterns, this provides a novel way to compute the involutive knot Floer homology of satellites from that of their companions. As a topological application, we show that our results can be applied to construct infinitely many examples of exotic pairs of contractible 4-manifolds which remain exotic after one stabilization. Along the way, we also establish first order naturality of bordered Floer homology.


title: FairPair: A Robust Evaluation of Biases in Language Models through Paired Perturbations

abstract: The accurate evaluation of differential treatment in language models to specific groups is critical to ensuring a positive and safe user experience. An ideal evaluation should have the properties of being robust, extendable to new groups or attributes, and being able to capture biases that appear in typical usage (rather than just extreme, rare cases). Relatedly, bias evaluation should surface not only egregious biases but also ones that are subtle and commonplace, such as a likelihood for talking about appearances with regard to women. We present FairPair, an evaluation framework for assessing differential treatment that occurs during ordinary usage. FairPair operates through counterfactual pairs, but crucially, the paired continuations are grounded in the same demographic group, which ensures equivalent comparison. Additionally, unlike prior work, our method factors in the inherent variability that comes from the generation process itself by measuring the sampling variability. We present an evaluation of several commonly used generative models and a qualitative analysis that indicates a preference for discussing family and hobbies with regard to women.


title: Encoder-Quantization-Motion-based Video Quality Metrics

abstract: In an adaptive bitrate streaming application, the efficiency of video compression and the encoded video quality depend on both the video codec and the quality metric used to perform encoding optimization. The development of such a quality metric need large scale subjective datasets. In this work we merge several datasets into one to support the creation of a metric tailored for video compression and scaling. We proposed a set of HEVC lightweight features to boost performance of the metrics. Our metrics can be computed from tightly coupled encoding process with 4% compute overhead or from the decoding process in real-time. The proposed method can achieve better correlation than VMAF and P.1204.3. It can extrapolate to different dynamic ranges, and is suitable for real-time video quality metrics delivery in the bitstream. The performance is verified by in-distribution and cross-dataset tests. This work paves the way for adaptive client-side heuristics, real-time segment optimization, dynamic bitrate capping, and quality-dependent post-processing neural network switching, etc.


title: What is Your Favorite Gender, MLM? Gender Bias Evaluation in Multilingual Masked Language Models

abstract: Bias is a disproportionate prejudice in favor of one side against another. Due to the success of transformer-based Masked Language Models (MLMs) and their impact on many NLP tasks, a systematic evaluation of bias in these models is needed more than ever. While many studies have evaluated gender bias in English MLMs, only a few works have been conducted for the task in other languages. This paper proposes a multilingual approach to estimate gender bias in MLMs from 5 languages: Chinese, English, German, Portuguese, and Spanish. Unlike previous work, our approach does not depend on parallel corpora coupled with English to detect gender bias in other languages using multilingual lexicons. Moreover, a novel model-based method is presented to generate sentence pairs for a more robust analysis of gender bias, compared to the traditional lexicon-based method. For each language, both the lexicon-based and model-based methods are applied to create two datasets respectively, which are used to evaluate gender bias in an MLM specifically trained for that language using one existing and 3 new scoring metrics. Our results show that the previous approach is data-sensitive and not stable as it does not remove contextual dependencies irrelevant to gender. In fact, the results often flip when different scoring metrics are used on the same dataset, suggesting that gender bias should be studied on a large dataset using multiple evaluation metrics for best practice.


title: Calibrating Higher-Order Statistics for Few-Shot Class-Incremental Learning with Pre-trained Vision Transformers

abstract: Few-shot class-incremental learning (FSCIL) aims to adapt the model to new classes from very few data (5 samples) without forgetting the previously learned classes. Recent works in many-shot CIL (MSCIL) (using all available training data) exploited pre-trained models to reduce forgetting and achieve better plasticity. In a similar fashion, we use ViT models pre-trained on large-scale datasets for few-shot settings, which face the critical issue of low plasticity. FSCIL methods start with a many-shot first task to learn a very good feature extractor and then move to the few-shot setting from the second task onwards. While the focus of most recent studies is on how to learn the many-shot first task so that the model generalizes to all future few-shot tasks, we explore in this work how to better model the few-shot data using pre-trained models, irrespective of how the first task is trained. Inspired by recent works in MSCIL, we explore how using higher-order feature statistics can influence the classification of few-shot classes. We identify the main challenge of obtaining a good covariance matrix from few-shot data and propose to calibrate the covariance matrix for new classes based on semantic similarity to the many-shot base classes. Using the calibrated feature statistics in combination with existing methods significantly improves few-shot continual classification on several FSCIL benchmarks. Code is available at https://github.com/dipamgoswami/FSCIL-Calibration.


title: Quasiorders for a characterization of iso-dense spaces

abstract: A (generalized) topological space is called an iso-dense space if the set of all its isolated points is dense in the space. The main aim of the article is to show in $\mathbf{ZF}$ a new characterization of iso-dense spaces in terms of special quasiorders. For a non-empty family $\mathcal{A}$ of subsets of a set $X$, a quasiorder $\lesssim_{\mathcal{A}}$ on $X$ determined by $\mathcal{A}$ is defined. Necessary and sufficient conditions for $\mathcal{A}$ are given to have the property that the topology consisting of all $\lesssim_{\mathcal{A}}$-increasing sets coincides with the generalized topology on $X$ consisting of the empty set and all supersets of non-empty members of $\mathcal{A}$. The results obtained, applied to the quasiorder $\lesssim_{\mathcal{D}}$ determined by the family $\mathcal{D}$ of all dense sets of a given (generalized) topological space, lead to a new characterization of non-trivial iso-dense spaces. Independence results concerning resolvable spaces are also obtained.


title: Smooth Actual EIRP Control for EMF Compliance with Minimum Traffic Guarantees

abstract: To mitigate Electromagnetic Fields (EMF) human exposure from base stations, international standards bodies define EMF emission requirements that can be translated into limits on the "actual" Equivalent Isotropic Radiated Power (EIRP), i.e., averaged over a sliding time window. We aim to enable base stations to adhere to these constraints while mitigating any impact on user performance. Specifically, our objectives are to: i) ensure EMF exposure compliance using actual EIRP control when implementing the "actual maximum approach" described in IEC 62232:2022, ii) guarantee a minimum EIRP level, and iii) prevent resource shortages at all times. We first investigate exact and conservative algorithms, with linear and constant complexity, respectively, to compute the maximum allowed EIRP consumption under constraints i) and ii), denoted as EIRP "budget". Subsequently, we design a control method based on Drift-Plus-Penalty theory that preemptively curbs EIRP consumption only when needed to avoid future resource shortages.


title: Adapted optimal transport between Gaussian processes in discrete time

abstract: We derive explicitly the adapted $2$-Wasserstein distance between non-degenerate Gaussian distributions on $\mathbb{R}^N$ and characterize the optimal bicausal coupling(s). This leads to an adapted version of the Bures-Wasserstein distance on the space of positive definite matrices.


title: Why is soccer so popular: Understanding underdog achievement and randomness in team ball sports

abstract: In this paper, we examine team ball sports to investigate how the likelihood of weaker teams winning against stronger ones, referred to as underdog achievement, is influenced by inherent randomness factors that affect match outcomes in such sports. To address our research question, we collected data on match scores and computed corresponding team rankings from major international competitions for 12 popular team ball sports: basketball, cricket, field hockey, futsal, handball, ice hockey, lacrosse, roller hockey, rugby, soccer, volleyball, and water polo. Then, we developed an underdog achievement score to identify the sports with the highest occurrences of weaker teams prevailing over stronger ones, and we designed a randomness model consisting of factors that contribute to unexpected match outcomes within each sport. Our findings indicate that soccer is among the sports in which a weaker team is most likely to win. Through principal component analysis (PCA) and correlation analysis, we demonstrate that our randomness model can explain such a phenomenon, showing that the underdog achievement can be attributed to numerous factors that can randomly influence match outcomes.


title: A Beehive Haloscope for High-mass Axion Dark Matter

abstract: We propose a new haloscope geometry that can arbitrarily increase the resonator volume for a given target axion mass. This geometry consists of closely packed, overlapping coaxial cavities operating as a single resonator. While the resonant frequency is still determined by the dimensions of the individual "cells," the strong interactions between the cells encourage the entire "beehive" to oscillate in phase, a phenomenon expected of tightly coupled harmonic oscillators. This synchronization behavior allows the construction of a singly connected large-volume resonator at high frequency by simply increasing the number of the cells. Using direct numerical simulations, we verify the existence of a global eigenmode that has a high (40%) form factor in a 169-element beehive resonator. The resonant frequency of the eigenmode is tunable by moving the center rods laterally in unison. The form factor is very tolerant to dimensional deviations and misalignment, as a result of mode hybridization due to strong coupling. The beehive haloscope inherits many appealing properties from the conventional coaxial cavity: a high quality factor, compatibility with a solenoid magnet, ease of fabrication, tuning, and coupling. We argue that this geometry is an excellent candidate for high-mass axion searches covering the post-inflationary parameter space (>5 GHz).


title: Quantum graph models for transport in filamentary switching

abstract: The formation of metallic nanofilaments bridging two electrodes across an insulator is a mechanism for resistive switching. Examples of such phenomena include atomic synapses, which constitute a distinct class of memristive devices whose behavior is closely tied to the properties of the filament. Until recently, experimental investigation of the low-temperature regime and quantum transport effects has been limited. However, with growing interest in understanding the true impacts of the filament on device conductance, comprehending quantum effects has become crucial for quantum neuromorphic hardware. We discuss quantum transport resulting from filamentary switching in a narrow region where the continuous approximation of the contact is not valid, and only a few atoms are involved. In this scenario, the filament can be represented by a graph depicting the adjacency of atoms and the overlap between atomic orbitals. Using quantum graphs, we calculate the scattering amplitude of charge carriers on this graph and explore the interplay between filamentary formation and quantum transport effects.

categories: cond-mat.mes-hall cond-mat.dis-nn math-ph math.MP


title: Thermal Barrier Coatings in burner rig experiment analyzed through LAser Shock for DAmage Monitoring (LASDAM) method

abstract: This study investigates failure mechanisms in a typical thermal barrier coating (TBC) system comprising an EB-PVD columnar top coat, an aluminide bond coat, and a Ni-based single crystal superalloy substrate, simulating gas turbine operating conditions using a burner rig. TBC degradation, initiated by interfacial defects from the LASAT method, was studied during thermal gradient cycling under fast and slow cooling. In-situ optical and infrared imaging, along with ex-situ SEM cross-sectional analysis, monitored failure mechanisms. The Laser Shock for Damage Monitoring (LASDAM) technique provided insights into gradient and cooling rate impacts on columnar TBC damage. Results showed significant effects of cooling rate on delamination and localized failure at blister sites, with LASDAM revealing significant overheating at damage sites. Analysis included full-field temperature and damage assessment, emphasizing blister-driven delamination under severe thermal gradients. Discussion focused on elastic stored energy effects, noting that fast cooling induced transient conditions where reversed temperature gradients increased damage, limiting TBC lifespan


title: An Energy Stable High-Order Cut Cell Discontinuous Galerkin Method with State Redistribution for Wave Propagation

abstract: Cut meshes are a type of mesh that is formed by allowing embedded boundaries to "cut" a simple underlying mesh resulting in a hybrid mesh of cut and standard elements. While cut meshes can allow complex boundaries to be represented well regardless of the mesh resolution, their arbitrarily shaped and sized cut elements can present issues such as the small cell problem, where small cut elements can result in a severely restricted CFL condition. State redistribution, a technique developed by Berger and Giuliani [1], can be used to address the small cell problem. In this work, we pair state redistribution with a high-order discontinuous Galerkin scheme that is $L_2$ energy stable for arbitrary quadrature. We prove that state redistribution can be added to a provably $L_2$ energy stable discontinuous Galerkin method on a cut mesh without damaging the scheme's $L_2$ stability. We numerically verify the high order accuracy and stability of our scheme on two-dimensional wave propagation problems.


title: Counting Objects in a Robotic Hand

abstract: A robot performing multi-object grasping needs to sense the number of objects in the hand after grasping. The count plays an important role in determining the robot's next move and the outcome and efficiency of the whole pick-place process. This paper presents a data-driven contrastive learning-based counting classifier with a modified loss function as a simple and effective approach for object counting despite significant occlusion challenges caused by robotic fingers and objects. The model was validated against other models with three different common shapes (spheres, cylinders, and cubes) in simulation and in a real setup. The proposed contrastive learning-based counting approach achieved above 96\% accuracy for all three objects in the real setup.


title: Relative entropy bounds for sampling with and without replacement

abstract: Sharp, nonasymptotic bounds are obtained for the relative entropy between the distributions of sampling with and without replacement from an urn with balls of $c\geq 2$ colors. Our bounds are asymptotically tight in certain regimes and, unlike previous results, they depend on the number of balls of each colour in the urn. The connection of these results with finite de Finetti-style theorems is explored, and it is observed that a sampling bound due to Stam (1978) combined with the convexity of relative entropy yield a new finite de Finetti bound in relative entropy, which achieves the optimal asymptotic convergence rate.


title: Evolving Loss Functions for Specific Image Augmentation Techniques

abstract: Previous work in Neural Loss Function Search (NLFS) has shown a lack of correlation between smaller surrogate functions and large convolutional neural networks with massive regularization. We expand upon this research by revealing another disparity that exists, correlation between different types of image augmentation techniques. We show that different loss functions can perform well on certain image augmentation techniques, while performing poorly on others. We exploit this disparity by performing an evolutionary search on five types of image augmentation techniques in the hopes of finding image augmentation specific loss functions. The best loss functions from each evolution were then taken and transferred to WideResNet-28-10 on CIFAR-10 and CIFAR-100 across each of the five image augmentation techniques. The best from that were then taken and evaluated by fine-tuning EfficientNetV2Small on the CARS, Oxford-Flowers, and Caltech datasets across each of the five image augmentation techniques. Multiple loss functions were found that outperformed cross-entropy across multiple experiments. In the end, we found a single loss function, which we called the inverse bessel logarithm loss, that was able to outperform cross-entropy across the majority of experiments.


title: Perplexed: Understanding When Large Language Models are Confused

abstract: Large Language Models (LLMs) have become dominant in the Natural Language Processing (NLP) field causing a huge surge in progress in a short amount of time. However, their limitations are still a mystery and have primarily been explored through tailored datasets to analyze a specific human-level skill such as negation, name resolution, etc. In this paper, we introduce perplexed, a library for exploring where a particular language model is perplexed. To show the flexibility and types of insights that can be gained by perplexed, we conducted a case study focused on LLMs for code generation using an additional tool we built to help with the analysis of code models called codetokenizer. Specifically, we explore success and failure cases at the token level of code LLMs under different scenarios pertaining to the type of coding structure the model is predicting, e.g., a variable name or operator, and how predicting of internal verses external method invocations impact performance. From this analysis, we found that our studied code LLMs had their worst performance on coding structures where the code was not syntactically correct. Additionally, we found the models to generally perform worse at predicting internal method invocations than external ones. We have open sourced both of these tools to allow the research community to better understand LLMs in general and LLMs for code generation.


title: Current Affairs: A Measurement Study of Deployment and Security Trends in EV Charging Infrastructure

abstract: The deployment of electric vehicle charging infrastructure is occurring at a rapid pace. Simultaneously, existing standards, such as ISO 15118, which defines critical charging communication, are being improved and further developed. In this paper, we conduct a measurement study of already deployed DC charging stations to analyze the current state of deployment for various protocols. We present the adoption of TLS, and various EV charging protocols with a direct security impact, as well as observations about the Signal Level Attenuation Characterization (SLAC) process, and encryption keys. Our results indicate that even recently installed charging stations (December 2023) do not adhere to the latest version of the standard, leaving them vulnerable to attacks. We found that 84% of the surveyed charging stations do not implement Transport Layer Security (TLS), and are thus unable to implement the latest versions of the ISO 15118 protocol, leaving them vulnerable to attacks already demonstrated years ago. Finally, we observe and document anomalous behavior and violations of the standard.


title: The Kadomtsev pinch revisited for sheared-flow-stabilized Z-pinch modeling

abstract: The Kadomtsev pinch, namely the Z-pinch profile marginally stable to interchange modes, is revisited in light of observations from axisymmetric MHD modeling of the FuZE sheared-flow-stabilized Z-pinch experiment. We show that Kadomtsev's stability criterion, cleanly derived by the minimum energy principle but of opaque physical significance, has an intuitive interpretation in the specific entropy analogous to the Schwarzschild-Ledoux criterion for convective stability of adiabatic pressure distributions in the fields of astrophysics, meteorology, and oceanography. By analogy, the Kadomtsev profile may be described as magnetoadiabatic in the sense that plasma pressure is polytropically related to area-averaged current density from the ideal MHD stability condition on the specific entropy. Further, the non-ideal stability condition of the entropy modes is shown to relate the specific entropy gradient to the ideal interchange stability function. Hence, the combined activity of the ideal interchange and non-ideal entropy modes drives both the specific entropy and specific magnetic flux gradients to zero in the marginally stable state. The physical properties of Kadomtsev's pinch are reviewed in detail and following from this the localization of pinch confinement, i.e., pinch size and inductance, is quantified by the ratio of extensive magnetic and thermal energies. In addition, results and analysis of axisymmetric MHD modeling of the FuZE Z-pinch experiment are presented where pinch structure is found to consist of a near-marginal flowing core surrounded by a super-magnetoadiabatic low-beta sheared flow.


title: GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis

abstract: We present GeoSynth, a model for synthesizing satellite images with global style and image-driven layout control. The global style control is via textual prompts or geographic location. These enable the specification of scene semantics or regional appearance respectively, and can be used together. We train our model on a large dataset of paired satellite imagery, with automatically generated captions, and OpenStreetMap data. We evaluate various combinations of control inputs, including different types of layout controls. Results demonstrate that our model can generate diverse, high-quality images and exhibits excellent zero-shot generalization. The code and model checkpoints are available at https://github.com/mvrl/GeoSynth.


title: SAM-I-Am: Semantic Boosting for Zero-shot Atomic-Scale Electron Micrograph Segmentation

abstract: Image segmentation is a critical enabler for tasks ranging from medical diagnostics to autonomous driving. However, the correct segmentation semantics - where are boundaries located? what segments are logically similar? - change depending on the domain, such that state-of-the-art foundation models can generate meaningless and incorrect results. Moreover, in certain domains, fine-tuning and retraining techniques are infeasible: obtaining labels is costly and time-consuming; domain images (micrographs) can be exponentially diverse; and data sharing (for third-party retraining) is restricted. To enable rapid adaptation of the best segmentation technology, we propose the concept of semantic boosting: given a zero-shot foundation model, guide its segmentation and adjust results to match domain expectations. We apply semantic boosting to the Segment Anything Model (SAM) to obtain microstructure segmentation for transmission electron microscopy. Our booster, SAM-I-Am, extracts geometric and textural features of various intermediate masks to perform mask removal and mask merging operations. We demonstrate a zero-shot performance increase of (absolute) +21.35%, +12.6%, +5.27% in mean IoU, and a -9.91%, -18.42%, -4.06% drop in mean false positive masks across images of three difficulty classes over vanilla SAM (ViT-L).


title: On cardinal invariants related to Rosenthal families and large-scale topology

abstract: Given a function $f \in \omega^\omega$, a set $A \in [\omega]^\omega$ is free for $f$ if $f[A] \cap A$ is finite. For a class of functions $\Gamma \subseteq \omega^{\omega}$, we define $\mathfrak{ros}_\Gamma$ as the smallest size of a family $\mathcal{A}\subseteq [\omega]^\omega$ such that for every $f\in\Gamma$ there is a set $A \in \mathcal{A}$ which is free for $f$, and $\Delta_\Gamma$ as the smallest size of a family $\mathcal{F}\subseteq\Gamma$ such that for every $A\in[\omega]^\omega$ there is $f\in\mathcal{F}$ such that $A$ is not free for $f$. We compare several versions of these cardinal invariants with some of the classical cardinal characteristics of the continuum. Using these notions, we partially answer some questions from arXiv:1911.01336 [math.LO] and arXiv:2004.01979 [math.GN].


title: Modification of Jet Velocities in an Explosively Loaded Copper Target with a Conical Defect

abstract: In this work, the design and execution of an experiment with the goal of demonstrating control over the evolution of a copper jet is described. Simulations show that when using simple multi-material buffers placed between a copper target with a conical defect and a cylinder of high-explosive, a variety of jetting behaviors occur based on material placement, including both jet velocity augmentation and mitigation. A parameter sweep was performed to determine optimal buffer designs in two configurations. Experiments using the optimal buffer designs verified the effectiveness of the buffer and validated the modeling.


title: Federated learning model for predicting major postoperative complications

abstract: Background: The accurate prediction of postoperative complication risk using Electronic Health Records (EHR) and artificial intelligence shows great potential. Training a robust artificial intelligence model typically requires large-scale and diverse datasets. In reality, collecting medical data often encounters challenges surrounding privacy protection. Methods: This retrospective cohort study includes adult patients who were admitted to UFH Gainesville (GNV) (n = 79,850) and Jacksonville (JAX) (n = 28,636) for any type of inpatient surgical procedure. Using perioperative and intraoperative features, we developed federated learning models to predict nine major postoperative complications (i.e., prolonged intensive care unit stay and mechanical ventilation). We compared federated learning models with local learning models trained on a single site and central learning models trained on pooled dataset from two centers. Results: Our federated learning models achieved the area under the receiver operating characteristics curve (AUROC) values ranged from 0.81 for wound complications to 0.92 for prolonged ICU stay at UFH GNV center. At UFH JAX center, these values ranged from 0.73-0.74 for wound complications to 0.92-0.93 for hospital mortality. Federated learning models achieved comparable AUROC performance to central learning models, except for prolonged ICU stay, where the performance of federated learning models was slightly higher than central learning models at UFH GNV center, but slightly lower at UFH JAX center. In addition, our federated learning model obtained comparable performance to the best local learning model at each center, demonstrating strong generalizability. Conclusion: Federated learning is shown to be a useful tool to train robust and generalizable models from large scale data across multiple institutions where data protection barriers are high.


title: Modulus representation of the Riemann $\xi$ function

abstract: We use the Jacobi theta function to give a representation of the modulus of the Riemann $\xi$ function.


title: On Frobenius-Schur exponent bounds

abstract: Here we study bounds on the Frobenius-Schur exponent of spherical fusion categories based on their global dimension generalizing bounds from the representation theory of finite-dimensional quasi-Hopf algebras. Our main result is that if the Frobenius-Schur exponent of a modular fusion category is a prime power for some prime integer $p$, then it is bounded by the norm of its global dimension when $p$ is odd, and four times the norm of its global dimension when $p=2$; these bounds are optimal. If one assumes in addition pseudounitarity, the categories achieving the optimal bound are completely described and we attain similar bounds and classifications for arbitrary spherical fusion categories. This proof includes an explicit classification of modular fusion categories of Frobenius-Perron dimension $p^5$; all examples which are not pointed are constructed explicitly from the Ising categories and the representation theory of extraspecial $p$-groups.


title: Khayyam Challenge (PersianMMLU): Is Your LLM Truly Wise to The Persian Language?

abstract: Evaluating Large Language Models (LLMs) is challenging due to their generative nature, necessitating precise evaluation methodologies. Additionally, non-English LLM evaluation lags behind English, resulting in the absence or weakness of LLMs for many languages. In response to this necessity, we introduce Khayyam Challenge (also known as PersianMMLU), a meticulously curated collection comprising 20,192 four-choice questions sourced from 38 diverse tasks extracted from Persian examinations, spanning a wide spectrum of subjects, complexities, and ages. The primary objective of the Khayyam Challenge is to facilitate the rigorous evaluation of LLMs that support the Persian language. Distinctive features of the Khayyam Challenge are (i) its comprehensive coverage of various topics, including literary comprehension, mathematics, sciences, logic, intelligence testing, etc., aimed at assessing different facets of LLMs such as language comprehension, reasoning, and information retrieval across various educational stages, from lower primary school to upper secondary school (ii) its inclusion of rich metadata such as human response rates, difficulty levels, and descriptive answers (iii) its utilization of new data to avoid data contamination issues prevalent in existing frameworks (iv) its use of original, non-translated data tailored for Persian speakers, ensuring the framework is free from translation challenges and errors while encompassing cultural nuances (v) its inherent scalability for future data updates and evaluations without requiring special human effort. Previous works lacked an evaluation framework that combined all of these features into a single comprehensive benchmark. Furthermore, we evaluate a wide range of existing LLMs that support the Persian language, with statistical analyses and interpretations of their outputs.


title: GenCHiP: Generating Robot Policy Code for High-Precision and Contact-Rich Manipulation Tasks

abstract: Large Language Models (LLMs) have been successful at generating robot policy code, but so far these results have been limited to high-level tasks that do not require precise movement. It is an open question how well such approaches work for tasks that require reasoning over contact forces and working within tight success tolerances. We find that, with the right action space, LLMs are capable of successfully generating policies for a variety of contact-rich and high-precision manipulation tasks, even under noisy conditions, such as perceptual errors or grasping inaccuracies. Specifically, we reparameterize the action space to include compliance with constraints on the interaction forces and stiffnesses involved in reaching a target pose. We validate this approach on subtasks derived from the Functional Manipulation Benchmark (FMB) and NIST Task Board Benchmarks. Exposing this action space alongside methods for estimating object poses improves policy generation with an LLM by greater than 3x and 4x when compared to non-compliant action spaces


title: Game Semantics for Higher-Order Unitary Quantum Computation

abstract: We develop a symmetric monoidal closed category of games, incorporating sums and products, to model quantum computation at higher types. This model is expressive, capable of representing all unitary operators at base types. It is compatible with base types and realizable by unitary operators.


title: From Protoscience to Epistemic Monoculture: How Benchmarking Set the Stage for the Deep Learning Revolution

abstract: Over the past decade, AI research has focused heavily on building ever-larger deep learning models. This approach has simultaneously unlocked incredible achievements in science and technology, and hindered AI from overcoming long-standing limitations with respect to explainability, ethical harms, and environmental efficiency. Drawing on qualitative interviews and computational analyses, our three-part history of AI research traces the creation of this "epistemic monoculture" back to a radical reconceptualization of scientific progress that began in the late 1980s. In the first era of AI research (1950s-late 1980s), researchers and patrons approached AI as a "basic" science that would advance through autonomous exploration and organic assessments of progress (e.g., peer-review, theoretical consensus). The failure of this approach led to a retrenchment of funding in the 1980s. Amid this "AI Winter," an intervention by the U.S. government reoriented the field towards measurable progress on tasks of military and commercial interest. A new evaluation system called "benchmarking" provided an objective way to quantify progress on tasks by focusing exclusively on increasing predictive accuracy on example datasets. Distilling science down to verifiable metrics clarified the roles of scientists, allowed the field to rapidly integrate talent, and provided clear signals of significance and progress. But history has also revealed a tradeoff to this streamlined approach to science: the consolidation around external interests and inherent conservatism of benchmarking has disincentivized exploration beyond scaling monoculture. In the discussion, we explain how AI's monoculture offers a compelling challenge to the belief that basic, exploration-driven research is needed for scientific progress. Implications for the spread of AI monoculture to other sciences in the era of generative AI are also discussed.


title: Constraints on atmospheric water abundance and cloud deck pressure in the warm Neptune GJ 3470 b via CARMENES transmission spectroscopy

abstract: Observations of cooler atmospheres of super-Earths and Neptune sized objects often show flat transmission spectra. The most likely cause of this trend is the presence of aerosols (i.e. clouds and hazes) in the atmospheres of such objects. High-resolution spectroscopy provides an opportunity to test this hypothesis by targeting molecular species whose spectral line cores extend above the level of such opaque decks. In this work, we analyse high-resolution infrared observations of the warm Neptune GJ 3470 b taken over two transits using CARMENES (R $\sim$ 80,000) and look for signatures of H$_2$O (previously detected using HST WFC3+Spitzer observations) in these transits with a custom pipeline fully accounting for the effects of data cleaning on any potential exoplanet signal. We find that our data are potentially able to weakly detect ($\sim3\sigma$) an injected signal equivalent to the best-fit model from previous HST WFC3+Spitzer observations. However, we do not make a significant detection using the actual observations. Using a Bayesian framework to simultaneously constrain the H$_2$O Volume Mixing Ratio (VMR) and the cloud top pressure level, we select a family of models compatible with the non detection. These are either very high VMR, cloud-free models, solar-abundance models with a high cloud deck, or sub-solar abundance models with a moderate cloud deck. This is a broader range compared to published results from low-resolution spectroscopy, but is also compatible with them at a 1$\sigma$ level.


title: Efficiently Cooling Quantum Systems with Finite Resources: Insights from Thermodynamic Geometry

abstract: Landauer's universal limit on heat dissipation during information erasure becomes increasingly crucial as computing devices shrink: minimising heat-induced errors demands optimal pure-state preparation. For this, however, Nernst's third law posits an infinite-resource requirement: either energy, time, or control complexity must diverge. Here, we address the practical challenge of efficiently cooling quantum systems using finite resources. We investigate the ensuing resource trade-offs and present efficient protocols for finite distinct energy gaps in settings pertaining to coherent or incoherent control, corresponding to quantum batteries and heat engines, respectively. Expressing energy bounds through thermodynamic length, our findings illuminate the optimal distribution of energy gaps, detailing the resource limitations of preparing pure states in practical settings.


title: A Frequency-Domain Beamforming Procedure for Extracting Rayleigh Wave Attenuation Coefficients and Small-Strain Damping Ratio from 2D Ambient Noise Array Measurements

abstract: The small-strain damping ratio plays a crucial role in assessing the response of soil deposits to earthquake-induced ground motions and general dynamic loading. The damping ratio can theoretically be inverted for after extracting frequency-dependent Rayleigh wave attenuation coefficients from wavefields collected during surface wave testing. However, determining reliable estimates of in-situ attenuation coefficients is much more challenging than achieving robust phase velocity dispersion data, which are commonly measured using both active-source and ambient-wavefield surface wave methods. This paper introduces a new methodology for estimating frequency-dependent attenuation coefficients through the analysis of ambient noise wavefield data recorded by two-dimensional (2D) arrays of surface seismic sensors for the subsequent evaluation of the small-strain damping ratio. The approach relies on the application of an attenuation-specific wavefield conversion and frequency-domain beamforming. Numerical simulations are employed to verify the proposed approach and inform best practices for its application. Finally, the practical efficacy of the proposed approach is showcased through its application to field data collected at a deep, soft soil site in Logan, Utah, USA, where phase velocity and attenuation coefficients are extracted from surface wave data and then simultaneously inverted to develop deep shear wave velocity and damping ratio profiles.


title: Adiabatic modulation of driving protocols in periodically driven quantum systems

abstract: We consider a periodically driven system where the high-frequency driving protocol consists of a sequence of potentials switched on and off at different instants within a period. We explore the possibility of introducing an adiabatic modulation of the driving protocol by considering a slow evolution of the instants when the sequence of potentials is switched on/off. We examine how this influences the long-term dynamics of periodically driven quantum systems. By assuming that the slow and fast timescales in the problem can be decoupled, we derive the stroboscopic (effective) Hamiltonian for a four-step driving sequence up to the first order in perturbation theory. We then apply this approach to a rigid rotor, where the adiabatic modulation of the driving protocol is chosen to produce an evolving emergent magnetic field that interacts with the rotor's spin. We study the emergence of $\textit{diabolical points}$ and $\textit{diabolical loci}$ in the parameter space of the effective Hamiltonian. Further, we study the topological properties of the maps of the adiabatic paths in the parameter space to the eigenspace of the effective Hamiltonian. In effect, we obtain a technique to tune the topological properties of the eigenstates by selecting various adiabatic evolution of the driving protocol characterized by different paths in the parameter space. This technique can be applied to any periodic driving protocol to achieve desirable topological effects.


title: Collisions of Spin-polarized YO Molecules for Single Partial Waves

abstract: Efficient sub-Doppler laser cooling and optical trapping of YO molecules offer new opportunities to study collisional dynamics in the quantum regime. Confined in a crossed optical dipole trap, we achieve the highest phase-space density of $2.5 \times 10^{-5}$ for a bulk laser-cooled molecular sample. This sets the stage to study YO-YO collisions in the microkelvin temperature regime, and reveal state-dependent, single-partial-wave two-body collisional loss rates. We determine the partial-wave contributions to specific rotational states (first excited $N=1$ and ground $N=0$) following two strategies. First, we measure the change of the collision rate in a spin mixture of $N=1$ by tuning the kinetic energy with respect to the p- and d-wave centrifugal barriers. Second, we compare loss rates between a spin mixture and a spin-polarized state in $N=0$. Using quantum defect theory with a partially absorbing boundary condition at short range, we show that the dependence on temperature for $N=1$ can be reproduced in the presence of a d-wave or f-wave resonance, and the dependence on a spin mixture for $N=0$ with a p-wave resonance.


title: FlameFinder: Illuminating Obscured Fire through Smoke with Attentive Deep Metric Learning

abstract: FlameFinder is a deep metric learning (DML) framework designed to accurately detect flames, even when obscured by smoke, using thermal images from firefighter drones during wildfire monitoring. Traditional RGB cameras struggle in such conditions, but thermal cameras can capture smoke-obscured flame features. However, they lack absolute thermal reference points, leading to false positives.To address this issue, FlameFinder utilizes paired thermal-RGB images for training. By learning latent flame features from smoke-free samples, the model becomes less biased towards relative thermal gradients. In testing, it identifies flames in smoky patches by analyzing their equivalent thermal-domain distribution. This method improves performance using both supervised and distance-based clustering metrics.The framework incorporates a flame segmentation method and a DML-aided detection framework. This includes utilizing center loss (CL), triplet center loss (TCL), and triplet cosine center loss (TCCL) to identify optimal cluster representatives for classification. However, the dominance of center loss over the other losses leads to the model missing features sensitive to them. To address this limitation, an attention mechanism is proposed. This mechanism allows for non-uniform feature contribution, amplifying the critical role of cosine and triplet loss in the DML framework. Additionally, it improves interpretability, class discrimination, and decreases intra-class variance. As a result, the proposed model surpasses the baseline by 4.4% in the FLAME2 dataset and 7% in the FLAME3 dataset for unobscured flame detection accuracy. Moreover, it demonstrates enhanced class separation in obscured scenarios compared to VGG19, ResNet18, and three backbone models tailored for flame detection.


title: RULER: What's the Real Context Size of Your Long-Context Language Models?

abstract: The needle-in-a-haystack (NIAH) test, which examines the ability to retrieve a piece of information (the "needle") from long distractor texts (the "haystack"), has been widely adopted to evaluate long-context language models (LMs). However, this simple retrieval-based test is indicative of only a superficial form of long-context understanding. To provide a more comprehensive evaluation of long-context LMs, we create a new synthetic benchmark RULER with flexible configurations for customized sequence length and task complexity. RULER expands upon the vanilla NIAH test to encompass variations with diverse types and quantities of needles. Moreover, RULER introduces new task categories multi-hop tracing and aggregation to test behaviors beyond searching from context. We evaluate ten long-context LMs with 13 representative tasks in RULER. Despite achieving nearly perfect accuracy in the vanilla NIAH test, all models exhibit large performance drops as the context length increases. While these models all claim context sizes of 32K tokens or greater, only four models (GPT-4, Command-R, Yi-34B, and Mixtral) can maintain satisfactory performance at the length of 32K. Our analysis of Yi-34B, which supports context length of 200K, reveals large room for improvement as we increase input length and task complexity. We open source RULER to spur comprehensive evaluation of long-context LMs.


title: Gersten's Injectivity for Smooth Algebras over Valuation Rings

abstract: Gersten's injectivity conjecture for a functor $F$ of ``motivic type'', predicts that given a semilocal, ``non-singular'', integral domain $R$ with a fraction field $K$, the restriction morphism induces an injection of $F(R)$ inside $F(K)$. We prove two new cases of this conjecture for smooth algebras over valuation rings. Namely, we show that the higher algebraic $K$-groups of a semilocal, integral domain that is an essentially smooth algebra over an equicharacteristic valuation ring inject inside the same of its fraction field. Secondly, we show that Gersten's injectivity is true for smooth algebras over, possibly of mixed-characteristic, valuation rings in the case of torsors under tori and also in the case of the Brauer group.


title: Reverse Divisors and Magic Numbers

abstract: The study examines the relationship between Ball's magic numbers and reverses divisors. These numbers are the source of beautiful and curious properties. Activities related to numbers can be a fun way to motivate mathematics students, while also enabling surprising analysis and connections.


title: Res-U2Net: Untrained Deep Learning for Phase Retrieval and Image Reconstruction

abstract: Conventional deep learning-based image reconstruction methods require a large amount of training data which can be hard to obtain in practice. Untrained deep learning methods overcome this limitation by training a network to invert a physical model of the image formation process. Here we present a novel untrained Res-U2Net model for phase retrieval. We use the extracted phase information to determine changes in an object's surface and generate a mesh representation of its 3D structure. We compare the performance of Res-U2Net phase retrieval against UNet and U2Net using images from the GDXRAY dataset.


title: Polygonal equalities and $p$-negative type

abstract: Nontrivial $p$-polygonal equalities impose certain conditions on the geometry of a metric space $(X,d)$ and so it is of interest to be able to identify the values of $p \in [0,\infty)$ for which such equalities exist. Following work of Li and Weston, Kelleher, Miller, Osborn and Weston established that if a metric space $(X,d)$ is of $p$-negative type, then $(X,d)$ admits no nontrivial $p$-polygonal equalities if and only if it is of strict $p$-negative type. In this note we remove the underlying premise of $p$-negative type from this theorem. As an application we show that the set of all $p$ for which a finite metric space $(X,d)$ admits a nontrivial $p$-polygonal equality is always a closed interval of the form $[\wp, \infty)$, where $\wp > 0$, or the empty set. It follows that for each $q \not= 2$, the Schatten $q$-class $\mathcal{C}_{q}$ admits a nontrivial $p$-polygonal equality for each $p > 0$. Other spaces with this same property include $C[0, 1]$ and $\ell_{q}^{(3)}$ for all $q > 2$.


title: Leveraging Interesting Facts to Enhance User Engagement with Conversational Interfaces

abstract: Conversational Task Assistants (CTAs) guide users in performing a multitude of activities, such as making recipes. However, ensuring that interactions remain engaging, interesting, and enjoyable for CTA users is not trivial, especially for time-consuming or challenging tasks. Grounded in psychological theories of human interest, we propose to engage users with contextual and interesting statements or facts during interactions with a multi-modal CTA, to reduce fatigue and task abandonment before a task is complete. To operationalize this idea, we train a high-performing classifier (82% F1-score) to automatically identify relevant and interesting facts for users. We use it to create an annotated dataset of task-specific interesting facts for the domain of cooking. Finally, we design and validate a dialogue policy to incorporate the identified relevant and interesting facts into a conversation, to improve user engagement and task completion. Live testing on a leading multi-modal voice assistant shows that 66% of the presented facts were received positively, leading to a 40% gain in the user satisfaction rating, and a 37% increase in conversation length. These findings emphasize that strategically incorporating interesting facts into the CTA experience can promote real-world user participation for guided task interactions.


title: JWST Spectrophotometry of the Small Satellites of Uranus and Neptune

abstract: We use 1.4-4.6 micron multi-band photometry of the small inner Uranian and Neptunian satellites obtained with the James Webb Space Telescope's near-infrared imager NIRCam to characterize their surface compositions. We find that the satellites of the ice giants have, to first-order, similar compositions to one another, with a 3.0 micron absorption feature possibly associated with an O-H stretch, indicative of water ice or hydrated minerals. Additionally, the spectrophotometry for the small ice giant satellites matches spectra of some Neptune Trojans and excited Kuiper belt objects, suggesting shared properties. Future spectroscopy of these small satellites is necessary to identify and better constrain their specific surface compositions.


title: Efficient Denoising using Score Embedding in Score-based Diffusion Models

abstract: It is well known that training a denoising score-based diffusion models requires tens of thousands of epochs and a substantial number of image data to train the model. In this paper, we propose to increase the efficiency in training score-based diffusion models. Our method allows us to decrease the number of epochs needed to train the diffusion model. We accomplish this by solving the log-density Fokker-Planck (FP) Equation numerically to compute the score \textit{before} training. The pre-computed score is embedded into the image to encourage faster training under slice Wasserstein distance. Consequently, it also allows us to decrease the number of images we need to train the neural network to learn an accurate score. We demonstrate through our numerical experiments the improved performance of our proposed method compared to standard score-based diffusion models. Our proposed method achieves a similar quality to the standard method meaningfully faster.


title: Modular Vector Fields for Lattice Polarized K3

abstract: We consider a moduli space of lattice polarized K3 surfaces with the additional information of a frame of the trascendental cohomology with respect to the lattice polarization. This moduli space is proved to be quasi-affine, and the existence of vector fields on it, called modular vector fields, is proved. A purely algebraic version of the algebra of Siegel quasi-modular forms is obtained as the algebra of global regular functions over this moduli space, with a differential structure coming from the modular vector fields. By means of trascendental considerations we are able to obtain a differential algebra of meromorphic Siegel quasi-modular forms from the previous algebra.


title: Multi-modal Document Presentation Attack Detection With Forensics Trace Disentanglement

abstract: Document Presentation Attack Detection (DPAD) is an important measure in protecting the authenticity of a document image. However, recent DPAD methods demand additional resources, such as manual effort in collecting additional data or knowing the parameters of acquisition devices. This work proposes a DPAD method based on multi-modal disentangled traces (MMDT) without the above drawbacks. We first disentangle the recaptured traces by a self-supervised disentanglement and synthesis network to enhance the generalization capacity in document images with different contents and layouts. Then, unlike the existing DPAD approaches that rely only on data in the RGB domain, we propose to explicitly employ the disentangled recaptured traces as new modalities in the transformer backbone through adaptive multi-modal adapters to fuse RGB/trace features efficiently. Visualization of the disentangled traces confirms the effectiveness of the proposed method in different document contents. Extensive experiments on three benchmark datasets demonstrate the superiority of our MMDT method on representing forensic traces of recapturing distortion.


title: CulturalTeaming: AI-Assisted Interactive Red-Teaming for Challenging LLMs' (Lack of) Multicultural Knowledge

abstract: Frontier large language models (LLMs) are developed by researchers and practitioners with skewed cultural backgrounds and on datasets with skewed sources. However, LLMs' (lack of) multicultural knowledge cannot be effectively assessed with current methods for developing benchmarks. Existing multicultural evaluations primarily rely on expensive and restricted human annotations or potentially outdated internet resources. Thus, they struggle to capture the intricacy, dynamics, and diversity of cultural norms. LLM-generated benchmarks are promising, yet risk propagating the same biases they are meant to measure. To synergize the creativity and expert cultural knowledge of human annotators and the scalability and standardizability of LLM-based automation, we introduce CulturalTeaming, an interactive red-teaming system that leverages human-AI collaboration to build truly challenging evaluation dataset for assessing the multicultural knowledge of LLMs, while improving annotators' capabilities and experiences. Our study reveals that CulturalTeaming's various modes of AI assistance support annotators in creating cultural questions, that modern LLMs fail at, in a gamified manner. Importantly, the increased level of AI assistance (e.g., LLM-generated revision hints) empowers users to create more difficult questions with enhanced perceived creativity of themselves, shedding light on the promises of involving heavier AI assistance in modern evaluation dataset creation procedures. Through a series of 1-hour workshop sessions, we gather CULTURALBENCH-V0.1, a compact yet high-quality evaluation dataset with users' red-teaming attempts, that different families of modern LLMs perform with accuracy ranging from 37.7% to 72.2%, revealing a notable gap in LLMs' multicultural proficiency.


title: Deep Generative Data Assimilation in Multimodal Setting

abstract: Robust integration of physical knowledge and data is key to improve computational simulations, such as Earth system models. Data assimilation is crucial for achieving this goal because it provides a systematic framework to calibrate model outputs with observations, which can include remote sensing imagery and ground station measurements, with uncertainty quantification. Conventional methods, including Kalman filters and variational approaches, inherently rely on simplifying linear and Gaussian assumptions, and can be computationally expensive. Nevertheless, with the rapid adoption of data-driven methods in many areas of computational sciences, we see the potential of emulating traditional data assimilation with deep learning, especially generative models. In particular, the diffusion-based probabilistic framework has large overlaps with data assimilation principles: both allows for conditional generation of samples with a Bayesian inverse framework. These models have shown remarkable success in text-conditioned image generation or image-controlled video synthesis. Likewise, one can frame data assimilation as observation-conditioned state calibration. In this work, we propose SLAMS: Score-based Latent Assimilation in Multimodal Setting. Specifically, we assimilate in-situ weather station data and ex-situ satellite imagery to calibrate the vertical temperature profiles, globally. Through extensive ablation, we demonstrate that SLAMS is robust even in low-resolution, noisy, and sparse data settings. To our knowledge, our work is the first to apply deep generative framework for multimodal data assimilation using real-world datasets; an important step for building robust computational simulators, including the next-generation Earth system models. Our code is available at: https://github.com/yongquan-qu/SLAMS


title: SafeGen: Mitigating Unsafe Content Generation in Text-to-Image Models

abstract: Text-to-image (T2I) models, such as Stable Diffusion, have exhibited remarkable performance in generating high-quality images from text descriptions in recent years. However, text-to-image models may be tricked into generating not-safe-for-work (NSFW) content, particularly in sexual scenarios. Existing countermeasures mostly focus on filtering inappropriate inputs and outputs, or suppressing improper text embeddings, which can block explicit NSFW-related content (e.g., naked or sexy) but may still be vulnerable to adversarial prompts inputs that appear innocent but are ill-intended. In this paper, we present SafeGen, a framework to mitigate unsafe content generation by text-to-image models in a text-agnostic manner. The key idea is to eliminate unsafe visual representations from the model regardless of the text input. In this way, the text-to-image model is resistant to adversarial prompts since unsafe visual representations are obstructed from within. Extensive experiments conducted on four datasets demonstrate SafeGen's effectiveness in mitigating unsafe content generation while preserving the high-fidelity of benign images. SafeGen outperforms eight state-of-the-art baseline methods and achieves 99.1% sexual content removal performance. Furthermore, our constructed benchmark of adversarial prompts provides a basis for future development and evaluation of anti-NSFW-generation methods.


title: Slow relaxation of quasi-periodically driven integrable quantum many-body systems

abstract: We study the emergence and stability of a prethermal phase in an integrable many-body system subjected to a Fibonacci drive. Despite not being periodic, Fibonacci drives have been shown to introduce dynamical constraints due to their self-similar structure, unlike random driving protocols. From perturbative analysis, this has been argued to result in an exponentially long prethermal phase in the high frequency limit of driving. Examining higher order terms in the perturbative expansion, we show that the perturbative description breaks down eventually in such systems at a finite universal order, which depends solely on features of the Fibonacci sequence. This leads to an onset of energy absorption at long time scales for intermediate and low driving frequencies. Interestingly, in spite of the breakdown of an effective Hamiltonian in the perturbative analysis, we still observe slow logarithmic heating time-scales, unlike purely random drives.


title: Forecasting the Future with Future Technologies: Advancements in Large Meteorological Models

abstract: The field of meteorological forecasting has undergone a significant transformation with the integration of large models, especially those employing deep learning techniques. This paper reviews the advancements and applications of these models in weather prediction, emphasizing their role in transforming traditional forecasting methods. Models like FourCastNet, Pangu-Weather, GraphCast, ClimaX, and FengWu have made notable contributions by providing accurate, high-resolution forecasts, surpassing the capabilities of traditional Numerical Weather Prediction (NWP) models. These models utilize advanced neural network architectures, such as Convolutional Neural Networks (CNNs), Graph Neural Networks (GNNs), and Transformers, to process diverse meteorological data, enhancing predictive accuracy across various time scales and spatial resolutions. The paper addresses challenges in this domain, including data acquisition and computational demands, and explores future opportunities for model optimization and hardware advancements. It underscores the integration of artificial intelligence with conventional meteorological techniques, promising improved weather prediction accuracy and a significant contribution to addressing climate-related challenges. This synergy positions large models as pivotal in the evolving landscape of meteorological forecasting.


title: On Bounds for Greedy Schemes in String Optimization based on Greedy Curvatures

abstract: We consider the celebrated bound introduced by Conforti and Cornu\'ejols (1984) for greedy schemes in submodular optimization. The bound assumes a submodular function defined on a collection of sets forming a matroid and is based on greedy curvature. We show that the bound holds for a very general class of string problems that includes maximizing submodular functions over set matroids as a special case. We also derive a bound that is computable in the sense that they depend only on quantities along the greedy trajectory. We prove that our bound is superior to the greedy curvature bound of Conforti and Cornu\'ejols. In addition, our bound holds under a condition that is weaker than submodularity.


title: What's Mine becomes Yours: Defining, Annotating and Detecting Context-Dependent Paraphrases in News Interview Dialogs

abstract: Best practices for high conflict conversations like counseling or customer support almost always include recommendations to paraphrase the previous speaker. Although paraphrase classification has received widespread attention in NLP, paraphrases are usually considered independent from context, and common models and datasets are not applicable to dialog settings. In this work, we investigate paraphrases in dialog (e.g., Speaker 1: "That book is mine." becomes Speaker 2: "That book is yours."). We provide an operationalization of context-dependent paraphrases, and develop a training for crowd-workers to classify paraphrases in dialog. We introduce a dataset with utterance pairs from NPR and CNN news interviews annotated for context-dependent paraphrases. To enable analyses on label variation, the dataset contains 5,581 annotations on 600 utterance pairs. We present promising results with in-context learning and with token classification models for automatic paraphrase detection in dialog.


title: Simple arithmetic operation in latent space can generate a novel three dimensional graph metamaterials

abstract: Recent advancements in artificial intelligence (AI)-based design strategies for metamaterials have revolutionized the creation of customizable architectures spanning nano- to macro-scale dimensions, achieving unprecedented mechanical behaviors that surpass the inherent properties of the constituent materials. However, the growing complexity of these methods poses challenges in generating diverse metamaterials without substantial human and computational resources, hindering widespread adoption. Addressing this, our study introduces an innovative design strategy capable of generating various three-dimensional graph metamaterials using simple arithmetic operations within the latent space. By seamlessly integrating hidden representations of disentangled latent space and latent diffusion processes, our approach provides a comprehensive understanding of complex design spaces, generating diverse graph metamaterials through arithmetic operations. This methodology stands as a versatile tool for creating structures ranging from repetitive lattice structures to functionally graded mechanical metamaterials. It also serves as an inverse design strategy for diverse lattice structures, including crystalline structures and those made of trabecular bone. We believe that this methodology represents a foundational step in advancing our comprehension of the intricate latent design space, offering the potential to establish a unified model for various traditional generative models in the realm of mechanical metamaterials.


title: Biomedical Open Source Software: Crucial Packages and Hidden Heroes

abstract: Despite the importance of scientific software for research, it is often not formally recognized and rewarded. This is especially true for foundation libraries, which are used by the software packages visible to the users, being ``hidden'' themselves. The funders and other organizations need to understand the complex network of computer programs that the modern research relies upon. In this work we used CZ Software Mentions Dataset to map the dependencies of the software used in biomedical papers and find the packages critical to the software ecosystems. We propose the centrality metrics for the network of software dependencies, analyze three ecosystems (PyPi, CRAN, Bioconductor) and determine the packages with the highest centrality.


title: Non-extensive Effects on the QCD Equation of State and Fluctuations of Conserved Charges within Polyakov Quark Meson Model

abstract: The influence of non-extensive Tsallis statistics on the hadron phase structure has been investigated using the Polyakov-quark-meson (PQM) model. The analysis examines the non-extensive effects on the temperature dependence of PQM order parameters, thermodynamic quantities related to the QCD equation of state, and fluctuations of conserved charges at varying chemical potentials. The results show that non-extensive effects have the most significant deviations near the crossover region. The pseudo-critical temperature $T_{\chi}(\mu_B)$ is not a universal constant and decreases with increasing non-extensive $q$ parameter. The chiral phase diagram of the PQM model indicates a decrease in the behavior of the ($T_{\chi}-\mu_B$) plane with increasing non-extensive $q$ parameter. The PQM model exhibits good qualitative agreement with lattice QCD calculations. Moreover, these findings suggest the existence of a Tsallis limit, which serves as an alternative to the Stefan-Boltzmann (SB) limit for the massless ideal gas. The critical endpoint (CEP) exhibits lower temperature but higher chemical potential with increasing non-extensive $q$ parameter. Overall, this study highlights the importance of non-extensive Tsallis statistics in characterizing the quark-hadron phase structure of the PQM model and contributes to a deeper understanding of non-extensive effects in the quark-hadron phase transition.


title: VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editing

abstract: We present VoiceShop, a novel speech-to-speech framework that can modify multiple attributes of speech, such as age, gender, accent, and speech style, in a single forward pass while preserving the input speaker's timbre. Previous works have been constrained to specialized models that can only edit these attributes individually and suffer from the following pitfalls: the magnitude of the conversion effect is weak, there is no zero-shot capability for out-of-distribution speakers, or the synthesized outputs exhibit undesirable timbre leakage. Our work proposes solutions for each of these issues in a simple modular framework based on a conditional diffusion backbone model with optional normalizing flow-based and sequence-to-sequence speaker attribute-editing modules, whose components can be combined or removed during inference to meet a wide array of tasks without additional model finetuning. Audio samples are available at \url{https://voiceshopai.github.io}.


title: Toward Cross-Layer Energy Optimizations in Machine Learning Systems

abstract: The enormous energy consumption of machine learning (ML) and generative AI workloads shows no sign of waning, taking a toll on operating costs, power delivery, and environmental sustainability. Despite a long line of research on energy-efficient hardware, we found that software plays a critical role in ML energy optimization through two recent works: Zeus and Perseus. This is especially true for large language models (LLMs) because their model sizes and, therefore, energy demands are growing faster than hardware efficiency improvements. Therefore, we advocate for a cross-layer approach for energy optimizations in ML systems, where hardware provides architectural support that pushes energy-efficient software further, while software leverages and abstracts the hardware to develop techniques that bring hardware-agnostic energy-efficiency gains.


title: Topological Feature Search Method for Multichannel EEG: Application in ADHD classification

abstract: In recent years, the preliminary diagnosis of Attention Deficit Hyperactivity Disorder (ADHD) using electroencephalography (EEG) has garnered attention from researchers. EEG, known for its expediency and efficiency, plays a pivotal role in the diagnosis and treatment of ADHD. However, the non-stationarity of EEG signals and inter-subject variability pose challenges to the diagnostic and classification processes. Topological Data Analysis (TDA) offers a novel perspective for ADHD classification, diverging from traditional time-frequency domain features. Yet, conventional TDA models are restricted to single-channel time series and are susceptible to noise, leading to the loss of topological features in persistence diagrams.This paper presents an enhanced TDA approach applicable to multi-channel EEG in ADHD. Initially, optimal input parameters for multi-channel EEG are determined. Subsequently, each channel's EEG undergoes phase space reconstruction (PSR) followed by the utilization of k-Power Distance to Measure (k-PDTM) for approximating ideal point clouds. Then, multi-dimensional time series are re-embedded, and TDA is applied to obtain topological feature information. Gaussian function-based Multivariate Kernel Density Estimation (MKDE) is employed in the merger persistence diagram to filter out desired topological feature mappings. Finally, persistence image (PI) method is utilized to extract topological features, and the influence of various weighting functions on the results is discussed.The effectiveness of our method is evaluated using the IEEE ADHD dataset. Results demonstrate that the accuracy, sensitivity, and specificity reach 85.60%, 83.61%, and 88.33%, respectively. Compared to traditional TDA methods, our method was effectively improved and outperforms typical nonlinear descriptors. These findings indicate that our method exhibits higher precision and robustness.


title: Noise-Tolerance of Majorana Teleportation in Mesoscopic Topological Superconductors

abstract: We investigate teleportation interference associated with the non-local character of Majorana zero modes (MZMs) as a probe of MZMs focusing on the tolerance of teleportation against disturbances, such as inhomogeneous potentials at junctions and disorder. We develop a method for calculating non-local conductance in mesoscopic topological superconductors with fixed parity. In the trivial phase, the non-local conductance exhibits the $h/2e$-periodicity, while in the topological phase with fixed parity, it exhibits the $h/e$-periodicity, indicative of Majorana teleportation. We find that the $h/e$-periodicity is stable against changes in inhomogeneous potential structures and disorder. These results imply that MZMs can cause teleportation interference even in the presence of disturbances, leading to a clear distinction between the trivial and topological phases.


title: Many-defect solutions in planar nematics: interactions, spiral textures and boundary conditions

abstract: From incompressible flows to electrostatics, harmonic functions can provide solutions to many two-dimensional problems and, similarly, the director field of a planar nematic can be determined using complex analysis. We derive a closed-form solution for a quasi-steady state director field induced by an arbitrarily large set of point defects and circular inclusions with or without fixed rotational degrees of freedom, and compute the forces and torques acting on each defect or inclusion. We show that a complete solution must include two types of singularities, generating a defect winding number and its spiral texture, which have a direct effect on defect equilibrium textures and their dynamics. The solution accounts for discrete degeneracy of topologically distinct free energy minima which can be obtained by defect braiding. The derived formalism can be readily applied to equilibrium and slowly evolving nematic textures for active or passive fluids with multiple defects present within the orientational order.


title: Neural Optimizer Equation, Decay Function, and Learning Rate Schedule Joint Evolution

abstract: A major contributor to the quality of a deep learning model is the selection of the optimizer. We propose a new dual-joint search space in the realm of neural optimizer search (NOS), along with an integrity check, to automate the process of finding deep learning optimizers. Our dual-joint search space simultaneously allows for the optimization of not only the update equation, but also internal decay functions and learning rate schedules for optimizers. We search the space using our proposed mutation-only, particle-based genetic algorithm able to be massively parallelized for our domain-specific problem. We evaluate our candidate optimizers on the CIFAR-10 dataset using a small ConvNet. To assess generalization, the final optimizers were then transferred to large-scale image classification on CIFAR- 100 and TinyImageNet, while also being fine-tuned on Flowers102, Cars196, and Caltech101 using EfficientNetV2Small. We found multiple optimizers, learning rate schedules, and Adam variants that outperformed Adam, as well as other standard deep learning optimizers, across the image classification tasks.


title: Onco-Retriever: Generative Classifier for Retrieval of EHR Records in Oncology

abstract: Retrieving information from EHR systems is essential for answering specific questions about patient journeys and improving the delivery of clinical care. Despite this fact, most EHR systems still rely on keyword-based searches. With the advent of generative large language models (LLMs), retrieving information can lead to better search and summarization capabilities. Such retrievers can also feed Retrieval-augmented generation (RAG) pipelines to answer any query. However, the task of retrieving information from EHR real-world clinical data contained within EHR systems in order to solve several downstream use cases is challenging due to the difficulty in creating query-document support pairs. We provide a blueprint for creating such datasets in an affordable manner using large language models. Our method results in a retriever that is 30-50 F-1 points better than propriety counterparts such as Ada and Mistral for oncology data elements. We further compare our model, called Onco-Retriever, against fine-tuned PubMedBERT model as well. We conduct an extensive manual evaluation on real-world EHR data along with latency analysis of the different models and provide a path forward for healthcare organizations to build domain-specific retrievers.


title: Causal Unit Selection using Tractable Arithmetic Circuits

abstract: The unit selection problem aims to find objects, called units, that optimize a causal objective function which describes the objects' behavior in a causal context (e.g., selecting customers who are about to churn but would most likely change their mind if encouraged). While early studies focused mainly on bounding a specific class of counterfactual objective functions using data, more recent work allows one to find optimal units exactly by reducing the causal objective to a classical objective on a meta-model, and then applying a variant of the classical Variable Elimination (VE) algorithm to the meta-model -- assuming a fully specified causal model is available. In practice, however, finding optimal units using this approach can be very expensive because the used VE algorithm must be exponential in the constrained treewidth of the meta-model, which is larger and denser than the original model. We address this computational challenge by introducing a new approach for unit selection that is not necessarily limited by the constrained treewidth. This is done through compiling the meta-model into a special class of tractable arithmetic circuits that allows the computation of optimal units in time linear in the circuit size. We finally present empirical results on random causal models that show order-of-magnitude speedups based on the proposed method for solving unit selection.


title: Learning Multidimensional Disentangled Representations of Instrumental Sounds for Musical Similarity Assessment

abstract: To achieve a flexible recommendation and retrieval system, it is desirable to calculate music similarity by focusing on multiple partial elements of musical pieces and allowing the users to select the element they want to focus on. A previous study proposed using multiple individual networks for calculating music similarity based on each instrumental sound, but it is impractical to use each signal as a query in search systems. Using separated instrumental sounds alternatively resulted in less accuracy due to artifacts. In this paper, we propose a method to compute similarities focusing on each instrumental sound with a single network that takes mixed sounds as input instead of individual instrumental sounds. Specifically, we design a single similarity embedding space with disentangled dimensions for each instrument, extracted by Conditional Similarity Networks, which is trained by the triplet loss using masks. Experimental results have shown that (1) the proposed method can obtain more accurate feature representation than using individual networks using separated sounds as input, (2) each sub-embedding space can hold the characteristics of the corresponding instrument, and (3) the selection of similar musical pieces focusing on each instrumental sound by the proposed method can obtain human consent, especially in drums and guitar.


title: Unsupervised Visible-Infrared ReID via Pseudo-label Correction and Modality-level Alignment

abstract: Unsupervised visible-infrared person re-identification (UVI-ReID) has recently gained great attention due to its potential for enhancing human detection in diverse environments without labeling. Previous methods utilize intra-modality clustering and cross-modality feature matching to achieve UVI-ReID. However, there exist two challenges: 1) noisy pseudo labels might be generated in the clustering process, and 2) the cross-modality feature alignment via matching the marginal distribution of visible and infrared modalities may misalign the different identities from two modalities. In this paper, we first conduct a theoretic analysis where an interpretable generalization upper bound is introduced. Based on the analysis, we then propose a novel unsupervised cross-modality person re-identification framework (PRAISE). Specifically, to address the first challenge, we propose a pseudo-label correction strategy that utilizes a Beta Mixture Model to predict the probability of mis-clustering based network's memory effect and rectifies the correspondence by adding a perceptual term to contrastive learning. Next, we introduce a modality-level alignment strategy that generates paired visible-infrared latent features and reduces the modality gap by aligning the labeling function of visible and infrared features to learn identity discriminative and modality-invariant features. Experimental results on two benchmark datasets demonstrate that our method achieves state-of-the-art performance than the unsupervised visible-ReID methods.


title: Beyond trees: the metric geometry of subsets of weighted Hamming cubes

abstract: Associated to any finite metric space are a large number of objects and quantities which provide some degree of structural or geometric information about the space. In this paper we show that in the setting of subsets of weighted Hamming cubes there are unexpected relationships between many of these quantities. We obtain in particular formulas for the determinant of the distance matrix, the $M$-constant and the cofactor sum for such spaces. This work extends previous results for unweighted metric trees, and more generally, for subsets of standard Hamming cubes, as well as results for weighted metric trees. Finally we consider polygonal equalities in these spaces, giving a complete description of nontrivial $1$-polygonal equalities that can arise in weighted Hamming cubes.