title: On Repairing Natural Language to SQL Queries

abstract: Data analysts use SQL queries to access and manipulate data on their databases. However, these queries are often challenging to write, and small mistakes can lead to unexpected data output. Recent work has explored several ways to automatically synthesize queries based on a user-provided specification. One promising technique called text-to-SQL consists of the user providing a natural language description of the intended behavior and the database's schema. Even though text-to-SQL tools are becoming more accurate, there are still many instances where they fail to produce the correct query. In this paper, we analyze when text-to-SQL tools fail to return the correct query and show that it is often the case that the returned query is close to a correct query. We propose to repair these failing queries using a mutation-based approach that is agnostic to the text-to-SQL tool being used. We evaluate our approach on two recent text-to-SQL tools, RAT-SQL and SmBoP, and show that our approach can repair a significant number of failing queries.


title: Rational Points Near Manifolds, Homogeneous Dynamics, and Oscillatory Integrals

abstract: Let $\mathcal{M}\subset \mathbb{R}^n$ be a compact and sufficiently smooth manifold of dimension $d$. Suppose $\mathcal{M}$ is nowhere completely flat. Let $N_{\mathcal{M}}(\delta,Q)$ denote the number of rational vectors $\mathbf{a}/q$ within a distance of $\delta/q$ from $\mathcal{M}$ so that $q \in [Q,2Q)$. We develop a novel method to analyse $N_{\mathcal{M}}(\delta,Q)$. The salient feature of our technique is the combination of powerful quantitative non-divergence estimates, in a form due to Bernik, Kleinbock, and Margulis, with Fourier analytic tools. The second ingredient enables us to eschew the Dani correspondence and an explicit use of the geometry of numbers. We employ this new method to address in a strong sense a problem of Beresnevich regarding lower bounds on $N_{\mathcal{M}}(\delta,Q)$ for non-analytic manifolds. Additionally, we obtain asymptotic formulae which are the first of their kind for such a general class of manifolds. As a by-product, we improve upon upper bounds on $N_{\mathcal{M}}(\delta,Q)$ from a recent breakthrough of Beresnevich and Yang and recover their convergence Khintchine type theorem for arbitrary nondegenerate submanifolds. Moreover, we obtain new Hausdorff dimension and measure refinements for the set of well-approximable points for a range of Diophantine exponents close to $1/n$.


title: On the finite separability of finitely generated commutative rings

abstract: We find necessary and sufficient conditions for the finite separability of finitely generated commutative rings. Namely, we prove that every such ring is a finite extension of its torsion ideal $I_k$ where $k$ is square-free, and $I_k$ is a subdirect product of a finite ring and finitely many zero divisor-free rings of prime characteristic each of which is an entire extension of any of its infinite monogenic subrings.


title: Comparison of different definitions of pseudocharacters

abstract: We prove that the definitions of a $d$-dimensional pseudocharacter (or pseudorepresentation) given by Chenevier and V. Lafforgue agree over any ring. We also compare the scheme of Lafforgue's $G$-pseudocharacters of a group with its $G$-character variety.


title: Consistency Regularization Improves Placenta Segmentation in Fetal EPI MRI Time Series

abstract: The placenta plays a crucial role in fetal development. Automated 3D placenta segmentation from fetal EPI MRI holds promise for advancing prenatal care. This paper proposes an effective semi-supervised learning method for improving placenta segmentation in fetal EPI MRI time series. We employ consistency regularization loss that promotes consistency under spatial transformation of the same image and temporal consistency across nearby images in a time series. The experimental results show that the method improves the overall segmentation accuracy and provides better performance for outliers and hard samples. The evaluation also indicates that our method improves the temporal coherency of the prediction, which could lead to more accurate computation of temporal placental biomarkers. This work contributes to the study of the placenta and prenatal clinical decision-making. Code is available at https://github.com/firstmover/cr-seg.


title: A note on a $L^p$ stability estimate for regular Lagrangian flows

abstract: In this note, we prove a $L^p$ version of the well known stability estimate for regular Lagrangian flows derived by Gianluca Crippa and Camillo De Lellis in \cite{crippa2008estimates}. As far as we know, the only estimate of this kind readily available in the literature is for the case $p=1$. With minor modifications to the proof in \cite{crippa2008estimates}, we show that an analogous estimate holds in $L^p$ norm with $p \in (1, + \infty)$.


title: FNOSeg3D: Resolution-Robust 3D Image Segmentation with Fourier Neural Operator

abstract: Due to the computational complexity of 3D medical image segmentation, training with downsampled images is a common remedy for out-of-memory errors in deep learning. Nevertheless, as standard spatial convolution is sensitive to variations in image resolution, the accuracy of a convolutional neural network trained with downsampled images can be suboptimal when applied on the original resolution. To address this limitation, we introduce FNOSeg3D, a 3D segmentation model robust to training image resolution based on the Fourier neural operator (FNO). The FNO is a deep learning framework for learning mappings between functions in partial differential equations, which has the appealing properties of zero-shot super-resolution and global receptive field. We improve the FNO by reducing its parameter requirement and enhancing its learning capability through residual connections and deep supervision, and these result in our FNOSeg3D model which is parameter efficient and resolution robust. When tested on the BraTS'19 dataset, it achieved superior robustness to training image resolution than other tested models with less than 1% of their model parameters.


title: Neuromorphic Robust Framework for Concurrent Estimation and Control in Dynamical Systems using Spiking Neural Networks

abstract: Concurrent estimation and control of robotic systems remains an ongoing challenge, where controllers rely on data extracted from states/parameters riddled with uncertainties and noises. Framework suitability hinges on task complexity and computational constraints, demanding a balance between computational efficiency and mission-critical accuracy. This study leverages recent advancements in neuromorphic computing, particularly spiking neural networks (SNNs), for estimation and control applications. Our presented framework employs a recurrent network of leaky integrate-and-fire (LIF) neurons, mimicking a linear quadratic regulator (LQR) through a robust filtering strategy, a modified sliding innovation filter (MSIF). Benefiting from both the robustness of MSIF and the computational efficiency of SNN, our framework customizes SNN weight matrices to match the desired system model without requiring training. Additionally, the network employs a biologically plausible firing rule similar to predictive coding. In the presence of uncertainties, we compare the SNN-LQR-MSIF with non-spiking LQR-MSIF and the optimal linear quadratic Gaussian (LQG) strategy. Evaluation across a workbench linear problem and a satellite rendezvous maneuver, implementing the Clohessy-Wiltshire (CW) model in space robotics, demonstrates that the SNN-LQR-MSIF achieves acceptable performance in computational efficiency, robustness, and accuracy. This positions it as a promising solution for addressing dynamic systems' concurrent estimation and control challenges in dynamic systems.


title: Benchmarking a foundation LLM on its ability to re-label structure names in accordance with the AAPM TG-263 report

abstract: Purpose: To introduce the concept of using large language models (LLMs) to re-label structure names in accordance with the American Association of Physicists in Medicine (AAPM) Task Group (TG)-263 standard, and to establish a benchmark for future studies to reference. Methods and Materials: The Generative Pre-trained Transformer (GPT)-4 application programming interface (API) was implemented as a Digital Imaging and Communications in Medicine (DICOM) storage server, which upon receiving a structure set DICOM file, prompts GPT-4 to re-label the structure names of both target volumes and normal tissues according to the AAPM TG-263. Three disease sites, prostate, head and neck, and thorax were selected for evaluation. For each disease site category, 150 patients were randomly selected for manually tuning the instructions prompt (in batches of 50) and 50 patients were randomly selected for evaluation. Structure names that were considered were those that were most likely to be relevant for studies utilizing structure contours for many patients. Results: The overall re-labeling accuracy of both target volumes and normal tissues for prostate, head and neck, and thorax cases was 96.0%, 98.5%, and 96.9% respectively. Re-labeling of target volumes was less accurate on average except for prostate - 100%, 93.1%, and 91.1% respectively. Conclusions: Given the accuracy of GPT-4 in re-labeling structure names of both target volumes and normal tissues as presented in this work, LLMs are poised to be the preferred method for standardizing structure names in radiation oncology, especially considering the rapid advancements in LLM capabilities that are likely to continue.


title: Sheaves of Measures and KMS-Weights on Topological Graph Algebras

abstract: We show that the collection of regular Borel measures on a second-countable locally compact Hausdorff space has the structure of a sheaf. With this we give an alternate description of the pullback of a regular Borel measure along a local homeomorphism. We are able to use these tools to give a description of the KMS-weights for the gauge-action on the graph C*-algebra of a second-countable topological graph in terms of sub-invariant measures on the vertex space of said topological graph.


title: Towards Developing Mid-Infrared Photonics Using Mxenes

abstract: Recent research and development in the mid-infrared (IR) wavelength range (2-20 um) for a variety of applications, such as trace gas monitoring, thermal imaging, and free space communications have shown tremendous and fascinating progress. MXenes, which mainly refer to two-dimensional (2D) transition-metal carbides, nitrides, and carbonitrides, have drawn a lot of interest since their first investigation in 2011. MXenes project enormous potential for use in optoelectronics, photonics, catalysis, and energy harvesting fields proven by extensive experimental and theoretical studies over a decade. MXenes offers a novel 2D nano platform for cutting-edge optoelectronics devices due to their interesting mechanical, optical, and electrical capabilities, along with their elemental and chemical composition. We here discuss the key developments of MXene emphasizing the evolution of material synthesis methods over time and the resulting device applications. Photonic and optoelectronic device design and fabrication for mid-IR photonics are demonstrated by integrating MXene materials with various electrical and photonic platforms. Here, we show the potential of using Mxene in photonics for mid-IR applications and a pathway toward achieving next-generation devices for various applications.


title: Sturm-Hurwitz Theorem for quantum graphs

abstract: We prove upper and lower bounds for the number of zeroes of linear combinations of Schr\"odinger eigenfunctions on metric (quantum) graphs. These bounds are distinct from both the interval and manifolds. We complement these bounds by giving non-trivial examples for the lower bound as well as sharp examples for the upper bound. In particular, we show that even tree graphs differ from the interval with respect to the nodal count of linear combinations of eigenfunctions. This stands in distinction to previous results which show that all tree graphs have to same eigenfunction nodal count as the interval.


title: Automatic and Human-AI Interactive Text Generation

abstract: In this tutorial, we focus on text-to-text generation, a class of natural language generation (NLG) tasks, that takes a piece of text as input and then generates a revision that is improved according to some specific criteria (e.g., readability or linguistic styles), while largely retaining the original meaning and the length of the text. This includes many useful applications, such as text simplification, paraphrase generation, style transfer, etc. In contrast to text summarization and open-ended text completion (e.g., story), the text-to-text generation tasks we discuss in this tutorial are more constrained in terms of semantic consistency and targeted language styles. This level of control makes these tasks ideal testbeds for studying the ability of models to generate text that is both semantically adequate and stylistically appropriate. Moreover, these tasks are interesting from a technical standpoint, as they require complex combinations of lexical and syntactical transformations, stylistic control, and adherence to factual knowledge, -- all at once. With a special focus on text simplification and revision, this tutorial aims to provide an overview of the state-of-the-art natural language generation research from four major aspects -- Data, Models, Human-AI Collaboration, and Evaluation -- and to discuss and showcase a few significant and recent advances: (1) the use of non-retrogressive approaches; (2) the shift from fine-tuning to prompting with large language models; (3) the development of new learnable metric and fine-grained human evaluation framework; (4) a growing body of studies and datasets on non-English languages; (5) the rise of HCI+NLP+Accessibility interdisciplinary research to create real-world writing assistant systems.


title: Non Commutative Convolutional Signal Models in Neural Networks: Stability to Small Deformations

abstract: In this paper we discuss the results recently published in~[1] about algebraic signal models (ASMs) based on non commutative algebras and their use in convolutional neural networks. Relying on the general tools from algebraic signal processing (ASP), we study the filtering and stability properties of non commutative convolutional filters. We show how non commutative filters can be stable to small perturbations on the space of operators. We also show that although the spectral components of the Fourier representation in a non commutative signal model are associated to spaces of dimension larger than one, there is a trade-off between stability and selectivity similar to that observed for commutative models. Our results have direct implications for group neural networks, multigraph neural networks and quaternion neural networks, among other non commutative architectures. We conclude by corroborating these results through numerical experiments.


title: Linear cooling of a levitated micromagnetic cylinder by vibration

abstract: We report feedback cooling of translational and librational degrees of freedom of a levitated micromagnet cylinder, utilizing a piezoelectric actuator to apply linear feedback to high-Q mechanical modes. The normal modes are measured with a superconducting pick-up coil coupled to a DC SQUID, and phase information is fed back to the piezoelectric actuator to feedback cool a center-of-mass mode to ~$\sim$~7~K, and a librational mode to $830 \pm 200$~mK. Q-factors of $1.0 \times 10^7$ are evaluated for the center-of-mass mode. We find that it is plausible to achieve ground state cooling of the center-of-mass mode by introducing vibration isolation, optimizing the geometry of the pick-up coil to focus on the specific mode of interest and utilizing a state-of-the-art SQUID for detection.


title: Thermally driven fluid convection in the incompressible limit regime

abstract: We consider a scaled Navier--Stokes--Fourier system describing the motion of a compressible, heat-conducting, viscous fluid driven by inhomogeneous boundary temperature distribution together with the gravitational force of a massive object placed outside the fluid. We identify the limit system in the low Mach/low Froude number regime for the ill prepared initial data. The fluid is confined to a bounded cavity with acoustically hard boundary enhancing reflection of acoustic waves.


title: Small batch deep reinforcement learning

abstract: In value-based deep reinforcement learning with replay memories, the batch size parameter specifies how many transitions to sample for each gradient update. Although critical to the learning process, this value is typically not adjusted when proposing new algorithms. In this work we present a broad empirical study that suggests {\em reducing} the batch size can result in a number of significant performance gains; this is surprising, as the general tendency when training neural networks is towards larger batch sizes for improved performance. We complement our experimental findings with a set of empirical analyses towards better understanding this phenomenon.


title: Surrogate-based Real-time Curbside Management for Ride-hailing and Delivery Operations

abstract: The present work investigates surrogate model-based optimization for real-time curbside traffic management operations. An optimization problem is formulated to minimize the congestion on roadway segments caused by vehicles stopping on the segment (e.g., ride-hailing or delivery operations) and implemented in a model predictive control framework. A hybrid simulation approach where main traffic flows interact with individually modeled stopping vehicles is adopted. Due to its non-linearity, the optimization problem is coupled with a meta-heuristic. However, because simulations are time expensive and hence unsuitable for real-time control, a trained surrogate model that takes the decision variables as inputs and approximates the objective function is employed to replace the simulation within the meta-heuristic algorithm. Several modeling techniques (i.e., linear regression, polynomial regression, neural network, radial basis network, regression tree ensemble, and Gaussian process regression) are compared based on their accuracy in reproducing solutions to the problem and computational tractability for real-time control under different configurations of simulation parameters. It is found that Gaussian process regression is the most suited for use as a surrogate model for the given problem. Finally, a realistic application with multiple ride-hailing vehicle operations is presented. The proposed approach for controlling the stop positions of vehicles is able to achieve an improvement of 20.65% over the uncontrolled case. The example shows the potential of the proposed approach in reducing the negative impacts of stopping vehicles and favorable computational properties.


title: Information Geometry for the Working Information Theorist

abstract: Information geometry is a study of statistical manifolds, that is, spaces of probability distributions from a geometric perspective. Its classical information-theoretic applications relate to statistical concepts such as Fisher information, sufficient statistics, and efficient estimators. Today, information geometry has emerged as an interdisciplinary field that finds applications in diverse areas such as radar sensing, array signal processing, quantum physics, deep learning, and optimal transport. This article presents an overview of essential information geometry to initiate an information theorist, who may be unfamiliar with this exciting area of research. We explain the concepts of divergences on statistical manifolds, generalized notions of distances, orthogonality, and geodesics, thereby paving the way for concrete applications and novel theoretical investigations. We also highlight some recent information-geometric developments, which are of interest to the broader information theory community.

categories: cs.IT cs.LG eess.SP math.DG math.IT stat.ML


title: Trustworthy Formal Natural Language Specifications

abstract: Interactive proof assistants are computer programs carefully constructed to check a human-designed proof of a mathematical claim with high confidence in the implementation. However, this only validates truth of a formal claim, which may have been mistranslated from a claim made in natural language. This is especially problematic when using proof assistants to formally verify the correctness of software with respect to a natural language specification. The translation from informal to formal remains a challenging, time-consuming process that is difficult to audit for correctness. This paper shows that it is possible to build support for specifications written in expressive subsets of natural language, within existing proof assistants, consistent with the principles used to establish trust and auditability in proof assistants themselves. We implement a means to provide specifications in a modularly extensible formal subset of English, and have them automatically translated into formal claims, entirely within the Lean proof assistant. Our approach is extensible (placing no permanent restrictions on grammatical structure), modular (allowing information about new words to be distributed alongside libraries), and produces proof certificates explaining how each word was interpreted and how the sentence's structure was used to compute the meaning. We apply our prototype to the translation of various English descriptions of formal specifications from a popular textbook into Lean formalizations; all can be translated correctly with a modest lexicon with only minor modifications related to lexicon size.


title: Demonstration of a monocrystalline GaAs-$\beta$-Ga$_2$O$_3$ p-n heterojunction

abstract: In this work, we report the fabrication and characterizations of a monocrystalline GaAs/$\beta$-Ga$_2$O$_3$ p-n heterojunction by employing semiconductor grafting technology. The heterojunction was created by lifting off and transfer printing a p-type GaAs single crystal nanomembrane to an Al$_2$O$_3$-coated n-type$\beta$-Ga$_2$O$_3$ epitaxial substrate. The resultant heterojunction diodes exhibit remarkable performance metrics, including an ideality factor of 1.23, a high rectification ratio of 8.04E9 at +/- 4V, and a turn on voltage of 2.35 V. Furthermore, at +5 V, the diode displays a large current density of 2500 A/cm$^2$ along with a low ON resistance of 2 m$\Omega\cdot$cm$^2$.


title: Performance of periodic EOM-CCSD for band gaps of inorganic semiconductors and insulators

abstract: We calculate the band gaps of 12 inorganic semiconductors and insulators composed of atoms from the first three rows of the periodic table using periodic equation-of-motion coupled-cluster theory with single and double excitations (EOM-CCSD). Our calculations are performed with atom-centered triple-zeta basis sets and up to 64 $k$-points in the Brillouin zone. We analyze the convergence behavior with respect to number of orbitals and number of $k$-points sampled, using composite corrections and extrapolations to produce our final values. When accounting for electron-phonon corrections to experimental band gaps, we find that EOM-CCSD has a mean signed error of $-0.12$ eV and a mean absolute error of $0.42$ eV; the largest outliers are C (error of $-0.93$ eV), BP ($-1.00$ eV), and LiH ($+0.78$ eV). Surprisingly, we find that the more affordable partitioned EOM-MP2 theory performs as well as EOM-CCSD.


title: Frequency Domain Analysis of Nonlinear Series Elastic Actuator via Describing Function

abstract: Nonlinear stiffness SEAs (NSEAs) inspired by biological muscles offer promise in achieving adaptable stiffness for assistive robots. While assistive robots are often designed and compared based on torque capability and control bandwidth, NSEAs have not been systematically designed in the frequency domain due to their nonlinearity. The describing function, an analytical concept for nonlinear systems, offers a means to understand their behavior in the frequency domain. This paper introduces a frequency domain analysis of nonlinear series elastic actuators using the describing function method. This framework aims to equip researchers and engineers with tools for improved design and control in assistive robotics.


title: Audio Event-Relational Graph Representation Learning for Acoustic Scene Classification

abstract: Most deep learning-based acoustic scene classification (ASC) approaches identify scenes based on acoustic features converted from audio clips containing mixed information entangled by polyphonic audio events (AEs). However, these approaches have difficulties in explaining what cues they use to identify scenes. This paper conducts the first study on disclosing the relationship between real-life acoustic scenes and semantic embeddings from the most relevant AEs. Specifically, we propose an event-relational graph representation learning (ERGL) framework for ASC to classify scenes, and simultaneously answer clearly and straightly which cues are used in classifying. In the event-relational graph, embeddings of each event are treated as nodes, while relationship cues derived from each pair of nodes are described by multi-dimensional edge features. Experiments on a real-life ASC dataset show that the proposed ERGL achieves competitive performance on ASC by learning embeddings of only a limited number of AEs. The results show the feasibility of recognizing diverse acoustic scenes based on the audio event-relational graph. Visualizations of graph representations learned by ERGL are available here (https://github.com/Yuanbo2020/ERGL).


title: Accelerated Neural Network Training with Rooted Logistic Objectives

abstract: Many neural networks deployed in the real world scenarios are trained using cross entropy based loss functions. From the optimization perspective, it is known that the behavior of first order methods such as gradient descent crucially depend on the separability of datasets. In fact, even in the most simplest case of binary classification, the rate of convergence depends on two factors: (1) condition number of data matrix, and (2) separability of the dataset. With no further pre-processing techniques such as over-parametrization, data augmentation etc., separability is an intrinsic quantity of the data distribution under consideration. We focus on the landscape design of the logistic function and derive a novel sequence of {\em strictly} convex functions that are at least as strict as logistic loss. The minimizers of these functions coincide with those of the minimum norm solution wherever possible. The strict convexity of the derived function can be extended to finetune state-of-the-art models and applications. In empirical experimental analysis, we apply our proposed rooted logistic objective to multiple deep models, e.g., fully-connected neural networks and transformers, on various of classification benchmarks. Our results illustrate that training with rooted loss function is converged faster and gains performance improvements. Furthermore, we illustrate applications of our novel rooted loss function in generative modeling based downstream applications, such as finetuning StyleGAN model with the rooted loss. The code implementing our losses and models can be found here for open source software development purposes: https://anonymous.4open.science/r/rooted_loss.


title: HDNA: A graph-based change detection in HTML pages(Deface Attack Detection)

abstract: In this paper, a new approach called HDNA (HTML DNA) is introduced for analyzing and comparing Document Object Model (DOM) trees in order to detect differences in HTML pages. This method assigns an identifier to each HTML page based on its structure, which proves to be particularly useful for detecting variations caused by server-side updates, user interactions or potential security risks. The process involves preprocessing the HTML content generating a DOM tree and calculating the disparities between two or more trees. By assigning weights to the nodes valuable insights about their hierarchical importance are obtained. The effectiveness of the HDNA approach has been demonstrated in identifying changes in DOM trees even when dynamically generated content is involved. Not does this method benefit web developers, testers, and security analysts by offering a deeper understanding of how web pages evolve. It also helps ensure the functionality and performance of web applications. Additionally, it enables detection and response to vulnerabilities that may arise from modifications in DOM structures. As the web ecosystem continues to evolve HDNA proves to be a tool, for individuals engaged in web development, testing, or security analysis.


title: New resonance scattering model in AtomDB: application to line suppression in galaxy clusters and elliptical galaxies

abstract: In this paper, we present a simple, one-step, self-consistent, and fast resonance scattering model rsapec based on the AtomDB database. This model can be used as an alternative to the commonly used APEC model for fitting such X-ray spectra with optically thick lines. The current model is intended, in general, for verifying the presence of the effect and for spectral modeling of galaxy clusters and elliptical galaxies under applicable assumptions. We test rsapec to derive the line suppression in the elliptical galaxy NGC 4636 and the Perseus cluster of galaxies and obtain resonance suppression of ~ 1.24 and ~ 1.30, respectively.


title: Characterizing the Features of Mitotic Figures Using a Conditional Diffusion Probabilistic Model

abstract: Mitotic figure detection in histology images is a hard-to-define, yet clinically significant task, where labels are generated with pathologist interpretations and where there is no ``gold-standard'' independent ground-truth. However, it is well-established that these interpretation based labels are often unreliable, in part, due to differences in expertise levels and human subjectivity. In this paper, our goal is to shed light on the inherent uncertainty of mitosis labels and characterize the mitotic figure classification task in a human interpretable manner. We train a probabilistic diffusion model to synthesize patches of cell nuclei for a given mitosis label condition. Using this model, we can then generate a sequence of synthetic images that correspond to the same nucleus transitioning into the mitotic state. This allows us to identify different image features associated with mitosis, such as cytoplasm granularity, nuclear density, nuclear irregularity and high contrast between the nucleus and the cell body. Our approach offers a new tool for pathologists to interpret and communicate the features driving the decision to recognize a mitotic figure.


title: Using Clustering to Understand Intra-city Warming in Heatwaves: Insights into Paris, Montreal, and Zurich

abstract: We introduce a novel methodological advancement by clustering paired near-surface air temperature with the planetary boundary layer height (PBLH) to characterize intra-city clusters for analytics. To illustrate this approach, we analyze three heatwaves (HW): the 2019 HW in Paris, the 2018 HW in Montreal, and the 2017 HW in Zurich. We assess cluster-based characteristics before, during, and after heatwave events. Using the objective hysteresis model, we determine the overall strength coefficient of the hysteresis loop between ground storage flux and all-wave downward radiative flux, ranging from 0.414 to 0.457 for urban clusters and from 0.126 to 0.157 for rural clusters during the heatwave periods. Across all cities, we observe a consistent refueling-restoration mode in the cumulative ground heat flux as the heatwaves progress. Future developments of this proposed two-component clustering approach, with the integration of more influential physics, will offer a more comprehensive characterization of cities for urban climate analytics.


title: TWICE Dataset: Digital Twin of Test Scenarios in a Controlled Environment

abstract: Ensuring the safe and reliable operation of autonomous vehicles under adverse weather remains a significant challenge. To address this, we have developed a comprehensive dataset composed of sensor data acquired in a real test track and reproduced in the laboratory for the same test scenarios. The provided dataset includes camera, radar, LiDAR, inertial measurement unit (IMU), and GPS data recorded under adverse weather conditions (rainy, night-time, and snowy conditions). We recorded test scenarios using objects of interest such as car, cyclist, truck and pedestrian -- some of which are inspired by EURONCAP (European New Car Assessment Programme). The sensor data generated in the laboratory is acquired by the execution of simulation-based tests in hardware-in-the-loop environment with the digital twin of each real test scenario. The dataset contains more than 2 hours of recording, which totals more than 280GB of data. Therefore, it is a valuable resource for researchers in the field of autonomous vehicles to test and improve their algorithms in adverse weather conditions, as well as explore the simulation-to-reality gap. The dataset is available for download at: https://twicedataset.github.io/site/


title: Dispersive Drumhead States in Nodal-Line Semimetal Junctions

abstract: We consider a smooth interface between a topological nodal-line semimetal and a topologically trivial insulator (e.g., the vacuum) or another semimetal with a nodal ring of different radius. Using a low-energy effective Hamiltonian including only the two crossing bands, we show that these junctions accommodate a two-dimensional zero-energy level and a set of two-dimensional dispersive bands, corresponding to states localized at the interface. We characterize the spectrum, identifying the parameter ranges in which these states are present, and highlight the role of the nodal radius and the smoothness of the interface. We also suggest material-independent ways to detect and identify these states, using optical conductivity and infrared absorption spectroscopy in magnetic field.


title: Break-Resilient Codes for Forensic 3D Fingerprinting

abstract: 3D printing brings about a revolution in consumption and distribution of goods, but poses a significant risk to public safety. Any individual with internet access and a commodity printer can now produce untraceable firearms, keys, and dangerous counterfeit products. To aid government authorities in combating these new security threats, objects are often tagged with identifying information. This information, also known as fingerprints, is written into the object using various bit embedding techniques, such as varying the width of the molten thermoplastic layers. Yet, due to the adversarial nature of the problem, it is important to devise tamper resilient fingerprinting techniques, so that the fingerprint could be extracted even if the object was damaged. While fingerprinting various forms of digital media (such as videos, images, etc.) has been studied extensively in the past, 3D printing is a relatively new medium which is exposed to different types of adversarial physical tampering that do not exist in the digital world. This paper focuses on one such type of adversarial tampering, where the adversary breaks the object to at most a certain number of parts. This gives rise to a new adversarial coding problem, which is formulated and investigated herein. We survey the existing technology, present an abstract problem definition, provide lower bounds for the required redundancy, and construct a code which attains it up to asymptotically small factors. Notably, the problem bears some resemblance to the torn paper channel, which was recently studied for applications in DNA storage.


title: Class-Incremental Learning Using Generative Experience Replay Based on Time-aware Regularization

abstract: Learning new tasks accumulatively without forgetting remains a critical challenge in continual learning. Generative experience replay addresses this challenge by synthesizing pseudo-data points for past learned tasks and later replaying them for concurrent training along with the new tasks' data. Generative replay is the best strategy for continual learning under a strict class-incremental setting when certain constraints need to be met: (i) constant model size, (ii) no pre-training dataset, and (iii) no memory buffer for storing past tasks' data. Inspired by the biological nervous system mechanisms, we introduce a time-aware regularization method to dynamically fine-tune the three training objective terms used for generative replay: supervised learning, latent regularization, and data reconstruction. Experimental results on major benchmarks indicate that our method pushes the limit of brain-inspired continual learners under such strict settings, improves memory retention, and increases the average performance over continually arriving tasks.


title: CrysFormer: Protein Structure Prediction via 3d Patterson Maps and Partial Structure Attention

abstract: Determining the structure of a protein has been a decades-long open question. A protein's three-dimensional structure often poses nontrivial computation costs, when classical simulation algorithms are utilized. Advances in the transformer neural network architecture -- such as AlphaFold2 -- achieve significant improvements for this problem, by learning from a large dataset of sequence information and corresponding protein structures. Yet, such methods only focus on sequence information; other available prior knowledge, such as protein crystallography and partial structure of amino acids, could be potentially utilized. To the best of our knowledge, we propose the first transformer-based model that directly utilizes protein crystallography and partial structure information to predict the electron density maps of proteins. Via two new datasets of peptide fragments (2-residue and 15-residue) , we demonstrate our method, dubbed \texttt{CrysFormer}, can achieve accurate predictions, based on a much smaller dataset size and with reduced computation costs.


title: A Game Approach to Multi-dimensional Opinion Dynamics in Social Networks with Stubborn Strategist Agents

abstract: In a social network, individuals express their opinions on several interdependent topics, and therefore the evolution of their opinions on these topics is also mutually dependent. In this work, we propose a differential game model for the multi-dimensional opinion formation of a social network whose population of agents interacts according to a communication graph. Each individual's opinion evolves according to an aggregation of disagreements between the agent's opinions and its graph neighbors on multiple interdependent topics exposed to an unknown extraneous disturbance. For a social network with strategist agents the opinions evolve over time with respect to the minimization of a quadratic cost function that solely represents each individual's motives against the disturbance. We find the unique Nash/worst-case equilibrium solution for the proposed differential game model of coupled multi-dimensional opinions under an open-loop information structure. Moreover, we propose a distributed implementation of the Nash/worst-case equilibrium solution. We examine the non-distributed and proposed distributed open-loop Nash/worst-case strategies on a small social network with strategist agents in a two-dimensional opinion space. Then we compare the opinions evolved based on the Nash/worst-case strategy with the opinions corresponding to social optimality actions for non-strategist agents.


title: Challenges and Insights: Exploring 3D Spatial Features and Complex Networks on the MISP Dataset

abstract: Multi-channel multi-talker speech recognition presents formidable challenges in the realm of speech processing, marked by issues such as background noise, reverberation, and overlapping speech. Overcoming these complexities requires leveraging contextual cues to separate target speech from a cacophonous mix, enabling accurate recognition. Among these cues, the 3D spatial feature has emerged as a cutting-edge solution, particularly when equipped with spatial information about the target speaker. Its exceptional ability to discern the target speaker within mixed audio, often rendering intermediate processing redundant, paves the way for the direct training of "All-in-one" ASR models. These models have demonstrated commendable performance on both simulated and real-world data. In this paper, we extend this approach to the MISP dataset to further validate its efficacy. We delve into the challenges encountered and insights gained when applying 3D spatial features to MISP, while also exploring preliminary experiments involving the replacement of these features with more complex input and models.


title: Provable benefits of annealing for estimating normalizing constants: Importance Sampling, Noise-Contrastive Estimation, and beyond

abstract: Recent research has developed several Monte Carlo methods for estimating the normalization constant (partition function) based on the idea of annealing. This means sampling successively from a path of distributions that interpolate between a tractable "proposal" distribution and the unnormalized "target" distribution. Prominent estimators in this family include annealed importance sampling and annealed noise-contrastive estimation (NCE). Such methods hinge on a number of design choices: which estimator to use, which path of distributions to use and whether to use a path at all; so far, there is no definitive theory on which choices are efficient. Here, we evaluate each design choice by the asymptotic estimation error it produces. First, we show that using NCE is more efficient than the importance sampling estimator, but in the limit of infinitesimal path steps, the difference vanishes. Second, we find that using the geometric path brings down the estimation error from an exponential to a polynomial function of the parameter distance between the target and proposal distributions. Third, we find that the arithmetic path, while rarely used, can offer optimality properties over the universally-used geometric path. In fact, in a particular limit, the optimal path is arithmetic. Based on this theory, we finally propose a two-step estimator to approximate the optimal path in an efficient way.


title: LLM-Coordination: Evaluating and Analyzing Multi-agent Coordination Abilities in Large Language Models

abstract: The emergent reasoning and Theory of Mind (ToM) abilities demonstrated by Large Language Models (LLMs) make them promising candidates for developing coordination agents. In this study, we introduce a new LLM-Coordination Benchmark aimed at a detailed analysis of LLMs within the context of Pure Coordination Games, where participating agents need to cooperate for the most gain. This benchmark evaluates LLMs through two distinct tasks: (1) \emph{Agentic Coordination}, where LLMs act as proactive participants for cooperation in 4 pure coordination games; (2) \emph{Coordination Question Answering (QA)}, where LLMs are prompted to answer 198 multiple-choice questions from the 4 games for evaluation of three key reasoning abilities: Environment Comprehension, ToM Reasoning, and Joint Planning. Furthermore, to enable LLMs for multi-agent coordination, we introduce a Cognitive Architecture for Coordination (CAC) framework that can easily integrate different LLMs as plug-and-play modules for pure coordination games. Our findings indicate that LLM agents equipped with GPT-4-turbo achieve comparable performance to state-of-the-art reinforcement learning methods in games that require commonsense actions based on the environment. Besides, zero-shot coordination experiments reveal that, unlike RL methods, LLM agents are robust to new unseen partners. However, results on Coordination QA show a large room for improvement in the Theory of Mind reasoning and joint planning abilities of LLMs. The analysis also sheds light on how the ability of LLMs to understand their environment and their partner's beliefs and intentions plays a part in their ability to plan for coordination. Our code is available at \url{https://github.com/eric-ai-lab/llm_coordination}.


title: Velocity-Resolved Reverberation Mapping of NGC 3227

abstract: We describe the results of a new reverberation mapping program focused on the nearby Seyfert galaxy NGC 3227. Photometric and spectroscopic monitoring were carried out from 2022 December to 2023 June with the Las Cumbres Observatory network of telescopes. We detected time delays in several optical broad emission lines, with H$\beta$ having the longest delay at $\tau_{\rm cent}=4.0^{+0.9}_{-0.9}$ days and He II having the shortest delay with $\tau_{\rm cent}=0.9^{+1.1}_{-0.8}$ days. We also detect velocity-resolved behavior of the H$\beta$ emission line, with different line-of-sight velocities corresponding to different observed time delays. Combining the integrated H$\beta$ time delay with the width of the variable component of the emission line and a standard scale factor suggests a black hole mass of $M_{\rm BH}=1.1^{+0.2}_{-0.3} \times 10^7 M_{\odot}$. Modeling of the full velocity-resolved response of the H$\beta$ emission line with the phenomenological code CARAMEL finds a similar mass of $M_{\rm BH}=1.2^{+1.5}_{-0.7} \times 10^7 M_{\odot}$, and suggests that the H$\beta$-emitting broad line region (BLR) may be represented by a biconical or flared disk structure that we are viewing at an inclination angle of $\theta_i \approx 33^{\circ}$ and with gas motions that are dominated by rotation. The new photoionization-based BLR modeling tool BELMAC finds general agreement with the observations when assuming the best-fit CARAMEL results, however BELMAC prefers a thick disk geometry and kinematics that are equally comprised of rotation and inflow. Both codes infer a radially extended and flattened BLR that is not outflowing.


title: A remark on the product by the hyperplane class in the Chow ring of some complete intersections

abstract: By classical calculation, for a smooth hypersurface $Y\subset \mathbb P^{n+1}_{\mathbb C}$, the product by the hyperplane class is zero on homologically trivial rational cycles i.e. $H_{|Y}\cdot :{\rm CH}_i(Y)_{hom,\mathbb Q}\rightarrow {\rm CH}_{i-1}(Y)_{hom,\mathbb Q}$ is $0$ for any $i$. This note extends that result to some complete intersections.


title: PyDCM: Custom Data Center Models with Reinforcement Learning for Sustainability

abstract: The increasing global emphasis on sustainability and reducing carbon emissions is pushing governments and corporations to rethink their approach to data center design and operation. Given their high energy consumption and exponentially large computational workloads, data centers are prime candidates for optimizing power consumption, especially in areas such as cooling and IT energy usage. A significant challenge in this pursuit is the lack of a configurable and scalable thermal data center model that offers an end-to-end pipeline. Data centers consist of multiple IT components whose geometric configuration and heat dissipation make thermal modeling difficult. This paper presents PyDCM, a customizable Data Center Model implemented in Python, that allows users to create unique configurations of IT equipment with custom server specifications and geometric arrangements of IT cabinets. The use of vectorized thermal calculations makes PyDCM orders of magnitude faster (30 times) than current Energy Plus modeling implementations and scales sublinearly with the number of CPUs. Also, PyDCM enables the use of Deep Reinforcement Learning via the Gymnasium wrapper to optimize data center cooling and offers a user-friendly platform for testing various data center design prototypes.


title: Density-functional perturbation theory for one-dimensional systems: implementation and relevance for phonons and electron-phonon interactions

abstract: The electronic and vibrational properties and electron-phonon couplings of one-dimensional materials will be key to many prospective applications in nanotechnology. Dimensionality strongly affects these properties and has to be correctly accounted for in first-principles calculations. Here we develop and implement a formulation of density-functional and density-functional perturbation theory that is tailored for one-dimensional systems. A key ingredient is the inclusion of a Coulomb cutoff, a reciprocal-space technique designed to correct for the spurious interactions between periodic images in periodic-boundary conditions. This restores the proper one-dimensional open-boundary conditions, letting the true response of the isolated one-dimensional system emerge. In addition to total energies, forces and stress tensors, phonons and electron-phonon interactions are also properly accounted for. We demonstrate the relevance of the present method on a portfolio of realistic systems: BN atomic chains, BN armchair nanotubes, and GaAs nanowires. Notably, we highlight the critical role of the Coulomb cutoff by studying previously inaccessible polar-optical phonons and Frohlich electron-phonon couplings. We also develop and apply analytical models to support the physical insights derived from the calculations and we discuss their consequences on electronic lifetimes. The present work unlocks the possibility to accurately simulate the linear response properties of one-dimensional systems, sheds light on the transition between dimensionalities and paves the way for further studies in several fields, including charge transport, optical coupling and polaritronics.


title: Realizing XR Applications Using 5G-Based 3D Holographic Communication and Mobile Edge Computing

abstract: 3D holographic communication has the potential to revolutionize the way people interact with each other in virtual spaces, offering immersive and realistic experiences. However, demands for high data rates, extremely low latency, and high computations to enable this technology pose a significant challenge. To address this challenge, we propose a novel job scheduling algorithm that leverages Mobile Edge Computing (MEC) servers in order to minimize the total latency in 3D holographic communication. One of the motivations for this work is to prevent the uncanny valley effect, which can occur when the latency hinders the seamless and real-time rendering of holographic content, leading to a less convincing and less engaging user experience. Our proposed algorithm dynamically allocates computation tasks to MEC servers, considering the network conditions, computational capabilities of the servers, and the requirements of the 3D holographic communication application. We conduct extensive experiments to evaluate the performance of our algorithm in terms of latency reduction, and the results demonstrate that our approach significantly outperforms other baseline methods. Furthermore, we present a practical scenario involving Augmented Reality (AR), which not only illustrates the applicability of our algorithm but also highlights the importance of minimizing latency in achieving high-quality holographic views. By efficiently distributing the computation workload among MEC servers and reducing the overall latency, our proposed algorithm enhances the user experience in 3D holographic communications and paves the way for the widespread adoption of this technology in various applications, such as telemedicine, remote collaboration, and entertainment.


title: Self-interacting Dark Matter in Non-Standard Cosmology

abstract: Discrepancies of the $\Lambda {\rm CDM}$ model with small-scale cosmological observations and stringent constraints from direct search experiments cast doubts over typical weak scale cold dark matter candidates e.g. WIMPs. Self-interacting dark matter (SIDM) is a very promising alternative to WIMP, which not only alleviates the small-scale anomalies of the $\Lambda {\rm CDM}$ model, but also matches with the highly accurate large-scale $\Lambda {\rm CDM}$ predictions. The small-scale anomalies can be resolved with a self-scattering cross-section $\sigma/m_{DM} \sim 1 cm^2/gm$. Such large cross-sections can be realised in models of DM with a light MeV scale mediator and a sizeable coupling. We assume the DM to be Dirac fermion and the mediator to be either a light scalar or vector boson. In a standard cosmological history, one major issue with such models is to realise the correct relic density of dark matter via thermal freeze-out as the DM annihilates efficiently to the light mediators and ends up with an under-abundant relic. However, we show that, if the expansion rate of the universe is not radiation-dominated (RD) during the epoch of SIDM freeze-out, its relic abundance is enhanced significantly. We assume a non-standard expansion history of the universe by introducing a non-radiation like component in the early universe. In such a scenario, DM freezes out at an earlier epoch resulting in enhanced DM abundance, which can be matched with the correct relic density with suitable model parameters. The light mediator can also couple to an SM mediator and pave a way to detect SIDM at terrestrial laboratories. The mixing between the mediators can be constrained by data from direct search experiments. We find out the viable parameter space for a generic SIDM model taking into account the relevant phenomenological and experimental constraints.


title: Holomorphic functions on complex Banach lattices

abstract: We introduce and study the algebraic, analytic and lattice properties of regular homogeneous polynomials and holomorphic functions on complex Banach lattices. We show that the theory of power series with regular terms is closer to the theory of functions of several complex variables than the theory of holomorphic functions on Banach spaces. We extend the concept of the Bohr radius to Banach lattices and show that it provides us with a lower bound for the ratio between the radius of regular convergence and the radius of convergence of a regular holomorphic function. This allows us to show that in finite dimensions the radius of convergence of the Taylor series of a holomorphic function coincides with the radius of convergence of its monomial expansion but that on $\ell_p$ these two radii can be radically different.


title: Coloring Deep CNN Layers with Activation Hue Loss

abstract: This paper proposes a novel hue-like angular parameter to model the structure of deep convolutional neural network (CNN) activation space, referred to as the {\em activation hue}, for the purpose of regularizing models for more effective learning. The activation hue generalizes the notion of color hue angle in standard 3-channel RGB intensity space to $N$-channel activation space. A series of observations based on nearest neighbor indexing of activation vectors with pre-trained networks indicate that class-informative activations are concentrated about an angle $\theta$ in both the $(x,y)$ image plane and in multi-channel activation space. A regularization term in the form of hue-like angular $\theta$ labels is proposed to complement standard one-hot loss. Training from scratch using combined one-hot + activation hue loss improves classification performance modestly for a wide variety of classification tasks, including ImageNet.


title: RTDK-BO: High Dimensional Bayesian Optimization with Reinforced Transformer Deep kernels

abstract: Bayesian Optimization (BO), guided by Gaussian process (GP) surrogates, has proven to be an invaluable technique for efficient, high-dimensional, black-box optimization, a critical problem inherent to many applications such as industrial design and scientific computing. Recent contributions have introduced reinforcement learning (RL) to improve the optimization performance on both single function optimization and \textit{few-shot} multi-objective optimization. However, even few-shot techniques fail to exploit similarities shared between closely related objectives. In this paper, we combine recent developments in Deep Kernel Learning (DKL) and attention-based Transformer models to improve the modeling powers of GP surrogates with meta-learning. We propose a novel method for improving meta-learning BO surrogates by incorporating attention mechanisms into DKL, empowering the surrogates to adapt to contextual information gathered during the BO process. We combine this Transformer Deep Kernel with a learned acquisition function trained with continuous Soft Actor-Critic Reinforcement Learning to aid in exploration. This Reinforced Transformer Deep Kernel (RTDK-BO) approach yields state-of-the-art results in continuous high-dimensional optimization problems.


title: TRAIL Team Description Paper for RoboCup@Home 2023

abstract: Our team, TRAIL, consists of AI/ML laboratory members from The University of Tokyo. We leverage our extensive research experience in state-of-the-art machine learning to build general-purpose in-home service robots. We previously participated in two competitions using Human Support Robot (HSR): RoboCup@Home Japan Open 2020 (DSPL) and World Robot Summit 2020, equivalent to RoboCup World Tournament. Throughout the competitions, we showed that a data-driven approach is effective for performing in-home tasks. Aiming for further development of building a versatile and fast-adaptable system, in RoboCup @Home 2023, we unify three technologies that have recently been evaluated as components in the fields of deep learning and robot learning into a real household robot system. In addition, to stimulate research all over the RoboCup@Home community, we build a platform that manages data collected from each site belonging to the community around the world, taking advantage of the characteristics of the community.


title: Introducing High School Students to Version Control, Continuous Integration, and Quality Assurance

abstract: Software Engineering concepts such as version control, continuous integration, and unit testing are often not presented in college computer science curriculums until the third year of study, after completing several semesters of programming courses. Throughout the summer of 2023, two high school students volunteered in our lab at Wayne State University where I'm a graduate research assistant and Ph.D. student in computer science. The students had taken AP Computer Science but had no prior experience with software engineering or software testing. This paper documents our experience devising a group project to teach the requisite software engineering skills to implement automated tests that meaningfully contribute to open-source scientific computing projects developed in connection with our lab. We describe the concepts covered, tools used, and software tests written in this early introduction to software engineering while maintaining shared emphases on education and the deployment of our work.


title: Leveraging Low-Rank and Sparse Recurrent Connectivity for Robust Closed-Loop Control

abstract: Developing autonomous agents that can interact with changing environments is an open challenge in machine learning. Robustness is particularly important in these settings as agents are often fit offline on expert demonstrations but deployed online where they must generalize to the closed feedback loop within the environment. In this work, we explore the application of recurrent neural networks to tasks of this nature and understand how a parameterization of their recurrent connectivity influences robustness in closed-loop settings. Specifically, we represent the recurrent connectivity as a function of rank and sparsity and show both theoretically and empirically that modulating these two variables has desirable effects on network dynamics. The proposed low-rank, sparse connectivity induces an interpretable prior on the network that proves to be most amenable for a class of models known as closed-form continuous-time neural networks (CfCs). We find that CfCs with fewer parameters can outperform their full-rank, fully-connected counterparts in the online setting under distribution shift. This yields memory-efficient and robust agents while opening a new perspective on how we can modulate network dynamics through connectivity.


title: Toward a Foundation Model for Time Series Data

abstract: A foundation model is a machine learning model trained on a large and diverse set of data, typically using self-supervised learning-based pre-training techniques, that can be adapted to various downstream tasks. However, current research on time series pre-training has mostly focused on models pre-trained solely on data from a single domain, resulting in a lack of knowledge about other types of time series. However, current research on time series pre-training has predominantly focused on models trained exclusively on data from a single domain. As a result, these models possess domain-specific knowledge that may not be easily transferable to time series from other domains. In this paper, we aim to develop an effective time series foundation model by leveraging unlabeled samples from multiple domains. To achieve this, we repurposed the publicly available UCR Archive and evaluated four existing self-supervised learning-based pre-training methods, along with a novel method, on the datasets. We tested these methods using four popular neural network architectures for time series to understand how the pre-training methods interact with different network designs. Our experimental results show that pre-training improves downstream classification tasks by enhancing the convergence of the fine-tuning process. Furthermore, we found that the proposed pre-training method, when combined with the Transformer model, outperforms the alternatives.


title: Anisotropy of thermal conductivity oscillations in relation to the Kitaev spin liquid phase

abstract: In the presence of external magnetic field, the Kitaev model could either hosts gapped topological anyon or gapless Majorana fermions. In $\alpha$-RuCl$_3$, the gapped and gapless cases are only separated by a thirty-degree rotation of the in-plane magnetic field vector. The presence/absence of the spectral gap is key for understanding the thermal transport behavior in $\alpha$-RuCl$_3$. Here, we study the anisotropy of the oscillatory features of thermal conductivity in $\alpha$-RuCl$_3$. We examine the oscillatory features of thermal conductivities (k//a, k//b) with fixed external fields and found distinct behavior for the gapped (B//a) and gapless (B//b) scenarios. Furthermore, we track the evolution of thermal resistivity ($\lambda_{a}$) and its oscillatory features with the rotation of in-plane magnetic fields from B//b to B//a. The thermal resistivity $\lambda (B,\theta)$ display distinct rotational symmetries before and after the emergence of the field induced Kitaev spin liquid phase. These experiment data suggest close correlations between the oscillatory features of thermal conductivity, the underlying Kitaev spin liquid phase and the fermionic excitation it holds.


title: Unsupervised SFQ-Based Spiking Neural Network

abstract: Single Flux Quantum (SFQ) technology represents a groundbreaking advancement in computational efficiency and ultra-high-speed neuromorphic processing. The key features of SFQ technology, particularly data representation, transmission, and processing through SFQ pulses, closely mirror fundamental aspects of biological neural structures. Consequently, SFQ-based circuits emerge as an ideal candidate for realizing Spiking Neural Networks (SNNs). This study presents a proof-of-concept demonstration of an SFQ-based SNN architecture, showcasing its capacity for ultra-fast switching at remarkably low energy consumption per output activity. Notably, our work introduces innovative approaches: (i) We introduce a novel spike-timing-dependent plasticity mechanism to update synapses and to trace spike-activity by incorporating a leaky non-destructive readout circuit. (ii) We propose a novel method to dynamically regulate the threshold behavior of leaky integrate and fire superconductor neurons, enhancing the adaptability of our SNN architecture. (iii) Our research incorporates a novel winner-take-all mechanism, aligning with practical strategies for SNN development and enabling effective decision-making processes. The effectiveness of these proposed structural enhancements is evaluated by integrating high-level models into the BindsNET framework. By leveraging BindsNET, we model the online training of an SNN, integrating the novel structures into the learning process. To ensure the robustness and functionality of our circuits, we employ JoSIM for circuit parameter extraction and functional verification through simulation.


title: An Efficient Content-based Time Series Retrieval System

abstract: A Content-based Time Series Retrieval (CTSR) system is an information retrieval system for users to interact with time series emerged from multiple domains, such as finance, healthcare, and manufacturing. For example, users seeking to learn more about the source of a time series can submit the time series as a query to the CTSR system and retrieve a list of relevant time series with associated metadata. By analyzing the retrieved metadata, users can gather more information about the source of the time series. Because the CTSR system is required to work with time series data from diverse domains, it needs a high-capacity model to effectively measure the similarity between different time series. On top of that, the model within the CTSR system has to compute the similarity scores in an efficient manner as the users interact with the system in real-time. In this paper, we propose an effective and efficient CTSR model that outperforms alternative models, while still providing reasonable inference runtimes. To demonstrate the capability of the proposed method in solving business problems, we compare it against alternative models using our in-house transaction data. Our findings reveal that the proposed model is the most suitable solution compared to others for our transaction data problem.


title: Block2: a comprehensive open source framework to develop and apply state-of-the-art DMRG algorithms in electronic structure and beyond

abstract: Block2 is an open source framework to implement and perform density matrix renormalization group and matrix product state algorithms. Out-of-the-box it supports the eigenstate, time-dependent, response, and finite-temperature algorithms. In addition, it carries special optimizations for ab initio electronic structure Hamiltonians and implements many quantum chemistry extensions to the density matrix renormalization group, such as dynamical correlation theories. The code is designed with an emphasis on flexibility, extensibility, and efficiency, and to support integration with external numerical packages. Here we explain the design principles and currently supported features and present numerical examples in a range of applications.


title: Gaussian Approximation Potentials: theory, software implementation and application examples

abstract: Gaussian Approximation Potentials are a class of Machine Learned Interatomic Potentials routinely used to model materials and molecular systems on the atomic scale. The software implementation provides the means for both fitting models using ab initio data and using the resulting potentials in atomic simulations. Details of the GAP theory, algorithms and software are presented, together with detailed usage examples to help new and existing users. We review some recent developments to the GAP framework, including MPI parallelisation of the fitting code enabling its use on thousands of CPU cores and compression of descriptors to eliminate the poor scaling with the number of different chemical elements.


title: Multi-year characterisation of the broad-band emission from the intermittent extreme BL Lac 1ES~2344+514

abstract: The BL Lac 1ES 2344+514 is known for temporary extreme properties (e.g., a shift of the synchrotron SED peak energy $\nu_{synch,p}$ above 1keV). While those extreme states were so far observed only during high flux levels, additional multi-year observing campaigns are required to achieve a coherent picture. Here, we report the longest investigation of the source from radio to VHE performed so far, focusing on a systematic characterisation of the intermittent extreme states. While our results confirm that 1ES 2344+514 typically exhibits $\nu_{synch,p}>$1keV during elevated flux periods, we also find periods where the extreme state coincides with low flux activity. A strong spectral variability thus happens in the quiescent state, and is likely caused by an increase of the electron acceleration efficiency without a change in the electron injection luminosity. We also report a strong X-ray flare (among the brightest for 1ES 2344+514) without a significant shift of $\nu_{synch,p}$. During this particular flare, the X-ray spectrum is among the softest of the campaign. It unveils complexity in the spectral evolution, where the common harder-when-brighter trend observed in BL Lacs is violated. During a low and hard X-ray state, we find an excess of the UV flux with respect to an extrapolation of the X-ray spectrum to lower energies. This UV excess implies that at least two regions contribute significantly to the infrared/optical/ultraviolet/X-ray emission. Using the simultaneous MAGIC, XMM-Newton, NuSTAR, and AstroSat observations, we argue that a region possibly associated with the 10 GHz radio core may explain such an excess. Finally, we investigate a VHE flare, showing an absence of simultaneous variability in the 0.3-2keV band. Using a time-dependent leptonic modelling, we show that this behaviour, in contradiction to single-zone scenarios, can instead be explained by a two-component model.


title: Open-Fusion: Real-time Open-Vocabulary 3D Mapping and Queryable Scene Representation

abstract: Precise 3D environmental mapping is pivotal in robotics. Existing methods often rely on predefined concepts during training or are time-intensive when generating semantic maps. This paper presents Open-Fusion, a groundbreaking approach for real-time open-vocabulary 3D mapping and queryable scene representation using RGB-D data. Open-Fusion harnesses the power of a pre-trained vision-language foundation model (VLFM) for open-set semantic comprehension and employs the Truncated Signed Distance Function (TSDF) for swift 3D scene reconstruction. By leveraging the VLFM, we extract region-based embeddings and their associated confidence maps. These are then integrated with 3D knowledge from TSDF using an enhanced Hungarian-based feature-matching mechanism. Notably, Open-Fusion delivers outstanding annotation-free 3D segmentation for open-vocabulary without necessitating additional 3D training. Benchmark tests on the ScanNet dataset against leading zero-shot methods highlight Open-Fusion's superiority. Furthermore, it seamlessly combines the strengths of region-based VLFM and TSDF, facilitating real-time 3D scene comprehension that includes object concepts and open-world semantics. We encourage the readers to view the demos on our project page: https://uark-aicv.github.io/OpenFusion


title: Problem-tailored Simulation of Energy Transport on Noisy Quantum Computers

abstract: The transport of conserved quantities like spin and charge is fundamental to characterizing the behavior of quantum many-body systems. Numerically simulating such dynamics is generically challenging, which motivates the consideration of quantum computing strategies. However, the relatively high gate errors and limited coherence times of today's quantum computers pose their own challenge, highlighting the need to be frugal with quantum resources. In this work we report simulations on quantum hardware of infinite-temperature energy transport in the mixed-field Ising chain, a paradigmatic many-body system that can exhibit a range of transport behaviors at intermediate times. We consider a chain with $L=12$ sites and find results broadly consistent with those from ideal circuit simulators over 90 Trotter steps, containing up to 990 entangling gates. To obtain these results, we use two key problem-tailored insights. First, we identify a convenient basis$\unicode{x2013}$the Pauli $Y$ basis$\unicode{x2013}$in which to sample the infinite-temperature trace and provide theoretical and numerical justifications for its efficiency relative to, e.g., the computational basis. Second, in addition to a variety of problem-agnostic error mitigation strategies, we employ a renormalization strategy that compensates for global nonconservation of energy due to device noise. We expect that these techniques will prove useful beyond the specific application considered here.


title: Multitask Learning for Time Series Data with 2D Convolution

abstract: Multitask learning (MTL) aims to develop a unified model that can handle a set of closely related tasks simultaneously. By optimizing the model across multiple tasks, MTL generally surpasses its non-MTL counterparts in terms of generalizability. Although MTL has been extensively researched in various domains such as computer vision, natural language processing, and recommendation systems, its application to time series data has received limited attention. In this paper, we investigate the application of MTL to the time series classification (TSC) problem. However, when we integrate the state-of-the-art 1D convolution-based TSC model with MTL, the performance of the TSC model actually deteriorates. By comparing the 1D convolution-based models with the Dynamic Time Warping (DTW) distance function, it appears that the underwhelming results stem from the limited expressive power of the 1D convolutional layers. To overcome this challenge, we propose a novel design for a 2D convolution-based model that enhances the model's expressiveness. Leveraging this advantage, our proposed method outperforms competing approaches on both the UCR Archive and an industrial transaction TSC dataset.


title: Hyperbolic phonon-polariton electroluminescence in graphene-hBN van der Waals heterostructures

abstract: Phonon-polaritons are electromagnetic waves resulting from the coherent coupling of photons with optical phonons in polar dielectrics. Due to their exceptional ability to confine electric fields to deep subwavelength scales with low loss, they are uniquely poised to enable a suite of applications beyond the reach of conventional photonics, such as sub-diffraction imaging and near-field energy transfer. The conventional approach to exciting phonon-polaritons through optical methods, however, necessitates costly mid-infrared and terahertz coherent light sources along with near-field scanning probes, and generally leads to low excitation efficiency due to the substantial momentum mismatch between phonon-polaritons and free-space photons. Here, we demonstrate that under proper conditions, phonon-polaritons can be excited all-electrically by flowing charge carriers. Specifically, in hexagonal boron nitride (hBN)/graphene heterostructures, by electrically driving charge carriers in ultra-high-mobility graphene out of equilibrium, we observe bright electroluminescence of hBN's hyperbolic phonon-polaritons (HPhPs) at mid-IR frequencies. The HPhP electroluminescence shows a temperature and carrier density dependence distinct from black-body or super-Planckian thermal emission. Moreover, the carrier density dependence of HPhP electroluminescence spectra reveals that HPhP electroluminescence can arise from both inter-band transition and intra-band Cherenkov radiation of charge carriers in graphene. The HPhP electroluminescence offers fundamentally new avenues for realizing electrically-pumped, tunable mid-IR and THz phonon-polariton lasers, and efficient cooling of electronic devices.


title: Improving classifier decision boundaries using nearest neighbors

abstract: Neural networks are not learning optimal decision boundaries. We show that decision boundaries are situated in areas of low training data density. They are impacted by few training samples which can easily lead to overfitting. We provide a simple algorithm performing a weighted average of the prediction of a sample and its nearest neighbors' (computed in latent space) leading to a minor favorable outcomes for a variety of important measures for neural networks. In our evaluation, we employ various self-trained and pre-trained convolutional neural networks to show that our approach improves (i) resistance to label noise, (ii) robustness against adversarial attacks, (iii) classification accuracy, and to some degree even (iv) interpretability. While improvements are not necessarily large in all four areas, our approach is conceptually simple, i.e., improvements come without any modification to network architecture, training procedure or dataset. Furthermore, they are in stark contrast to prior works that often require trade-offs among the four objectives or provide valuable, but non-actionable insights.


title: Exploring the evolution of research topics during the COVID-19 pandemic

abstract: The COVID-19 pandemic has changed the research agendas of most scientific communities, resulting in an overwhelming production of research articles in a variety of domains, including medicine, virology, epidemiology, economy, psychology, and so on. Several open-access corpora and literature hubs were established; among them, the COVID-19 Open Research Dataset (CORD-19) has systematically gathered scientific contributions for 2.5 years, by collecting and indexing over one million articles. Here, we present the CORD-19 Topic Visualizer (CORToViz), a method and associated visualization tool for inspecting the CORD-19 textual corpus of scientific abstracts. Our method is based upon a careful selection of up-to-date technologies (including large language models), resulting in an architecture for clustering articles along orthogonal dimensions and extraction techniques for temporal topic mining. Topic inspection is supported by an interactive dashboard, providing fast, one-click visualization of topic contents as word clouds and topic trends as time series, equipped with easy-to-drive statistical testing for analyzing the significance of topic emergence along arbitrarily selected time windows. The processes of data preparation and results visualization are completely general and virtually applicable to any corpus of textual documents - thus suited for effective adaptation to other contexts.


title: Phonon engineering of atomic-scale defects in superconducting quantum circuits

abstract: Noise within solid-state systems at low temperatures, where many of the degrees of freedom of the host material are frozen out, can typically be traced back to material defects that support low-energy excitations. These defects can take a wide variety of microscopic forms, and for amorphous materials are broadly described using generic models such as the tunneling two-level systems (TLS) model. Although the details of TLS, and their impact on the low-temperature behavior of materials have been studied since the 1970s, these states have recently taken on further relevance in the field of quantum computing, where the limits to the coherence of superconducting microwave quantum circuits are dominated by TLS. Efforts to mitigate the impact of TLS have thus far focused on circuit design, material selection, and material surface treatment. In this work, we take a new approach that seeks to directly modify the properties of TLS through nanoscale-engineering. This is achieved by periodically structuring the host material, forming an acoustic bandgap that suppresses all microwave-frequency phonons in a GHz-wide frequency band around the operating frequency of a transmon qubit superconducting quantum circuit. For embedded TLS that are strongly coupled to the electric qubit, we measure a pronounced increase in relaxation time by two orders of magnitude when the TLS transition frequency lies within the acoustic bandgap, with the longest $T_1$ time exceeding $5$ milliseconds. Our work paves the way for in-depth investigation and coherent control of TLS, which is essential for deepening our understanding of noise in amorphous materials and advancing solid-state quantum devices.


title: GroundLink: A Dataset Unifying Human Body Movement and Ground Reaction Dynamics

abstract: The physical plausibility of human motions is vital to various applications in fields including but not limited to graphics, animation, robotics, vision, biomechanics, and sports science. While fully simulating human motions with physics is an extreme challenge, we hypothesize that we can treat this complexity as a black box in a data-driven manner if we focus on the ground contact, and have sufficient observations of physics and human activities in the real world. To prove our hypothesis, we present GroundLink, a unified dataset comprised of captured ground reaction force (GRF) and center of pressure (CoP) synchronized to standard kinematic motion captures. GRF and CoP of GroundLink are not simulated but captured at high temporal resolution using force platforms embedded in the ground for uncompromising measurement accuracy. This dataset contains 368 processed motion trials (~1.59M recorded frames) with 19 different movements including locomotion and weight-shifting actions such as tennis swings to signify the importance of capturing physics paired with kinematics. GroundLinkNet, our benchmark neural network model trained with GroundLink, supports our hypothesis by predicting GRFs and CoPs accurately and plausibly on unseen motions from various sources. The dataset, code, and benchmark models are made public for further research on various downstream tasks leveraging the rich physics information at https://csr.bu.edu/groundlink/.


title: Optical Properties and Behavior of Whispering Gallery Mode Resonators in Complex Microsphere Configurations: Insights for Sensing and Information Processing Applications

abstract: Whispering gallery mode (WGM) resonators are garnering significant attention due to their unique characteristics and remarkable properties. When integrated with optical sensing and processing technology, WGM resonators offer numerous advantages, including compact size, high sensitivity, rapid response, and tunability. This paper comprehensively investigates the optical properties and behavior of WGMs in complex microsphere resonator configurations. The findings underscore the potential of WGMs in sensing applications and their role in advancing future optical information processing. The study explores the impact of configuration, size, excitation, polarization, and coupling effects on the WGMs properties. The paper provides crucial insights and valuable guidance for designing and optimizing microsphere resonator systems, enabling their realization for practical applications.


title: Bridging Low-level Geometry to High-level Concepts in Visual Servoing of Robot Manipulation Task Using Event Knowledge Graphs and Vision-Language Models

abstract: In this paper, we propose a framework of building knowledgeable robot control in the scope of smart human-robot interaction, by empowering a basic uncalibrated visual servoing controller with contextual knowledge through the joint usage of event knowledge graphs (EKGs) and large-scale pretrained vision-language models (VLMs). The framework is expanded in twofold: first, we interpret low-level image geometry as high-level concepts, allowing us to prompt VLMs and to select geometric features of points and lines for motor control skills; then, we create an event knowledge graph (EKG) to conceptualize a robot manipulation task of interest, where the main body of the EKG is characterized by an executable behavior tree, and the leaves by semantic concepts relevant to the manipulation context. We demonstrate, in an uncalibrated environment with real robot trials, that our method lowers the reliance of human annotation during task interfacing, allows the robot to perform activities of daily living more easily by treating low-level geometric-based motor control skills as high-level concepts, and is beneficial in building cognitive thinking for smart robot applications.


title: On Fractional Spherically Restricted Hyperbolic Diffusion Random Field

abstract: The paper investigates solutions of the fractional hyperbolic diffusion equation in its most general form with two fractional derivatives of distinct orders. The solutions are given as spatial-temporal homogeneous and isotropic random fields and their spherical restrictions are studied. The spectral representations of these fields are derived and the associated angular spectrum is analysed. The obtained mathematical results are illustrated by numerical examples. In addition, the numerical investigations assess the dependence of the covariance structure and other properties of these fields on the orders of fractional derivatives.


title: A Quantum Theory of Temporally Mismatched Homodyne Measurements with Applications to Optical Frequency Comb Metrology

abstract: The fields of precision timekeeping and spectroscopy increasingly rely on optical frequency comb interferometry. However, comb-based measurements are not described by existing quantum theory because they exhibit both large mode mismatch and finite strength local oscillators. To establish this quantum theory, we derive measurement operators for homodyne detection with arbitrary mode overlap. These operators are a combination of quadrature and intensity-like measurements, which inform a filter that maximizes the quadrature measurement signal-to-noise ratio. Furthermore, these operators establish a foundation to extend frequency-comb interferometry to a wide range of scenarios, including metrology with nonclassical states of light.


title: Equigeodesic vectors on compact homogeneous spaces with equivalent isotropy summands

abstract: In this paper, we investigate equigeodesics on a compact homogeneous space $M=G/H.$ We introduce a formula for the identification of equigeodesic vectors only relying on the isotropy representation of $M$ and the Lie structure of the Lie algebra of $G$. Applications to $M$-spaces are also discussed.


title: Universal insulating-to-metallic crossover in tight-binding random geometric graphs

abstract: Within the scattering matrix approach to electronic transport, the scattering and transport properties of tight-binding random graphs are analyzed. In particular, we compute the scattering matrix elements, the transmission, the channel-to-channel transmission distributions (including the total transmission distribution), the shot noise power, and the elastic enhancement factor. Two graph models are considered: random geometric graphs and bipartite random geometric graphs. The results show an insulating to a metallic crossover in the scattering and transport properties by increasing the average degree of the graphs from small to large values. Also, the scattering and transport properties are shown to be invariant under a scaling parameter depending on the average degree and the graph size. Furthermore, for large connectivity and in the perfect coupling regime, the scattering and transport properties of both graph models are well described by the random matrix theory predictions of electronic transport, except for bipartite graphs in particular scattering setups.


title: Diffusion Models as Masked Audio-Video Learners

abstract: Over the past several years, the synchronization between audio and visual signals has been leveraged to learn richer audio-visual representations. Aided by the large availability of unlabeled videos, many unsupervised training frameworks have demonstrated impressive results in various downstream audio and video tasks. Recently, Masked Audio-Video Learners (MAViL) has emerged as a state-of-the-art audio-video pre-training framework. MAViL couples contrastive learning with masked autoencoding to jointly reconstruct audio spectrograms and video frames by fusing information from both modalities. In this paper, we study the potential synergy between diffusion models and MAViL, seeking to derive mutual benefits from these two frameworks. The incorporation of diffusion into MAViL, combined with various training efficiency methodologies that include the utilization of a masking ratio curriculum and adaptive batch sizing, results in a notable 32% reduction in pre-training Floating-Point Operations (FLOPS) and an 18% decrease in pre-training wall clock time. Crucially, this enhanced efficiency does not compromise the model's performance in downstream audio-classification tasks when compared to MAViL's performance.


title: EFFUSE: Efficient Self-Supervised Feature Fusion for E2E ASR in Low Resource and Multilingual Scenarios

abstract: Self-Supervised Learning (SSL) models have demonstrated exceptional performance in various speech tasks, particularly in low-resource and multilingual domains. Recent works show that fusing diverse SSL models could achieve superior performance compared to using one SSL model. However, fusing models increases the overall parameter size, leading to higher computational costs. We propose EFFUSE, a novel approach that uses a single SSL model to mimic the features of multiple SSL models via prediction, resulting in a lightweight framework with competitive performance. Our experiments show that EFFUSE outperforms individual SSL models in multilingual speech recognition tasks. Our best performing model achieves an average SUPERB score increase of 63.5 (6.3%) from the SSL baselines in Multilingual Speech Universal PERformance Benchmark (ML-SUPERB), while decreasing parameter size on average by 317M parameters (49%) from the fusion models.


title: Integration-by-parts identities and differential equations for parametrised Feynman integrals

abstract: Integration-by-parts (IBP) identities and differential equations are the primary modern tools for the evaluation of high-order Feynman integrals. They are commonly derived and implemented in the momentum-space representation. We provide a different viewpoint on these important tools by working in Feynman-parameter space, and using its projective geometry. Our work is based upon little-known results pre-dating the modern era of loop calculations: we adapt and generalise these results, deriving a very general expression for sets of IBP identities in parameter space, associated with a generic Feynman diagram, and valid to any loop order, relying on the characterisation of Feynman-parameter integrands as projective forms. We validate our method by deriving and solving systems of differential equations for several simple diagrams at one and two loops, providing a unified perspective on a number of existing results.


title: Beyond Random Augmentations: Pretraining with Hard Views

abstract: Many Self-Supervised Learning (SSL) methods aim for model invariance to different image augmentations known as views. To achieve this invariance, conventional approaches make use of random sampling operations within the image augmentation pipeline. We hypothesize that the efficacy of pretraining pipelines based on conventional random view sampling can be enhanced by explicitly selecting views that benefit the learning progress. A simple, yet effective approach is to select hard views that yield a higher loss. In this paper, we present Hard View Pretraining (HVP), a learning-free strategy that builds upon this hypothesis and extends random view generation. HVP exposes the model to harder, more challenging samples during SSL pretraining, which enhances downstream performance. It encompasses the following iterative steps: 1) randomly sample multiple views and forward each view through the pretrained model, 2) create pairs of two views and compute their loss, 3) adversarially select the pair yielding the highest loss depending on the current model state, and 4) run the backward pass with the selected pair. As a result, HVP achieves linear evaluation accuracy improvements of 1% on average on ImageNet for both 100 and 300 epoch pretraining and similar improvements on transfer tasks across DINO, SimSiam, iBOT, and SimCLR.


title: LaTeX: Language Pattern-aware Triggering Event Detection for Adverse Experience during Pandemics

abstract: The COVID-19 pandemic has accentuated socioeconomic disparities across various racial and ethnic groups in the United States. While previous studies have utilized traditional survey methods like the Household Pulse Survey (HPS) to elucidate these disparities, this paper explores the role of social media platforms in both highlighting and addressing these challenges. Drawing from real-time data sourced from Twitter, we analyzed language patterns related to four major types of adverse experiences: loss of employment income (LI), food scarcity (FS), housing insecurity (HI), and unmet needs for mental health services (UM). We first formulate a sparsity optimization problem that extracts low-level language features from social media data sources. Second, we propose novel constraints on feature similarity exploiting prior knowledge about the similarity of the language patterns among the adverse experiences. The proposed problem is challenging to solve due to the non-convexity objective and non-smoothness penalties. We develop an algorithm based on the alternating direction method of multipliers (ADMM) framework to solve the proposed formulation. Extensive experiments and comparisons to other models on real-world social media and the detection of adverse experiences justify the efficacy of our model.


title: Towards Distributed Quantum Computing by Qubit and Gate Graph Partitioning Techniques

abstract: Distributed quantum computing is motivated by the difficulty in building large-scale, individual quantum computers. To solve that problem, a large quantum circuit is partitioned and distributed to small quantum computers for execution. Partitions running on different quantum computers share quantum information using entangled Bell pairs. However, entanglement generation and purification introduces both a runtime and memory overhead on distributed quantum computing. In this paper we study that trade-off by proposing two techniques for partitioning large quantum circuits and for distribution to small quantum computers. Our techniques map a quantum circuit to a graph representation. We study two approaches: one that considers only gate teleportation, and another that considers both gate and state teleportation to achieve the distributed execution. Then we apply the METIS graph partitioning algorithm to obtain the partitions and the number of entanglement requests between them. We use the SeQUeNCe quantum communication simulator to measure the time required for generating all the entanglements required to execute the distributed circuit. We find that the best partitioning technique will depend on the specific circuit of interest.


title: Disentangling the Black Hole Mass Spectrum with Photometric Microlensing Surveys

abstract: From the formation mechanisms of stars and compact objects to nuclear physics, modern astronomy frequently leverages surveys to understand populations of objects to answer fundamental questions. The population of dark and isolated compact objects in the Galaxy contains critical information related to many of these topics, but is only practically accessible via gravitational microlensing. However, photometric microlensing observables are degenerate for different types of lenses, and one can seldom classify an event as involving either a compact object or stellar lens on its own. To address this difficulty, we apply a Bayesian framework that treats lens type probabilistically and jointly with a lens population model. This method allows lens population characteristics to be inferred despite intrinsic uncertainty in the lens-class of any single event. We investigate this method's effectiveness on a simulated ground-based photometric survey in the context of characterizing a hypothetical population of primordial black holes (PBHs) with an average mass of $30 M_{\odot}$. On simulated data, our method outperforms current black hole (BH) lens identification pipelines and characterizes different subpopulations of lenses while jointly constraining the PBH contribution to dark matter to ${\approx}25$\%. Key to robust inference, our method can marginalize over population model uncertainty. We find the lower mass cutoff for stellar origin BHs, a key observable in understanding the BH mass gap, particularly difficult to infer in our simulations. This work lays the foundation for cutting-edge PBH abundance constraints to be extracted from current photometric microlensing surveys.


title: Dark Energy Survey Year 1 Clusters are Consistent with Planck

abstract: The recent Dark Energy Survey Year 1 (DES-Y1) analysis of galaxy cluster abundances and weak lensing produced $\Omega_{\rm m}$ and $\sigma_8$ constraints in 5.6$\sigma$ tension with Planck. It is suggested in that work that this tension is driven by unmodelled systematics in optical cluster selection. We present a novel simulation-based forward modeling framework that explicitly incorporates cluster selection into its model predictions. Applying this framework to the DES-Y1 data we find consistency with Planck, resolving the tension found in the DES-Y1 analysis. An extension of this approach to the final DES data set will produce robust constraints on $\Lambda$CDM parameters and correspondingly strong tests of cosmological models.


title: On Wasserstein distances for affine transformations of random vectors

abstract: We expound on some known lower bounds of the quadratic Wasserstein distance between random vectors in $\mathbb{R}^n$ with an emphasis on affine transformations that have been used in manifold learning of data in Wasserstein space. In particular, we give concrete lower bounds for rotated copies of random vectors in $\mathbb{R}^2$ by computing the Bures metric between the covariance matrices. We also derive upper bounds for compositions of affine maps which yield a fruitful variety of diffeomorphisms applied to an initial data measure. We apply these bounds to various distributions including those lying on a 1-dimensional manifold in $\mathbb{R}^2$ and illustrate the quality of the bounds. Finally, we give a framework for mimicking handwritten digit or alphabet datasets that can be applied in a manifold learning framework.