title: Data synthesis improves detection of radiation sources in urban environments

abstract: Distributed sensors have been proposed to detect nuclear materials if they enter urban areas. Past work on small detector systems has shown that data fusion can improve detection. Here, we show how this could be done for a large detector network using Pearsons Method. We evaluate how a sensor network would perform in New York City using a combination of radiation transport and geographic information systems. We use OpenStreetMap data to construct a grid over the streets and analyze vehicle paths using pickup and drop off data from the New York State Department of Transportation. The results show that data synthesis in a large network not only improves the time to the first detection but reduces the number of missed sources.


title: Optimal Hamilton covers and linear arboricity for random graphs

abstract: In his seminal 1976 paper, P\'osa showed that for all $p\geq C\log n/n$, the binomial random graph $G(n,p)$ is with high probability Hamiltonian. This leads to the following natural questions, which have been extensively studied: How well is it typically possible to cover all edges of $G(n,p)$ with Hamilton cycles? How many cycles are necessary? In this paper we show that for $ p\geq C\log n/n$, we can cover $G\sim G(n,p)$ with precisely $\lceil\Delta(G)/2\rceil$ Hamilton cycles. Our result is clearly best possible both in terms of the number of required cycles, and the asymptotics of the edge probability $p$, since it starts working at the weak threshold needed for Hamiltonicity. This resolves a problem of Glebov, Krivelevich and Szab\'o, and improves upon previous work of Hefetz, K\"uhn, Lapinskas and Osthus, and of Ferber, Kronenberg and Long, essentially closing a long line of research on Hamiltonian packing and covering problems in random graphs.


title: Features in the Inflaton Potential and the Spectrum of Cosmological Perturbations

abstract: Cosmological perturbations, originating in the quantum fluctuations of the fields that drive inflation, are observed to be nearly scale invariant at the largest scales. At smaller scales, however, perturbations are not severely constrained and might be of particular importance if their amplitude is large. They can trigger the creation of primordial black holes (PBHs) or stochastic gravitational waves (GWs). Small-scale perturbations are generated during the later stages of inflation, when possible strong features in the inflaton potential can break scale invariance and leave characteristic imprints on the spectrum. We focus on and review three types of features: inflection points and steep steps in the potential, as well as sharp turns in the inflationary trajectory in field space. We show that such features induce a strong enhancement of the curvature spectrum within a certain wavenumber range. In particular cases, they also generate characteristic oscillatory patterns that are transferred in the spectrum of secondary GWs, which are potentially observable by operating or designed experiments. We demonstrate these effects through the calculation of the primordial power spectrum and the PBH abundance in the context of $\alpha$-attractors and supergravity (SUGRA) models of inflation.


title: Cohen Generic Structures with Functions

abstract: Suppose $\mathscr{L}^-\subseteq \mathscr{L}$ are languages where $\mathscr{L} \setminus\mathscr{L}^-$ is relational. Additionally, let $\mathbf{K}$ be a strong $\textrm{Fra\"iss\'e}$ class in $\mathscr{L}$. We consider the partial ordering, under substructure, of those elements in $\mathbf{K}$ whose reduct to $\mathscr{L}^-$ are substructures of a fixed $\mathscr{L}^-$-structure $\mathcal{M}^-$. In this paper, we establish that, under general conditions, this partial order satisfies the $|\mathcal{M}^-|$-chain condition. Furthermore, under these conditions, we demonstrate that any generic for such a partial order satisfies the theory of the \Fraisse\ limit of $\mathbf{K}$, provided $\mathcal{M}^-$ satisfies the theory of$\textrm{Fra\"iss\'e}$ limit of its age. We also provide general conditions that guarantee all such generics to be rigid, as well as conditions ensuring that these generics possess large automorphism groups.


title: Dynamical evolution of second-generation circumstellar/protoplanetary disks in evolved wide binary systems

abstract: In mass-transferring wide binary stellar systems, the companion star can capture some of the mass released in wind by the primary evolved star, and form an accretion disk. Such accretion disks could evolve to form disks of comparable properties to protoplanetary disks and may enable the formation of new planets and/or the interactions, re-growth, and re-migration of pre-existing planets in the newly formed disks. We study the formation and the dynamical evolution of such "second generation" (SG) protoplanetary disks in evolved wide binary systems, with primaries in the mass range of 1-8 Solar mass. We follow their evolution from the asymptotic giant branch (AGB) phase of the red giant stellar donor until its evolution to become a white dwarf. We perform 1D semi-analytical numerical simulations for several binary systems varying the mass of the evolved stellar donor and the initial orbital distance, taking into account the changing mass-loss rates and the binary orbital expansion due to mass-loss. We calculate the radial density profile of the formed SG accretion disk and its temperature profile, considering a non-stationary viscosity profile which depends on the radial temperature profile. We find that SG circumstellar disks evolve to form a long-lived stable structure over the lifetime of the donor star, and we show that we can consistently produce the observed conditions and accretion rate inferred for the Mira evolved wide-binary system. The quasi-steady state radial surface density profiles are comparable with the typical range of masses and densities of observed (regular "first-generation") protoplanetary disks. This suggests that realistic SG disks can give rise to a second phase of planet formation and dynamics in old wide binary systems.


title: BasahaCorpus: An Expanded Linguistic Resource for Readability Assessment in Central Philippine Languages

abstract: Current research on automatic readability assessment (ARA) has focused on improving the performance of models in high-resource languages such as English. In this work, we introduce and release BasahaCorpus as part of an initiative aimed at expanding available corpora and baseline models for readability assessment in lower resource languages in the Philippines. We compiled a corpus of short fictional narratives written in Hiligaynon, Minasbate, Karay-a, and Rinconada -- languages belonging to the Central Philippine family tree subgroup -- to train ARA models using surface-level, syllable-pattern, and n-gram overlap features. We also propose a new hierarchical cross-lingual modeling approach that takes advantage of a language's placement in the family tree to increase the amount of available training data. Our study yields encouraging results that support previous work showcasing the efficacy of cross-lingual models in low-resource settings, as well as similarities in highly informative linguistic features for mutually intelligible languages.


title: Low-energy electronic interactions in ferrimagnetic Sr2CrReO6 thin films

abstract: We reveal in this study the fundamental low-energy landscape in the ferrimagnetic Sr2CrReO6 double perovskite and describe the underlying mechanisms responsible for the three low-energy excitations below 1.4 eV. Based on resonant inelastic x-ray scattering and magnetic dynamics calculations, and experiments collected from both Sr2CrReO6 powders and epitaxially strained thin films, we reveal a strong competition between spin-orbit coupling, Hund's coupling, and the strain-induced tetragonal crystal field. We also demonstrate that a spin-flip process is at the origin of the lowest excitation at 200 meV, and we bring insights into the predicted presence of orbital ordering in this material. We study the nature of the magnons through a combination of ab initio and spin-wave theory calculations, and show that two nondegenerate magnon bands exist and are dominated either by rhenium or chromium spins. The rhenium band is found to be flat at about 200 meV ($\pm$25 meV) through X-L-W-U high-symmetry points and is dispersive toward $\Gamma$


title: Excited States in Warm and Hot Dense Matter

abstract: Accurate modeling of warm and hot dense matter is challenging in part due to the multitude of excited states that must be considered. In thermal density functional theory, these excited states are averaged over to produce a single, averaged, thermal ground state. Here we present a variational framework and model that includes explicit excited states. In this framework an excited state is defined by a set of effective one-electron occupation factors and the corresponding energy is defined by the effective one-body energy with an exchange and correlation term. The variational framework is applied to an atom-in-plasma model (a generalization of the so-called average atom model). Comparisons with a density functional theory based average atom model generally reveal good agreement in the calculated pressure, but the new model also gives access to the excitation energies and charge state distributions.


title: Multi-graded Macaulay Dual Spaces

abstract: We describe an algorithm for computing Macaulay dual spaces for multi-graded ideals. For homogeneous ideals, the natural grading is inherited by the Macaulay dual space which has been leveraged to develop algorithms to compute the Macaulay dual space in each homogeneous degree. Our main theoretical result extends this idea to multi-graded Macaulay dual spaces inherited from multi-graded ideals. This natural duality allows ideal operations to be translated from homogeneous ideals to their corresponding operations on the multi-graded Macaulay dual spaces. In particular, we describe a linear operator with a right inverse for computing quotients by a multi-graded polynomial. By using a total ordering on the homogeneous components of the Macaulay dual space, we also describe how to recursively construct a basis for each component. Several examples are included to demonstrate this new approach.


title: Determination of the Equation of State from Nuclear Experiments and Neutron Star Observations

abstract: With recent advances in neutron star observations, major progress has been made in determining the pressure of neutron star matter at high density. This pressure is constrained by the neutron star deformability, determined from gravitational waves emitted in a neutron-star merger, and measurements of radii of two neutron stars, using a new X-ray observatory on the International Space Station. Previous studies have relied on nuclear theory calculations to provide the equation of state at low density. Here we use a combination of 15 constraints composed of three astronomical observations and twelve nuclear experimental constraints that extend over a wide range of densities. Bayesian Inference is then used to obtain a comprehensive nuclear equation of state. This data-centric result provides benchmarks for theoretical calculations and modeling of nuclear matter and neutron stars. Furthermore, it provides insights on the composition of neutron stars and their cooling via neutrino radiation.


title: Eliciting Human Preferences with Language Models

abstract: Language models (LMs) can be directed to perform target tasks by using labeled examples or natural language prompts. But selecting examples or writing prompts for can be challenging--especially in tasks that involve unusual edge cases, demand precise articulation of nebulous preferences, or require an accurate mental model of LM behavior. We propose to use *LMs themselves* to guide the task specification process. In this paper, we introduce **Generative Active Task Elicitation (GATE)**: a learning framework in which models elicit and infer intended behavior through free-form, language-based interaction with users. We study GATE in three domains: email validation, content recommendation, and moral reasoning. In preregistered experiments, we show that LMs prompted to perform GATE (e.g., by generating open-ended questions or synthesizing informative edge cases) elicit responses that are often more informative than user-written prompts or labels. Users report that interactive task elicitation requires less effort than prompting or example labeling and surfaces novel considerations not initially anticipated by users. Our findings suggest that LM-driven elicitation can be a powerful tool for aligning models to complex human preferences and values.


title: Towards Inferring Users' Impressions of Robot Performance in Navigation Scenarios

abstract: Human impressions of robot performance are often measured through surveys. As a more scalable and cost-effective alternative, we study the possibility of predicting people's impressions of robot behavior using non-verbal behavioral cues and machine learning techniques. To this end, we first contribute the SEAN TOGETHER Dataset consisting of observations of an interaction between a person and a mobile robot in a Virtual Reality simulation, together with impressions of robot performance provided by users on a 5-point scale. Second, we contribute analyses of how well humans and supervised learning techniques can predict perceived robot performance based on different combinations of observation types (e.g., facial, spatial, and map features). Our results show that facial expressions alone provide useful information about human impressions of robot performance; but in the navigation scenarios we tested, spatial features are the most critical piece of information for this inference task. Also, when evaluating results as binary classification (rather than multiclass classification), the F1-Score of human predictions and machine learning models more than doubles, showing that both are better at telling the directionality of robot performance than predicting exact performance ratings. Based on our findings, we provide guidelines for implementing these predictions models in real-world navigation scenarios.


title: Topological rigidity of maps in positive characteristic and anabelian geometry

abstract: We study pairs of non-constant maps between two integral schemes of finite type over two (possibly different) fields of positive characteristic. When the target is quasi-affine, Tamagawa showed that the two maps are equal up to a power of Frobenius if and only if they induce the same homomorphism on their \'etale fundamental groups. We extend Tamagawa's result by adding a purely topological criterion for maps to agree up to a power of Frobenius.


title: Characterization of diamond-turned optics for SCALES

abstract: High-contrast imaging has been used to discover and characterize dozens of exoplanets to date. The primary limiting performance factor for these instruments is contrast, the ratio of exoplanet to host star brightness that an instrument can successfully resolve. Contrast is largely determined by wavefront error, consisting of uncorrected atmospheric turbulence and optical aberrations downstream of AO correction. Single-point diamond turning allows for high-precision optics to be manufactured for use in astronomical instrumentation, presenting a cheaper and more versatile alternative to conventional glass polishing. This work presents measurements of wavefront error for diamond-turned aluminum optics in the Slicer Combined with an Array of Lenslets for Exoplanet Spectroscopy (SCALES) instrument, a 2-5 micron coronagraphic integral field spectrograph under construction for Keck Observatory. Wavefront error measurements for these optics are used to simulate SCALES' point spread function using physical optics propagation software poppy, showing that SCALES' contrast performance is not limited by wavefront error from internal instrument optics.


title: Automated Evaluation of Personalized Text Generation using Large Language Models

abstract: Personalized text generation presents a specialized mechanism for delivering content that is specific to a user's personal context. While the research progress in this area has been rapid, evaluation still presents a challenge. Traditional automated metrics such as BLEU and ROUGE primarily measure lexical similarity to human-written references, and are not able to distinguish personalization from other subtle semantic aspects, thus falling short of capturing the nuances of personalized generated content quality. On the other hand, human judgments are costly to obtain, especially in the realm of personalized evaluation. Inspired by these challenges, we explore the use of large language models (LLMs) for evaluating personalized text generation, and examine their ability to understand nuanced user context. We present AuPEL, a novel evaluation method that distills three major semantic aspects of the generated text: personalization, quality and relevance, and automatically measures these aspects. To validate the effectiveness of AuPEL, we design carefully controlled experiments and compare the accuracy of the evaluation judgments made by LLMs versus that of judgements made by human annotators, and conduct rigorous analyses of the consistency and sensitivity of the proposed metric. We find that, compared to existing evaluation metrics, AuPEL not only distinguishes and ranks models based on their personalization abilities more accurately, but also presents commendable consistency and efficiency for this task. Our work suggests that using LLMs as the evaluators of personalized text generation is superior to traditional text similarity metrics, even though interesting new challenges still remain.


title: Adversarial Robustness Unhardening via Backdoor Attacks in Federated Learning

abstract: In today's data-driven landscape, the delicate equilibrium between safeguarding user privacy and unleashing data potential stands as a paramount concern. Federated learning, which enables collaborative model training without necessitating data sharing, has emerged as a privacy-centric solution. This decentralized approach brings forth security challenges, notably poisoning and backdoor attacks where malicious entities inject corrupted data. Our research, initially spurred by test-time evasion attacks, investigates the intersection of adversarial training and backdoor attacks within federated learning, introducing Adversarial Robustness Unhardening (ARU). ARU is employed by a subset of adversaries to intentionally undermine model robustness during decentralized training, rendering models susceptible to a broader range of evasion attacks. We present extensive empirical experiments evaluating ARU's impact on adversarial training and existing robust aggregation defenses against poisoning and backdoor attacks. Our findings inform strategies for enhancing ARU to counter current defensive measures and highlight the limitations of existing defenses, offering insights into bolstering defenses against ARU.


title: WaveAttack: Asymmetric Frequency Obfuscation-based Backdoor Attacks Against Deep Neural Networks

abstract: Due to the popularity of Artificial Intelligence (AI) technology, numerous backdoor attacks are designed by adversaries to mislead deep neural network predictions by manipulating training samples and training processes. Although backdoor attacks are effective in various real scenarios, they still suffer from the problems of both low fidelity of poisoned samples and non-negligible transfer in latent space, which make them easily detectable by existing backdoor detection algorithms. To overcome the weakness, this paper proposes a novel frequency-based backdoor attack method named WaveAttack, which obtains image high-frequency features through Discrete Wavelet Transform (DWT) to generate backdoor triggers. Furthermore, we introduce an asymmetric frequency obfuscation method, which can add an adaptive residual in the training and inference stage to improve the impact of triggers and further enhance the effectiveness of WaveAttack. Comprehensive experimental results show that WaveAttack not only achieves higher stealthiness and effectiveness, but also outperforms state-of-the-art (SOTA) backdoor attack methods in the fidelity of images by up to 28.27\% improvement in PSNR, 1.61\% improvement in SSIM, and 70.59\% reduction in IS.


title: Skyrmion Transport and Annihilation in Funnel Geometries

abstract: Using atomistic simulations, we have investigated the transport and annihilation of skyrmions interacting with a funnel array under a current applied perpendicular to the funnel axis. We find that transport without annihilation is possible at low currents, when the motion is dominated by skyrmion-skyrmion interactions and skyrmions push each other through the funnel opening. Skyrmion annihilation occurs for higher currents when skyrmions in the upper half of the sample exert pressure on skyrmions in the bottom half of the sample due to the external current. Upon interacting with the funnel wall, the skyrmions undergo a size reduction that makes it easier for them to pass through the funnel opening. We find five phases as a function of the applied current and the size of the funnel opening: (i) pinned, (ii) transport without annihilation, (iii) transport with annihilation, (iv) complete annihilation, and (v) a reentrant pinning phase that only occurs for very narrow openings. Our findings provide insight into how to control skyrmion transport using funnel arrays by delineating regimes in which transport of skyrmions is possible as well as the conditions under which annihilation occurs.


title: The Efficacy of Transformer-based Adversarial Attacks in Security Domains

abstract: Today, the security of many domains rely on the use of Machine Learning to detect threats, identify vulnerabilities, and safeguard systems from attacks. Recently, transformer architectures have improved the state-of-the-art performance on a wide range of tasks such as malware detection and network intrusion detection. But, before abandoning current approaches to transformers, it is crucial to understand their properties and implications on cybersecurity applications. In this paper, we evaluate the robustness of transformers to adversarial samples for system defenders (i.e., resiliency to adversarial perturbations generated on different types of architectures) and their adversarial strength for system attackers (i.e., transferability of adversarial samples generated by transformers to other target models). To that effect, we first fine-tune a set of pre-trained transformer, Convolutional Neural Network (CNN), and hybrid (an ensemble of transformer and CNN) models to solve different downstream image-based tasks. Then, we use an attack algorithm to craft 19,367 adversarial examples on each model for each task. The transferability of these adversarial examples is measured by evaluating each set on other models to determine which models offer more adversarial strength, and consequently, more robustness against these attacks. We find that the adversarial examples crafted on transformers offer the highest transferability rate (i.e., 25.7% higher than the average) onto other models. Similarly, adversarial examples crafted on other models have the lowest rate of transferability (i.e., 56.7% lower than the average) onto transformers. Our work emphasizes the importance of studying transformer architectures for attacking and defending models in security domains, and suggests using them as the primary architecture in transfer attack settings.


title: Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priors

abstract: Learning neural implicit representations has achieved remarkable performance in 3D reconstruction from multi-view images. Current methods use volume rendering to render implicit representations into either RGB or depth images that are supervised by multi-view ground truth. However, rendering a view each time suffers from incomplete depth at holes and unawareness of occluded structures from the depth supervision, which severely affects the accuracy of geometry inference via volume rendering. To resolve this issue, we propose to learn neural implicit representations from multi-view RGBD images through volume rendering with an attentive depth fusion prior. Our prior allows neural networks to perceive coarse 3D structures from the Truncated Signed Distance Function (TSDF) fused from all depth images available for rendering. The TSDF enables accessing the missing depth at holes on one depth image and the occluded parts that are invisible from the current view. By introducing a novel attention mechanism, we allow neural networks to directly use the depth fusion prior with the inferred occupancy as the learned implicit function. Our attention mechanism works with either a one-time fused TSDF that represents a whole scene or an incrementally fused TSDF that represents a partial scene in the context of Simultaneous Localization and Mapping (SLAM). Our evaluations on widely used benchmarks including synthetic and real-world scans show our superiority over the latest neural implicit methods. Project page: https://machineperceptionlab.github.io/Attentive_DF_Prior/


title: Hybrid Trajectory Optimization of Simple Skateboarding Tricks through Contact

abstract: Trajectories are optimized for a two-dimensional simplified skateboarding system to allow it to perform a fundamental skateboarding trick called an "ollie". A methodology for generating trick trajectories by controlling the position of a point-mass relative to a board is presented and demonstrated over a range of peak jump heights. A hybrid dynamics approach is taken to perform this optimization, with contact constraints applied along a sequence of discrete timesteps based on the board's position throughout designated sections of the trick. These constraints introduce explicit and implicit discontinuities between chosen sections of the trick sequence. The approach has been shown to be successful for a set of realistic system parameters.


title: Rotation Vectors for Torus Maps by the Weighted Birkhoff Average

abstract: In this paper, we focus on distinguishing between the types of dynamical behavior that occur for typical one- and two-dimensional torus maps, in particular without the assumption of invertibility. We use three fast and accurate numerical methods: weighted Birkhoff averages, Farey trees, and resonance orders. The first of these allows us to distinguish between chaotic and regular orbits, as well as to calculate the frequency vectors for the regular case to high precision. The second method allows us to distinguish between the periodic and quasiperiodic orbits, and the third allows us to distinguish among the quasiperiodic orbits to determine the dimension the resulting attracting tori. We first consider the well-studied Arnold circle map, comparing our results to the universal power law of Jensen and Ecke. We next consider quasiperiodically forced circle maps, inspired by models introduced by Ding, Grebogi, and Ott. We use the Birkhoff average to distinguish between "strong" chaos (positive Lyapunov exponents) and "weak" chaos (strange nonchaotic attractors). Finally, we apply our methods to 2D torus maps, building on the work of Grebogi, Ott, and Yorke. We distinguish incommensurate, resonant, periodic, and chaotic orbits and accurately compute the proportions of each as the strength of the nonlinearity grows. We compute generalizations of Arnold tongues corresponding to resonances and to periodic orbits, and we show that chaos typically begins before the map becomes noninvertible. We show that the proportion of nonresonant orbits does not obey a universal power law like that seen in the 1D case.


title: LANSCE 805 MHz Low Level RF Resonance Control Water System Upgrade

abstract: The Los Alamos Neutron Science Center (LANSCE) accelerator at Los Alamos National Laboratory (LANL) has been in service for over 50 years. Efforts to update and modernize crucial systems, many of which are origi-nal, are ongoing. This paper reports on the refurbishment of the Low-Level Radio Frequency (LLRF) Resonance Control Water System (RCWS) for the half-mile long Cavity-Coupled LINAC (CCL). The RCWS controls the resonance frequency of the cavities by controlling the temperature of the cooling water delivered to each of 44 accelerator modules. Of the 44 modules making up the CCL, 20 now have an upgraded RCWS. Upgrading in-cludes removing the old hardware and installing new components including: water pumps, mix tanks, valves, temperature switches, flow switches and plumbing. This paper describes the design of the new system, material and component selection, installation, and technical challenges.


title: FreSh: A Lock-Free Data Series Index

abstract: We present FreSh, a lock-free data series index that exhibits good performance (while being robust). FreSh is based on Refresh, which is a generic approach we have developed for supporting lock-freedom in an efficient way on top of any localityaware data series index. We believe Refresh is of independent interest and can be used to get well-performed lock-free versions of other locality-aware blocking data structures. For developing FreSh, we first studied in depth the design decisions of current state-of-the-art data series indexes, and the principles governing their performance. This led to a theoretical framework, which enables the development and analysis of data series indexes in a modular way. The framework allowed us to apply Refresh, repeatedly, to get lock-free versions of the different phases of a family of data series indexes. Experiments with several synthetic and real datasets illustrate that FreSh achieves performance that is as good as that of the state-of-the-art blocking in-memory data series index. This shows that the helping mechanisms of FreSh are light-weight, respecting certain principles that are crucial for performance in locality-aware data structures.This paper was published in SRDS 2023.


title: Group sequential two-stage preference designs

abstract: The two-stage preference design (TSPD) enables the inference for treatment efficacy while allowing for incorporation of patient preference to treatment. It can provide unbiased estimates for selection and preference effects, where a selection effect occurs when patients who prefer one treatment respond differently than those who prefer another, and a preference effect is the difference in response caused by an interaction between the patient's preference and the actual treatment they receive. One potential barrier to adopting TSPD in practice, however, is the relatively large sample size required to estimate selection and preference effects with sufficient power. To address this concern, we propose a group sequential two-stage preference design (GS-TSPD), which combines TSPD with sequential monitoring for early stopping. In the GS-TSPD, pre-planned sequential monitoring allows investigators to conduct repeated hypothesis tests on accumulated data prior to full enrollment to assess study eligibility for early trial termination without inflating type I error rates. Thus, the procedure allows investigators to terminate the study when there is sufficient evidence of treatment, selection, or preference effects during an interim analysis, thereby reducing the design resource in expectation. To formalize such a procedure, we verify the independent increments assumption for testing the selection and preference effects and apply group sequential stopping boundaries from the approximate sequential density functions. Simulations are then conducted to investigate the operating characteristics of our proposed GS-TSPD compared to the traditional TSPD. We demonstrate the applicability of the design using a study of Hepatitis C treatment modality.


title: Language Models as Zero-Shot Trajectory Generators

abstract: Large Language Models (LLMs) have recently shown promise as high-level planners for robots when given access to a selection of low-level skills. However, it is often assumed that LLMs do not possess sufficient knowledge to be used for the low-level trajectories themselves. In this work, we address this assumption thoroughly, and investigate if an LLM (GPT-4) can directly predict a dense sequence of end-effector poses for manipulation tasks, when given access to only object detection and segmentation vision models. We designed a single, task-agnostic prompt, without any in-context examples, motion primitives, or external trajectory optimisers. Then we studied how well it can perform across 30 real-world language-based tasks, such as "open the bottle cap" and "wipe the plate with the sponge", and we investigated which design choices in this prompt are the most important. Our conclusions raise the assumed limit of LLMs for robotics, and we reveal for the first time that LLMs do indeed possess an understanding of low-level robot control sufficient for a range of common tasks, and that they can additionally detect failures and then re-plan trajectories accordingly. Videos, prompts, and code are available at: https://www.robot-learning.uk/language-models-trajectory-generators.


title: DIAR: Deep Image Alignment and Reconstruction using Swin Transformers

abstract: When taking images of some occluded content, one is often faced with the problem that every individual image frame contains unwanted artifacts, but a collection of images contains all relevant information if properly aligned and aggregated. In this paper, we attempt to build a deep learning pipeline that simultaneously aligns a sequence of distorted images and reconstructs them. We create a dataset that contains images with image distortions, such as lighting, specularities, shadows, and occlusion. We create perspective distortions with corresponding ground-truth homographies as labels. We use our dataset to train Swin transformer models to analyze sequential image data. The attention maps enable the model to detect relevant image content and differentiate it from outliers and artifacts. We further explore using neural feature maps as alternatives to classical key point detectors. The feature maps of trained convolutional layers provide dense image descriptors that can be used to find point correspondences between images. We utilize this to compute coarse image alignments and explore its limitations.


title: Morphologie des posets (-1)-critiques

abstract: Let $G=(V,A)$ be a digraph. For $X\subseteq V$, the subdigraph of $G$ induced by $X$ is denoted by $G[X]$. A subset $I$ of $V$ is an interval of $G$ if for every $a,b \in I$ and $x \in V \setminus I$, $(x,a) \in A$ if and only if $(x,b) \in A$, and similarly for $(a,x)$ and $(b,x)$. The trivial intervals of $G$ are $\varnothing$, $V$ and $\lbrace x\rbrace$, where $x\in V$. The digraph $G$ is indecomposable if $| V(G)|\geqslant 3$ and all its intervals are trivial. Given an indecomposable digraph $G$, a vertex $x$ of $G$ is critical, if the induced subdigraph $G[V(G) \setminus \{x\}]$ is decomposable. The digraph $G$ is said to be (-1)-critical if it admits a single non-critical vertex. A poset (or a strict partial order) is a transitive digraph. In this paper, We characterize the (-1)-critical posets.


title: TK-KNN: A Balanced Distance-Based Pseudo Labeling Approach for Semi-Supervised Intent Classification

abstract: The ability to detect intent in dialogue systems has become increasingly important in modern technology. These systems often generate a large amount of unlabeled data, and manually labeling this data requires substantial human effort. Semi-supervised methods attempt to remedy this cost by using a model trained on a few labeled examples and then by assigning pseudo-labels to further a subset of unlabeled examples that has a model prediction confidence higher than a certain threshold. However, one particularly perilous consequence of these methods is the risk of picking an imbalanced set of examples across classes, which could lead to poor labels. In the present work, we describe Top-K K-Nearest Neighbor (TK-KNN), which uses a more robust pseudo-labeling approach based on distance in the embedding space while maintaining a balanced set of pseudo-labeled examples across classes through a ranking-based approach. Experiments on several datasets show that TK-KNN outperforms existing models, particularly when labeled data is scarce on popular datasets such as CLINC150 and Banking77. Code is available at https://github.com/ServiceNow/tk-knn


title: Classification of Safety Driver Attention During Autonomous Vehicle Operation

abstract: Despite the continual advances in Advanced Driver Assistance Systems (ADAS) and the development of high-level autonomous vehicles (AV), there is a general consensus that for the short to medium term, there is a requirement for a human supervisor to handle the edge cases that inevitably arise. Given this requirement, it is essential that the state of the vehicle operator is monitored to ensure they are contributing to the vehicle's safe operation. This paper introduces a dual-source approach integrating data from an infrared camera facing the vehicle operator and vehicle perception systems to produce a metric for driver alertness in order to promote and ensure safe operator behaviour. The infrared camera detects the driver's head, enabling the calculation of head orientation, which is relevant as the head typically moves according to the individual's focus of attention. By incorporating environmental data from the perception system, it becomes possible to determine whether the vehicle operator observes objects in the surroundings. Experiments were conducted using data collected in Sydney, Australia, simulating AV operations in an urban environment. Our results demonstrate that the proposed system effectively determines a metric for the attention levels of the vehicle operator, enabling interventions such as warnings or reducing autonomous functionality as appropriate. This comprehensive solution shows promise in contributing to ADAS and AVs' overall safety and efficiency in a real-world setting.


title: Reflection-Equivariant Diffusion for 3D Structure Determination from Isotopologue Rotational Spectra in Natural Abundance

abstract: Structure determination is necessary to identify unknown organic molecules, such as those in natural products, forensic samples, the interstellar medium, and laboratory syntheses. Rotational spectroscopy enables structure determination by providing accurate 3D information about small organic molecules via their moments of inertia. Using these moments, Kraitchman analysis determines isotopic substitution coordinates, which are the unsigned $|x|,|y|,|z|$ coordinates of all atoms with natural isotopic abundance, including carbon, nitrogen, and oxygen. While unsigned substitution coordinates can verify guesses of structures, the missing $+/-$ signs make it challenging to determine the actual structure from the substitution coordinates alone. To tackle this inverse problem, we develop KREED (Kraitchman REflection-Equivariant Diffusion), a generative diffusion model that infers a molecule's complete 3D structure from its molecular formula, moments of inertia, and unsigned substitution coordinates of heavy atoms. KREED's top-1 predictions identify the correct 3D structure with >98% accuracy on the QM9 and GEOM datasets when provided with substitution coordinates of all heavy atoms with natural isotopic abundance. When substitution coordinates are restricted to only a subset of carbons, accuracy is retained at 91% on QM9 and 32% on GEOM. On a test set of experimentally measured substitution coordinates gathered from the literature, KREED predicts the correct all-atom 3D structure in 25 of 33 cases, demonstrating experimental applicability for context-free 3D structure determination with rotational spectroscopy.


title: On the asymptotic behavior of p-superharmonic functions at singularities

abstract: In this paper we develop the p-thinness and the p-fine topology for the asymptotic behavior of p-superharmonic functions at singular points. We consider these as extensions of earlier works on superharmonic functions in dimension 2, on the Riesz and Log potentials in higher dimensions,, and on p-harmonic functions. It is remarkable that, contrary to the above cases, the p-thinness for the singular behavior differs from the p-thinness for continuity by the Wiener criterion for p-superharmonic functions. As applications of asymptotic estimates of p-superharmonic functions, we also obtain asymptotic estimates of solutions to a class of fully nonlinear elliptic equations. This paper grows out of our recent papers on the potential theory in conformal geometry.


title: In defense of parameter sharing for model-compression

abstract: When considering a model architecture, there are several ways to reduce its memory footprint. Historically, popular approaches included selecting smaller architectures and creating sparse networks through pruning. More recently, randomized parameter-sharing (RPS) methods have gained traction for model compression at start of training. In this paper, we comprehensively assess the trade-off between memory and accuracy across RPS, pruning techniques, and building smaller models. Our findings demonstrate that RPS, which is both data and model-agnostic, consistently outperforms/matches smaller models and all moderately informed pruning strategies, such as MAG, SNIP, SYNFLOW, and GRASP, across the entire compression range. This advantage becomes particularly pronounced in higher compression scenarios. Notably, even when compared to highly informed pruning techniques like Lottery Ticket Rewinding (LTR), RPS exhibits superior performance in high compression settings. This points out inherent capacity advantage that RPS enjoys over sparse models. Theoretically, we establish RPS as a superior technique in terms of memory-efficient representation when compared to pruning for linear models. This paper argues in favor of paradigm shift towards RPS based models. During our rigorous evaluation of RPS, we identified issues in the state-of-the-art RPS technique ROAST, specifically regarding stability (ROAST's sensitivity to initialization hyperparameters, often leading to divergence) and Pareto-continuity (ROAST's inability to recover the accuracy of the original model at zero compression). We provably address both of these issues. We refer to the modified RPS, which incorporates our improvements, as STABLE-RPS.


title: Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks

abstract: In this work, we present a post-processing solution to address the hubness problem in cross-modal retrieval, a phenomenon where a small number of gallery data points are frequently retrieved, resulting in a decline in retrieval performance. We first theoretically demonstrate the necessity of incorporating both the gallery and query data for addressing hubness as hubs always exhibit high similarity with gallery and query data. Second, building on our theoretical results, we propose a novel framework, Dual Bank Normalization (DBNorm). While previous work has attempted to alleviate hubness by only utilizing the query samples, DBNorm leverages two banks constructed from the query and gallery samples to reduce the occurrence of hubs during inference. Next, to complement DBNorm, we introduce two novel methods, dual inverted softmax and dual dynamic inverted softmax, for normalizing similarity based on the two banks. Specifically, our proposed methods reduce the similarity between hubs and queries while improving the similarity between non-hubs and queries. Finally, we present extensive experimental results on diverse language-grounded benchmarks, including text-image, text-video, and text-audio, demonstrating the superior performance of our approaches compared to previous methods in addressing hubness and boosting retrieval performance. Our code is available at https://github.com/yimuwangcs/Better_Cross_Modal_Retrieval.


title: No Evidence for More Earth-sized Planets in the Habitable Zone of Kepler's M versus FGK Stars

abstract: Reliable detections of Earth-sized planets in the habitable zone remain elusive in the Kepler sample, even for M dwarfs. The Kepler sample was once thought to contain a considerable number of M dwarf stars ($T_\mathrm{eff} < 4000$ K), which hosted enough Earth-sized ($[0.5,1.5]$ R$_\oplus$) planets to estimate their occurrence rate ($\eta_\oplus$) in the habitable zone. However, updated stellar properties from Gaia have shifted many Kepler stars to earlier spectral type classifications, with most stars (and their planets) now measured to be larger and hotter than previously believed. Today, only one partially-reliable Earth-sized candidate remains in the optimistic habitable zone, and zero in the conservative zone. Here we performed a new investigation of Kepler's Earth-sized planets orbiting M dwarf stars, using occurrence rate models with considerations of updated parameters and candidate reliability. Extrapolating our models to low instellations, we found an occurrence rate of $\eta_\oplus={8.58}_{-8.22}^{+17.94}\%$ for the conservative habitable zone (and ${14.22}_{-12.71}^{+24.96}\%$ for the optimistic), consistent with previous works when considering the large uncertainties. Comparing these estimates to those from similarly comprehensive studies of Sun-like stars, we found that the current Kepler sample does not offer evidence to support an increase in $\eta_\oplus$ from FGK to M stars. While the Kepler sample is too sparse to resolve an occurrence trend between early and mid-to-late M dwarfs for Earth-sized planets, studies including larger planets and/or data from the K2 and TESS missions are well-suited to this task.


title: Learning a Hierarchical Planner from Humans in Multiple Generations

abstract: A typical way in which a machine acquires knowledge from humans is by programming. Compared to learning from demonstrations or experiences, programmatic learning allows the machine to acquire a novel skill as soon as the program is written, and, by building a library of programs, a machine can quickly learn how to perform complex tasks. However, as programs often take their execution contexts for granted, they are brittle when the contexts change, making it difficult to adapt complex programs to new contexts. We present natural programming, a library learning system that combines programmatic learning with a hierarchical planner. Natural programming maintains a library of decompositions, consisting of a goal, a linguistic description of how this goal decompose into sub-goals, and a concrete instance of its decomposition into sub-goals. A user teaches the system via curriculum building, by identifying a challenging yet not impossible goal along with linguistic hints on how this goal may be decomposed into sub-goals. The system solves for the goal via hierarchical planning, using the linguistic hints to guide its probability distribution in proposing the right plans. The system learns from this interaction by adding newly found decompositions in the successful search into its library. Simulated studies and a human experiment (n=360) on a controlled environment demonstrate that natural programming can robustly compose programs learned from different users and contexts, adapting faster and solving more complex tasks when compared to programmatic baselines.


title: Potential of Photovoltaics and Energy Storage to Address Lack of Electricity Access

abstract: Lack of electricity access is widespread in the developing world and associated with increased mortality, reduced educational levels, and economic and social disadvantages, especially among women. The 2030 Agenda for Sustainable Development has emphasized securing access to affordable, reliable, and sustainable energy for all. For climatological and health reasons, particular attention has been focused on expanding the use of renewables for electricity production. In particular, photovoltaics, coupled to energy storage, is an attractive option for dispatchable electricity production, but the degree to which they can be used to address global lack of electricity access, and associated costs, merits more attention. This study presents a global geospatial analysis to identify areas suitable for production of dispatchable electricity using photovoltaics and energy storage. Analysis considers land use restrictions, 25 years of historical hourly solar irradiance, seasonal demand curves, population, and visible nighttime light (as a measure of electrification). We show that nearly all the population identified without electricity access (approx. 1.1 billion people) could get access to Tier 5 level electricity in the Sustainable Energy for All initiative framework using photovoltaics and battery storage coupled systems. Under most cost scenarios analyzed, around 90 percent of this population could be served for a lifetime cost of electricity (LCOE) of 0.20 dollars per kWhe or less at current system costs.


title: Unveiling the General Intelligence Factor in Language Models: A Psychometric Approach

abstract: This study uncovers the factor of general intelligence, or g, in language models, extending the psychometric theory traditionally applied to humans and certain animal species. Utilizing factor analysis on two extensive datasets - Open LLM Leaderboard with 1,232 models and General Language Understanding Evaluation (GLUE) Leaderboard with 88 models - we find compelling evidence for a unidimensional, highly stable g factor that accounts for 85% of the variance in model performance. The study also finds a moderate correlation of .49 between model size and g. The discovery of g in language models offers a unified metric for model evaluation and opens new avenues for more robust, g-based model ability assessment. These findings lay the foundation for understanding and future research on artificial general intelligence from a psychometric perspective and have practical implications for model evaluation and development.


title: Comments on the double cone wormhole

abstract: In this paper we revisit the double cone wormhole introduced by Saad, Shenker and Stanford (SSS), which was shown to reproduce the ramp in the spectral form factor. As a first approximation we can say that this solution computes $\textrm{Tr}[e^{-iKT}]$, a trace of the "evolution" operator that generates Schwarzschild time translations on the two sided wormhole geometry. This point of view leads to a simple way to compute the normalization factor of the wormhole. When we have bulk matter fields, SSS suggested using a modified evolution $\tilde K$ which involves a slightly complex geometry, so that we are really computing $\textrm{Tr}[e^{-i\tilde{K}T}]$. We argue that, for general black holes, the spectrum of $\tilde K$ is given by quasinormal mode frequencies. We explain that this reproduces various features that were previously predicted from the spectral form factor on hydrodynamics grounds. We also give a general algebraic construction of the modified boost in terms of operators constructed from half sided modular inclusions. For the special case of JT gravity, we work out the backreaction of matter on the geometry of the double cone and find that it deforms the geometry in an undesirable direction. We finally give some comments on the possible physical interpretation of $\tilde K$.


title: Testing Modules for Experiments in Stellar Astrophysics (MESA)

abstract: Regular, automated testing is a foundational principle of modern software development. Numerous widely-used continuous integration systems exist, but they are often not suitable for the unique needs of scientific simulation software. Here we describe the testing infrastructure developed for and used by the Modules for Experiments in Stellar Astrophysics (MESA) project. This system allows the computationally-demanding MESA test suite to be regularly run on a heterogeneous set of computers and aggregates and displays the testing results in a form that allows for the rapid identification and diagnosis of regressions. Regularly collecting comprehensive testing data also enables longitudinal studies of the performance of the software and the properties of the models it generates.


title: Determining the Betti numbers of $R/(x^{p^e},y^{p^e},z^{p^e})$ for most even degree hypersurfaces in odd characteristic

abstract: Let $k$ be a field of odd characteristic $p$. Fix an even number $d<p+1$ and a power $q\geq d+3$ of $p$. For most choices of degree $d$ standard graded hypersurfaces $R=k[x,y,z]/(f)$ with homogeneous maximal ideal $\mathfrak{m}$, we can determine the graded Betti numbers of $R/\mathfrak{m}^{[q]}$. In fact, given two fixed powers $q_0,q_1\geq d+3$, for most choices of $R$ the graded Betti numbers in high homological degree of $R/\mathfrak{m}^{[q_0]}$ and $R/\mathfrak{m}^{[q_1]}$ are the same up to a constant shift. This thesis shows this fact by combining our results with the work of Miller, Rahmati, and R.G. on link-$q$-compressed polynomials in Betti numbers of the frobenius powers of the maximal ideal over certain hypersurfaces. We show that link-$q$-compressed polynomials are indeed fairly common in many polynomial rings.


title: Enhancing modified treatment policy effect estimation with weighted energy distance

abstract: The effects of continuous treatments are often characterized through the average dose response function, which is challenging to estimate from observational data due to confounding and positivity violations. Modified treatment policies (MTPs) are an alternative approach that aim to assess the effect of a modification to observed treatment values and work under relaxed assumptions. Estimators for MTPs generally focus on estimating the conditional density of treatment given covariates and using it to construct weights. However, weighting using conditional density models has well-documented challenges. Further, MTPs with larger treatment modifications have stronger confounding and no tools exist to help choose an appropriate modification magnitude. This paper investigates the role of weights for MTPs showing that to control confounding, weights should balance the weighted data to an unobserved hypothetical target population, that can be characterized with observed data. Leveraging this insight, we present a versatile set of tools to enhance estimation for MTPs. We introduce a distance that measures imbalance of covariate distributions under the MTP and use it to develop new weighting methods and tools to aid in the estimation of MTPs. We illustrate our methods through an example studying the effect of mechanical power of ventilation on in-hospital mortality.


title: The Impact of Patchy Reionization on Ultra-faint Dwarf Galaxies

abstract: We investigate how patchy reionization affects the star formation history (SFH) and stellar metallicity of ultra-faint dwarf galaxies (UFDs). Patchy reionization refers to varying ultraviolet (UV) background strengths depending on a galaxy's environment. Recent observations highlight the significance of this effect on UFDs, as UFDs can have different SFHs depending on their relative position with respect to their host halo during the period of reionization. However, most cosmological hydrodynamic simulations do not consider environmental factors such as patchy reionization, and the effect of reionization is typically applied homogeneously. Using a novel approach to implement patchy reionization, we show how SFHs of simulated UFDs can change. Our cosmological hydrodynamic zoom-in simulations focus on UFD analogs with M_vir~10^9solar mass, M_star < 10^5 solar mass at $z=0$. We find that patchy reionization can weaken the effect of reionization by two orders of magnitude up to $z=3$, enabling late star formation in half of the simulated UFDs, with quenching times $\sim$460 Myr later than those with homogeneous reionization. We also show that halo merger and mass assembly can affect the SFHs of simulated UFDs, in addition to patchy reionization. The average stellar iron-to-hydrogen ratio, [Fe/H], of the simulated UFDs with patchy reionization increases by 0.22-0.42 dex. Finally, our findings suggest that patchy reionization could be responsible for the extended SFHs of Magellanic UFDs compared to non-Magellanic UFDs.


title: High-Resolution Building and Road Detection from Sentinel-2

abstract: Mapping buildings and roads automatically with remote sensing typically requires high-resolution imagery, which is expensive to obtain and often sparsely available. In this work we demonstrate how multiple 10 m resolution Sentinel-2 images can be used to generate 50 cm resolution building and road segmentation masks. This is done by training a `student' model with access to Sentinel-2 images to reproduce the predictions of a `teacher' model which has access to corresponding high-resolution imagery. While the predictions do not have all the fine detail of the teacher model, we find that we are able to retain much of the performance: for building segmentation we achieve 78.3% mIoU, compared to the high-resolution teacher model accuracy of 85.3% mIoU. We also describe a related method for counting individual buildings in a Sentinel-2 patch which achieves R^2 = 0.91 against true counts. This work opens up new possibilities for using freely available Sentinel-2 imagery for a range of tasks that previously could only be done with high-resolution satellite imagery.


title: Stein's theorem on infinite type domains

abstract: The disc property is formulated for domains in $\mathbb{C}^n$. Holomorphic Lipschitz functions enjoy a gain in the order of Lipschitz regularity along the complex tangential direction on domains with disc property. Disc property is studied on various domains of infinite type. As applications, the local version of Stein's theorem is obtained on these domains, including the worm domains.


title: The free energy balance equation applied to gyrokinetic instabilities, the effect of the charge flux constraint, and application to simplified kinetic models

abstract: The free energy balance equation for gyrokinetic fluctuations is derived and applied to instabilities. An additional term due to electromagnetic sources is included. This can provide a simpler way to compute the free energy balance in practical applications, and is also conceptually clarifying. The free energy balance, by itself, is not sufficient to determine an eigenfrequency. The preceding results are derived in general geometry. The charge flux constraint in gyrokinetics can provide a necessary additional relation, and the combination of these two can be equivalent to a dispersion relation. The charge flux constraint can prevent the appearance of an unstable eigenmode even though the free energy balance would allow strongly growing fluctuations. The application of these concepts to simplified kinetic models in simplified geometry is also indicated.


title: The Einstein-Hilbert functional and the Donaldson-Futaki invariant

abstract: Given a Kaehler manifold polarised by a holomorphic ample line bundle, we consider the circle bundle associated to the polarisation with the induced transversal holomorphic structure. The space of contact structures compatible with this transversal structure is naturally identified with a bundle, of infinite rank, over the space of Kaehler metrics in the first Chern class of the polarisation. We show that the Einstein-Hilbert functional of the associated Tanaka-Webster connections is a functional on this bundle, whose critical points are constant scalar curvature Sasaki structures. In particular, when the group of automorphisms is discrete, these critical points correspond to constant scalar curvature Kaehler metrics in the first Chern class of the polarisation. We show that the Einstein--Hilbert functional satisfies some monotonicity properties along some one-parameter families of CR-contact structures that are naturally associated to test configurations, and that its limit on the central fibre of a test configuration is related to the Donaldson-Futaki invariant through an expansion in terms of an extra real parameter. As a by-product, we obtain an original proof that the existence of constant scalar curvature Kaehler metrics on a polarized manifold implies K-semistability. We also show that the limit of the Einstein-Hilbert functional on the central fibre coincides with the ratio of the equivariant index characters pole coefficients of the central fibre.


title: HyperNetX: A Python package for modeling complex network data as hypergraphs

abstract: HyperNetX (HNX) is an open source Python library for the analysis and visualization of complex network data modeled as hypergraphs. Initially released in 2019, HNX facilitates exploratory data analysis of complex networks using algebraic topology, combinatorics, and generalized hypergraph and graph theoretical methods on structured data inputs. With its 2023 release, the library supports attaching metadata, numerical and categorical, to nodes (vertices) and hyperedges, as well as to node-hyperedge pairings (incidences). HNX has a customizable Matplotlib-based visualization module as well as HypernetX-Widget, its JavaScript addon for interactive exploration and visualization of hypergraphs within Jupyter Notebooks. Both packages are available on GitHub and PyPI. With a growing community of users and collaborators, HNX has become a preeminent tool for hypergraph analysis.


title: Could a Kilonova Kill: a Threat Assessment

abstract: Binary neutron star mergers (BNS) produce high-energy emissions from several physically different sources, including a gamma-ray burst (GRB) and its afterglow, a kilonova, and, at late times, a remnant many parsecs in size. Ionizing radiation from these sources can be dangerous for life on Earth-like planets when located too close. Work to date has explored the substantial danger posed by the GRB to on-axis observers: here we focus instead on the potential threats posed to nearby off-axis observers. Our analysis is based largely on observations of the GW 170817/GRB 170817A multi-messenger event, as well as theoretical predictions. For baseline kilonova parameters, we find that the X-ray emission from the afterglow may be lethal out to $\sim 5$ pc and the off-axis gamma-ray emission may threaten a range out to $\sim 4$ pc, whereas the greatest threat comes years after the explosion, from the cosmic rays accelerated by the kilonova blast, which can be lethal out to distances up to $\sim 11$ pc. The distances quoted here are typical, but the values have significant uncertainties and depend on the viewing angle, ejected mass, and explosion energy in ways we quantify. Assessing the overall threat to Earth-like planets, have a similar kill distance to supernovae, but are far less common. However, our results rely on the scant available kilonova data, and multi-messenger observations will clarify the danger posed by such events.


title: Learn Your Tokens: Word-Pooled Tokenization for Language Modeling

abstract: Language models typically tokenize text into subwords, using a deterministic, hand-engineered heuristic of combining characters into longer surface-level strings such as 'ing' or whole words. Recent literature has repeatedly shown the limitations of such a tokenization strategy, particularly for documents not written in English and for representing numbers. On the other extreme, byte/character-level language models are much less restricted but suffer from increased sequence description lengths and a subsequent quadratic expansion in self-attention computation. Recent attempts to compress and limit these context lengths with fixed size convolutions is helpful but completely ignores the word boundary. This paper considers an alternative 'learn your tokens' scheme which utilizes the word boundary to pool bytes/characters into word representations, which are fed to the primary language model, before again decoding individual characters/bytes per word in parallel. We find that our moderately expressive and moderately fast end-to-end tokenizer outperform by over 300% both subwords and byte/character models over the intrinsic language modeling metric of next-word prediction across datasets. It particularly outshines on rare words, outperforming by a factor of 30! We extensively study the language modeling setup for all three categories of tokenizers and theoretically analyze how our end-to-end models can also be a strong trade-off in efficiency and robustness.


title: Holistic Parking Slot Detection with Polygon-Shaped Representations

abstract: Current parking slot detection in advanced driver-assistance systems (ADAS) primarily relies on ultrasonic sensors. This method has several limitations such as the need to scan the entire parking slot before detecting it, the incapacity of detecting multiple slots in a row, and the difficulty of classifying them. Due to the complex visual environment, vehicles are equipped with surround view camera systems to detect vacant parking slots. Previous research works in this field mostly use image-domain models to solve the problem. These two-stage approaches separate the 2D detection and 3D pose estimation steps using camera calibration. In this paper, we propose one-step Holistic Parking Slot Network (HPS-Net), a tailor-made adaptation of the You Only Look Once (YOLO)v4 algorithm. This camera-based approach directly outputs the four vertex coordinates of the parking slot in topview domain, instead of a bounding box in raw camera images. Several visible points and shapes can be proposed from different angles. A novel regression loss function named polygon-corner Generalized Intersection over Union (GIoU) for polygon vertex position optimization is also proposed to manage the slot orientation and to distinguish the entrance line. Experiments show that HPS-Net can detect various vacant parking slots with a F1-score of 0.92 on our internal Valeo Parking Slots Dataset (VPSD) and 0.99 on the public dataset PS2.0. It provides a satisfying generalization and robustness in various parking scenarios, such as indoor (F1: 0.86) or paved ground (F1: 0.91). Moreover, it achieves a real-time detection speed of 17 FPS on Nvidia Drive AGX Xavier. A demo video can be found at https://streamable.com/75j7sj.


title: Adaptive Bootstrap Tests for Composite Null Hypotheses in the Mediation Pathway Analysis

abstract: Mediation analysis aims to assess if, and how, a certain exposure influences an outcome of interest through intermediate variables. This problem has recently gained a surge of attention due to the tremendous need for such analyses in scientific fields. Testing for the mediation effect is greatly challenged by the fact that the underlying null hypothesis (i.e. the absence of mediation effects) is composite. Most existing mediation tests are overly conservative and thus underpowered. To overcome this significant methodological hurdle, we develop an adaptive bootstrap testing framework that can accommodate different types of composite null hypotheses in the mediation pathway analysis. Applied to the product of coefficients (PoC) test and the joint significance (JS) test, our adaptive testing procedures provide type I error control under the composite null, resulting in much improved statistical power compared to existing tests. Both theoretical properties and numerical examples of the proposed methodology are discussed.


title: Future changes in the vertical structure of severe convective storm environments over the U.S. central Great Plains

abstract: The effect of warming on severe convective storm potential is commonly explained in terms of changes in vertically-integrated ("bulk") environmental parameters, such as CAPE and 0--6 km shear. However, such events are known to depend on details of the vertical structure of the thermodynamic and kinematic environment that can change independently of these bulk parameters. This work examines how warming may affect the complete vertical structure of these environments for fixed ranges of values of high CAPE and bulk shear, using data over the central Great Plains from two high-performing climate models. Temperature profiles warm relatively uniformly with height, with a slight decrease in free tropospheric lapse rate, and the tropopause shifts upwards at constant temperature. The boundary layer becomes slightly drier (-2--4\% relative humidity) while the free troposphere becomes slightly moister (+2--3\%). Moist static energy (MSE) increases relatively uniformly with height with slightly larger increase within the boundary layer. Moist static energy deficit increases slightly above 4 km altitude. Wind shear and storm-relative helicity increase within the lowest 1.5 km associated with stronger hodograph curvature. Changes are broadly consistent between the two models despite differing biases relative to ERA5. The increased low-level shear and SRH suggests an increased potential for severe thunderstorms and tornadoes, while the slight increase in free tropospheric MSE deficit (enhanced entrainment) and decrease in boundary layer relative humidity (higher LCL) may oppose these effects. Evaluation of the net response of severe convective storm outcomes cannot be ascertained here but could be explored in simulation experiments.


title: Intertwined fractional quantum anomalous Hall states and charge density waves

abstract: Motivated by the recent experimental breakthrough on the observation of the fractional quantum anomalous Hall (FQAH) effects in semiconductor and graphene moir\'{e} materials, we explore the rich physics associated with the coexistence of FQAH effect and the charge density wave (CDW) order that spontaneously breaks the translation symmetry. We refer to a state with both properties as "FQAH-crystal". We show that the interplay between FQAH effect and CDW can lead to a rich phase diagram including multiple topological phases and topological quantum phase transitions at the same moir\'e filling. In particular, we demonstrate the possibility of direct quantum phase transitions from a FQAH-crystal with Hall conductivity $\sigma_H = - 2/3$ to a trivial CDW insulator with $\sigma_H = 0$, and more interestingly, to a QAH-crystal with $\sigma_H= -1$.


title: Towards a Topological Classification of Nonadiabaticity in Chemical Reactions

abstract: The application of topology, a branch of mathematics, to the study of electronic states in crystalline materials has had a revolutionary impact on the field of condensed matter physics. For example, the development of topological band theory has delivered new approaches and tools to characterize the electronic structure of materials, resulting in the discovery of new phases of matter with exotic properties. In the framework of topological band theory, the crossings between energy levels of electrons are characterized by topological invariants, which predict the presence of topological boundary states. Given the frequency of energy level crossings on the potential energy surface in molecules, the applicability of these concepts to molecular systems could be of great interest for our understanding of reaction dynamics. However, challenges arise due to differing quantum mechanical descriptions of solids and molecules. Out work aims to bridge the gap between topological band theory and molecular chemistry. We propose that the Euler Class, a topological invariant, can be used to categorize and analyse the distribution of nonadiabatic couplings on the potential energy surface. To exemplify this connection, we introduce a model system with two distinct regimes that are characterized by different values of the Euler Class, yet identical potential energy surfaces. Contrary to expectations set by the Born-Oppenheimer approximation, we propose that these two regimes don't exhibit identical dynamics, due to a qualitatively distinct distribution of nonadiabatic couplings.


title: MAGNIFICo: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel Interpretations

abstract: Humans possess a remarkable ability to assign novel interpretations to linguistic expressions, enabling them to learn new words and understand community-specific connotations. However, Large Language Models (LLMs) have a knowledge cutoff and are costly to finetune repeatedly. Therefore, it is crucial for LLMs to learn novel interpretations in-context. In this paper, we systematically analyse the ability of LLMs to acquire novel interpretations using in-context learning. To facilitate our study, we introduce MAGNIFICo, an evaluation suite implemented within a text-to-SQL semantic parsing framework that incorporates diverse tokens and prompt settings to simulate real-world complexity. Experimental results on MAGNIFICo demonstrate that LLMs exhibit a surprisingly robust capacity for comprehending novel interpretations from natural language descriptions as well as from discussions within long conversations. Nevertheless, our findings also highlight the need for further improvements, particularly when interpreting unfamiliar words or when composing multiple novel interpretations simultaneously in the same example. Additionally, our analysis uncovers the semantic predispositions in LLMs and reveals the impact of recency bias for information presented in long contexts.


title: Break-up and Recovery of Harmony between Direct and Indirect Pathways in The Basal Ganglia; Huntington's Disease and Treatment

abstract: The basal ganglia (BG) in the brain exhibit diverse functions for motor, cognition, and emotion. Such BG functions could be made via competitive harmony between the two competing pathways, direct pathway (DP) (facilitating movement) and indirect pathway (IP) (suppressing movement). As a result of break-up of harmony between DP and IP, there appear pathological states with disorder for movement, cognition, and psychiatry. In this paper, we are concerned about the Huntington's disease (HD), which is a genetic neurodegenerative disorder causing involuntary movement and severe cognitive and psychiatric symptoms. For the HD, the number of D2 SPNs ($N_{\rm D2}$) is decreased due to degenerative loss, and hence, by decreasing $x_{\rm D2}$ (fraction of $N_{\rm D2}$), we investigate break-up of harmony between DP and IP in terms of their competition degree ${\cal C}_d$, given by the ratio of strength of DP (${\cal S}_{DP}$) to strength of IP (${\cal S}_{IP}$) (i.e., ${\cal C}_d = {\cal S}_{DP} / {\cal S}_{IP}$). In the case of HD, the IP is under-active, in contrast to the case of Parkinson's disease with over-active IP, which results in increase in ${\cal C}_d$ (from the normal value). Thus, hyperkinetic dyskinesia such as chorea (involuntary jerky movement) occurs. We also investigate treatment of HD, based on optogenetics and GP ablation, by increasing strength of IP, resulting in recovery of harmony between DP and IP. Finally, we study effect of loss of healthy synapses of all the BG cells on HD. Due to loss of healthy synapses, disharmony between DP and IP increases, leading to worsen symptoms of the HD.


title: A Uniform Language to Explain Decision Trees

abstract: The formal XAI community has studied a plethora of interpretability queries aiming to understand the classifications made by decision trees. However, a more uniform understanding of what questions we can hope to answer about these models, traditionally deemed to be easily interpretable, has remained elusive. In an initial attempt to understand uniform languages for interpretability, Arenas et al. (2021) proposed FOIL, a logic for explaining black-box ML models, and showed that it can express a variety of interpretability queries. However, we show that FOIL is limited in two important senses: (i) it is not expressive enough to capture some crucial queries, and (ii) its model agnostic nature results in a high computational complexity for decision trees. In this paper, we carefully craft two fragments of first-order logic that allow for efficiently interpreting decision trees: Q-DT-FOIL and its optimization variant OPT-DT-FOIL. We show that our proposed logics can express not only a variety of interpretability queries considered by previous literature, but also elegantly allows users to specify different objectives the sought explanations should optimize for. Using finite model-theoretic techniques, we show that the different ingredients of Q-DT-FOIL are necessary for its expressiveness, and yet that queries in Q-DT-FOIL can be evaluated with a polynomial number of queries to a SAT solver, as well as their optimization versions in OPT-DT-FOIL. Besides our theoretical results, we provide a SAT-based implementation of the evaluation for OPT-DT-FOIL that is performant on industry-size decision trees.


title: FixPix: Fixing Bad Pixels using Deep Learning

abstract: Efficient and effective on-line detection and correction of bad pixels can improve yield and increase the expected lifetime of image sensors. This paper presents a comprehensive Deep Learning (DL) based on-line detection-correction approach, suitable for a wide range of pixel corruption rates. A confidence calibrated segmentation approach is introduced, which achieves nearly perfect bad pixel detection, even with few training samples. A computationally light-weight correction algorithm is proposed for low rates of pixel corruption, that surpasses the accuracy of traditional interpolation-based techniques. We also propose an autoencoder based image reconstruction approach which alleviates the need for prior bad pixel detection and yields promising results for high rates of pixel corruption. Unlike previous methods, which use proprietary images, we demonstrate the efficacy of the proposed methods on the open-source Samsung S7 ISP and MIT-Adobe FiveK datasets. Our approaches yield up to 99.6% detection accuracy with <0.6% false positives and corrected images within 1.5% average pixel error from 70% corrupted images.


title: Systematic Assessment of Factual Knowledge in Large Language Models

abstract: Previous studies have relied on existing question-answering benchmarks to evaluate the knowledge stored in large language models (LLMs). However, this approach has limitations regarding factual knowledge coverage, as it mostly focuses on generic domains which may overlap with the pretraining data. This paper proposes a framework to systematically assess the factual knowledge of LLMs by leveraging knowledge graphs (KGs). Our framework automatically generates a set of questions and expected answers from the facts stored in a given KG, and then evaluates the accuracy of LLMs in answering these questions. We systematically evaluate the state-of-the-art LLMs with KGs in generic and specific domains. The experiment shows that ChatGPT is consistently the top performer across all domains. We also find that LLMs performance depends on the instruction finetuning, domain and question complexity and is prone to adversarial context.


title: CrossData: Leveraging Text-Data Connections for Authoring Data Documents

abstract: Data documents play a central role in recording, presenting, and disseminating data. Despite the proliferation of applications and systems designed to support the analysis, visualization, and communication of data, writing data documents remains a laborious process, requiring a constant back-and-forth between data processing and writing tools. Interviews with eight professionals revealed that their workflows contained numerous tedious, repetitive, and error-prone operations. The key issue that we identified is the lack of persistent connection between text and data. Thus, we developed CrossData, a prototype that treats text-data connections as persistent, interactive, first-class objects. By automatically identifying, establishing, and leveraging text-data connections, CrossData enables rich interactions to assist in the authoring of data documents. An expert evaluation with eight users demonstrated the usefulness of CrossData, showing that it not only reduced the manual effort in writing data documents but also opened new possibilities to bridge the gap between data exploration and writing.


title: Free-text Keystroke Authentication using Transformers: A Comparative Study of Architectures and Loss Functions

abstract: Keystroke biometrics is a promising approach for user identification and verification, leveraging the unique patterns in individuals' typing behavior. In this paper, we propose a Transformer-based network that employs self-attention to extract informative features from keystroke sequences, surpassing the performance of traditional Recurrent Neural Networks. We explore two distinct architectures, namely bi-encoder and cross-encoder, and compare their effectiveness in keystroke authentication. Furthermore, we investigate different loss functions, including triplet, batch-all triplet, and WDCL loss, along with various distance metrics such as Euclidean, Manhattan, and cosine distances. These experiments allow us to optimize the training process and enhance the performance of our model. To evaluate our proposed model, we employ the Aalto desktop keystroke dataset. The results demonstrate that the bi-encoder architecture with batch-all triplet loss and cosine distance achieves the best performance, yielding an exceptional Equal Error Rate of 0.0186%. Furthermore, alternative algorithms for calculating similarity scores are explored to enhance accuracy. Notably, the utilization of a one-class Support Vector Machine reduces the Equal Error Rate to an impressive 0.0163%. The outcomes of this study indicate that our model surpasses the previous state-of-the-art in free-text keystroke authentication. These findings contribute to advancing the field of keystroke authentication and offer practical implications for secure user verification systems.


title: Cloud-Magnetic Resonance Imaging System: In the Era of 6G and Artificial Intelligence

abstract: Magnetic Resonance Imaging (MRI) plays an important role in medical diagnosis, generating petabytes of image data annually in large hospitals. This voluminous data stream requires a significant amount of network bandwidth and extensive storage infrastructure. Additionally, local data processing demands substantial manpower and hardware investments. Data isolation across different healthcare institutions hinders cross-institutional collaboration in clinics and research. In this work, we anticipate an innovative MRI system and its four generations that integrate emerging distributed cloud computing, 6G bandwidth, edge computing, federated learning, and blockchain technology. This system is called Cloud-MRI, aiming at solving the problems of MRI data storage security, transmission speed, AI algorithm maintenance, hardware upgrading, and collaborative work. The workflow commences with the transformation of k-space raw data into the standardized Imaging Society for Magnetic Resonance in Medicine Raw Data (ISMRMRD) format. Then, the data are uploaded to the cloud or edge nodes for fast image reconstruction, neural network training, and automatic analysis. Then, the outcomes are seamlessly transmitted to clinics or research institutes for diagnosis and other services. The Cloud-MRI system will save the raw imaging data, reduce the risk of data loss, facilitate inter-institutional medical collaboration, and finally improve diagnostic accuracy and work efficiency.


title: Direct numerical simulation of Taylor-Couette flow with vertical asymmetric rough walls

abstract: Direct numerical simulations are performed to explore the effects of rotating direction of the vertical asymmetric rough wall on the transport properties of Taylor-Couette (TC) flow up to a Taylor number of $\textit{Ta} = 2.39 \times 10^7$. It is shown that compared to the smooth wall, the rough wall with vertical asymmetric strips can enhance the dimensionless torque \textit{Nu}$_\omega$, and more importantly, at high \textit{Ta} clockwise rotation of the inner rough wall (the fluid is sheared by the steeper slope side of the strips) results in a significantly bigger torque enhancement as compared to the counter-clockwise rotation (the fluid is sheared by the smaller slope side of the strips) due to the larger convective contribution to the angular velocity flux, although the rotating direction has a negligible effect on the torque at low \textit{Ta}. The larger torque enhancement caused by the clockwise rotation of vertical asymmetric rough wall at high \textit{Ta} is then explained by the stronger coupling between the rough wall and the bulk due to the larger biased azimuthal velocity towards the rough wall at the mid-gap of TC system, the increased intensity of turbulence manifesting by larger Reynolds stress and thinner boundary layer, and the more significant contribution of the pressure force on the surface of rough wall to the torque.


title: Opinion Change or Differential Turnout: Changing Opinions on the Austin Police Department in a Budget Feedback Process

abstract: In 2020 the tragic murder of George Floyd at the hands of law enforcement ignited and intensified nationwide protests, demanding changes in police funding and allocation. This happened during a budgeting feedback exercise where residents of Austin, Texas were invited to share opinions on the budgets of various city service areas, including the Police Department, on an online platform designed by our team. Daily responses increased by a hundredfold and responses registered after the "exogenous shock" overwhelmingly advocated for reducing police funding. This opinion shift far exceeded what we observed in 14 other Participatory Budgeting elections on our Participatory Budgeting Platform, and can't be explained by shifts in the respondent demographics. Analysis of the results from an Austin budgetary feedback exercise in 2021 and a follow-up survey indicates that the opinion shift from 2020 persisted, with the opinion gap on police funding widening. We conclude that there was an actual change of opinion regarding police funding. This study not only sheds light on the enduring impact of the 2020 events and protests on public opinion, but also showcases the value of analysis of clustered opinions as a tool in the evaluation toolkit of survey organizers.


title: Open Information Extraction: A Review of Baseline Techniques, Approaches, and Applications

abstract: With the abundant amount of available online and offline text data, there arises a crucial need to extract the relation between phrases and summarize the main content of each document in a few words. For this purpose, there have been many studies recently in Open Information Extraction (OIE). OIE improves upon relation extraction techniques by analyzing relations across different domains and avoids requiring hand-labeling pre-specified relations in sentences. This paper surveys recent approaches of OIE and its applications on Knowledge Graph (KG), text summarization, and Question Answering (QA). Moreover, the paper describes OIE basis methods in relation extraction. It briefly discusses the main approaches and the pros and cons of each method. Finally, it gives an overview about challenges, open issues, and future work opportunities for OIE, relation extraction, and OIE applications.


title: Towards Abdominal 3-D Scene Rendering from Laparoscopy Surgical Videos using NeRFs

abstract: Given that a conventional laparoscope only provides a two-dimensional (2-D) view, the detection and diagnosis of medical ailments can be challenging. To overcome the visual constraints associated with laparoscopy, the use of laparoscopic images and videos to reconstruct the three-dimensional (3-D) anatomical structure of the abdomen has proven to be a promising approach. Neural Radiance Fields (NeRFs) have recently gained attention thanks to their ability to generate photorealistic images from a 3-D static scene, thus facilitating a more comprehensive exploration of the abdomen through the synthesis of new views. This distinguishes NeRFs from alternative methods such as Simultaneous Localization and Mapping (SLAM) and depth estimation. In this paper, we present a comprehensive examination of NeRFs in the context of laparoscopy surgical videos, with the goal of rendering abdominal scenes in 3-D. Although our experimental results are promising, the proposed approach encounters substantial challenges, which require further exploration in future research.


title: Spectral evidence for Dirac spinons in a kagome lattice antiferromagnet

abstract: Emergent quasiparticles with a Dirac dispersion in condensed matter systems can be described by the Dirac equation for relativistic electrons, in analogy with Dirac particles in high-energy physics. For example, electrons with a Dirac dispersion have been intensively studied in electronic systems such as graphene and topological insulators. However, charge is not a prerequisite for Dirac fermions, and the emergence of Dirac fermions without charge degree of freedom has been theoretically predicted to be realized in Dirac quantum spin liquids. These quasiparticles carry a spin of 1/2 but are charge-neutral, and so are called spinons. Here we show that the spin excitations of a kagome antiferromagnet, YCu$_3$(OD)$_6$Br$_2$[Br$_{0.33}$(OD)$_{0.67}$], are conical with a spin continuum inside, which is consistent with the convolution of two Dirac spinons. The predictions of a Dirac spin liquid model with a spinon velocity obtained from the spectral measurements are in agreement with the low-temperature specific heat of the sample. Our results thus provide spectral evidence for the Dirac quantum spin liquid state emerging in this kagome lattice antiferromagnet. However, the locations of the conical spin excitations differ from those calculated by the nearest neighbor Heisenberg model, suggesting the Dirac spinons have an unexpected origin.


title: Jointly stationary solutions of periodic Burgers flow

abstract: For the one dimensional Burgers equation with a random and periodic forcing, it is well-known that there exits a family of invariant measures, each corresponding to a different average velocity. In this paper, we consider the coupled invariant measures and study how they change as the velocity parameter varies. We show that the derivative of the invariant measure with respect to the velocity parameter exists, and it can be interpreted as the steady state of a diffusion advected by the Burgers flow.


title: Zero-shot Faithfulness Evaluation for Text Summarization with Foundation Language Model

abstract: Despite tremendous improvements in natural language generation, summarization models still suffer from the unfaithfulness issue. Previous work evaluates faithfulness either using models trained on the other tasks or in-domain synthetic data, or prompting a large model such as ChatGPT. This paper proposes to do zero-shot faithfulness evaluation simply with a moderately-sized foundation language model. We introduce a new metric FFLM, which is a combination of probability changes based on the intuition that prefixing a piece of text that is consistent with the output will increase the probability of predicting the output. Experiments show that FFLM performs competitively with or even outperforms ChatGPT on both inconsistency detection and faithfulness rating with 24x fewer parameters. FFLM also achieves improvements over other strong baselines.


title: Three-loop matching of heavy flavor-changing (axial-)tensor currents

abstract: We present the three-loop calculations of the nonrelativistic QCD (NRQCD) current renormalization constants and corresponding anomalous dimensions, and the matching coefficients for the spatial-temporal tensor and spatial-spatial axial-tensor currents with two different heavy quark masses. We obtain the convergent decay constant ratio up to the next-to-next-to-next-to-leading order (N$^3$LO) for the $S$-wave vector meson $B_c^*$ involving the tensor and axial-tensor currents. We obtain the three-loop finite ($\epsilon^0$) term in the ratio of the QCD heavy flavor-changing tensor current renormalization constant in the on-shell ($\mathrm{OS}$) scheme to that in the modified-minimal-subtraction ($\mathrm{\overline{MS}}$) scheme, which is helpful to obtain the three-loop matching coefficients for all heavy flavor-changing (axial-)tensor currents.


title: VKIE: The Application of Key Information Extraction on Video Text

abstract: Extracting structured information from videos is critical for numerous downstream applications in the industry. In this paper, we define a significant task of extracting hierarchical key information from visual texts on videos. To fulfill this task, we decouple it into four subtasks and introduce two implementation solutions called PipVKIE and UniVKIE. PipVKIE sequentially completes the four subtasks in continuous stages, while UniVKIE is improved by unifying all the subtasks into one backbone. Both PipVKIE and UniVKIE leverage multimodal information from vision, text, and coordinates for feature representation. Extensive experiments on one well-defined dataset demonstrate that our solutions can achieve remarkable performance and efficient inference speed.


title: US Microelectronics Packaging Ecosystem: Challenges and Opportunities

abstract: The semiconductor industry is experiencing a significant shift from traditional methods of shrinking devices and reducing costs. Chip designers actively seek new technological solutions to enhance cost-effectiveness while incorporating more features into the silicon footprint. One promising approach is Heterogeneous Integration (HI), which involves advanced packaging techniques to integrate independently designed and manufactured components using the most suitable process technology. However, adopting HI introduces design and security challenges. To enable HI, research and development of advanced packaging is crucial. The existing research raises the possible security threats in the advanced packaging supply chain, as most of the Outsourced Semiconductor Assembly and Test (OSAT) facilities/vendors are offshore. To deal with the increasing demand for semiconductors and to ensure a secure semiconductor supply chain, there are sizable efforts from the United States (US) government to bring semiconductor fabrication facilities onshore. However, the US-based advanced packaging capabilities must also be ramped up to fully realize the vision of establishing a secure, efficient, resilient semiconductor supply chain. Our effort was motivated to identify the possible bottlenecks and weak links in the advanced packaging supply chain based in the US.


title: (1,p)-Sobolev spaces based on strongly local Dirichlet forms

abstract: In the framework of quasi-regular strongly local Dirichlet form $(\mathscr{E},D(\mathscr{E}))$ on $L^2(X;\mathfrak{m})$ admitting minimal $\mathscr{E}$-dominant measure $\mu$, we construct a natural $p$-energy functional $(\mathscr{E}^{\,p},D(\mathscr{E}^{\,p}))$ on $L^p(X;\mathfrak{m})$ and $(1,p)$-Sobolev space $(H^{1,p}(X),\|\cdot\|_{H^{1,p}})$ for $p\in]1,+\infty[$. In this paper, we establish the Clarkson type inequality for $(H^{1,p}(X),\|\cdot\|_{H^{1,p}})$. As a consequence, $(H^{1,p}(X),\|\cdot\|_{H^{1,p}})$ is a uniformly convex Banach space, hence it is reflexive. Based on the reflexivity of $(H^{1,p}(X),\|\cdot\|_{H^{1,p}})$, we prove that (generalized) normal contraction operates on $(\mathscr{E}^{\,p},D(\mathscr{E}^{\,p}))$, which has been shown in the case of various concrete settings, but has not been proved for such general framework. Moreover, we prove that $(1,p)$-capacity ${\rm Cap}_{1,p}(A)<\infty$ for open set $A$ admits an equilibrium potential $e_A\in D(\mathscr{E}^{\,p})$ with $0\leq e_A\leq 1$ $\mathfrak{m}$-a.e. and $e_A=1$ $\mathfrak{m})$-a.e.~on $A$.


title: Quantum work: Reconciling quantum mechanics and thermodynamics

abstract: It has been recently claimed that no protocol for measuring quantum work can satisfy standard required physical principles, casting doubts on the compatibility between quantum mechanics, thermodynamics, and the classical limit. In this Letter, we present a solution for this incompatibility. We demonstrate that the standard formulation of these principles fails to address the classical limit properly. By proposing changes in this direction, we prove that all the essential principles can be satisfied when work is defined as a quantum observable, reconciling quantum work statistics and thermodynamics.


title: Subject-specific Deep Neural Networks for Count Data with High-cardinality Categorical Features

abstract: There is a growing interest in subject-specific predictions using deep neural networks (DNNs) because real-world data often exhibit correlations, which has been typically overlooked in traditional DNN frameworks. In this paper, we propose a novel hierarchical likelihood learning framework for introducing gamma random effects into the Poisson DNN, so as to improve the prediction performance by capturing both nonlinear effects of input variables and subject-specific cluster effects. The proposed method simultaneously yields maximum likelihood estimators for fixed parameters and best unbiased predictors for random effects by optimizing a single objective function. This approach enables a fast end-to-end algorithm for handling clustered count data, which often involve high-cardinality categorical features. Furthermore, state-of-the-art network architectures can be easily implemented into the proposed h-likelihood framework. As an example, we introduce multi-head attention layer and a sparsemax function, which allows feature selection in high-dimensional settings. To enhance practical performance and learning efficiency, we present an adjustment procedure for prediction of random parameters and a method-of-moments estimator for pretraining of variance component. Various experiential studies and real data analyses confirm the advantages of our proposed methods.


title: Field-testing items using artificial intelligence: Natural language processing with transformers

abstract: Five thousand variations of the RoBERTa model, an artificially intelligent "transformer" that can understand text language, completed an English literacy exam with 29 multiple-choice questions. Data were used to calculate the psychometric properties of the items, which showed some degree of agreement to those obtained from human examinee data.